{"id":18005682,"url":"https://github.com/areed1192/azure-sql-data-project","last_synced_at":"2025-10-05T18:20:44.001Z","repository":{"id":108436678,"uuid":"287393397","full_name":"areed1192/azure-sql-data-project","owner":"areed1192","description":"A python application that is used to create instances of SQL Server instances on Microsoft Azure, and insert data into those databases.","archived":false,"fork":false,"pushed_at":"2024-06-11T20:32:37.000Z","size":3778,"stargazers_count":39,"open_issues_count":2,"forks_count":22,"subscribers_count":3,"default_branch":"master","last_synced_at":"2025-07-13T06:42:04.530Z","etag":null,"topics":["azure","azure-sql","azure-sql-database","azure-sql-management","python"],"latest_commit_sha":null,"homepage":"","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/areed1192.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":".github/FUNDING.yml","license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null},"funding":{"github":["areed1192"],"patreon":"sigmacoding","custom":null}},"created_at":"2020-08-13T22:41:14.000Z","updated_at":"2024-11-10T13:50:40.000Z","dependencies_parsed_at":"2025-05-02T22:41:13.006Z","dependency_job_id":null,"html_url":"https://github.com/areed1192/azure-sql-data-project","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":"areed1192/sigma-template","purl":"pkg:github/areed1192/azure-sql-data-project","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/areed1192%2Fazure-sql-data-project","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/areed1192%2Fazure-sql-data-project/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/areed1192%2Fazure-sql-data-project/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/areed1192%2Fazure-sql-data-project/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/areed1192","download_url":"https://codeload.github.com/areed1192/azure-sql-data-project/tar.gz/refs/heads/master","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/areed1192%2Fazure-sql-data-project/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":275931310,"owners_count":25555118,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","status":"online","status_checked_at":"2025-09-19T02:00:09.700Z","response_time":108,"last_error":null,"robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":true,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["azure","azure-sql","azure-sql-database","azure-sql-management","python"],"created_at":"2024-10-30T00:21:07.219Z","updated_at":"2025-09-19T11:42:37.422Z","avatar_url":"https://github.com/areed1192.png","language":"Python","readme":"# Azure SQL Database Pipeline Project\n\n## Table of Contents\n\n- [Overview](#overview)\n- [Resources](#resources)\n- [Setup](#setup)\n- [Usage](#usage)\n- [Support These Projects](#support-these-projects)\n\n## Overview\n\nMicrosoft Azure provides a wide number of services for managing and storing data. One\nproduct is Microsoft Azure SQL. Which gives us the capability to create and manage\ninstances of SQL Servers hosted in the cloud. This project, demonstrates how to use these\nservices to manage data we collect from different sources.\n\n## Resources\n\nTo use this project you will need to install some dependencies to connect to the database.\nTo download the drivers needed go to to [Microsoft SQL Drivers for Python](https://docs.microsoft.com/en-us/sql/connect/sql-connection-libraries?view=sql-server-ver15#anchor-20-drivers-relational-access). Once you download it, run through\nthe installation process.\n\n**Resources - PYODBC with Azure:**\n\nIf you would like to read more on the topic of using PYODBC in conjunction with Microsoft\nAzure, then I would refer you to the [documentation provided by Microsoft](https://docs.microsoft.com/en-us/sql/connect/python/pyodbc/step-3-proof-of-concept-connecting-to-sql-using-pyodbc?view=sql-server-ver15).\n\n## Setup\n\nRight now, this project is not planned to be hosted on **PyPi** so you will need to do\na local install on your system if you plan to use it in other scrips you use. First,\nclone this repo to your local system.\n\n**Setup - Local Install:**\n\nIf you plan to use this project in other projects on your system, I would recommend you\neither install this project in `editable` mode or do a `local install`. For those of you,\nwho want to make modifications to this project. I would recommend you install the library\nin `editable` mode.\n\nIf you want to install the library in `editable` mode, make sure to run the `setup.py`\nfile, so you can install any dependencies you may need. To run the `setup.py` file,\nrun the following command in your terminal.\n\n```console\npip install -e .\n```\n\nIf you don't plan to make any modifications to the project but still want to use it across\nyour different projects, then do a local install.\n\n```console\npip install .\n```\n\nThis will install all the dependencies listed in the `setup.py` file. Once done\nyou can use the library wherever you want.\n\n**Setup - Requirement Install:**\n\nIf you don't plan to use this project in any of your other projects, I would recommend you\njust install the dependencies by using the `requirement.txt` file.\n\n```console\npip install --requirement requirements.txt\n```\n\n## Usage\n\nHere is a simple example of using the `azure_sql_pipeline` library to grab a specific\ndatabase from our SQL Server.\n\n```python\nfrom pprint import pprint\nfrom configparser import ConfigParser\nfrom azure_data_pipeline.client import AzureSQLClient\n\n# Initialize the Parser.\nconfig = ConfigParser()\n\n# Read the file.\nconfig.read('config/config.ini')\n\n# Grab the Azure Management Credentials.\nsubscription_id = config.get('azure_credentials', 'azure_subscription_id')\ntenant_id = config.get('azure_credentials', 'azure_tenant_id')\nclient_id = config.get('azure_credentials', 'azure_client_id')\nclient_secret = config.get('azure_credentials', 'azure_client_secret')\n\n# Grab the Azure SQL Server Credentials.\nserver_username = config.get('server_info', 'administrator_login')\nserver_password = config.get('server_info', 'administrator_login_password')\n\n# Initialize the client.\nazure_pipeline_client = AzureSQLClient(\n    client_id=client_id,\n    client_secret=client_secret,\n    subscription_id=subscription_id,\n    tenant_id=tenant_id,\n    username=server_username,\n    password=server_password\n)\n```\n\n## Support These Projects\n\n**Patreon:**\nHelp support this project and future projects by donating to my [Patreon Page](https://www.patreon.com/sigmacoding)\n. I'm always looking to add more content for individuals like yourself, unfortuantely some of the\nAPIs I would require me to pay monthly fees.\n\n**YouTube:**\nIf you'd like to watch more of my content, feel free to visit my YouTube channel [Sigma Coding](https://www.youtube.com/c/SigmaCoding).\n","funding_links":["https://github.com/sponsors/areed1192","https://patreon.com/sigmacoding","https://www.patreon.com/sigmacoding"],"categories":[],"sub_categories":[],"project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fareed1192%2Fazure-sql-data-project","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fareed1192%2Fazure-sql-data-project","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fareed1192%2Fazure-sql-data-project/lists"}