https://github.com/e-espootin/etl-data-onprem-azure
Azure Data Factory
https://github.com/e-espootin/etl-data-onprem-azure
adf azure-data-factory azuresql terraform
Last synced: 12 months ago
JSON representation
Azure Data Factory
- Host: GitHub
- URL: https://github.com/e-espootin/etl-data-onprem-azure
- Owner: e-espootin
- Created: 2024-08-29T16:01:13.000Z (almost 2 years ago)
- Default Branch: main
- Last Pushed: 2024-10-01T06:39:38.000Z (over 1 year ago)
- Last Synced: 2025-03-28T18:52:09.279Z (about 1 year ago)
- Topics: adf, azure-data-factory, azuresql, terraform
- Language: HCL
- Homepage:
- Size: 25.4 KB
- Stars: 0
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
## devlope and learn terraform with azure
#part 1
- [x] 1. create a Azure storage with terraform
- [x] 1.1 create container
- [x] 1.2 set secrets with terraform tfvars , alternative: read from key vault
- [ ] 2. SQL Server with terraform
- [x] 2.1 create a SQL Server
- [x] 2.2 set firewall and allowed service acount
- [x] 2.3 create a database
- [ ] 2.3 create tables
- [x] 3. Azure Data Factory with terraform
- [x] 3.1 create a linked service
- [x] 3.2 create a dataset
- [x] 3.3 create pipeline from template
- [x] 4. set terraform modular
- [x] 5. seperate dev and prod environment
## description
prepare infra for etl data from onprem to azure with terraform and Azure Data Factory
#part 2 airflow & mssql server
link: https://github.com/espootin2/p032-etl-data-airflow