https://github.com/msmia76/azure-arm-lakehouse-demo
End-to-end Azure Lakehouse + Operational Analytics demo with IaC (Bicep/ARM), secure data landing (ADLS, Fabric, Synapse), and can’t-mess-it-up automation (Cosmos upserts + DevOps). Scales with skills, satisfies auditors, and proves automation can be boringly reliable (that’s the point). Runs cleanly every time ... even under interview pressure.
https://github.com/msmia76/azure-arm-lakehouse-demo
adls arm automation azure bicep cosmosdb data-engineering demo fabric iac powerbi security synapse
Last synced: about 1 month ago
JSON representation
End-to-end Azure Lakehouse + Operational Analytics demo with IaC (Bicep/ARM), secure data landing (ADLS, Fabric, Synapse), and can’t-mess-it-up automation (Cosmos upserts + DevOps). Scales with skills, satisfies auditors, and proves automation can be boringly reliable (that’s the point). Runs cleanly every time ... even under interview pressure.
- Host: GitHub
- URL: https://github.com/msmia76/azure-arm-lakehouse-demo
- Owner: msmia76
- Created: 2025-09-08T03:59:13.000Z (about 1 month ago)
- Default Branch: main
- Last Pushed: 2025-09-08T06:04:14.000Z (about 1 month ago)
- Last Synced: 2025-09-08T06:13:19.709Z (about 1 month ago)
- Topics: adls, arm, automation, azure, bicep, cosmosdb, data-engineering, demo, fabric, iac, powerbi, security, synapse
- Language: Bicep
- Homepage:
- Size: 7.81 KB
- Stars: 1
- Watchers: 0
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# Secure Lakehouse + Operational Analytics (Demo)
This repo shows a **shadowIT-can’t-mess-it-up** demo:
- One-command **IaC stamp** (Bicep) for ADLS Gen2 + Cosmos DB.
- A tiny ADF pipeline that **upserts incrementally** from the lake into Cosmos (idempotent).
## Files
- `main.bicep` — deploys ADLS, Key Vault, Cosmos (autoscale) for demo.
- `pipelines/pipeline.json` — ADF copy with watermark + upsert.
- `data/customers.csv` — sample input with `UpdatedAt` watermark.
- `.github/workflows/deploy.yml` — manual CI stub (safe to leave as is).
## Manual deploy (if you try it)
```bash
az group create -n rg-demo-lakehouse -l eastus
az deployment group create -g rg-demo-lakehouse -f main.bicep -p baseName=demo