Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/shaneochotny/Azure-Synapse-Analytics-PoC
Template to deploy Synapse Analytics using best practices to deliver a proof of concept.
https://github.com/shaneochotny/Azure-Synapse-Analytics-PoC
Last synced: 3 months ago
JSON representation
Template to deploy Synapse Analytics using best practices to deliver a proof of concept.
- Host: GitHub
- URL: https://github.com/shaneochotny/Azure-Synapse-Analytics-PoC
- Owner: shaneochotny
- Created: 2021-08-05T20:40:26.000Z (over 3 years ago)
- Default Branch: main
- Last Pushed: 2023-03-03T21:10:08.000Z (almost 2 years ago)
- Last Synced: 2024-06-05T07:32:27.510Z (8 months ago)
- Language: Bicep
- Homepage:
- Size: 14.5 MB
- Stars: 21
- Watchers: 4
- Forks: 33
- Open Issues: 4
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
- awesome-synapse - shaneochotny/Azure-Synapse-Analytics-PoC - Synapse Bicep and Terraform templates. (Repositories / Deployment Templates)
README
# Azure Synapse Analytics PoC Accelerator
# Description
Create a Synapse Analytics environment based on best practices to achieve a successful proof of concept. While settings can be adjusted,
the major deployment differences are based on whether or not you used Private Endpoints for connectivity. If you do not already use
Private Endpoints for other Azure deployments, it's discouraged to use them for a proof of concept as they have many other networking
depandancies than what can be configured here.
# How to Run
### "Easy Button" Deployment
The following commands should be executed from the Azure Cloud Shell at https://shell.azure.com using bash:
```
@Azure:~$ git clone https://github.com/shaneochotny/Azure-Synapse-Analytics-PoC
@Azure:~$ cd Azure-Synapse-Analytics-PoC
@Azure:~$ bash deploySynapse.sh
```
### Advanced Deployment: Bicep
You can manually configure the Bicep parameters and update default settings such as the Azure region, database name, credentials, and private endpoint integration. The following commands should be executed from the Azure Cloud Shell at https://shell.azure.com using bash:
```
@Azure:~$ git clone https://github.com/shaneochotny/Azure-Synapse-Analytics-PoC
@Azure:~$ cd Azure-Synapse-Analytics-PoC
@Azure:~$ code Bicep/main.parameters.json
@Azure:~$ az deployment sub create --template-file Bicep/main.bicep --parameters Bicep/main.parameters.json --name Azure-Synapse-Analytics-PoC --location eastus
@Azure:~$ bash deploySynapse.sh
```
### Advanced Deployment: Terraform
You can manually configure the Terraform parameters and update default settings such as the Azure region, database name, credentials, and private endpoint integration. The following commands should be executed from the Azure Cloud Shell at https://shell.azure.com using bash:
```
@Azure:~$ git clone https://github.com/shaneochotny/Azure-Synapse-Analytics-PoC
@Azure:~$ cd Azure-Synapse-Analytics-PoC
@Azure:~$ code Terraform/terraform.tfvars
@Azure:~$ terraform -chdir=Terraform init
@Azure:~$ terraform -chdir=Terraform plan
@Azure:~$ terraform -chdir=Terraform apply
@Azure:~$ bash deploySynapse.sh
```
# What's Deployed
### Azure Synapse Analytics Workspace
- DW1000 Dedicated SQL Pool
### Azure Data Lake Storage Gen2
- config container for Azure Synapse Analytics Workspace
- data container for queried/ingested data
### Azure Log Analytics
- Logging and telemetry for Azure Synapse Analytics
- Logging and telemetry for Azure Data Lake Storage Gen2
# What's Configured
- Enable Result Set Caching
- Create a pipeline to auto pause/resume the Dedicated SQL Pool
- Feature flag to enable/disable Private Endpoints
- Serverless SQL Demo Data Database
- Proper service and user permissions for Azure Synapse Analytics Workspace and Azure Data Lake Storage Gen2
- Parquet Auto Ingestion pipeline to optimize data ingestion using best practices
# To Do
- Example script for configuring Row Level Security
- Example script for configuring Dynamic Data Masking