https://github.com/pietheinstrengholt/synapse-lab
https://github.com/pietheinstrengholt/synapse-lab
Last synced: 7 months ago
JSON representation
- Host: GitHub
- URL: https://github.com/pietheinstrengholt/synapse-lab
- Owner: pietheinstrengholt
- Created: 2022-02-04T14:12:33.000Z (over 3 years ago)
- Default Branch: main
- Last Pushed: 2022-02-20T11:33:34.000Z (over 3 years ago)
- Last Synced: 2024-12-14T11:13:15.483Z (10 months ago)
- Language: Python
- Size: 24.6 MB
- Stars: 1
- Watchers: 2
- Forks: 3
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# Azure Synapse Workshop Lab
## What is Azure Synapse?
Azure Synapse Analytics is a limitless analytics service that brings together data integration, enterprise data warehousing, and big data analytics. It gives you the freedom to query data on your terms, using either serverless or dedicated resources—at scale. Azure Synapse brings these worlds together with a unified experience to ingest, explore, prepare, transform, manage, and serve data for immediate BI and machine learning needs.
## Hands-on lab
In this hands-on lab, you will look at the process of creating an end-to-end solution using Azure Synapse Analytics. The lab learning modules will cover various aspects of data management and data engineering, such as data extraction, data transformation, and data loading, along with performing data governance. At the end of this lab, you will be better able to design and build a complete end-to-end advanced analytics solution using Azure Synapse Analytics.
## :thinking: Prerequisites
* An [Azure account](https://azure.microsoft.com/en-us/free/) with an active subscription. Note: If you don't have access to an Azure subscription, you may be able to start with a [free account](https://www.azure.com/free).
* You must have the necessary privileges within your Azure subscription to create resources, perform role assignments, register resource providers (if required), etc.
## :books: Learning Modules
1. [Create an Azure Synapse Workspace](./module01/module01.md)
2. [Deploy Azure SQL using AdventureWorks Sample database](./module02/module02.md)
3. [Setup Data Lake, Ingest data to Bronze layer (Parquet)](./module03/module03.md)
4. [Create Spark Script, Process to Silver layer (Delta)](./module04/module04.md)
5. [Transforming data using Data Flows](./module05/module05.md)
6. [Create Stored Procedures, Process to Gold layer (External table)](./module06/module06.md)
7. [Create and use a Dedicated SQL Pool](./module07/module07.md)
8. [Analyze data using Azure Synapse Data Explorer](./module08/module08.md)
9. [Data governance with Azure Purview](./module09/module09.md)
10. [Implement version control using Git](./module10/module10.md)