https://github.com/lynnlangit/aws-redshift-matillion-workshop

Scripts, Instructions and Materials for AWS Redshift and Matillion ETL workshop
https://github.com/lynnlangit/aws-redshift-matillion-workshop

Last synced: 7 months ago
JSON representation

Scripts, Instructions and Materials for AWS Redshift and Matillion ETL workshop

• Host: GitHub
• URL: https://github.com/lynnlangit/aws-redshift-matillion-workshop
• Owner: lynnlangit
• License: apache-2.0
• Created: 2015-10-11T23:50:20.000Z (almost 10 years ago)
• Default Branch: master
• Last Pushed: 2016-02-03T22:10:02.000Z (over 9 years ago)
• Last Synced: 2023-08-08T05:13:32.828Z (about 2 years ago)
• Language: Shell
• Size: 6.17 MB
• Stars: 7
• Watchers: 5
• Forks: 6
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

          
# AWS-Redshift-Matillion-Workshop

Scripts, Instructions and Materials for AWS Redshift and Matillion ETL workshop

![Redshift Workshop Diagram](/Redshift-Workshop.png)

This Repo details instructions on how to use these artifacts can be found on my blog post about the AWS re:Invent 2015 

'Build a Data Warehouse in 2 hours using AWS Redshift and AWS Marketplace Big Data Partners'. NOTE: We modified (reduced size and complexity) from the original Matillion instructions, so you will have to carefully read the blog post and modify based on the amount and complexity of source data you wish to load and analyze.

What's here

- AWS Cli install script - 'BuildRedshiftMatillionWorkshop.sh'

- Two Matillion ETL for Redshift jobs - 'Data Load.json' & 'Data Transform.json'

- Tableau workbook for this scenario - 'Redshift Flights.twb'

Here's a simple diagram of the solution architecture, note that we've included use of AWS VPC and AWS IAM User as best practices:

![Redshift Workshop Architecture](/reInvent-Workshop-Architecture.png)

Here's the result - visualized as a Tableau Dashboard

![Redshift Workshop Visualization](/Tableau-Dashboard-Complete.png)