https://github.com/souvik150/spotify-data-pipeline

https://github.com/souvik150/spotify-data-pipeline

Last synced: 2 days ago
JSON representation

• Host: GitHub
• URL: https://github.com/souvik150/spotify-data-pipeline
• Owner: souvik150
• Created: 2024-09-10T07:22:04.000Z (2 months ago)
• Default Branch: main
• Last Pushed: 2024-09-10T07:30:59.000Z (2 months ago)
• Last Synced: 2024-09-10T09:49:22.296Z (2 months ago)
• Language: Python
• Size: 1.42 MB
• Stars: 0
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
# Spotify Data Pipeline

* Developed a data pipeline using AWS Lambda, S3, Glue Crawler, and Athena for real-time Spotify data ingestion,

transformation, and querying.

* Replaced AWS Lambda with AWS Glue ETL and Apache Spark for more efficient transformations and orchestrated the

entire pipeline with Apache Airflow for automation.