https://github.com/ismahenelarbi/data_engineering_beginner
Creating a data pipeline to extract data from spotify and save the songs listened to everyday into a local sqlite db.
https://github.com/ismahenelarbi/data_engineering_beginner
airflow airflow-dags api data-engineering etl json pipeline python spotify-api spotify-playlist sqlalchemy-python sqlite3
Last synced: 7 months ago
JSON representation
Creating a data pipeline to extract data from spotify and save the songs listened to everyday into a local sqlite db.
- Host: GitHub
- URL: https://github.com/ismahenelarbi/data_engineering_beginner
- Owner: IsmaheneLarbi
- Created: 2022-01-14T16:09:46.000Z (over 3 years ago)
- Default Branch: main
- Last Pushed: 2023-01-19T16:38:33.000Z (over 2 years ago)
- Last Synced: 2025-01-16T03:14:48.439Z (9 months ago)
- Topics: airflow, airflow-dags, api, data-engineering, etl, json, pipeline, python, spotify-api, spotify-playlist, sqlalchemy-python, sqlite3
- Language: Python
- Homepage:
- Size: 8.79 KB
- Stars: 1
- Watchers: 2
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# data_engineering_beginner
Creating a data pipeline to extract **data** unsing the **spotify api** and save the songs listened to everyday into a local **sqlite db**. Then used airflow to automate the process.
I achieved this project by following Karolina's [data engineering for beginners' course.](https://github.com/karolina-sowinska/free-data-engineering-course-for-beginners) I highly recommend you check her [Youtube channel.](https://www.youtube.com/channel/UCAxnMry1lETl47xQWABvH7g)