https://github.com/mihirkudale/twitter-data-pipeline-using-airflow
This is End-To-End Data Engineering Project using Airflow and Python. In this project, we will extract data using Twitter API, use python to transform data, deploy the code on Airflow/EC2 and save the final result on Amazon S3
https://github.com/mihirkudale/twitter-data-pipeline-using-airflow
amazon-ec2 amazon-s3 apache-airflow aws data-engineering datapipeline python twitter twitterapi
Last synced: about 2 months ago
JSON representation
This is End-To-End Data Engineering Project using Airflow and Python. In this project, we will extract data using Twitter API, use python to transform data, deploy the code on Airflow/EC2 and save the final result on Amazon S3
- Host: GitHub
- URL: https://github.com/mihirkudale/twitter-data-pipeline-using-airflow
- Owner: mihirkudale
- Created: 2024-05-11T16:16:13.000Z (about 2 years ago)
- Default Branch: main
- Last Pushed: 2024-05-11T16:28:21.000Z (about 2 years ago)
- Last Synced: 2025-01-25T18:11:18.070Z (over 1 year ago)
- Topics: amazon-ec2, amazon-s3, apache-airflow, aws, data-engineering, datapipeline, python, twitter, twitterapi
- Language: Python
- Homepage:
- Size: 5.86 KB
- Stars: 0
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# Twitter-Data-Pipeline-using-Airflow-Data-Engineering-Project
This is End-To-End Data Engineering Project using Airflow and Python. In this project, we will extract data using Twitter API, use python to transform data, deploy the code on Airflow/EC2 and save the final result on Amazon S3