https://github.com/arjunan-k/twitter_pipeline
Tweets extractor using Twitter API by Tweepy library. Created the workflow in Apache Airflow with the help of AWS EC2 & S3 bucket.
https://github.com/arjunan-k/twitter_pipeline
airflow-dags apache-airflow aws
Last synced: 8 months ago
JSON representation
Tweets extractor using Twitter API by Tweepy library. Created the workflow in Apache Airflow with the help of AWS EC2 & S3 bucket.
- Host: GitHub
- URL: https://github.com/arjunan-k/twitter_pipeline
- Owner: arjunan-k
- Created: 2022-10-14T04:03:45.000Z (almost 3 years ago)
- Default Branch: main
- Last Pushed: 2022-12-22T19:20:30.000Z (almost 3 years ago)
- Last Synced: 2025-01-09T11:09:13.055Z (9 months ago)
- Topics: airflow-dags, apache-airflow, aws
- Language: Python
- Homepage:
- Size: 865 KB
- Stars: 0
- Watchers: 2
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
#
Twitter Airflow Data Pipeline
Built a tweets extractor using Twitter API by Tweepy library. Created the workflow in Apache Airflow with the help of AWS EC2 and stored the results in the AWS S3 bucket. Following is the simple demo of our pipeline.
#### For complete [presentation](https://github.com/arjunan-k/Twitter_Pipeline/blob/main/Images/Presentation.pdf) click below.
[](https://github.com/arjunan-k/Twitter_Pipeline/blob/main/Images/Presentation.pdf)