An open API service indexing awesome lists of open source software.

https://github.com/arjunan-k/twitter_pipeline

Tweets extractor using Twitter API by Tweepy library. Created the workflow in Apache Airflow with the help of AWS EC2 & S3 bucket.
https://github.com/arjunan-k/twitter_pipeline

airflow-dags apache-airflow aws

Last synced: 8 months ago
JSON representation

Tweets extractor using Twitter API by Tweepy library. Created the workflow in Apache Airflow with the help of AWS EC2 & S3 bucket.

Awesome Lists containing this project

README

          

#

Twitter Airflow Data Pipeline


Built a tweets extractor using Twitter API by Tweepy library. Created the workflow in Apache Airflow with the help of AWS EC2 and stored the results in the AWS S3 bucket. Following is the simple demo of our pipeline.
#### For complete [presentation](https://github.com/arjunan-k/Twitter_Pipeline/blob/main/Images/Presentation.pdf) click below.
[![pic](https://github.com/arjunan-k/Twitter_Pipeline/blob/main/Images/Pipeline.jpg?raw=true)](https://github.com/arjunan-k/Twitter_Pipeline/blob/main/Images/Presentation.pdf)