Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/kishlayjeet/twitter-data-pipeline-using-airflow-and-aws-s3
An end-to-end Twitter Data Pipeline that extracts data from Twitter and loads it into AWS S3.
https://github.com/kishlayjeet/twitter-data-pipeline-using-airflow-and-aws-s3
airflow airflow-dags apache-airflow boto3 data-engineering data-engineering-pipeline data-pipeline etl etl-job etl-pipeline python s3 scheduler tweepy twitter twitter-api twitter-data-pipeline
Last synced: 2 months ago
JSON representation
An end-to-end Twitter Data Pipeline that extracts data from Twitter and loads it into AWS S3.
- Host: GitHub
- URL: https://github.com/kishlayjeet/twitter-data-pipeline-using-airflow-and-aws-s3
- Owner: kishlayjeet
- Created: 2023-01-22T15:54:08.000Z (almost 2 years ago)
- Default Branch: main
- Last Pushed: 2023-08-26T12:47:02.000Z (over 1 year ago)
- Last Synced: 2023-08-26T14:18:35.243Z (over 1 year ago)
- Topics: airflow, airflow-dags, apache-airflow, boto3, data-engineering, data-engineering-pipeline, data-pipeline, etl, etl-job, etl-pipeline, python, s3, scheduler, tweepy, twitter, twitter-api, twitter-data-pipeline
- Language: Python
- Homepage:
- Size: 20.5 KB
- Stars: 4
- Watchers: 2
- Forks: 2
- Open Issues: 0