https://github.com/kevinsaephanh/stock-market-etl-consumer

https://github.com/kevinsaephanh/stock-market-etl-consumer

aws cassandra kafka python

Last synced: about 2 months ago
JSON representation

• Host: GitHub
• URL: https://github.com/kevinsaephanh/stock-market-etl-consumer
• Owner: KevinSaephanh
• Created: 2024-10-07T04:26:55.000Z (4 months ago)
• Default Branch: main
• Last Pushed: 2024-12-07T22:57:41.000Z (about 2 months ago)
• Last Synced: 2024-12-07T23:26:04.987Z (about 2 months ago)
• Topics: aws, cassandra, kafka, python
• Language: Python
• Homepage:
• Size: 9.77 KB
• Stars: 0
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
# Stock Market ETL Consumer

This project does the following:

- Consume messages from a Kafka topic containing stock data (producer app [here](https://github.com/KevinSaephanh/stock-market-etl-producer))

- Transform the data format with Pandas

- Export the modified data to a CSV file

- Upload the CSV file to AWS S3

Tech:

- Python

- Kafka

- AWS