https://github.com/rafat97/aws-kinesis-data-stream-lambda-s3
AWS kinesis data stream consume with lambda and store into s3 bucket
https://github.com/rafat97/aws-kinesis-data-stream-lambda-s3
aws aws-kinesis aws-kinesis-stream aws-lambda aws-s3 serverless-framework
Last synced: about 2 months ago
JSON representation
AWS kinesis data stream consume with lambda and store into s3 bucket
- Host: GitHub
- URL: https://github.com/rafat97/aws-kinesis-data-stream-lambda-s3
- Owner: Rafat97
- Created: 2023-06-10T06:18:41.000Z (almost 2 years ago)
- Default Branch: master
- Last Pushed: 2023-06-10T14:19:55.000Z (almost 2 years ago)
- Last Synced: 2025-01-24T17:17:05.358Z (4 months ago)
- Topics: aws, aws-kinesis, aws-kinesis-stream, aws-lambda, aws-s3, serverless-framework
- Language: TypeScript
- Homepage:
- Size: 183 KB
- Stars: 1
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# AWS Kinesis Data Stream, Lambda and S3
The main purpose of this application is to help the data analytics team. The data analytics team collects data from s3 and does their analysis. This serverless application will do that, a client application
produce data and pass data into the AWS kinesis data stream then lambda consumer will consume the data and store it in s3 for further work.
## Architecture
## Blog
https://medium.com/@rafat97/kinesis-data-stream-kinesis-firehose-common-use-case-d515c785e51
## How to Run
1. Install serverless freamwork
``` npm install -g serverless ```
2. Clone the repository
``` git clone https://github.com/Rafat97/aws-kinesis-data-stream-lambda-s3.git ```
3. install packages
``` npm install ```
4. Deploy application into AWS
``` npm run deploy:dev:us-west-1 ```
5. After complition run producer for producing messages.
``` npm run run:producer ```
6. [NOTE] If you want to remove application
``` npm run remove:dev:us-west-1 ```
7. For more commend you can checkout `package.json` file.
---
Thank you