https://github.com/conduktor/quickstart-conduktor-aws-msk

https://github.com/conduktor/quickstart-conduktor-aws-msk

Last synced: 11 months ago
JSON representation

• Host: GitHub
• URL: https://github.com/conduktor/quickstart-conduktor-aws-msk
• Owner: conduktor
• Created: 2022-10-19T17:52:56.000Z (over 3 years ago)
• Default Branch: main
• Last Pushed: 2022-11-07T10:39:58.000Z (over 3 years ago)
• Last Synced: 2025-06-25T09:03:16.631Z (about 1 year ago)
• Language: Dockerfile
• Size: 182 KB
• Stars: 3
• Watchers: 21
• Forks: 2
• Open Issues: 1
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

          
# Steps

1) Deploy the first CloudFormation file, this will create ECR, S3 and CodeBuild resources

2) upload all the files / folders in this repo (`conduktor-platform-config`, `buildspec.yml`, `Dockerfile`) in the S3 bucket that was created 

3) Launch a build in CodeBuild: this will build a Docker image with a proper configuration file to connect to an MSK cluster (this is fully serverless). To update the config, just change the file in S3 and relaunch a build in CodeBuild 

![Base Setup](./arch-diagrams/step1-base.png)

4) (optional) Start an MSK cluster (if none exist) using the second CloudFormation file

5) Deploy the third CloudFormation file, which will create an ECS service using Fargate, and launch an ALB to expose the conduktor platform container. Supply the bootstrap servers to the container (can be private)

![Conduktor Platform ECS Service](./arch-diagrams/step3-ecs.png)