https://github.com/zkfmapf123/kafka-configure

kafka-configure
https://github.com/zkfmapf123/kafka-configure

Last synced: over 1 year ago
JSON representation

kafka-configure

• Host: GitHub
• URL: https://github.com/zkfmapf123/kafka-configure
• Owner: zkfmapf123
• Created: 2025-01-01T04:59:07.000Z (over 1 year ago)
• Default Branch: master
• Last Pushed: 2025-01-18T16:44:58.000Z (over 1 year ago)
• Last Synced: 2025-03-25T03:55:39.125Z (over 1 year ago)
• Language: Go
• Homepage:
• Size: 861 KB
• Stars: 0
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

          
# Content-Delivery

- [x] API

- [x] Kafka

- [x] Consumer Server

- [x] Database

- [x] fluentbit

- [x] prometheus

- [x] loki

- [ ] tempo

- [x] grafana

- [ ] grafana -> metric dashboard

- [ ] grafana -> trace dashboard

- [ ] grafana -> log dashboard

## Docker-Compose

- [docker-compose.yml](./docker-compose.yml) api 서버

- [docker-compose.kafka.yml](./docker-compose.kafka.yml) kafka + ui

- [docker-compose.log.yml](./docker-compose.log.yml) prometheus + loki + grafana + open telemetry

# Huge Traffic Architecture Use Kafka

![asis](./public/asis.png)

- 대용량에 트래픽이 발생하게 될때 -> DB 모든 부하가 발생함

- DB 자체에 장애가 발생한다면 모든시스템에 장애가 발생할 수 있음 (SPOF)

![tobe](./public/tobe.png)

## LGTM Stack

![ff](./public/fluentbit.png)

### 로그수집

- fluentbit + loki

### 메트릭 수집

- fluentbit + prometheus + mimir

### 분산 Tracing

- application + tempo

## 참고

-  Golang Tempo 구성하기