https://github.com/itboon/kafka-helm
Kafka Helm Charts
https://github.com/itboon/kafka-helm
apache-kafka helm-charts kafka kafka-docker kafka-helm-chart kafka-kraft kraft
Last synced: 5 months ago
JSON representation
Kafka Helm Charts
- Host: GitHub
- URL: https://github.com/itboon/kafka-helm
- Owner: itboon
- Created: 2023-08-23T10:31:00.000Z (almost 3 years ago)
- Default Branch: main
- Last Pushed: 2025-01-14T15:35:44.000Z (over 1 year ago)
- Last Synced: 2025-01-14T15:52:50.664Z (over 1 year ago)
- Topics: apache-kafka, helm-charts, kafka, kafka-docker, kafka-helm-chart, kafka-kraft, kraft
- Language: Smarty
- Homepage:
- Size: 767 KB
- Stars: 7
- Watchers: 1
- Forks: 1
- Open Issues: 1
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# Kafka helm chart
https://github.com/itboon/kafka-helm
## Prerequisites
- Kubernetes 1.22+
- Helm 3.3+
## 获取 helm 仓库
``` shell
helm repo add kafka-repo https://helm-charts.itboon.top/kafka
helm repo update kafka-repo
```
## 部署 Kafka
### 部署单节点 Kafka 集群
``` shell
## 下面的部署案例关闭了持久化存储，仅作为演示
helm upgrade --install kafka \
--namespace kafka-demo \
--create-namespace \
--set broker.persistence.enabled="false" \
kafka-repo/kafka
```
``` shell
## 默认已开启持久化存储
helm upgrade --install kafka \
--namespace kafka-demo \
--create-namespace \
kafka-repo/kafka
```
### 独立部署 controller 模块
生产环境推荐独立部署 controller 模块， 方便 broker 横向扩缩容。
``` shell
helm upgrade --install kafka \
--namespace kafka-demo \
--create-namespace \
--set controller.enabled="true" \
--set controller.replicaCount="1" \
--set broker.replicaCount="1" \
kafka-repo/kafka
```
> `kafka-repo/kafka` 默认关闭 controller 独立部署，`kafka-repo/kafka-ha` 默认开启。
### 部署高可用集群
``` shell
## kafka-repo/kafka-ha 默认部署 3 controller + 3 broker
helm upgrade --install kafka \
--namespace kafka-demo \
--create-namespace \
kafka-repo/kafka-ha
```
``` shell
## 调整集群资源配额
helm upgrade --install kafka \
--namespace kafka-demo \
--create-namespace \
--set controller.replicaCount="3" \
--set broker.replicaCount="3" \
--set broker.heapOpts="-Xms4096m -Xmx4096m" \
--set broker.resources.requests.memory="8Gi" \
--set broker.resources.limits.memory="16Gi" \
kafka-repo/kafka-ha
```
> More values please refer to [examples/values-production.yml](https://github.com/sir5kong/kafka-docker/raw/main/examples/values-production.yml)
## Kafka Broker 配置
```yaml
## 单节点 Broker 配置
broker:
replicaCount: 1
config:
num.partitions: "2"
```
```yaml
## 高可用集群推荐配置
broker:
replicaCount: 3
config:
num.partitions: "6"
default.replication.factor: "3"
min.insync.replicas: "2"
```
> `broker.config` 某些关键配置会被环境变量覆盖，例如: node.id advertised.listeners controller.quorum.voters 等
## 集群外访问
```yaml
## NodePort example
broker:
external:
enabled: true
service:
type: "NodePort"
annotations: {}
autoDiscovery:
enabled: true
```
更多集群外案例请参考