https://github.com/saidsef/k8s-nifi-cluster
Apache NiFi cluster running in Kubernetes
https://github.com/saidsef/k8s-nifi-cluster
containers k8s kubernetes kubernetes-nifi-cluster kubernetes-statefulset nifi nifi-cluster
Last synced: 6 months ago
JSON representation
Apache NiFi cluster running in Kubernetes
- Host: GitHub
- URL: https://github.com/saidsef/k8s-nifi-cluster
- Owner: saidsef
- License: apache-2.0
- Created: 2019-04-12T23:16:38.000Z (over 6 years ago)
- Default Branch: main
- Last Pushed: 2025-02-08T14:14:25.000Z (8 months ago)
- Last Synced: 2025-04-09T22:12:01.821Z (6 months ago)
- Topics: containers, k8s, kubernetes, kubernetes-nifi-cluster, kubernetes-statefulset, nifi, nifi-cluster
- Homepage:
- Size: 96.7 KB
- Stars: 55
- Watchers: 5
- Forks: 25
- Open Issues: 3
-
Metadata Files:
- Readme: README.md
- Contributing: CONTRIBUTING.md
- License: LICENSE.md
Awesome Lists containing this project
README
# Kubernetes NiFi Cluster
[Apache NiFi](https://nifi.apache.org/) supports powerful and scalable directed graphs of data routing, transformation, and system mediation logic.
My goal is to show how to run Apache NiFi Cluster in Kubernetes
## Prerequisites
- Kubernetes Cluster >= v1.23
## Deployments
This will deploy Apache NiFi in a Cluster mode with extenal Apache Zookeeper managing ellections:
```shell
kubectl apply -k deployments/
```> *NOTE:* Remember to update Ingress hostname
This will create:
- 1x NiFi Namespace (all the items will be deployed here)
- 2x Apache NiFi Instances (can be increased)
- 1x Apache Zookeeper (accessible within the cluster only)
- 1x Secrets (basic auth username/passowrd: `admin:admin`)
- 1x Ingress (access endpoint)> :information_source: Set `Ingress` hostname to valid hostname before enabling it in `kustomization.yml`
> Important: Remeber to update the default `username/password`.## Services
```shell
kubectl get all,ing
```## Contributing
We would :heart: you to contribute by making a [pull request](https://github.com/saidsef/k8s-nifi-cluster/pulls).
Please read the official [Contribution Guide](./CONTRIBUTING.md) for more information on how you can contribute.
## Useful links:
- [I Started NiFi. Now What?](https://nifi.apache.org/docs/nifi-docs/html/getting-started.html#i-started-nifi-now-what)
- [NiFi System Administrator’s Guide](https://nifi.apache.org/docs/nifi-docs/html/administration-guide.html#build-a-custom-distribution)