An open API service indexing awesome lists of open source software.

https://github.com/saidsef/k8s-nifi-cluster

Apache NiFi cluster running in Kubernetes
https://github.com/saidsef/k8s-nifi-cluster

containers k8s kubernetes kubernetes-nifi-cluster kubernetes-statefulset nifi nifi-cluster

Last synced: 6 months ago
JSON representation

Apache NiFi cluster running in Kubernetes

Awesome Lists containing this project

README

          

# Kubernetes NiFi Cluster

[Apache NiFi](https://nifi.apache.org/) supports powerful and scalable directed graphs of data routing, transformation, and system mediation logic.

My goal is to show how to run Apache NiFi Cluster in Kubernetes

## Prerequisites

- Kubernetes Cluster >= v1.23

## Deployments

This will deploy Apache NiFi in a Cluster mode with extenal Apache Zookeeper managing ellections:

```shell
kubectl apply -k deployments/
```

> *NOTE:* Remember to update Ingress hostname

This will create:

- 1x NiFi Namespace (all the items will be deployed here)
- 2x Apache NiFi Instances (can be increased)
- 1x Apache Zookeeper (accessible within the cluster only)
- 1x Secrets (basic auth username/passowrd: `admin:admin`)
- 1x Ingress (access endpoint)

> :information_source: Set `Ingress` hostname to valid hostname before enabling it in `kustomization.yml`
> Important: Remeber to update the default `username/password`.

## Services

```shell
kubectl get all,ing
```

## Contributing

We would :heart: you to contribute by making a [pull request](https://github.com/saidsef/k8s-nifi-cluster/pulls).

Please read the official [Contribution Guide](./CONTRIBUTING.md) for more information on how you can contribute.

## Useful links:

- [I Started NiFi. Now What?](https://nifi.apache.org/docs/nifi-docs/html/getting-started.html#i-started-nifi-now-what)
- [NiFi System Administrator’s Guide](https://nifi.apache.org/docs/nifi-docs/html/administration-guide.html#build-a-custom-distribution)