https://github.com/sanderploegsma/flink-k8s
Example Apache Flink cluster on Kubernetes
https://github.com/sanderploegsma/flink-k8s
apache-flink kubernetes
Last synced: 2 months ago
JSON representation
Example Apache Flink cluster on Kubernetes
- Host: GitHub
- URL: https://github.com/sanderploegsma/flink-k8s
- Owner: sanderploegsma
- Created: 2018-03-29T18:05:22.000Z (over 7 years ago)
- Default Branch: master
- Last Pushed: 2018-08-22T21:26:14.000Z (almost 7 years ago)
- Last Synced: 2025-04-05T18:50:34.544Z (3 months ago)
- Topics: apache-flink, kubernetes
- Language: Kotlin
- Size: 58.6 KB
- Stars: 22
- Watchers: 2
- Forks: 15
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# Flink on Kubernetes
This repository is a sample setup to run an Apache Flink job in Kubernetes.
It uses the new StandaloneJob entry point introduced in Flink 1.6.0 which means that when the JobManager starts,
it will automatically run the job that is packaged in the JAR.
## Setup
First, compile the example application
mvn clean package
Then, make sure you build the Docker image and make it available to your Kubernetes cluster.
When the Docker image is available, set up the Flink cluster by applying all manifests from the `kubernetes` folder:
kubectl apply -f kubernetes
If you want to see the JobManager UI, you can forward its port to your local machine:
kubectl port-forward 8081
You can safely scale the TaskManagers up or down:
kubectl scale deployment flink-taskmanager --replicas=4
As soon as the required number of task slots are available the job will start running.