https://github.com/getindata/flink-python-loader
https://github.com/getindata/flink-python-loader
Last synced: 4 months ago
JSON representation
- Host: GitHub
- URL: https://github.com/getindata/flink-python-loader
- Owner: getindata
- Created: 2022-05-30T08:43:38.000Z (about 4 years ago)
- Default Branch: main
- Last Pushed: 2024-11-04T12:55:00.000Z (over 1 year ago)
- Last Synced: 2026-01-30T12:04:31.010Z (4 months ago)
- Language: Java
- Size: 51.8 KB
- Stars: 1
- Watchers: 10
- Forks: 1
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- Changelog: CHANGELOG.md
Awesome Lists containing this project
README
## How to run this on VVP?
1. Install VVP (e.g. on minikube): https://docs.ververica.com/getting_started/installation.html
2. mvn clean package
3. (optional) Publish docker image e.g.
- `docker build docker /ververica/pyflink:1.11.2-scala_2.12`
- `docker push /ververica/pyflink:1.11.2-scala_2.12`
4. Add secrets for pulling docker images
- `kubectl create secret docker-registry regcred --docker-server= --docker-username=[gitlab-username] --docker-password=[token] --docker-email=[email] -n vvp-jobs`
4. Create a deployment
- upload shaded jar in the UI (note: you might have to edit YAML manually for the first time to make it work)
- go to the YAML tab and add:
```yaml
spec:
template:
spec:
artifact:
flinkImageRegistry:
flinkImageRepository: ververica/pyflink
flinkImageTag: 1.11.2-scala_2.12
kubernetes:
pods:
imagePullSecrets:
- name: regcred
```
5. Job should finish successfully
In general: we package program with the jar and execute it on VVP.
Alternative approach: use persistent volume.