https://github.com/sanderploegsma/beam-scheduling-kubernetes

Scheduled Dataflow pipelines using Kubernetes Cronjobs
https://github.com/sanderploegsma/beam-scheduling-kubernetes

apache-beam cronjob dataflow google-cloud google-cloud-dataflow google-cloud-platform kotlin kubernetes

Last synced: about 1 year ago
JSON representation

Scheduled Dataflow pipelines using Kubernetes Cronjobs

• Host: GitHub
• URL: https://github.com/sanderploegsma/beam-scheduling-kubernetes
• Owner: sanderploegsma
• Created: 2018-02-15T21:46:16.000Z (over 8 years ago)
• Default Branch: master
• Last Pushed: 2018-02-26T22:32:19.000Z (over 8 years ago)
• Last Synced: 2025-04-05T18:50:34.119Z (about 1 year ago)
• Topics: apache-beam, cronjob, dataflow, google-cloud, google-cloud-dataflow, google-cloud-platform, kotlin, kubernetes
• Language: Kotlin
• Homepage:
• Size: 59.6 KB
• Stars: 8
• Watchers: 1
• Forks: 2
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

          
# Scheduled Apache Beam jobs using Kubernetes Cronjobs

[![](https://img.shields.io/docker/automated/sanderp/beam-scheduling-kubernetes.svg)](https://hub.docker.com/r/sanderp/beam-scheduling-kubernetes/)

## Prerequisites

- Kubernetes cluster version >= 1.8

- Docker (optional, only needed when building your own image)

- Java (optional, only needed to run the application on your own machine)

## Setting up

Deploy the Kubernetes Cronjob using

    kubectl apply -f kubernetes/cronjob.yml