https://github.com/bobbui/spark-kubernetes-docker-image
Docker image use to run Apache Spark inside Kubernetes cluster as indicated here: https://spark.apache.org/docs/latest/running-on-kubernetes.html#docker-images
https://github.com/bobbui/spark-kubernetes-docker-image
Last synced: 6 months ago
JSON representation
Docker image use to run Apache Spark inside Kubernetes cluster as indicated here: https://spark.apache.org/docs/latest/running-on-kubernetes.html#docker-images
- Host: GitHub
- URL: https://github.com/bobbui/spark-kubernetes-docker-image
- Owner: bobbui
- Created: 2019-01-08T20:16:57.000Z (over 7 years ago)
- Default Branch: master
- Last Pushed: 2019-01-08T20:24:31.000Z (over 7 years ago)
- Last Synced: 2025-01-19T05:46:54.697Z (over 1 year ago)
- Size: 5.86 KB
- Stars: 6
- Watchers: 0
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# spark-kubernetes-docker-image
Docker image use to run Apache Spark inside Kubernetes cluster as indicated here: https://spark.apache.org/docs/latest/running-on-kubernetes.html#docker-images
Built from official spark Dockerfile: https://github.com/apache/spark/tree/master/resource-managers/kubernetes/docker/src/main/dockerfiles/spark .
Get the image from here: https://cloud.docker.com/repository/docker/thangbui/spark .
Tags:
`-f tag: Dockerfile to build for JVM based Jobs. By default builds the Dockerfile shipped with Spark.
`-py tag: Dockerfile to build for PySpark Jobs. Builds Python dependencies and ships with Spark.
`-r tag: Dockerfile to build for SparkR Jobs. Builds R dependencies and ships with Spark.