https://github.com/kanchishimono/spark-on-k8s-images

Docker images for spark on kubernetes
https://github.com/kanchishimono/spark-on-k8s-images

docker docker-image dockerfile kubernetes pyspark spark spark-kubernetes spark-on-k8s spark-on-kubernetes

Last synced: 30 days ago
JSON representation

Docker images for spark on kubernetes

• Host: GitHub
• URL: https://github.com/kanchishimono/spark-on-k8s-images
• Owner: KanchiShimono
• Created: 2020-03-22T08:46:35.000Z (almost 5 years ago)
• Default Branch: master
• Last Pushed: 2021-10-24T15:22:34.000Z (about 3 years ago)
• Last Synced: 2023-03-12T01:51:45.053Z (almost 2 years ago)
• Topics: docker, docker-image, dockerfile, kubernetes, pyspark, spark, spark-kubernetes, spark-on-k8s, spark-on-kubernetes
• Language: Dockerfile
• Homepage:
• Size: 63.5 KB
• Stars: 2
• Watchers: 1
• Forks: 4
• Open Issues: 1
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
# spark-on-k8s-images

[![GitHub Actions status](https://github.com/KanchiShimono/spark-on-k8s-images/workflows/Build/badge.svg)](https://github.com/KanchiShimono/spark-on-k8s-images/actions?query=workflow%3ABuild)

Docker images for spark on kubernetes

| Name            | Description                                                                                                                                                                           |

| :-------------- | :------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ |

| spark           | Spark image for Spark on k8s. This image built on the image that built by official tool [docker-image-tool.sh](https://github.com/apache/spark/blob/master/bin/docker-image-tool.sh). |

| pyspark         | PySpark image for Spark on k8s. Install PySpark on Spark image.                                                                                                                       |

| pyspark-jupyter | Install Jupyter Lab Server on PySpark image.                                                                                                                                          |

## TAG

Docker image tag is named from GitHub event following rules

| Event          | Ref                    | Docker Tag                       | Pushed |

| -------------- | ---------------------- | -------------------------------- | ------ |

| `pull_request` | `refs/pull/2/merge`    | `pr-2`                           | No     |

| `push`         | `refs/heads/master`    | `master`                         | Yes    |

| `push`         | `refs/heads/my/branch` | `my-branch`                      | Yes    |

| `push tag`     | `refs/tags/v1.2.3`     | `v1.2.3`, `v1.2`, `v1`, `latest` | Yes    |