https://github.com/srfrnk/spar-kube

Spark cluster deployment on a k8s cluster
https://github.com/srfrnk/spar-kube

hadoop k8s k8s-cluster kubernetes spar-kube spark zeppelin

Last synced: 2 months ago
JSON representation

Spark cluster deployment on a k8s cluster

• Host: GitHub
• URL: https://github.com/srfrnk/spar-kube
• Owner: srfrnk
• License: mit
• Created: 2017-01-27T07:47:59.000Z (over 9 years ago)
• Default Branch: master
• Last Pushed: 2017-02-24T17:44:39.000Z (over 9 years ago)
• Last Synced: 2025-01-29T23:43:19.317Z (over 1 year ago)
• Topics: hadoop, k8s, k8s-cluster, kubernetes, spar-kube, spark, zeppelin
• Language: Makefile
• Size: 5.86 KB
• Stars: 0
• Watchers: 4
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

          
# spar-kube

Spark cluster deployment on a k8s cluster

Updated to latest versions:

- Hadoop 2.7.3

- Spark 2.1.0

- Zeppelin 0.6.2

## Clone

`cd` to an appropriate directory on your OS

```bash

git clone https://github.com/srfrnk/spar-kube.git

```

## Deploy

connect `kubectl` to your cluster

```bash

cd spar-kube

make deploy

```

## Build Images Locally

**Not required for deployment.**

```bash

cd spar-kube

make images

```

## Push Locally Built Images

**Not required for deployment.**

Requires privileges to push images to docker hub. 

```bash

cd spar-kube

make push

```