https://github.com/kubernetes-sigs/kube-batch

A batch scheduler of kubernetes for high performance workload, e.g. AI/ML, BigData, HPC
https://github.com/kubernetes-sigs/kube-batch

bigdata hpc k8s-sig-scheduling kubernetes machine-learning

Last synced: about 1 month ago
JSON representation

A batch scheduler of kubernetes for high performance workload, e.g. AI/ML, BigData, HPC

• Host: GitHub
• URL: https://github.com/kubernetes-sigs/kube-batch
• Owner: kubernetes-retired
• License: apache-2.0
• Archived: true
• Created: 2017-06-30T02:08:57.000Z (over 7 years ago)
• Default Branch: master
• Last Pushed: 2023-05-22T13:50:02.000Z (over 1 year ago)
• Last Synced: 2024-05-22T20:10:04.943Z (7 months ago)
• Topics: bigdata, hpc, k8s-sig-scheduling, kubernetes, machine-learning
• Language: Go
• Homepage:
• Size: 44.1 MB
• Stars: 1,069
• Watchers: 51
• Forks: 265
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • Contributing: CONTRIBUTING.md
  • License: LICENSE
  • Code of conduct: CODE_OF_CONDUCT.md
  • Security: SECURITY_CONTACTS

Awesome Lists containing this project

• awesome-starts - kubernetes-sigs/kube-batch - A batch scheduler of kubernetes for high performance workload, e.g. AI/ML, BigData, HPC (Go)

README

        
# kube-batch

[![Build Status](https://travis-ci.org/kubernetes-sigs/kube-batch.svg?branch=master)](https://travis-ci.org/kubernetes-sigs/kube-batch)

[![Go Report Card](https://goreportcard.com/badge/github.com/kubernetes-sigs/kube-batch)](https://goreportcard.com/report/github.com/kubernetes-sigs/kube-batch)

[![RepoSize](https://img.shields.io/github/repo-size/kubernetes-sigs/kube-batch.svg)](https://github.com/kubernetes-sigs/kube-batch)

[![Release](https://img.shields.io/github/release/kubernetes-sigs/kube-batch.svg)](https://github.com/kubernetes-sigs/kube-batch/releases)

[![LICENSE](https://img.shields.io/github/license/kubernetes-sigs/kube-batch.svg)](https://github.com/kubernetes-sigs/kube-batch/blob/master/LICENSE)

`kube-batch` is a batch scheduler for Kubernetes, providing mechanisms for applications which would like to run batch jobs leveraging Kubernetes. It builds upon a decade and a half of experience on running batch workloads at scale using several systems, combined with best-of-breed ideas and practices from the open source community.

Refer to [tutorial](doc/usage/tutorial.md) on how to use `kube-batch` to run batch job in Kubernetes.

## Overall Architecture

The following figure describes the overall architecture and scope of `kube-batch`; the out-of-scope part is going to be handled by other projects.

![kube-batch](doc/images/kube-batch.png)

## Who uses kube-batch?

As the kube-batch Community grows, we'd like to keep track of our users. Please send a PR with your organization name.

Currently **officially** using kube-batch:

1. [openBCE](https://github.com/openbce)

1. [Kubeflow](https://www.kubeflow.org)

1. [Volcano](https://github.com/volcano-sh/volcano)

1. [Baidu Inc](http://www.baidu.com)

1. [TuSimple](https://www.tusimple.com)

1. [MOGU Inc](https://www.mogujie.com)

1. [Vivo](https://www.vivo.com)

## Community, discussion, contribution, and support

Learn how to engage with the Kubernetes community on the [community page](http://kubernetes.io/community/).

You can reach the maintainers of this project at:

- Slack: #sig-scheduling

- Mailing List: https://groups.google.com/forum/#!forum/kubernetes-sig-scheduling

### Code of conduct

Participation in the Kubernetes community is governed by the [Kubernetes Code of Conduct](code-of-conduct.md).