Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/G-Research/armada
A multi-cluster batch queuing system for high-throughput workloads on Kubernetes.
https://github.com/G-Research/armada
gr-oss kubernetes
Last synced: about 2 months ago
JSON representation
A multi-cluster batch queuing system for high-throughput workloads on Kubernetes.
- Host: GitHub
- URL: https://github.com/G-Research/armada
- Owner: armadaproject
- License: apache-2.0
- Created: 2019-06-19T16:31:11.000Z (over 5 years ago)
- Default Branch: master
- Last Pushed: 2024-04-14T14:12:22.000Z (5 months ago)
- Last Synced: 2024-04-14T20:10:47.372Z (5 months ago)
- Topics: gr-oss, kubernetes
- Language: Go
- Homepage: https://armadaproject.io
- Size: 19.4 MB
- Stars: 407
- Watchers: 25
- Forks: 126
- Open Issues: 79
-
Metadata Files:
- Readme: README.md
- Contributing: CONTRIBUTING.md
- License: LICENSE
- Code of conduct: CODE_OF_CONDUCT.md
Awesome Lists containing this project
- awesome-cloud-native - Armada - A multi-cluster batch queuing system for high-throughput workloads on Kubernetes. (Scheduler)
README
# Armada
Armada is a system built on top of [Kubernetes](https://kubernetes.io/docs/concepts/overview/) for running batch workloads. With Armada as middleware for batch, Kubernetes can be a common substrate for batch and service workloads. Armada is used in production and can run millions of jobs per day across tens of thousands of nodes.
Armada addresses the following limitations of Kubernetes:
1. Scaling a single Kubernetes cluster beyond a certain size is [challenging](https://openai.com/blog/scaling-kubernetes-to-7500-nodes/). Hence, Armada is designed to effectively schedule jobs across many Kubernetes clusters. Many thousands of nodes can be managed by Armada in this way.
2. Achieving very high throughput using the in-cluster storage backend, etcd, is [challenging](https://etcd.io/docs/v3.5/op-guide/performance/). Hence, Armada performs queueing and scheduling out-of-cluster using a specialized storage layer. This allows Armada to maintain queues composed of millions of jobs.
3. The default [kube-scheduler](https://kubernetes.io/docs/reference/command-line-tools-reference/kube-scheduler/) is not suitable for batch. Instead, Armada includes a novel multi-Kubernetes cluster scheduler with support for important batch scheduling features, such as:
* Fair queuing and scheduling across multiple users. Based on dominant resource fairness.
* Resource and job scheduling rate limits.
* Gang-scheduling, i.e., atomically scheduling sets of related jobs.
* Job preemption, both to run urgent jobs in a timely fashion and to balance resource allocation between users.
Armada also provides features to help manage large compute clusters effectively, including:
* Detailed analytics exposed via [Prometheus](https://prometheus.io/) showing how the system behaves and how resources are allocated.
* Automatically removing nodes exhibiting high failure rates from consideration for scheduling.
* A mechanism to earmark nodes for a particular set of jobs, but allowing them to be used by other jobs when not used for their primary purpose.
Armada is designed with the enterprise in mind; all components are secure and highly available.
Armada is a [CNCF](https://www.cncf.io/) Sandbox project and is used in production at [G-Research](https://www.gresearch.co.uk/).
For an overview of Armada, see the following videos:
- [Armada - high-throughput batch scheduling](https://www.youtube.com/watch?v=FT8pXYciD9A)
- [Building Armada - Running Batch Jobs at Massive Scale on Kubernetes](https://www.youtube.com/watch?v=B3WPxw3OUl4)
The Armada project adheres to the CNCF [Code of Conduct](https://github.com/cncf/foundation/blob/master/code-of-conduct.md).
## Installation
### Armada Operator
For installation instructions, easiest way is to use the Armada Operator.
For more information, see the [Armada Operator repository](https://github.com/armadaproject/armada-operator).
Alternatively, you can install Armada manually by using the Helm charts defined in the `deployment` directory.
### armadactl
Armada also provides a command-line interface, `armadactl`, which can be used to interact with the Armada system.
To install `armadactl`, run the following script:
```bash
scripts/get-armadactl.sh
```
Or download it from the [GitHub Release](https://github.com/armadaproject/armada/releases/latest) page for your platform.
## Documentation
For documentation, see the following:
- [System overview](./docs/system_overview.md)
- [Scheduler](./docs/scheduler.md)
- [User guide](./docs/user.md)
- [Development guide](./docs/developer.md)
- [Release notes/Version history](https://github.com/armadaproject/armada/releases)
- [API Documentation](./docs/developer/api.md)
We expect readers of the documentation to have a basic understanding of Docker and Kubernetes; see, e.g., the following links:
- [Docker overiew](https://docs.docker.com/get-started/overview/)
- [Kubernetes overview](https://kubernetes.io/docs/concepts/overview/)
## Contributions
Thank you for considering contributing to Armada!
We want everyone to feel that they can contribute to the Armada Project.
Your contributions are valuable, whether it's fixing a bug, implementing a new feature, improving documentation, or suggesting enhancements.
We appreciate your time and effort in helping make this project better for everyone.
For more information about contributing to Armada see [CONTRIBUTING.md](https://github.com/armadaproject/armada/blob/master/CONTRIBUTING.md) and before proceeding to contributions see [CODE_OF_CONDUCT.md](CODE_OF_CONDUCT.md)
## Discussion
If you are interested in discussing Armada you can find us on [](https://cloud-native.slack.com/?redir=%2Farchives%2FC03T9CBCEMC)