Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/GoogleCloudPlatform/slurm-gcp

Last synced: 10 days ago
JSON representation

Host: GitHub
URL: https://github.com/GoogleCloudPlatform/slurm-gcp
Owner: GoogleCloudPlatform
License: apache-2.0
Created: 2023-11-30T17:31:57.000Z (12 months ago)
Default Branch: master
Last Pushed: 2024-10-29T17:11:58.000Z (15 days ago)
Last Synced: 2024-10-29T17:56:31.304Z (14 days ago)
Language: HCL
Size: 5.05 MB
Stars: 26
Watchers: 16
Forks: 22
Open Issues: 15
Metadata Files:
- Readme: README.md
- Changelog: CHANGELOG.md
- Contributing: CONTRIBUTING.md
- License: LICENSE

Awesome Lists containing this project

awesome-cloud-hpc - Slurm on Google Cloud Platform - Open-source software solution that enables setting up Slurm clusters on Google Cloud Platform with ease. (Job Scheduler)

README

        # Slurm on Google Cloud Platform

## Guidance on usage

> [!CAUTION]

> Terraform modules in this repo are not meant to be used directly. Instead,

> [Cloud HPC Toolkit](https://github.com/GoogleCloudPlatform/hpc-toolkit) is the

> recommended way to use Slurm in GCP.

## Notices

> [!IMPORTANT]

> The naming scheme for SchedMD published images has changed with release 5.7.3.

> This is to ensure no incompatibilities between the terraform modules and old

> images that could be in the same family as a newer release. From now on, the

> image family includes the slurm-gcp major and minor version instead of the

> slurm version.

See [Images doc](./docs/images.md#published-image-family) for the latest

published images.

[FAQ](./docs/faq.md) | [Troubleshooting](./docs/troubleshooting.md) |

[Glossary](./docs/glossary.md)

- [Overview](#overview)

- [Image Support](#image-support)

  - [SchedMD](#schedmd)

- [Cluster Configurations](#cluster-configurations)

  - [Cloud](#cloud)

  - [Hybrid](#hybrid)

  - [Multi-Cluster/Federation](#multi-clusterfederation)

- [Upgrade to v6](#upgrade-to-v6)

- [TPU support](#tpu-support)

- [Help and Support](#help-and-support)

## Overview

`slurm-gcp` is an open-source software solution that enables setting up

[Slurm clusters](./docs/glossary.md#slurm) on

[Google Cloud Platform](./docs/glossary.md#gcp) with ease. With it, you can

create and manage [Slurm](./docs/glossary.md#slurm) cluster infrastructure in

[GCP](./docs/glossary.md#gcp), deployed in different configurations.

Google's

[HPC Toolkit](https://cloud.google.com/blog/products/compute/new-google-cloud-hpc-toolkit),

on [github](https://github.com/GoogleCloudPlatform/hpc-toolkit), can be used to

manage and deploy [Slurm clusters](./docs/glossary.md#slurm) and other

supporting infrastrucutre via

[HPC Blueprints](https://cloud.google.com/hpc-toolkit/docs/setup/hpc-blueprint).

## Image Support

See [supported Operating Systems](./docs/images.md#supported-operating-systems)

and [published Image Family](./docs/images.md#published-image-family) for

machine image support.

### SchedMD

SchedMD provides

[professional services and commercial support](https://www.schedmd.com/support.php)

to help you get up and running and stay running.

Issues and/or enhancement requests can be submitted to

[SchedMD's Bugzilla](https://bugs.schedmd.com).

Also, join community discussions on either the

[Slurm User mailing list](https://slurm.schedmd.com/mail.html) or the

[Google Cloud & Slurm Community Discussion Group](https://groups.google.com/forum/#!forum/google-cloud-slurm-discuss).

## Cluster Configurations

`slurm-gcp` can be deployed and used in different configurations and methods to

meet your computing needs.

See

[HPC Blueprints](https://cloud.google.com/hpc-toolkit/docs/setup/hpc-blueprint)

for

[HPC Toolkit](https://cloud.google.com/blog/products/compute/new-google-cloud-hpc-toolkit)

example cluster configurations that are production ready.

### Cloud

All Slurm cluster resources will exist in the cloud.

See the [Cloud Cluster Guide](./docs/cloud.md) for details.

### Hybrid

Only Slurm compute nodes will exist in the cloud. The Slurm controller and other

Slurm components will remain in the onprem environment.

See the [Hybrid Cluster Guide](./docs/hybrid.md) for details.

### Multi-Cluster/Federation

Two or more clusters are connected, allowing for jobs to be submitted from and

ran on different clusters. This can be a mix between onprem and cloud clusters.

See the [Federated Cluster Guide](./docs/federation.md) for details.

## Upgrade to v6

See the [Upgrade to v6 Guide](./docs/upgrade_to_v6.md) for details.

## TPU support

slurm-gcp supports using TPU-vm nodes. See [TPU guide](./docs/tpu.md) for

details.

## Help and Support

- See the [slurm-gcp FAQ](./docs/faq.md) for help with `slurm-gcp`.

- See the [Slurm FAQ](https://slurm.schedmd.com/faq.html) for help with

  [Slurm](./docs/glossary.md#slurm).

Please reach out to us

[here](./docs/faq.md#how-do-i-get-support-for-slurm-gcp-and-slurm). We will be

happy to support you!