https://github.com/f-dangel/wandb_preempt

Code and tutorial on integrating wandb sweeps with Slurm pre-emption
https://github.com/f-dangel/wandb_preempt

checkpointing preemption pytorch slurm sweep wandb

Last synced: 8 days ago
JSON representation

Code and tutorial on integrating wandb sweeps with Slurm pre-emption

• Host: GitHub
• URL: https://github.com/f-dangel/wandb_preempt
• Owner: f-dangel
• License: mit
• Created: 2024-08-25T22:44:12.000Z (about 1 year ago)
• Default Branch: main
• Last Pushed: 2024-09-25T13:22:48.000Z (about 1 year ago)
• Last Synced: 2025-09-13T03:42:28.945Z (about 1 month ago)
• Topics: checkpointing, preemption, pytorch, slurm, sweep, wandb
• Language: Python
• Homepage: https://wandb-preempt.readthedocs.io/en/latest/
• Size: 1.62 MB
• Stars: 2
• Watchers: 2
• Forks: 0
• Open Issues: 3
• Metadata Files:
  • Readme: README.md
  • Changelog: changelog.md
  • License: LICENSE

Awesome Lists containing this project

README

          
# wandb_preempt

[![PyPI - Version](https://img.shields.io/pypi/v/wandb_preempt)](https://pypi.org/project/wandb-preempt/)

[![Documentation Status](https://readthedocs.org/projects/wandb-preempt/badge/?version=latest)](https://wandb-preempt.readthedocs.io/en/latest/?badge=latest)

This repository contains a tutorial on how to combine [wandb](https://wandb.ai/) sweeps

with [Slurm](https://slurm.schedmd.com/)'s pre-emption, i.e. how to automatically

re-queue and resume runs from a Weights & Biases sweep on a Slurm cluster.

## Getting started

### Installation

```bash

pip install wandb_preempt

```

### Basic Example

Please see the [docs](https://wandb-preempt.readthedocs.io/en/latest/walkthrough/).