https://github.com/ascii-supply-networks/dagster-slurm

Dagster SLURM integration
https://github.com/ascii-supply-networks/dagster-slurm

dagster feray hpc ray slurm spark

Last synced: 2 months ago
JSON representation

Dagster SLURM integration

• Host: GitHub
• URL: https://github.com/ascii-supply-networks/dagster-slurm
• Owner: ascii-supply-networks
• License: apache-2.0
• Created: 2025-08-01T20:17:12.000Z (2 months ago)
• Default Branch: main
• Last Pushed: 2025-08-10T13:21:55.000Z (2 months ago)
• Last Synced: 2025-08-10T13:22:52.713Z (2 months ago)
• Topics: dagster, feray, hpc, ray, slurm, spark
• Language: Python
• Homepage: https://ascii-supply-networks.github.io/dagster-slurm
• Size: 868 KB
• Stars: 1
• Watchers: 0
• Forks: 0
• Open Issues: 15
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

          
# dagster-slurm

[![image](https://img.shields.io/pypi/v/dagster-slurm.svg)](https://pypi.python.org/pypi/dagster-slurm)

[![image](https://img.shields.io/pypi/l/dagster-slurm.svg)](https://pypi.python.org/pypi/dagster-slurm)

[![image](https://img.shields.io/pypi/pyversions/dagster-slurm.svg)](https://pypi.python.org/pypi/dagster-slurm)

[![Ruff](https://img.shields.io/endpoint?url=https://raw.githubusercontent.com/astral-sh/ruff/main/assets/badge/v2.json)](https://github.com/astral-sh/ruff)

---

Integrating dagster to orchestrate slurm jobs for distributed systems like ray for a better developer experience on supercomputers.

As part of the hackathon (https://www.openhackathons.org/s/siteevent/a0CUP000013Tp8f2AC/se000375) we intend to work on this integration.

We are looking for more hands to join in - or review the task list so that we can make sure we are not missing anything.

- Tasks for implementation: https://github.com/orgs/ascii-supply-networks/projects/4

- Project lives here https://github.com/ascii-supply-networks/dagster-slurm

See the (draft) [documentation](https://ascii-supply-networks.github.io/dagster-slurm/)

> We are actively looking for contributions to bring this package to life together