https://github.com/jaantollander/workflows
Repository for testing various workflow tools and combinations on HPC clusters.
https://github.com/jaantollander/workflows
hyperqueue lmod netxflow slurm
Last synced: 6 months ago
JSON representation
Repository for testing various workflow tools and combinations on HPC clusters.
- Host: GitHub
- URL: https://github.com/jaantollander/workflows
- Owner: jaantollander
- License: mit
- Created: 2023-06-29T12:05:27.000Z (almost 3 years ago)
- Default Branch: main
- Last Pushed: 2023-07-17T11:07:26.000Z (almost 3 years ago)
- Last Synced: 2024-12-29T02:52:03.473Z (over 1 year ago)
- Topics: hyperqueue, lmod, netxflow, slurm
- Language: Shell
- Homepage:
- Size: 126 KB
- Stars: 0
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# Workflows
Repository for testing various workflow tools and combinations on HPC clusters.
## Hyperqueue
Installation
```bash
mkdir -p appl/hyperqueue/0.15.0
wget https://github.com/It4innovations/hyperqueue/releases/download/v0.15.0/hq-v0.15.0-linux-x64.tar.gz
tar xf hq-v0.15.0-linux-x64.tar.gz --directory=appl/hyperqueue/0.15.0
```
Use local modulefiles
```bash
module use "$PWD/modulefiles"
```
Running scripts
```bash
export SBATCH_ACCOUNT=project_
sbatch ./hyperqueue/.sh
```
Resources
- https://docs.csc.fi/apps/hyperqueue/
- https://csc-training.github.io/csc-env-eff/hands-on/throughput/hyperqueue.html