https://github.com/andersy005/hpc-tools
https://github.com/andersy005/hpc-tools
Last synced: 11 months ago
JSON representation
- Host: GitHub
- URL: https://github.com/andersy005/hpc-tools
- Owner: andersy005
- License: mit
- Created: 2018-09-12T01:46:57.000Z (over 7 years ago)
- Default Branch: master
- Last Pushed: 2020-11-30T14:20:40.000Z (over 5 years ago)
- Last Synced: 2025-03-28T23:37:49.082Z (about 1 year ago)
- Language: Python
- Size: 24.4 KB
- Stars: 0
- Watchers: 2
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# Cheatsheet
- [Cheatsheet](#cheatsheet)
- [1. Glade Quota: `gladequota`](#1-glade-quota-gladequota)
- [2. Using environment modules](#2-using-environment-modules)
- [3. Interacting with the job schedulers](#3-interacting-with-the-job-schedulers)
- [3.1 PBS on Cheyenne](#31-pbs-on-cheyenne)
- [3.2 Slurm on DAV](#32-slurm-on-dav)
- [4. Accessing Geyser, and Caldera using the Slurm scheduler](#4-accessing-geyser-and-caldera-using-the-slurm-scheduler)
- [4.1. Basic commands for managing jobs when using Slurm](#41-basic-commands-for-managing-jobs-when-using-slurm)
- [4.2. Starting interactive jobs](#42-starting-interactive-jobs)
## 1. Glade Quota: `gladequota`
```
abanihi@cheyenne1: ~ $ gladequota
Current GLADE space usage: abanihi
Space Used Quota % Full # Files
---------------------------------- ----------- ----------- --------- -----------
/glade/scratch/abanihi 0.00 TB 10.00 TB 0.00 % 4
/glade/work/abanihi 0.64 GB 1024.00 GB 0.06 % 14098
/glade/scratch_old/abanihi 0.00 TB 10.00 TB 0.00 % 741
/glade/p_old/work/abanihi 0.00 GB 512.00 GB 0.00 % 1
/glade/u/home/abanihi 1.54 GB 50.00 GB 3.08 % 19414
/glade/scratch - 38.1% used (5712 TB used out of 15000 TB total)
```
## 2. Using environment modules
- `module add/remove `
- `module avail`: show all currently-loadable modules
- `module list` : show loaded modules
- `module purge` : remove all loaded modules
- `module save/restore ` : create/load a saved set of software
- `module spider ` : search for a particular module
## 3. Interacting with the job schedulers
### 3.1 PBS on Cheyenne
- `qsub ` : submit batch job
- `qstat <jobid>` : query job status
- `qdel <jobid>` : delete/kill a job
- `qinteractive -A <project>` : Run an interactive job
- `qcmd -A <project> -- cmd.exe` : Run a command on a single compute node
- `qselect -u <username> | xargs qdel` : delete all my jobs at once, not one at a time
### 3.2 Slurm on DAV
- `sbatch <script>` : Submit batch job
- `squeue -j <jobid>` : query job status
- `scancel <jobid>` : delete/kill a job
- `execdev -A <project>` : Run interactive job on DAV
- `execca -A <project>` :
- `execgy -A <project>` :
- `execgpu -A <project>` :
## 4. Accessing Geyser, and Caldera using the Slurm scheduler
### 4.1. Basic commands for managing jobs when using Slurm
- `squeue -u $USER`: list your current job
- `scontrol show job <ID>` : examine a job in detail
- `scancel <ID>` : kill a job
### 4.2. Starting interactive jobs
- `execgy -a <project>` : run on a geyser node
- `execca -a <project>` : run on a caldera node
- `execdav -a <project>` : run on the first available DAV resources (caldera, geyser), regardless of location