Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/jsta/wisc_chtc_examples
Worked examples and templates for the Wisconsin CHTC
https://github.com/jsta/wisc_chtc_examples
Last synced: about 1 month ago
JSON representation
Worked examples and templates for the Wisconsin CHTC
- Host: GitHub
- URL: https://github.com/jsta/wisc_chtc_examples
- Owner: jsta
- Created: 2020-12-22T18:09:52.000Z (about 4 years ago)
- Default Branch: main
- Last Pushed: 2021-05-11T18:16:08.000Z (over 3 years ago)
- Last Synced: 2024-06-11T17:09:24.654Z (7 months ago)
- Language: Makefile
- Homepage:
- Size: 49.8 KB
- Stars: 0
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
## Worked examples and templates for the Wisconsin CHTC
### Submit file
Every CHTC job has a "submit" file which specifies 1) The path to an `executable` shell script and 2) the paths to one or more `transfer_input_files` to transfer to the job server.
Submit file template
```
# template.sub
# starter submit file for CHTC jobs
universe = vanilla
log = job_$(Cluster).log
error = job_$(Cluster)_$(Process).err
output = job_$(Cluster)_$(Process).out
executable =
arguments =
should_transfer_files = YES
when_to_transfer_output = ON_EXIT
transfer_input_files =
request_cpus = 1
request_memory = 1GB
request_disk = 1GB
queue 1
```
### Executable shell script
Every CHTC job has an executable shell script that optionally sets up job files/environments and runs commands/scripts.
Shell script template
```
#!/bin/bash
# setup job files/environments
tar -xzf jobfiles.tar.gz
# run an R/python/other script
python jobscript.py
```
## Cheatsheet
Run an interactive job with: `condor_submit -i sub_file`
[Transfer files using `scp`](https://chtc.cs.wisc.edu/connecting.shtml):
```shell
# push
scp file [email protected]:/home/username
# pull
scp username@[email protected]:/home/username/file ./
```
Remove "held" jobs
```shell
condor_rm $JOB_ID
```
## Links
https://chtc.cs.wisc.edu/
https://github.com/CHTC/chtc-website-source
https://chtc.cs.wisc.edu/file-avail-squid