https://github.com/tacc/tapis-hpc-jupyter
Jupyter notebook Tapis apps for TACC HPCs
https://github.com/tacc/tapis-hpc-jupyter
Last synced: about 2 months ago
JSON representation
Jupyter notebook Tapis apps for TACC HPCs
- Host: GitHub
- URL: https://github.com/tacc/tapis-hpc-jupyter
- Owner: TACC
- Created: 2020-01-14T16:19:57.000Z (almost 6 years ago)
- Default Branch: master
- Last Pushed: 2020-04-14T14:52:04.000Z (over 5 years ago)
- Last Synced: 2025-04-04T06:16:51.168Z (9 months ago)
- Language: Dockerfile
- Size: 31.3 KB
- Stars: 2
- Watchers: 6
- Forks: 1
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# tapis-hpc-jupyter
Jupyter notebook Tapis apps for TACC HPCs
NOTE:
> This implementation is designed use hosted singularity images in the CIC service account's Stockyard allocation to insure each job will not download a whole new set of images on a compute node. The images are referenced [here.](/frontera/src/wrapper.sh#L13) There is also specific [code](/get_port.py) that computes a unique port to be opened on a login node.
## Pre-requisites
- Have an [Oauth client setup and generate a token.](https://tacc-cloud.readthedocs.io/projects/agave/en/latest/agave/introduction/tutorials.html#create-an-oauth-client)
- Users must have an [allocation](https://fronteraweb.tacc.utexas.edu/user-guide/admin/#check-your-allocation-status) on Frontera to run a job.
## Deployment instructions
- Modify each definition below by replacing sections with [...] with relevant information
- NOTE: When modifying `/home1/[05747]/[USERNAME]/work`, be sure to update the number after `/home1/` to the one matching your account
- POST each definition to Tapis
- Once deployed, an email will be sent to the email defined in the [job.json.](/frontera/job.json) Multiple emails can be sent by putting spaces between each address.
### Storage System
```curl -sk -H "Authorization: Bearer $ACCESS_TOKEN" -F "fileToUpload=@storage_system.json" https://api.tacc.utexas.edu/systems/v2```
### Execution System
```curl -sk -H "Authorization: Bearer $ACCESS_TOKEN" -F "fileToUpload=@execution_system.json" https://api.tacc.utexas.edu/systems/v2```
### App
```curl -sk -H "Authorization: Bearer $ACCESS_TOKEN" -F "fileToUpload=@app.json" https://api.tacc.utexas.edu/apps/v2```
### Job
```curl -X POST --data "@job.json" -H "Content-Type:application/json" -H "Authorization:Bearer $ACCESS_TOKEN" https://api.tacc.utexas.edu/jobs/v2?pretty=true```
## Testing
NOTE:
> If on a system with a different configuration, it may be neccessary to alter the [hpcs.json](/hpcs.json) script.
Example testing frontera GPU for collisions: ```python3 get_port.py frontera gpu 45000 c196-112 -t```
Output:
```
INFO: Test mode ignores compute_node argument
c196-011 -> port: 45000
c196-012 -> port: 45001
c196-021 -> port: 45002
...
c199-112 -> port: 45093
c199-121 -> port: 45094
c199-122 -> port: 45095
TEST: No port collisions detected!
```