https://github.com/goerz/clusterjob

Manage traditional HPC cluster workflows in Python
https://github.com/goerz/clusterjob

hpc python slurm

Last synced: 2 months ago
JSON representation

Manage traditional HPC cluster workflows in Python

• Host: GitHub
• URL: https://github.com/goerz/clusterjob
• Owner: goerz
• License: mit
• Created: 2015-03-22T21:56:42.000Z (almost 11 years ago)
• Default Branch: develop
• Last Pushed: 2018-04-06T17:20:11.000Z (almost 8 years ago)
• Last Synced: 2025-02-01T11:03:20.688Z (11 months ago)
• Topics: hpc, python, slurm
• Language: Python
• Size: 193 KB
• Stars: 13
• Watchers: 5
• Forks: 2
• Open Issues: 1
• Metadata Files:
  • Readme: README.markdown
  • License: LICENSE

Awesome Lists containing this project

README

          
# clusterjob

[![PyPI version](https://badge.fury.io/py/clusterjob.svg)](https://badge.fury.io/py/clusterjob)

[![Build Status](https://travis-ci.org/goerz/clusterjob.svg?branch=develop)](https://travis-ci.org/goerz/clusterjob)

[![Documentation Status](https://readthedocs.org/projects/clusterjob/badge/?version=latest)](http://clusterjob.readthedocs.org/en/latest/?badge=latest)

[![Coverage Status](https://coveralls.io/repos/goerz/clusterjob/badge.svg?branch=develop&service=github)](https://coveralls.io/github/goerz/clusterjob?branch=develop)

Python library to manage workflows on traditional HPC cluster systems.

The library provides the `JobScript` class that wraps around shell scripts,

allowing them to be submitted to a local or remote HPC cluster scheduling

system. The resource requirements (nodes, CPUs, runtime, etc.) for the scheduler

are stored in the attributes of the JobScript object.

[Read the full documentation on ReadTheDocs](http://clusterjob.readthedocs.org/en/latest/)

At present, the following schedulers are supported:

*   [SLURM](https://computing.llnl.gov/linux/slurm/) (default)

*   [Torque/PBS](http://www.adaptivecomputing.com/products/open-source/torque/)

*   [PBS Pro](http://www.pbsworks.com/PBSProduct.aspx?n=PBS-Professional&c=Overview-and-Capabilities)

*   [LPBS](https://github.com/goerz/LPBS)

*   [LSF](http://www.platform.com/Products/platform-lsf)

*   [Sun Grid Engine (SGE)](http://en.wikipedia.org/wiki/Oracle_Grid_Engine) (deprecated)

Support for the

[Univa Grid Engine (UGE)](http://www.univa.com/products/grid-engine.php)

is planned.

## Installation

    pip install clusterjob