Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/toolforge/grid-jobs

Mirror of https://phabricator.wikimedia.org/source/tool-grid-jobs/
https://github.com/toolforge/grid-jobs

mirror toolforge

Last synced: about 2 months ago
JSON representation

Mirror of https://phabricator.wikimedia.org/source/tool-grid-jobs/

Awesome Lists containing this project

README

        

sge-jobs
========

List tools running on Toolforge Son of Grid Engine exec nodes.

Install
-------

Clone repo and create basic files:
```
bastion$ become sge-jobs
tools.sge-jobs@bastion:~$ mkdir -p ~/www/python
tools.sge-jobs@bastion:~$ git clone https://phabricator.wikimedia.org/source/tool-grid-jobs.git ~/www/python/src
```

Create virtualenv inside kubernetes:
```
tools.sge-jobs@bastion:~$ webservice --backend=kubernetes python shell
tools.sge-jobs@interactive:~$ python3 -m venv ~/www/python/venv
tools.sge-jobs@interactive:~$ source ~/www/python/venv/bin/activate
(venv)tools.sge-jobs@interactive:~$ pip install -U pip
(venv)tools.sge-jobs@interactive:~$ pip install -r ~/www/python/src/requirements.txt
```

Back to bastion, start the webservice:
```
tools.sge-jobs@bastion:~$ webservice --backend=kubernetes python start
```

Creating the list is pretty expensive and we don't need it to be a real time
display, so a nice thing to do is setup a cron job to collect new data once an
hour:
```
21 * * * * jstart -N update-cache curl 'https://tools.wmflabs.org/sge-jobs/?purge'
```

License
-------
[GNU GPLv3+](//www.gnu.org/copyleft/gpl.html "GNU GPLv3+")

Forked from
[precise-tools](https://phabricator.wikimedia.org/source/tool-precise-tools/)