https://github.com/pygridtools/gridmap
Easily map Python functions onto a cluster using a DRMAA-compatible grid engine like Sun Grid Engine (SGE).
https://github.com/pygridtools/gridmap
grid grid-engine hacktoberfest linux
Last synced: 25 days ago
JSON representation
Easily map Python functions onto a cluster using a DRMAA-compatible grid engine like Sun Grid Engine (SGE).
- Host: GitHub
- URL: https://github.com/pygridtools/gridmap
- Owner: pygridtools
- License: gpl-3.0
- Created: 2013-01-29T16:24:00.000Z (about 13 years ago)
- Default Branch: master
- Last Pushed: 2023-02-27T13:58:30.000Z (about 3 years ago)
- Last Synced: 2025-10-20T16:42:50.952Z (5 months ago)
- Topics: grid, grid-engine, hacktoberfest, linux
- Language: Python
- Homepage:
- Size: 829 KB
- Stars: 84
- Watchers: 13
- Forks: 34
- Open Issues: 32
-
Metadata Files:
- Readme: README.rst
- License: LICENSE.txt
Awesome Lists containing this project
README
GridMap
-----------
.. image:: https://img.shields.io/travis/pygridtools/gridmap/stable.svg
:alt: Build status
:target: https://travis-ci.org/pygridtools/gridmap
.. image:: https://img.shields.io/coveralls/pygridtools/gridmap/stable.svg
:target: https://coveralls.io/r/pygridtools/gridmap
.. image:: https://img.shields.io/pypi/dm/gridmap.svg
:target: https://warehouse.python.org/project/gridmap/
:alt: PyPI downloads
.. image:: https://img.shields.io/pypi/v/gridmap.svg
:target: https://warehouse.python.org/project/gridmap/
:alt: Latest version on PyPI
.. image:: https://img.shields.io/pypi/l/gridmap.svg
:alt: License
A package to allow you to easily create jobs on the cluster directly from
Python. You can directly map Python functions onto the cluster without needing
to write any wrapper code yourself.
This is the ETS fork of an older project called `Python Grid `__. Unlike the older
version, it is Python 2/3 compatible. Another major difference is that you can
change the configuration via environment variables instead of having to modify
a Python file in your ``site-packages`` directory. We've also fixed some bugs.
For some examples of how to use it, check out ``map_reduce.py`` (for a simple
example of how you can map a function onto the cluster) and ``manual.py`` (for
an example of how you can create list of jobs yourself) in the examples folder.
For complete documentation `read the docs `__.
*NOTE*: You cannot use GridMap on machines that are not allowed to submit jobs
(e.g., worker or edge nodes).
Requirements
~~~~~~~~~~~~
- `cloudpickle `__
- `drmaa `__
- `psutil `__
- `pyzmq `__
- Python 2.7+
Acknowledgments
~~~~~~~~~~~~~~~
Thank you to `Max-Planck-Society `__ and
`Educational Testing Service `__ for
funding the development of GridMap.
Changelog
~~~~~~~~~
See `GitHub releases `__.