Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://mcieslik-mctp.github.io/papy/

The papy package provides an implementation of the flow-based programming paradigm in Python
https://mcieslik-mctp.github.io/papy/

Last synced: about 14 hours ago
JSON representation

The papy package provides an implementation of the flow-based programming paradigm in Python

Awesome Lists containing this project

README

        

**PaPy** - Parallel Pipelines in Python
#######################################

The ``papy`` package provides an implementation of the flow-based programming
paradigm in Python that enables the construction and deployment of distributed
workflows.

The ``NuMap`` package is a parallel (thread- or process-based, local or
remote), buffered, multi-task, ``itertools.imap`` or
``multiprocessing.Pool.imap`` function replacment. Like ``imap`` it
evaluates a function on elements of a sequence or iterable, and it does so
lazily. Laziness can be adjusted via the "stride" and "buffer" arguments.
Unlike ``imap``, ``NuMap`` supports **multiple pairs** of function and
iterable **tasks**. The **tasks** are **not** queued rather they are
**interwoven** and share a pool or **worker** "processes" or "threads" and
a memory "buffer".

Documentation can be found `here `_

The package is tested on Python 2.7.6