https://github.com/dansan/python-zmq-message-patterns
Library to quickly build ZeroMQ based applications.
https://github.com/dansan/python-zmq-message-patterns
concurrency messaging parallel-processing pubsub python zeromq zeromq-library zmq
Last synced: 20 days ago
JSON representation
Library to quickly build ZeroMQ based applications.
- Host: GitHub
- URL: https://github.com/dansan/python-zmq-message-patterns
- Owner: dansan
- License: mit
- Created: 2018-04-21T09:34:41.000Z (about 8 years ago)
- Default Branch: master
- Last Pushed: 2019-06-23T23:59:35.000Z (almost 7 years ago)
- Last Synced: 2025-12-15T17:57:18.286Z (4 months ago)
- Topics: concurrency, messaging, parallel-processing, pubsub, python, zeromq, zeromq-library, zmq
- Language: Python
- Size: 22.5 KB
- Stars: 0
- Watchers: 1
- Forks: 0
- Open Issues: 2
-
Metadata Files:
- Readme: README.rst
- License: LICENSE
Awesome Lists containing this project
README
python-zmq-message-patterns
===========================
Library to quickly build ZeroMQ based Python applications.
Introduction
------------
Library to make writing applications using `ZeroMQ `_ message patterns through `PyZMQ `_ easier.
TODO: explain ``ZMessage`` and ``ZNode`` classes.
Install
-------
Install through pip::
pip install zmq-message-patterns
Pipeline
--------
A ventilator sends jobs to multiple worker processes, which send the results to a sink.
Channels:
* ventilator -> worker: jobs for the workers
* ventilator -> sink: IDs of jobs sent to workers, so sink knows if all jobs have completed
* worker -> sink: results
* sink -> worker: sink sends shutdown command, when finished
Diagram::
ventilator-------------+
| |
+-------+------+ |
| | | |
worker worker worker ... |
|| || || |
++------++----++ |
|| |
sink----------------+
An is a fully functional example in the examples directory (``examples/pipeline_example.py``).