Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/pystorm/streamparse
Run Python in Apache Storm topologies. Pythonic API, CLI tooling, and a topology DSL.
https://github.com/pystorm/streamparse
apache-storm python storm
Last synced: 2 days ago
JSON representation
Run Python in Apache Storm topologies. Pythonic API, CLI tooling, and a topology DSL.
- Host: GitHub
- URL: https://github.com/pystorm/streamparse
- Owner: pystorm
- License: apache-2.0
- Created: 2014-05-02T20:33:50.000Z (over 10 years ago)
- Default Branch: main
- Last Pushed: 2024-08-09T15:10:50.000Z (4 months ago)
- Last Synced: 2024-10-29T15:33:32.937Z (about 2 months ago)
- Topics: apache-storm, python, storm
- Language: Python
- Homepage: http://streamparse.readthedocs.io/
- Size: 6.16 MB
- Stars: 1,495
- Watchers: 101
- Forks: 218
- Open Issues: 58
-
Metadata Files:
- Readme: README.rst
- Contributing: CONTRIBUTING.rst
- License: LICENSE
Awesome Lists containing this project
- best-of-python - GitHub - 21% open · ⏱️ 21.04.2024): (Data Pipelines & Streaming)
README
|logo|
|Build Status| |Docs Status|
Streamparse lets you run Python code against real-time streams of data via
Apache Storm. With streamparse you can create Storm bolts and spouts in
Python without having to write a single line of Java. It also provides handy
CLI utilities for managing Storm clusters and projects.
The Storm/streamparse combo can be viewed as a more robust alternative to Python
worker-and-queue systems, as might be built atop frameworks like Celery and RQ.
It offers a way to do "real-time map/reduce style computation" against live
streams of data. It can also be a powerful way to scale long-running, highly
parallel Python processes in production.
|Demo|
Documentation
-------------
* `HEAD `_
* `Stable `_
User Group
----------
Follow the project's progress, get involved, submit ideas and ask for help via
our Google Group, `[email protected] `__.
Contributors
------------
Alphabetical, by last name:
- Dan Blanchard (`@dsblanch `__)
- Keith Bourgoin (`@kbourgoin `__)
- Arturo Filastò (`@hellais `__)
- Jeffrey Godwyll (`@rey12rey `__)
- Daniel Hodges (`@hodgesds `__)
- Wieland Hoffmann (`@mineo `__)
- Tim Hopper (`@tdhopper `__)
- Omer Katz (`@thedrow `__)
- Aiyesha Ma (`@Aiyesha `__)
- Andrew Montalenti (`@amontalenti `__)
- Rohit Sankaran (`@roadhead `__)
- Viktor Shlapakov (`@vshlapakov `__)
- Mike Sukmanowsky (`@msukmanowsky `__)
- Cody Wilbourn (`@codywilbourn `__)
- Curtis Vogt (`@omus `__)
Changelog
---------
See the `releases `__ page on
GitHub.
Roadmap
-------
See the `Roadmap `__.
.. |logo| image:: https://raw.githubusercontent.com/Parsely/streamparse/master/doc/images/streamparse-logo.png
.. |Build Status| image:: https://github.com/pystorm/streamparse/actions/workflows/test.yml/badge.svg
:target: https://github.com/pystorm/streamparse/actions/workflows/test.yml
:alt: Build Status
.. |Docs Status| image:: https://readthedocs.org/projects/streamparse/badge/?version=latest
:target: https://streamparse.readthedocs.io/en/stable/?badge=latest
:alt: Documentation Status
.. |Demo| image:: https://raw.githubusercontent.com/Parsely/streamparse/master/doc/source/images/quickstart.gif