https://github.com/pystorm/streamparse

Run Python in Apache Storm topologies. Pythonic API, CLI tooling, and a topology DSL.
https://github.com/pystorm/streamparse

apache-storm python storm

Last synced: 30 days ago
JSON representation

Run Python in Apache Storm topologies. Pythonic API, CLI tooling, and a topology DSL.

• Host: GitHub
• URL: https://github.com/pystorm/streamparse
• Owner: pystorm
• License: apache-2.0
• Created: 2014-05-02T20:33:50.000Z (over 10 years ago)
• Default Branch: master
• Last Pushed: 2024-04-29T13:25:56.000Z (6 months ago)
• Last Synced: 2024-05-19T11:10:44.856Z (6 months ago)
• Topics: apache-storm, python, storm
• Language: Python
• Homepage: http://streamparse.readthedocs.io/
• Size: 6.15 MB
• Stars: 1,490
• Watchers: 103
• Forks: 218
• Open Issues: 74
• Metadata Files:
  • Readme: README.rst
  • Contributing: CONTRIBUTING.rst
  • License: LICENSE

Awesome Lists containing this project

• best-of-python - GitHub - 21% open · ⏱️ 21.04.2024): (Data Pipelines & Streaming)

README

        
|logo|

|Build Status|

Streamparse lets you run Python code against real-time streams of data via

Apache Storm.  With streamparse you can create Storm bolts and spouts in

Python without having to write a single line of Java.  It also provides handy

CLI utilities for managing Storm clusters and projects.

The Storm/streamparse combo can be viewed as a more robust alternative to Python

worker-and-queue systems, as might be built atop frameworks like Celery and RQ.

It offers a way to do "real-time map/reduce style computation" against live

streams of data. It can also be a powerful way to scale long-running, highly

parallel Python processes in production.

|Demo|

Documentation

-------------

* `HEAD `_

* `Stable `_

User Group

----------

Follow the project's progress, get involved, submit ideas and ask for help via

our Google Group, `[email protected] `__.

Contributors

------------

Alphabetical, by last name:

-  Dan Blanchard (`@dsblanch `__)

-  Keith Bourgoin (`@kbourgoin `__)

-  Arturo Filastò (`@hellais `__)

-  Jeffrey Godwyll (`@rey12rey `__)

-  Daniel Hodges (`@hodgesds `__)

-  Wieland Hoffmann (`@mineo `__)

-  Tim Hopper (`@tdhopper `__)

-  Omer Katz (`@thedrow `__)

-  Aiyesha Ma (`@Aiyesha `__)

-  Andrew Montalenti (`@amontalenti `__)

-  Rohit Sankaran (`@roadhead `__)

-  Viktor Shlapakov (`@vshlapakov `__)

-  Mike Sukmanowsky (`@msukmanowsky `__)

-  Cody Wilbourn (`@codywilbourn `__)

-  Curtis Vogt (`@omus `__)

Changelog

---------

See the `releases `__ page on

GitHub.

Roadmap

-------

See the `Roadmap `__.

.. |logo| image:: https://raw.githubusercontent.com/Parsely/streamparse/master/doc/source/images/streamparse-logo.png

.. |Build Status| image:: https://travis-ci.org/Parsely/streamparse.svg?branch=master

   :target: https://travis-ci.org/Parsely/streamparse

.. |Demo| image:: https://raw.githubusercontent.com/Parsely/streamparse/master/doc/source/images/quickstart.gif