https://github.com/thruflo/close.consumer
gevent based Streaming API consumer
https://github.com/thruflo/close.consumer
Last synced: 5 months ago
JSON representation
gevent based Streaming API consumer
- Host: GitHub
- URL: https://github.com/thruflo/close.consumer
- Owner: thruflo
- Created: 2010-03-19T21:38:04.000Z (about 16 years ago)
- Default Branch: master
- Last Pushed: 2011-11-18T08:50:27.000Z (over 14 years ago)
- Last Synced: 2026-01-05T14:15:11.686Z (5 months ago)
- Language: Python
- Homepage:
- Size: 106 KB
- Stars: 8
- Watchers: 1
- Forks: 3
- Open Issues: 0
-
Metadata Files:
- Readme: README.rst
Awesome Lists containing this project
README
Abstract base classes for a long running, streaming API consumer and a specific implementation that puts the data into a redis_ queue and processes it in batches.
Requires gevent_. The example implementation depends on redis_.
Coded initially to send batches of statuses from the `Twitter Streaming API`_ to an appengine webhook. May (or may not) be usable for other purposes.
Presumes the data coming down the pipe is `Chunked Transfer Encoded`_.
.. _redis: http://code.google.com/p/redis/
.. _gevent: http://www.gevent.org/
.. _Twitter Streaming API: http://apiwiki.twitter.com/Streaming-API-Documentation
.. _Chunked Transfer Encoded: http://en.wikipedia.org/wiki/Chunked_transfer_encoding