An open API service indexing awesome lists of open source software.

https://github.com/cinterloper/movement

Parallel Dataflow System
https://github.com/cinterloper/movement

Last synced: 6 months ago
JSON representation

Parallel Dataflow System

Awesome Lists containing this project

README

          

Movement: A system for moving data from an emitter to an output via an encoder.

emiter-encoder-output triples are organized in one or more concurrent pipelines.

A WorkChunkDriver driver drives the system forward, and an Output ID driver provides an id for every emittable written to the output.