https://github.com/unixjunkie/opipe

More generic version of the UNIX pipe
https://github.com/unixjunkie/opipe

Last synced: about 1 month ago
JSON representation

More generic version of the UNIX pipe

• Host: GitHub
• URL: https://github.com/unixjunkie/opipe
• Owner: UnixJunkie
• Created: 2013-04-18T02:30:11.000Z (over 11 years ago)
• Default Branch: master
• Last Pushed: 2013-04-18T02:46:31.000Z (over 11 years ago)
• Last Synced: 2023-03-22T11:08:13.410Z (over 1 year ago)
• Size: 109 KB
• Stars: 1
• Watchers: 2
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
opipe

=====

More generic version of the UNIX pipe

specification

=============

 - it is always possible to write in an opipe

 - if there is too much data into the pipe, it will

   be be backed by a file on disk

 - one can only read if something has previously written one record

 - be able to specify the field seperator function/program to use

   (a demultiplexer)

 - be able to specify the field aggregator function/program to use

   (a multiplexer)

 - be able to specify the function/program to use during map

 - set the number of cores to use during computation

 - set the number of blocks to read at once (default to 1)

dependencies

============

- OCaml

- OCaml batteries for an extended library

- Parmap for parallelization

- OPAM for packaging

- obuild would be nice to compile

TODO

====

- complete the specification