Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/shwars/mPyPl

Monadic Pipeline Library for Python
https://github.com/shwars/mPyPl

Last synced: about 2 months ago
JSON representation

Monadic Pipeline Library for Python

Awesome Lists containing this project

README

        

# mPyPl -- [Official Site](http://shwars.github.io/mPyPl)

## Monadic Pipeline Library for Python

This library was created by a team of enthusiastic software developers / data scientists at Microsoft, who
wanted to simplify tasks of data processing and creating complex data pipelines. The library is inspired
by the following main ideas:

* Using functional approach to data processing (which implies immutability, lazy evaluation, etc.)
* Using [pipe](https://github.com/JulienPalard/Pipe) module in Python to achieve data pipelines similar to
[F#](http://fsharp.org).
* Data pipeline uses dictionaries with different fields as base type, new operations would typically enrich data and add
new fields by using `apply` function. Those dictionaries are similar to *monads*, and `apply` is similar to *lift* operation
on monads. Thus the naming of the library.

## Tutorial

You can [watch demo video](https://www.youtube.com/watch?v=EI1ZYZPcQyI), this [3 min intro](https://youtu.be/F1c_qQC4Wlw), or read project wiki.

## Credits

Principal developers of mPyPl:

* [Dmitri Soshnikov](https://github.com/shwars)
* [Yana Valieva](https://github.com/vJenny)
* [Tim Scarfe](https://github.com/ecsplendid)

[![Binder](https://mybinder.org/badge_logo.svg)](https://mybinder.org/v2/gh/shwars/mPyPl/master)