Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

https://github.com/codekitchen/pipeline

the `pipeline` shell command
https://github.com/codekitchen/pipeline

data-analysis data-mining shell-scripting

Last synced: 20 days ago
JSON representation

the `pipeline` shell command

Lists

README

        

# The `pipeline` shell command

A utility to make building up a pipeline of shell commands easier, especially when
doing data exploration.

If you've ever found yourself writing shell code, in an endless loop of piping
output to `less`, scanning it over and making changes, then `pipeline` can make
your life just a little bit more beautiful.

This is just a thin wrapper around your shell, not some totally new data mining
tool. Launch pipeline, and start typing shell commands as usual. Every time you
hit enter you'll see a one-screen preview of your output, similar to piping
output to `less`, but your cursor will stay right where it was for further
editing.

![](pipeline_demo.gif)

Ctrl-C when you're done.

## Installation

Pipeline depends only on ncurses and readline (or libedit), both of which ship with MacOS and most common Linux distros.

### MacOS

Install with [Homebrew](https://brew.sh).

```
brew tap codekitchen/pipeline
brew install pipeline
```

### From Source

You can download the latest release tarball from the [releases page](https://github.com/codekitchen/pipeline/releases), or git clone the repo to build the master branch.

```
autoreconf -fi # only if building from git, skip this for release tarballs
./configure
make
```

After make finishes, you'll be able to use `./pipeline`. You can also install it using:

```
sudo make install
```

### Windows

It might work under MinGW/GitBash? Please let me know.