Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/basis-os/basis-devkit

Data pipelines from re-usable components
https://github.com/basis-os/basis-devkit

data-analysis data-engineering data-pipeline data-pipelines data-science etl etl-framework etl-pipeline etl-pipelines functional-reactive-programming immutability pipelines sql

Last synced: 2 months ago
JSON representation

Data pipelines from re-usable components

Awesome Lists containing this project

README

        

 





 



Patterns - Build data systems from re-usable sql and python components

---

## Installation

`pip install patterns-devkit`

## Usage

`patterns create graph mygraph`

This will create an empty patterns graph:

```
mygraph/
graph.yml
```

Create a new python node:

```
cd mygraph
patterns create node mynode.py
```

```
mygraph/
graph.yml
mynode.py
```

## Upload

To deploy a graph, you must sign up for a [patterns.app](https://studio.patterns.app)
account and login to authenticate the cli:

`patterns login`

Then you can upload your graph:

`patterns upload`

## Other commands

You can see the full list of available cli commands:

```
patterns --help
```