Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/pipebase/pipebase

data integration framework
https://github.com/pipebase/pipebase

api-integration data-engineering declarative-pipeline

Last synced: about 2 months ago
JSON representation

data integration framework

Host: GitHub
URL: https://github.com/pipebase/pipebase
Owner: pipebase
License: apache-2.0
Created: 2021-06-04T12:13:56.000Z (over 3 years ago)
Default Branch: main
Last Pushed: 2022-04-15T16:47:23.000Z (over 2 years ago)
Last Synced: 2024-10-31T10:36:24.246Z (about 2 months ago)
Topics: api-integration, data-engineering, declarative-pipeline
Language: Rust
Homepage:
Size: 4.85 MB
Stars: 9
Watchers: 2
Forks: 0
Open Issues: 0
Metadata Files:
- Readme: README.md
- License: LICENSE

Awesome Lists containing this project

README

        




[![Build Status]][travis]

[Build Status]: https://github.com/pipebase/pipebase/actions/workflows/ci.yml/badge.svg

[travis]: https://github.com/pipebase/pipebase/actions?branch%3Amain






`pipebase` is a data integration framework, provides:

* *manifest*, YAML specification of pipe / custom data object

* *cli tool*, build data integration app with manifest

* *plugins*, customized pipes using third party SDK

[Quick Start] | [Examples] | [Templates]

## Overview

`pipebase` is composed of three main components

* **build**: [`pipegen`], [`cargo-pipe`], [`schema`]

* **runtime**: [`pipebase`]

* **plugins**: [`pipeware`]

[`cargo-pipe`]: https://github.com/pipebase/pipebase/tree/main/cargo-pipe

[`pipebase`]: https://github.com/pipebase/pipebase/tree/main/pipebase

[`pipegen`]: https://github.com/pipebase/pipebase/tree/main/pipegen

[`pipeware`]: https://github.com/pipebase/pipebase/tree/main/pipeware

[`examples`]: https://github.com/pipebase/pipebase/tree/main/examples

[Examples]: https://github.com/pipebase/pipebase/tree/main/examples

[`schema`]: https://github.com/pipebase/schema

[Templates]: https://github.com/pipebase/template

[Quick Start]: https://github.com/pipebase/pipebase/blob/main/cargo-pipe/README.md