https://github.com/jbris/dataframe-processor
A simple R library to construct Extract - Transform - Load (ETL) pipelines and merge different datasets together
https://github.com/jbris/dataframe-processor
Last synced: 11 months ago
JSON representation
A simple R library to construct Extract - Transform - Load (ETL) pipelines and merge different datasets together
- Host: GitHub
- URL: https://github.com/jbris/dataframe-processor
- Owner: JBris
- License: mit
- Created: 2022-03-15T03:29:51.000Z (over 4 years ago)
- Default Branch: main
- Last Pushed: 2022-04-20T03:14:10.000Z (over 4 years ago)
- Last Synced: 2025-01-12T16:08:14.701Z (over 1 year ago)
- Language: R
- Homepage:
- Size: 35.2 KB
- Stars: 2
- Watchers: 2
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# dataframe-processor
## Table of Contents
* [Introduction](#introduction)
* [Pipeline Script](#pipeline-script)
* [Pipeline File](#pipeline-file)
### Introduction
A simple and lightweight R library to construct Extract - Transform - Load (ETL) pipelines.
Execute `init.sh` to initialise the pipeline tool. Several additional options are supported. Run `init.sh -h` for help.
Edit `.env` to specify your local environment variables as required. Define your pipeline using a `config.yaml` file. See [.env.example](.env.example) and [config.yaml.example](config.yaml.example) for examples of how to construct these files.
For working with relational databases, consider using the [ETL package](https://cran.rstudio.com/web/packages/etl/index.html).
### Pipeline Script
### Pipeline File