https://github.com/zachsa/msc-2018-couchapps
Source code related UCT MSc IT (2018). Couchapps were used to do stats calcs on top of the CouchDB indices)
https://github.com/zachsa/msc-2018-couchapps
Last synced: about 1 year ago
JSON representation
Source code related UCT MSc IT (2018). Couchapps were used to do stats calcs on top of the CouchDB indices)
- Host: GitHub
- URL: https://github.com/zachsa/msc-2018-couchapps
- Owner: zachsa
- Created: 2020-03-08T08:37:47.000Z (over 6 years ago)
- Default Branch: master
- Last Pushed: 2020-03-08T08:38:14.000Z (over 6 years ago)
- Last Synced: 2025-03-13T00:15:03.322Z (over 1 year ago)
- Language: JavaScript
- Size: 74.2 KB
- Stars: 0
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
## nETL (node.js Extraction Transform load)
This library provides a general purpose framework for extracting, transforming and loading data. All these (extraction source, transformations, and loading) are configurable (see below for examples). The idea is simple - create an iterator over a source, and then incrementally extract from that source, apply transformations and load data.
## How to use
download the source, run `npm install`, and then (from the source code root directory) run `node index `
## Config file
This is a JSON file in which all extractions, transformations and loads are configured. Included in the repository is a file `example.config.json` that shows all existing extraction, transform and load tasks. Of course, you can register your own tasks! (to be included in future documentation). Note that the config file can have any extension so long as the format is strictly json - so you may want to call your file `config`.
# Query Deployment
`couchapp push . http://admin:password@localhost:5984/grades`
`couchapp push . http://admin:password@localhost:5984/variance-benchmarks`
`couchapp push . http://admin:password@localhost:5984/correlation-grades`
`couchapp push . http://admin:password@localhost:5984/correlation-events`