https://github.com/fako/datagrowth

Data engineering tools to create data mash ups using Django and Celery
https://github.com/fako/datagrowth

Last synced: 9 days ago
JSON representation

Data engineering tools to create data mash ups using Django and Celery

• Host: GitHub
• URL: https://github.com/fako/datagrowth
• Owner: fako
• License: lgpl-3.0
• Created: 2019-08-12T12:51:02.000Z (almost 7 years ago)
• Default Branch: master
• Last Pushed: 2024-04-23T15:12:59.000Z (about 2 years ago)
• Last Synced: 2024-04-24T02:17:34.656Z (about 2 years ago)
• Language: Python
• Homepage:
• Size: 2.59 MB
• Stars: 3
• Watchers: 3
• Forks: 0
• Open Issues: 2
• Metadata Files:
  • Readme: README.md
  • Changelog: CHANGELOG.md
  • License: LICENSE

Awesome Lists containing this project

README

          
[![datagrowth workflow](https://github.com/fako/datagrowth/actions/workflows/postgres.yml/badge.svg)](https://github.com/fako/datagrowth/actions) [![PyPI pyversions](https://img.shields.io/pypi/pyversions/datagrowth.svg)](https://pypi.python.org/pypi/datagrowth/) [![GPLv3 license](https://img.shields.io/badge/License-LGPLv3-blue.svg)](https://github.com/fako/datagrowth/blob/master/LICENSE)

DATAGROWTH

==========

Data Growth is a Django application that helps to gather data in an organized way. With it you can declare pipelines

for the data gathering and preprocessing as well as pipelines for filtering and redistribution.

Installation

------------

You can install Datagrowth with your Django application by running

```bash

pip install datagrowth

```

Getting started

---------------

Currently there are two major use cases.

The **Resources** provide a way to uniformly gather data from very different sources.

**Configurations** are a way to store and transfer key-value pairs,

which your code can use to act on different contexts.

Follow these guides to get an idea how you can use Datagrowth:

* [Resources](https://data-scope.com/datagrowth/resources/)

* [Configurations](https://data-scope.com/datagrowth/configuration/)

Running the tests

-----------------

There is a Django mock project inside the tests directory of the repository.

You can run these tests by running this inside that directory:

```bash

python manage.py test

```

Alternatively you can execute the tests against multiple Django versions by running:

```bash

tox

```