Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/marcua/datools
https://github.com/marcua/datools
Last synced: about 2 months ago
JSON representation
- Host: GitHub
- URL: https://github.com/marcua/datools
- Owner: marcua
- License: other
- Created: 2021-05-09T15:24:35.000Z (almost 4 years ago)
- Default Branch: main
- Last Pushed: 2023-05-30T09:59:02.000Z (over 1 year ago)
- Last Synced: 2024-12-26T07:07:29.832Z (about 2 months ago)
- Language: Python
- Size: 137 KB
- Stars: 115
- Watchers: 8
- Forks: 4
- Open Issues: 18
-
Metadata Files:
- Readme: README.md
- Changelog: HISTORY.md
- Contributing: CONTRIBUTING.md
- License: LICENSE
- Authors: AUTHORS.md
Awesome Lists containing this project
README
# `datools`
[](https://datools.readthedocs.io/en/latest/?version=latest) [](https://pypi.python.org/pypi/datools) [](https://github.com/marcua/datools/actions/workflows/python-tests.yml) [](https://github.com/marcua/datools/blob/main/LICENSE)## Introduction
`datools` is a collection of Python-based tools for working with data in relational databases. While it contains several utilities for smoothing the rough edges of SQL, its most baked component is `datools.diff`, an algorithm that's best explained in a [blog post](https://blog.marcua.net/2022/02/20/data-diffs-algorithms-for-explaining-what-changed-in-a-dataset.html) and [Jupyter Notebook](https://github.com/marcua/datools/blob/main/examples/diff/intel-sensor.ipynb).To learn more, [read the docs](https://datools.readthedocs.io/en/latest/index.html) or [reach out](https://twitter.com/marcua/).
## Database support
While `datools` generates SQL for its operations, different databases
have their nuances. `datools` may run on your database today, but in
an attempt to give you some certainty as to databases we know it has
successfully run on, we run all tests in the test suite against the
following databases:| Database | Evaluated by test suite |
| ----------- | ----------- |
| SQLite | Since v0.1.2 |
| DuckDB | Since v0.1.4 |
| PostgreSQL | Since v0.1.5 |
| Redshift, Snowflake | *You provide an instance, I'll make the tests pass* |