https://github.com/ehrenamt/basicetl
A basic tool for ETL processes, mostly for local work.
https://github.com/ehrenamt/basicetl
data-science etl python
Last synced: 11 months ago
JSON representation
A basic tool for ETL processes, mostly for local work.
- Host: GitHub
- URL: https://github.com/ehrenamt/basicetl
- Owner: ehrenamt
- Created: 2025-06-27T23:56:39.000Z (about 1 year ago)
- Default Branch: main
- Last Pushed: 2025-08-13T07:41:01.000Z (11 months ago)
- Last Synced: 2025-08-13T09:26:00.788Z (11 months ago)
- Topics: data-science, etl, python
- Language: Python
- Homepage:
- Size: 188 KB
- Stars: 0
- Watchers: 0
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# basicetl
> [WORK IN PROGRESS]
> A basic tool for ETL processes, mostly for local work.
# Description
basicetl simplifies ETL processes by abstracting error checking and extracting logic. Simply provide the sources, whether local files or via a remote resource, and specify the transformation and output.
Useful for bootstrapping local data analysis and ML projects.
Currently does not work with zipped files, but it should be a simple fix. I am working on SQL support as well, but without security features.
It supports
- Extracting from local ```csv```, ```JSON```, ```XML``` files.
- Extracting from remote ```csv```, ```JSON```, ```XML``` files via URL.
I plan to support extracting from SQL databases, to be added later once I have finished all features for the above data types.
# Examples
WIP
# Installation and Packages
WIP
# Tests
WIP. Tests are written using ```pytest``` and are located in the ```test``` subdirectory.