https://github.com/laureberti/learn2clean
Learn2Clean: Optimizing the Sequence of Tasks for Data Preparation and Cleaning
https://github.com/laureberti/learn2clean
automated data-cleaning data-cleaning-pipeline data-curation data-preprocessing reinforcement-learning
Last synced: 27 days ago
JSON representation
Learn2Clean: Optimizing the Sequence of Tasks for Data Preparation and Cleaning
- Host: GitHub
- URL: https://github.com/laureberti/learn2clean
- Owner: LaureBerti
- License: bsd-3-clause
- Created: 2019-03-29T15:35:49.000Z (over 6 years ago)
- Default Branch: master
- Last Pushed: 2022-12-26T20:53:17.000Z (almost 3 years ago)
- Last Synced: 2025-07-12T16:05:22.231Z (3 months ago)
- Topics: automated, data-cleaning, data-cleaning-pipeline, data-curation, data-preprocessing, reinforcement-learning
- Language: Python
- Homepage:
- Size: 34.6 MB
- Stars: 51
- Watchers: 2
- Forks: 20
- Open Issues: 9
-
Metadata Files:
- Readme: readme.rst
- Contributing: docs/contributing.rst
- License: LICENSE
Awesome Lists containing this project
README
.. image:: ./docs/images/learn2clean-text.png
-----------------------
**Learn2Clean: Optimizing the Sequence of Tasks for Data Preparation and Data Cleaning**
|Documentation Status| |PyPI version| |Build Status| |GitHub Issues| |codecov| |License|
-----------------------
Learn2Clean is a Python library for data preprocessing and cleaning based on Q-Learning, a model-free reinforcement learning technique. It selects, for a given dataset, a ML model, and a quality performance metric, the optimal sequence of tasks for preparing the data such that the quality of the ML model result is maximized.
You can try it for composing your own data preprocessing pipelines or for automizing data preparation before clustering, regression, and classification.
.. image:: ./docs/images/figure_Learn2Clean.jpeg
**For more details**, please refer to the paper presented at the Web Conf 2019 and the related tutorial.
- Laure Berti-Equille. Learn2Clean: Optimizing the Sequence of Tasks for Web Data Preparation. Proceedings of the Web Conf 2019, San Francisco, May 2019. `Preprint `__
- Laure Berti-Equille. ML to Data Management: A Round Trip. Tutorial Part I, ICDE 2018. `Tutorial `__
--------------------------
How to Contribute
=================
Learn2Clean is a research prototype. Your help is very valuable to make it better for everyone.
- Check out `call for contributions `__ to see what can be improved, or open an issue if you want something.
- Contribute to the `tests `__ to make it more reliable.
- Contribute to the `documents `__ to make it clearer for everyone.
- Contribute to the `examples `__ to share your experience with other users.
- Open `issue `__ if you met problems during development.
For more details, please refer to `CONTRIBUTING `__.
.. |Documentation Status| image:: https://readthedocs.org/projects/learn2clean/badge/?version=latest
:target: https://learn2clean.readthedocs.io/en/latest/
.. |PyPI version| image:: https://badge.fury.io/py/learn2clean.svg
:target: https://pypi.python.org/pypi/learn2clean
.. |Build Status| image:: https://travis-ci.org/LaureBerti/Learn2Clean.svg?branch=master
:target: https://travis-ci.org/LaureBerti/Learn2Clean
.. |GitHub Issues| image:: https://img.shields.io/github/issues/LaureBerti/Learn2Clean.svg
:target: https://github.com/LaureBerti/Learn2Clean/issues
.. |codecov| image:: https://codecov.io/gh/LaureBerti/Learn2Clean/branch/master/graph/badge.svg
:target: https://codecov.io/gh/LaureBerti/Learn2Clean
.. |License| image:: https://img.shields.io/badge/License-BSD%203--Clause-blue.svg
:target: https://github.com/LaureBerti/Learn2Clean/blob/master/LICENSE
--------------------------
Licence
=================
Learn2Clean is licensed under the BSD 3-Clause "New" or "Revised" License.