https://github.com/mobiletelesystems/etl-entities
Basic ETL Entity classes for onETL
https://github.com/mobiletelesystems/etl-entities
etl onetl
Last synced: about 1 year ago
JSON representation
Basic ETL Entity classes for onETL
- Host: GitHub
- URL: https://github.com/mobiletelesystems/etl-entities
- Owner: MobileTeleSystems
- License: apache-2.0
- Created: 2022-12-19T15:16:31.000Z (over 3 years ago)
- Default Branch: develop
- Last Pushed: 2025-03-11T08:37:55.000Z (about 1 year ago)
- Last Synced: 2025-04-23T05:58:41.290Z (about 1 year ago)
- Topics: etl, onetl
- Language: Python
- Homepage: https://etl-entities.readthedocs.io/
- Size: 582 KB
- Stars: 5
- Watchers: 3
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.rst
- Contributing: CONTRIBUTING.rst
- License: LICENSE.txt
- Security: SECURITY.rst
Awesome Lists containing this project
README
.. title
ETL Entities
============
|Repo Status| |PyPI Latest Release| |PyPI License| |PyPI Python Version| |PyPI Downloads|
|Documentation| |CI Status| |Test Coverage| |pre-commit.ci Status|
.. |Repo Status| image:: https://www.repostatus.org/badges/latest/active.svg
:alt: Repo status - Active
:target: https://github.com/MobileTeleSystems/etl-entities
.. |PyPI Latest Release| image:: https://img.shields.io/pypi/v/etl-entities
:alt: PyPI - Latest Release
:target: https://pypi.org/project/etl-entities/
.. |PyPI License| image:: https://img.shields.io/pypi/l/etl-entities.svg
:alt: PyPI - License
:target: https://github.com/MobileTeleSystems/etl-entities/blob/develop/LICENSE.txt
.. |PyPI Python Version| image:: https://img.shields.io/pypi/pyversions/etl-entities.svg
:alt: PyPI - Python Version
:target: https://pypi.org/project/etl-entities/
.. |PyPI Downloads| image:: https://img.shields.io/pypi/dm/etl-entities
:alt: PyPI - Downloads
:target: https://pypi.org/project/etl-entities/
.. |Documentation| image:: https://readthedocs.org/projects/etl-entities/badge/?version=stable
:alt: Documentation - ReadTheDocs
:target: https://etl-entities.readthedocs.io/
.. |CI Status| image:: https://github.com/MobileTeleSystems/etl-entities/workflows/Tests/badge.svg
:alt: Github Actions - latest CI build status
:target: https://github.com/MobileTeleSystems/etl-entities/actions
.. |Test Coverage| image:: https://codecov.io/gh/MobileTeleSystems/etl-entities/branch/develop/graph/badge.svg?token=RIO8URKNZJ
:alt: Test coverage - percent
:target: https://codecov.io/gh/MobileTeleSystems/etl-entities
.. |pre-commit.ci Status| image:: https://results.pre-commit.ci/badge/github/MobileTeleSystems/etl-entities/develop.svg
:alt: pre-commit.ci - status
:target: https://results.pre-commit.ci/latest/github/MobileTeleSystems/etl-entities/develop
What is ETL Entities?
-----------------------
Collection of classes & decorators used for handling High Water Mark (HWM).
Currently implemented:
* HWM classes:
* ``ColumnIntHWM``
* ``ColumnDateHWM``
* ``ColumnDateTimeHWM``
* ``FileListHWM``
* ``FileModifiedTimeHWM``
* ``KeyValueIntHWM``
* HWM Store classes:
* ``BaseHWMStore`` (base interface)
* ``MemoryHWMStore``
.. installation
How to install
---------------
.. code:: bash
pip install etl-entities
.. documentation
Documentation
-------------
See https://etl-entities.readthedocs.io/