https://github.com/reity/metatable
Extensible table data structure that supports the introduction of user-defined workflow combinators and the use of these combinators in concise workflow descriptions.
https://github.com/reity/metatable
python-data-structure python-library table-data
Last synced: 2 months ago
JSON representation
Extensible table data structure that supports the introduction of user-defined workflow combinators and the use of these combinators in concise workflow descriptions.
- Host: GitHub
- URL: https://github.com/reity/metatable
- Owner: reity
- License: mit
- Created: 2021-03-07T03:26:59.000Z (about 4 years ago)
- Default Branch: main
- Last Pushed: 2022-08-04T07:04:45.000Z (almost 3 years ago)
- Last Synced: 2025-01-23T12:30:28.633Z (4 months ago)
- Topics: python-data-structure, python-library, table-data
- Language: Python
- Homepage: https://pypi.org/project/metatable
- Size: 52.7 KB
- Stars: 0
- Watchers: 2
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.rst
- License: LICENSE
Awesome Lists containing this project
README
=========
metatable
=========
Extensible table data structure that supports the introduction of user-defined workflow combinators and the use of these combinators in concise workflow descriptions.
|pypi| |readthedocs| |actions| |coveralls|
.. |pypi| image:: https://badge.fury.io/py/metatable.svg
:target: https://badge.fury.io/py/metatable
:alt: PyPI version and link.
.. |readthedocs| image:: https://readthedocs.org/projects/metatable/badge/?version=latest
:target: https://metatable.readthedocs.io/en/latest/?badge=latest
:alt: Read the Docs documentation status.
.. |actions| image:: https://github.com/reity/metatable/workflows/lint-test-cover-docs/badge.svg
:target: https://github.com/reity/metatable/actions/workflows/lint-test-cover-docs.yml
:alt: GitHub Actions status.
.. |coveralls| image:: https://coveralls.io/repos/github/reity/metatable/badge.svg?branch=main
:target: https://coveralls.io/github/reity/metatable?branch=main
:alt: Coveralls test coverage summary.
Installation and Usage
----------------------
This library is available as a `package on PyPI `__::
python -m pip install metatable
The library can be imported in the usual ways::
import metatable
from metatable import *
Examples
^^^^^^^^
This library makes it possible to work with tabular data that is represented as a list of lists (*i.e.*, each row is a list of column values and a table is a list of rows)::
>>> from metatable import *
>>> t = metatable([['a', 0], ['b', 1], ['c', 2]])
>>> list(iter(t))
[['a', 0], ['b', 1], ['c', 2]]
.. |metatable| replace:: ``metatable``
.. _metatable: https://metatable.readthedocs.io/en/1.3.0/_source/metatable.html#metatable.metatable.metatable
All rows in a |metatable|_ instance can be updated in-place using a symbolic representation (implemented using the `symbolism `__ library) of the transformation that must be applied to each row. For example, the transformation ``{1: column(0)}`` indicates that the value in the column having index ``1`` (*i.e.*, the right-hand column) should be replaced with the value in the column having index ``0`` (*i.e.*, the left-hand column)::
>>> t.update({1: column(0)})
[['a', 'a'], ['b', 'b'], ['c', 'c']]
It is also possible to perform an update that removes rows based on a condition. The condition in the example below is the symbolic expression ``column(1) > symbol(0)`` (constructed using the `symbolism `__ library)::
>>> from symbolism import symbol
>>> t = metatable([['a', 0], ['b', 1], ['c', 2]])
>>> t.update_filter({0: column(1)}, column(1) > symbol(0))
[[1, 1], [2, 2]]
There is also support for working with a tabular data set in which there is a header row containing column names::
>>> t = metatable([['char', 'num'], ['a', 0], ['b', 1]], header=True)
>>> t.update({1: column(0)})
[['char', 'num'], ['a', 'a'], ['b', 'b']]
Development
-----------
All installation and development dependencies are fully specified in ``pyproject.toml``. The ``project.optional-dependencies`` object is used to `specify optional requirements `__ for various development tasks. This makes it possible to specify additional options (such as ``docs``, ``lint``, and so on) when performing installation using `pip `__::
python -m pip install .[docs,lint]
Documentation
^^^^^^^^^^^^^
The documentation can be generated automatically from the source files using `Sphinx `__::
python -m pip install .[docs]
cd docs
sphinx-apidoc -f -E --templatedir=_templates -o _source .. && make html
Testing and Conventions
^^^^^^^^^^^^^^^^^^^^^^^
All unit tests are executed and their coverage is measured when using `pytest `__ (see the ``pyproject.toml`` file for configuration details)::
python -m pip install .[test]
python -m pytest
Alternatively, all unit tests are included in the module itself and can be executed using `doctest `__::
python src/metatable/metatable.py -v
Style conventions are enforced using `Pylint `__::
python -m pip install .[lint]
python -m pylint src/metatable
Contributions
^^^^^^^^^^^^^
In order to contribute to the source code, open an issue or submit a pull request on the `GitHub page `__ for this library.
Versioning
^^^^^^^^^^
The version number format for this library and the changes to the library associated with version number increments conform with `Semantic Versioning 2.0.0 `__.
Publishing
^^^^^^^^^^
This library can be published as a `package on PyPI `__ by a package maintainer. First, install the dependencies required for packaging and publishing::
python -m pip install .[publish]
Ensure that the correct version number appears in ``pyproject.toml``, and that any links in this README document to the Read the Docs documentation of this package (or its dependencies) have appropriate version numbers. Also ensure that the Read the Docs project for this library has an `automation rule `__ that activates and sets as the default all tagged versions. Create and push a tag for this version (replacing ``?.?.?`` with the version number)::
git tag ?.?.?
git push origin ?.?.?
Remove any old build/distribution files. Then, package the source into a distribution archive::
rm -rf build dist src/*.egg-info
python -m build --sdist --wheel .
Finally, upload the package distribution archive to `PyPI `__::
python -m twine upload dist/*