https://github.com/robert-koch-institut/mex-drop
RKI Metadata Exchange | API and GUI micro service for distributing metadata items before it gets picked up by ETL-pipelines for further processing.
https://github.com/robert-koch-institut/mex-drop
data-ingestion python research-data
Last synced: 4 months ago
JSON representation
RKI Metadata Exchange | API and GUI micro service for distributing metadata items before it gets picked up by ETL-pipelines for further processing.
- Host: GitHub
- URL: https://github.com/robert-koch-institut/mex-drop
- Owner: robert-koch-institut
- License: mit
- Created: 2023-06-26T07:44:20.000Z (about 3 years ago)
- Default Branch: main
- Last Pushed: 2026-02-26T04:01:18.000Z (4 months ago)
- Last Synced: 2026-02-26T08:34:13.731Z (4 months ago)
- Topics: data-ingestion, python, research-data
- Language: Python
- Homepage: https://robert-koch-institut.github.io/mex-drop/
- Size: 1.7 MB
- Stars: 6
- Watchers: 4
- Forks: 0
- Open Issues: 7
-
Metadata Files:
- Readme: README.md
- Changelog: CHANGELOG.md
- License: LICENSE
- Code of conduct: CODE_OF_CONDUCT.md
- Security: SECURITY.md
- Authors: AUTHORS
Awesome Lists containing this project
README
# MEx drop
Data upload and download service for the MEx project.
[](https://github.com/robert-koch-institut/mex-template)
[](https://github.com/robert-koch-institut/mex-drop/actions/workflows/cve-scan.yml)
[](https://robert-koch-institut.github.io/mex-drop)
[](https://github.com/robert-koch-institut/mex-drop/actions/workflows/linting.yml)
[](https://gitlab.opencode.de/robert-koch-institut/mex/mex-drop)
[](https://github.com/robert-koch-institut/mex-drop/actions/workflows/testing.yml)
## Project
The Metadata Exchange (MEx) project is committed to improve the retrieval of RKI
research data and projects. How? By focusing on metadata: instead of providing the
actual research data directly, the MEx metadata catalog captures descriptive information
about research data and activities. On this basis, we want to make the data FAIR[^1] so
that it can be shared with others.
Via MEx, metadata will be made findable, accessible and shareable, as well as available
for further research. The goal is to get an overview of what research data is available,
understand its context, and know what needs to be considered for subsequent use.
RKI cooperated with D4L data4life gGmbH for a pilot phase where the vision of a
FAIR metadata catalog was explored and concepts and prototypes were developed.
The partnership has ended with the successful conclusion of the pilot phase.
After an internal launch, the metadata will also be made publicly available and thus be
available to external researchers as well as the interested (professional) public to
find research data from the RKI.
For further details, please consult our
[project page](https://www.rki.de/DE/Aktuelles/Publikationen/Forschungsdaten/MEx/metadata-exchange-plattform-mex-node.html).
[^1]: FAIR is referencing the so-called
[FAIR data principles](https://www.go-fair.org/fair-principles/) – guidelines to make
data Findable, Accessible, Interoperable and Reusable.
**Contact** \
For more information, please feel free to email us at [mex@rki.de](mailto:mex@rki.de).
### Publisher
**Robert Koch-Institut** \
Nordufer 20 \
13353 Berlin \
Germany
## Package
The `mex-drop` package provides an API for uploading data to and downloading data from
the MEx project. Request payloads need to be JSON-formatted but can have arbitrary
structures. Accepted data will be ingested and processed asynchronously.
## License
This package is licensed under the [MIT license](/LICENSE). All other software
components of the MEx project are open-sourced under the same license as well.
## Development
### Installation
- install python on your system
- on unix, run `make install`
- on windows, run `.\mex.bat install`
### Linting and testing
- run all linters with `make lint` or `.\mex.bat lint`
- run just the unit tests with `make unit` or `.\mex.bat unit`
- run unit and integration tests with `make test` or `.\mex.bat test`
- for integration tests you need to start `mex-drop` locally beforehand
### Updating dependencies
- update boilerplate files with `cruft update`
- update global requirements in `requirements.txt` manually
- update git hooks with `pre-commit autoupdate`
- update package dependencies using `uv sync --upgrade`
- update github actions in `.github/workflows/*.yml` manually
### Creating release
- run `mex release RULE` to release a new version where RULE determines which part of
the version to update and is one of `major`, `minor`, `patch`.
### Container workflow
- build image with `make image`
- run directly using docker `make run`
- start with docker compose `make start`
## Commands
- run `uv run {command} --help` to print instructions
- run `uv run {command} --debug` for interactive debugging
### Drop
- `uv run drop` starts the drop service