https://github.com/openml/evaluationengine
Sources of the Java Evaluation Engine
https://github.com/openml/evaluationengine
Last synced: 12 months ago
JSON representation
Sources of the Java Evaluation Engine
- Host: GitHub
- URL: https://github.com/openml/evaluationengine
- Owner: openml
- Created: 2018-01-17T13:37:31.000Z (over 8 years ago)
- Default Branch: master
- Last Pushed: 2025-06-19T16:56:36.000Z (about 1 year ago)
- Last Synced: 2025-06-19T17:32:57.122Z (about 1 year ago)
- Language: Java
- Size: 21 MB
- Stars: 8
- Watchers: 5
- Forks: 6
- Open Issues: 16
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# EvaluationEngine
Sources of the Java Evaluation Engine. The evaluation engine performs backend tasks for OpenML:
- `process_datasets`: download a dataset, describe information per feature (e.g., the datatype and number of values per feature) and upload the results.
- `evaluate_run`: download a dataset and its splits, run the run's predictor on this dataset, and upload the evaluation (e.g., mean absolute error).
- `extract_features_all`: download a dataset, describe some features such as maximum number of distinct values of nominal features, and upload the results.
- `extract_features_simple`: same as `extract_features_all`, but with a subset of features.
## Usage
See [docker](./docker/README.md) directory for how to run this using docker.
### Prerequisites
- Java. It works with 11 LTS, compatibility with other versions is unknown.
- Maven
### Compile / package
mvn clean compile # only compile
mvn clean package -DskipTests # package (generate jar)
### Run
Generate the jar (see "Compile / package"). Then
java -jar target/EvaluationEngine-*-SNAPSHOT-jar-with-dependencies.jar -f process_dataset -id 1
java -jar target/EvaluationEngine-*-SNAPSHOT-jar-with-dependencies.jar -f evaluate_run -id 1