{"id":28471610,"url":"https://github.com/openml/evaluationengine","last_synced_at":"2025-07-01T22:30:59.917Z","repository":{"id":57739692,"uuid":"117841043","full_name":"openml/EvaluationEngine","owner":"openml","description":"Sources of the Java Evaluation Engine","archived":false,"fork":false,"pushed_at":"2025-06-19T16:56:36.000Z","size":22007,"stargazers_count":8,"open_issues_count":16,"forks_count":6,"subscribers_count":5,"default_branch":"master","last_synced_at":"2025-06-19T17:32:57.122Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":null,"language":"Java","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/openml.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null},"funding":{"github":"openml","open_collective":"openml"}},"created_at":"2018-01-17T13:37:31.000Z","updated_at":"2025-06-19T16:55:46.000Z","dependencies_parsed_at":"2024-09-18T00:28:34.425Z","dependency_job_id":"12d61169-d1db-4f88-984a-c7041301b338","html_url":"https://github.com/openml/EvaluationEngine","commit_stats":{"total_commits":89,"total_committers":3,"mean_commits":"29.666666666666668","dds":0.0674157303370787,"last_synced_commit":"5514044000b46d894ef05a1bccb30f2ce5e5b5d0"},"previous_names":[],"tags_count":3,"template":false,"template_full_name":null,"purl":"pkg:github/openml/EvaluationEngine","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/openml%2FEvaluationEngine","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/openml%2FEvaluationEngine/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/openml%2FEvaluationEngine/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/openml%2FEvaluationEngine/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/openml","download_url":"https://codeload.github.com/openml/EvaluationEngine/tar.gz/refs/heads/master","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/openml%2FEvaluationEngine/sbom","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":263046073,"owners_count":23405127,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2025-06-07T11:08:04.322Z","updated_at":"2025-07-01T22:30:59.897Z","avatar_url":"https://github.com/openml.png","language":"Java","funding_links":["https://github.com/sponsors/openml","https://opencollective.com/openml"],"categories":[],"sub_categories":[],"readme":"# EvaluationEngine\nSources of the Java Evaluation Engine. The evaluation engine performs backend tasks for OpenML:\n\n- `process_datasets`: download a dataset, describe information per feature (e.g., the datatype and number of values per feature) and upload the results. \n- `evaluate_run`: download a dataset and its splits, run the run's predictor on this dataset, and upload the evaluation (e.g., mean absolute error).\n- `extract_features_all`: download a dataset, describe some features such as maximum number of distinct values of nominal features, and upload the results.\n- `extract_features_simple`: same as `extract_features_all`, but with a subset of features.\n\n## Usage\n\nSee [docker](./docker/README.md) directory for how to run this using docker.\n\n### Prerequisites\n\n- Java. It works with 11 LTS, compatibility with other versions is unknown.\n- Maven\n\n### Compile / package\n\n    mvn clean compile                 # only compile\n    mvn clean package -DskipTests     # package (generate jar)\n\n### Run\nGenerate the jar (see \"Compile / package\"). Then\n\n    java -jar target/EvaluationEngine-*-SNAPSHOT-jar-with-dependencies.jar -f process_dataset -id 1\n    java -jar target/EvaluationEngine-*-SNAPSHOT-jar-with-dependencies.jar -f evaluate_run -id 1","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fopenml%2Fevaluationengine","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fopenml%2Fevaluationengine","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fopenml%2Fevaluationengine/lists"}