{"id":18520224,"url":"https://github.com/mlr-org/mlr3batchmark","last_synced_at":"2025-04-09T09:32:45.258Z","repository":{"id":49090077,"uuid":"287231238","full_name":"mlr-org/mlr3batchmark","owner":"mlr-org","description":"Connector between mlr3 and batchtools","archived":false,"fork":false,"pushed_at":"2024-04-25T07:54:09.000Z","size":125,"stargazers_count":5,"open_issues_count":4,"forks_count":3,"subscribers_count":6,"default_branch":"main","last_synced_at":"2024-05-01T09:37:21.613Z","etag":null,"topics":["batchtools","cluster-computing","high-performance-computing","hpc","mlr3","r","r-package"],"latest_commit_sha":null,"homepage":"","language":"R","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/mlr-org.png","metadata":{"funding":{"github":"mlr-org"},"files":{"readme":"README.Rmd","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2020-08-13T09:02:22.000Z","updated_at":"2024-05-28T22:10:55.950Z","dependencies_parsed_at":"2023-10-13T03:33:45.332Z","dependency_job_id":"eb0cef7a-1003-453e-a423-5c41926d3080","html_url":"https://github.com/mlr-org/mlr3batchmark","commit_stats":null,"previous_names":[],"tags_count":2,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/mlr-org%2Fmlr3batchmark","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/mlr-org%2Fmlr3batchmark/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/mlr-org%2Fmlr3batchmark/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/mlr-org%2Fmlr3batchmark/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/mlr-org","download_url":"https://codeload.github.com/mlr-org/mlr3batchmark/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":248012617,"owners_count":21033230,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["batchtools","cluster-computing","high-performance-computing","hpc","mlr3","r","r-package"],"created_at":"2024-11-06T17:19:08.738Z","updated_at":"2025-04-09T09:32:44.926Z","avatar_url":"https://github.com/mlr-org.png","language":"R","readme":"---\noutput: github_document\n---\n# mlr3batchmark\n\n[![r-cmd-check](https://github.com/mlr-org/mlr3batchmark/actions/workflows/r-cmd-check.yml/badge.svg)](https://github.com/mlr-org/mlr3batchmark/actions/workflows/r-cmd-check.yml)\n[![CRAN status](https://www.r-pkg.org/badges/version/mlr3batchmark)](https://CRAN.R-project.org/package=mlr3batchmark)\n[![StackOverflow](https://img.shields.io/badge/stackoverflow-mlr3-orange.svg)](https://stackoverflow.com/questions/tagged/mlr3)\n[![Mattermost](https://img.shields.io/badge/chat-mattermost-orange.svg)](https://lmmisld-lmu-stats-slds.srv.mwn.de/mlr_invite/)\n\nA connector between [mlr3](https://github.com/mlr-org/mlr3) and [batchtools](https://mllg.github.io/batchtools/).\nThis allows to run large-scale benchmark experiments on scheduled high-performance computing clusters.\n\nThe package comes with two core functions for switching between `mlr3` and `batchtools` to perform a benchmark:\n\n* After creating a `design` object (as required for `mlr3`'s `benchmark()` function), instead of `benchmark()` call `batchmark()` which populates\n  an `ExperimentRegistry` for the computational jobs of the benchmark.\n  You are now in the world of `batchtools` where you can selectively submit jobs with different resources, monitor the progress or resubmit as needed.\n* After the computations are finished, collect the results with `reduceResultsBatchmark()` to return to `mlr3`.\n  The resulting object is a regular `BenchmarkResult`.\n\n## Example\n\n```{r}\nlibrary(\"mlr3\")\nlibrary(\"batchtools\")\nlibrary(\"mlr3batchmark\")\ntasks = tsks(c(\"iris\", \"sonar\"))\nlearners = lrns(c(\"classif.featureless\", \"classif.rpart\"))\nresamplings = rsmp(\"cv\", folds = 3)\n\ndesign = benchmark_grid(\n  tasks = tasks,\n  learners = learners,\n  resamplings = resamplings\n)\n\nreg = makeExperimentRegistry(NA)\nids = batchmark(design, reg = reg)\n\nsubmitJobs()\ngetStatus()\n\nreduceResultsBatchmark()\n```\n\n\n## Resources\n\n* The *Large-Scale Benchmarking* chapter of the [mlr3 book](https://mlr3book.mlr-org.com/)\n","funding_links":["https://github.com/sponsors/mlr-org"],"categories":[],"sub_categories":[],"project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fmlr-org%2Fmlr3batchmark","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fmlr-org%2Fmlr3batchmark","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fmlr-org%2Fmlr3batchmark/lists"}