{"id":20683245,"url":"https://github.com/tudasc/mpi-corrbench","last_synced_at":"2025-04-22T12:21:53.360Z","repository":{"id":37500003,"uuid":"332579364","full_name":"tudasc/MPI-Corrbench","owner":"tudasc","description":"A benchmark suite to evaluate MPI correctness tools.","archived":false,"fork":false,"pushed_at":"2025-02-13T13:58:51.000Z","size":624,"stargazers_count":9,"open_issues_count":2,"forks_count":4,"subscribers_count":3,"default_branch":"main","last_synced_at":"2025-03-29T15:05:21.764Z","etag":null,"topics":["correctness","hpc","message-passing-interface","mpi"],"latest_commit_sha":null,"homepage":"","language":"C","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"bsd-3-clause","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/tudasc.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":"CONTRIBUTING.md","funding":null,"license":"LICENSE.txt","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null}},"created_at":"2021-01-24T23:25:54.000Z","updated_at":"2025-02-13T13:58:54.000Z","dependencies_parsed_at":"2023-02-13T21:15:37.150Z","dependency_job_id":null,"html_url":"https://github.com/tudasc/MPI-Corrbench","commit_stats":null,"previous_names":[],"tags_count":4,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/tudasc%2FMPI-Corrbench","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/tudasc%2FMPI-Corrbench/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/tudasc%2FMPI-Corrbench/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/tudasc%2FMPI-Corrbench/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/tudasc","download_url":"https://codeload.github.com/tudasc/MPI-Corrbench/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":250237880,"owners_count":21397412,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["correctness","hpc","message-passing-interface","mpi"],"created_at":"2024-11-16T22:16:02.712Z","updated_at":"2025-04-22T12:21:53.341Z","avatar_url":"https://github.com/tudasc.png","language":"C","funding_links":[],"categories":[],"sub_categories":[],"readme":"# MPI-CorrBench 2.0.0 [![License](https://img.shields.io/badge/License-BSD%203--Clause-blue.svg)](https://opensource.org/licenses/BSD-3-Clause) [![visualize](https://github.com/tudasc/MPI-Corrbench/actions/workflows/visualize.yml/badge.svg?branch=main)](https://github.com/tudasc/mpi-corrbench-dashboard)\n\nMPI-CorrBench \\[[CORRBE21](#ref-Corrbe21)\\] enables a structured comparison of the different available tools for MPI correctness checking  w.r.t. various types of errors.\n\n## [Visualization Dashboard](https://github.com/tudasc/mpi-corrbench-dashboard)\nMPI-CorrBench is automatically executed by our CI pipeline.\nYou can find the automatically generated visualizations in our [Visualization Dashboard](https://github.com/tudasc/mpi-corrbench-dashboard).\nfor the MPI+OpenMP testcases, the CI only executes one configuration for a better assesment it may be a good idea to execute it multiple times variing the amount of threads. For more detailes refer \\[[HYBE22](#ref-Hybe22)\\]\n\n## Usage\nProvide the Following environment Variables:\n* `MPI_CORRECTNESS_BM_DIR` full path to the local directory of this repo\n* `MPI_CORRECTNESS_BM_EXPERIMENT_DIR` full path to the directory where the tools should be executed\n\n### Running the benchmarks\n* Adapt the SLURM configuration in `scripts/SLURM_header.in`\n* for each tool a script file `scripts/\u003cTOOL\u003e/execute_tool.sh` exists. You may need to adopt it to use the tool on your system\n* run `scripts/run_measurement.sh 1` to generate the jobscript and submit them via sbatch (the argument given is the number of repetition for each test case)\n* after all jobs are finished use `scripts/gather_results.sh` to gather all the results, which will _override_ previous data in `output` (such as our results)\n\n### Visualize the results\nThe visualizations presented in \\[[CORRBE21](#ref-Corrbe21)\\] can be generated by the usage of the provided scripts. The scripts don't take any arguments and read the data in `output` to generate the visualization.\n\n#### References\n\u003ctable style=\"border:0px\"\u003e\n\u003ctr\u003e\n    \u003ctd valign=\"top\"\u003e\u003ca name=\"ref-Corrbe21\"\u003e\u003c/a\u003e[CORRBE21]\u003c/td\u003e\n    \u003ctd\u003eLehr, Jan-Patrick and Jammer, Tim and Bischof, Christian:\n      MPI-CorrBench: Towards an MPI Correctness Benchmark Suite 2021. https://dl.acm.org/doi/abs/10.1145/3431379.3460652\u003c/td\u003e\n\u003c/tr\u003e\n\u003ctr\u003e\n    \u003ctd valign=\"top\"\u003e\u003ca name=\"ref-Hybe22\"\u003e\u003c/a\u003e[HYBE22]\u003c/td\u003e\n    \u003ctd\u003eJammer, Tim and Hück, Alexander and Lehr, Jan-Patrick and Protze, Joachim and Schwitanski, Simon and Bischof, Christian:\n      Towards a Hybrid MPI Correctness Benchmark Suite 2022. https://dl.acm.org/doi/10.1145/3555819.3555853\u003c/td\u003e\n\u003c/tr\u003e\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Ftudasc%2Fmpi-corrbench","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Ftudasc%2Fmpi-corrbench","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Ftudasc%2Fmpi-corrbench/lists"}