https://github.com/tudasc/mpi-corrbench

A benchmark suite to evaluate MPI correctness tools.
https://github.com/tudasc/mpi-corrbench

correctness hpc message-passing-interface mpi

Last synced: about 1 month ago
JSON representation

A benchmark suite to evaluate MPI correctness tools.

• Host: GitHub
• URL: https://github.com/tudasc/mpi-corrbench
• Owner: tudasc
• License: bsd-3-clause
• Created: 2021-01-24T23:25:54.000Z (almost 4 years ago)
• Default Branch: main
• Last Pushed: 2023-01-24T12:09:07.000Z (almost 2 years ago)
• Last Synced: 2023-03-05T05:18:43.453Z (almost 2 years ago)
• Topics: correctness, hpc, message-passing-interface, mpi
• Language: C
• Homepage:
• Size: 596 KB
• Stars: 5
• Watchers: 3
• Forks: 4
• Open Issues: 2
• Metadata Files:
  • Readme: README.md
  • Contributing: CONTRIBUTING.md
  • License: LICENSE.txt

Awesome Lists containing this project

README

        
# MPI-CorrBench 2.0.0 [![License](https://img.shields.io/badge/License-BSD%203--Clause-blue.svg)](https://opensource.org/licenses/BSD-3-Clause) [![visualize](https://github.com/tudasc/MPI-Corrbench/actions/workflows/visualize.yml/badge.svg?branch=main)](https://github.com/tudasc/mpi-corrbench-dashboard)

MPI-CorrBench \[[CORRBE21](#ref-Corrbe21)\] enables a structured comparison of the different available tools for MPI correctness checking  w.r.t. various types of errors.

## [Visualization Dashboard](https://github.com/tudasc/mpi-corrbench-dashboard)

MPI-CorrBench is automatically executed by our CI pipeline.

You can find the automatically generated visualizations in our [Visualization Dashboard](https://github.com/tudasc/mpi-corrbench-dashboard).

for the MPI+OpenMP testcases, the CI only executes one configuration for a better assesment it may be a good idea to execute it multiple times variing the amount of threads. For more detailes refer \[[HYBE22](#ref-Hybe22)\]

## Usage

Provide the Following environment Variables:

* `MPI_CORRECTNESS_BM_DIR` full path to the local directory of this repo

* `MPI_CORRECTNESS_BM_EXPERIMENT_DIR` full path to the directory where the tools should be executed

### Running the benchmarks

* Adapt the SLURM configuration in `scripts/SLURM_header.in`

* for each tool a script file `scripts//execute_tool.sh` exists. You may need to adopt it to use the tool on your system

* run `scripts/run_measurement.sh 1` to generate the jobscript and submit them via sbatch (the argument given is the number of repetition for each test case)

* after all jobs are finished use `scripts/gather_results.sh` to gather all the results, which will _override_ previous data in `output` (such as our results)

### Visualize the results

The visualizations presented in \[[CORRBE21](#ref-Corrbe21)\] can be generated by the usage of the provided scripts. The scripts don't take any arguments and read the data in `output` to generate the visualization.

#### References

    [CORRBE21]

    Lehr, Jan-Patrick and Jammer, Tim and Bischof, Christian:

      MPI-CorrBench: Towards an MPI Correctness Benchmark Suite 2021. https://dl.acm.org/doi/abs/10.1145/3431379.3460652

    [HYBE22]

    Jammer, Tim and Hück, Alexander and Lehr, Jan-Patrick and Protze, Joachim and Schwitanski, Simon and Bischof, Christian:

      Towards a Hybrid MPI Correctness Benchmark Suite 2022. https://dl.acm.org/doi/10.1145/3555819.3555853