https://github.com/spcl/polybench-comparator
Regression and comparison tools for the Polybench benchmark
https://github.com/spcl/polybench-comparator
Last synced: about 1 year ago
JSON representation
Regression and comparison tools for the Polybench benchmark
- Host: GitHub
- URL: https://github.com/spcl/polybench-comparator
- Owner: spcl
- License: bsd-3-clause
- Created: 2018-07-09T19:41:17.000Z (almost 8 years ago)
- Default Branch: master
- Last Pushed: 2021-06-17T10:04:54.000Z (almost 5 years ago)
- Last Synced: 2024-04-28T02:00:19.016Z (about 2 years ago)
- Language: Shell
- Size: 10.7 KB
- Stars: 6
- Watchers: 6
- Forks: 1
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# Polybench Comparator
This collection of scripts creates and runs regression tests (reference outputs, comparison, and performance) on a variety of compilers.
## Requirements
* Polybench/C (tested with Polybench/C 4.2)
* Python 3.x
## Usage
Run the tool from the command line as follows (the second argument is optional):
```shell
$ ./test.sh /path/to/polybench [/path/to/results]
```
You can also compare two outputs using the following command:
```shell
$ python3 ./comparator.py /path/to/reference/file /path/to/output/file
```
## Files
* `comparator.py`: Tool that compares the outputs of polybench tests, returns absolute difference and the percentage of errors.
* `test.sh`: Compiles and runs tests using the other files. By default, only the gcc compiler is enabled, and the tool runs with parametric and constant loop bounds.
* `configurations.sh`: Sample configuration functions for popular compilers and polyhedral toolchains. *NOTE*: This file is intended to be included by `test.sh`, not used separately.
## Contributing
Feel free to create issues and pull requests. Any contribution is welcome!
## License
Polybench Comparator is published under the New BSD license, see [LICENSE](LICENSE).