https://github.com/hu-macsy/simexpal
Simplifying Experimental Algorithmics
https://github.com/hu-macsy/simexpal
algorithms benchmarking experiments research utility
Last synced: about 2 months ago
JSON representation
Simplifying Experimental Algorithmics
- Host: GitHub
- URL: https://github.com/hu-macsy/simexpal
- Owner: hu-macsy
- License: mit
- Created: 2019-02-25T11:40:03.000Z (about 7 years ago)
- Default Branch: master
- Last Pushed: 2025-05-06T10:04:30.000Z (11 months ago)
- Last Synced: 2025-10-21T19:26:12.587Z (6 months ago)
- Topics: algorithms, benchmarking, experiments, research, utility
- Language: Python
- Homepage: https://simexpal.readthedocs.io
- Size: 554 KB
- Stars: 18
- Watchers: 5
- Forks: 18
- Open Issues: 19
-
Metadata Files:
- Readme: README.md
- License: License.txt
Awesome Lists containing this project
README
# simexpal
_simexpal_ is a Python based tool to setup, manage, launch, monitor, and
evaluate algorithmic experiments. If you can not wait to try it out and dive
into it, you may find our [quick start
guide](https://simexpal.readthedocs.io/en/latest/quick_start.html) handy.
_simexpal_ is mainly developed by the MACSy (Modelling and Analysis of Complex
Systems) group where graph data is at the core of most projects. Therefore, the
tool provides some special functionality for graph algorithm experiments.
However, this does not limit _simexpal_ to be only used for graph algorithm
experiments, but is a tool that can be used to setup and manage almost all
algorithmic experiments.
Since algorithmic experiments require several tasks in a specific order, the
goal of this tool is to clearly describe and automatize these ordered, and
consecutively executed tasks. Firstly, _simexpal_ allows to make quick changes
to the experiment setup. Secondly, it allows to describe experiments that are
easy to rerun. When describing the necessary steps, even users with no knowledge
of _simexpal_ should be able to quickly setup and execute the described
experiments.
_simexpal_ consists of both a command line interface (CLI) utility and a Python
package. While the CLI can be used to perform many common tasks with minimal
configuration, the Python package can be employed when more extensive
customization is necessary.
## Feature Set Summary
The following is a non-exhaustive list of the functionality provided by
_simexpal_:
- **resolve external resources** such as Git repositories
- describe and setup **build processes**
- declaratively describe **experiments** using the YAML language
- define **parameters** and parameter permutations
- manage **data sets** and specifically graph data
- **run and monitor** experiments on multiple computing platforms
- **evaluate** experiment results
## Why should I use _simexpal_?
Whether you're a student, an algorithm enthusiast, or a researcher: developing
experiments that can easily be reproduced will support the validity of your
findings. Self-written scripts often bind experiments to a narrow set of soft-
and hardware. If not well documented, such scripts may be a source of error, or
the experiments may not be reproduced as intended.
Even though _simexpal_ may not yet be the perfect algorithm experiment
management software, our goal was to abstract algorithmic experiments from their
hard- and software requirements, as well as to provide a clearly structured and
well documented experiment setup. _simexpal_ will allow you to share your
experiments with third parties, and it allows the third parties to validate your
experimental results and findings with only a minimal description on how to
build and run the experiments on their side.
Ultimately, _simexpal_ represents an algorithmic experiment management tool with
which one can clearly define their experiment setup and execution. Therefore, by
using _simexpal_ one contributes to the goal of reproducible algorithmic
experiments.
# Documentation
Please see [readthedocs](https://simexpal.readthedocs.io) for our documentation
of _simexpal_ features.
Our documentation also includes a [quick start
guide](https://simexpal.readthedocs.io/en/latest/quick_start.html) including a
step-by-step guide to install and use _simexpal_.
# Reference
Whether you're using _simexpal_ for you open source project, as part of your
research, or any other purpose, please use the following article as reference
from [MDPI](https://www.mdpi.com/1999-4893/12/7/127):
Angriman, E.; van der Grinten, A.; von Looz, M.; Meyerhenke, H.; Nöllenburg, M.;
Predari, M.; Tzovas, C. Guidelines for Experimental Algorithmics: A Case Study
in Network Analysis. Algorithms 2019, 12, 127. https://doi.org/10.3390/a12070127
BibTex format (w/o abstract):
```tex
@article{simexpal2019,
author = {Angriman, Eugenio and van der Grinten, Alexander and von Looz, Moritz and Meyerhenke, Henning and Nöllenburg, Martin and Predari, Maria and Tzovas, Charilaos},
title = {Guidelines for Experimental Algorithmics: A Case Study in Network Analysis},
journal = {Algorithms},
volume = {12},
year = {2019},
number = {7},
article-number = {127},
url = {https://www.mdpi.com/1999-4893/12/7/127},
issn = {1999-4893},
doi = {10.3390/a12070127}
}
```