https://github.com/gjjvdburg/abed
abed: A command line tool for easily running machine learning benchmarks
https://github.com/gjjvdburg/abed
benchmarking evaluation machine-learning parallel-computing python
Last synced: 8 months ago
JSON representation
abed: A command line tool for easily running machine learning benchmarks
- Host: GitHub
- URL: https://github.com/gjjvdburg/abed
- Owner: GjjvdBurg
- License: gpl-2.0
- Created: 2015-04-29T16:21:29.000Z (about 11 years ago)
- Default Branch: master
- Last Pushed: 2022-02-15T13:39:09.000Z (over 4 years ago)
- Last Synced: 2024-09-15T22:38:37.756Z (almost 2 years ago)
- Topics: benchmarking, evaluation, machine-learning, parallel-computing, python
- Language: HTML
- Homepage:
- Size: 2.01 MB
- Stars: 4
- Watchers: 4
- Forks: 2
- Open Issues: 1
-
Metadata Files:
- Readme: README.rst
- Changelog: CHANGELOG.md
- License: LICENSE
Awesome Lists containing this project
README
================
Welcome to Abed!
================
`abed `_ is an automated system for
benchmarking machine learning algorithms. It is created for running
experiments where it is desired to run multiple methods on multiple datasets
using multiple parameters. It includes automated processing of result files
into result tables and figures.
``abed`` is available on PyPI::
$ pip install abed
``abed`` was created as a way to automate all the tedious work necessary to
set up proper benchmarking experiments. It also removes much of the hassle by
using a single configuration file for the experimental setup. A core feature
of ``abed`` is that it doesn't care about which language the tested methods are
written in.
``abed`` can create output tables as either simple txt files, or as html pages
using the excellent `DataTables `_ plugin. To support
offline operation the necessary DataTables files are packaged with ``abed``.
Documentation
-------------
For ``abed``'s documentation, see `the documentation
`_.
Screenshots
-----------
|figure1|_ |figure2|_ |figure3|_
.. _figure1: https://raw.githubusercontent.com/GjjvdBurg/abed/master/.github/rank_plots.png
.. _figure2: https://raw.githubusercontent.com/GjjvdBurg/abed/master/.github/tables.png
.. _figure3: https://raw.githubusercontent.com/GjjvdBurg/abed/master/.github/tables_time.png
.. |figure1| image:: https://raw.githubusercontent.com/GjjvdBurg/abed/master/.github/rank_plots.png
:alt: Rank plots in Abed
:width: 32%
:align: middle
.. |figure2| image:: https://raw.githubusercontent.com/GjjvdBurg/abed/master/.github/tables.png
:alt: Result tables in Abed
:width: 32%
:align: middle
.. |figure3| image:: https://raw.githubusercontent.com/GjjvdBurg/abed/master/.github/tables_time.png
:alt: Result tables in Abed (time)
:width: 32%
:align: middle
Notes
-----
The current version of ``abed`` is very usable. However, it is still considered
beta software, as it is not yet completely documented and some robustness
improvements are planned. For a similar and more mature project which works
with R see: `BatchExperiments `_.