Projects in Awesome Lists tagged with benchmarking-framework
A curated list of projects in awesome lists tagged with benchmarking-framework .
https://github.com/JinjieNi/MixEval
The official evaluation suite and dynamic data release for MixEval.
benchmark benchmark-mixture benchmarking-framework benchmarking-suite evaluation evaluation-framework foundation-models large-language-model large-language-models large-multimodal-models llm-evaluation llm-evaluation-framework llm-inference mixeval
Last synced: 14 Sep 2025
https://github.com/dice-group/gerbil
GERBIL - General Entity annotatoR Benchmark
benchmarking benchmarking-framework entity-annotation entity-linking named-entity-recognition
Last synced: 24 Jun 2025
https://github.com/eXascaleInfolab/PyExPool
Python Multi-Process Execution Pool: concurrent asynchronous execution pool with custom resource constraints (memory, timeouts, affinity, CPU cores and caching), load balancing and profiling capabilities of the external apps on NUMA architecture
application-framework benchmarking-framework cache-control execution-pool in-memory-computations load-balancing monitoring-server multiprocessing numa parallel-computing parallel-processing task-queue
Last synced: 02 Apr 2025
https://github.com/microsoft/mlos
MLOS is a project to enable autotuning for systems.
autotuning benchmarking benchmarking-framework data-science infrastructure optimize-systems performance-engineering
Last synced: 16 May 2025
https://github.com/spcl/npbench
NPBench - A Benchmarking Suite for High-Performance NumPy
benchmarking-framework benchmarking-suite numpy python
Last synced: 05 Apr 2025
https://github.com/hewlettpackard/dc-rl
SustainDC is a set of Python environments for Data Center simulation and control using Heterogeneous Multi Agent Reinforcement Learning. Includes customizable environments for workload scheduling, cooling optimization, and battery management, with integration into Gymnasium.
battery-management benchmark benchmarking benchmarking-framework carbon-footprint cooling-optimization data-center data-center-management energy-efficiency gymnasium gymnasium-environment heterogeneous-reinforcement-learning machine-learning multi-agent-reinforcement-learning python reinforcement-learningmulti-agent-systems sustainability sustainable-computing workload-scheduling
Last synced: 26 Apr 2025
https://github.com/neurosim/DNN_NeuroSim_V2.0
Benchmark framework of compute-in-memory based accelerators for deep neural network (on-chip training chip focused)
benchmarking-framework chip-training dnn-neurosim memory-accelerators xiaochen-peng
Last synced: 23 Apr 2025
https://github.com/kumarrobotics/kr_mp_design
A guidance for the design and evaluation of motion planners for quadrotors in Environments with Varying Complexities
benchmarking-framework motion-planning
Last synced: 17 Feb 2026
https://github.com/tonyredondo/timeitsharp
Command execution time meter
benchmark benchmarking-framework performance performance-testing
Last synced: 16 Jan 2026
https://github.com/aallan/benchmarking-ml-on-the-edge
Benchmarking machine learning inferencing on embedded hardware.
benchmark benchmarking-framework coral-tpu jetson-nano machine-learning movidius raspberry-pi small-ai tiny-ml
Last synced: 05 Sep 2025
https://github.com/dunnkers/fseval
Benchmarking framework for Feature Selection and Feature Ranking algorithms 🚀
automl benchmarking benchmarking-framework benchmarks feature-rankers feature-ranking feature-selection hydra machine-learning python scikit-learn wandb
Last synced: 13 Apr 2025
https://github.com/smarr/smark
Write Benchmarks like Tests
benchmarking-framework benchmarks pharo smalltalk squeak
Last synced: 09 Jul 2025
https://github.com/dejurin/php-micro-router-framework-benchmark
PHP Micro & Router Framework Benchmark
benchmark benchmark-framework benchmark-scripts benchmarking-framework micro-framework php php-framework router routing
Last synced: 16 Feb 2026
https://github.com/emanzione/mhlab.benchmark
A library to measure and profile some metrics of your code (execution time, average execution time, garbage collections)
benchmark benchmarking-framework dotnet dotnetcore measure
Last synced: 05 Jul 2025
https://github.com/graalvm/clamh
CLAMH (Cross-LAnguage Microbenchmark Harness) is a language-independent benchmark harness design and the implementation of that design for different languages.
benchmark-framework benchmarking benchmarking-framework c-plus-plus cplusplus cpp java microbenchmarking performance performance-testing
Last synced: 09 Jul 2025
https://github.com/sandeep-krishnamurthy/dl-operator-benchmark
Framework for benchmarking deep learning operators for Apache MXNet
apache-mxnet benchmarking-framework deep-learning performance
Last synced: 20 Mar 2025
https://github.com/pwwang/benchwork
A framework for benchmarking in python
benchmark-framework benchmarking benchmarking-framework benchmarking-suite python testing
Last synced: 10 Oct 2025
https://github.com/herudi/deno_benchmarks
Deno frameworks benchmarks
benchmark benchmark-framework benchmarking-framework benchmarks deno
Last synced: 27 Feb 2025
https://github.com/svenssonjoel/emacs-bencher
Use Emacs to run benchmarks and to collect data
benchmarking benchmarking-framework csv emacs
Last synced: 05 Apr 2025
https://github.com/pytest-with-eric/pytest-benchmark-example
How To Measure And Improve Code Efficiency with Pytest Benchmark (The Ultimate Guide)
benchmark benchmarking-framework pytest-benchmark python-benchmark
Last synced: 19 Aug 2025
https://github.com/narenkhatwani/spec-cpu-benchmarking-projects
This repository contains a comprehensive framework and codebase for running and analyzing SpecCPUv8 benchmarks. It provides a streamlined way to evaluate and compare the performance of different computing systems using the SpecCPUv8 suite.
benchmarking-framework benchmarking-utility cpu
Last synced: 05 Jul 2025
