Projects in Awesome Lists tagged with benchmarking
A curated list of projects in awesome lists tagged with benchmarking .
https://github.com/locustio/locust
Write scalable load tests in plain Python 🚗💨
benchmarking hacktoberfest http load-generator load-test load-testing load-tests locust performance performance-testing python
Last synced: 13 May 2025
https://github.com/tsenart/vegeta
HTTP load testing tool and library. It's over 9000!
benchmarking go http load-testing
Last synced: 12 May 2025
https://github.com/winsiderss/systeminformer
A free, powerful, multi-purpose tool that helps you monitor system resources, debug software and detect malware. Brought to you by Winsider Seminars & Solutions, Inc. @ http://www.windows-internals.com
administrator benchmarking debugger monitor monitor-performance monitoring performance performance-monitoring performance-tuning process-manager process-monitor processhacker profiling realtime security system-monitor systeminformer task-manager windows
Last synced: 14 May 2025
https://github.com/dotnet/benchmarkdotnet
Powerful .NET library for benchmarking
benchmark benchmarking c-sharp csharp dotnet hacktoberfest performance
Last synced: 09 Sep 2025
https://github.com/dotnet/BenchmarkDotNet
Powerful .NET library for benchmarking
benchmark benchmarking c-sharp csharp dotnet hacktoberfest performance
Last synced: 14 Mar 2025
https://github.com/flightlessmango/mangohud
A Vulkan and OpenGL overlay for monitoring FPS, temperatures, CPU/GPU load and more. Discord: https://discordapp.com/invite/Gj5YmBb
benchmarking hud linux monitoring opengl vulkan
Last synced: 12 May 2025
https://github.com/codesenberg/bombardier
Fast cross-platform HTTP benchmarking tool written in Go
benchmarking bombardier cli fast go golang http linux load-testing macos performance windows
Last synced: 12 May 2025
https://github.com/cleverhans-lab/cleverhans
An adversarial example library for constructing attacks, building defenses, and benchmarking both
benchmarking machine-learning security
Last synced: 12 Dec 2025
https://github.com/flightlessmango/MangoHud
A Vulkan and OpenGL overlay for monitoring FPS, temperatures, CPU/GPU load and more. Discord: https://discordapp.com/invite/Gj5YmBb
benchmarking hud linux monitoring opengl vulkan
Last synced: 19 Mar 2025
https://github.com/salesforce/merlion
Merlion: A Machine Learning Framework for Time Series Intelligence
anomaly-detection automl benchmarking ensemble-learning forecasting machine-learning time-series
Last synced: 13 May 2025
https://github.com/salesforce/Merlion
Merlion: A Machine Learning Framework for Time Series Intelligence
anomaly-detection automl benchmarking ensemble-learning forecasting machine-learning time-series
Last synced: 26 Mar 2025
https://github.com/httprunner/httprunner
HttpRunner 是一款开源的 API/UI 测试框架，简单易用，功能强大，具有丰富的插件化机制和高度的可扩展能力。
adb api-testing benchmarking boomer curl httprunner httptest jmeter load-testing locust performance-testing pytest requests testing ui-testing wda
Last synced: 14 May 2025
https://github.com/marker-inc-korea/autorag
AutoRAG: An Open-Source Framework for Retrieval-Augmented Generation (RAG) Evaluation & Optimization with AutoML-Style Automation
analysis automl benchmarking document-parser embeddings evaluation llm llm-evaluation llm-ops open-source ops optimization pipeline python qa rag rag-evaluation retrieval-augmented-generation
Last synced: 03 Apr 2026
https://github.com/nakabonne/ali
Generate HTTP load and plot the results in real-time
benchmarking go load-testing monitoring testing-tools tui visualization
Last synced: 19 Jan 2026
https://github.com/phoronix-test-suite/phoronix-test-suite
The Phoronix Test Suite open-source, cross-platform automated testing/benchmarking software.
benchmark benchmarking bsd linux performance php profiling solaris testing
Last synced: 13 May 2025
https://github.com/processone/tsung
Tsung is a high-performance benchmark framework for various protocols including HTTP, XMPP, LDAP, etc.
amqp benchmark benchmarking erlang ldap mqtt mysql postgresql xmpp
Last synced: 13 May 2025
https://github.com/wenbihan/reproducible-image-denoising-state-of-the-art
Collection of popular and reproducible image denoising works.
art arxiv benchmarking cnn curated-list deep-learning denoising-algorithms image-denoising image-processing image-reconstruction image-restoration implementation inverse-problems noise noise-reduction performance-analysis recovery-image reproducible-research state-of-the-art summary
Last synced: 25 Feb 2026
https://github.com/phpbench/phpbench
PHP Benchmarking framework
benchmark-framework benchmarking performance performance-testing
Last synced: 01 Apr 2026
https://github.com/clementchadebec/benchmark_vae
Unifying Variational Autoencoder (VAE) implementations in Pytorch (NeurIPS 2022)
benchmarking beta-vae comparison normalizing-flows pixel-cnn pytorch reproducibility reproducible-research vae vae-gan vae-implementation vae-pytorch variational-autoencoder vq-vae wasserstein-autoencoder
Last synced: 14 May 2025
https://github.com/clementchadebec/benchmark_VAE
Unifying Variational Autoencoder (VAE) implementations in Pytorch (NeurIPS 2022)
benchmarking beta-vae comparison normalizing-flows pixel-cnn pytorch reproducibility reproducible-research vae vae-gan vae-implementation vae-pytorch variational-autoencoder vq-vae wasserstein-autoencoder
Last synced: 29 Apr 2025
https://github.com/rrze-hpc/likwid
Performance monitoring and benchmarking suite
amd-gpu armv8 assembly benchmarking c hardware-performance-counters hwloc instrumentation likwid linux lua nvidia-gpu performance-analysis performance-engineering pin power9 profiling threading x86
Last synced: 12 Feb 2026
https://github.com/RRZE-HPC/likwid
Performance monitoring and benchmarking suite
amd-gpu armv8 assembly benchmarking c hardware-performance-counters hwloc instrumentation likwid linux lua nvidia-gpu performance-analysis performance-engineering pin power9 profiling threading x86
Last synced: 20 Mar 2025
https://github.com/alecthomas/go_serialization_benchmarks
Benchmarks of Go serialization methods
Last synced: 15 May 2025
https://github.com/alecthomas/Go_serialization_benchmarks
Benchmarks of Go serialization methods
Last synced: 12 Mar 2025
https://github.com/bencheeorg/benchee
Easy and extensible benchmarking in Elixir providing you with lots of statistics!
benchmarking elixir extensible graphs microbenchmarks statistics
Last synced: 13 May 2025
https://github.com/timescale/tsbs
Time Series Benchmark Suite, a tool for comparing and evaluating databases for time series data
benchmarking cassandra influxdb mongodb time-series timescaledb
Last synced: 14 May 2025
https://github.com/borealisai/advertorch
A Toolbox for Adversarial Robustness Research
adversarial-attacks adversarial-example adversarial-examples adversarial-learning adversarial-machine-learning adversarial-perturbations benchmarking machine-learning pytorch robustness security toolbox
Last synced: 15 May 2025
https://github.com/jsperf/jsperf.com
jsperf.com v2. https://github.com/h5bp/lazyweb-requests/issues/174
benchmark benchmarking javascript performance
Last synced: 16 May 2025
https://github.com/BorealisAI/advertorch
A Toolbox for Adversarial Robustness Research
adversarial-attacks adversarial-example adversarial-examples adversarial-learning adversarial-machine-learning adversarial-perturbations benchmarking machine-learning pytorch robustness security toolbox
Last synced: 27 Mar 2025
https://github.com/ionelmc/pytest-benchmark
pytest fixture for benchmarking code
benchmark benchmarking performance pytest python
Last synced: 23 Apr 2025
https://github.com/jonmagon/kdiskmark
A simple open-source disk benchmark tool for Linux distros
benchmarking cpp crystaldiskmark dbus disk drive linux polkit qt5 ssd
Last synced: 14 May 2025
https://github.com/JonMagon/KDiskMark
A simple open-source disk benchmark tool for Linux distros
benchmarking cpp crystaldiskmark dbus disk drive linux polkit qt5 ssd
Last synced: 03 Apr 2025
https://github.com/haydenjames/bench-scripts
A compilation of Linux server benchmarking scripts.
benchmark benchmarking linux performance scripts vps
Last synced: 16 May 2025
https://github.com/google/fuzzbench
FuzzBench - Fuzzer benchmarking as a service.
benchmark-framework benchmarking evaluation fuzzing security
Last synced: 14 May 2025
https://google.github.io/fuzzbench/
FuzzBench - Fuzzer benchmarking as a service.
benchmark-framework benchmarking evaluation fuzzing security
Last synced: 01 Apr 2025
https://github.com/sintel-dev/orion
Unsupervised time series anomaly detection library
anomaly-detection benchmarking data-science deep-learning generative-adversarial-network machine-learning orion signals time-series unsupervised-learning
Last synced: 14 May 2025
https://github.com/sintel-dev/Orion
A machine learning library for detecting anomalies in signals.
anomaly-detection benchmarking data-science deep-learning generative-adversarial-network machine-learning orion signals time-series unsupervised-learning
Last synced: 26 Mar 2025
https://github.com/inikep/lzbench
lzbench is an in-memory benchmark of open-source compressors
benchmark benchmarking brotli compression compressor lz4 zlib zstd
Last synced: 14 May 2025
https://github.com/google/swift-benchmark
A swift library to benchmark code snippets.
benchmark-framework benchmarking swift swiftpackage swiftpm
Last synced: 21 Oct 2025
https://github.com/google-research/rliable
[NeurIPS'21 Outstanding Paper] Library for reliable evaluation on RL and ML benchmarks, even with only a handful of seeds.
benchmarking evaluation-metrics google machine-learning reinforcement-learning rl
Last synced: 08 Apr 2025
https://github.com/lesovsky/noisia
Harmful workload generator for PostgreSQL
benchmarking failure-injection postgresql testing
Last synced: 04 Apr 2025
https://github.com/tpc-council/hammerdb
HammerDB Database Load Testing and Benchmarking Tool
benchmark benchmarking benchmarks databases db2 hammerdb mariadb mysql olap olapbenchmark oltp oltpbenchmark oracle postgresql scaleable sql sqlserver tpc tpcc tpch
Last synced: 15 May 2025
https://github.com/TPC-Council/HammerDB
HammerDB Database Load Testing and Benchmarking Tool
benchmark benchmarking benchmarks databases db2 hammerdb mariadb mysql olap olapbenchmark oltp oltpbenchmark oracle postgresql scaleable sql sqlserver tpc tpcc tpch
Last synced: 11 May 2025
https://github.com/bencherdev/bencher
🐰 Bencher - Continuous Benchmarking
benchmark benchmarking cd ci ci-cd code-quality continuous-benchmarking performance
Last synced: 26 Mar 2025
https://github.com/sforaidl/kd_lib
A Pytorch Knowledge Distillation library for benchmarking and extending works in the domains of Knowledge Distillation, Pruning, and Quantization.
algorithm-implementations benchmarking data-science deep-learning-library knowledge-distillation machine-learning model-compression pruning pytorch quantization
Last synced: 16 May 2025
https://github.com/dg92/Performance-Analysis-JS
Map/Reduce/Filter/Find Vs For loop Vs For each Vs Lodash vs Ramda
benchmarking es6 filter find functional-programming javascript javascript-functions lodash lodash-analysis map perfromance ramda ramdajs reduce
Last synced: 29 Apr 2025
https://github.com/udhos/goben
goben is a golang tool to measure TCP/UDP transport layer throughput between hosts.
bandwidth benchmarking go golang measure-tcp-throughput networking performance-testing tcp throughput tool udp
Last synced: 04 Apr 2025
https://github.com/salesforce/logai
LogAI - An open-source library for log analytics and intelligence
ai aiops anomaly-detection benchmarking log-analysis log-intelligence machine-learning python
Last synced: 14 May 2025
https://github.com/taoensso/tufte
Simple performance monitoring library for Clojure/Script
benchmarking clojure clojurescript epl performance-monitoring profiling taoensso
Last synced: 22 Oct 2025
https://github.com/safe-graph/gnn-fakenews
A collection of GNN-based fake news detection models.
benchmarking deep-learning fakenewsdetection graphneuralnetwork machine-learning misinformation social-media social-network-analysis
Last synced: 10 Sep 2025
https://github.com/safe-graph/GNN-FakeNews
A collection of GNN-based fake news detection models.
benchmarking deep-learning fakenewsdetection graphneuralnetwork machine-learning misinformation social-media social-network-analysis
Last synced: 21 Jul 2025
https://github.com/atesgoral/hrm-solutions
Human Resource Machine solutions and size/speed hacks
assembly benchmarking game human-resource-machine
Last synced: 15 May 2025
https://github.com/KevinMusgrave/powerful-benchmarker
A library for ML benchmarking. It's powerful.
benchmarking computer-vision deep-learning domain-adaptation machine-learning metric-learning pytorch transfer-learning
Last synced: 08 May 2025
https://github.com/v8/web-tooling-benchmark
JavaScript benchmark for common web developer workloads
benchmark benchmarking benchmarking-suite javascript node-js nodejs performance performance-testing v8 v8-javascript-engine v8js
Last synced: 12 Apr 2025
https://github.com/kevinmusgrave/powerful-benchmarker
A library for ML benchmarking. It's powerful.
benchmarking computer-vision deep-learning domain-adaptation machine-learning metric-learning pytorch transfer-learning
Last synced: 17 Nov 2025
https://github.com/sforaidl/genrl
A PyTorch reinforcement learning library for generalizable and reproducible algorithm implementations with an aim to improve accessibility in RL
algorithm-implementations benchmarking data-science deep-learning gym hacktoberfest machine-learning neural-network openai python pytorch reinforcement-learning reinforcement-learning-algorithms
Last synced: 09 Oct 2025
https://github.com/SforAiDl/genrl
A PyTorch reinforcement learning library for generalizable and reproducible algorithm implementations with an aim to improve accessibility in RL
algorithm-implementations benchmarking data-science deep-learning gym hacktoberfest machine-learning neural-network openai python pytorch reinforcement-learning reinforcement-learning-algorithms
Last synced: 01 May 2025
https://github.com/rabbitmq/rabbitmq-perf-test
A load testing tool
benchmarking load-testing rabbitmq tool
Last synced: 14 Apr 2025
https://github.com/reczoo/BARS
BARS: Towards Open Benchmarking for Recommender Systems https://openbenchmark.github.io/BARS
benchmarking collaborative-filtering ctr-prediction item-matching ranking recommender-system
Last synced: 20 Jul 2025
https://github.com/felixge/sqlbench
sqlbench measures and compares the execution time of one or more SQL queries.
benchmarking performance postgresql sql
Last synced: 06 Apr 2025
https://github.com/XiaoMi/mobile-ai-bench
Benchmarking Neural Network Inference on Mobile Devices
Last synced: 05 May 2025
https://github.com/reczoo/bars
BARS: Towards Open Benchmarking for Recommender Systems https://openbenchmark.github.io/BARS
benchmarking collaborative-filtering ctr-prediction item-matching ranking recommender-system
Last synced: 16 May 2025
https://github.com/xiaomi/mobile-ai-bench
Benchmarking Neural Network Inference on Mobile Devices
Last synced: 05 Apr 2025
https://github.com/cgnorthcutt/benchmarking-keras-pytorch
🔥 Reproducibly benchmarking Keras and PyTorch models
benchmarking cnn cnn-classification cnn-keras deep-learning imagenet keras keras-tutorials pytorch pytorch-tutorial
Last synced: 07 Apr 2025
https://github.com/smarr/are-we-fast-yet
Are We Fast Yet? Comparing Language Implementations with Objects, Closures, and Arrays
benchmark benchmarking comparison dynamic-languages language language-implementations performance
Last synced: 16 May 2025
https://github.com/mjebrahimi/easycompressor
⚡An Easy-to-Use and Optimized compression library for .NET that unified several compression algorithms including LZ4, Snappy, Zstd, LZMA, Brotli, GZip, ZLib, and Deflate. This library aids in Improving Performance by Reducing Memory Usage and Bandwidth Usage. Along with a greate Performance Benchmark between different compression algorithms.
benchmark benchmarking brotli compress compression compressor csharp decompression deflate dotnet gzip high-performance lz4 lzma optimization performance snappy zlib zstandard zstd
Last synced: 09 Apr 2025
https://github.com/aiverify-foundation/moonshot
Moonshot - A simple and modular tool to evaluate and red-team any LLM application.
benchmarking evaluation-framework llm red-teaming trustworthy-ai
Last synced: 05 Feb 2026
https://github.com/vhive-serverless/vhive
vHive: Open-source framework for serverless experimentation
benchmarking containerd faas firecracker functions-as-a-service gvisor knative knative-serving kubernetes microvm serverless vhive
Last synced: 01 Apr 2026
https://github.com/vhive-serverless/vHive
vHive: Open-source framework for serverless experimentation
benchmarking containerd faas firecracker functions-as-a-service gvisor knative knative-serving kubernetes microvm serverless vhive
Last synced: 30 Mar 2025
https://github.com/ant-research/easytemporalpointprocess
EasyTPP: Towards Open Benchmarking Temporal Point Processes
benchmarking machine-learning-algorithms stochastic-processes temporal-data time-series
Last synced: 15 May 2025
https://github.com/openml/openml-python
OpenML's Python API for a World of Data and More 💫
benchmarking data datascience machine-learning meta-learning openml python tabular-data
Last synced: 10 Apr 2025
https://github.com/ant-research/EasyTemporalPointProcess
EasyTPP: Towards Open Benchmarking Temporal Point Processes
benchmarking machine-learning-algorithms stochastic-processes temporal-data time-series
Last synced: 05 May 2025
https://github.com/rentruewang/bocoel
Bayesian Optimization as a Coverage Tool for Evaluating LLMs. Accurate evaluation (benchmarking) that's 10 times faster with just a few lines of modular code.
bayesian-optimization benchmarking evaluation language-model llm machine-learning
Last synced: 05 Apr 2025
https://github.com/sosy-lab/benchexec
BenchExec: A Framework for Reliable Benchmarking and Resource Measurement
benchmark benchmark-framework benchmarking cgroups linux python resource-measurement
Last synced: 02 Feb 2026
https://github.com/reframe-hpc/reframe
A powerful Python framework for writing and running portable regression tests and benchmarks for HPC systems.
benchmarking continuous-integration framework hpc performance-testing python3 regression-testing validation-testing
Last synced: 05 Mar 2026
https://github.com/carla-recourse/carla
CARLA: A Python Library to Benchmark Algorithmic Recourse and Counterfactual Explanation Algorithms
artificial-intelligence benchmark benchmarking counterfactual counterfactual-explanations counterfactuals explainability explainable-ai explainable-ml machine-learning python pytorch recourse tensorflow tensorflow2
Last synced: 05 Apr 2025
https://github.com/langchain-ai/langchain-benchmarks
🦜💯 Flex those feathers!
benchmark-framework benchmarking langchain langchain-python llm llms
Last synced: 15 Apr 2025
https://github.com/AaltoVision/ADVIO
An Authentic Dataset for Visual-Inertial Odometry
benchmarking computer-vision navigation visual-inertial-odometry
Last synced: 01 Apr 2025
https://github.com/aws-samples/foundation-model-benchmarking-tool
Foundation model benchmarking tool. Run any model on any AWS platform and benchmark for performance across instance type and serving stack options.
bedrock benchmark benchmarking deepseek deepseek-r1 evaluation-metrics foundation-models g5 g6 g6e generative-ai inferentia llama2 llama3 p4d p5 sagemaker trainium
Last synced: 15 May 2025
https://github.com/stalkermustang/llm-bulls-and-cows-benchmark
A mini-framework for evaluating LLM performance on the Bulls and Cows number guessing game, supporting multiple LLM providers.
benchmark benchmarking chatgpt games llm openai python reasoning
Last synced: 04 Apr 2025
https://github.com/wasi-master/fastero
Python timeit CLI for the 21st century! colored output, multi-line input with syntax highlighting and autocompletion and much more!
benchmark benchmarking fastero pyperf pyperform pyperformance python python-benchmark python-benchmarks python-timeit python3 timeit
Last synced: 05 Apr 2025
https://github.com/dice-group/gerbil
GERBIL - General Entity annotatoR Benchmark
benchmarking benchmarking-framework entity-annotation entity-linking named-entity-recognition
Last synced: 24 Jun 2025
https://github.com/lobocv/pyperform
An easy and convienent way to performance test python code.
benchmark-functions benchmarking performance-test python speed-test timeit
Last synced: 06 Apr 2025
https://github.com/aliesbelik/load-testing-toolkit
Collection of open-source tools for debugging, benchmarking, load and stress testing your code or services.
benchmarking ddos http-benchmarking load-testing performance performance-testing stress-testing
Last synced: 07 Feb 2026
https://github.com/g8a9/ferret
A python package for benchmarking interpretability techniques on Transformers.
benchmarking interpretability machine-learning transformers
Last synced: 09 Apr 2026
https://github.com/rhiever/sklearn-benchmarks
A centralized repository to report scikit-learn model performance across a variety of parameter settings and data sets.
benchmarking machine-learning python scikit-learn
Last synced: 21 Aug 2025
https://github.com/p-ranav/criterion
Microbenchmarking for Modern C++
benchmarking console console-application cpp17 cpp17-library criterion csv export header-only json library measurements microbenchmark microbenchmarks mit modern-cpp single-header single-header-lib single-header-library table
Last synced: 21 Aug 2025
https://github.com/profuzzbench/profuzzbench
ProFuzzBench - A Benchmark for Stateful Protocol Fuzzing
Last synced: 12 May 2025
https://github.com/doubaokun/node-ab
A command tool to test the performance of HTTP services.
ab-testing abtest abtesting benchmarking http-services javascript node-ab
Last synced: 18 Dec 2025
https://github.com/projectphysx/opencl-benchmark
A small OpenCL benchmark program to measure peak GPU/CPU performance.
bandwidth benchmark benchmarking flops gpgpu gpu gpu-computing high-performance-computing hpc opencl tool tools
Last synced: 04 Apr 2025
https://github.com/theremote/pibenchmarks
Raspberry Pi benchmarking scripts featuring a storage benchmark with score
benchmarking pi-storage raspberry-pi storage-benchmark
Last synced: 23 Apr 2025
https://github.com/nosqlbench/nosqlbench
The open source, pluggable, nosql benchmarking suite.
benchmarking cql dashboarding distributed-systems docker grafana java javascript linux multi-protocol nosql-benchmarking-suite nosql-ecosystem nosqlbench testing
Last synced: 18 Feb 2026
https://github.com/cleanlab/label-errors
🛠️ Corrected Test Sets for ImageNet, MNIST, CIFAR, Caltech-256, QuickDraw, IMDB, Amazon Reviews, 20News, and AudioSet
benchmarking datasets label-errors machine-learning
Last synced: 06 Jan 2026
https://github.com/morganstanley/xpedite
A non-sampling profiler purpose built to measure and optimize performance of C++ low latency/real time systems
benchmarking cpu-profiler intel jupyter jupyter-notebook low-latency perf-events performance performance-counters profiler real-time ultra-low-latency
Last synced: 04 Mar 2026
https://github.com/TheRemote/PiBenchmarks
Raspberry Pi benchmarking scripts featuring a storage benchmark with score
benchmarking pi-storage raspberry-pi storage-benchmark
Last synced: 16 Jul 2025
https://github.com/earlephilhower/ezfio
Simple NVME/SAS/SATA SSD test framework for Linux and Windows
benchmark benchmarking fio nvme nvmeof nvmeoverfabrics performance ssd testing
Last synced: 10 Apr 2025
https://github.com/mims-harvard/graphxai
GraphXAI: Resource to support the development and evaluation of GNN explainers
benchmarking deep-learning embeddings explainability explainable-ai explainable-ml graph-machine-learning graph-neural-networks interpretability
Last synced: 10 Oct 2025
