Projects in Awesome Lists tagged with benchmark-framework

https://github.com/graphdeeplearning/benchmarking-gnns

Repository for benchmarking graph neural networks (JMLR 2023)

benchmark-framework deep-learning dgl graph-deep-learning graph-neural-networks graph-representation-learning pytorch

Last synced: 15 May 2025

https://github.com/phpbench/phpbench

PHP Benchmarking framework

benchmark-framework benchmarking performance performance-testing

Last synced: 11 May 2025

https://github.com/myzhan/boomer

A better load generator for locust, written in golang.

benchmark benchmark-framework boomer locust performance performance-testing

Last synced: 14 May 2025

https://github.com/google/fuzzbench

FuzzBench - Fuzzer benchmarking as a service.

benchmark-framework benchmarking evaluation fuzzing security

Last synced: 14 May 2025

https://google.github.io/fuzzbench/

FuzzBench - Fuzzer benchmarking as a service.

benchmark-framework benchmarking evaluation fuzzing security

Last synced: 01 Apr 2025

https://github.com/google/swift-benchmark

A swift library to benchmark code snippets.

benchmark-framework benchmarking swift swiftpackage swiftpm

Last synced: 21 Oct 2025

https://github.com/OATML/bdl-benchmarks

Bayesian Deep Learning Benchmarks

bayesian-deep-learning benchmark-framework diabetic-retinopathy

Last synced: 01 May 2025

https://github.com/thu-ml/ares

A Python library for adversarial machine learning focusing on benchmarking adversarial robustness.

adversarial-attacks adversarial-machine-learning adversarial-robustness benchmark-framework bim boundary deepfool distillation evolutionary fgsm hgd mi-fgsm mmlda nes pca spsa

Last synced: 04 Apr 2025

https://github.com/Pacific-AI-Corp/langtest

Deliver safe & effective language models

ai-safety ai-testing artificial-intelligence benchmark-framework benchmarks ethics-in-ai large-language-models llm llm-as-evaluator llm-evaluation-toolkit llm-test llm-testing ml-safety ml-testing mlops model-assessment nlp responsible-ai trustworthy-ai

Last synced: 16 Oct 2025

https://github.com/chronoxor/cppbenchmark

Performance benchmark framework for C++ with nanoseconds measure precision

benchmark-framework benchmarks microbenchmarks performance

Last synced: 06 Apr 2025

https://github.com/sosy-lab/benchexec

BenchExec: A Framework for Reliable Benchmarking and Resource Measurement

benchmark benchmark-framework benchmarking cgroups linux python resource-measurement

Last synced: 02 Feb 2026

https://github.com/ordo-one/package-benchmark

Swift benchmark runner with many performance metrics and great CI support

benchmark benchmark-framework benchmarks ordo-core-package performance performance-metrics server-side-swift swift swift-package swift-package-manager-plugin

Last synced: 28 Jan 2026

https://github.com/langchain-ai/langchain-benchmarks

🦜💯 Flex those feathers!

benchmark-framework benchmarking langchain langchain-python llm llms

Last synced: 15 Apr 2025

https://github.com/sheredom/ubench.h

⏱️ single header benchmark framework for C and C++

benchmark benchmark-framework c cpp

Last synced: 07 Apr 2025

https://github.com/jieyuz2/wrench

[NeurIPS 2021] WRENCH: Weak supeRvision bENCHmark

benchmark-framework data-centric-ai data-programming dataset deep-learning machine-learning nlp robust-learning sequence-labeling weak-supervision weakly-supervised-learning

Last synced: 05 Apr 2025

https://github.com/JieyuZ2/wrench

[NeurIPS 2021] WRENCH: Weak supeRvision bENCHmark

benchmark-framework data-centric-ai data-programming dataset deep-learning machine-learning nlp robust-learning sequence-labeling weak-supervision weakly-supervised-learning

Last synced: 13 Oct 2025

https://github.com/iMeanAI/WebCanvas

All-in-one Web Agent framework for post-training. Start building with a few clicks!

agent benchmark-framework llm-agent llm-evaluation

Last synced: 01 Apr 2025

https://github.com/ziyadedher/evm-bench

🚀🪑 evm-bench is a suite of Ethereum Virtual Machine stress tests and benchmarks.

benchmark benchmark-framework ethereum ethereum-contract evm evm-bytecode smart-contracts

Last synced: 30 Oct 2025

https://github.com/celuigi/models-comparison.pytorch

Code for the paper Benchmark Analysis of Representative Deep Neural Network Architectures

benchmark-framework convolutional-neural-networks deep-neural-networks imagenet pytorch

Last synced: 15 Apr 2025

https://github.com/spcl/serverless-benchmarks

SeBS: serverless benchmarking suite for automatic performance analysis of FaaS platforms.

benchmark-framework benchmarking faas performance-analysis serverless

Last synced: 12 Apr 2025

https://github.com/ConduitIO/benchi

Benchmark any tool from the CLI

benchmark benchmark-framework

Last synced: 15 Jul 2025

https://github.com/ivafanas/sltbench

C++ benchmark tool. Practical, stable and fast performance testing framework.

benchmark benchmark-framework benchmarking cplusplus cpp cpp-library open-source performance test-framework testing testing-tools

Last synced: 09 May 2025

https://github.com/uber/bayesmark

Benchmark framework to easily compare Bayesian optimization methods on real machine learning tasks

bayesian-optimization benchmark-framework machine-learning sklearn

Last synced: 07 Apr 2025

https://github.com/ansible-lockdown/Windows-2019-CIS

CIS Baseline Ansible Role for Windows 2019

ansible ansible-playbook ansible-role benchmark benchmark-framework cis cis-benchmark cis-compliant cis-standards compliance-as-code compliance-automation hardening security security-automation security-tools windows windows-2019 windows-server windows-server-2019

Last synced: 04 Sep 2025

https://github.com/picovoice/wake-word-benchmark

wake word engine benchmark framework

benchmark benchmark-framework keyword-spotting wake-word wake-word-detection

Last synced: 14 Jul 2025

https://github.com/ansible-lockdown/RHEL9-CIS

Ansible role for Red Hat 9 CIS Baseline

ansible ansible-playbook ansible-role benchmark benchmark-framework cis cis-benchmark compliance-as-code compliance-automation redhat9 rhel rhel9 security security-automation security-tools

Last synced: 08 Apr 2025

https://github.com/ansible-lockdown/rhel9-cis

Ansible role for Red Hat 9 CIS Baseline

ansible ansible-playbook ansible-role benchmark benchmark-framework cis cis-benchmark compliance-as-code compliance-automation redhat9 rhel rhel9 security security-automation security-tools

Last synced: 12 Apr 2025

https://github.com/Dru-Mara/EvalNE

Source code for EvalNE, a Python library for evaluating Network Embedding methods.

benchmark benchmark-framework data-mining evaluation graph-algorithms graph-api graph-embedding graph-representation-learning graphs library link-prediction multilabel-classification network-embedding network-reconstruction networks node-classification python representation-learning research-tool sign-prediction

Last synced: 01 May 2025

https://github.com/microsoft/virtualclient

Benchmarking and monitoring automation, designed for cloud, built with .NET.

ab-testing benchmark-framework cloud-testing monitoring performance workload-automation

Last synced: 19 Oct 2025

https://github.com/ansible-lockdown/rhel8-stig

Ansible role for Red Hat 8 STIG Baseline

ansible ansible-role ansible-roles benchmark benchmark-framework compliance-as-code compliance-automation disa-stig redhat8 remediation rhel rhel8 security security-hardening stig stig-compliant

Last synced: 04 Apr 2025

https://github.com/myzhan/locust4j

Locust4j is a load generator for locust, written in Java.

benchmark benchmark-framework locust performance performance-testing

Last synced: 26 Aug 2025

https://github.com/bodigrim/tasty-bench

Featherlight benchmark framework, drop-in replacement for criterion and gauge.

benchmark benchmark-framework benchmark-suite benchmarking benchmarking-suite benchmarks criterion gauge haskell performance-analysis performance-measurement performance-testing

Last synced: 09 Apr 2025

https://github.com/ibmcb/cbtool

Cloud Rapid Experimentation and Analysis Toolkit

azure benchmark-framework benchmarking cloud digitalocean docker ec2 gce kubernetes libvirt lxc openstack python27 stress-testing workload-generator

Last synced: 07 Apr 2025

https://github.com/nyankiyoshi/pytest-django-queries

Generate performance reports from your django database performance tests.

benchmark benchmark-framework benchmark-suite benchmarking performance-monitoring pytest pytest-django pytest-plugin

Last synced: 25 Jul 2025

https://github.com/NyanKiyoshi/pytest-django-queries

Generate performance reports from your django database performance tests.

benchmark benchmark-framework benchmark-suite benchmarking performance-monitoring pytest pytest-django pytest-plugin

Last synced: 21 Mar 2025

https://github.com/MatheusRich/benchable

Write benchmarks without the hassle.

benchmark benchmark-framework hacktoberfest ruby

Last synced: 16 Jul 2025

https://github.com/open-compass/mmbench-gui

Official repo of "MMBench-GUI: Hierarchical Multi-Platform Evaluation Framework for GUI Agents". It can be used to evaluate a GUI agent with a hierarchical manner across multiple platforms, including Windows, Linux, macOS, iOS, Android and Web.

benchmark-framework computer-use gui-agent vision-language-model

Last synced: 15 Sep 2025

https://github.com/pathwaycom/pathway-benchmarks

Benchmarks for data processing systems: Pathway, Spark, Flink, Kafka Streams

benchmark-framework flink kafka-streams latency pagerank pathway spark-streaming streaming streaming-data wordcount

Last synced: 02 Aug 2025

https://github.com/drish/ben

Your benchmark assistant, written in Go.

benchmark benchmark-framework golang

Last synced: 17 Sep 2025

https://github.com/atomind-ai/mlip-arena

Fair and transparent benchmark of machine-learned interatomic potentials (MLIPs), beyond basic error metrics

benchmark-framework interatomic-potentials machine-learning materials molecules quantum-chemistry

Last synced: 08 Mar 2025

https://github.com/oracle/rwloadsim

RWP*Load Simulator - your tool for scripting, simulation and much more. Like having a bit of bash and SQL, a nip of C or Java, a dash of awk, a grain of sed plus drops of secret sauce in one single tool. See https://blogs.oracle.com/database/rwploadsim-oracle-db-performance-simluator for the announcement on the Oracle database blog.

bash-script benchmark-framework database gnuplot-graphs performance performance-testing plsql simulation sql workload

Last synced: 09 Apr 2025

https://github.com/icebob/benchmarkify

:zap: Benchmark framework for NodeJS

benchmark benchmark-framework benchmarking

Last synced: 31 Jul 2025

https://github.com/empiricalci/emp

:microscope: Empirical CLI

ai artificial-intelligence benchmark-framework benchmarking docker reproducible-research reproducible-science science

Last synced: 28 Sep 2025

https://github.com/wichtounet/cpm

Continuous Perfomance Monitor (CPM) for C++ code

benchmark benchmark-framework c-plus-plus cpp cpp11 performance

Last synced: 21 Mar 2025

https://github.com/mslinn/executorbenchmark

benchmark benchmark-framework scala

Last synced: 27 Oct 2025

https://github.com/spratiher9/sparkdataset

Instant search for and access to many datasets in Pyspark.

benchmark benchmark-framework data data-analysis data-mining dataengineering dataset datasets easy-access-application instantsearch pyspark python python3 quickstart r spark standard

Last synced: 02 Aug 2025

https://github.com/mwc360/lakebench

A multi-modal Python library for benchmarking lakehouse engines and ELT scenarios, supporting both industry-standard and novel benchmarks.

benchmark benchmark-framework daft lakehouse polars spark

Last synced: 20 Jan 2026

https://github.com/timeeval/timeeval-gui

[Read-Only Mirror] Benchmarking Toolkit for Time Series Anomaly Detection Algorithms using TimeEval and GutenTAG

benchmark-framework benchmarking jupyter-notebooks numpy pandas python3 streamlit time-series time-series-analysis time-series-anomaly-detection

Last synced: 16 Jan 2026

https://github.com/tweag/hyperion

A lab for future Criterion features.

benchmark-framework benchmarking criterion haskell hyperion latency performance

Last synced: 12 Apr 2025

https://github.com/uber/uber-graph-benchmark

A framework to benchmark different graph databases, based on generated data from customizable schema, distribution, and size.

benchmark-framework graph-database

Last synced: 02 Sep 2025

https://github.com/bodigrim/tasty-bench-fit

Benchmark a given function for variable input sizes and find out its time complexity

algorithm-analysis algorithm-complexity asymptotics benchmark-framework complexity-analysis haskell nonlinear-regression performance-analysis performance-measurement performance-testing regression time-complexity time-complexity-analysis

Last synced: 19 Oct 2025

https://github.com/ansible-lockdown/AMAZON2-CIS

Ansible role for Amazon Linux 2 CIS Baseline

amazon-linux amazon-linux-2 ansible ansible-playbook ansible-role benchmark benchmark-framework cis cis-benchmark compliance-as-code compliance-automation security security-automation security-tools

Last synced: 16 Apr 2025

https://github.com/kumarrobotics/kr_param_map

A parameterized map generator for planning evaluations and benchmarking

benchmark-framework map-generator motion-planning

Last synced: 11 Apr 2025

https://github.com/awadell1/pkgjogger.jl

Take your packages for a jog!

benchmark benchmark-framework benchmarking github-actions julia julia-language

Last synced: 02 Jul 2025

https://github.com/domsolutions/gopayloader

HTTP/S benchmark/load testing cross-platform tool with optional jwt generation - supports HTTP/1.1, HTTP/2, HTTP/3

benchmark benchmark-framework benchmark-scripts benchmarking fasthttpclient go golang high-performance http-client http-requests http2 http3 http3-client jwt jwt-authentication load-testing rps

Last synced: 14 Jan 2026

https://github.com/mushroomrl/mushroom-rl-benchmark

Benchmarking suite for MushroomRL Deep RL algorithms

benchmark-framework benchmarking deep-reinforcement-learning reinforcement-learning

Last synced: 21 Sep 2025

https://github.com/basemax/runbenchmarkjs

Tiny Library for benchmark javascript code.

benchmark benchmark-framework benchmark-scripts benchmarking benchmarks javascript js js-pure library purejs testing testing-tools tiny tiny-library

Last synced: 10 Oct 2025

https://github.com/picovoice/voice-activity-benchmark

Voice activity engine benchmark framework

benchmark benchmark-framework vad voice-activity

Last synced: 14 Jul 2025

https://github.com/jalalmostafa/scits

A tool to benchmark Time-series databases

benchmark benchmark-framework benchmarking benchmarking-suite benchmarks clickhouse database database-management databases influxdb metrics postgres postgresql scientific-computing scientific-publications time-series timescale timescaledb timeseries

Last synced: 30 Apr 2025

https://github.com/w3f/polkadot-lab

Testing framework for Polkadot networks

benchmark-framework blockchain docker helm kind kubernetes polkadot substrate terraform testing-tools

Last synced: 12 Apr 2025

https://github.com/johannesbuchner/nested-sampling

Pythonic Nested Sampling Development Framework & UltraNest

benchmark-framework integration-methods monte-carlo nested-sampling python

Last synced: 07 Jul 2025

https://github.com/lenochxd/pybench

Easy python benchmarking

benchmark benchmark-framework benchmarking python python-3 python3

Last synced: 21 Apr 2025

https://github.com/graalvm/clamh

CLAMH (Cross-LAnguage Microbenchmark Harness) is a language-independent benchmark harness design and the implementation of that design for different languages.

benchmark-framework benchmarking benchmarking-framework c-plus-plus cplusplus cpp java microbenchmarking performance performance-testing

Last synced: 09 Jul 2025

https://github.com/akolb1/hclient

Stand alone Thrift HMS client and benchmarking tools

benchmark-framework benchmarking hive hive-metastore hive-metastore-client microbenchmarks thrift-client

Last synced: 13 May 2025

https://github.com/ivan-tymoshenko/node-benchmarks

Benchmark library for NodeJs

benchmark benchmark-framework benchmarking benchmarks javascript js node node-js nodejs performance performance-testing testing

Last synced: 14 Sep 2025

https://github.com/sean-lamont/bait

artificial-intelligence benchmark-framework machine-learning theorem-proving

Last synced: 16 Jan 2026

https://github.com/nibbleshift/gorb

GO Regression testing and Benchmark Tools

benchmark-framework database go testing

Last synced: 12 Jan 2026

https://github.com/idlesign/narrow

Naive throughput measurements for Python web apps and servers.

benchmark-framework benchmarks http nginx python python3 ssl uwsgi

Last synced: 12 May 2025

https://github.com/macrat/asyncmark

A benchmarking library for javascript that supports Promise.

benchmark-framework benchmarking javascript-library npm-package

Last synced: 19 Oct 2025

https://github.com/eddelbuettel/rcppgeiger

Rcpp Bindings to C++14 Micro-Benchmarking Library

benchmark-framework benchmarking c-plus-plus c-plus-plus-14 r r-package

Last synced: 09 Oct 2025

https://github.com/leon0399/benchmarks

World's complete programming language benchmark

benchmark benchmark-framework benchmarking benchmarks hacktoberfest linpack programming-language scoreboards

Last synced: 22 Mar 2025

https://github.com/asika32764/php-simple-benchmark

PHP Simple Benchmark framework

benchmark benchmark-framework php

Last synced: 13 Apr 2025

https://github.com/anshulrgoyal/bust

Load Testing tool.

benchmark-framework cli http https rust server tool

Last synced: 26 Jun 2025

https://github.com/thanglequoc/timer-ninja

A handy Java utility for measuring execution time easily with annotation-based tracking, multiple time units, and stacktrace tree visualization.

aspectj benchmark benchmark-framework execution-time java measuring performance

Last synced: 11 Feb 2026

https://github.com/thundr67/raptor

An Easy Way To Benchmark Your Python Code

benchmark benchmark-framework benchmarking benchmarks pytho python python3 tool

Last synced: 17 Mar 2025

https://github.com/ivanhuay/micron-runner

Run your performance benchmark easier than ever

benchmark benchmark-framework nodejs-library tests utility

Last synced: 01 Aug 2025

https://github.com/0xfffc0000/benchmark-project

This is ongoing project. Some feature might not work.

benchmark benchmark-framework monero monero-wallet monero-wallet-rpc performance performance-testing

Last synced: 04 Jan 2026

https://github.com/wtanaka/ansible-role-ab

Ansible role to install ab -- ApacheBench benchmarking tool

ab ansible ansible-galaxy ansible-role ansible-roles apache apache-bench apache-benchmark apachebench benchmark benchmark-framework benchmarking benchmarks galaxy

Last synced: 22 Aug 2025

https://github.com/herudi/deno_benchmarks

Deno frameworks benchmarks

benchmark benchmark-framework benchmarking-framework benchmarks deno

Last synced: 27 Feb 2025

https://github.com/lampesm/golang-web-frameworks-performance

go web frameworks performance

benchmark-framework fastapi go golang load-testing locust performance-testing web-framework

Last synced: 20 Jan 2026

https://github.com/salmandabbakuti/hlf-benchmarking

Hyperledger fabric network benchmarking with caliper

benchmark-configurations benchmark-framework blockchain-technology caliper chaincode-sdk-nodejs hyperledger hyperledger-fabric

Last synced: 22 Feb 2025

https://github.com/pwwang/benchwork

A framework for benchmarking in python

benchmark-framework benchmarking benchmarking-framework benchmarking-suite python testing

Last synced: 10 Oct 2025

https://github.com/kreteshq/benchmark

Web Frameworks Benchmark

benchmark benchmark-framework benchmarks web-framework

Last synced: 11 Feb 2026

https://github.com/biobakery/maaslin2_benchmark

Large-scale Benchmarking of Microbial Multivariable Association Methods

benchmark-framework benchmarking differential-abundance-analysis false-discovery-rate metagenomics microbiome multiple-covariates public repeated-measures

Last synced: 05 Oct 2025

https://github.com/podgorskiy/nonius

Nonius benchmark-framework fork

benchmark benchmark-framework benchmarking cpp performance

Last synced: 28 Feb 2025

https://github.com/savi-lang/benchmark

The official benchmarking framework for Savi.

benchmark benchmark-framework library savi standard-library

Last synced: 18 Mar 2025

https://github.com/wenyxu/metrics-bench-suite

Metrics Bench Suite is a set of tools designed to benchmark the storage and querying of metrics data in time-series databases

benchmark-framework greptimedb prometheus time-series victoriametrics

Last synced: 31 Jul 2025

https://github.com/bluenote10/simplelanguagebenchmarks

Benchmark collection of random problem + language combinations.

benchmark benchmark-framework

Last synced: 02 Nov 2025

https://github.com/karimsa/wiz

Zero config toolchain to manage JS projects with simplicity.

benchmark-framework build bundler compiler javascript linter profiler test-framework

Last synced: 02 Jan 2026

https://github.com/jeffzi/luamark

A lightweight, portable microbenchmarking library for Lua

benchmark-framework lua

Last synced: 22 Apr 2025

https://github.com/dries007/fpgaperformancesuite

FPGA Benchmarking Software - Thesis project (2019) MSC @KULeuven - De Nayer

benchmark-framework benchmarking fpga fpga-benchmark kuleuven thesis

Last synced: 21 Jan 2026

https://github.com/ellerbrock/perfkit-alicloud

:mahjong: PerfKit Benchmarker for Alibaba Cloud Dockerized

alibaba-cloud alibabacloud alicloud aliyun aliyun-oss aliyuncli benchmark benchmark-framework benchmarking benchmarking-suite dcos perfkit perfkitbenchmarker

Last synced: 21 Mar 2025

https://github.com/ocramz/alleycat

benchmark-framework benchmarking golden-tests

Last synced: 27 Mar 2025

https://github.com/ony/criterionpp

Simple library for measuring the performance of C++ code, that tries match github.com/bos/criterion

benchmark-framework c-plus-plus

Last synced: 10 Apr 2025

https://github.com/ysskrishna/express-fastapi-performance-test

A comprehensive performance benchmark comparing FastAPI (sync vs. async) and Express.js. This project uses Artillery.io to simulate various real-world load testing scenarios (read/write-heavy, stress, spike) in a controlled Docker environment. It provides automated scripts, detailed performance reports, and a Looker Studio to visualize results.

artilleryio async benchmark-framework docker docker-compose express expressjs fastapi load-testing nodejs performance-testing postgresql python ysskrishna