Data

Tools

Indexes

Applications

Experiments

Awesome

An open API service indexing awesome lists of open source software.

Projects in Awesome Lists tagged with experimentation

A curated list of projects in awesome lists tagged with experimentation .

https://github.com/uptrain-ai/uptrain

UpTrain is an open-source unified platform to evaluate and improve Generative AI applications. We provide grades for 20+ preconfigured checks (covering language, code, embedding use-cases), perform root cause analysis on failure cases and give insights on how to resolve them.

autoevaluation evaluation experimentation hallucination-detection jailbreak-detection llm-eval llm-prompting llm-test llmops machine-learning monitoring openai-evals prompt-engineering root-cause-analysis

Last synced: 14 May 2025

https://github.com/shadow/shadow

Shadow is a discrete-event network simulator that directly executes real application code, enabling you to simulate distributed systems with thousands of network-connected processes in realistic and scalable private network experiments using your laptop, desktop, or server running Linux.

control emulation experimentation networking realism scalability science-research scientific-computing simulation tor

Last synced: 14 May 2025

https://github.com/dotnet/corefxlab

This repo is for experimentation and exploring new ideas that may or may not make it into the main corefx repo.

c-sharp corefx dotnet experimentation

Last synced: 30 Sep 2025

https://github.com/zalando/expan

Open-source Python library for statistical analysis of randomised control trials (A/B tests)

ab-testing abtest abtesting causal-inference experimentation python statistical-analysis statistics

Last synced: 01 May 2025

https://github.com/microsoft/genaiops-promptflow-template

GenAIOps with Prompt Flow is a "GenAIOps template and guidance" to help you build LLM-infused apps using Prompt Flow. It offers a range of features including Centralized Code Hosting, Lifecycle Management, Variant and Hyperparameter Experimentation, A/B Deployment, reporting for all runs and experiments and so on.

aistudio azure azuremachinelearning cloud docker evaluation experimentation genai genaiops largelanguagemodels llm llmops machine-learning mlops mlops-template orchestration prompt promptengineering promptflow python

Last synced: 15 May 2025

https://github.com/Minyus/pipelinex

PipelineX: Python package to build ML pipelines for experimentation with Kedro, MLflow, and more

data-engineering data-science deep-learning experimentation machine-learning pipeline

Last synced: 24 Mar 2025

https://github.com/eugeneyan/papermill-mlflow

🧪 Simple data science experimentation & tracking with jupyter, papermill, and mlflow.

experimentation jupyter mlflow papermill python

Last synced: 08 Oct 2025

https://github.com/stitchfix/mab

Library for multi-armed bandit selection strategies, including efficient deterministic implementations of Thompson sampling and epsilon-greedy.

data-science experimentation go golang multi-armed-bandit multi-armed-bandits multiarmed-bandits reinforcement-learning thompson thompson-sampling

Last synced: 16 Jul 2025

https://github.com/google-marketing-solutions/feedx

Transparent, robust and trustworthy A/B experimentation for Shopping feeds.

ab-testing data-science experimentation python shopping

Last synced: 12 Aug 2025

https://github.com/revisit-studies/study

Create your own study by cloning and editing configs; or check out the code behind the study components.

experimentation research user-study visualization

Last synced: 04 Mar 2026

https://github.com/webis-de/ir_axioms

↕️ Intuitive axiomatic retrieval experimentation.

anserini axioms experimentation information-retrieval pyserini pyterrier re-ranking terrier

Last synced: 11 Mar 2026

https://ucy-linc-lab.github.io/fogify/

A Fog Computing Emulation Framework

edge-computing experimentation fog-computing fog-topology jupyter

Last synced: 11 May 2025

https://github.com/microsoft/genaiops-azureaisdk-template

Implement GenAIOps using Azure AI Foundry with ease and jumpstart

ai azure deployment evaluation experimentation foundry genaiops llmops

Last synced: 11 Oct 2025

https://github.com/thomasweise/moptipy

Implementation of metaheuristic optimization methods in Python for scientific, industrial, and educational scenarios. Experiments can be executed in parallel or in a distributed fashion. Experimental results can be evaluated in various ways, including diagrams, tables, and export to Excel.

evolutionary-algorithms evolutionary-computation experimentation genetic-algorithm heuristic-optimization hill-climbing memetic-algorithms metaheuristics optimization optimization-algorithms python random-walk randomized-local-search replicability simulated-annealing

Last synced: 14 Mar 2026

https://github.com/microsoft/fluentui-charting-contrib

Contributor tools and guides for fluentui charting library

contrib-guide developer-docs experimentation extensions perf-tools test-framework

Last synced: 01 Sep 2025

https://github.com/S2-group/experiment-runner

Tool for the automatic orchestration of experiments targeting software systems

empirical empirical-software-engineering experimentation

Last synced: 05 Apr 2025

https://github.com/rigetti/paranormal

A declarative, parameter-parsing library that provides multiple parsing interfaces (YAML, command line, and JSON)

command-line control-systems experimentation parsing-library

Last synced: 10 Apr 2025

https://github.com/hpac/elaps

Experimental Linear Algebra Performance Studies

blas experimentation high-performance-computing lapack performance

Last synced: 13 Aug 2025

https://github.com/jonhoo/experiment

A tool for running concurrent multi-configuration experiments.

experimentation measurement orchestration

Last synced: 11 Apr 2025

https://github.com/0x48piraj/aos

Aroma of the Songs — Visualizing music in the form of intricate rose petals using moving cube traces.

aromaofsongs aromaofthesongs audio-processing audio-visualizer experimentation mathematical-modelling music-information-retrieval music-visualizer projectaos vizualisation

Last synced: 23 Mar 2025

https://github.com/angles-n-daemons/scrutinize

A/B Testing for scientists and engineers

ab-testing experimentation

Last synced: 05 Apr 2025

https://github.com/stillmatic/flagsheet

Serve feature flags from Google Sheets

experimentation feature-flags go

Last synced: 22 Jun 2025

https://github.com/optimizely/optimizely-flutter-sdk

Flutter SDK for Optimizely Feature Experimentation and Optimizely Full Stack (legacy).

experimentation optimizely-environment-prod optimizely-environment-public optimizely-owner-px production

Last synced: 15 Mar 2026

https://github.com/hamlim/switch-kit

A “build-your-own” Feature Flagging/Toggling/Experimentation/etc system!

cloudflare-kv experimentation feature-flags feature-toggles

Last synced: 20 Mar 2025

https://github.com/MUmarShahbaz/Graph-Plotter

This is a Graph Plotter. This tool is designed to make graphs based on raw data. It can take the data from Mathematical Equations, Manually, Programmed Calculation, as well as from a Serial Communication Device such as an Arduino using the function Serial.println(Numeric_Value), however you please and create as many graphs as you want to.

arduino experimentation graphs library maths physics plotter processing-ide serial

Last synced: 10 Apr 2025

https://github.com/aaron5670/statsig-browser-extension

🧪 A browser extension to search and toggle Statsig experiments and dynamic configs.

ab-testing chrome-extension chromium experimentation firefox firefox-addon firefox-extension statsig

Last synced: 28 Jan 2026

https://github.com/mumarshahbaz/graph-plotter

This is a Graph Plotter. This tool is designed to make graphs based on raw data. It can take the data from Mathematical Equations, Manually, Programmed Calculation, as well as from a Serial Communication Device such as an Arduino using the function Serial.println(Numeric_Value), however you please and create as many graphs as you want to.

arduino experimentation graphs library maths physics plotter processing-ide serial

Last synced: 10 Apr 2025

https://github.com/sdaza/experiment-utils-pd

Generic functions for experiment analysis and design

analytics experiment experimentation ipw

Last synced: 03 May 2026

https://github.com/broosky/squarely

A super low-frequency square wave counter using 74-series logic and 7-segment displays.

diy-electronics electonics experimentation integrated-circuits kicad led-display maker-project prototyping

Last synced: 18 Feb 2026

https://github.com/ninetailed-inc/gtm-ninetailed-template

Google Tag Manager (GTM) template which allows customers to fire Ninetailed API calls on their site via GTM.

events experimentation google-tag-manager personalization tracking

Last synced: 05 Jan 2026

https://github.com/wulfland/featureflags

Comparison between available solutions for feature flags (aka feature toggles).

ab-testing experimentation featureflags featuretoggles

Last synced: 02 Feb 2026

https://github.com/jgphilpott/babel

A repository for experimenting with all the different programming languages.

documentation experimentation learning-by-doing programming-languages self-education

Last synced: 15 Mar 2025

https://github.com/salfaris/financial-fraud-detection

Financial transactions fraud detection using ML (research, experimentation and deployment via Google Cloud)

deployment docker experimentation fraud-detection google-cloud-platform google-cloud-run machine-learning machine-learning-research scikit-learn streamlit

Last synced: 08 Jan 2026

https://github.com/lykmapipo/ubuntu.dockerfiles

Dockerfiles for building Ubuntu-based Docker images for development and experimentation

bash curl debian development docker docker-compose docker-images dockerfiles experimentation github-actions linux lykmapipo ubuntu

Last synced: 13 Apr 2026

https://github.com/hcvazquez/experimentexample

Example for UFFOptimizer experiment

experimentation javascript

Last synced: 24 Jul 2025

https://github.com/aosasona/gossiper

Shhh... it's UDP [WIP]

experimentation

Last synced: 13 Sep 2025

https://github.com/bilpapster/qualitab

🔎 Investigating the performance of tabular foundation models in the wild of imperfect data

data-errors experimentation imperfect-data tabular-data tabular-foundation-models

Last synced: 31 Jul 2025

https://github.com/jmitchell/pandoc-experiments

Sandbox to play with Pandoc and try out new use cases.

experimentation pandoc pandoc-filter

Last synced: 01 Aug 2025

https://github.com/erikbjare/rust-exploration

Exploring the wonders of Rust by writing a gravity simulator and doing some FFI

experimentation ffi nbody

Last synced: 12 Aug 2025

https://github.com/aosasona/ls.rs

An implementation of the unix `ls` command in Rust

experimentation

Last synced: 29 Oct 2025

https://github.com/ryan-otero/2025-09-02-support-ab-testing

Full-stack customer support system with integrated A/B testing infrastructure. Features real-time statistical analysis, dynamic conversion tracking, and comprehensive experiment management for data-driven decision making.

ab-testing analytics conversion-tracking customer-support data-driven experimentation express full-stack javascript nodejs react real-time sqlite statistical-analysis statistics

Last synced: 11 Apr 2026

https://github.com/absmartly/swift-sdk

A/B Smartly Swift SDK

ab-testing experimentation sdk swift

Last synced: 31 May 2026

https://github.com/1mb-dev/rollout-bucket

Deterministic bucketing for feature flags and A/B testing using MurmurHash3. Stateless, fast, TypeScript-native rollout library with zero dependencies.

ab-testing bucketing experimentation feature-flags feature-toggles murmurhash nodejs rollout stateless typescript

Last synced: 24 Feb 2026

https://github.com/noushinn/reproducible_workflows

EW2 - workshop on reproducible workflows for EW2 cohort as part of the Learning Event Series: https://noushinn.github.io/reproducible_workflows/

experimentation practice workshop

Last synced: 31 Jan 2026

https://github.com/pkhungurn/shion

My personal machine learning experimentation, designed to work with PyTorch.

experimentation machine-learning python pytorch training

Last synced: 18 Apr 2026

https://github.com/rcasto/ablab

A simple library for enabling experimentation.

ab-testing experimentation feature-flags

Last synced: 22 Apr 2026

https://github.com/harmos274/haskell-gi-template

Experimentation on GTK+ Haskell and QuasiQuotation

experimentation gtk gtk3 haskell haskell-gi quasiquoter template-haskell

Last synced: 17 May 2026

https://github.com/aymendaoudi/rimaz

Rimaz is a tool that helps analyze the byte code of Android applications written in Java.

analyses android-applications android-platforms experimentation soot

Last synced: 20 May 2026

https://github.com/mirkobunse/metaconfigurations.jl

Define a set of configurations as a single, more abstract and comprehensive meta-configuration.

configuration-management experimentation julia-package

Last synced: 24 Feb 2026

https://github.com/mizcausevic-dev/pricing-experiment-studio

React + TypeScript studio for packaging tests, elasticity readouts, rollout guardrails, and executive pricing decision support.

experimentation growth-analytics monetization revenue-operations typescript

Last synced: 01 Jun 2026

https://github.com/mizcausevic-dev/experimentation_insights_kpi

TypeScript platform for experiment lift analysis, rollout decisioning, KPI interpretation, and growth-oriented experimentation workflows.

ab-testing backend experimentation growth kpi nodejs openapi typescript

Last synced: 01 Jun 2026

https://github.com/mizcausevic-dev/ab-testing-command-center

React + TypeScript command center for experiment portfolios, segment lift, rollout decisions, and executive experimentation visibility.

ab-testing conversion experimentation frontend growth-analytics react rollout typescript

Last synced: 01 Jun 2026

https://github.com/mizcausevic-dev/attribution-intelligence-studio

React + TypeScript studio for multi-touch attribution analysis, experiment interpretation, and executive growth decisioning.

attribution experimentation frontend growth-analytics react revenue-operations typescript vite

Last synced: 01 Jun 2026

https://github.com/cgobat/mae-3120

Coursework for engineering experimentation/methods class (Spring 2022) at the George Washington University.

engineering experimentation instrumentation

Last synced: 23 May 2026

https://github.com/maxlorenz/dl4j-clj

DL4J experiments using Clojure

clojure dl4j experimentation

Last synced: 27 Mar 2025

https://github.com/welpo/srm

Precise Sample Ratio Mismatch calculator.

ab-testing experimentation sample-ratio-mismatch srm statistics

Last synced: 25 Oct 2025

https://github.com/sunkusun9/ml-labs

Pipeline-centric ML framework for experiment, train, and inference workflows

experimentation inference machine-learning pipeline sklearn training

Last synced: 10 Apr 2026

https://github.com/welpo/stop-early-stopping

Why you shouldn't peek at significance levels to decide when to stop an experiment

ab-testing bad-practices early-stopping experimental-design experimentation good-practices p-hacking

Last synced: 31 Jan 2026

https://github.com/vnykmshr/rollout-bucket

Deterministic bucketing for feature flags and A/B testing using MurmurHash3. Stateless, fast, TypeScript-native rollout library with zero dependencies.

ab-testing bucketing experimentation feature-flags feature-toggles murmurhash nodejs rollout stateless typescript

Last synced: 07 Feb 2026

https://github.com/aosasona/ls.go

An implementation of the UNIX `ls` function in Go

experimentation

Last synced: 13 Sep 2025

https://github.com/noushinn/experimentation_course

EW2 - Initiating an Experiment (Module 2) as part of Learning Event Series for EW2 cohort

canada ew2-cohort experimentation experimentation-course workflow

Last synced: 28 Feb 2026

https://github.com/sukaato/dependencies-injection

Experimentation of dependency injection implementation.

dependency-injection experimentation typescript

Last synced: 27 Mar 2025

https://github.com/rwxrob/lab

Learning happens in the lab, not the lecture hall. This repo contains various different coding and technical lab experiments, exercises, and explorations.

codebook education educational examples exercises experimentation exploration lab labs learning recepies self-assessment

Last synced: 11 Jan 2026