Projects in Awesome Lists tagged with experimentation

https://github.com/growthbook/growthbook

Open Source Feature Flagging and A/B Testing Platform

ab-testing abtest abtesting analytics bigquery clickhouse continuous-delivery data-analysis data-engineering data-science experimentation feature-flagging feature-flags mixpanel redshift remote-config snowflake split-testing statistics

Last synced: 29 Sep 2024

https://github.com/uptrain-ai/uptrain

UpTrain is an open-source unified platform to evaluate and improve Generative AI applications. We provide grades for 20+ preconfigured checks (covering language, code, embedding use-cases), perform root cause analysis on failure cases and give insights on how to resolve them.

autoevaluation evaluation experimentation hallucination-detection jailbreak-detection llm-eval llm-prompting llm-test llmops machine-learning monitoring openai-evals prompt-engineering root-cause-analysis

Last synced: 30 Sep 2024

https://github.com/dotnet/corefxlab

This repo is for experimentation and exploring new ideas that may or may not make it into the main corefx repo.

c-sharp corefx dotnet experimentation

Last synced: 27 Sep 2024

https://github.com/shadow/shadow

Shadow is a discrete-event network simulator that directly executes real application code, enabling you to simulate distributed systems with thousands of network-connected processes in realistic and scalable private network experiments using your laptop, desktop, or server running Linux.

control emulation experimentation networking realism scalability science-research scientific-computing simulation tor

Last synced: 25 Sep 2024

https://github.com/featbit/featbit

A feature flags service written in .NET

ab-test ab-testing asp-net-core continuous-delivery csharp dotnet entitlement experimentation feature feature-flags feature-management feature-toggles progressive-delivery python release-as-code remote-config self-hosted typescript

Last synced: 01 Oct 2024

https://github.com/thomaspoignant/go-feature-flag

GO Feature Flag is a simple, complete and lightweight self-hosted feature flag solution 100% Open Source. 🎛️

beginner-friendly continuous-delivery continuous-deployment continuous-testing devops experimentation experiments feature-flag feature-flags feature-toggle feature-toggles feature-toggling go golang golang-library help-wanted toggles variants

Last synced: 01 Oct 2024

https://github.com/huntermcgushion/hyperparameter_hunter

Easy hyperparameter optimization and automatic result saving across machine learning algorithms and libraries

ai artificial-intelligence catboost data-science deep-learning experimentation feature-engineering hyperparameter-optimization hyperparameter-tuning keras lightgbm machine-learning ml neural-network optimization python rgf scikit-learn sklearn xgboost

Last synced: 26 Sep 2024

https://github.com/HunterMcGushion/hyperparameter_hunter

Easy hyperparameter optimization and automatic result saving across machine learning algorithms and libraries

ai artificial-intelligence catboost data-science deep-learning experimentation feature-engineering hyperparameter-optimization hyperparameter-tuning keras lightgbm machine-learning ml neural-network optimization python rgf scikit-learn sklearn xgboost

Last synced: 02 Aug 2024

https://github.com/featurevisor/featurevisor

Feature flags, experiments, and remote config management with GitOps

ab-testing experimentation experiments feature feature-flags feature-management feature-toggles flags gitops javascript nodejs react reactjs segmentation toggles vue vuejs

Last synced: 06 Aug 2024

https://github.com/zalando/expan

Open-source Python library for statistical analysis of randomised control trials (A/B tests)

ab-testing abtest abtesting causal-inference experimentation python statistical-analysis statistics

Last synced: 02 Aug 2024

https://github.com/microsoft/genaiops-promptflow-template

GenAIOps with Prompt Flow is a "GenAIOps template and guidance" to help you build LLM-infused apps using Prompt Flow. It offers a range of features including Centralized Code Hosting, Lifecycle Management, Variant and Hyperparameter Experimentation, A/B Deployment, reporting for all runs and experiments and so on.

aistudio azure azuremachinelearning cloud docker evaluation experimentation genai genaiops largelanguagemodels llm llmops machine-learning mlops mlops-template orchestration prompt promptengineering promptflow python