Projects in Awesome Lists tagged with reproducibility

https://github.com/wandb/wandb

The AI developer platform. Use Weights & Biases to train and fine-tune models, and manage models from experimentation to production.

ai collaboration data-science data-versioning deep-learning experiment-track hyperparameter-optimization hyperparameter-search hyperparameter-tuning jax keras machine-learning ml-platform mlops model-versioning pytorch reinforcement-learning reproducibility tensorflow

Last synced: 05 Feb 2026

https://github.com/idsia/sacred

Sacred is a tool to help you configure, organize, log and reproduce experiments developed at IDSIA.

infrastructure machine-learning mongodb python reproducibility reproducible-research reproducible-science

Last synced: 19 Oct 2025

https://github.com/IDSIA/sacred

Sacred is a tool to help you configure, organize, log and reproduce experiments developed at IDSIA.

infrastructure machine-learning mongodb python reproducibility reproducible-research reproducible-science

Last synced: 18 Apr 2025

https://github.com/ashleve/lightning-hydra-template

PyTorch Lightning + Hydra. A very user-friendly template for ML experimentation. ⚡🔥⚡

best-practices config deep-learning hydra mlops project-structure pytorch pytorch-lightning reproducibility template

Last synced: 14 May 2025

https://github.com/catalyst-team/catalyst

Accelerated deep learning R&D

computer-vision deep-learning distributed-computing image-classification image-processing image-segmentation information-retrieval infrastructure machine-learning metric-learning natural-language-processing object-detection python pytorch recommender-system reinforcement-learning reproducibility research text-classification text-segmentation

Last synced: 13 May 2025

https://github.com/sahibzada-allahyar/YC-Killer

A library of enterprise-grade AI agents designed to democratize artificial intelligence and provide free, open-source alternatives to overvalued Y Combinator startups. If you are excited about democratizing AI access & AI agents, please star ⭐️ this repository and apply using the link in the readme to join our open source AI research team.

agora astrophysics bayesian-inference cosmology fastapi lean lean4 mcp openxr photon physics proof-assistant quantum ready-player-me reinforcement-learning reproducibility unity vr-office wolfram-alpha xri

Last synced: 04 Jun 2026

https://github.com/snakemake/snakemake

This is the development home of the workflow management system Snakemake. For general information, see

reproducibility snakemake workflow-management

Last synced: 29 Jan 2026

https://github.com/rlworkgroup/garage

A toolkit for reproducible reinforcement learning research.

pytorch reproducibility rl-algorithms tensorflow

Last synced: 14 May 2025

https://github.com/clementchadebec/benchmark_vae

Unifying Variational Autoencoder (VAE) implementations in Pytorch (NeurIPS 2022)

benchmarking beta-vae comparison normalizing-flows pixel-cnn pytorch reproducibility reproducible-research vae vae-gan vae-implementation vae-pytorch variational-autoencoder vq-vae wasserstein-autoencoder

Last synced: 14 May 2025

https://github.com/clementchadebec/benchmark_VAE

Unifying Variational Autoencoder (VAE) implementations in Pytorch (NeurIPS 2022)

benchmarking beta-vae comparison normalizing-flows pixel-cnn pytorch reproducibility reproducible-research vae vae-gan vae-implementation vae-pytorch variational-autoencoder vq-vae wasserstein-autoencoder

Last synced: 29 Apr 2025

https://github.com/cloud-cv/evalai

:cloud: :rocket: :bar_chart: :chart_with_upwards_trend: Evaluating state of the art in AI

ai ai-challenges angularjs artificial-intelligence challenge codecov coveralls django docker evalai evaluation leaderboard machine-learning python reproducibility reproducible-research travis-ci

Last synced: 14 May 2025

https://github.com/Cloud-CV/EvalAI

:cloud: :rocket: :bar_chart: :chart_with_upwards_trend: Evaluating state of the art in AI

ai ai-challenges angular7 angularjs artificial-intelligence challenge django docker evalai evaluation leaderboard machine-learning python reproducibility reproducible-research

Last synced: 26 Mar 2025

https://github.com/the-nix-way/dev-templates

Dev environments for numerous languages based on Nix flakes [maintainer=@lucperkins]

flakes nix reproducibility

Last synced: 14 May 2025

https://github.com/mlreef/mlreef

The collaboration workspace for Machine Learning

artificial-intelligence data-science deep-learning deeplearning machine-learning machine-learning-algorithms mlops mlops-environment models mxnet pytorch reproducibility tensorflow

Last synced: 15 May 2025

https://github.com/MLReef/mlreef

The collaboration workspace for Machine Learning

artificial-intelligence data-science deep-learning deeplearning machine-learning machine-learning-algorithms mlops mlops-environment models mxnet pytorch reproducibility tensorflow

Last synced: 15 Mar 2025

https://github.com/joedicastro/vps-comparison

A comparison between some VPS providers. It uses Ansible to perform a series of automated benchmark tests over the VPS servers that you specify. It allows the reproducibility of those tests by anyone that wanted to compare these results to their own. All the tests results are available in order to provide independence and transparency.

ansible cloud comparison hosting independence python reproducibility transparency vps

Last synced: 16 May 2025

https://github.com/ropensci/drake

An R-focused pipeline toolkit for reproducibility and high-performance computing

data-science drake high-performance-computing makefile peer-reviewed pipeline r r-package reproducibility reproducible-research ropensci rstats workflow

Last synced: 13 May 2025

https://github.com/nix-community/dream2nix

Simplified nix packaging for various programming language ecosystems [maintainer=@DavHau]

2nix dream-to-nix hacktoberfest lang2nix nix nix-community-buildbot nixos nodejs package-management reproducibility rust

Last synced: 14 May 2025

https://github.com/ddsjoberg/gtsummary

Presentation-Ready Data Summary and Analytic Result Tables

easy-to-use gt html5 r r-package regression-models reproducibility reproducible-research rstats statistics summary-statistics summary-tables table1 tableone

Last synced: 13 May 2025

https://github.com/toshas/torch-fidelity

High-fidelity performance metrics for generative models in PyTorch

evaluation frechet-inception-distance gan generative-model inception-score kernel-inception-distance metrics perceptual-path-length precision pytorch reproducibility reproducible-research

Last synced: 14 May 2025

https://github.com/ropensci/targets

Function-oriented Make-like declarative workflows for R

data-science high-performance-computing make peer-reviewed pipeline r r-package r-targetopia reproducibility reproducible-research rstats targets workflow

Last synced: 13 May 2025

https://github.com/MaurizioFD/RecSys2019_DeepLearning_Evaluation

This is the repository of our article published in RecSys 2019 "Are We Really Making Much Progress? A Worrying Analysis of Recent Neural Recommendation Approaches" and of several follow-up studies.

bpr bprmf bprslim collaborative-filtering content-based-recommendation deep-learning evaluation-framework funksvd hybrid-recommender-system hyperparameters knn matrix-completion matrix-factorization neural-network recommendation-algorithms recommendation-system recommender-system reproducibility reproducible-research slimelasticnet

Last synced: 11 May 2025

https://github.com/davhau/mach-nix

Create highly reproducible python environments

mach-nix nix nix-expression nixos nixpkgs python python-deps python-environment python-packages reproducibility

Last synced: 15 May 2025

https://github.com/DavHau/mach-nix

Create highly reproducible python environments

mach-nix nix nix-expression nixos nixpkgs python python-deps python-environment python-packages reproducibility

Last synced: 20 Mar 2025

https://github.com/openwdl/wdl

Specification for the Workflow Description Language (WDL).

bioinformatics cloud openwdl reproducibility reproducible-science wdl workflow

Last synced: 15 Feb 2026

https://github.com/tidyverse/reprex

Render bits of R code for sharing, e.g., on GitHub or StackOverflow.

github r reproducibility rmarkdown stackoverflow

Last synced: 30 Jul 2025

https://github.com/ptrsr/pi-ci

Prepare Raspberry Pi 3, 4 & 5 configurations using a virtual machine.

ansible container continuous-integration docker raspberry-pi reproducibility virtual-machine

Last synced: 15 May 2025

https://github.com/tweag/jupyenv

Declarative and reproducible Jupyter environments - powered by Nix

jupyter jupyter-notebooks jupyterlab nix reproducibility

Last synced: 25 Dec 2025

https://github.com/benmarwick/rrtools

rrtools: Tools for Writing Reproducible Research in R

quarto quarto-template r reproducibility reproducible-paper reproducible-research reproducible-science research-compendium research-paper research-project research-tool

Last synced: 16 May 2025

https://github.com/grok-ai/nn-template

Generic template to bootstrap your PyTorch project.

best-practices best-practises cookiecutter deep-learning dvc github-actions huggingface-datasets hydra mkdocs pre-commit project-structure pytorch pytorch-lightning reproducibility research streamlit template wandb weights-and-biases

Last synced: 04 Apr 2025

https://github.com/kwotsin/mimicry

[CVPR 2020 Workshop] A PyTorch GAN library that reproduces research results for popular GANs.

cgan cvpr cvpr20 cvpr2020 dcgan gan gans generative-adversarial-networks generative-models infomax-gan machine-learning python pytorch reproducibility sngan sngan-projection ssgan wgan-gp

Last synced: 12 Apr 2025

https://github.com/understandable-machine-intelligence-lab/quantus

Quantus is an eXplainable AI toolkit for responsible evaluation of neural network explanations

deep-learning explainable-ai interpretability machine-learning pytorch quantification-evaluation-methods reproducibility tensorflow xai

Last synced: 14 May 2025

https://github.com/henripal/labnotebook

LabNotebook is a tool that allows you to flexibly monitor, record, save, and query all your machine learning experiments.

experiment-manager experimental-data machine-learning postgres postgresql python reproducibility reproducible-research vuejs webapp

Last synced: 18 Apr 2025

https://github.com/understandable-machine-intelligence-lab/Quantus

Quantus is an eXplainable AI toolkit for responsible evaluation of neural network explanations

deep-learning explainable-ai interpretability machine-learning pytorch quantification-evaluation-methods reproducibility tensorflow xai

Last synced: 08 May 2025

https://github.com/nvidia/framework-reproducibility

Providing reproducibility in deep learning frameworks

atomics d9m deep-learning determinism deterministic-ops frameworks fwr13y gpu-determinism gpu-support ngc noise noise-reduction pytorch r13y reproducibility seed seeder tensorflow variance-reduction

Last synced: 16 May 2025

https://github.com/NVIDIA/framework-reproducibility

Providing reproducibility in deep learning frameworks

atomics d9m deep-learning determinism deterministic-ops frameworks fwr13y gpu-determinism gpu-support ngc noise noise-reduction pytorch r13y reproducibility seed seeder tensorflow variance-reduction

Last synced: 24 Apr 2025

https://github.com/bwplotka/bingo

Like `go get` but for Go tools! CI Automating versioning of Go binaries in a nested, isolated Go modules.

go golang gomodules modules packages pin reproducibility thanos versioning

Last synced: 14 May 2025

https://github.com/mit-ll-responsible-ai/hydra-zen

Create powerful Hydra applications without the yaml files and boilerplate code.

configurable configuration dataclasses deep-learning dynamic-configuration machine-learning machinelearning pytorch pytorch-lightning reproducibility reproducible-science scalable yaml-configuration

Last synced: 14 May 2025

https://github.com/datmo/datmo

Open source production model management tool for data scientists

artificial-intelligence data-science deep-learning machine-learning reproducibility version-control

Last synced: 14 Dec 2025

https://github.com/VIDA-NYU/reprozip

ReproZip is a tool that simplifies the process of creating reproducible experiments from command-line executions, a frequently-used common denominator in computational science.

archiving computational-science docker hacktoberfest linux nyu ptrace python reproducibility reproducible-research reproducible-science reprounzip reprozip science scientific-computing vagrant

Last synced: 27 Mar 2025

https://github.com/vida-nyu/reprozip

ReproZip is a tool that simplifies the process of creating reproducible experiments from command-line executions, a frequently-used common denominator in computational science.

archiving computational-science docker hacktoberfest linux nyu ptrace python reproducibility reproducible-research reproducible-science reprounzip reprozip science scientific-computing vagrant

Last synced: 10 Apr 2025

https://github.com/matthewcroughan/nixcfg

My nix configuration(s), using flakes. It's my laptop, it's my servers, it's my everything, in code.

dotfiles flakes infrastructure-as-code nix nixos reproducibility

Last synced: 07 Apr 2025

https://github.com/getpopper/popper

Container-native task automation engine.

automation-engine cli containers devops docker podman reproducibility sciops singularity workflows

Last synced: 14 Dec 2025

https://github.com/MatthewCroughan/nixcfg

My nix configuration(s), using flakes. It's my laptop, it's my servers, it's my everything, in code.

dotfiles flakes infrastructure-as-code nix nixos reproducibility

Last synced: 17 Apr 2025

https://github.com/ropensci/rix

Reproducible Data Science environments for R with Nix

nix peer-reviewed reproducibility reproducible-research

Last synced: 25 Jun 2025

https://github.com/buildsafedev/bsf

Developer-centric tool to secure your software supply chain.

hacktoberfest nix reproducibility slsa supply-chain-security

Last synced: 16 May 2025

https://github.com/anaconda/anaconda-project

Tool for encapsulating, running, and reproducing data science projects

anaconda conda-environment data datascience encapsulation reproducibility running

Last synced: 11 Dec 2025

https://github.com/AI4LIFE-GROUP/OpenXAI

OpenXAI : Towards a Transparent Evaluation of Model Explanations

benchmark explainability explainable-ai interpretability leaderboard reproducibility

Last synced: 28 Apr 2025

https://github.com/maxmcd/bramble

Purely functional build system and package manager

bramble build-system golang package-manager reproducibility starlark

Last synced: 15 Mar 2025

https://github.com/the-nix-way/nome

My Nix home

dev-environments home-manager nix nixos reproducibility

Last synced: 17 Mar 2025

https://github.com/datajoint/datajoint-python

Relational data pipelines for the science lab

data-engineering data-integrity data-lineage data-pipelines datajoint declarative metadata-management mysql neuroscience object-storage postgresql python relational-model reproducibility research-software schema-management scientific-computing workflow-management

Last synced: 17 Feb 2026

https://github.com/stal-ix/ix

ix package manager, statically build packages, for darwin/linux, with clang

bootstrap distribution hermetcity linking reproducibility static

Last synced: 01 Jun 2026

https://github.com/michelenuijten/statcheck

A spellchecker for statistics

cran nhst p-values r reproducibility statistics

Last synced: 22 Oct 2025

https://github.com/mlr-org/batchtools

Tools for computation on batch systems

batchexperiments batchjobs cran docker-swarm high-performance-computing hpc hpc-clusters lsf openlava parallel-computing r reproducibility sge slurm torque

Last synced: 02 Apr 2026

https://github.com/iterative/example-get-started

Get started DVC project (NLP, random forest)

dvc example machine-learning nlp python random-forest reproducibility reproducible reproducible-research

Last synced: 18 Jun 2025

https://github.com/tycho-kirchner/shournal

Log shell-commands and used files. Snapshot executed scripts. Fully automatic.

bash command-tracker computational-science file-tracker lowlevel provenance reproducibility reproducible-research reproducible-science shell zsh

Last synced: 06 Mar 2025

https://github.com/swcarpentry/make-novice

Automation and Make

automation carpentries english lesson make programming reproducibility software-carpentry stable

Last synced: 21 Jan 2026

https://swcarpentry.github.io/make-novice/

Automation and Make

automation carpentries english lesson make programming reproducibility software-carpentry stable

Last synced: 08 Sep 2025

https://github.com/ropensci/datapackager

An R package to enable reproducible data processing, packaging and sharing.

peer-reviewed r r-package reproducibility rstats

Last synced: 06 Sep 2025

https://github.com/ropensci/DataPackageR

An R package to enable reproducible data processing, packaging and sharing.

peer-reviewed r r-package reproducibility rstats

Last synced: 08 Apr 2025

https://github.com/ropensci/tarchetypes

Archetypes for targets and pipelines

data-science high-performance-computing peer-reviewed pipeline r r-package r-targetopia reproducibility rstats targets workflow

Last synced: 16 May 2025

https://github.com/minerva-ml/steppy

Lightweight, Python library for fast and reproducible experimentation :microscope:

data-science deep-learning image-processing machine-learning minimal-interface nlp open-source pipeline python python-library python3 reproducibility reproducible-research steppy steppy-library steppy-toolkit steps

Last synced: 27 Mar 2025

https://github.com/scalacenter/scalac-profiling

Compilation profiling tool for Scala 2 projects

implicit-searches macros reproducibility sbt-plugin scala-development scalac statistics

Last synced: 05 Apr 2025

https://github.com/glotzerlab/signac

Manage large and heterogeneous data spaces on the file system.

data data-management database reproducibility

Last synced: 08 Apr 2025

https://github.com/lockedata/starters

R Package 📦 for initializing projects for various R activities :nut_and_bolt:

developer-tools r r-package reproducibility rstats setup setup-tool setuptools

Last synced: 13 Jul 2025

https://github.com/aaronpeikert/reproducible-research

A Reproducible Data Analysis Workflow with R Markdown, Git, Make, and Docker

containerization dependency-management literate-programming open-science r reproducibility version-management

Last synced: 13 Apr 2025

https://github.com/stencila/dockta

🐳 A Docker image builder for researchers

docker dockerfile nodejs python r reproducibility

Last synced: 13 Apr 2025

https://github.com/singularityhub/singularity-hpc

Local filesystem registry for containers (intended for HPC) using Lmod or Environment Modules. Works for users and admins.

containers hpc lmod reproducibility singularity

Last synced: 16 May 2025

https://github.com/frankkramer-lab/miseval

a metric library for Medical Image Segmentation EVALuation

evaluaton medical-image-segmentation metrics pip python reproducibility segmentation statistics

Last synced: 30 Jun 2025

https://github.com/ropensci/ezknitr

Avoid the typical working directory pain when using 'knitr'

knitr peer-reviewed r r-package reproducibility rmarkdown rmd rstats

Last synced: 22 Oct 2025

https://github.com/deanmarchiori/analysis-flow

Data Analysis Workflows & Reproducibility Learning Resources

data-analysis reproducibility reproducible-data-science reproducible-science tooling workflow

Last synced: 29 Jul 2025

https://github.com/ml-tooling/ml-project-template

ML project template facilitating both research and production phases.

docker machine-learning reproducibility

Last synced: 20 Oct 2025

https://github.com/jvalegre/aqme

Automated Quantum Mechanical Environments (AQME) offers transparent and reproducible workflows available for Jupyter Notebooks and command lines, including: 1) RDKit- and CREST-based conformer generation, 2) QM input file creation, 3) post-processing of QM output files, 4) generation of xTB, DFT and RDKit descriptors. https://aqme.readthedocs.io

automation cheminformatics jupyter-notebooks python quantum-chemistry reproducibility workflows

Last synced: 13 Apr 2025

https://github.com/formlio/forml

ForML - A development framework and MLOps platform for the lifecycle management of data science projects

ai data-science machine-learning ml mlops portability python reproducibility

Last synced: 08 May 2025

https://github.com/wlandau/targets-tutorial

Short course on the targets R package

data-science make pipeline r r-package reproducibility reproducible-research rstats targets workflow

Last synced: 16 Mar 2025

https://github.com/braintwister/docker-devel-env

Fast, reproducible, and portable software development environments

clang cmake conan cuda development docker eclipse gcc jenkins nsight portability reproducibility vscode

Last synced: 23 Oct 2025

https://github.com/smarr/rebench

Execute and document benchmarks reproducibly.

benchmarking continuous-benchmarking continuous-testing performance-tracking python reproducibility research-tool science

Last synced: 12 Apr 2025

https://github.com/BrainTwister/docker-devel-env

Fast, reproducible, and portable software development environments

clang cmake conan cuda development docker eclipse gcc jenkins nsight portability reproducibility vscode

Last synced: 06 Aug 2025

https://github.com/snakemake-workflows/dna-seq-varlociraptor

A Snakemake workflow for calling small and structural variants under any kind of scenario (tumor/normal, tumor/normal/relapse, germline, pedigree, populations) via the unified statistical model of Varlociraptor.

genomic-variant-calling reproducibility sciworkflows snakemake varlociraptor

Last synced: 25 May 2026

https://github.com/ropensci/gittargets

Data version control for reproducible analysis pipelines in R with {targets}.

data-science data-version-control data-versioning r r-package reproducibility reproducible-research rstats targets workflow

Last synced: 21 Aug 2025

https://github.com/mcs-cli/mcs

Managed Claude Stack - Reproducible AI infrastructure for Claude Code

agent agentic-ai claude-code convergence portability reproducibility

Last synced: 29 Apr 2026

https://github.com/greenelab/continuous_analysis

Computational reproducibility using Continuous Integration to produce verifiable end-to-end runs of scientific analysis.

continuous-integration methodology open-science reproducibility supplement

Last synced: 05 May 2025

https://github.com/gesistsa/rang

🐶 (Re)constructing R computational environments

cran r reproducibility reproducible-research rstats

Last synced: 05 May 2025

https://github.com/neurogenomics/rworkflows

Continuous integration for R packages. 🔀 Automates testing ✅, documentation website building 📦, & containerised deployment 🐳.

bioconductor containers continuous-integration cran-r docker dockerhub github-actions r reproducibility workflows

Last synced: 05 Apr 2025

https://github.com/pfnet-research/git-ghost

Synchronize your working directory efficiently to a remote place without committing the changes.

docker git kubernetes reproducibility

Last synced: 13 Apr 2025

https://github.com/jesperdramsch/ml.recipes

Increase citations, ease review & collaboration A collection of "easy wins" to make machine learning in research reproducible. This tutorial focuses on basics that work. Getting you 90% of the way to top-tier reproducibility.

jupyter-book machine-learning ml4science python reproducibility science software-sustainability

Last synced: 07 Apr 2025

https://github.com/HALFpipe/HALFpipe

ENIGMA HALFpipe is a user-friendly software that facilitates reproducible analysis of fMRI data

bids fmri meta-analysis neuroimaging pipeline reproducibility

Last synced: 01 May 2025

https://github.com/ropensci/geotargets

Targets extensions for geospatial data

geospatial pipeline r r-package r-targetopia raster reproducibility reproducible-research rstats targets vector workflow

Last synced: 09 Apr 2025

https://github.com/njtierney/geotargets

Targets extensions for geospatial data

geospatial pipeline r r-package r-targetopia raster reproducibility reproducible-research rstats targets vector workflow

Last synced: 03 Mar 2025

https://github.com/the-nix-way/real-world-devops-with-nix

An example project for building containers with Nix and deploying them to Kubernetes

devops docker go golang kubernetes nix reproducibility terraform

Last synced: 03 Apr 2025

https://github.com/polydawn/repeatr

Repeatr: Reproducible, hermetic Computation. Provision containers from Content-Addressable snapshots; run using familiar containers (e.g. runc); store outputs in Content-Addressable form too! JSON API; connect your own pipelines! (Or, use github.com/polydawn/stellar for pipelines!)

containers distributed formula reproducibility reproducible-builds snapshots timeless timeless-stack

Last synced: 22 Feb 2026

https://github.com/odeleongt/postr

Prepare reproducible R Markdown posters

poster r reproducibility template

Last synced: 25 Oct 2025

https://github.com/wlandau/targets-shiny

Example Shiny app containing a targets pipeline.

high-performance-computing make pipeline r reproducibility reproducible-research shiny targets workflow

Last synced: 20 Mar 2025

https://github.com/uczltw6/trace-file-lineage

Find which script, notebook, data, command, or AI agent produced a file — locally, with evidence and honest uncertainty.

ai-agents artifact-tracking claude-code cli codex data-lineage data-provenance developer-tools file-lineage local-first provenance python reproducibility research-tools

Last synced: 13 Sep 2026

https://github.com/ywatanabe1989/scitex-python

Python toolkit for reproducible science. CLI commands, 371+ MCP tools, built-in skills. From raw data to manuscript — with reproducibility verification. For AI and human researchers.

academic-writing ai-research automation bibtex data-visualization generative-ai latex literature-review machine-learning matplotlib mcp mcp-server pandas python pytorch reproducibility research-automation scientific-computing scitex statistics