Projects in Awesome Lists tagged with reproducibility

https://github.com/iterative/dvc

🦉 Data Versioning and ML Experiments

ai data-science data-version-control developer-tools machine-learning reproducibility unstructured-data

Last synced: 16 Dec 2024

https://github.com/wandb/wandb

The AI developer platform. Use Weights & Biases to train and fine-tune models, and manage models from experimentation to production.

ai collaboration data-science data-versioning deep-learning experiment-track hyperparameter-optimization hyperparameter-search hyperparameter-tuning jax keras machine-learning ml-platform mlops model-versioning pytorch reinforcement-learning reproducibility tensorflow

Last synced: 21 Dec 2024

https://github.com/idsia/sacred

Sacred is a tool to help you configure, organize, log and reproduce experiments developed at IDSIA.

infrastructure machine-learning mongodb python reproducibility reproducible-research reproducible-science

Last synced: 16 Dec 2024

https://github.com/IDSIA/sacred

Sacred is a tool to help you configure, organize, log and reproduce experiments developed at IDSIA.

infrastructure machine-learning mongodb python reproducibility reproducible-research reproducible-science

Last synced: 09 Nov 2024

https://github.com/ashleve/lightning-hydra-template

PyTorch Lightning + Hydra. A very user-friendly template for ML experimentation. ⚡🔥⚡

best-practices config deep-learning hydra mlops project-structure pytorch pytorch-lightning reproducibility template

Last synced: 17 Dec 2024

https://github.com/catalyst-team/catalyst

Accelerated deep learning R&D

computer-vision deep-learning distributed-computing image-classification image-processing image-segmentation information-retrieval infrastructure machine-learning metric-learning natural-language-processing object-detection python pytorch recommender-system reinforcement-learning reproducibility research text-classification text-segmentation

Last synced: 17 Dec 2024

https://github.com/snakemake/snakemake

This is the development home of the workflow management system Snakemake. For general information, see

reproducibility snakemake workflow-management

Last synced: 24 Nov 2024

https://github.com/rlworkgroup/garage

A toolkit for reproducible reinforcement learning research.

pytorch reproducibility rl-algorithms tensorflow

Last synced: 19 Dec 2024

https://github.com/clementchadebec/benchmark_vae

Unifying Variational Autoencoder (VAE) implementations in Pytorch (NeurIPS 2022)

benchmarking beta-vae comparison normalizing-flows pixel-cnn pytorch reproducibility reproducible-research vae vae-gan vae-implementation vae-pytorch variational-autoencoder vq-vae wasserstein-autoencoder

Last synced: 17 Dec 2024

https://github.com/clementchadebec/benchmark_VAE

Unifying Variational Autoencoder (VAE) implementations in Pytorch (NeurIPS 2022)

benchmarking beta-vae comparison normalizing-flows pixel-cnn pytorch reproducibility reproducible-research vae vae-gan vae-implementation vae-pytorch variational-autoencoder vq-vae wasserstein-autoencoder

Last synced: 11 Nov 2024

https://github.com/cloud-cv/evalai

:cloud: :rocket: :bar_chart: :chart_with_upwards_trend: Evaluating state of the art in AI

ai ai-challenges angular7 angularjs artificial-intelligence challenge django docker evalai evaluation leaderboard machine-learning python reproducibility reproducible-research

Last synced: 18 Dec 2024

https://github.com/Cloud-CV/EvalAI

:cloud: :rocket: :bar_chart: :chart_with_upwards_trend: Evaluating state of the art in AI

ai ai-challenges angular7 angularjs artificial-intelligence challenge django docker evalai evaluation leaderboard machine-learning python reproducibility reproducible-research

Last synced: 30 Oct 2024

https://github.com/MLReef/mlreef

The collaboration workspace for Machine Learning

artificial-intelligence data-science deep-learning deeplearning machine-learning machine-learning-algorithms mlops mlops-environment models mxnet pytorch reproducibility tensorflow

Last synced: 27 Oct 2024

https://github.com/mlreef/mlreef

The collaboration workspace for Machine Learning

artificial-intelligence data-science deep-learning deeplearning machine-learning machine-learning-algorithms mlops mlops-environment models mxnet pytorch reproducibility tensorflow

Last synced: 15 Dec 2024

https://github.com/joedicastro/vps-comparison

A comparison between some VPS providers. It uses Ansible to perform a series of automated benchmark tests over the VPS servers that you specify. It allows the reproducibility of those tests by anyone that wanted to compare these results to their own. All the tests results are available in order to provide independence and transparency.

ansible cloud comparison hosting independence python reproducibility transparency vps

Last synced: 17 Dec 2024

https://github.com/ropensci/drake

An R-focused pipeline toolkit for reproducibility and high-performance computing

data-science drake high-performance-computing makefile peer-reviewed pipeline r r-package reproducibility reproducible-research ropensci rstats workflow

Last synced: 17 Dec 2024

https://github.com/the-nix-way/dev-templates

Dev environments for numerous languages based on Nix flakes [maintainer=@lucperkins]

flakes nix reproducibility

Last synced: 19 Dec 2024

https://github.com/ddsjoberg/gtsummary

Presentation-Ready Data Summary and Analytic Result Tables

easy-to-use gt html5 r r-package regression-models reproducibility reproducible-research rstats statistics summary-statistics summary-tables table1 tableone

Last synced: 17 Dec 2024

https://github.com/nix-community/dream2nix

Simplified nix packaging for various programming language ecosystems [maintainer=@DavHau]

2nix dream-to-nix hacktoberfest lang2nix nix nix-community-buildbot nixos nodejs package-management reproducibility rust

Last synced: 19 Dec 2024

https://github.com/toshas/torch-fidelity

High-fidelity performance metrics for generative models in PyTorch

evaluation frechet-inception-distance gan generative-model inception-score kernel-inception-distance metrics perceptual-path-length precision pytorch reproducibility reproducible-research

Last synced: 21 Dec 2024

https://github.com/MaurizioFD/RecSys2019_DeepLearning_Evaluation

This is the repository of our article published in RecSys 2019 "Are We Really Making Much Progress? A Worrying Analysis of Recent Neural Recommendation Approaches" and of several follow-up studies.

bpr bprmf bprslim collaborative-filtering content-based-recommendation deep-learning evaluation-framework funksvd hybrid-recommender-system hyperparameters knn matrix-completion matrix-factorization neural-network recommendation-algorithms recommendation-system recommender-system reproducibility reproducible-research slimelasticnet

Last synced: 17 Nov 2024

https://github.com/ropensci/targets

Function-oriented Make-like declarative workflows for R

data-science high-performance-computing make peer-reviewed pipeline r r-package r-targetopia reproducibility reproducible-research rstats targets workflow

Last synced: 17 Dec 2024

https://github.com/davhau/mach-nix

Create highly reproducible python environments

mach-nix nix nix-expression nixos nixpkgs python python-deps python-environment python-packages reproducibility

Last synced: 21 Dec 2024

https://github.com/DavHau/mach-nix

Create highly reproducible python environments

mach-nix nix nix-expression nixos nixpkgs python python-deps python-environment python-packages reproducibility

Last synced: 27 Oct 2024

https://github.com/tidyverse/reprex

Render bits of R code for sharing, e.g., on GitHub or StackOverflow.

github r reproducibility rmarkdown stackoverflow

Last synced: 04 Dec 2024

https://github.com/openwdl/wdl

Workflow Description Language - Specification and Implementations

bioinformatics cloud cromwell openwdl reproducibility reproducible-science wdl workflow

Last synced: 06 Nov 2024

https://github.com/benmarwick/rrtools

rrtools: Tools for Writing Reproducible Research in R

quarto quarto-template r reproducibility reproducible-paper reproducible-research reproducible-science research-compendium research-paper research-project research-tool

Last synced: 21 Dec 2024

https://github.com/ptrsr/pi-ci

Prepare Raspberry Pi 3, 4 & 5 configurations using a virtual machine.

ansible container continuous-integration docker raspberry-pi reproducibility virtual-machine

Last synced: 20 Dec 2024

https://github.com/tweag/jupyenv

Declarative and reproducible Jupyter environments - powered by Nix

jupyter jupyter-notebooks jupyterlab nix reproducibility

Last synced: 20 Dec 2024

https://github.com/grok-ai/nn-template

Generic template to bootstrap your PyTorch project.

best-practices best-practises cookiecutter deep-learning dvc github-actions huggingface-datasets hydra mkdocs pre-commit project-structure pytorch pytorch-lightning reproducibility research streamlit template wandb weights-and-biases

Last synced: 20 Dec 2024

https://github.com/kwotsin/mimicry

[CVPR 2020 Workshop] A PyTorch GAN library that reproduces research results for popular GANs.

cgan cvpr cvpr20 cvpr2020 dcgan gan gans generative-adversarial-networks generative-models infomax-gan machine-learning python pytorch reproducibility sngan sngan-projection ssgan wgan-gp

Last synced: 17 Dec 2024

https://github.com/henripal/labnotebook

LabNotebook is a tool that allows you to flexibly monitor, record, save, and query all your machine learning experiments.

experiment-manager experimental-data machine-learning postgres postgresql python reproducibility reproducible-research vuejs webapp

Last synced: 09 Nov 2024

https://github.com/understandable-machine-intelligence-lab/Quantus

Quantus is an eXplainable AI toolkit for responsible evaluation of neural network explanations

deep-learning explainable-ai interpretability machine-learning pytorch quantification-evaluation-methods reproducibility tensorflow xai

Last synced: 15 Nov 2024

https://github.com/NVIDIA/framework-reproducibility

Providing reproducibility in deep learning frameworks

atomics d9m deep-learning determinism deterministic-ops frameworks fwr13y gpu-determinism gpu-support ngc noise noise-reduction pytorch r13y reproducibility seed seeder tensorflow variance-reduction

Last synced: 10 Nov 2024

https://github.com/nvidia/framework-reproducibility

Providing reproducibility in deep learning frameworks

atomics d9m deep-learning determinism deterministic-ops frameworks fwr13y gpu-determinism gpu-support ngc noise noise-reduction pytorch r13y reproducibility seed seeder tensorflow variance-reduction

Last synced: 15 Dec 2024

https://github.com/bwplotka/bingo

Like `go get` but for Go tools! CI Automating versioning of Go binaries in a nested, isolated Go modules.

go golang gomodules modules packages pin reproducibility thanos versioning

Last synced: 21 Dec 2024

https://github.com/datmo/datmo

Open source production model management tool for data scientists

artificial-intelligence data-science deep-learning machine-learning reproducibility version-control

Last synced: 12 Nov 2024

https://github.com/mit-ll-responsible-ai/hydra-zen

Create powerful Hydra applications without the yaml files and boilerplate code.

configurable configuration dataclasses deep-learning dynamic-configuration machine-learning machinelearning pytorch pytorch-lightning reproducibility reproducible-science scalable yaml-configuration

Last synced: 15 Nov 2024

https://github.com/vida-nyu/reprozip

ReproZip is a tool that simplifies the process of creating reproducible experiments from command-line executions, a frequently-used common denominator in computational science.

archiving computational-science docker hacktoberfest linux nyu ptrace python reproducibility reproducible-research reproducible-science reprounzip reprozip science scientific-computing vagrant

Last synced: 17 Dec 2024

https://github.com/getpopper/popper

Container-native task automation engine.

automation-engine cli containers devops docker podman reproducibility sciops singularity workflows

Last synced: 28 Oct 2024

https://github.com/VIDA-NYU/reprozip

ReproZip is a tool that simplifies the process of creating reproducible experiments from command-line executions, a frequently-used common denominator in computational science.

archiving computational-science docker hacktoberfest linux nyu ptrace python reproducibility reproducible-research reproducible-science reprounzip reprozip science scientific-computing vagrant

Last synced: 30 Oct 2024

https://github.com/matthewcroughan/nixcfg

My nix configuration(s), using flakes. It's my laptop, it's my servers, it's my everything, in code.

dotfiles flakes infrastructure-as-code nix nixos reproducibility

Last synced: 17 Dec 2024

https://github.com/MatthewCroughan/nixcfg

My nix configuration(s), using flakes. It's my laptop, it's my servers, it's my everything, in code.

dotfiles flakes infrastructure-as-code nix nixos reproducibility

Last synced: 08 Nov 2024

https://github.com/AI4LIFE-GROUP/OpenXAI

OpenXAI : Towards a Transparent Evaluation of Model Explanations

benchmark explainability explainable-ai interpretability leaderboard reproducibility

Last synced: 11 Nov 2024

https://github.com/anaconda/anaconda-project

Tool for encapsulating, running, and reproducing data science projects

anaconda conda-environment data datascience encapsulation reproducibility running

Last synced: 18 Dec 2024

https://github.com/the-nix-way/nome

My Nix home

dev-environments home-manager nix nixos reproducibility

Last synced: 18 Nov 2024

https://github.com/maxmcd/bramble

Purely functional build system and package manager

bramble build-system golang package-manager reproducibility starlark

Last synced: 26 Oct 2024

https://github.com/mllg/batchtools

Tools for computation on batch systems

batchexperiments batchjobs cran docker-swarm high-performance-computing hpc hpc-clusters lsf openlava parallel-computing r reproducibility sge slurm torque

Last synced: 18 Dec 2024

https://github.com/iterative/example-get-started

Get started DVC project (NLP, random forest)

dvc example machine-learning nlp python random-forest reproducibility reproducible reproducible-research

Last synced: 14 Nov 2024

https://github.com/tycho-kirchner/shournal

Log shell-commands and used files. Snapshot executed scripts. Fully automatic.

bash command-tracker computational-science file-tracker lowlevel provenance reproducibility reproducible-research reproducible-science shell zsh

Last synced: 20 Oct 2024

https://swcarpentry.github.io/make-novice/

Automation and Make

automation carpentries english lesson make programming reproducibility software-carpentry stable

Last synced: 12 Sep 2024

https://github.com/swcarpentry/make-novice

Automation and Make

automation carpentries english lesson make programming reproducibility software-carpentry stable

Last synced: 19 Nov 2024

https://github.com/ropensci/DataPackageR

An R package to enable reproducible data processing, packaging and sharing.

peer-reviewed r r-package reproducibility rstats

Last synced: 06 Nov 2024

https://github.com/ropensci/tarchetypes

Archetypes for targets and pipelines

data-science high-performance-computing peer-reviewed pipeline r r-package r-targetopia reproducibility rstats targets workflow

Last synced: 15 Dec 2024

https://github.com/minerva-ml/steppy

Lightweight, Python library for fast and reproducible experimentation :microscope:

data-science deep-learning image-processing machine-learning minimal-interface nlp open-source pipeline python python-library python3 reproducibility reproducible-research steppy steppy-library steppy-toolkit steps

Last synced: 30 Oct 2024

https://github.com/scalacenter/scalac-profiling

Compilation profiling tool for Scala 2 projects

implicit-searches macros reproducibility sbt-plugin scala-development scalac statistics

Last synced: 15 Dec 2024

https://github.com/glotzerlab/signac

Manage large and heterogeneous data spaces on the file system.

data data-management database hacktoberfest reproducibility

Last synced: 21 Dec 2024

https://github.com/lockedata/starters

R Package 📦 for initializing projects for various R activities :nut_and_bolt:

developer-tools r r-package reproducibility rstats setup setup-tool setuptools

Last synced: 22 Nov 2024

https://github.com/aaronpeikert/reproducible-research

A Reproducible Data Analysis Workflow with R Markdown, Git, Make, and Docker

containerization dependency-management literate-programming open-science r reproducibility version-management

Last synced: 07 Nov 2024

https://github.com/stencila/dockta

🐳 A Docker image builder for researchers

docker dockerfile nodejs python r reproducibility

Last synced: 20 Dec 2024

https://ropensci.github.io/reproducibility-guide

:no_entry: ARCHIVED :no_entry:

reproducibility reproducibility-guide reproducible-research

Last synced: 02 Oct 2024

https://github.com/singularityhub/singularity-hpc

Local filesystem registry for containers (intended for HPC) using Lmod or Environment Modules. Works for users and admins.

containers hpc lmod reproducibility singularity

Last synced: 15 Dec 2024

https://github.com/ropensci/ezknitr

Avoid the typical working directory pain when using 'knitr'

knitr peer-reviewed r r-package reproducibility rmarkdown rmd rstats

Last synced: 04 Dec 2024

https://github.com/deanmarchiori/analysis-flow

Data Analysis Workflows & Reproducibility Learning Resources

data-analysis reproducibility reproducible-data-science reproducible-science tooling workflow

Last synced: 04 Dec 2024

https://github.com/formlio/forml

ForML - A development framework and MLOps platform for the lifecycle management of data science projects

ai data-science machine-learning ml mlops portability python reproducibility

Last synced: 15 Nov 2024

https://github.com/jvalegre/aqme

Automated Quantum Mechanical Environments (AQME) offers transparent and reproducible workflows available for Jupyter Notebooks and command lines, including: 1) RDKit- and CREST-based conformer generation, 2) QM input file creation, 3) post-processing of QM output files, 4) generation of xTB, DFT and RDKit descriptors. https://aqme.readthedocs.io

automation cheminformatics jupyter-notebooks python quantum-chemistry reproducibility workflows

Last synced: 17 Dec 2024

https://github.com/wlandau/targets-tutorial

Short course on the targets R package

data-science make pipeline r r-package reproducibility reproducible-research rstats targets workflow

Last synced: 27 Oct 2024

https://github.com/braintwister/docker-devel-env

Fast, reproducible, and portable software development environments

clang cmake conan cuda development docker eclipse gcc jenkins nsight portability reproducibility vscode

Last synced: 09 Oct 2024

https://github.com/BrainTwister/docker-devel-env

Fast, reproducible, and portable software development environments

clang cmake conan cuda development docker eclipse gcc jenkins nsight portability reproducibility vscode

Last synced: 09 Dec 2024

https://github.com/smarr/rebench

Execute and document benchmarks reproducibly.

benchmarking continuous-benchmarking continuous-testing performance-tracking python reproducibility research-tool science

Last synced: 18 Dec 2024

https://github.com/greenelab/continuous_analysis

Computational reproducibility using Continuous Integration to produce verifiable end-to-end runs of scientific analysis.

continuous-integration methodology open-science reproducibility supplement

Last synced: 13 Nov 2024

https://github.com/ropensci/gittargets

Data version control for reproducible analysis pipelines in R with {targets}.

data-science data-version-control data-versioning r r-package reproducibility reproducible-research rstats targets workflow

Last synced: 19 Dec 2024

https://github.com/ml-tooling/ml-project-template

ML project template facilitating both research and production phases.

docker machine-learning reproducibility

Last synced: 10 Nov 2024

https://github.com/gesistsa/rang

🐶 (Re)constructing R computational environments

cran r reproducibility reproducible-research rstats

Last synced: 04 Dec 2024

https://github.com/neurogenomics/rworkflows

Continuous integration for R packages. 🔀 Automates testing ✅, documentation website building 📦, & containerised deployment 🐳.

bioconductor containers continuous-integration cran-r docker dockerhub github-actions r reproducibility workflows

Last synced: 13 Nov 2024

https://github.com/HALFpipe/HALFpipe

ENIGMA HALFpipe is a user-friendly software that facilitates reproducible analysis of fMRI data

bids fmri meta-analysis neuroimaging pipeline reproducibility

Last synced: 12 Nov 2024

https://github.com/buildsafedev/bsf

Developer-centric tool to secure your software supply chain.

hacktoberfest nix reproducibility slsa supply-chain-security

Last synced: 18 Dec 2024

https://github.com/pfnet-research/git-ghost

Synchronize your working directory efficiently to a remote place without committing the changes.

docker git kubernetes reproducibility

Last synced: 15 Nov 2024

https://github.com/the-nix-way/real-world-devops-with-nix

An example project for building containers with Nix and deploying them to Kubernetes

devops docker go golang kubernetes nix reproducibility terraform

Last synced: 18 Nov 2024

https://github.com/odeleongt/postr

Prepare reproducible R Markdown posters

poster r reproducibility template

Last synced: 22 Nov 2024

https://github.com/polydawn/repeatr

Repeatr: Reproducible, hermetic Computation. Provision containers from Content-Addressable snapshots; run using familiar containers (e.g. runc); store outputs in Content-Addressable form too! JSON API; connect your own pipelines! (Or, use github.com/polydawn/stellar for pipelines!)

containers distributed formula reproducibility reproducible-builds snapshots timeless timeless-stack

Last synced: 25 Nov 2024

https://github.com/jesperdramsch/ml.recipes

Increase citations, ease review & collaboration A collection of "easy wins" to make machine learning in research reproducible. This tutorial focuses on basics that work. Getting you 90% of the way to top-tier reproducibility.

jupyter-book machine-learning ml4science python reproducibility science software-sustainability