Projects in Awesome Lists tagged with checkpointing

https://github.com/kakaobrain/torchgpipe

A GPipe implementation in PyTorch

checkpointing deep-learning gpipe model-parallelism parallelism pipeline-parallelism pytorch

Last synced: 15 May 2025

https://github.com/argonne-lcf/dlio_benchmark

An I/O benchmark for deep Learning applications

artificial-intelligence checkpointing data-management deep-learning llm pytorch storage tensorflow

Last synced: 04 Apr 2025

https://github.com/cedana/cedana-cli

Cedana: Access and run on compute anywhere in the world, on any provider. Migrate seamlessly between providers, arbitraging price/performance in realtime to maximize pure runtime.

ai checkpointing cpu docker gpu linux

Last synced: 16 Jan 2026

https://github.com/jorgensd/adios4dolfinx

Extending DOLFINx with checkpointing functionality

adios2 checkpointing fenicsx mpi-applications

Last synced: 09 Oct 2025

https://github.com/dorukkarinca/keras-buoy

Keras wrapper that autosaves what ModelCheckpoint cannot.

autosave checkpointing colab colab-automation colab-notebook colaboratory data-science keras machine-learning

Last synced: 04 Oct 2025

https://github.com/Idleness76/weavegraph

Weavegraph rust graph/agent/node

async checkpointing event-driven graph-workflows petgraph rust state-machine workflow-engine

Last synced: 23 Jul 2026

https://github.com/sayiir/sayiir

Sayiir — Lightweight embeddable durable workflow engine in Rust with Python bindings. Checkpoint-based recovery, no deterministic replay. Alternative to Temporal, Restate, Airflow..

ai-agents async-rust checkpointing distributed distributed-systems durable-execution durable-workflows embeddable orchestration pyo3 python rust temporal-alternative workflow workflow-automation workflow-engine

Last synced: 05 Mar 2026

https://github.com/stifler7/cairn

Recoverable long-horizon AI agents — a framework-agnostic reference harness + recovery-faithful live benchmark. Thesis: "Checkpoints Are Compactions" via Re-grounding Recovery. 0.x: v1.0 held until a powered live-LLM study confirms the claims.

agent-memory agent-recovery agent-runtime agentic-ai ai-agents ai-research autonomous-agents benchmark checkpoint-restart checkpointing code-agent context-management durable-execution fault-tolerance llm llm-agents long-horizon-agents re-grounding recovery resilience

Last synced: 08 Jul 2026

https://github.com/f-dangel/wandb_preempt

Code and tutorial on integrating wandb sweeps with Slurm pre-emption

checkpointing preemption pytorch slurm sweep wandb

Last synced: 13 Mar 2026

https://github.com/rubrikinc/sysfail

A shared library to help test your code with failure-injection

checkpointing failure-injection failure-injection-testing idempotency progress resilience-testing resumability stateful-app

Last synced: 26 Jun 2025

https://github.com/smooai/smooth-operator-core

Polyglot AI agent orchestration core (Rust reference + TS/Go/.NET/Python bindings) — agents, workflows, tools, checkpointing, memory, HITL, cost. A security-first LangGraph; the engine behind smooth-operator and lom.smoo.ai.

agent-orchestration ai-agent checkpointing langgraph-alternative llm multi-language polyglot rust workflows

Last synced: 05 Jul 2026

https://github.com/kadubon/bottleneck-audit-toolkit

Offline, fail-closed verifier for JSONL telemetry event logs. Emits deterministic audit certificates + human summaries with explicit claims/non-claims for bottleneck and integrity review.

ai audit bottleneck checkpointing distributed-training event-logs jsonl mlops offline-verification performance-monitoring silent-data-corruption tail-latency telemetry