Data

Tools

Indexes

Applications

Experiments

Awesome

An open API service indexing awesome lists of open source software.

Projects in Awesome Lists tagged with distributed-systems

A curated list of projects in awesome lists tagged with distributed-systems .

https://github.com/doocs/advanced-java

😮 Core Interview Questions & Answers For Experienced Java(Backend) Developers | 互联网 Java 工程师进阶知识完全扫盲：涵盖高并发、分布式、高可用、微服务、海量数据处理等领域知识

advanced-java distributed-search-engine distributed-systems doocs dubbo elasticsearch eureka feign high-availability high-concurrency hystrix java message-queue microservices-architecture redis ribbon rpc spring-cloud springcloud-config zookeeper

Last synced: 12 May 2025

https://github.com/etcd-io/etcd

Distributed reliable key-value store for the most critical data of a distributed system

cncf consensus database distributed-database distributed-systems etcd go key-value kubernetes raft

Last synced: 09 Sep 2025

https://github.com/coreos/etcd

Distributed reliable key-value store for the most critical data of a distributed system

cncf consensus database distributed-database distributed-systems etcd go key-value kubernetes raft

Last synced: 28 Mar 2025

https://github.com/apache/dubbo

The java implementation of Apache Dubbo. An RPC and microservice framework.

distributed-systems dubbo framework grpc http java microservices restful rpc service-mesh web

Last synced: 16 Dec 2025

https://github.com/spacedriveapp/spacedrive

Spacedrive is an open source cross-platform file explorer, powered by a virtual distributed filesystem written in Rust.

cross-platform distributed-systems encryption file-manager open-source rust storage typescript

Last synced: 13 May 2025

https://github.com/dmlc/xgboost

Scalable, Portable and Distributed Gradient Boosting (GBDT, GBRT or GBM) Library, for Python, R, Java, Scala, C++ and more. Runs on single machine, Hadoop, Spark, Dask, Flink and DataFlow

distributed-systems gbdt gbm gbrt machine-learning xgboost

Last synced: 12 May 2025

https://github.com/nsqio/nsq

A realtime distributed messaging platform

distributed-systems go message-queue messaging nsq queue

Last synced: 16 Dec 2025

https://github.com/seaweedfs/seaweedfs

SeaweedFS is a fast distributed storage system for blobs, objects, files, and data lake, for billions of files! Blob store has O(1) disk seek, cloud tiering. Filer supports Cloud Drive, cross-DC active-active replication, Kubernetes, POSIX FUSE mount, S3 API, S3 Gateway, Hadoop, WebDAV, encryption, Erasure Coding.

blob-storage cloud-drive distributed-file-system distributed-storage distributed-systems erasure-coding fuse hadoop-hdfs hdfs kubernetes object-storage posix replication s3 s3-storage seaweedfs tiered-file-system

Last synced: 16 Dec 2025

https://github.com/micro/go-micro

A Go microservices framework

distributed-systems go golang micro microservices rpc

Last synced: 16 Oct 2025

https://github.com/conductor-oss/conductor

Conductor is an event driven orchestration platform providing durable and highly resilient execution engine for your applications

distributed-systems durable-execution grpc java javascript microservice-orchestration orchestration-engine orchestrator reactjs spring-boot workflow-automation workflow-engine workflow-management workflows

Last synced: 12 May 2025

https://github.com/vonng/ddia

《Designing Data-Intensive Application》DDIA中文翻译

book database ddia distributed-systems

Last synced: 12 May 2025

https://github.com/Vonng/ddia

《Designing Data-Intensive Application》DDIA中文翻译

book database ddia distributed-systems

Last synced: 19 Mar 2025

https://github.com/nats-io/nats-server

High-Performance server for NATS.io, the cloud and edge native messaging system.

cloud cloud-computing cloud-native distributed-systems go golang message-bus message-queue messaging microservices-architecture nats-server

Last synced: 16 Dec 2025

https://github.com/nats-io/gnatsd

High-Performance server for NATS.io, the cloud and edge native messaging system.

cloud cloud-computing cloud-native distributed-systems go golang message-bus message-queue messaging microservices-architecture nats-server

Last synced: 01 Apr 2025

https://github.com/rqlite/rqlite

The lightweight, user-friendly, distributed relational database built on SQLite.

consensus database distributed-database distributed-systems go raft relational-database sql sqlite

Last synced: 12 May 2025

https://github.com/akka/akka

A platform to build and run apps that are elastic, agile, and resilient. SDK, libraries, and hosted environments.

actor-model akka cloud-native concurrency distributed-actors distributed-systems high-performance reactive streaming

Last synced: 09 Sep 2025

https://github.com/juicedata/juicefs

JuiceFS is a distributed POSIX file system built on top of Redis and S3.

bigdata cloud-native distributed-systems filesystem go golang hdfs object-storage posix redis s3 storage

Last synced: 12 May 2025

https://github.com/vesoft-inc/nebula

A distributed, fast open-source graph database featuring horizontal scalability and high availability

big-data cpp database distributed distributed-systems graph graph-database graphdb hacktoberfest nebula nebula-graph nebulagraph raft scalability

Last synced: 13 May 2025

https://github.com/trinodb/trino

Official repository of Trino, the distributed SQL query engine for big data, formerly known as PrestoSQL (https://trino.io)

analytics big-data data-science database databases datalake delta-lake distributed-database distributed-systems hadoop hive iceberg java jdbc presto prestodb query-engine sql trino

Last synced: 12 Nov 2025

https://github.com/pingcap/talent-plan

open source training courses about distributed database and distributed systems

distributed-database distributed-systems golang open-source pingcap rust talent-plan

Last synced: 29 Apr 2025

https://github.com/encoredev/encore

Open Source Development Platform for building robust type-safe distributed systems with declarative infrastructure

api aws backend backend-framework cloud cloud-native database devops distributed-systems encore gcp go golang microservice-framework microservices nodejs-framework postgresql serverless typescript typescript-framework

Last synced: 12 May 2025

https://github.com/cadence-workflow/cadence

Cadence is a distributed, scalable, durable, and highly available orchestration engine to execute asynchronous long-running business logic in a scalable and resilient way.

cadence distributed-systems golang java orchestration-engine service-bus service-fabric services-platform uber workflow-automation workflows

Last synced: 14 Dec 2025

https://github.com/twitter/finagle

A fault tolerant, protocol-agnostic RPC system

distributed-systems finagle http http2 java memcached mysql redis rpc scala thrift zipkin

Last synced: 09 Sep 2025

https://twitter.github.io/finagle/

A fault tolerant, protocol-agnostic RPC system

distributed-systems finagle http http2 java memcached mysql redis rpc scala thrift zipkin

Last synced: 10 May 2025

https://github.com/uber/cadence

Cadence is a distributed, scalable, durable, and highly available orchestration engine to execute asynchronous long-running business logic in a scalable and resilient way.

cadence distributed-systems golang java orchestration-engine service-bus service-fabric services-platform uber workflow-automation workflows

Last synced: 30 Jun 2025

https://github.com/git-bug/git-bug

Distributed, offline-first bug tracker embedded in git, with bridges

bugtracker decentralized-application distributed-systems git gitdb

Last synced: 12 May 2025

https://github.com/isno/thebytebook

⭐ 【开源书籍】深入讲解内核网络、Kubernetes、ServiceMesh、容器等云原生相关技术。经历实践检验的 DevOps、SRE指南。如发现错误，谢谢提issue

cloud-native container devops distributed-systems finops kubernetes networking paas service-mesh sre

Last synced: 12 May 2025

https://github.com/isno/theByteBook

⭐ 【开源书籍】深入讲解内核网络、Kubernetes、ServiceMesh、容器等云原生相关技术。经历实践检验的 DevOps、SRE指南。如发现错误，谢谢提issue

cloud-native container devops distributed-systems finops kubernetes networking paas paxos raft service-mesh sre

Last synced: 01 Apr 2025

https://github.com/longhorn/longhorn

Cloud-Native distributed storage built on and for Kubernetes

cncf distributed-systems high-availability k8s-sig-storage kubernetes longhorn storage

Last synced: 12 May 2025

https://github.com/hazelcast/hazelcast

Hazelcast is a unified real-time data platform combining stream processing with a fast data store, allowing customers to act instantly on data-in-motion for real-time insights.

big-data caching data-in-motion data-insights distributed distributed-computing distributed-systems hacktoberfest hazelcast in-memory java low-latency real-time scalability stream-processing

Last synced: 09 Sep 2025

https://github.com/moleculerjs/moleculer

:rocket: Progressive microservices framework for Node.js

distributed-systems microservice microservice-framework microservices moleculer nodejs

Last synced: 12 May 2025

https://github.com/materializeinc/materialize

Real-time Data Integration and Transformation: use SQL to transform, deliver, and act on fast-changing data.

data-store database distributed-systems kafka materialized-view operational-data-store postgresql postgresql-dialect rust sql stream-processing streaming streaming-data

Last synced: 09 Sep 2025

https://github.com/authzed/spicedb

Open Source, Google Zanzibar-inspired database for scalably storing and querying fine-grained authorization data

abac acl authorization ciam cloud-native database distributed-systems entitlements fga fine-grained-access-control fine-grained-authorization kubernetes permissions rbac rebac security security-tools zanzibar

Last synced: 14 May 2025

https://github.com/asynkron/protoactor-go

Proto Actor - Ultra fast distributed actors for Go, C# and Java/Kotlin

actor-model actors akka clustering cross-platform distributed-computing distributed-systems go golang grpc protobuf

Last synced: 15 Dec 2025

https://github.com/AsynkronIT/protoactor-go

Proto Actor - Ultra fast distributed actors for Go, C# and Java/Kotlin

actor-model actors akka clustering cross-platform distributed-computing distributed-systems go golang grpc protobuf

Last synced: 26 Apr 2025

https://github.com/travisjeffery/jocko

Kafka implemented in Golang with built-in coordination (No ZK dep, single binary install, Cloud Native)

distributed-systems go kafka messaging queue streaming

Last synced: 14 May 2025

https://github.com/paradigmxyz/reth

Modular, contributor-friendly and blazing-fast implementation of the Ethereum protocol, in Rust

blockchain contributor-friendly distributed-systems ethereum execution-layer modular p2p rust

Last synced: 12 May 2025

https://github.com/build-trust/ockam

Orchestrate end-to-end encryption, cryptographic identities, mutual authentication, and authorization policies between distributed applications – at massive scale.

authentication authorization credentials distributed-systems e2ee encrypted-connections encrypted-messages encryption end-to-end-encryption identity kafka key-management messaging rust security snowflake trust zero-trust

Last synced: 11 Dec 2025

https://github.com/dotnet/aspire

Tools, templates, and packages to accelerate building observable, production-ready apps

cloud cloud-native distributed-systems dotnet dotnet-core

Last synced: 12 May 2025

https://github.com/distribworks/dkron

Dkron - Distributed, fault tolerant job scheduling system https://dkron.io

cron distributed-systems fault-tolerance scheduled-jobs

Last synced: 13 May 2025

https://github.com/ergo-services/ergo

An actor-based Framework with network transparency for creating event-driven architecture in Golang. Inspired by Erlang. Zero dependencies.

actor-model actors distributed distributed-systems elixir ergo-framework erlang event-driven event-driven-microservices framework go golang microservice microservices-architecture network-transparency otp otp-applications supervisor workflow workflow-engine

Last synced: 13 May 2025

https://github.com/ag2ai/faststream

FastStream is a powerful and easy-to-use Python framework for building asynchronous services interacting with event streams such as Apache Kafka, RabbitMQ, NATS and Redis.

asyncapi asyncio distributed-systems fastkafka faststream kafka nats propan python rabbitmq redis stream-processing

Last synced: 14 May 2025

https://github.com/purpleidea/mgmt

Next generation distributed, event-driven, parallel config management!

choreography config-management configuration-management devops distributed-systems etcd go golang graph-theory

Last synced: 13 May 2025

https://github.com/adilkhash/data-engineering-howto

A list of useful resources to learn Data Engineering from scratch

cloud-providers data-engineering data-pipeline distributed-systems scala

Last synced: 14 May 2025

https://github.com/adilkhash/Data-Engineering-HowTo

A list of useful resources to learn Data Engineering from scratch

cloud-providers data-engineering data-pipeline distributed-systems scala

Last synced: 28 Mar 2025

https://github.com/ekzhang/rustpad

Efficient and minimal collaborative code editor, self-hosted, no database required

async code-editor collaborative-editing distributed-systems operational-transformation react rust self-hosted tokio typescript

Last synced: 14 May 2025

https://github.com/chrislusf/gleam

Fast, efficient, and scalable distributed map/reduce system, DAG execution, in memory or on disk, written in pure Go, runs standalone or distributedly.

distributed-computing distributed-systems golang map-reduce

Last synced: 13 May 2025

https://github.com/taubyte/tau

Open source distributed Platform as a Service (PaaS). A self-hosted Vercel / Netlify / Cloudflare alternative.

5g ai cdn cloud-computing cloud-native distributed-systems p2p paas serverless webassembly

Last synced: 28 Mar 2025

https://github.com/jepsen-io/maelstrom

A workbench for writing toy implementations of distributed systems.

distributed-systems jepsen testing

Last synced: 23 Apr 2025

https://github.com/olric-data/olric

Distributed, in-memory key/value store and cache. It can be used as an embedded Go library and a language-independent service.

cache database distributed-cache distributed-database distributed-hash-table distributed-systems in-memory-database key-value key-value-store nosql redis

Last synced: 14 May 2025

https://github.com/buraksezer/olric

Distributed, in-memory key/value store and cache. It can be used as an embedded Go library and a language-independent service.

cache database distributed-cache distributed-database distributed-hash-table distributed-systems in-memory-database key-value key-value-store nosql redis

Last synced: 09 Apr 2025

https://github.com/lonng/nano

Lightweight, facility, high performance golang based game server framework

distributed-systems game golang json lightweight micro networking protobuf server tcp-server websocket-server

Last synced: 14 Dec 2025

https://github.com/tikv/raft-rs

Raft distributed consensus algorithm implemented in Rust.

distributed-consensus-algorithms distributed-systems raft rust

Last synced: 12 Dec 2025

https://github.com/storj/storj

Ongoing Storj v3 development. Decentralized cloud object storage that is affordable, easy to use, private, and secure.

distributed distributed-storage distributed-systems golang object-storage open-source storage

Last synced: 13 May 2025

https://github.com/microsoft/service-fabric

Service Fabric is a distributed systems platform for packaging, deploying, and managing stateless and stateful distributed applications and containers at large scale.

cloud-computing cloud-native containers distributed-systems microservices orchestration

Last synced: 13 May 2025

https://github.com/oklog/oklog

A distributed and coördination-free log management system

distributed distributed-systems log logging metallica

Last synced: 13 Mar 2025

https://github.com/airtai/faststream

FastStream is a powerful and easy-to-use Python framework for building asynchronous services interacting with event streams such as Apache Kafka, RabbitMQ, NATS and Redis.

asyncapi asyncio distributed-systems fastkafka faststream kafka nats propan python rabbitmq redis stream-processing

Last synced: 25 Mar 2025

https://github.com/feixiao/Distributed-Systems

MIT课程《Distributed Systems 》学习和翻译

distributed-systems golang

Last synced: 25 Mar 2025

https://github.com/bloomberg/blazingmq

A modern high-performance open source message queuing system

blazingmq distributed-systems message-queue messaging middleware queue queues

Last synced: 13 May 2025

https://asatarin.github.io/testing-distributed-systems/

Curated list of resources on testing distributed systems

distributed-systems fault-injection fuzzing jepsen jepsen-tests testing

Last synced: 15 Nov 2025

https://github.com/peerdb-io/peerdb

Fast, Simple and a cost effective tool to replicate data from Postgres to Data Warehouses, Queues and Storage

bigquery cdc clickhouse cloud-native distributed-systems etl eventhubs kafka postgres postgresql realtime rust s3 snowflake sql stream-processing

Last synced: 14 May 2025