Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
Projects in Awesome Lists tagged with distributed-systems
A curated list of projects in awesome lists tagged with distributed-systems .
https://github.com/doocs/advanced-java
😮 Core Interview Questions & Answers For Experienced Java(Backend) Developers | 互联网 Java 工程师进阶知识完全扫盲：涵盖高并发、分布式、高可用、微服务、海量数据处理等领域知识
advanced-java distributed-search-engine distributed-systems doocs dubbo elasticsearch eureka feign high-availability high-concurrency hystrix java message-queue microservices-architecture redis ribbon rpc spring-cloud springcloud-config zookeeper
Last synced: 29 Sep 2024
https://github.com/coreos/etcd
Distributed reliable key-value store for the most critical data of a distributed system
cncf consensus database distributed-database distributed-systems etcd go key-value kubernetes raft
Last synced: 30 Jul 2024
https://github.com/etcd-io/etcd
Distributed reliable key-value store for the most critical data of a distributed system
cncf consensus database distributed-database distributed-systems etcd go key-value kubernetes raft
Last synced: 29 Sep 2024
https://github.com/apache/dubbo
The java implementation of Apache Dubbo. An RPC and microservice framework.
distributed-systems dubbo framework grpc http java microservices restful rpc service-mesh web
Last synced: 29 Sep 2024
https://github.com/karanpratapsingh/system-design
Learn how to design systems at scale and prepare for system design interviews
architecture distributed-systems engineering interview interview-preparation microservices scalability system-design system-design-interview tech
Last synced: 29 Sep 2024
https://github.com/spacedriveapp/spacedrive
Spacedrive is an open source cross-platform file explorer, powered by a virtual distributed filesystem written in Rust.
cross-platform distributed-systems encryption file-manager rust storage typescript
Last synced: 29 Sep 2024
https://github.com/dmlc/xgboost
Scalable, Portable and Distributed Gradient Boosting (GBDT, GBRT or GBM) Library, for Python, R, Java, Scala, C++ and more. Runs on single machine, Hadoop, Spark, Dask, Flink and DataFlow
distributed-systems gbdt gbm gbrt machine-learning xgboost
Last synced: 29 Sep 2024
https://github.com/nsqio/nsq
A realtime distributed messaging platform
distributed-systems go message-queue messaging nsq queue
Last synced: 29 Sep 2024
https://github.com/go-micro/go-micro
A Go microservices framework
distributed-systems go golang micro microservices rpc
Last synced: 17 Aug 2024
https://github.com/asim/go-micro
A Go microservices framework
distributed-systems go golang micro microservices rpc
Last synced: 04 Aug 2024
https://github.com/asim/nitro
A Go microservices framework
distributed-systems go golang micro microservices rpc
Last synced: 22 Aug 2024
https://github.com/micro/go-micro
A Go microservices framework
distributed-systems go golang micro microservices rpc
Last synced: 29 Sep 2024
https://github.com/seaweedfs/seaweedfs
SeaweedFS is a fast distributed storage system for blobs, objects, files, and data lake, for billions of files! Blob store has O(1) disk seek, cloud tiering. Filer supports Cloud Drive, cross-DC active-active replication, Kubernetes, POSIX FUSE mount, S3 API, S3 Gateway, Hadoop, WebDAV, encryption, Erasure Coding.
blob-storage cloud-drive distributed-file-system distributed-storage distributed-systems erasure-coding fuse hadoop-hdfs hdfs kubernetes object-storage posix replication s3 s3-storage seaweedfs tiered-file-system
Last synced: 29 Sep 2024
https://github.com/chrislusf/seaweedfs
SeaweedFS is a fast distributed storage system for blobs, objects, files, and data lake, for billions of files! Blob store has O(1) disk seek, cloud tiering. Filer supports Cloud Drive, cross-DC active-active replication, Kubernetes, POSIX FUSE mount, S3 API, S3 Gateway, Hadoop, WebDAV, encryption, Erasure Coding.
blob-storage cloud-drive distributed-file-system distributed-storage distributed-systems erasure-coding fuse hadoop-hdfs hdfs kubernetes object-storage posix replication s3 s3-storage seaweedfs tiered-file-system
Last synced: 30 Jul 2024
https://github.com/vonng/ddia
《Designing Data-Intensive Application》DDIA中文翻译
book database ddia distributed-systems
Last synced: 30 Sep 2024
https://github.com/Vonng/ddia
《Designing Data-Intensive Application》DDIA中文翻译
book database ddia distributed-systems
Last synced: 31 Jul 2024
https://github.com/conductor-oss/conductor
Conductor is an event driven orchestration platform
distributed-systems durable-execution grpc java javascript microservice-orchestration orchestration-engine orchestrator reactjs spring-boot workflow-automation workflow-engine workflow-management workflows
Last synced: 27 Sep 2024
https://github.com/nats-io/nats-server
High-Performance server for NATS.io, the cloud and edge native messaging system.
cloud cloud-computing cloud-native distributed-systems go golang message-bus message-queue messaging microservices-architecture nats-server
Last synced: 29 Sep 2024
https://github.com/nats-io/gnatsd
High-Performance server for NATS.io, the cloud and edge native messaging system.
cloud cloud-computing cloud-native distributed-systems go golang message-bus message-queue messaging microservices-architecture nats-server
Last synced: 30 Jul 2024
https://github.com/rqlite/rqlite
The lightweight, distributed relational database built on SQLite.
consensus database distributed-database distributed-systems go raft relational-database sql sqlite
Last synced: 29 Sep 2024
https://github.com/akka/akka
Build highly concurrent, distributed, and resilient message-driven applications on the JVM
actor-model akka cloud-native concurrency distributed-actors distributed-systems hacktoberfest high-performance reactive streaming
Last synced: 29 Sep 2024
https://github.com/Netflix/conductor
Conductor is a microservices orchestration engine.
distributed-systems grpc java javascript microservice-orchestration orchestration-engine orchestrator reactjs spring-boot workflow-automation workflow-engine workflow-management workflows
Last synced: 31 Jul 2024
https://github.com/netflix/conductor
Conductor is a microservices orchestration engine.
distributed-systems grpc java javascript microservice-orchestration orchestration-engine orchestrator reactjs spring-boot workflow-automation workflow-engine workflow-management workflows
Last synced: 29 Sep 2024
https://netflix.github.io/conductor/
Conductor is a microservices orchestration engine.
distributed-systems grpc java javascript microservice-orchestration orchestration-engine orchestrator reactjs spring-boot workflow-automation workflow-engine workflow-management workflows
Last synced: 31 Jul 2024
https://github.com/apache/zookeeper
Apache ZooKeeper
apache configuration-management consensus coordination database distributed-configuration distributed-database distributed-systems hacktoberfest java key-value service-discovery zab zookeeper
Last synced: 29 Sep 2024
https://github.com/systemdesign42/system-design
A resource to help you pass system design interview and become good at work 👇
computer-science development distributed-systems high-level-design interview-questions programming scalability software-engineering system-design system-design-interview
Last synced: 01 Oct 2024
https://github.com/trinodb/trino
Official repository of Trino, the distributed SQL query engine for big data, formerly known as PrestoSQL (https://trino.io)
analytics big-data data-science database databases datalake delta-lake distributed-database distributed-systems hadoop hive iceberg java jdbc presto prestodb query-engine sql trino
Last synced: 29 Sep 2024
https://github.com/pingcap/talent-plan
open source training courses about distributed database and distributed systems
distributed-database distributed-systems golang open-source pingcap rust talent-plan
Last synced: 30 Sep 2024
https://github.com/vesoft-inc/nebula
A distributed, fast open-source graph database featuring horizontal scalability and high availability
big-data cpp database distributed distributed-systems graph graph-database graphdb hacktoberfest nebula nebula-graph nebulagraph raft scalability
Last synced: 30 Sep 2024
https://github.com/dotnet/orleans
Cloud Native application framework for .NET
actor-model actors cloud-computing cloud-native concurrency distributed-actors distributed-systems dotnet orleans
Last synced: 27 Sep 2024
https://github.com/dotnet/Orleans
Cloud Native application framework for .NET
actor-model actors cloud-computing cloud-native concurrency distributed-actors distributed-systems dotnet orleans
Last synced: 03 Aug 2024
https://github.com/juicedata/juicefs
JuiceFS is a distributed POSIX file system built on top of Redis and S3.
bigdata cloud-native distributed-systems filesystem go golang hdfs object-storage posix redis s3 storage
Last synced: 29 Sep 2024
https://github.com/temporalio/temporal
Temporal service
cronjob-scheduler distributed-cron distributed-systems golang microservice-framework microservice-orchestration microservices-architecture orchestrator service-bus service-fabric workflow-automation workflow-engine workflow-management workflow-management-system workflows
Last synced: 29 Sep 2024
https://github.com/bigscience-workshop/petals
🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading
bloom chatbot deep-learning distributed-systems falcon gpt guanaco language-models large-language-models llama machine-learning mixtral neural-networks nlp pipeline-parallelism pretrained-models pytorch tensor-parallelism transformer volunteer-computing
Last synced: 29 Sep 2024
https://github.com/git-bug/git-bug
Distributed, offline-first bug tracker embedded in git, with bridges
bugtracker decentralized-application distributed-systems git gitdb
Last synced: 26 Sep 2024
https://github.com/MichaelMure/git-bug
Distributed, offline-first bug tracker embedded in git, with bridges
bugtracker decentralized-application distributed-systems git gitdb
Last synced: 30 Jul 2024
https://github.com/uber/cadence
Cadence is a distributed, scalable, durable, and highly available orchestration engine to execute asynchronous long-running business logic in a scalable and resilient way.
cadence distributed-systems golang java orchestration-engine service-bus service-fabric services-platform uber workflow-automation workflows
Last synced: 30 Sep 2024
https://github.com/oldratlee/translations
🐼 Chinese translations for classic software development resources
api api-design chinese-translation concurrency consensus design design-principle distributed-systems elixir erlang experiment functional-programming git lisp paxos python reactive simplified-chinese translation translations
Last synced: 30 Sep 2024
https://github.com/robinhood/faust
Python Stream Processing
asyncio distributed-systems kafka kafka-streams python stream-processing
Last synced: 29 Sep 2024
https://github.com/supabase/realtime
Broadcast, Presence, and Postgres Changes via WebSockets
cdc change-data-capture crdt distributed-systems elixir phoenix phoenix-framework postgres postgresql pubsub realtime
Last synced: 27 Sep 2024
https://github.com/isno/thebytebook
⭐ 【开源书籍】深入讲解内核网络、Kubernetes、ServiceMesh、容器等云原生相关技术。经历实践检验的 DevOps、SRE指南。如发现错误，谢谢提issue
cloud-native container devops distributed-systems finops kubernetes networking paas paxos raft service-mesh sre
Last synced: 30 Sep 2024
https://github.com/isno/theByteBook
⭐ 【开源书籍】深入讲解内核网络、Kubernetes、ServiceMesh、容器等云原生相关技术。经历实践检验的 DevOps、SRE指南。如发现错误，谢谢提issue
cloud-native container devops distributed-systems finops kubernetes networking paas paxos raft service-mesh sre
Last synced: 01 Aug 2024
https://github.com/pachyderm/pachyderm
Data-Centric Pipelines and Data Versioning
analytics big-data containers data-analysis data-science distributed-systems docker go kubernetes pachyderm
Last synced: 30 Jul 2024
https://github.com/moleculerjs/moleculer
:rocket: Progressive microservices framework for Node.js
distributed-systems hacktoberfest microservice microservice-framework microservices moleculer nodejs
Last synced: 29 Sep 2024
https://github.com/hazelcast/hazelcast
Hazelcast is a unified real-time data platform combining stream processing with a fast data store, allowing customers to act instantly on data-in-motion for real-time insights.
big-data caching data-in-motion data-insights distributed distributed-computing distributed-systems hacktoberfest hazelcast in-memory java low-latency real-time scalability stream-processing
Last synced: 30 Jul 2024
https://github.com/megaease/easegress
A Cloud Native traffic orchestration system
api-gateway cloud-native distributed-systems etcd gateway go golang http kubernetes load-balancer mesh microservice microservices proxy-server raft reverse-proxy service-mesh sidecar traffic
Last synced: 30 Jul 2024
https://github.com/easegress-io/easegress
A Cloud Native traffic orchestration system
api-gateway cloud-native distributed-systems etcd gateway go golang http kubernetes load-balancer mesh microservice microservices proxy-server raft reverse-proxy service-mesh sidecar traffic
Last synced: 31 Jul 2024
https://github.com/materializeinc/materialize
The data warehouse for operational workloads.
data-warehouse database distributed-systems kafka materialized-view operational-data-warehouse postgresql postgresql-dialect rust sql stream-processing streaming streaming-data
Last synced: 29 Sep 2024
https://github.com/MaterializeInc/materialize
The data warehouse for operational workloads.
data-warehouse database distributed-systems kafka materialized-view operational-data-warehouse postgresql postgresql-dialect rust sql stream-processing streaming streaming-data
Last synced: 31 Jul 2024
https://github.com/tendermint/tendermint
⟁ Tendermint Core (BFT Consensus) in Go
bft blockchain consensus consistency cryptocurrency cryptography db distributed-systems go
Last synced: 29 Sep 2024
https://github.com/rancher/longhorn
Cloud-Native distributed storage built on and for Kubernetes
cncf distributed-systems high-availability k8s-sig-storage kubernetes longhorn storage
Last synced: 04 Aug 2024
https://github.com/longhorn/longhorn
Cloud-Native distributed storage built on and for Kubernetes
cncf distributed-systems high-availability k8s-sig-storage kubernetes longhorn storage
Last synced: 26 Sep 2024
https://github.com/pixie-io/pixie
Instant Kubernetes-Native Application Observability
aks apache-arrow cloud-native cncf distributed-systems ebpf eks gke golang kubernetes machine-learning metrics minikube monitoring observability pandas pixie px px-run vega
Last synced: 29 Sep 2024
https://github.com/pixie-labs/pixie
Instant Kubernetes-Native Application Observability
aks apache-arrow cloud-native cncf distributed-systems ebpf eks gke golang kubernetes machine-learning metrics minikube monitoring observability pandas pixie px px-run vega
Last synced: 30 Jul 2024
https://github.com/gaia-pipeline/gaia
Build powerful pipelines in any programming language.
automation build continuous-delivery continuous-integration continuous-testing cplusplus deployment devops devops-tools distributed-systems gitops go java kubernetes pipeline python ruby
Last synced: 25 Sep 2024
https://github.com/lni/dragonboat
A feature complete and high performance multi-group Raft library in Go.
consensus distributed-consensus distributed-storage distributed-systems go golang paxos raft raft-algorithm raft-protocol replicated-state-machines
Last synced: 29 Sep 2024
https://github.com/authzed/spicedb
Open Source, Google Zanzibar-inspired database for scalably storing and querying fine-grained authorization data
abac acl ciam cloud-native database distributed-systems entitlements fga fine-grained-access-control grpc kubernetes latency permissions production rbac rebac scale security security-tools zanzibar
Last synced: 29 Sep 2024
https://github.com/travisjeffery/jocko
Kafka implemented in Golang with built-in coordination (No ZK dep, single binary install, Cloud Native)
distributed-systems go kafka messaging queue streaming
Last synced: 30 Sep 2024
https://github.com/asynkron/protoactor-go
Proto Actor - Ultra fast distributed actors for Go, C# and Java/Kotlin
actor-model actors akka clustering cross-platform distributed-computing distributed-systems go golang grpc protobuf
Last synced: 29 Sep 2024
https://github.com/encoredev/encore
Encore is the Backend Development Platform purpose-built to help you create event-driven and distributed systems.
api aws backend backend-api backend-framework cloud cloud-native database devops distributed-systems encore gcp go golang microservice-framework microservices postgresql serverless
Last synced: 26 Sep 2024
https://github.com/gluster/glusterfs
Gluster Filesystem : Build your distributed storage in minutes
c distributed-systems erasure-coding filesystem fuse-filesystem gluster glusterfs high-availability k8s-sig-storage libgfapi linux replication server snapshot storage
Last synced: 26 Sep 2024
https://github.com/build-trust/ockam
Orchestrate end-to-end encryption, cryptographic identities, mutual authentication, and authorization policies between distributed applications – at massive scale.
authentication authorization credentials distributed-systems e2ee encrypted-connections encrypted-messages encryption end-to-end-encryption identity kafka key-management messaging rust security snowflake trust zero-trust
Last synced: 29 Sep 2024
https://github.com/ockam-network/ockam
Orchestrate end-to-end encryption, cryptographic identities, mutual authentication, and authorization policies between distributed applications – at massive scale.
authentication authorization credentials distributed-systems e2ee encrypted-connections encrypted-messages encryption end-to-end-encryption identity kafka key-management messaging rust security snowflake trust zero-trust
Last synced: 05 Aug 2024
https://github.com/distribworks/dkron
Dkron - Distributed, fault tolerant job scheduling system https://dkron.io
cron distributed-systems fault-tolerance scheduled-jobs
Last synced: 30 Sep 2024
https://github.com/dotnet/aspire
An opinionated, cloud ready stack for building observable, production ready, distributed applications in .NET
cloud cloud-native distributed-systems dotnet dotnet-core
Last synced: 27 Sep 2024
https://github.com/purpleidea/mgmt
Next generation distributed, event-driven, parallel config management!
choreography config-management configuration-management devops distributed-systems etcd go golang graph-theory
Last synced: 01 Aug 2024
https://github.com/adilkhash/data-engineering-howto
A list of useful resources to learn Data Engineering from scratch
cloud-providers data-engineering data-pipeline distributed-systems scala
Last synced: 29 Sep 2024
https://github.com/chrislusf/gleam
Fast, efficient, and scalable distributed map/reduce system, DAG execution, in memory or on disk, written in pure Go, runs standalone or distributedly.
distributed-computing distributed-systems golang map-reduce
Last synced: 30 Sep 2024
https://github.com/ekzhang/rustpad
Efficient and minimal collaborative code editor, self-hosted, no database required
async code-editor collaborative-editing distributed-systems operational-transformation react rust self-hosted tokio typescript
Last synced: 30 Sep 2024
https://github.com/adilkhash/Data-Engineering-HowTo
A list of useful resources to learn Data Engineering from scratch
cloud-providers data-engineering data-pipeline distributed-systems scala
Last synced: 31 Jul 2024
https://github.com/hatchet-dev/hatchet
A distributed, fault-tolerant task queue
concurrency dag distributed distributed-systems durable-execution event-driven fastapi golang nodejs python queue typescript workflow-engine
Last synced: 28 Sep 2024
https://github.com/paradigmxyz/reth
Modular, contributor-friendly and blazing-fast implementation of the Ethereum protocol, in Rust
blockchain contributor-friendly distributed-systems ethereum execution-layer modular p2p rust
Last synced: 29 Sep 2024
https://github.com/buraksezer/olric
Distributed, in-memory key/value store and cache. It can be used as an embedded Go library and a language-independent service.
cache database distributed-cache distributed-database distributed-hash-table distributed-systems in-memory-database key-value key-value-store nosql redis
Last synced: 30 Sep 2024
https://github.com/microsoft/service-fabric
Service Fabric is a distributed systems platform for packaging, deploying, and managing stateless and stateful distributed applications and containers at large scale.
cloud-computing cloud-native containers distributed-systems microservices orchestration
Last synced: 30 Sep 2024
https://github.com/p-org/p
The P programming language.
asynchronous distributed-systems event-driven formal-methods formal-verification model-checking p programming-language robotics state-machine systematic-testing
Last synced: 30 Sep 2024
https://github.com/jepsen-io/maelstrom
A workbench for writing toy implementations of distributed systems.
distributed-systems jepsen testing
Last synced: 30 Sep 2024
https://github.com/oklog/oklog
A distributed and coördination-free log management system
distributed distributed-systems log logging metallica
Last synced: 30 Jul 2024
https://github.com/p-org/P
The P programming language.
asynchronous distributed-systems event-driven formal-methods formal-verification model-checking p programming-language robotics state-machine systematic-testing
Last synced: 30 Jul 2024
https://github.com/storj/storj
Ongoing Storj v3 development. Decentralized cloud object storage that is affordable, easy to use, private, and secure.
distributed distributed-storage distributed-systems golang object-storage open-source storage
Last synced: 01 Oct 2024
https://github.com/pingcap/raft-rs
Raft distributed consensus algorithm implemented in Rust.
distributed-consensus-algorithms distributed-systems raft rust
Last synced: 06 Aug 2024
https://github.com/tikv/raft-rs
Raft distributed consensus algorithm implemented in Rust.
distributed-consensus-algorithms distributed-systems raft rust
Last synced: 29 Sep 2024
https://github.com/bastion-rs/bastion
Highly-available Distributed Fault-tolerant Runtime
actor asynchronous concurrency distributed distributed-systems fault-tolerance hacktoberfest numa-aware rust rust-language smp supervision
Last synced: 30 Sep 2024
https://github.com/go-chassis/go-chassis
a cloud native application framework for Go with rich eco-system
circuit-breaker cloud-native distributed-systems framework go go-restful grpc istio kubernetes microservice restful servicecomb servicemesh
Last synced: 29 Sep 2024
https://github.com/feixiao/Distributed-Systems
MIT课程《Distributed Systems 》学习和翻译
Last synced: 31 Jul 2024
https://github.com/lonng/nano
Lightweight, facility, high performance golang based game server framework
distributed-systems game golang json lightweight micro networking protobuf server tcp-server websocket-server
Last synced: 30 Sep 2024
https://github.com/halturin/ergo
An actor-based Framework with network transparency for creating event-driven architecture in Golang. Inspired by Erlang. Zero dependencies.
actor-model actors distributed distributed-systems elixir ergo-framework erlang erlang-node event-driven event-driven-microservices framework go golang microservice microservices-architecture network-transparency otp otp-applications supervisor worker
Last synced: 06 Aug 2024
https://github.com/ergo-services/ergo
An actor-based Framework with network transparency for creating event-driven architecture in Golang. Inspired by Erlang. Zero dependencies.
actor-model actors distributed distributed-systems elixir ergo-framework erlang erlang-node event-driven event-driven-microservices framework go golang microservice microservices-architecture network-transparency otp otp-applications supervisor worker
Last synced: 30 Sep 2024
https://github.com/lagom/lagom
Reactive Microservices for the JVM
akka distributed-systems hacktoberfest java lagom microservices play playframework reactive scala
Last synced: 30 Sep 2024
https://github.com/habitat-sh/habitat
Modern applications with built-in automation
automation choreographer configuration-management containers distributed-systems package-management package-manager rust
Last synced: 01 Oct 2024
https://github.com/liftbridge-io/liftbridge
Lightweight, fault-tolerant message streams.
cloud-native distributed-systems go golang grpc liftbridge message-queue messaging nats pubsub streaming
Last synced: 29 Sep 2024
https://github.com/gojektech/heimdall
An enhanced HTTP client for Go
backoff circuit-breaker distributed-systems golang httpclient hystrix retries scale
Last synced: 05 Aug 2024
https://github.com/gojek/heimdall
An enhanced HTTP client for Go
backoff circuit-breaker distributed-systems golang httpclient hystrix retries scale
Last synced: 01 Oct 2024
https://github.com/bloomberg/blazingmq
A modern high-performance open source message queuing system
blazingmq distributed-systems message-queue messaging middleware queue queues
Last synced: 30 Sep 2024
https://github.com/asatarin/testing-distributed-systems
Curated list of resources on testing distributed systems
distributed-systems fault-injection fuzzing jepsen jepsen-tests testing
Last synced: 30 Sep 2024
https://github.com/absmach/magistrala
Industrial IoT Messaging and Device Management Platform
coap distributed-systems edge edge-computing golang iiot internet-of-things iot iot-cloud iot-gateway iot-platform lora lorawan lwm2m message-broker messaging mqtt opc-ua telecom web-socket
Last synced: 27 Sep 2024
https://github.com/atomix/atomix
A Kubernetes toolkit for building distributed applications using cloud native principles
atomix consensus data-structures distributed-systems go kubernetes raft
Last synced: 30 Sep 2024
https://github.com/heidihoward/distributed-consensus-reading-list
A list of papers about distributed consensus.
atomic-broadcast-protocol consensus-algorithms consistency distributed-computing distributed-systems fault-tolerance paxos quorum-systems replication state-machine-replication zookeeper
Last synced: 30 Sep 2024
https://heidihoward.github.io/distributed-consensus-reading-list/
A list of papers about distributed consensus.
atomic-broadcast-protocol consensus-algorithms consistency distributed-computing distributed-systems fault-tolerance paxos quorum-systems replication state-machine-replication zookeeper
Last synced: 03 Aug 2024