An open API service indexing awesome lists of open source software.

Projects in Awesome Lists tagged with distributed-computing

A curated list of projects in awesome lists tagged with distributed-computing .

https://github.com/hazelcast/hazelcast

Hazelcast is a unified real-time data platform combining stream processing with a fast data store, allowing customers to act instantly on data-in-motion for real-time insights.

big-data caching data-in-motion data-insights distributed distributed-computing distributed-systems hacktoberfest hazelcast in-memory java low-latency real-time scalability stream-processing

Last synced: 12 May 2025

https://github.com/livebook-dev/livebook

Automate code & data workflows with interactive Elixir notebooks

charts collaborative distributed-computing elixir liveview markdown math notebooks phoenix realtime visualization

Last synced: 13 May 2025

https://github.com/asynkron/protoactor-go

Proto Actor - Ultra fast distributed actors for Go, C# and Java/Kotlin

actor-model actors akka clustering cross-platform distributed-computing distributed-systems go golang grpc protobuf

Last synced: 13 May 2025

https://github.com/AsynkronIT/protoactor-go

Proto Actor - Ultra fast distributed actors for Go, C# and Java/Kotlin

actor-model actors akka clustering cross-platform distributed-computing distributed-systems go golang grpc protobuf

Last synced: 26 Apr 2025

https://github.com/chrislusf/gleam

Fast, efficient, and scalable distributed map/reduce system, DAG execution, in memory or on disk, written in pure Go, runs standalone or distributedly.

distributed-computing distributed-systems golang map-reduce

Last synced: 13 May 2025

https://github.com/eventual-inc/daft

Distributed data engine for Python/SQL designed for the cloud, powered by Rust

big-data data-engineering data-science dataframe distributed-computing machine-learning python rust

Last synced: 08 May 2025

https://github.com/Eventual-Inc/Daft

Distributed data engine for Python/SQL designed for the cloud, powered by Rust

big-data data-engineering data-science dataframe distributed-computing machine-learning python rust

Last synced: 09 Apr 2025

https://github.com/fugue-project/fugue

A unified interface for distributed computing. Fugue executes SQL, Python, Pandas, and Polars code on Spark, Dask and Ray without any rewrites.

dask data-practitioners distributed distributed-computing distributed-systems machine-learning pandas spark sql

Last synced: 12 May 2025

https://github.com/b4rtaz/distributed-llama

Connect home devices into a powerful cluster to accelerate LLM inference. More devices means faster inference.

distributed-computing distributed-llm llama2 llama3 llm llm-inference llms neural-network open-llm

Last synced: 13 Apr 2025

https://github.com/eclipse-zenoh/zenoh

zenoh unifies data in motion, data in-use, data at rest and computations. It carefully blends traditional pub/sub with geo-distributed storages, queries and computations, while retaining a level of time and space efficiency that is well beyond any of the mainstream stacks.

distributed-computing distributed-storage distributed-systems edge-computing embedded geo-distributed-storages iot messaging network-programming networking protocol robotics ros2 rust rust-lang storage zenoh

Last synced: 12 May 2025

https://github.com/asynkron/protoactor-dotnet

Proto Actor - Ultra fast distributed actors for Go, C# and Java/Kotlin

actors akka clustering distributed-computing distributed-systems proto-actor

Last synced: 14 May 2025

https://github.com/moosefs/moosefs

MooseFS Distributed Storage – Open Source, Petabyte, Fault-Tolerant, Highly Performing, Scalable Network Distributed File System / Software-Defined Storage

backup block-storage distributed-computing distributed-file-storage distributed-file-system distributed-storage ditributed-systems erasure-coding file-storage file-system filesystem fuse high-availability media posix posix-compliant snapshots software-defined-storage storage tiering

Last synced: 14 May 2025

https://github.com/AsynkronIT/protoactor-dotnet

Proto Actor - Ultra fast distributed actors for Go, C# and Java/Kotlin

actors akka clustering distributed-computing distributed-systems proto-actor

Last synced: 08 Jan 2025

https://github.com/dask/distributed

A distributed task scheduler for Dask

dask distributed-computing hacktoberfest pydata python

Last synced: 06 May 2025

https://github.com/maxpumperla/elephas

Distributed Deep learning with Keras & Spark

deep-learning distributed-computing keras neural-networks spark

Last synced: 15 May 2025

https://github.com/wx-chevalier/DistributedSystem-Notes

:books: 深入浅出分布式基础架构,Linux 与操作系统篇 | 分布式系统篇 | 分布式计算篇 | 数据库篇 | 网络篇 | 虚拟化与编排篇 | 大数据与云计算篇

distributed-computing distributed-systems maintainance network operatingsystem storage virtualization

Last synced: 04 May 2025

https://github.com/wx-chevalier/distributedsystem-notes

:books: 深入浅出分布式基础架构,Linux 与操作系统篇 | 分布式系统篇 | 分布式计算篇 | 数据库篇 | 网络篇 | 虚拟化与编排篇 | 大数据与云计算篇

distributed-computing distributed-systems maintainance network operatingsystem storage virtualization

Last synced: 10 Apr 2025

https://github.com/AshwinRJ/Federated-Learning-PyTorch

Implementation of Communication-Efficient Learning of Deep Networks from Decentralized Data

deep-learning distributed-computing federated-learning python pytorch

Last synced: 06 May 2025

https://github.com/s8sg/goflow

A Golang based high performance, scalable and distributed workflow framework

distributed-computing framework golang workflow workflow-engine workload-automation

Last synced: 15 May 2025

https://github.com/holochain/holochain

The current, performant & industrial strength version of Holochain on Rust.

blockchain dapps dapps-development distributed-computing holochain holochain-rust p2p rust web3

Last synced: 13 May 2025

https://github.com/haidra-org/ai-horde

A crowdsourced distributed cluster for AI art and text generation

ai distributed-computing flask-api gpt opt stable-diffusion volunteer-computing

Last synced: 14 May 2025

https://github.com/dotnetcore/smartsql

SmartSql = MyBatis in C# + .NET Core+ Cache(Memory | Redis) + R/W Splitting + PropertyChangedTrack +Dynamic Repository + InvokeSync + Diagnostics

cache cross-platform distributed-computing dotnet dotnet-core dotnetcore high-performance mybatis mysql oracle orm postgresql read-write-separation redis skywalking smartsql sql sqlite sqlserver zookeeper

Last synced: 13 Apr 2025

https://github.com/dotnetcore/SmartSql

SmartSql = MyBatis in C# + .NET Core+ Cache(Memory | Redis) + R/W Splitting + PropertyChangedTrack +Dynamic Repository + InvokeSync + Diagnostics

cache cross-platform distributed-computing dotnet dotnet-core dotnetcore high-performance mybatis mysql oracle orm postgresql read-write-separation redis skywalking smartsql sql sqlite sqlserver zookeeper

Last synced: 16 Mar 2025

https://github.com/Haidra-Org/AI-Horde

A crowdsourced distributed cluster for AI art and text generation

ai distributed-computing flask-api gpt opt stable-diffusion volunteer-computing

Last synced: 25 Nov 2024

https://uber.github.io/fiber/

Distributed Computing for AI Made Simple

distributed-computing machine-learning multiprocessing python sandbox

Last synced: 11 May 2025

https://github.com/uber/fiber

Distributed Computing for AI Made Simple

distributed-computing machine-learning multiprocessing python sandbox

Last synced: 17 Jan 2025

https://github.com/futureverse/future

:rocket: R package: future: Unified Parallel and Distributed Processing in R for Everyone

asynchronous cran distributed-computing futures hpc hpc-clusters parallel-computing parallel-processing parallelization programming promises r

Last synced: 13 May 2025

https://github.com/HenrikBengtsson/future

:rocket: R package: future: Unified Parallel and Distributed Processing in R for Everyone

asynchronous cran distributed-computing futures hpc hpc-clusters parallel-computing parallel-processing parallelization programming promises r

Last synced: 23 Nov 2024

https://github.com/couler-proj/couler

Unified Interface for Constructing and Managing Workflows on different workflow engines, such as Argo Workflows, Tekton Pipelines, and Apache Airflow.

apache-airflow argo-workflows cloud-native distributed-computing kubeflow kubernetes machine-learning python scheduler tekton-pipelines unified-api unified-interface workflow-automation workflow-engine workflow-management

Last synced: 03 Apr 2025

https://github.com/lichess-org/fishnet

Distributed Stockfish analysis for lichess.org

chess distributed-computing lichess stockfish volunteer-computing

Last synced: 14 May 2025

https://github.com/substantic/rain

Framework for large distributed pipelines

distributed-computing pipelines python-api rust workflows

Last synced: 27 Apr 2025

https://github.com/pnxtech/hydra

A light-weight library for building distributed applications such as microservices

backend distributed-computing hydra microservices redis services

Last synced: 15 May 2025

https://github.com/transient-haskell/transient

A full stack, reactive architecture for general purpose programming. Algebraic and monadically composable primitives for concurrency, parallelism, event handling, transactions, multithreading, Web, and distributed computing with complete de-inversion of control (No callbacks, no blocking, pure state)

backtracking composability composition concurrency distributed-computing events haskell threading transaction web

Last synced: 16 May 2025

https://github.com/yotpoltd/metorikku

A simplified, lightweight ETL Framework based on Apache Spark

big-data distributed-computing etl etl-framework etl-pipeline scala spark sql

Last synced: 06 Apr 2025

https://github.com/thrill/thrill

Thrill - An EXPERIMENTAL Algorithmic Distributed Big Data Batch Processing Framework in C++

big-data c-plus-plus distributed-computing thrill

Last synced: 15 Mar 2025

https://github.com/google/yggdrasil-decision-forests

A library to train, evaluate, interpret, and productionize decision forest models such as Random Forest and Gradient Boosted Decision Trees.

cart cli cpp decision-forest decision-trees distributed-computing go gradient-boosting interpretability javascript machine-learning ml pypi python random-forest tensorflow

Last synced: 14 May 2025

https://github.com/lablup/backend.ai

Backend.AI is a streamlined, container-based computing cluster platform that hosts popular computing/ML frameworks and diverse programming languages, with pluggable heterogeneous accelerator support including CUDA GPU, ROCm GPU, TPU, IPU and other NPUs.

api backendai cloud-computing containers distributed-computing docker documentation hpc monitoring paas python

Last synced: 14 May 2025

https://github.com/tidwall/finn

Fast Raft framework using the Redis protocol for Go

distributed-computing golang raft redis

Last synced: 03 May 2025

https://hdi-project.github.io/ATM/

Auto Tune Models - A multi-tenant, multi-data system for automated machine learning (model selection and tuning).

automl data-science distributed-computing hyperparameter-optimization machine-learning

Last synced: 12 May 2025

https://github.com/HDI-Project/ATM

Auto Tune Models - A multi-tenant, multi-data system for automated machine learning (model selection and tuning).

automl data-science distributed-computing hyperparameter-optimization machine-learning

Last synced: 25 Nov 2024

https://github.com/haptork/easylambda

distributed dataflows with functional list operations for data processing with C++14

cpp14 dataflow-programming distributed-computing functional-programming hpc mpi parallel

Last synced: 06 Apr 2025

https://github.com/haptork/easyLambda

distributed dataflows with functional list operations for data processing with C++14

cpp14 dataflow-programming distributed-computing functional-programming hpc mpi parallel

Last synced: 15 Mar 2025

https://github.com/kubeflow/mpi-operator

Kubernetes Operator for MPI-based applications (distributed training, HPC, etc.)

apache-mxnet distributed-computing horovod kubeflow kubernetes mpi pytorch tensorflow

Last synced: 14 May 2025

https://github.com/it4innovations/hyperqueue

Scheduler for sub-node tasks for HPC systems with batch scheduling

distributed-computing hpc rust task-graph

Last synced: 15 May 2025

https://github.com/persiaml/persia

High performance distributed framework for training deep learning recommendation models based on PyTorch.

bagua deep-learning distributed-computing machine-learning persia pytorch recommender-system rust-lang

Last synced: 16 May 2025

https://github.com/PersiaML/PERSIA

High performance distributed framework for training deep learning recommendation models based on PyTorch.

bagua deep-learning distributed-computing machine-learning persia pytorch recommender-system rust-lang

Last synced: 27 Apr 2025

https://github.com/It4innovations/hyperqueue

Scheduler for sub-node tasks for HPC systems with batch scheduling

distributed-computing hpc rust task-graph

Last synced: 01 Apr 2025

https://github.com/camdavidsonpilon/tdigest

t-Digest data structure in Python. Useful for percentiles and quantiles, including distributed enviroments like PySpark

distributed-computing estimate mapreduce percentile pyspark python quantile

Last synced: 08 Apr 2025

https://github.com/CamDavidsonPilon/tdigest

t-Digest data structure in Python. Useful for percentiles and quantiles, including distributed enviroments like PySpark

distributed-computing estimate mapreduce percentile pyspark python quantile

Last synced: 26 Mar 2025

https://github.com/ursiform/sleuth

A Go library for master-less peer-to-peer autodiscovery and RPC between HTTP services

discovery distributed-computing distributed-systems golang peer-autodiscovery rpc service-autodiscovery sleuth zeromq

Last synced: 14 Mar 2025

https://github.com/ArchiveBox/good-karma-kit

😇 A Docker Compose bundle to run on servers with spare CPU, RAM, disk, and bandwidth to help the world. Includes Tor, ArchiveWarrior, BOINC, and more...

archivebox archivewarrior boinc distributed-computing distributed-storage docker docker-compose foldingathome good-karma i2p internet-archiving ipfs kiwix pywb sia storj tor zimfarm

Last synced: 07 Apr 2025

https://github.com/archivebox/good-karma-kit

😇 A Docker Compose bundle to run on servers with spare CPU, RAM, disk, and bandwidth to help the world. Includes Tor, ArchiveWarrior, BOINC, and more...

archivebox archivewarrior boinc distributed-computing distributed-storage docker docker-compose foldingathome good-karma i2p internet-archiving ipfs kiwix pywb sia storj tor zimfarm

Last synced: 06 Apr 2025

https://github.com/guydavis/machinaris

An easy-to-use WebUI for crypto plotting and farming. Offers Bladebit, Gigahorse, MadMax, Chiadog and Plotman in a Docker container. Supports Chia, MMX, Chives, Flax, and HDDCoin among others.

bladebit blockchain chia chia-network chiadog crypto cryptocurrency dashboard distributed-computing farming madmax plotman plotting webui

Last synced: 04 Apr 2025

https://github.com/douban/paracel

Distributed training framework with parameter server

c-plus-plus distributed-computing graph machine-learning

Last synced: 07 Apr 2025

https://github.com/profjsb/python-seminar

Python for Data Science (Seminar Course at UC Berkeley; AY 250)

data-science distributed-computing machine-learning python visualization

Last synced: 27 Nov 2024

https://github.com/juliafolds/floops.jl

Fast sequential, threaded, and distributed for-loops for Julia—fold for humans™

distributed-computing high-performance julia parallel transducers

Last synced: 12 Apr 2025

https://github.com/JuliaFolds/FLoops.jl

Fast sequential, threaded, and distributed for-loops for Julia—fold for humans™

distributed-computing high-performance julia parallel transducers

Last synced: 10 Apr 2025

https://github.com/quiver-team/torch-quiver

PyTorch Library for Low-Latency, High-Throughput Graph Learning on GPUs.

distributed-computing geometric-deep-learning gpu-acceleration graph-learning graph-neural-networks pytorch

Last synced: 04 Apr 2025

https://github.com/Bluefog-Lib/bluefog

Distributed and decentralized training framework for PyTorch over graph

asynchronous decentralized deeplearning distributed-computing machine-learning mpi nccl one-sided pytorch

Last synced: 27 Nov 2024

https://github.com/scalecube/scalecube-cluster

ScaleCube Cluster is a lightweight Java VM implementation of SWIM: Scalable Weakly-consistent Infection-style Process Group Membership Protocol. features cluster membership, failure detection, and gossip protocol library.

cluster-membership distributed-computing distributed-systems failure-detection gossip-protocol gossip-protocol-library reactive-programming reactor3 service-discovery-protocol swim-protocol

Last synced: 15 May 2025

https://github.com/pgiri/dispy

Distributed and Parallel Computing Framework with / for Python

cloud-computing distributed-computing parallel-computing

Last synced: 09 May 2025

https://github.com/nexaai/octopus-v4

AI for all: Build the large graph of the language models

distributed-computing graph large-language-models

Last synced: 07 Apr 2025

https://github.com/bears-r-us/arkouda

Arkouda (αρκούδα): Interactive Data Analytics at Supercomputing Scale :bear:

chapel data data-analysis data-science distributed-computing eda hpc python

Last synced: 06 Apr 2025