Projects in Awesome Lists tagged with scalability

https://github.com/charlax/professional-programming

A collection of learning resources for curious software engineers

architecture computer-science concepts documentation engineer learning lessons-learned professional programmer programming-language read-articles scalability software-engineering

Last synced: 13 May 2025

https://github.com/karanpratapsingh/system-design

Learn how to design systems at scale and prepare for system design interviews

architecture distributed-systems engineering interview interview-preparation microservices scalability system-design system-design-interview tech

Last synced: 20 Mar 2025

https://github.com/taosdata/tdengine

High-performance, scalable time-series database designed for Industrial IoT (IIoT) scenarios

bigdata cloud-native cluster connected-vehicles database distributed financial-analysis industrial-iot iot metrics monitoring scalability sql tdengine time-series time-series-database tsdb

Last synced: 12 May 2025

https://github.com/taosdata/TDengine

High-performance, scalable time-series database designed for Industrial IoT (IIoT) scenarios

bigdata cloud-native cluster connected-vehicles database distributed financial-analysis industrial-iot iot metrics monitoring scalability sql tdengine time-series time-series-database tsdb

Last synced: 24 Mar 2025

https://github.com/paddlepaddle/paddle

PArallel Distributed Deep LEarning: Machine Learning Framework from Industrial Practice （『飞桨』核心框架，深度学习&机器学习高性能单机、分布式训练和跨平台部署）

deep-learning distributed-training efficiency machine-learning neural-network paddlepaddle python scalability

Last synced: 12 May 2025

https://github.com/PaddlePaddle/Paddle

PArallel Distributed Deep LEarning: Machine Learning Framework from Industrial Practice （『飞桨』核心框架，深度学习&机器学习高性能单机、分布式训练和跨平台部署）

deep-learning distributed-training efficiency machine-learning neural-network paddlepaddle python scalability

Last synced: 16 Mar 2025

https://github.com/baidu/Paddle

PArallel Distributed Deep LEarning: Machine Learning Framework from Industrial Practice （『飞桨』核心框架，深度学习&机器学习高性能单机、分布式训练和跨平台部署）

deep-learning distributed-training efficiency machine-learning neural-network paddlepaddle python scalability

Last synced: 04 Feb 2025

https://github.com/ashishps1/awesome-system-design-resources?tab=readme-ov-file

Learn System Design concepts and prepare for interviews using free resources.

awesome backend computer-science distributed-systems high-level-design hld interview interview-questions scalability system-design

Last synced: 17 Dec 2024

https://github.com/InterviewReady/system-design-resources

These are the best resources for System Design on the Internet

cache fault-tolerance scalability system-design

Last synced: 14 Mar 2025

https://github.com/systemdesign42/system-design

A resource to help you become good at work 👇

computer-science development distributed-systems high-level-design interview-questions programming scalability software-engineering system-design system-design-interview

Last synced: 27 Mar 2025

https://github.com/victoriametrics/victoriametrics

VictoriaMetrics: fast, cost-effective monitoring solution and time series database

cluster database grafana graphite influxdb k8s kubernetes monitoring observability opentsdb prometheus promql scalability thanos tsdb

Last synced: 12 May 2025

https://github.com/stas00/ml-engineering

Machine Learning Engineering Open Book

ai inference large-language-models llm machine-learning machine-learning-engineering mlops pytorch scalability slurm training transformers

Last synced: 14 May 2025

https://github.com/VictoriaMetrics/VictoriaMetrics

VictoriaMetrics: fast, cost-effective monitoring solution and time series database

cluster database grafana graphite influxdb k8s kubernetes monitoring observability opentsdb prometheus promql scalability thanos tsdb

Last synced: 13 Mar 2025

https://github.com/vesoft-inc/nebula

A distributed, fast open-source graph database featuring horizontal scalability and high availability

big-data cpp database distributed distributed-systems graph graph-database graphdb hacktoberfest nebula nebula-graph nebulagraph raft scalability

Last synced: 13 May 2025

https://github.com/centrifugal/centrifugo

Scalable real-time messaging server in a language-agnostic way. Self-hosted alternative to Pubnub, Pusher, Ably. Set up once and forever.

eventsource grpc http-streaming http3 messaging pubsub real-time redis scalability server-sent-events sse streaming websocket websockets webtransport

Last synced: 12 May 2025

https://github.com/shashank88/system_design

Preparation links and resources for system design questions

architecture concurrency engineering facebook interview interview-preparation interview-preparation-resources interview-questions preparation scalability scale-systems system-design

Last synced: 26 Mar 2025

https://github.com/centrifugal/centrifuGo

Scalable real-time messaging server in a language-agnostic way. Self-hosted alternative to Pubnub, Pusher, Ably. Set up once and forever.

eventsource grpc http-streaming http3 messaging pubsub real-time redis scalability sockjs sse streaming websocket websockets webtransport

Last synced: 12 Mar 2025

https://github.com/hazelcast/hazelcast

Hazelcast is a unified real-time data platform combining stream processing with a fast data store, allowing customers to act instantly on data-in-motion for real-time insights.

big-data caching data-in-motion data-insights distributed distributed-computing distributed-systems hacktoberfest hazelcast in-memory java low-latency real-time scalability stream-processing

Last synced: 12 May 2025

https://github.com/tuist/tuist

Build better Swift apps faster

hacktoberfest ios objective-c productivity scalability swift xcode

Last synced: 13 May 2025

https://github.com/axonframework/axonframework

Framework for Evolutionary Message-Driven Microservices on the JVM

cqrs domain-driven-design event-sourcing java message-driven performance scalability

Last synced: 14 May 2025

https://github.com/AxonFramework/AxonFramework

Framework for Evolutionary Message-Driven Microservices on the JVM

cqrs domain-driven-design event-sourcing java message-driven performance scalability

Last synced: 27 Apr 2025

https://github.com/talyssonoc/node-api-boilerplate

DDD/Clean Architecture inspired boilerplate for Node web APIs

boilerplate clean-architecture ddd good-practices hacktoberfest nodejs scalability

Last synced: 15 May 2025

https://github.com/dashersw/cote

A Node.js library for building zero-configuration microservices.

high-availability javascript microservice microservices nodejs scalability zero-configuration

Last synced: 13 May 2025

https://github.com/xudong-huang/may

rust stackful coroutine library

async coroutines fibers generator green-threads high-performance io primitives rust scalability

Last synced: 23 Apr 2025

https://github.com/codersguild/system-design

It's just fascinating. How is modern software designed? 🤔 Some design-level considerations for scalability, maintainability eventual consistency, availability & reliability. 👨‍💻 Interview Prep. 👨‍💻

amazon architecture computer-science eventual-consistency facebook google hacktoberfest interview interview-preparation microsoft netflix reliability scalability scale software-engineering system-design toc whatsapp youtube

Last synced: 15 May 2025

https://github.com/codersguild/System-Design

It's just fascinating. How is modern software designed? 🤔 Some design-level considerations for scalability, maintainability eventual consistency, availability & reliability. 👨‍💻 Interview Prep. 👨‍💻

amazon architecture computer-science eventual-consistency facebook google hacktoberfest interview interview-preparation microsoft netflix reliability scalability scale software-engineering system-design toc whatsapp youtube

Last synced: 10 Apr 2025

https://github.com/Xudong-Huang/may

rust stackful coroutine library

async coroutines fibers generator green-threads high-performance io primitives rust scalability

Last synced: 19 Mar 2025

https://github.com/shadow/shadow

Shadow is a discrete-event network simulator that directly executes real application code, enabling you to simulate distributed systems with thousands of network-connected processes in realistic and scalable private network experiments using your laptop, desktop, or server running Linux.

control emulation experimentation networking realism scalability science-research scientific-computing simulation tor

Last synced: 14 May 2025

https://github.com/honzaap/Systemizer

A system design tool that allows you to simulate data flow of distributed systems.

architecture backend data-flow database design-tool distributed-systems microservices microservices-architecture scalability server system-design visualization web-development

Last synced: 02 Apr 2025

https://github.com/honzaap/systemizer

A system design tool that allows you to simulate data flow of distributed systems.

architecture backend data-flow database design-tool distributed-systems microservices microservices-architecture scalability server system-design visualization web-development

Last synced: 13 Apr 2025

https://github.com/AElfProject/AElf

An AI-enhanced cloud-native layer-1 blockchain network.

blockchain clusters csharp dotnet-core multi-chain scalability

Last synced: 09 May 2025

https://github.com/aelfproject/aelf

An AI-enhanced cloud-native layer-1 blockchain network.

blockchain clusters csharp dotnet-core multi-chain scalability

Last synced: 14 May 2025

https://github.com/centrifugal/centrifuge

Real-time messaging library for Go. The simplest way to add feature-rich and scalable WebSocket support to your application. The core of Centrifugo server.

authentication eventsource http-streaming json messaging protobuf pubsub real-time redis scalability sse websocket

Last synced: 11 May 2025

https://github.com/maticnetwork/contracts

Smart contracts comprising the business logic of the Matic Network

blockchain cryptocurrencies dapps decentralised-exchange ethereum payment scalability

Last synced: 18 Jan 2025

https://github.com/deeprec-ai/deeprec

DeepRec is a high-performance recommendation deep learning framework based on TensorFlow. It is hosted in incubation in LF AI & Data Foundation.

advertising deep-learning distributed-training machine-learning python recommendation-engine scalability search-engine

Last synced: 14 May 2025

https://github.com/DeepRec-AI/DeepRec

DeepRec is a high-performance recommendation deep learning framework based on TensorFlow. It is hosted in incubation in LF AI & Data Foundation.

advertising deep-learning distributed-training machine-learning python recommendation-engine scalability search-engine

Last synced: 30 Mar 2025

https://github.com/bregman-arie/system-design-notebook

Learn System Design step by step

architecture cache dns exercises load-balancer scalability throughput

Last synced: 29 Mar 2025

https://github.com/uwdata/mosaic

An extensible framework for linking databases and interactive views.

data duckdb interaction scalability visualization

Last synced: 14 May 2025

https://github.com/sairyss/system-design-patterns

Resources related to distributed systems, system design, microservices, scalability and performance, etc

architecture-pattern design-patterns distributed-systems microservices microservices-architecture patterns scalability software-architecture software-design system-design

Last synced: 12 Mar 2025

https://github.com/linkedin/brooklin

An extensible distributed system for reliable nearline data streaming at scale

change-data-capture data-streaming distributed-systems java kafka kafka-mirror-maker linkedin scalability

Last synced: 30 Apr 2025

https://github.com/linkedin/Brooklin

An extensible distributed system for reliable nearline data streaming at scale

change-data-capture data-streaming distributed-systems java kafka kafka-mirror-maker linkedin scalability

Last synced: 12 Mar 2025

https://github.com/eclipse-vertx/vertx-sql-client

High performance reactive SQL Client written in Java

async mssql mysql netty non-blocking performance pg postgres reactive scalability vertx

Last synced: 14 May 2025

https://github.com/adamsilver/maintainablecss.com-jekyll

Write CSS without worrying that overzealous, pre-existing styles will cause problems. MaintainableCSS is an approach to writing modular, scalable and of course, maintainable CSS.

css maintainance modular scalability web

Last synced: 13 Mar 2025

https://github.com/kubewharf/kubebrain

A High Performance Metadata System for Kubernetes

etcd kubernetes kv-store metadata scalability

Last synced: 12 Apr 2025

https://github.com/Sairyss/system-design-patterns

Resources related to distributed systems, system design, microservices, scalability and performance, etc

architecture-pattern design-patterns distributed-systems microservices microservices-architecture patterns scalability software-architecture software-design system-design

Last synced: 30 Mar 2025

https://github.com/geerlingguy/ansible-for-kubernetes

Ansible and Kubernetes examples from Ansible for Kubernetes Book

ansible automation book devops go infrastructure kubernetes python scalability

Last synced: 16 May 2025

https://github.com/untu/comedy

Node.js actor framework.

actors framework nodejs nodejs-framework scalability

Last synced: 25 Mar 2025

https://github.com/reactivemanifesto/reactivemanifesto

The Reactive Manifesto

asynchronous distributed-systems manifesto reactive reactive-programming resilience scalability

Last synced: 03 Apr 2025

https://github.com/ScriptFUSION/Porter

:lipstick: Durable and asynchronous data imports for consuming data at scale and publishing testable SDKs.

abstraction asynchronous data-import data-transformation durability fibers framework library php-development porter scalability

Last synced: 05 Apr 2025

https://github.com/scriptfusion/porter

:lipstick: Durable and asynchronous data imports for consuming data at scale and publishing testable SDKs.

abstraction asynchronous data-import data-transformation durability fibers framework library php-development porter scalability

Last synced: 14 May 2025

https://github.com/huggingface/large_language_model_training_playbook

An open collection of implementation tips, tricks and resources for training large language models

cuda large-language-models llm nccl nlp performance python pytorch scalability troubleshooting

Last synced: 27 Apr 2025

https://github.com/Clivern/Gauntlet

🔖 Guides, Articles, Podcasts, Videos and Notes to Build Reliable Large-Scale Distributed Systems.

automation aws containers continuous-delivery continuous-integration database-replication devops digitalocean distributed-systems docker failover hacktoberfest high-availability kubernetes load-balancer microservice microservices-architecture scalability sre

Last synced: 07 Apr 2025

https://github.com/clivern/gauntlet

🔖 Guides, Articles, Podcasts, Videos and Notes to Build Reliable Large-Scale Distributed Systems.

automation aws containers continuous-delivery continuous-integration database-replication devops digitalocean distributed-systems docker failover hacktoberfest high-availability kubernetes load-balancer microservice microservices-architecture scalability sre

Last synced: 05 Apr 2025

https://github.com/azure/azuredatabricksbestpractices

Version 1 of Technical Best Practices of Azure Databricks based on real world Customer and Technical SME inputs

azure azuredatabricks deployment grafana performance performance-monitoring provisioning python scalability security spark

Last synced: 04 Apr 2025

https://github.com/Azure/AzureDatabricksBestPractices

Version 1 of Technical Best Practices of Azure Databricks based on real world Customer and Technical SME inputs

azure azuredatabricks deployment grafana performance performance-monitoring provisioning python scalability security spark

Last synced: 04 Dec 2024

https://github.com/oracle/coherence

Oracle Coherence Community Edition

caching cloud clustering coherence data-grid distributed hpc imdg in-memory java kv-store microservices polyglot scalability

Last synced: 15 May 2025

https://github.com/cloudi/cloudi

A Cloud at the lowest level!

actor-model cloud cloud-computing cloudi concurrency distributed-actors distributed-systems fault-tolerance functional-reactive-programming microservices reactive scalability soa

Last synced: 15 May 2025

https://github.com/CloudI/CloudI

A Cloud at the lowest level!

actor-model cloud cloud-computing cloudi concurrency distributed-actors distributed-systems fault-tolerance functional-reactive-programming microservices reactive scalability soa

Last synced: 20 Nov 2024

https://github.com/thautwarm/mlstyle.jl

Julia functional programming infrastructures and metaprogramming facilities

algebraic-data-types pattern-matching scalability statically-generated syntax-sugar

Last synced: 16 May 2025

https://github.com/teivah/designdeck

An Open-Source Collection of 230+ Flash Cards to Help You Succeed in Your System Design Interview and More 💯

cache cloud database http interview interview-preparation kafka leetcode network reliability scalability security system-design

Last synced: 03 Apr 2025

https://github.com/infinit/infinit

The Infinit policy-based software-defined storage platform.

block-device decentralized distributed fault-tolerance filesystem fuse infinit iscsi key-value ldap nbd nfs object-storage peer-to-peer platform policies resilience s3 scalability storage

Last synced: 25 Mar 2025

https://github.com/jonhoo/drwmutex

Distributed RWMutex in Go

golang locking multi-core scalability synchronization

Last synced: 06 Apr 2025

https://github.com/telepat-io/telepat-api

This is the Telepat API where HTTP calls are made. CRUD operations are not processed here directly. Messages are sent to the Telepat workers where CRUD operations are being taken care of along with client communication (notifications).

notifications realtime scalability synchronization

Last synced: 29 Nov 2024

https://github.com/feliixx/mgodatagen

Generate random data for MongoDB

bson database-population mongodb random scalability seeding test

Last synced: 05 Apr 2025

https://github.com/cardano-scaling/hydra

Implementation of the Hydra Head protocol

blockchain cardano haskell plutus scalability

Last synced: 26 Mar 2025

https://github.com/paypal/hera

High Efficiency Reliable Access to data stores

databases mux mysql oracle scalability

Last synced: 15 May 2025

https://github.com/jponge/vertx-in-action

Examples for the Manning "Vert.x in Action" book

book distributed-systems examples manning reactive resilience scalability vertx

Last synced: 07 Apr 2025

https://github.com/deephyper/deephyper

DeepHyper: Scalable Asynchronous Neural Architecture and Hyperparameter Search for Deep Neural Networks

automl deep-learning hpc hyperparameter-optimization keras machine-learning mpi multi-fidelity neural-architecture-search python pytorch raylib scalability tensorflow uncertainty-quantification

Last synced: 07 Apr 2025

https://github.com/openpmix/openpmix

OpenPMIx Project Repository

exascale hacktoberfest pmi scalability wireup

Last synced: 26 Mar 2025

https://github.com/scify/jedaitoolkit

An open source, high scalability toolkit in Java for Entity Resolution.

blocking entity-matching entity-resolution scalability

Last synced: 06 Apr 2025

https://github.com/scify/JedAIToolkit

An open source, high scalability toolkit in Java for Entity Resolution.

blocking entity-matching entity-resolution scalability

Last synced: 07 May 2025

https://github.com/geerlingguy/ansible-role-haproxy

Ansible Role - HAProxy

ansible haproxy load-balancer performance proxy reverse-proxy role scalability webserver

Last synced: 05 Apr 2025

https://github.com/barrel-db/barrel-platform

Distributed database for the modern world

barrel barrel-platform database document-database documentdb erlang http json p2p reactive scalability

Last synced: 03 Apr 2025

https://github.com/timebertt/kubernetes-controller-sharding

Horizontally Scalable Kubernetes Controllers: distribute reconciliation of Kubernetes objects across multiple controller instances

controller distributed-systems kubernetes master-studies scalability sharding

Last synced: 05 Apr 2025

https://github.com/codahale/usl4j

A reasonably complete implementation of the Universal Scalability Law model.

capacity-planning java java-8 scalability universal-scalability-law usl

Last synced: 23 Jan 2025

https://github.com/houssemdellai/aks-course

Demoing Kubernetes/AKS features

aks backup containers devops helm kubernetes monitoring policy scalability security terraform

Last synced: 15 May 2025

https://github.com/fabriziosalmi/proxmox-lxc-autoscale

Automatically scale LXC containers resources on Proxmox hosts

autoscaler autoscaling autoscaling-groups containers lxc lxc-containers proxmox proxmox-infrastructure proxmox-tools scalability

Last synced: 04 Apr 2025

https://github.com/sin7y/olavm

A STARK-based ZKVM which aims to Programmable Scalability, Programmable Privacy

privacy-preserving rust scalability zk-zkvm

Last synced: 09 Apr 2025

https://github.com/aojea/kindnet

minimalistic Kubernetes network plugin that just works

cni ipv4 ipv6 kubernetes networking performance scalability

Last synced: 04 Apr 2025

https://github.com/Sin7Y/olavm

A STARK-based ZKVM which aims to Programmable Scalability, Programmable Privacy

privacy-preserving rust scalability zk-zkvm

Last synced: 18 Apr 2025

https://github.com/rusty1s/pyg_autoscale

Implementation of "GNNAutoScale: Scalable and Expressive Graph Neural Networks via Historical Embeddings" in PyTorch

graph-neural-networks pytorch pytorch-geometric scalability

Last synced: 20 Dec 2024

https://github.com/dpc/mioco

[no longer maintained] Scalable, coroutine-based, fibers/green-threads for Rust. (aka MIO COroutines).

async asynchronous coroutines fibers green-threads io rust scalability

Last synced: 06 Apr 2025

https://github.com/labring/sealfs

The storage system of sealos, aims to be a high-performance, high-reliability, and auto-scaling distributed file system

distributed-systems filesystem rust scalability storage

Last synced: 27 Apr 2025

https://github.com/andygeiss/ecs

Build your own Game-Engine based on the Entity Component System concept in Golang.

benchmark bitmask bitset entity-component-system game-development game-engine game-engine-2d go golang goroutine raylib scalability

Last synced: 13 Apr 2025

https://github.com/Clustering4Ever/Clustering4Ever

C4E, a JVM friendly library written in Scala for both local and distributed (Spark) Clustering.

ai artificial-intelligence big-data bigdata clustering clustering-algorithm clustering-evaluation scala scalability spark

Last synced: 13 May 2025

https://github.com/clustering4ever/clustering4ever

C4E, a JVM friendly library written in Scala for both local and distributed (Spark) Clustering.

ai artificial-intelligence big-data bigdata clustering clustering-algorithm clustering-evaluation scala scalability spark

Last synced: 23 Feb 2025

https://github.com/dice-group/LIMES

Link Discovery Framework for Metric Spaces.

artificial-intelligence linked-data machine-learning optimization rdf record-linkage scalability semantic-web

Last synced: 03 Apr 2025

https://github.com/input-output-hk/mithril

Stake-based threshold multi-signatures protocol

blockchain cardano cardano-node mithril multi-signature-aggregation multi-signatures multisig rust scalability

Last synced: 15 May 2025

https://github.com/ionutbalosin/ecommerce-app

eCommerce application is a platform where customers can find products, shop around using a cart, check out the products and initiate payments. It is used for the didactic purpose only, as a support project for my training.

api-driven-development asynchronous-logging avro caching debezium docker event-driven flywaydb kafka location-decoupling microservices openapi postgresql resilience resilience4j scalability schema-first-approach shared-nothing-database-approach spring-boot testcontainers

Last synced: 05 Apr 2025

https://github.com/hazelcast/hazelcast-python-client

Hazelcast Python Client

big-data caching clustering datagrid distributed hazelcast hazelcast-client imdg in-memory python python2 scalability

Last synced: 15 May 2025

https://github.com/paulveillard/cybersecurity-soar

A collection of awesome framework, libraries, learning tutorials, videos, webcasts, technical resources and cool stuff about Security Orchestration, Automation and Response (SOAR).

compliance-as-code compliant cyber-threat-intelligence design-patterns hacking-tools incident-management incident-matrix incident-response ios-hacking orchestration orchestration-services os-hardening regulatory scalability scalable-applications security-hardening siem soar