Data

Tools

Indexes

Applications

Experiments

Awesome

An open API service indexing awesome lists of open source software.

Projects in Awesome Lists tagged with load-balancing

A curated list of projects in awesome lists tagged with load-balancing .

https://github.com/maximhq/bifrost

Fastest enterprise AI gateway (50x faster than LiteLLM) with adaptive load balancer, cluster mode, guardrails, 1000+ models support & <100 µs overhead at 5k RPS.

ai-gateway gateway gateway-services generative-ai guardrails llm llm-cost llm-gateway llm-observability llmops load-balancing mcp-client mcp-gateway mcp-server model-router token-management

Last synced: 07 Jun 2026

https://github.com/pegaprox/project-pegaprox

The ultimate datacenter management solution for Proxmox VE and XCP-NG. Unified multi-cluster control, intelligent load balancing, and seamless cross-cluster VM migrations — all in one beautiful interface.

backup-management cluster-management container-management datacenter high-availability load-balancing monitoring multi-cluster proxmox proxmox-ve self-hosted sysadmin virtualization vm-management web-dashboard

Last synced: 31 May 2026

https://github.com/cloudsimplus/cloudsimplus

State-of-the-art Framework 🏗 for Cloud Computing ⛅️ Simulation: a modern, full-featured, easier-to-use, highly extensible 🧩, faster 🚀 and more accurate ☕️ Java 17+ tool for cloud computing research 🎓. Examples: https://github.com/cloudsimplus/cloudsimplus-examples

auto-scaling cloud-computing cloud-infrastructure cloud-simulation cloudsim cloudsim-simulator cloudsimplus google-cluster-data iaas java java-17 load-balancing paas research saas simulation simulation-framework test-bed trace workload

Last synced: 04 Jan 2026

https://github.com/junkurihara/rust-rpxy

A simple and ultrafast http reverse proxy serving multiple domain names and terminating TLS for http/1.1, 2 and 3, written in Rust

acme http http-proxy http11 http2 http3 https load-balancing multidomain pqc proxy reverse-proxy rust tls tls-alpn-01 tls-termination

Last synced: 03 Jun 2026

https://github.com/helicone/ai-gateway

The fastest, lightest, and easiest-to-integrate AI gateway on the market. Fully open-sourced.

ai cache gateway llm llms load-balancing observability rate-limiting

Last synced: 09 Sep 2025

https://github.com/cfal/tobaru

Port forwarding utility written in Rust with IP and TLS SNI/ALPN-based forwarding rules, multiple targets per port, iptables support, and hot reloading.

load-balancing port-forward port-forwarding portforward rust tcp-proxy tls tls-alpn tls-alpn-01 tls-sni tls-sni-01 tls-tunnel tunnel

Last synced: 09 Apr 2025

https://github.com/yahoo/l3dsr

Direct Server Return load balancing across Layer 3 boundaries.

big-data- c load-balancing perl

Last synced: 09 Apr 2025

https://github.com/norkator/open-intelligence

Creepy stalking tool to process security camera motion triggered images and sort seen objects in different categories, detect license plates and faces. Has PWA ready web front end. Meant to make property monitoring faster without need to watch video recordings.

alpr clustering face-detection face-recognition intelligence-cctv intelligence-gathering load-balancing neural-nets neural-networks object-detection plate-detection plate-recognition security-camera security-cameras super-resolution surveillance surveillance-systems tensorflow yolov3 yolov4

Last synced: 08 Apr 2025

https://github.com/eXascaleInfolab/PyExPool

Python Multi-Process Execution Pool: concurrent asynchronous execution pool with custom resource constraints (memory, timeouts, affinity, CPU cores and caching), load balancing and profiling capabilities of the external apps on NUMA architecture

application-framework benchmarking-framework cache-control execution-pool in-memory-computations load-balancing monitoring-server multiprocessing numa parallel-computing parallel-processing task-queue

Last synced: 02 Apr 2025

https://github.com/immanuelfodor/kube-karp

☸ Add a floating virtual IP to Kubernetes cluster nodes for load balancing easily.

carp devops docker floating-ip helm helm-chart high-availability kubernetes load-balancing virtual-ip

Last synced: 08 May 2025

https://github.com/mayuresh82/gocast

GoCast is a tool for controlled BGP route announcements from a host

anycast bgp consul docker exabgp golang load-balancing nomad vip

Last synced: 12 Jan 2026

https://github.com/PegaProx/project-pegaprox

The ultimate datacenter management solution for Proxmox VE. Unified multi-cluster control, intelligent load balancing, and seamless cross-cluster VM migrations — all in one beautiful interface.

backup-management cluster-management container-management datacenter high-availability load-balancing monitoring multi-cluster proxmox proxmox-ve self-hosted sysadmin virtualization vm-management web-dashboard

Last synced: 10 Feb 2026

https://github.com/wdamron/go-anchorhash

A minimal-memory AnchorHash (consistent-hash) implementation for Go

anchorhash consistent-hashing load-balancing

Last synced: 30 Apr 2025

https://github.com/lightsing/openai-hub

A secure and efficient gateway for interacting with OpenAI's API, featuring load balancing, user request handling without individual API keys, and global access control.

access-control acl artificial-intelligence authentication axum load-balancing openai openai-api rust

Last synced: 21 Jul 2025

https://github.com/giansalex/aspnetcore-load-balancing

ASP.NET Core 6.0 - Load Balancing with Nginx | Traefik | Caddy - Alpine - Docker

aspnet-core caddy docker load-balancing netcore3 nginx traefik

Last synced: 18 Mar 2025

https://github.com/gunrock/loops

🎃 GPU load-balancing library for regular and irregular computations.

cuda gpu gpu-computing hpc load-balancing parallel

Last synced: 09 May 2026

https://github.com/k8snetworkplumbingwg/bond-cni

Bond-cni is for fail-over and high availability of networking in cloudnative orchestration

active-backup alb bonding-cni cni failover fault-tolerance high-availability interface-bonding link-aggregator load-balancing networking tlb

Last synced: 18 Jun 2025

https://github.com/realvnf/coord-sim

Lightweight flow-level simulator for inter-node network and service coordination (e.g., in cloud/edge computing or NFV).

coordination edge-computing flow load-balancing network networkx nfv openai-gym placement python scaling scheduling simpy simulation simulator

Last synced: 04 Apr 2025

https://github.com/maojianwei/onos_loadbalance_routing_forward

LoadBalance Routing and Forwarding Application at ONOS

forwarding load-balancing loadbalancer loadbalancing network onos onos-app

Last synced: 21 Mar 2025

https://github.com/miekg/xds

command line interface for Envoy xDS endpoint

coredns envoy load-balancing xds

Last synced: 09 May 2025

https://github.com/piomin/sample-quarkus-microservices-consul

Demo applications illustrating how to build microservices and run them outside Kubernetes with Quarkus. It shows how to integrate the Quarkus application with Consul discovery and the KV store.

consul consul-kv-store distributed-configuration java load-balancing microservices quarkus quarkus-rest quarkus-stork rest-api rest-client service-discovery smallrye-stork

Last synced: 21 Aug 2025

https://github.com/majiayu000/litellm-rs

A high-performance AI Gateway written in Rust — call 100+ LLM APIs using OpenAI format

ai-gateway anthropic api-client async-rust aws-bedrock embeddings gemini llm load-balancing multi-provider ollama openai rust streaming

Last synced: 06 Apr 2026

https://github.com/unkn0wn-root/terraster

Uncomplicated L7 Load Balancer/Reverse Proxy with Plugins support and Admin API

go golang l7 l7-balancer load-balancer load-balancing loadbalancer networking proxy proxy-server

Last synced: 18 Oct 2025

https://github.com/markdingo/cslb

A Go Client-Side Load-Balancer for HTTP/HTTPS

balancers go golang golang-package http http-client load-balancing microservices srv-rr

Last synced: 16 Jan 2026

https://github.com/sarthakpranesh/mininet-load-balancing

Mininet SDN based experiments on load balancing and improving server response times

cloud load-balancing load-testing mininet python sdn sdn-network server

Last synced: 23 Mar 2025

https://github.com/runityru/anycastd

Simple daemon to make BGP announces if service is alive

anycast bgp high-availability liveness-detection load-balancing loadbalancing networking

Last synced: 18 Apr 2026

https://github.com/tranngoclam/ops-lab

Set of blueprints for Operation in Distributed System, Microservices.

consul docker docker-buildkit docker-compose golang grpc haproxy hashicorp k8s load-balancing microservices nginx nomad rest

Last synced: 10 Mar 2026

https://github.com/nulidangxueshen/ALBUS

A Method for efficiently processing SpMV using SIMD and load balancing

albus csr load-balancing simd simd-instructions sparse-matrix-vector-multiplication spmv

Last synced: 21 Apr 2025

https://github.com/anotherkamila/sdn-loadbalancer

A P4 load balancer able to distribute the traffic on real-time server metrics, at line rate.

load-balancing p4 sdn sdn-controller sdn-switch software-defined-networking

Last synced: 12 Apr 2025

https://github.com/archishmansengupta/consistent-hashing

A Thread-safe Go library for distributed load balancing using consistent hashing with bounded loads

consistent-hashing distributed-systems golang hash load-balancing murmurhash3 thread-safe

Last synced: 17 Jun 2025

https://github.com/fufuok/balancer

⚖️ Goroutine-safe, High-performance general load balancing algorithm library.

consistent-hash load-balancing smooth-weighted-round-robin weighed-rand weighted-round-robin

Last synced: 14 Apr 2025

https://github.com/armbian/armbian-router

Geolocation content delivery system to leverage the user's location information to improve download performance

caching cdn geo-targeting global-distribution latency-reduction load-balancing redundancy router serverless-cdn smart-routing

Last synced: 15 Jun 2025

https://github.com/fidanf/ansible-role-pgpool

Installs and configures PgPool-II for Debian/Ubuntu.

high-availability load-balancing pgpool2 postgresql replication watchdog

Last synced: 23 Jul 2025

https://github.com/mwiater/golangconsuldiscovery

Replicating and Load Balancing Go Applications in Docker Containers with Consul and Fabio. More details in my article on Better Programming:

consul docker fabio golang load-balancing

Last synced: 10 Apr 2025

https://github.com/paolosalvatori/shared-azure-openai-tpm

This example shows how a multitenant service can distribute requests evenly among multiple Azure OpenAI Service instances and manage tokens per minute (TPM) for multiple tenants.

aks azure-kubernetes-service azure-openai azure-openai-service grafana grafana-dashboard kubernetes load-balancing openai prometheus tokens-per-minute tpm

Last synced: 25 Oct 2025

https://github.com/thegeekyasian/round-robin-go

round-robin-go is an implementation of round-robin algorithm that allows you to use your resources in a shared rational order. This project uses go generics that enables you to use any data type in your round robin implementation.

go golang load-balancer load-balancing round-robin round-robin-scheduler round-robin-simulator roundrobin

Last synced: 13 Mar 2026

https://github.com/seipan/mylb

⭐ Implementing a Load Balancer in Golang(just a toy) ⭐

go golang load-balancer load-balancing

Last synced: 23 Apr 2025

https://github.com/heremaps/saturate-nodes-plugin

A Jenkins plugin which allows to saturate nodes as much as possible

cloud cost-optimization jenkins load-balancing plugin

Last synced: 27 Jun 2025

https://github.com/alextanhongpin/traefik-grpc-docker

gRPC Load Balancing with Traefik in Docker

docker grpc grpc-gateway load-balancing

Last synced: 04 Aug 2025

https://github.com/nemisolv/spring-ecommerce-microservices

This repository showcases Spring Boot microservices for eCommerce, each handling tasks like user authentication/authorization, product management, and order processing within a cohesive distributed architecture, ensuring scalability and efficiency.

distributed-system-architecture ecommerce java load-balancing microservices scalability security spring-cloud-gateway springboot springboot-microservices

Last synced: 28 Feb 2026

https://github.com/radlab-dev-group/llm-router

LLM Router is a service that can be deployed on‑premises or in the cloud. It adds a layer between any application and the LLM provider. In real time it controls traffic, distributes a load among providers of a specific LLM, and enables analysis of outgoing requests from a security perspective (masking, anonymization, prohibited content).

automation cloud genai llm llm-balancing llm-gateway llm-gateway-system llm-router llm-router-models llm-router-plugins load-balancing local-llm local-llm-integration model-management on-prem pii prometheus rest-api security

Last synced: 14 May 2026

https://github.com/udhos/a10-go-rest-client

Go golang API rest client for A10 Networks devices

a10 api go golang golang-package load-balancing networking rest

Last synced: 01 Jun 2026

https://github.com/sleekpanther/load-balancing-problem-approximation-algorithm

Approximation Algorithm for the NP-Complete problem of balancing job loads on machines. Does not guarantee an optimal solution, but instead, a solution is within a factor of 1.5 of the optimal solution

algorithm-design algorithms approximation approximation-algorithms balance cpu jobs load load-balancing load-balancing-problem machine makespan noah noah-patullo pattullo pattulo patullo patulo priority-queue processing

Last synced: 24 Sep 2025

https://github.com/b-a-m-n/flockparser

Distributed document RAG system with intelligent GPU/CPU orchestration. Auto-discovers heterogeneous nodes, routes workloads adaptively, and achieves 60x+ speedups through VRAM-aware load balancing. Privacy-first architecture with 4 interfaces (CLI, API, MCP, Web UI). Real distributed systems engineering, not just an API wrapper.

api auto-discovery chromadb cli distributed-rag document-processing gpu-orchestration heterogeneous-computing llm load-balancing mcp ollama privacy-first python rag semantic-search vector-database vram-aware web-ui workload-orchestration

Last synced: 14 Dec 2025

https://github.com/rtmigo/schedulers_dart

Dart library for running asynchronous functions on time. For load balancing, rate limiting, lazy execution

callbacks dart-library lazy-evaluation load-balancing rate-limiting time

Last synced: 11 Jan 2026

https://github.com/oefenweb/ansible-nginx

Ansible role to set up (the latest version of) NGINX in Debian-like systems

ansible debian http https load-balancing ubuntu webserver

Last synced: 13 Jul 2025

https://github.com/andylamp/gpurelperf

A handy utility to find relative GPU performance quickly in multi-gpu boxes

gpu load-balancing mxnet

Last synced: 22 Feb 2026

https://github.com/aichy126/onedock

🐳 Smart Docker container orchestration with intelligent load balancing and automatic port management. Built with Go + Gin framework.

container-orchestration containerization devops docker docker-management golang load-balancing port-management proxy-server scaling

Last synced: 14 Jan 2026

https://github.com/sumanadithan/nginx

This repository contains Docker configurations for Nginx and Express servers, demonstrating web server setups, load balancing, and URL management.

containerization docker express load-balancing nginx url-rewriting web-server

Last synced: 24 Jan 2026

https://github.com/sshehrozali/daffodil

Distributed systems example in Spring framework using Load Balancer, API Gateway, Service Discovery and Distributed tracing.

distributed-computing distributed-log docker eureka http load-balancing microservices service-disovery spring spring-boot zipkin-sleuth

Last synced: 09 Feb 2026

https://github.com/gennady73/rhbk-multi-site-sso-workshop

Hands-on workshop for a multi-site, high-availability (HA) Red Hat Build of Keycloak (RHBK) deployment. Covers Infinispan cross-site replication, HAProxy, and GSLB.

clustering cross-site cross-site-replication gslb high-availability iam infinispan keycloak load-balancing multi-site observability rhbk rhel9 sso tutorial v26 workshop

Last synced: 04 Mar 2026

https://github.com/avrtt/pochemuchka

Automatic prompt engineering, testing & load balancing for your AI models in production

ai-engineering cicd llms load-balancing mlops model-integration modelops prompt-engineering prompt-tuning

Last synced: 19 May 2026

https://github.com/rvhonorato/job-orchestrator

Asynchronous job orchestrator with quota-based load balancing for distributing computational workloads across heterogeneous computing resources

async distributed-computing hpc job-orchestrator job-scheduler load-balancing quota-management rest-api rust scientific-computing tokio workflow-engine

Last synced: 20 Feb 2026

https://github.com/bitsofinfo/kubernetes-ingress-info

Simple REST endpoint to determine existence of Kubernetes Ingress "host" presence (or lack thereof) in a k8s cluster.

cloud discovery ingress kubernetes load-balancer load-balancing

Last synced: 04 May 2026

https://github.com/alextanhongpin/traefik-grpc-nomad

Load Balancing gRPC with traefik combined with nomad template functionality

grpc load-balancing nomad traefik

Last synced: 30 Apr 2026

https://github.com/neoblizz/spmv

Efficient Sparse Matrix-Vector Multiplication (SpMV) using ModernGPU (MTX + CSR formats).

csr cuda gpgpu load-balancing mtx spmv

Last synced: 28 Apr 2026

https://github.com/nihadamirov/spring-boot-microservices

A set of microservices built with Spring Boot, featuring service discovery with Eureka, load balancing with Ribbon, and an API gateway with Zuul.

api-gateway docker docker-compose eureka load-balancing mongodb postgresql ribbon service-discovery spring-boot-microservices swagger zuul

Last synced: 11 Apr 2026

https://github.com/patrickbrown-dev/pblb

An experimental load balancer with configurable balancing algorithms.

go golang load-balancer load-balancing

Last synced: 30 Aug 2025

https://github.com/ntdls/catmq

A high-performance and reliable persistent message queue designed for efficient inter-process communication, task queuing, load balancing, and data buffering over TCP/IP.

ipc load-balancing message-queue queuing

Last synced: 08 May 2026

https://github.com/oktadev/okta-spring-sessions-example

Load balanced Spring Boot + Spring Session application with OAuth 2.0

haproxy java load-balancing redis spring-boot spring-session

Last synced: 22 Sep 2025

https://github.com/kelindar/emitter-share

How to use shared subscriptions (subscription groups) with Emitter

consumer-group emitter load-balancing subscriber-group subscriptions

Last synced: 25 Mar 2025

https://github.com/gregorykogan/jwt-microservice

A high-performance JWT authentication microservice written in Go, featuring Redis caching and Docker support.

authentication auto-logout caching docker docker-compose go high-performance jwt load-balancing microservice nginx redis security structured-logging testing token-refresh uuid

Last synced: 04 Apr 2026

https://github.com/whisperity/distcc-driver

Driving DistCC-based distributed C/C++ compilation in a smarter way: without having to deal with DISTCC_HOSTS intricacies and without accidentally stalling your development machine.

bash bash-script c clang compiler compiler-frontend cplusplus cpp developer-environment developer-tools distcc distributed-computing driver gcc linux load-balancing zsh zsh-script

Last synced: 07 Apr 2026

https://github.com/andrey123815/news_highload

:vhs: Технопарк Mail.ru 3 семестр. Курсовая работа по курсу "HighLoad". Веб-сервер для отдачи статики с диска

database-schema highload load-balancing load-calculation servers target-group

Last synced: 17 Feb 2026

https://github.com/mmikhail2001/highload_youtube

Расчетно-пояснительная записка. Проектирование высоконагруженного сервиса YouTube.

bgp-anycast cassandra cdn clickhouse ecmp envoy geo-dns internet-exchange k8s kafka load-balancing mapreduce s3 tarantool

Last synced: 14 May 2026

https://github.com/vbattista78/microstack-autoscaling-project

Demo of CPU-driven autoscaling with load balancing on MicroStack/OpenStack: create clone on high CPU, delete base on low.

bash cloud-computing cloud-init cpu-metrics load-balancing microstack openstack python vm-cloning

Last synced: 16 May 2026

https://github.com/1mb-dev/hash-orbit

TypeScript consistent hashing for distributed systems. Route keys with minimal redistribution (~1/N). Pure algorithm, zero infrastructure opinions.

caching consistent-hashing database distributed-systems hash-ring load-balancing partitioning redis sharding typescript

Last synced: 24 Feb 2026

https://github.com/msantos/runhash-go

runhash: command line interface for distributed node selection

load-balancing rendezvous-hash

Last synced: 08 Sep 2025

https://github.com/abbychau/phpmyserver

A program that starts multiple PHP development servers and load balances incoming requests between them using a round-robin algorithm.

go load-balancing php process-management round-robin web-development

Last synced: 24 Apr 2026