Data

Tools

Indexes

Applications

Experiments

Awesome

An open API service indexing awesome lists of open source software.

Projects in Awesome Lists tagged with sharding

A curated list of projects in awesome lists tagged with sharding .

https://github.com/shardeum/shardeum

Shardeum is an EVM based autoscaling blockchain

blockchain dapp ethereum evm evm-blockchain payments sharding typescript

Last synced: 12 May 2025

https://github.com/thiagopradi/octopus

Database Sharding for ActiveRecord

activerecord ruby ruby-on-rails sharding

Last synced: 27 Apr 2025

https://github.com/lealone/Lealone

比 MySQL 和 MongoDB 快10倍的 OLTP 关系数据库和文档数据库

acid async database lealone microservice newsql oltp orm rdbms replication sharding sql

Last synced: 20 Mar 2025

https://github.com/pytorch/torchrec

Pytorch domain library for recommendation systems

cuda deep-learning gpu pytorch recommendation-system recommender-system sharding

Last synced: 12 May 2025

https://github.com/mycatapache/mycat2

MySQL Proxy using Java NIO based on Sharding SQL,Calcite ,simple and fast

async calcite java jdbc joinclustering mariadb mgr mha mycat mysql nio proxy rxjava server sharding slice sql transcation vertx xa

Last synced: 15 May 2025

https://github.com/MyCatApache/MyCat2

MySQL Proxy using Java NIO based on Sharding SQL,Calcite ,simple and fast

async calcite java jdbc joinclustering mariadb mgr mha mycat mysql nio proxy rxjava server sharding slice sql transcation vertx xa

Last synced: 28 Mar 2025

https://github.com/session-replay-tools/cetus

Cetus is high-performance middleware designed to provide transparent routing between your application and backend MySQL servers.

database distributed horizontal-scalable middleware mysql mysql-proxy performance scaling sharding xa

Last synced: 14 May 2025

https://github.com/dotnetcore/sharding-core

high performance lightweight solution for efcore sharding table and sharding database support read-write-separation .一款ef-core下高性能、轻量级针对分表分库读写分离的解决方案，具有零依赖、零学习成本、零业务代码入侵

efcore entity-framework-core orm read-write-separation sharding

Last synced: 13 May 2025

https://github.com/actiontech/dble

A High Scalability Middle-ware for MySQL Sharding

dble distributed-database mysql mysql-sharding sharding

Last synced: 14 May 2025

https://github.com/pg-sharding/spqr

Stateless Postgres Query Router.

go pooler postgresql proxy sharding

Last synced: 31 Mar 2025

https://github.com/jfaster/mango

Distributed ORM Framework for Java

java mango orm-framework sharding

Last synced: 30 Dec 2025

https://github.com/netease-im/camellia

Camellia provide easy-to-use server toolkits, such as: redis proxy、delay queue、id gen、hot key and more

daocache dbcache delay-queue delayqueue double-write hot-key hotkey id-gen idgen idgenerator netty4 read-write-splitting redis redis-cluster-proxy redis-proxy redis-sentinel redisproxy sharding

Last synced: 14 May 2025

https://github.com/gojek/weaver

An Advanced HTTP Reverse Proxy with Dynamic Sharding Strategies

go golang layer7 proxy proxy-server sharding

Last synced: 04 Apr 2025

https://github.com/tnicola/cypress-parallel

Reduce up to 40% your Cypress suite execution time parallelizing the test run on the same machine.

cypress localhost parallel shard sharding

Last synced: 29 Apr 2025

https://github.com/pgdogdev/pgdog

Horizontal scaling for PostgreSQL with automatic sharding.

load-balancer pooler postgresql rust sharding

Last synced: 06 Apr 2025

https://github.com/dromara/easy-query

java/kotlin high performance lightweight solution for jdbc query,support oltp and olap query,一款java下面支持强类型、轻量级、高性能的ORM,致力于解决jdbc查询,拥有对象模型筛选、隐式子查询、隐式join

java jdbc join kotlin mysql orm sharding

Last synced: 21 Feb 2025

https://github.com/ahoo-wang/cosid

Universal, flexible, high-performance distributed ID generator. | 通用、灵活、高性能的分布式 ID 生成器

clock clock-synchronization cloud-native distributed generator gradle id id-generator idgenerator java k8s kubernetes microservice redis sharding snowflake spring spring-boot spring-cloud zookeeper

Last synced: 15 May 2025

https://github.com/Ahoo-Wang/CosId

Universal, flexible, high-performance distributed ID generator. | 通用、灵活、高性能的分布式 ID 生成器

clock clock-synchronization cloud-native distributed generator gradle id id-generator idgenerator java k8s kubernetes microservice redis sharding snowflake spring spring-boot spring-cloud zookeeper

Last synced: 16 Apr 2025

https://github.com/ethereum/sharding

Sharding manager contract, and related software and tests

ethereum python sharding vyper

Last synced: 30 Oct 2025

https://github.com/lambdalabsml/distributed-training-guide

Best practices & guides on how to write distributed pytorch training code

cluster cuda deepspeed distributed-training fsdp gpu gpu-cluster kuberentes lambdalabs mpi nccl pytorch sharding slurm

Last synced: 16 May 2025

https://github.com/devsisters/shardcake

Sharding and location transparency for Scala

actor-model functional-programming messaging scala sharding

Last synced: 15 May 2025

https://github.com/LambdaLabsML/distributed-training-guide

Best practices & guides on how to write distributed pytorch training code

cluster cuda deepspeed distributed-training fsdp gpu gpu-cluster kuberentes lambdalabs mpi nccl pytorch sharding slurm

Last synced: 08 Mar 2025

https://github.com/cabol/shards

Partitioned ETS tables for Erlang and Elixir

elixir erlang ets partitioning sharding

Last synced: 08 Apr 2025

https://github.com/go-gorm/sharding

High performance table sharding plugin for Gorm.

gorm mysql postgresql sharding

Last synced: 08 Apr 2025

https://github.com/drecom/activerecord-turntable

ActiveRecord Sharding Plugin

activerecord rails ruby sharding

Last synced: 25 Mar 2025

https://github.com/bitwalker/libring

A fast consistent hash ring implementation in Elixir

consistent-hashing elixir hash-ring sharding

Last synced: 06 Apr 2025

https://github.com/timebertt/kubernetes-controller-sharding

Horizontally Scalable Kubernetes Controllers: distribute reconciliation of Kubernetes objects across multiple controller instances

controller distributed-systems kubernetes master-studies scalability sharding

Last synced: 05 Apr 2025

https://github.com/qnjr-group/sharding-method

分表分库的新思路——服务层Sharding框架，全SQL、全数据库兼容，ACID特性与原生数据库一致，能实现RR级别读写分离，无SQL解析性能更高

db2 mariadb mysql oracle sharding sharding-jdbc sqlserver

Last synced: 21 Aug 2025

https://github.com/QNJR-GROUP/sharding-method

分表分库的新思路——服务层Sharding框架，全SQL、全数据库兼容，ACID特性与原生数据库一致，能实现RR级别读写分离，无SQL解析性能更高

db2 mariadb mysql oracle sharding sharding-jdbc sqlserver

Last synced: 04 May 2025

https://github.com/smira/redis-resharding-proxy

Redis Resharding Proxy

go redis sharding

Last synced: 29 Jul 2025

https://github.com/ton-blockchain/stablecoin-contract

Sample code for centralised stablecoin jetton. TEP-74 and TEP-89 compatible

sharding stablecoin ton

Last synced: 13 Apr 2025

https://github.com/copperbits/TON

Telegram Open Network research group. Telegram: https://t.me/ton_research

blockchain research sharding telegram ton tutorial

Last synced: 06 May 2025

https://github.com/OpenST/mosaic-contracts

Mosaic-0: Gateways and anchors on top of Ethereum to scale DApps

blockchain ethereum metablockchain mosaic openst-protocol ost sharding simpletoken

Last synced: 31 Mar 2025

https://github.com/salimane/redis-tools

my tools working with redis

cluster copy protocol redis sharding

Last synced: 10 Apr 2025

https://github.com/neo4j/trillion-graph

A scale demo of Neo4j Fabric spanning up to 1129 machines/shards running a 100TB (LDBC) dataset with 1.2tn nodes and relationships.

demo graph-database neo4j scale scale-out sharding

Last synced: 06 Apr 2025

https://github.com/levkk/pgdog

Automatic sharding for PostgreSQL.

load-balancer pooler postgresql proxy rust sharding

Last synced: 20 Feb 2025

https://github.com/samber/hot

🌶️ In-memory caching library for read-intensive Go applications

2q arc cache chain concurrency expiration generics go golang in-memory jitter lfu loader lru performance sharding ttl

Last synced: 09 Apr 2025

https://github.com/cookpad/mixed_gauge

A simple and robust database sharding with ActiveRecord.

activerecord database-sharding hash-slots rails sharding

Last synced: 08 Oct 2025

https://github.com/chainspace/chainspace-prototype

Chainspace is a distributed ledger platform for high-integrity and transparent processing of transactions within a decentralized system.

blockchain consensus decentralization sharding

Last synced: 11 Apr 2025

https://github.com/naver/rye

RYE, Native Sharding RDBMS

database native-sharding-rdbms newsql sharding

Last synced: 14 May 2025

https://github.com/pchalamet/fbus

small and lean .net service-bus

rabbitmq scaleout servicebus sharding testable worker

Last synced: 10 Oct 2025

https://github.com/hsgubert/rails-sharding

Simple and robust sharding for Rails, including Migrations and ActiveRecord extensions

activerecord ruby-on-rails shard-databases sharding shards

Last synced: 14 Apr 2025

https://github.com/danclay/eris-fleet

Cluster management for Discord bots using the Eris library.

bot clustering discord eris nodejs sharding

Last synced: 21 Jul 2025

https://github.com/leodutra/simpleflakes

Fast and test-driven distributed 64-bit ID generation, using pure JavaScript, for Node.js.

generator guid microservices sharding uid

Last synced: 13 Apr 2025

https://github.com/shipgirlproject/indomitable

A lightweight (the actual ship is heavy though), performant, & powerful sharder for Discord.JS

cluster clustering discord discordjs fast lightweight shard sharding

Last synced: 29 Oct 2025

https://github.com/timebertt/thesis-controller-sharding

Towards Horizontally Scalable Kubernetes Controllers (Study Project)

controller distributed-systems kubernetes master-studies scalability sharding thesis

Last synced: 21 Mar 2025

https://github.com/chainbound/shardmap

A performant, highly concurrent and simple sharded hashmap implementation using generics

cache concurrency generics golang high-performance low-latency map sharding

Last synced: 06 Sep 2025

https://github.com/brussell98/megane

A framework for large multi-process Discord bots

bot clusters discord eris ipc sharding worker

Last synced: 14 Apr 2025

https://github.com/shargri-la/shargri-la

A transaction-level sharding simulator for protocol testing against users' behavior on a sharded blockchain.

blockchain ethereum sharding

Last synced: 29 Apr 2025

https://github.com/jaimerc/mongodb-university-courses

Courseware and solutions of problems from MongoDB University's classes that I've attended.

javascript mongodb nodejs replica-set sharding shell

Last synced: 29 Jun 2025

https://github.com/wednesday-solutions/node-mongo-express

An enterprise Mongo-Express REST API built using nodejs showcasing - Testing Strategy, mongoDB sharding, models, a REST API Interface, support for Redis, aggregation queries, aggregation caching, circuit-breakers, slack integration, RBAC, rate limited APIs and multi-container queues and schedulers.

authorization circuitbreaker express mongodb mongoose node-api node-i18n node-mongo-api node-mongo-express node-mongo-express-api nodejs oauth2 rbac rest-api sharding

Last synced: 13 Apr 2025

https://github.com/xuejmnet/ncdc

sharding-connector is dotnet sharding proxy framework based on ado.net

sharding sharding-adonet sharding-connector sharding-efcore sharding-jdbc sharding-orm shardingsphere

Last synced: 03 Jul 2025

https://github.com/adammck/ranger

Generic range-based sharding prototype

distributed-systems sharding

Last synced: 07 May 2025

https://github.com/kaymekaydex/go-vshard-router

go vshard-router implementation for tarantool

go no-sql sharding tarantool vshard

Last synced: 12 Aug 2025

https://github.com/shipgirlproject/azuma

A package that actually syncs your ratelimits across all your clusters on Discord.JS

bot discord discord-bot discord-js discord-ratelimits discordjs nodejs ratelimits sharding

Last synced: 27 Apr 2025

https://github.com/toozwu/TONBUS

Telegram Open Network（TON）中文社区。Telegram 群组：https://t.me/ton_china

bitcoin blockchain sharding telegram ton

Last synced: 11 Mar 2025

https://github.com/mssrinivas/coffeewithcloudyspartans

Developed an Online Coffee Store application using Mongo, Express, React, Node (MERN) and Go. Hosted the data service API modules developed in Go as microservices using Kubernetes. Aim is to demonstrate right use the cloud technologies following industry standards in terms of security, scalability and efficiency.

api aws cloud-computing distributed-systems docker expressjs golang heroku jwt-authentication mern-stack microservices-architecture mongodb nodejs nosql-database reactjs replication riak scalability sharding

Last synced: 24 Apr 2025

https://github.com/kibae/typeorm-sharding-repository

TypeORM Sharding Repository: Enables TypeORM to be utilized in a distributed database environment.

decorator distributed distributed-database nodejs rangesharding sharding typeorm typescript

Last synced: 11 Jul 2025

https://github.com/lmxdawn/sharding-spring-boot-mybatis-example

Sharding-Sphere examples 分库分表

sharding sharding-jdbc

Last synced: 15 Apr 2025

https://github.com/fang-yan-peng/badger

轻量级单表操作dao框架，支持分库分表

badger mango mybatis sharding

Last synced: 11 Apr 2025

https://github.com/AntonAleksandrov13/python-redis-tool

Python CLI for Redis Cluster administration

python redis redis-cli redis-cluster redis-sharding sharding

Last synced: 22 Apr 2025

https://github.com/melisadev/melisa

MelisaPy is a cache-optimized Discord microframework for Python 3

aiohttp alternative async asyncio caching clustering discord optimized python sharding websocket

Last synced: 04 Mar 2025

https://github.com/evolution-gaming/sharding-strategy

Custom sharding strategies for akka cluster

akka cluster scala sharding

Last synced: 23 Apr 2025

https://github.com/timebertt/masters-thesis-controller-sharding

Horizontally Scalable Kubernetes Controllers (Master's Thesis)

controller distributed-systems kubernetes master-studies scalability sharding thesis

Last synced: 27 Oct 2025

https://github.com/studyzy/shardingdb

LevelDB support sharding and concurrent writes

golang goleveldb leveldb sharding sharding-db

Last synced: 18 Sep 2025

https://github.com/enriquefynn/ethereum-partitioning-experiments

Experiments on sharding ethereum

datamining ethereum sharding

Last synced: 23 Oct 2025

https://github.com/cclient/sequelize-sharding

通过sequelize的hooks模块，更改读写前的table_name，实现类似spring AOP的分表读写，sequelize Model hooks for sharded-table that like [tablename]_yyyy_mm...

sequelize sequelize-model-hooks sharding

Last synced: 26 Jun 2025

https://github.com/Drops-of-Diamond/Drops-of-Diamond-history-outdated

History on an implementation of sharding and statelessness

ethereum ethereum-virtual-machine evm ewasm sharding vm web-assembly

Last synced: 11 Mar 2025

https://github.com/arkatufus/akka.cluster.sharding-kubernetes-scaling

Kubernetes horizontal pod auto scaling with Akka.NET cluster sharding

akka-cluster autoscaler k8s kubernetes sharding

Last synced: 13 Aug 2025

https://github.com/neo4j-examples/neo4j-fabric-examples

Set of resources for the real time detection of fraud with Neo4j Fabric across shards, use case transaction structuring aka smurfing

fabric financial fraud-prevention neo4j sharding

Last synced: 15 Sep 2025

https://github.com/magestacks/shardingsphere-example

⚡️ ShardingSphere 示例项目，覆盖 4.1.1 以及即将发布的 5.0 版本，示例功能包括数据加密、影子库、分库分表等，主要提供版本回溯

encrypt shadow sharding shardingsphere

Last synced: 05 Jul 2025

https://github.com/alibaba/kube-sharding

Automated deployment of large-scale sharding services on kubernetes.

k8s kube-sharding kubernetes shard sharding

Last synced: 03 Oct 2025

https://github.com/ev2900/opensearch_index_shard_size

Example covering ideal shard size + how to adjust # of primary, replicate shards for an index

aws opensearch performance-tuning reindex sharding

Last synced: 06 Apr 2025

https://github.com/zengfr/datasource-spring-boot-starter

datasource-spring-boot-starter. AbstractRoutingDataSource dynamic datasource for springboot,Multiple &Routing&Sharding&RW&Master Slave

abstractroutingdatasource datasource dynamic dynamic-datasource multiple sharding shards spring springboot zengfr

Last synced: 10 Jul 2025

https://github.com/dyxushuai/grpclb

grpclb implemention based on ketama and distributed k/v store

consistent-hashing etcd grpclb service-discovery sharding

Last synced: 24 Mar 2025

https://github.com/thewtex/shardedstore

Provides a sharded Zarr store

python sharding zarr

Last synced: 14 Apr 2025

https://github.com/clickup/pg-microsharding

Support for microshards on top of PostgreSQL schemas with cross-nodes rebalancing

microshards postgresql sharding

Last synced: 05 Mar 2025