Projects in Awesome Lists tagged with hyperloglog

https://github.com/ekzhu/datasketch

MinHash, LSH, LSH Forest, Weighted MinHash, HyperLogLog, HyperLogLog++, LSH Ensemble and HNSW

data-sketches data-summary hnsw hyperloglog jaccard-similarity locality-sensitive-hashing lsh lsh-ensemble lsh-forest minhash python search top-k weighted-quantiles

Last synced: 13 May 2025

https://github.com/axiomhq/hyperloglog

HyperLogLog with lots of sugar (Sparse, LogLog-Beta bias correction and TailCut space reduction) brought to you by Axiom

axiom data-structures go golang hyperloglog

Last synced: 15 Dec 2025

https://github.com/Callidon/bloom-filters

JS implementation of probabilistic data structures: Bloom Filter (and its derived), HyperLogLog, Count-Min Sketch, Top-K and MinHash

bloom-filter count-min-sketch cuckoo-filter hyperloglog invertible-bloom-filter javascript minhash probabilistic topk

Last synced: 25 Mar 2025

https://github.com/fcambus/logswan

Fast Web log analyzer using probabilistic data structures

analyzer hyperloglog log web

Last synced: 16 May 2025

https://github.com/axiomhq/hyperminhash

HyperMinHash: Bringing intersections to HyperLogLog

estimation hyperloglog

Last synced: 06 May 2025

https://github.com/thepirat000/cachingframework.redis

Distributed caching based on StackExchange.Redis and Redis. Includes support for tagging and is cluster-compatible.

cache geospatial hyperloglog keyspace-notifications-api lexicographical netcore pubsub redis redis-api redis-client redis-cluster redis-command serialization tagging ttl ttl-cache

Last synced: 16 May 2025

https://github.com/thepirat000/CachingFramework.Redis

Distributed caching based on StackExchange.Redis and Redis. Includes support for tagging and is cluster-compatible.

cache geospatial hyperloglog keyspace-notifications-api lexicographical netcore pubsub redis redis-api redis-client redis-cluster redis-command serialization tagging ttl ttl-cache

Last synced: 04 May 2025

https://github.com/dnbaker/dashing

Fast and accurate genomic distances using HyperLogLog

hyperloglog indexing metagenomics sketch-data-structures

Last synced: 31 Jul 2025

https://github.com/dnbaker/sketch

C++ Implementations of sketch data structures with SIMD Parallelism, including Python bindings

bloom-filter count-min-sketch hll hyperloglog minhash sketch-data-structures

Last synced: 18 Jul 2025

https://github.com/bigmlcom/sketchy

Sketching Algorithms for Clojure (bloom filter, min-hash, hyper-loglog, count-min sketch)

bloom-filter clojure count-min-sketch hashing hyperloglog minhash sketching

Last synced: 14 Apr 2025

https://github.com/dynatrace-oss/hash4j

Dynatrace hash library for Java

cardinality-estimation consistent-hashing data-sketches farmhash hash hash-algorithm hash-functions hashing-algorithm hyperloglog imohash java jumphash minhash murmur3 non-cryptographic-hash-functions simhash streaming-algorithms superminhash wyhash xxh3

Last synced: 13 Apr 2025

https://github.com/alecmocatta/streaming_algorithms

Performant implementations of various streaming algorithms, including Count–min sketch, Top k, HyperLogLog, Reservoir sampling.

data-structures hyperloglog probabilistic-data-structures rust streaming-algorithms

Last synced: 09 Apr 2025

https://github.com/bcgsc/ntcard

Estimating k-mer coverage histogram of genomics data

cardinality-estimation hyperloglog k-mer-counting k-mer-frequency streaming-algorithms

Last synced: 09 Jul 2025

https://github.com/oertl/hyperloglog-sketch-estimation-paper

Paper about the estimation of cardinalities from HyperLogLog sketches

cardinality-estimation data-sketches hyperloglog hyperloglog-sketches sketch-data-structures

Last synced: 04 Oct 2025

https://github.com/retailnext/hllpp

HyperLogLog cardinality estimation algorithm in go/golang!

awesome dinosaur go golang hyperloglog

Last synced: 11 May 2025

https://github.com/LiveRamp/HyperMinHash-java

Union, intersection, and set cardinality in loglog space

cardinality cardinality-estimation hyperloglog hyperloglog-sketches java loglog loglog-beta minhash

Last synced: 27 Mar 2025

https://github.com/jedisct1/rust-hyperloglog

A HyperLogLog implementation in Rust.

hyperloglog rust sketching

Last synced: 04 Apr 2025

https://github.com/andy2046/gopie

go patterns

barrier bloom-filter consistent-hashing count-min-sketch drf golang hyperloglog lru patterns pubsub semaphore singleton skiplist subsetting

Last synced: 13 Apr 2025

https://github.com/nidorx/sqlog

SQLog - Connecting the dots

bloom-filter golang hyperloglog logging lsm-tree observability sqlite

Last synced: 07 Sep 2025

https://github.com/sasha-s/go-hll

HyperLogLog in golang

golang hll hyperloglog

Last synced: 10 Apr 2025

https://github.com/davidesantangelo/hyll

A Ruby implementation of the HyperLogLog algorithm for efficient cardinality estimation with minimal memory footprint. Count millions of distinct elements using only kilobytes of memory.

alghoritms counting-distinct-elements hyperloglog presto ruby

Last synced: 12 May 2025

https://github.com/shabbyrobe/phphll

HyperLogLog for PHP implemented as a C extension

hyperloglog php php-extension

Last synced: 18 Dec 2025

https://github.com/matoous/visigo

Unique site visits counter in Go

golang hyperloglog middleware unique-visitors

Last synced: 10 Sep 2025

https://github.com/cloudflare/cardinality-estimator

A crate for estimating the cardinality of distinct elements in a stream or dataset.

cardinality-estimation distinct-elements hyperloglog probalistic-data-structures sketches

Last synced: 20 Oct 2025

https://github.com/simonprickett/python-probabilistic-data-structures

Exploring Probabilistic Data Structures in Python - my 2021 Pycon USA and Australia and Pycon MEA 2022 talk.

bloom-filter hyperloglog probabilistic-data-structures pycon python redis

Last synced: 25 Mar 2025

https://github.com/ankane/datasketches-ruby

Sketch data structures for Ruby

hyperloglog

Last synced: 17 Nov 2025

https://github.com/jlumbroso/python-random-hash

A simple, time-tested, family of random hash functions in Python, based on CRC32 and xxHash, affine transformations, and the Mersenne Twister. 🎲

analysis-of-algorithms analytic-combinatorics data-streaming flajolet flajolet-martin hash-functions hyperloglog python randomized-algorithm streaming-algorithms

Last synced: 26 Jul 2025

https://github.com/jlumbroso/java-random-hash

A simple, time-tested, family of random hash functions in Java, based on CRC32, affine transformations, and the Mersenne Twister. 🎲

data-streaming flajolet flajolet-martin hash-functions hyperloglog java

Last synced: 26 Jul 2025

https://github.com/gyson/hll

Redis compatible HyperLogLog implementation in Elixir

elixir erlang hyperloglog redis

Last synced: 26 Oct 2025

https://github.com/mtchavez/go-hll

Go implementation of Hyper Log Log

go golang hyperloglog sketching-algorithm

Last synced: 12 Apr 2025

https://github.com/narasimha1997/bit_vector

A header-only bit vector library for C . This can be used for implementing dynamic bit-vectors for building Bloom-Filters and Hyper-Logs .

bloom-filter c cplusplus datastructures hashtable hyperloglog

Last synced: 12 Apr 2025

https://github.com/sangupta/dry-redis

In-memory Pure Java implementation to Redis useful for unit testing

geo hyperloglog in-memory java redis

Last synced: 22 Aug 2025

https://github.com/redis-developer/redisbloom-moby-dick

Experiments with RedisBloom and the text from Moby Dick

bloom-filter hyperloglog node-redis nodejs redis redis-stack

Last synced: 12 Apr 2025

https://github.com/calvinlfer/streaming-analytics

A streaming data pipeline to perform basic analytics with scalability in mind

akka-http akka-streams cassandra hyperloglog kafka scala

Last synced: 25 Feb 2025

https://github.com/mbrg/py-hyperminhash

HyperLogLog with intersection

estimation hyperloglog minhash

Last synced: 29 Jun 2025

https://github.com/vislee/lua-resty-hyperloglog

Hyperloglog for openresty.

hll hyperloglog lua-resty

Last synced: 16 Jan 2026

https://github.com/jsiqbal/redis

Complete redis course by stephen grider

hyperloglog redis redis-hash redis-sets redis-string session sort sorted-sets sveltkit

Last synced: 10 Apr 2025

https://github.com/sundy-li/simple_hll

A simple HyperLogLog implementation in rust

cardinality database hyperloglog

Last synced: 25 Apr 2025

https://github.com/shuvava/mssql-hll

HyperLogLog implementation for mssql

hyperloglog mssql t-sql

Last synced: 18 Oct 2025

https://github.com/liangyaopei/hyper

Thread safe, concurrent used hyperloglog implemented in Golang, using murmur v3 hash function

algorithms algorithms-and-data-structures data-structures golang hyperloglog

Last synced: 25 Jan 2026

https://github.com/danchen6/pfutil

Fast and Redis-compatible HyperLogLog extension for Python 3

hyperloglog python redis

Last synced: 19 Jul 2025

https://github.com/guysmoilov/streaming-hll

Extension to Clearspring impl. of HLL++, which allows merging directly from a stream

hyperloglog

Last synced: 30 Oct 2025

https://github.com/matejamaric/kafka-go-cardinality

Estimating cardinality for a data stream using Go and Apache Kafka

cardinality cardinality-estimation go golang hyperloglog kafka streams

Last synced: 02 Jan 2026

https://github.com/phungvandat/calculate-ccu

Example calculate current ccu

batch-processing ccu golang hyperloglog redis

Last synced: 07 Oct 2025

https://github.com/knightchaser/hyperloglog

A simple Python implementation of the HyperLogLog algorithm, a probabilistic data structure used for estimating the cardinality of a set.

hyperloglog math probability

Last synced: 15 Jun 2025

https://github.com/soumyadip007/redis-endpoint-storage-application-using-spring-boot-rest-and-microservices

Redis is an in-memory data structure project implementing a distributed, in-memory key-value database with optional durability. Redis supports different kinds of abstract data structures, such as strings, lists, maps, sets, sorted sets, HyperLogLogs, bitmaps, streams, and spatial indexes.

bitmaps cache cloud distributed-systems hyperloglog in-memory-caching in-memory-database java microservices redis rest spatial-index spring-boot streams

Last synced: 24 Feb 2025

https://github.com/influxdata/hll-check

A small tool for comparing HLL/HLL++ implementations

hyperloglog influxdb testing

Last synced: 30 Nov 2025

https://github.com/rohra-mehak/scala-projects

bloom-filter currying dgim hyperloglog oop-principles scala

Last synced: 16 Jun 2025

https://github.com/devarshpatel1506/real-time-student-attendance-system

A production-style, real-time attendance pipeline using Apache Pulsar, Redis Bloom and HyperLogLog, Apache Cassandra, and Python.

apache-cassandra apache-pulsar big-data data-engineering data-pipeline hyperloglog python redis-bloomfilter

Last synced: 05 Oct 2025

https://github.com/danvratil/zetasketch-rs

Rust port of the Google Zetasketch library

google hyperloglog hyperloglog-sketches hyperloglogplus rust zetasketch

Last synced: 10 Aug 2025

https://github.com/20101301-alina-hasan/parallel-hyperloglog-cardinality-estimation

A Python project demonstrating efficient estimation of unique elements in any dataset using the HyperLogLog algorithm with parallel processing. In this example, we apply the method to a transactional dataset, showcasing data cleaning, visualization, and performance comparisons for scalable cardinality estimation.

cardinality-estimation hyperloglog multiprocessing parallel-computing performance-optimization python transactional-data