Projects in Awesome Lists tagged with minhash
A curated list of projects in awesome lists tagged with minhash .
https://github.com/ekzhu/datasketch
MinHash, LSH, LSH Forest, Weighted MinHash, HyperLogLog, HyperLogLog++, LSH Ensemble and HNSW
data-sketches data-summary hnsw hyperloglog jaccard-similarity locality-sensitive-hashing lsh lsh-ensemble lsh-forest minhash python search top-k weighted-quantiles
Last synced: 13 May 2025
https://github.com/sourmash-bio/sourmash
Quickly search, compare, and analyze genomic and metagenomic data sets.
bioinformatics fracminhash hacktoberfest kmer minhash python rust scaled-minhash sketching sourmash taxonomic-classification taxonomic-profiling
Last synced: 21 Oct 2025
https://github.com/Callidon/bloom-filters
JS implementation of probabilistic data structures: Bloom Filter (and its derived), HyperLogLog, Count-Min Sketch, Top-K and MinHash
bloom-filter count-min-sketch cuckoo-filter hyperloglog invertible-bloom-filter javascript minhash probabilistic topk
Last synced: 25 Mar 2025
https://github.com/dnbaker/sketch
C++ Implementations of sketch data structures with SIMD Parallelism, including Python bindings
bloom-filter count-min-sketch hll hyperloglog minhash sketch-data-structures
Last synced: 18 Jul 2025
https://github.com/bigmlcom/sketchy
Sketching Algorithms for Clojure (bloom filter, min-hash, hyper-loglog, count-min sketch)
bloom-filter clojure count-min-sketch hashing hyperloglog minhash sketching
Last synced: 14 Apr 2025
https://github.com/src-d/minhashcuda
Weighted MinHash implementation on CUDA (multi-gpu).
cuda lsh machine-learning minhash
Last synced: 09 Apr 2025
https://github.com/YaleDHLab/intertext
Detect and visualize text reuse
data-visualization minhash text-mining web-app
Last synced: 09 Jul 2025
https://github.com/dynatrace-oss/hash4j
Dynatrace hash library for Java
cardinality-estimation consistent-hashing data-sketches farmhash hash hash-algorithm hash-functions hashing-algorithm hyperloglog imohash java jumphash minhash murmur3 non-cryptographic-hash-functions simhash streaming-algorithms superminhash wyhash xxh3
Last synced: 13 Apr 2025
https://github.com/serega/gaoya
Locality Sensitive Hashing
locality-sensitive-hashing lsh minhash search simhash similarity
Last synced: 17 Mar 2026
https://github.com/will-rowe/groot
A resistome profiler for Graphing Resistance Out Of meTagenomes
alignment antibiotic-resistance lsh metagenomics minhash resistome
Last synced: 01 Feb 2026
https://github.com/codelibs/elasticsearch-minhash
Elasticsearch plugin for b-bit minhash algorism
elasticsearch elasticsearch-plugin minhash
Last synced: 27 Aug 2025
https://github.com/andrewmcloud/consimilo
A Clojure library for querying large data-sets on similarity
clojure collaborative-filtering cosine-distance data-sketches data-sketching document-similarity hamming-distance jaccard-similarity lsh lsh-forest minhash minhash-lsh-algorithm plagiarism-detection recommender-system similarity similarity-search
Last synced: 14 Apr 2025
https://github.com/LiveRamp/HyperMinHash-java
Union, intersection, and set cardinality in loglog space
cardinality cardinality-estimation hyperloglog hyperloglog-sketches java loglog loglog-beta minhash
Last synced: 27 Mar 2025
https://github.com/duhaime/minhash
Quickly estimate the similarity between many sets
locality-sensitive-hashing lsh minhash text-mining
Last synced: 12 Apr 2025
https://github.com/edawson/rkmh
Classify sequencing reads using MinHash.
bioinformatics kmer minhash mutations nanopore openmp
Last synced: 24 Apr 2025
https://github.com/esteinig/sketchy
Genomic neighbor typing of bacterial pathogens using MinHash :rat:
bacterial-genomes bioinformatics finch genomic-neighbor-typing mash minhash nanopore rust-lang
Last synced: 10 Apr 2025
https://github.com/oertl/probminhash
ProbMinHash – A Class of Locality-Sensitive Hash Algorithms for the (Probability) Jaccard Similarity
jaccard-similarity jaccard-similarity-estimation locality-sensitive-hashing lsh-algorithm minhash minhash-sketches similarity sketch
Last synced: 23 Sep 2025
https://github.com/dselivanov/lshr
Locality Sensitive Hashing In R
approximate-nearest-neighbor-search locality-sensitive-hashing minhash random-projections
Last synced: 14 Apr 2025
https://github.com/codelibs/minhash
This provides tools for b-bit MinHash algorism.
Last synced: 30 Apr 2025
https://github.com/oertl/bagminhash
BagMinHash - Minwise Hashing Algorithm for Weighted Sets
jaccard-similarity jaccard-similarity-estimation locality-sensitive-hashing minhash minwise-hashing minwise-hashing-algorithm weighted-sets
Last synced: 12 Jul 2025
https://github.com/cheng-lin-li/spark
There are Python 2.7 codes and learning notes for Spark 2.1.1
als alternating-least-squares apriori-algorithm apriori-son cosine-similarity kmeans kmeans-clustering map-reduce minhash minhash-lsh-algorithm python27 savasere-omiecinski-and-navathe spark tf-idf uv-decomposition
Last synced: 19 Feb 2026
https://github.com/edawson/mkmh
Generate kmers/minimizers/hashes/MinHash signatures, including with multiple kmer sizes.
kmer locality-sensitive-hashing minhash
Last synced: 10 Jul 2025
https://github.com/davidsvy/Neural-Scam-Artist
Web Scraping, Document Deduplication & GPT-2 Fine-tuning with a newly created scam dataset.
dataset deduplication fine-tuning fraud gpt2 huggingface lsh minhash nlp pytorch readability scam transformer web-scraping
Last synced: 13 Jul 2025
https://github.com/BlaCkinkGJ/catch-me-if-you-can
plagiarism detector
minhash plagiarism plagiarism-detection python
Last synced: 14 Jul 2025
https://github.com/lgautier/mashing-pumpkins
Minhash and maxhash library in Python, combining flexibility, expressivity, and performance.
dice-similarity jaccard-similarity locality-sensitive-hashing minhash minhash-sketches murmurhash3 python xxhash
Last synced: 23 Apr 2025
https://github.com/sourmash-bio/wort
A database for signatures of public genomic sources
bioinformatics bioinformatics-databases minhash sourmash webservice
Last synced: 05 Mar 2026
https://github.com/oertl/treeminhash
TreeMinHash: Fast Sketching for Weighted Jaccard Similarity Estimation
hash-algorithm jaccard jaccard-coefficient jaccard-distance jaccard-index jaccard-similarity jaccard-similarity-estimation locality-sensitive locality-sensitive-hashing lsh-algorithm minhash minwise-hashing minwise-hashing-algorithm similarity-measures similarity-metric similarity-search sketching sketching-algorithm weighted-sets
Last synced: 13 Apr 2025
https://github.com/ashvardanian/hashevals
Minimalistic Rust toolkit for hash function quality analysis. Tests avalanche effect, differential patterns, and statistical distribution across variable-length n-grams.
benchmark bioinformatics bloom-filter evaluation hash hashing hashmap hashtable minhash nlp smhasher string string-manipulation testing
Last synced: 09 Nov 2025
https://github.com/h4sh5/bcddb
cross-architecture binary comparison database
decompiler lsh minhash retdec reverse-engineering
Last synced: 27 Jul 2025
https://github.com/luizirber/2017-recomb
Poster presented at RECOMB 2017
data-sharing databases decentralized minhash persistent-data-structures sequence-bloom-trees similarity sourmash
Last synced: 05 Apr 2025
https://github.com/shaltielshmid/minhashsharp
A Robust Library in C# for Similarity Estimation
deduplication deduplication-filter lsh lsh-algorithm lsh-implementation minhash statistics
Last synced: 08 Oct 2025
https://github.com/haradama/plasmidpicker
Software to identify plasmid sequence data from metagenome using logistic regression and Minhash
bioinformatics classification contigs fasta logistic-regression metagenome metagenomics minhash plasmids
Last synced: 13 Apr 2025
https://github.com/ppw0/minhash
find similar text files quickly
jaccard-similarity minhash mining-massive-datasets python
Last synced: 18 Jul 2025
https://github.com/mbrg/py-hyperminhash
HyperLogLog with intersection
estimation hyperloglog minhash
Last synced: 29 Jun 2025
https://github.com/haradama/phash
Software to identify known plasmid sequence from metagenomic assembly using Minhash
bioinformatics biology contigs fasta golang metagenome metagenomics minhash plasmid plasmids
Last synced: 05 Mar 2025
https://github.com/davidefiocco/dockerized-elasticsearch-duplicate-finder
Attempt to use MinHash to find duplicates in an Elasticsearch index
duplicates elasticsearch minhash python
Last synced: 19 May 2026
https://github.com/luozijun/rust-jieba
Rust jieba
hamming-distance hidden-markov-model hmm jaccard jieba minhash mmseg simhash similarity
Last synced: 12 May 2026
https://github.com/sskender/analysis-of-massive-datasets
Analysis of Massive Datasets FER labs
big-data data-flow data-flows frequency-analysis graph-algorithms graph-theory map-reduce mapreduce minhash node-ranking page-rank page-ranking recommendation-system recommender-system simhash similarity-search
Last synced: 18 Aug 2025
https://github.com/dearmadman/minhash
An implementation of the minhash algorithm in golang
Last synced: 27 Mar 2025
https://github.com/shreyansh26/minhash-implemenation
A simple MinHash implementation based on the explanation in the Mining of Massive Datasets course by Stanford
document-similarity minhash minhash-similarity plagiarism-detection
Last synced: 03 Mar 2025
https://github.com/themankindproject/txtfp
Text fingerprinting: MinHash + LSH, SimHash, TLSH, ONNX semantic embeddings (BGE/E5/MiniLM), with byte-stable hash layouts and no_std + alloc default builds.
deduplication embeddings fingerprinting locality-sensitive-hashing lsh minhash near-duplicate no-std onnx rust sdk semantic-search simhash text-processing tlsh wasm
Last synced: 28 May 2026
https://github.com/guenthermi/fast_minh
Python package for fast MinHash calculation and operations
jaccard lsh minhash search similarity
Last synced: 01 Jul 2026
https://github.com/92amartins/minhash-example
MinHash Example
minhash minhash-lsh-algorithm similarity similarity-search
Last synced: 09 Jul 2026
https://github.com/forthoney/doc_sim
Approximate document similarity with Minhash + Locality Sensitive Hashing
document-similarity locality-sensitive-hashing minhash
Last synced: 13 Oct 2025
https://github.com/waerhert/shimmer
Nearby peer discovery through environmental observations
libp2p lsh minhash peer-discovery rendezvous
Last synced: 22 Jun 2026
https://github.com/luis-varona/shadowseek
A CLI tool for near-duplicate detection in text files, written in Rust with no dependencies on runtime environments.
duplicate-detection minhash near-duplicate-detection simhash text-classification
Last synced: 25 Jul 2025
https://github.com/mamiglia/adm-lt_hw1
Homework 1 for the course Advanced Data Mining and Language Technology
Last synced: 10 Aug 2025
