Projects in Awesome Lists tagged with streaming-algorithms

https://github.com/johnkerl/miller

Miller is like awk, sed, cut, join, and sort for name-indexed data such as CSV, TSV, and tabular JSON

command-line command-line-tools csv csv-format data-cleaning data-processing data-reduction data-regression devops devops-tools json json-data miller statistical-analysis statistics streaming-algorithms streaming-data tabular-data tsv unix-toolkit

Last synced: 21 Feb 2026

https://github.com/waikato/moa

MOA is an open source framework for Big Data stream mining. It includes a collection of machine learning algorithms (classification, regression, clustering, outlier detection, concept drift detection and recommender systems) and tools for evaluation.

clustering data-stream-mining java machine-learning machine-learning-algorithms moa streaming-algorithms

Last synced: 15 May 2025

https://github.com/Waikato/moa

MOA is an open source framework for Big Data stream mining. It includes a collection of machine learning algorithms (classification, regression, clustering, outlier detection, concept drift detection and recommender systems) and tools for evaluation.

clustering data-stream-mining java machine-learning machine-learning-algorithms moa streaming-algorithms

Last synced: 05 Mar 2025

https://github.com/ast-al/rangeless

c++ LINQ -like library of higher-order functions for data manipulation

cpp cpp11 functional functional-programming itertools lazy-evaluation linq parallel pipeline range streaming-algorithms streaming-data

Last synced: 08 May 2025

https://github.com/dynatrace-oss/hash4j

Dynatrace hash library for Java

cardinality-estimation consistent-hashing data-sketches farmhash hash hash-algorithm hash-functions hashing-algorithm hyperloglog imohash java jumphash minhash murmur3 non-cryptographic-hash-functions simhash streaming-algorithms superminhash wyhash xxh3

Last synced: 13 Apr 2025

https://github.com/alecmocatta/streaming_algorithms

Performant implementations of various streaming algorithms, including Count–min sketch, Top k, HyperLogLog, Reservoir sampling.

data-structures hyperloglog probabilistic-data-structures rust streaming-algorithms

Last synced: 09 Apr 2025

https://github.com/bcgsc/ntcard

Estimating k-mer coverage histogram of genomics data

cardinality-estimation hyperloglog k-mer-counting k-mer-frequency streaming-algorithms

Last synced: 09 Jul 2025

https://github.com/usmanm/redis-tdigest

t-digest module for Redis

percentile quantile redis redis-module redis-tdigest streaming-algorithms tdigest

Last synced: 07 Mar 2026

https://github.com/laurentrdc/npstreams

Streaming operations on NumPy arrays

numpy python3 streaming-algorithms

Last synced: 10 Apr 2025

https://github.com/bmoscon/streamingalgorithms

A Set of Streaming Algorithms in C++, Python, and Go

c-plus-plus cpp go golang python streaming-algorithms

Last synced: 30 Apr 2025

https://github.com/bmoscon/StreamingAlgorithms

A Set of Streaming Algorithms in C++, Python, and Go

c-plus-plus cpp go golang python streaming-algorithms

Last synced: 06 May 2025

https://github.com/alexander-yu/stream

An online statistics library, written in Go

data-structures go golang online-algorithms statistics stats streaming-algorithms

Last synced: 14 Jan 2026

https://github.com/mikejareds/hermiter

Efficient Sequential and Batch Estimation of Univariate and Bivariate Probability Density Functions and Cumulative Distribution Functions along with Quantiles (Univariate) and Nonparametric Correlation (Bivariate)

cumulative-distribution-function kendall-correlation-coefficient online-algorithms probability-density-function quantile spearman-correlation-coefficient statistics streaming-algorithms streaming-data

Last synced: 22 Oct 2025

https://github.com/MikeJaredS/hermiter

Efficient Sequential and Batch Estimation of Univariate and Bivariate Probability Density Functions and Cumulative Distribution Functions along with Quantiles (Univariate) and Nonparametric Correlation (Bivariate)

cumulative-distribution-function kendall-correlation-coefficient online-algorithms probability-density-function quantile spearman-correlation-coefficient statistics streaming-algorithms streaming-data

Last synced: 13 Jul 2025

https://github.com/jlumbroso/python-random-hash

A simple, time-tested, family of random hash functions in Python, based on CRC32 and xxHash, affine transformations, and the Mersenne Twister. 🎲

analysis-of-algorithms analytic-combinatorics data-streaming flajolet flajolet-martin hash-functions hyperloglog python randomized-algorithm streaming-algorithms

Last synced: 26 Jul 2025

https://github.com/sjorek/mediacastsegmenter

Create MPEG2-TS encapsulated stream-segments.

c http mpeg2 streaming streaming-algorithms streaming-video

Last synced: 30 Apr 2025

https://github.com/CHSZLab/CHSZLabLib

Python Frontend to Algorithms of the Algorithm Engineering Group Heidelberg

combinatorial-optimization community-detection dynamic-graphs edge-orientation graph-algorithms graph-partitioning hpc hypergraph independent-set minimum-cut process-mapping pybind11 python streaming-algorithms

Last synced: 07 May 2026

https://github.com/SebastianSchmidl/pyonlinesvr

Python-Wrapper for Francesco Parrella's OnlineSVR C++ implementation with scikit-learn-compatible interface.

cpp machine-learning numpy online onlinesvr python python3 scikit-learn streaming-algorithms svr

Last synced: 26 Oct 2025

https://github.com/statsim/preview

Preview large text files online

streaming-algorithms webapp

Last synced: 26 Feb 2026

https://github.com/logannye/emsqrt

Process any data size with a fixed, small memory footprint. EM-√ is an external-memory ETL/log processing engine with hard peak-RAM guarantees. Unlike traditional systems that "try" to stay within memory limits, EM-√ enforces a strict memory cap, enabling you to process arbitrarily large datasets using small memory footprints.

big-data big-data-analytics cloud cloud-computing edge-ai edge-computing efficiency efficient-algorithm memory-allocation rust streaming streaming-algorithms streaming-data