https://github.com/onurakpolat/awesome-bigdata

A curated list of awesome big data frameworks, ressources and other awesomeness.

awesome awesome-list bigdata data data-analytics data-science data-stream data-visualization data-warehouse database distributed-database series-database stream-processing streaming-data visualize-data

Last synced: 22 Mar 2025

https://github.com/strimzi/strimzi-kafka-operator

Apache Kafka® running on Kubernetes

data-stream data-streaming data-streams hacktoberfest kafka kafka-connect kafka-streams kubernetes kubernetes-controller kubernetes-operator messaging openshift

Last synced: 14 May 2025

https://github.com/strimzi/strimzi

Apache Kafka® running on Kubernetes

data-stream data-streaming data-streams hacktoberfest kafka kafka-connect kafka-streams kubernetes kubernetes-controller kubernetes-operator messaging openshift

Last synced: 05 Mar 2025

https://github.com/reugn/go-streams

A lightweight stream processing library for Go

aerospike data-pipeline data-stream etl kafka kafka-streams low-code nats-streaming pipeline pulsar redis stream-processing stream-processor streaming-api streaming-data streams throttling websocket windowing workflow

Last synced: 14 May 2025

https://github.com/tylertreat/boomfilters

Probabilistic data structures for processing continuous, unbounded streams.

bloom-filter count-min-sketch counting-bloom-filters cuckoo-filter data-stream filter go probabilistic-programming scalable-bloom-filters stable-bloom-filters

Last synced: 14 May 2025

https://github.com/tylertreat/BoomFilters

Probabilistic data structures for processing continuous, unbounded streams.

bloom-filter count-min-sketch counting-bloom-filters cuckoo-filter data-stream filter go probabilistic-programming scalable-bloom-filters stable-bloom-filters

Last synced: 14 Mar 2025

https://github.com/openscap/openscap

NIST Certified SCAP 1.2 toolkit

compliance cpe data-stream openscap oval scanning scap xccdf

Last synced: 24 Mar 2025

https://github.com/OpenSCAP/openscap

NIST Certified SCAP 1.2 toolkit

compliance cpe data-stream openscap oval scanning scap xccdf

Last synced: 14 Mar 2025

https://github.com/mentatinnovations/datastream.io

An open-source framework for real-time anomaly detection using Python, ElasticSearch and Kibana

alerts anomaly anomaly-detection anomalydetection anomalydiscovery bokeh-dashboard dashboard data-science data-stream datascience dataset dsio elasticsearch iot jupyter kibana machinelearning python sklearn timeseries

Last synced: 04 Oct 2025

https://github.com/MentatInnovations/datastream.io

An open-source framework for real-time anomaly detection using Python, ElasticSearch and Kibana

alerts anomaly anomaly-detection anomalydetection anomalydiscovery bokeh-dashboard dashboard data-science data-stream datascience dataset dsio elasticsearch iot jupyter kibana machinelearning python sklearn timeseries

Last synced: 14 Mar 2025

https://github.com/vladimirvivien/automi

A stream processing API for Go (alpha)

data-stream go golang stream-processing streaming-api

Last synced: 15 May 2025

https://github.com/ConduitIO/conduit

Conduit streams data between data stores. Kafka Connect replacement. No JVM required.

conduit data-engineering data-integration data-pipeline data-stream etl go kafka kafkaconnect

Last synced: 15 Jul 2025

https://github.com/conduitio/conduit

Conduit streams data between data stores. Kafka Connect replacement. No JVM required.

conduit data-engineering data-integration data-pipeline data-stream etl go kafka kafkaconnect

Last synced: 10 Feb 2026

https://github.com/Spreads/Spreads

Series and Panels for Real-time and Exploratory Analysis of Data Streams

cep data-stream real-time series-manipulation time-series

Last synced: 05 May 2025

https://github.com/scramjetorg/scramjet

Public tracker for Scramjet Cloud Platform, a platform that bring data from many environments together.

data-processing data-space data-stream edge-computing event-stream javascript python raspberry-pi reactive-programming transformations virtual-data-environment

Last synced: 07 Apr 2025

https://github.com/GridProtectionAlliance/openHistorian

The Open Source Time-Series Data Historian

data-mining data-storage data-stream historian time-series

Last synced: 08 Apr 2025

https://github.com/alipsgh/tornado

The Tornado :tornado: framework, designed and implemented for adaptive online learning and data stream mining in Python.

adaptive-learning adwin concept-drift data-stream ddm drift-detection eddm fhddm hddm incremental-learning mddm online-learning

Last synced: 02 Apr 2025

https://github.com/xxxnell/flex

Probabilistic deep learning for data streams.

data-stream functional-programming probability probability-density-function probability-distribution scala statistics

Last synced: 14 Jan 2026

https://github.com/tideland/gocells

Event Based Applications [DEPRECATED]

cep data-analysis data-stream eda event-driven event-processing event-stream go golang library tideland

Last synced: 05 Apr 2025

https://github.com/bakdata/streams-explorer

Explore Apache Kafka data pipelines in Kubernetes.

apache-kafka data-pipelines data-stream hacktoberfest kafka-connect kafka-streams kubernetes python react

Last synced: 10 Apr 2025

https://github.com/scramjetorg/framework-js

Simple yet powerful live data computation framework.

data-stream es6 event-stream javascript nodejs promise react reactive-programming spark-streaming stream stream2 transformations typescript

Last synced: 07 Jul 2025

https://github.com/openfun/ralph

:gear: Ralph, the ultimate Learning Record Store (and more!) for your learning analytics

analytics cli data-stream docker elasticsearch fastapi gelf k8s learning-analytics lrs pydantic python stream-processing xapi

Last synced: 22 Apr 2025

https://github.com/jiowchern/Regulus.Remote

A simple C# network library.

c-sharp csharp data-stream greeter il2cpp netstandard20 network remote-method-invocation socket stride3d unity unity-3d unity3d xenko

Last synced: 06 May 2025

https://github.com/rpj/rpi

RPJiOS: RPJ's RPi OS, a sensor data platform for the Raspberry Pi built with python2.7 and redis.

data-pipeline data-platform data-processing data-stream garden-bots python raspberry-pi redis rpi sensor sensors

Last synced: 12 Apr 2025

https://github.com/green-coder/cdc

A library for performing Content-Defined Chunking (CDC) on data streams.

cdc data-stream rust rust-library

Last synced: 16 Mar 2025

https://github.com/ominibyte/richflow

A Node.js and JavaScript synchronous data pipeline processing, data sharing and stream processing library. Actionable & Transformable Pipeline data processing.

data-flow data-pipeline data-processor data-stream data-transformation flow javascript nodejs pipe-data pipeline-framework streaming-data synchronous

Last synced: 30 Mar 2025

https://github.com/bakdata/quick

The Fastest Way to Create Live Data Products

apache-kafka data-stream graphql kafka-streams rest-api

Last synced: 10 Apr 2025

https://github.com/grebtsew/visualize-realtime-data-stream-chart-in-flask

Automate Visualization of realtime data streams in chart.JS using Flask in python3.

async chartjs data-stream dockerfile flask flask-socketio plotly rtsp socket-server stream video-streaming visualize

Last synced: 15 Apr 2025

https://github.com/correia-jpv/fucking-awesome-bigdata

A curated list of awesome big data frameworks, resources and other awesomeness. With repository stars⭐ and forks🍴

awesome awesome-list bigdata data data-analytics data-science data-stream data-visualization data-warehouse database distributed-database series-database stream-processing streaming-data visualize-data

Last synced: 27 Apr 2025

https://github.com/gustavohfmo/idpso-elm-s

Algorithms proposed in the following paper: OLIVEIRA, Gustavo HFMO et al. Time series forecasting in the presence of concept drift: A pso-based approach. In: 2017 IEEE 29th International Conference on Tools with Artificial Intelligence (ICTAI). IEEE, 2017. p. 239-246.

concept-drift data-stream extreme-learning-machine idpso-elm-s time-series

Last synced: 07 Apr 2025

https://github.com/bilpapster/stream-daq

A highly-configurable, real-time data quality monitoring tool designed for streaming data

data-quality-assessment data-quality-measurement data-quality-monitoring data-stream python-3 real-time stream-mining

Last synced: 08 Oct 2025

https://github.com/mitjafelicijan/nanocloudlogger

Simple cloud based logger for microcontrollers.

arduino cloud data-stream hardware microcontroller sensor

Last synced: 14 May 2025

https://github.com/alexkross/air

Real-time data stream classification and knowledge generation engine with no dependencies

c-language cisco-aci cython data-analysis data-science data-stream devnet fintech ipython jupyter-notebooks knowledge-discovery knowledge-generation-engine knowledge-representation machine-learning pony-language predictive-modeling python real-time

Last synced: 10 Apr 2025

https://github.com/pjechris/cohesionkit

Single source of truth library

combine-framework coredataless data-stream domain-driven-design identifiable identity-map identity-mapper ios live-data live-updates reactive-programming relationship single-source-of-truth source-of-truth storage swift swift-combine swift-package-manager synchronization type-safe

Last synced: 11 Dec 2025

https://github.com/doganulus/reelay-codegen

A code generator from high-level formal specifications for monitoring and pattern matching sequential/temporal data.

code-generation data-stream formal-specification monitoring monitoring-tool regular-expression runtime-verification stream-processing temporal-data temporal-logic

Last synced: 05 Apr 2025

https://github.com/bcg-x-official/fluxus

Python framework for concurrent data flows

async concurrent-programming data-stream flow pipeline python

Last synced: 11 Sep 2025

https://github.com/leomaurodesenv/paper-2019-iceis

Detecting Influencers in Very Large Social Networks of Games

classification data-mining data-stream feature-extraction paper player-modeling social-network-analysis social-networks

Last synced: 17 Jun 2025

https://github.com/hurence/historian

big data timeseries historian

bigdata compression data-storage data-stream grafana historian sampling spark-streaming time-series

Last synced: 30 Apr 2025

https://github.com/daq-tools/lorrystream

A lightweight and polyglot stream-processing library, to be used as a data backplane-, message relay-, or pipeline-subsystem.

amqp broker cratedb data-stream data-stream-processing data-stream-processing-framework data-streaming kotori-daq message-broker message-bus message-queue mosquitto mqtt pandas sqlalchemy stream streaming streamz zeromq zmq

Last synced: 30 Apr 2025

https://github.com/tideland/go-cells

Light-weight event-processing based on the idea of meshed cells with different pluggable behaviors

cep data-analysis data-stream event-processing events golang

Last synced: 05 Apr 2025

https://github.com/scramjetorg/framework-cpp

Simple yet powerful live data computation framework. C++ port of Scramjet framework.

cpp data-stream event-stream reactive-programming scramjet spark-streaming stream stream2 transformations

Last synced: 22 Feb 2025

https://github.com/ethanyuan/open-transaction-pool

A CKB Open Transaction solution based on memory pool.

blockchain ckb ckb-transaction ckb-wallet data-stream layer-1 lock-script memory-pool nervosnetwork open-transaction otx-sdk partial-sign plugins reactive-programming rust sighash smart-contracts transaction-pool udt

Last synced: 09 Apr 2025

https://github.com/pratikgajjar/mysql-data-stream-kafka

This project create data stream from mysql using replication protocols and ingest into kafka. You can create event driven system using this.

cdc change-data-capture data-stream event-streaming kafka kafka-producer mysql python realtime

Last synced: 22 Nov 2025

https://github.com/mhahsler/remm

clustering data-stream sequence-analysis

Last synced: 30 Apr 2025

https://github.com/rijalghodi/linguatube-ui

Learn english while watching youtube

data-stream front-end nextjs openai

Last synced: 01 Feb 2026

https://github.com/dataphos/lib-streamproc

A Go library that exposes executors, interfaces, data structures, and utility functions which combined a universal stream processor, invariant to any specific messaging system.

cloud-native data-stream data-streaming go library messaging

Last synced: 28 Aug 2025

https://github.com/mrdcvlsc/bytepadding

A collection of different byte padding methods

alignment ansix923 block block-cipher block-cipher-mode byte-array c-plus-plus cplusplus cpp cryptography data-processing data-stream fill iso-iec-7810 library memory memory-management padding pkcs5 pkcs7

Last synced: 18 Jul 2025

https://github.com/tberey/social-stocks

A Graphical Data and Analysis Tool

data data-analysis data-science data-stream data-visualization database javascript mysql mysql-database node nodejs rest rest-api social-stocks stock-market stocks ticker-data tickers trends typescript

Last synced: 21 Jan 2026

https://github.com/dataphos/schema-registry

Schema Registry is a product used for schema management and message validation.

cloud-native data-mesh data-stream event-driven go kafka messaging pubsub schema-registry serverless servicebus

Last synced: 08 Sep 2025

https://github.com/rezacsedu/Mining-Maximal-Frequent-Pattern-Spark

Implementation of Static mining part of "Mining maximal frequent patterns in transactional databases and dynamic data streams: A spark-based approach" Information Sciences, Volume 432, March 2018, Pages 278-300

data-mining data-stream frequent-pattern-mining java maximal-frequent-pattern spark structured-streaming

Last synced: 26 Mar 2025

https://github.com/lefteris-souflas/azure-stream-analytics-atm-transactions

Azure Stream Analytics processes ATM transaction data streams, employing Event Hub, Storage, and Stream Analytics Job. Queries include total amounts and alerts. The setup and query execution process are documented with screenshots.

azure-stream-analytics blob-storage data-stream event-hub storage-account stream-query

Last synced: 02 Mar 2025

https://github.com/anhmiuhv/android_realtime_graph_view

An small android module to display a data stream in realtime

android data-stream data-visualization graph realtime

Last synced: 04 Apr 2025

https://github.com/dataphos/lib-brokers

lib-brokers is a Go library which contains the interfaces used to interact with messaging systems without relying on a specific technology or client library. This library attempts to solve the issue of properly abstracting away the interaction between applications and messaging systems.

cloud-native data-stream data-streaming go jetstream kafka library messaging pubsub pulsar servicebus

Last synced: 24 Dec 2025

https://github.com/gustavohfmo/sisc

Algorithms proposed in the following master dissertation: OLIVEIRA, Gustavo Henrique Ferreira de Miranda. Previsão de séries temporais na presença de mudança de conceito: uma abordagem baseada em PSO. 2018. Dissertação de Mestrado. Universidade Federal de Pernambuco.

concept-drift data-stream elm sisc-m sisc-p time-series

Last synced: 29 Dec 2025

https://github.com/yuvadm/rivulet

Elengant asynchronous data streams

async asyncio data-processing data-stream python

Last synced: 21 Mar 2025

https://github.com/sofyan48/wahoo

Data stream library with kinesis

aws data data-stream event kinesis stream

Last synced: 28 Oct 2025