Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/karafka/karafka-web
Web UI for monitoring and managing Karafka consumers
kafka-consumer kafka-manager kafka-monitor kafka-monitoring kafka-monitoring-dashboards kafka-producer kafka-ui karafka karafka-framework rails ruby ruby-on-rails streaming streaming-data web-
Last synced: 03 Jul 2024
https://github.com/provectus/kafka-ui
Open-Source Web UI for Apache Kafka Management
apache-kafka big-data cluster-management event-streaming hacktoberfest kafka kafka-brokers kafka-client kafka-cluster kafka-connect kafka-manager kafka-producer kafka-streams kafka-ui opensource streaming-data streams web-ui
Last synced: 01 Jul 2024
https://github.com/simplygreatwork/godsend
A simple and eloquent workflow for streaming messages to micro-services.
broker bus filter javascript message-broker message-bus message-passing messaging microservice microservices microservices-architecture stream stream-processing streaming-api streaming-data streams
Last synced: 27 Jun 2024
https://github.com/systemaccounting/mxfactorial
a payment application intended for deployment by the united states treasury that replaces banking with accounting
banking bivector capital cga combinatorial-game combinatorial-optimization conservation-laws economics federal-reserve finance fintech game-theory geometric-algebra inflation mathematical-physics monetary-inflation physics price-discovery stream-processing streaming-data
Last synced: 27 Jun 2024
https://github.com/axway-streams/axway-amplify-streams-js
AMPLIFY Streams Javascript package containing SDK, documentation and sample applications
angular js nodejs server-sent-events sse streamdataio streaming-data vuejs
Last synced: 21 Jun 2024
https://github.com/joshday/OnlineStats.jl
⚡ Single-pass algorithms for statistics
big-data julia julia-language julialang online-algorithms onlinestats statistics stochastic-approximation streaming-data
Last synced: 18 Jun 2024
https://github.com/bitfinexcom/bfx-ost-streamer
The Bitfinex osTicket Streamer Plugin.
beanstalkd kinesis osticket osticket-plugin php plugin streaming-data
Last synced: 14 Jun 2024
https://github.com/GridProtectionAlliance/openPDC
Open Source Phasor Data Concentrator
bpa-pdc-stream complex-event-processing hadoop iec61850 ieee-1344 ieee-c37118 naspi openpdc pdc phasor-data-concentrator phasor-measurement-unit pmu stream-processing stream-processing-engine streaming-data synchrophasor time-series
Last synced: 13 Jun 2024
https://github.com/memgraph/memgraph
Open-source graph database, built for real-time streaming data, compatible with Neo4j.
cypher graph graph-algorithms graph-analysis graph-database kafka kafka-streams nosql opencypher stream-processing streaming-data
Last synced: 11 Jun 2024
https://github.com/AbubakrChan/crewai-UI-business-product-launch
Streamlit UI for crewai | crewai ui
crewai crewaiui python streaming-data streamlit terminal ui
Last synced: 02 Jun 2024
https://github.com/readysettech/readyset
Readyset is a MySQL and Postgres wire-compatible caching layer that sits in front of existing databases to speed up queries and horizontally scale read throughput. Under the hood, ReadySet caches the results of cached select statements and incrementally updates these results over time as the underlying data changes.
backend cache caching caching-proxy databases mysql mysql-database postgres postgresql postgresql-database rust rust-lang sql streaming-data
Last synced: 02 Jun 2024
https://github.com/ominibyte/richflow
A Node.js and JavaScript synchronous data pipeline processing, data sharing and stream processing library. Actionable & Transformable Pipeline data processing.
data-flow data-pipeline data-processor data-stream data-transformation flow javascript nodejs pipe-data pipeline-framework streaming-data synchronous
Last synced: 02 Jun 2024
https://github.com/redpanda-data/connect
Fancy stream processing made operationally mundane
amqp cqrs data-engineering data-ops etl event-sourcing go golang kafka logs message-bus message-queue nats rabbitmq stream-processing stream-processor streaming-data
Last synced: 30 May 2024
https://github.com/GridProtectionAlliance/gsf
Grid Solutions Framework
communications complex-event-processing comtrade electric gsf ieee-1344 ieee-c37118 libraries macrodyne osi-pi phasor-measurement-unit pmu pqdif stream-processing stream-processing-engine streaming-data synchrophasor time-series
Last synced: 28 May 2024
https://github.com/lightbend/cloudflow
Cloudflow enables users to quickly develop, orchestrate, and operate distributed streaming applications on Kubernetes.
akka cloudflow flink kubernetes microservices-architectures spark streaming-applications streaming-data streaming-runtimes
Last synced: 26 May 2024
https://github.com/MikeJaredS/hermiter
Efficient Sequential and Batch Estimation of Univariate and Bivariate Probability Density Functions and Cumulative Distribution Functions along with Quantiles (Univariate) and Nonparametric Correlation (Bivariate)
cumulative-distribution-function kendall-correlation-coefficient online-algorithms probability-density-function quantile spearman-correlation-coefficient statistics streaming-algorithms streaming-data
Last synced: 19 May 2024
https://github.com/onurakpolat/awesome-bigdata
A curated list of awesome big data frameworks, ressources and other awesomeness.
awesome awesome-list bigdata data data-analytics data-science data-stream data-visualization data-warehouse database distributed-database series-database stream-processing streaming-data visualize-data
Last synced: 18 May 2024
https://github.com/exajobs/data-engineering-collection
A collection of awesome software, libraries, Learning Tutorials, documents, books, resources and interesting stuff about Big Data Science & Engineering
awesome-list big-data big-data-analytics bigdata bigdata-module data-science data-scientists data-structures data-visualization database-deployment database-design database-development database-migrations databases engineering hadoop query series-data streaming-data
Last synced: 14 May 2024
https://github.com/online-ml/river
🌊 Online machine learning in Python
concept-drift data-science incremental-learning machine-learning online-learning online-machine-learning online-statistics python real-time-processing stream-processing streaming streaming-data
Last synced: 12 May 2024
https://github.com/scikit-multiflow/scikit-multiflow
A machine learning package for streaming data in Python. The other ancestor of River.
machine-learning meka moa scikit scikit-learn stream streaming-data
Last synced: 12 May 2024
https://github.com/sb-haz/twitter-wrapped
Brings the Spotify Wrapped concept to Twitter.
pillow python sentiment-analysis streaming-data tweepy twitter twitterapi twitterbot
Last synced: 10 May 2024
https://github.com/selimfirat/pysad
Streaming Anomaly Detection Framework in Python (Outlier Detection for Streaming Data)
anomaly anomaly-detection fraud-detection incremental-learning intrusion-detection machine-learning outlier-detection outliers python real-time streaming-data unsupervised-learning
Last synced: 09 May 2024
https://github.com/kLabUM/rrcf
🌲 Implementation of the Robust Random Cut Forest algorithm for anomaly detection on streams
anomaly-detection detect-outliers machine-learning outliers python random-forest robust-random-cut-forest streaming-data tree
Last synced: 09 May 2024
https://github.com/infoslack/awesome-kafka
A list about Apache Kafka
apache-kafka apache-spark data-pipeline data-processing infrastructure kafka kafka-streams stream-processing streaming-data
Last synced: 07 May 2024
https://github.com/johnkerl/miller
Miller is like awk, sed, cut, join, and sort for name-indexed data such as CSV, TSV, and tabular JSON
command-line command-line-tools csv csv-format data-cleaning data-processing data-reduction data-regression devops devops-tools json json-data miller statistical-analysis statistics streaming-algorithms streaming-data tabular-data tsv unix-toolkit
Last synced: 07 May 2024
https://github.com/zpl-c/zpl
📐 Pushing the boundaries of simplicity
c cli coroutines cpp cross-platform csv-parser hashing header-only helper json5-parser math memory-allocation memory-management streaming-data tar thread-pool threading time timer zpl
Last synced: 01 May 2024
https://github.com/Stratio/sparta
Real Time Analytics and Data Pipelines based on Spark Streaming
analytics hdfs kafka lambda olap real-time scala spark spark-streaming sparksql sparta stratio stratio-sparta streaming streaming-data triggers workflow
Last synced: 30 Apr 2024
https://github.com/goodboy/tractor
A distributed, structured concurrent runtime for Python (and friends)
actor-model async-await distributed-systems multicore-programming multiprocessing rpc streaming-data structured-concurrency trio
Last synced: 30 Apr 2024
https://github.com/whitaker-io/machine
Machine is a workflow/pipeline library for processing data
codespaces github-actions golang golang-library golang-package golangci-lint mit-license pipeline pipeline-framework stream-processing streaming-data workflow workflow-engine
Last synced: 29 Apr 2024
https://github.com/reugn/go-streams
A lightweight stream processing library for Go
aerospike data-pipeline data-stream etl kafka kafka-streams low-code nats-streaming pipeline pulsar redis stream-processing stream-processor streaming-api streaming-data streams throttling websocket windowing workflow
Last synced: 29 Apr 2024
https://github.com/benthosdev/benthos
Fancy stream processing made operationally mundane
amqp cqrs data-engineering data-ops etl event-sourcing go golang kafka logs message-bus message-queue nats rabbitmq stream-processing stream-processor streaming-data
Last synced: 29 Apr 2024
https://github.com/hstreamdb/hstream
HStreamDB is an open-source, cloud-native streaming database for IoT and beyond. Modernize your data stack for real-time applications.
data-processing database distributed-database distributed-systems financial-analysis haskell hstreamdb iot iot-database kafka materialized-view real-time realtime-database scale sql stream-processing streaming streaming-data streaming-database
Last synced: 29 Apr 2024
https://github.com/infinyon/fluvio
Lean and mean distributed stream processing system written in rust and web assembly.
cloud-native data-flow data-integration data-pipelines distributed-systems event-driven-architecture real-time rust serverless stateful stream-processing stream-processing-engine streaming streaming-data streaming-data-pipelines streaming-data-processing webassembly
Last synced: 29 Apr 2024
https://github.com/MaterializeInc/materialize
The data warehouse for operational workloads.
data-warehouse database distributed-systems kafka materialized-view operational-data-warehouse postgresql postgresql-dialect rust sql stream-processing streaming streaming-data
Last synced: 29 Apr 2024
https://github.com/maraisr/meros
🪢 A fast utility that makes reading multipart responses simple
defer fetch graphql multipart multipart-mixed relay stream streaming-data
Last synced: 20 Apr 2024
https://github.com/keithknott26/datadash
Visualize and graph data in the terminal
chart charting csv go golang graph graphing graphing-application streaming-data tabular-data terminal-based terminal-ui tsv
Last synced: 20 Apr 2024
https://github.com/MileBuurmeijer/OPCUA-Player
An OPC UA player that support replaying OPC UA data from file
opc-ua player server streaming-data testing-tools
Last synced: 19 Apr 2024
https://github.com/guillermo-navas-palencia/optbinning
Optimal binning: monotonic binning with constraints. Support batch & stream optimal binning. Scorecard modelling and counterfactual explanations.
batch-processing binning counterfactual-explanations credit-scoring mdlp optimization python scorecard stream streaming-data woe woebinning
Last synced: 18 Apr 2024
https://github.com/ast-al/rangeless
c++ LINQ -like library of higher-order functions for data manipulation
cpp cpp11 functional functional-programming itertools lazy-evaluation linq parallel pipeline range streaming-algorithms streaming-data
Last synced: 16 Apr 2024
https://github.com/python-streamz/streamz
Real-time stream processing for python
async python real-time streaming-data
Last synced: 11 Apr 2024
https://paragroup.github.io/WindFlow/
A C++17 Data Stream Processing Parallel Library for Multicores and GPUs
cuda gpu gpu-acceleration gpu-computing gpu-programming multi-core multicore multithreading parallel-computing parallel-patterns parallel-programming parallelism sliding-windows stream stream-api stream-processing streaming streaming-api streaming-data streams
Last synced: 11 Apr 2024
https://github.com/Microsoft/trill
Trill is a single-node query processor for temporal or streaming data.
Last synced: 11 Apr 2024
https://github.com/lsds/Saber
Window-Based Hybrid CPU/GPU Stream Processing Engine
gpu high-throughput hybrid multicore multicore-cpu saber sliding-windows stream stream-processing streaming streaming-data
Last synced: 11 Apr 2024
https://github.com/piskvorky/smart_open
Utils for streaming large files (S3, HDFS, gzip, bz2...)
boto bz2 file gzip-stream hacktoberfest hdfs python s3 streaming streaming-data webhdfs
Last synced: 11 Apr 2024
https://github.com/maki-nage/makinage
Stream Processing Made Easy
distributed-systems kafka machine-learning python reactive-machine-learning reactive-programming reactive-systems stream-processing streaming streaming-data
Last synced: 05 Apr 2024
https://github.com/pravega/pravega
Pravega - Streaming as a new software defined storage primitive
data-ingestion distributed-storage real-time-data streaming streaming-data
Last synced: 31 Mar 2024
https://github.com/streamdal/streamdal
Code-Native Data Pipelines
astrojs data-contracts deno docker event-driven go javascript message-queues nodejs observability python reactjs rust streaming-data tail-f wasi wasm
Last synced: 30 Mar 2024
https://github.com/swimos/swim
Full stack application platform for building stateful microservices, streaming APIs, and real-time UIs
actor-model asynchronous-programming decentralized-applications distributed-systems microservices-architecture non-blocking-io real-time serverless serverless-framework stateful streaming-api streaming-data web-agent websockets
Last synced: 26 Mar 2024
https://github.com/bytewax/bytewax
Python Stream Processing
data-engineering data-processing data-science dataflow machine-learning python rust stream-processing streaming-data
Last synced: 23 Mar 2024
https://github.com/benedekrozemberczki/NestedSubtreeHash
A distributed implementation of "Nested Subtree Hash Kernels for Large-Scale Graph Classification Over Streams" (ICDM 2012).
data-mining data-science deepwalk distributed-machine-learning feature-extraction gensim graph-classification graph-kernel graph-mining hashing large-scale-learning machine-learning multi-scale node2vec representation-learning streaming-data streaming-processing word2vec
Last synced: 22 Mar 2024