Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

https://github.com/ververica/flink-sql-cookbook

The Apache Flink SQL Cookbook is a curated collection of examples, patterns, and use cases of Apache Flink SQL. Many of the recipes are completely self-contained and can be run in Ververica Platform as is.

apache-flink flink flink-sql sql stream-processing

Last synced: 03 Jul 2024

https://github.com/danthelion/twitter-trending

A small example visualizing live Twitter trending data using Redpanda and Materialize

kafka materialize metabase redpanda stream-processing

Last synced: 02 Jul 2024

https://github.com/logrange/logrange

High performance data aggregating storage

database go golang log-aggregation logging pipelines stream-processing streams

Last synced: 02 Jul 2024

https://github.com/uhop/stream-json

The micro-library of Node.js stream components for creating custom JSON processing pipelines with a minimal memory footprint. It can parse JSON files far exceeding available memory streaming individual primitives using a SAX-inspired API.

javascript-objects parse-json-files parser stream-components stream-processing streaming-json

Last synced: 01 Jul 2024

https://github.com/raystack/dagger

Dagger is an easy-to-use, configuration over code, cloud-native framework built on top of Apache Flink for stateful processing of real-time streaming data.

apache-flink apache-kafka dataops framework influxdb prometheus real-time-analytics real-time-processing stream-processing

Last synced: 01 Jul 2024

https://github.com/pemrouz/fero

light, fast, scalable, streaming microservices made easy

fast kafka lightweight microservices scalable stateful stream-processing

Last synced: 27 Jun 2024

https://github.com/talariadb/talaria

TalariaDB is a distributed, highly available, and low latency time-series database for Presto

big-data column-store database prestodb real-time stream-processing time-series

Last synced: 16 Jun 2024

https://github.com/Point72/csp

csp is a high performance reactive stream processing library, written in C++ and Python

cpp python reactive reactive-programming stream-processing streaming

Last synced: 13 Jun 2024

https://github.com/memgraph/memgraph

Open-source graph database, built for real-time streaming data, compatible with Neo4j.

cypher graph graph-algorithms graph-analysis graph-database kafka kafka-streams nosql opencypher stream-processing streaming-data

Last synced: 11 Jun 2024

https://github.com/francoispqt/gojay

high performance JSON encoder/decoder with stream API for Golang

decoder encoder go golang json perfomance stream-decoder stream-processing

Last synced: 10 Jun 2024

https://github.com/vladimirvivien/automi

A stream processing API for Go (alpha)

data-stream go golang stream-processing streaming-api

Last synced: 07 Jun 2024

https://github.com/twalthr/flink-api-examples

Examples for using Apache Flink® with DataStream API, Table API, Flink SQL and connectors such as MySQL, JDBC, CDC, Kafka.

apache-flink data-engineering flink flink-examples flink-sql stream-processing

Last synced: 07 Jun 2024

https://github.com/PeerDB-io/peerdb

Fast, Simple and a cost effective tool to replicate data from Postgres to Data Warehouses, Queues and Storage

bigquery cdc clickhouse cloud-native distributed-systems etl eventhubs kafka postgres postgresql realtime rust s3 snowflake sql stream-processing

Last synced: 07 Jun 2024

https://github.com/itsubaki/gostream

Stream Processing library for Go

complex-event-processing stream-processing

Last synced: 05 Jun 2024

https://github.com/vectorengine/vectorsql

VectorSQL is a free analytics DBMS for IoT & Big Data, compatible with ClickHouse.

clickhouse column-store distributed-database iot olap pipeline reactive stream-processing

Last synced: 05 Jun 2024

https://github.com/zhisheng17/flink-learning

flink learning blog. http://www.54tianzhisheng.cn/ 含 Flink 入门、概念、原理、实战、性能调优、源码解析等内容。涉及 Flink Connector、Metrics、Library、DataStream API、Table API & SQL 等内容的学习案例,还有 Flink 落地应用的大型项目案例(PVUV、日志存储、百亿数据实时去重、监控告警)分享。欢迎大家支持我的专栏《大数据实时计算引擎 Flink 实战与性能优化》

clickhouse elasticsearch flink hbase influxdb kafka loki mysql opentsdb rabbitmq redis rocketmq spark stream-processing streaming

Last synced: 31 May 2024

https://github.com/numaproj/numaflow

Kubernetes-native platform to run massively parallel data/streaming jobs

data-processing hacktoberfest k8s kubernetes map-reduce pipeline stream-processing

Last synced: 24 May 2024

https://github.com/streamnative/function-mesh

The serverless framework purpose-built for event streaming applications.

apache-pulsar connectors event-streaming pulsar-functions pulsar-io serverless stream-processing

Last synced: 22 May 2024

https://github.com/sedgecloud/ECSNeTpp

ECSNeT++ is a simulation framework built on OMNeT++ for Distributed Stream Processing applications running on Edge and Cloud computing environments.

edge-computing omnet-simulation omnetpp simulation-framework stream-processing

Last synced: 16 May 2024

https://github.com/gazette/core

Build platforms that flexibly mix SQL, batch, and stream processing paradigms

brokers event-sourcing golang stream-processing streaming-platforms

Last synced: 16 May 2024

https://github.com/n0-computer/quic-rpc

A streaming rpc system based on quic

crate quic rpc-library rust stream-processing

Last synced: 16 May 2024

https://github.com/IBMStreams/streamsx.topology

Develop streaming applications for IBM Streams in Python, Java & Scala.

ibm-streams java python python-3 scala stream-processing streaming-topologies toolkit

Last synced: 15 May 2024

https://github.com/samber/awesome-olap

A curated list of awesome Online Analytical Processing databases, frameworks, ressources and other awesomeness.

analytics awesome awesome-list batch-processing big-data database datalake datawarehouse lakehouse metastore olap processing sql stream-processing streaming timeseries

Last synced: 14 May 2024

https://github.com/KMax/cqels

A fork of CQELS (Continuous Query Evaluation over Linked Data)

rdf stream-processing

Last synced: 12 May 2024

https://github.com/lpgauth/swirl

High-Performance Erlang Stream Processor

erlang flow high-performance stream-processing

Last synced: 09 May 2024

https://github.com/nmaquet/kasper

Kasper is a lightweight library for processing Kafka topics.

golang-library kafka stream-processing

Last synced: 07 May 2024

https://github.com/halaxa/json-machine

Efficient, easy-to-use, and fast PHP JSON stream parser

json-iterator json-parser json-stream parsing php stream-processing

Last synced: 05 May 2024

https://github.com/manuzhang/awesome-streaming

a curated list of awesome streaming frameworks, applications, etc

awesome awesome-list list stream-processing

Last synced: 05 May 2024

https://github.com/smooks/smooks

Extensible data integration Java framework for building XML and non-XML fragment-based applications

analytics big-data enterprise-integration etl event-driven java pipelines sax smooks stream-processing xml

Last synced: 02 May 2024

https://github.com/hazelcast/hazelcast

Hazelcast is a unified real-time data platform combining stream processing with a fast data store, allowing customers to act instantly on data-in-motion for real-time insights.

big-data caching data-in-motion data-insights distributed distributed-computing distributed-systems hacktoberfest hazelcast in-memory java low-latency real-time scalability stream-processing

Last synced: 02 May 2024

https://github.com/clj-commons/manifold

A compatibility layer for event-driven abstractions

async clojure future hacktoberfest stream stream-processing

Last synced: 01 May 2024

https://github.com/ThreeDotsLabs/watermill

Building event-driven applications the easy way in Go.

cqrs event-driven event-sourcing events go golang kafka nats rabbitmq reactive sagas stream-processing watermill

Last synced: 29 Apr 2024

https://github.com/hstreamdb/hstream

HStreamDB is an open-source, cloud-native streaming database for IoT and beyond. Modernize your data stack for real-time applications.

data-processing database distributed-database distributed-systems financial-analysis haskell hstreamdb iot iot-database kafka materialized-view real-time realtime-database scale sql stream-processing streaming streaming-data streaming-database

Last synced: 29 Apr 2024

https://github.com/vectordotdev/vector

A high-performance observability data pipeline.

events forwarder logs metrics observability parser pipeline router rust stream-processing vector

Last synced: 29 Apr 2024

https://github.com/RisingWaveLabs/risingwave

Cloud-native SQL stream processing, analytics, and management. KsqlDB and Apache Flink alternative. 🚀 10x more productive. 🚀 10x more cost-efficient.

analytics big-data cloud-native data-engineering database distributed-database flink kafka ksqldb materialized-view postgres postgresql postgresql-database real-time rust serverless spark spark-streaming sql stream-processing

Last synced: 29 Apr 2024

https://github.com/redpanda-data/redpanda

Redpanda is a streaming data platform for developers. Kafka API compatible. 10x faster. No ZooKeeper. No JVM!

containers cpp event-driven go kafka kubernetes microservices realtime redpanda seastar storage-engine stream-processing streaming

Last synced: 26 Apr 2024

https://github.com/IBCNServices/StreamingMASSIF

Cascading Stream Reasoning with Streaming MASSIF

reasoning stream-processing streamreasoning

Last synced: 23 Apr 2024

https://github.com/bytedance/Elkeid-HUB

Elkeid HUB is a rule/event processing engine maintained by the Elkeid Team that supports streaming/offline (not yet supported by the community edition) data processing. The original intention is to solve complex data/event processing and external system linkage requirements through standardized rules.

event-engine rule-engine ruleengine soar stream-processing

Last synced: 22 Apr 2024

https://github.com/samsara/samsara

Samsara is a real-time analytics platform

analytics clojure elasticsearch fast iot kafka realtime stream-processing

Last synced: 20 Apr 2024

https://github.com/javascriptdata/danfojs

Danfo.js is an open source, JavaScript library providing high performance, intuitive, and easy to use data structures for manipulating and processing structured data.

danfojs data-analysis data-analytics data-manipulation data-science dataframe javascript pandas plotting-charts stream-data stream-processing table tensorflow tensors

Last synced: 20 Apr 2024

https://github.com/timeplus-io/proton

A streaming SQL engine, a fast and lightweight alternative to ksqlDB and Apache Flink, 🚀 powered by ClickHouse.

analytics clickhouse confluent cpp flink-alternative high-performance kakfa ksqldb-alternative redpanda simd single-binary sql stream-processing streaming-sql udf

Last synced: 11 Apr 2024

https://github.com/apache/streampipes

Apache StreamPipes - A self-service (Industrial) IoT toolbox to enable non-technical users to connect, analyze and explore IoT data streams.

analytics edge hacktoberfest iiot iot self-service stream-processing

Last synced: 11 Apr 2024

https://github.com/asavinov/bistro

A general-purpose data analysis engine radically changing the way batch and stream data is processed

analytics big-data-analytics edge-analytics iot stream-analytics stream-processing

Last synced: 11 Apr 2024

https://github.com/quixio/quix-streams

Quix Streams - A library for data streaming and Python Stream Processing

apache-kafka kafka python stream-processing

Last synced: 11 Apr 2024

https://github.com/pipelinedb/pipelinedb

High-performance time-series aggregation for PostgreSQL

aggregation analytics pipelinedb postgresql push realtime sql stream-processing time-series

Last synced: 11 Apr 2024

https://github.com/scramjetorg/transform-hub

Scramjet Transform Hub (STH) is a runtime supervisor that can run data processing programs called Sequences and manage local resources on any Linux server, Docker on small edge servers, and even large-scale Kubernetes clusters in the cloud or datacenters. It connects to Scramjet Spaces in Scramjet Cloud Platform.

containers data-acquisition docker kubernetes kubernetes-deployment nodejs python python3 real-time runtime-supervisor stream-processing streaming transform-as-a-service

Last synced: 11 Apr 2024

https://github.com/gearpump/gearpump

Lightweight real-time big data streaming engine over Akka

akka bigdata scala stream-processing

Last synced: 11 Apr 2024

https://manuzhang.github.io/awesome-streaming/

a curated list of awesome streaming frameworks, applications, etc

awesome awesome-list list stream-processing

Last synced: 11 Apr 2024

https://github.com/robhowley/s3-streaming

stream and (de)serialize s3 streams

aws file-io s3 stream-processing

Last synced: 09 Apr 2024

https://github.com/project-flogo/stream

Elegant stream processing pipeline written entirely in Golang

edge flogo stream-processing streaming

Last synced: 08 Apr 2024

https://github.com/Kurento/kurento

Kurento WebRTC Media Server

stream-processing video-streaming webrtc

Last synced: 08 Apr 2024

https://github.com/fluent/fluent-bit

Fast and Lightweight Logs and Metrics processor for Linux, BSD, OSX and Windows

c cloudnative data-collector fluent-bit fluentd forwarder logging logs metrics opentelemetry prometheus sql-queries stream-processing traces

Last synced: 07 Apr 2024

https://github.com/apache/hudi

Upserts, Deletes And Incremental Processing on Big Data.

apacheflink apachehudi apachespark bigdata data-integration datalake hudi incremental-processing stream-processing

Last synced: 31 Mar 2024

https://github.com/schollz/pluck

Pluck text in a fast and intuitive way :rooster:

extract-information finite-state-machine regex stream-processing

Last synced: 30 Mar 2024

https://github.com/ccamel/poc-piper-worker-flink

:alembic: An experiment to make flink a worker for the workflow engine piper

amqp flink rabbitmq stream-processing worker workflow-engine

Last synced: 30 Mar 2024

https://github.com/Banno/kafka4s

Functional programming with Kafka and Scala

cats cats-effect fp fs2 functional-programming kafka scala stream-processing

Last synced: 30 Mar 2024

https://github.com/IBMStreams/streamsx.kafka

Repository for integration with Apache Kafka

apache-spark ibm-streams kafka messaging stream-processing toolkit

Last synced: 26 Mar 2024