https://github.com/dashbitco/broadway

Concurrent and multi-stage data ingestion and data processing with Elixir

broadway concurrent data-ingestion data-processing elixir genstage

Last synced: 14 May 2025

https://github.com/antonmi/flowex

Flow-Based Programming framework for Elixir

elixir fbp genstage pipeline

Last synced: 13 Apr 2025

https://github.com/fredwu/opq

Elixir queue! A simple, in-memory queue with worker pooling and rate limiting in Elixir.

back-pressure demand-control elixir fifo gen-stage genstage in-memory opq pool pooling queue rate-limit worker-pool

Last synced: 12 Apr 2025

https://github.com/dashbitco/broadway_kafka

A Broadway connector for Kafka

broadway genstage kafka

Last synced: 14 May 2025

https://github.com/dashbitco/broadway_rabbitmq

A Broadway producer for RabbitMQ

broadway genstage rabbitmq

Last synced: 14 May 2025

https://github.com/dashbitco/broadway_sqs

A Broadway producer for Amazon SQS

amazon broadway genstage sqs

Last synced: 07 May 2025

https://github.com/nietaki/crawlie

A simple Elixir library for writing decently-performing crawlers with minimum effort.

crawler elixir elixir-library genstage

Last synced: 24 Aug 2025

https://github.com/scripbox/flume

A blazing fast job processing system backed by GenStage & Redis.

background-jobs batch-processing concurrent elixir-lang genstage rate-limiting redis scheduled-jobs

Last synced: 30 Mar 2025

https://github.com/mtwilliams/bourne

:speedboat: Better streaming for Ecto.

ecto elixir genstage streaming

Last synced: 24 Aug 2025

https://github.com/sorentwo/kiq

:postbox: Robust job queue powered by GenStage and Redis

background-jobs elixir genstage redis workers

Last synced: 22 Feb 2025

https://github.com/cloud8421/osteria

Osteria demo app for GenStage in the Kitchen talk. Rough code, beware!

elixir elm genstage

Last synced: 05 May 2025

https://github.com/akash-akya/off_broadway_redis_stream

A Broadway producer for Redis Stream

broadway genstage redis-stream

Last synced: 07 Apr 2025

https://github.com/tattdcodemonkey/genstage_sqs_example

Example GenStage producer for AWS Simple Queue Service

aws elixir genstage sqs

Last synced: 13 Apr 2025

https://github.com/nfibrokerage/volley

GenStage producers for EventStoreDB 20+ with Spear

broadway eventstoredb genstage

Last synced: 09 Jul 2025

https://github.com/sashman/elasticsearch_elixir_bulk_processor

Elasticsearch Elixir Bulk Processor is a configurable manager for efficiently inserting data into Elasticsearch. This processor uses GenStages (data-exchange steps) for handling backpressure, and various settings to control the bulk payloads being uploaded to Elasticsearch.

bulk elasticsearch elixir genstage hacktoberfest processor

Last synced: 21 Mar 2025

https://github.com/iacobson/umbrella_stage

Subscribes GenStage consumers to producers across Elixir Umbrella apps.

genstage umbrella

Last synced: 08 Oct 2025

https://github.com/kloeckner-i/genstage_importer

Example of data import pipeline using Flow library

csv data-import elixir flow genstage import pipeline

Last synced: 01 Aug 2025

https://github.com/amokan/broadway_redis

A Broadway producer for Redis lists

broadway data-ingestion data-processing elixir genstage

Last synced: 05 May 2025

https://github.com/voronchuk/kraken

REST API wrapper to communicate with Kraken exchange.

bitcoin genstage kraken kraken-exchange-api rest-api

Last synced: 04 Jul 2025

https://github.com/mcrumm/off_broadway_imps

In-memory producers for Broadway and Elixir

broadway data-processing elixir genstage in-memory

Last synced: 03 Oct 2025

https://github.com/aifrak/real-time-phoenix-hello-sockets

Code from the book "Real-Time Phoenix" part I

elixir elixir-lang elixir-phoenix genstage learning phoenix phoenix-channels phoenix-framework

Last synced: 14 Mar 2025

https://github.com/nfibrokerage/kelvin

GenStage/Broadway producers for Extreme

broadway event-sourcing eventstoredb genstage

Last synced: 09 Jul 2025

https://github.com/nirev/gen_stage_example

Elixir's GenStage example

elixir-lang genstage talks

Last synced: 21 Feb 2025

https://github.com/cloud8421/oredev-flow-demo

Elixir Flow demo application for Oredev 2017 conference

elixir flow genstage oredev

Last synced: 03 Jul 2025

https://github.com/aifrak/concurrent-data-processing-in-elixir

Code from the book "Concurrent Data Processing in Elixir".

broadway elixir flow genstage learning otp

Last synced: 14 Mar 2025

https://github.com/sescobb27/genstage-scraper

elixir floki genstage scraper

Last synced: 18 Aug 2025

https://github.com/iacobson/blog_stockr

Demo app for GenStage under Umbrella blog article

genstage umbrella

Last synced: 23 Oct 2025

https://github.com/charlieroth/scraper

A project to learn about GenStage

elixir genstage

Last synced: 11 Sep 2025

https://github.com/jaeyson/concurrent-data-processing-in-elixir-p1

Applied examples from Concurrent Data Processing in Elixir

background-jobs broadway concurrency data-pipeline elixir flow genstage otp supervisor task

Last synced: 04 Apr 2025

https://github.com/aifrak/real-time-phoenix-sneaker-23

Code from the book "Real-Time Phoenix" since part II

elixir elixir-lang elixir-phoenix genstage learning phoenix phoenix-channels phoenix-framework

Last synced: 14 Mar 2025

https://github.com/sneako/queue_consumer

Small and simple Elixir lib to process messages from a queue via GenStage ConsumerSupervisor

elixir genstage sqs

Last synced: 19 Oct 2025

https://github.com/cloud8421/oredev-genstage-demo

Elixir GenStage demo application for Oredev 2017 conference

elixir genstage oredev pubsub

Last synced: 13 Jun 2025