{"id":13566060,"url":"https://github.com/wintoncode/winton-kafka-streams","last_synced_at":"2025-04-07T12:07:54.125Z","repository":{"id":66346455,"uuid":"96986889","full_name":"wintoncode/winton-kafka-streams","owner":"wintoncode","description":"A Python implementation of Apache Kafka Streams","archived":false,"fork":false,"pushed_at":"2019-01-23T12:34:10.000Z","size":279,"stargazers_count":311,"open_issues_count":13,"forks_count":55,"subscribers_count":31,"default_branch":"master","last_synced_at":"2025-03-31T10:10:24.900Z","etag":null,"topics":["kafka-streams","librdkafka","python","streaming-api"],"latest_commit_sha":null,"homepage":null,"language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/wintoncode.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":"CONTRIBUTING.md","funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":"ROADMAP.md","authors":null}},"created_at":"2017-07-12T08:58:48.000Z","updated_at":"2024-11-28T16:33:27.000Z","dependencies_parsed_at":"2023-02-21T23:46:42.291Z","dependency_job_id":null,"html_url":"https://github.com/wintoncode/winton-kafka-streams","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/wintoncode%2Fwinton-kafka-streams","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/wintoncode%2Fwinton-kafka-streams/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/wintoncode%2Fwinton-kafka-streams/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/wintoncode%2Fwinton-kafka-streams/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/wintoncode","download_url":"https://codeload.github.com/wintoncode/winton-kafka-streams/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":247648977,"owners_count":20972945,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["kafka-streams","librdkafka","python","streaming-api"],"created_at":"2024-08-01T13:02:01.231Z","updated_at":"2025-04-07T12:07:54.099Z","avatar_url":"https://github.com/wintoncode.png","language":"Python","funding_links":[],"categories":["Libraries","Python","Operations"],"sub_categories":["Kafka Streams","Tools"],"readme":"# Winton Kafka Streams\n\n[![Build Status](https://travis-ci.org/wintoncode/winton-kafka-streams.svg?branch=master)](https://travis-ci.org/wintoncode/winton-kafka-streams)\n\nImplementation of [Apache Kafka's Streams API](https://kafka.apache.org/documentation/streams/) in Python.\n\n## What and why?\nApache Kafka is an open-source stream processing platform developed\nby the Apache Software Foundation written in Scala and Java. Kafka\nhas Streams API added for building stream processing applications\nusing Apache Kafka. Applications built with Kafka's Streams API do not require any\nsetup beyond the provision of a Kafka cluster.\n\nWinton Kafka Streams is a Python implementation of Apache Kafka's\nStreams API. It builds on Confluent's librdkafka (a high\nperformance C library implementing the Kafka protocol) and the\nConfluent Python Kafka library to achieve this.\n\nThe power and simplicity of both Python and Kafka's Streams API combined\nopens the streaming model to many more people and applications.\n\n## Getting started\n\n### Dependencies\n\nThe minimum Python version is currently 3.6 and a working Kafka\ncluster (a single replica is sufficient for testing) are required.\n\nYou will require [librdkafka](https://github.com/edenhill/librdkafka). On Mac OS, we recommend installing this via HomeBrew and setting `CFLAGS=-I/usr/local/include` and `LDFLAGS=-L/usr/local/lib` is\nwhen installing Confluent Python Kafka (see below).\nThe librdkafka GitHub page lists packages available for Debian and Ubuntu, as well as RPMS.\nFor Arch Linux it is available via [AUR](https://aur.archlinux.org/packages/librdkafka-git/).\n\nConfluent Python Kafka is also required and it should be installed\nas a dependency by pip.\n\n### Installing\n\nCloning the Winton Kafka Streams repository from GitHub is\nrecommended if you want to contribute to the project.\nThen use\n`pip install --editable \u003cpath/to/winton_kafka_streams\u003e[develop]`\nto install as an editable workspace with additional dependencies\nrequired for development.\nYou may need to do this using `sudo` on Linux.\n\nIf you want to install the code and get a feel for it as a user then\nwe recommend using `pip install git+https://github.com/wintoncode/winton-kafka-streams`.\n\n### Running tests\nTests will run when py.test is called in the root of the repository.\n\n### Running examples\nTo run examples, you must have cloned the code locally from GitHub.\n\nThe debug and wordcount examples will run without further additional\nrequirements.\n\nThe Jupyter notebook in the binning example requires some additional\npackages. Install these with the command:\n\npip install \u003cpath/to/winton_kafka_streams\u003e[binning_example]\n\n## Contributing\nPlease see the CONTRIBUTING.md document for more details on getting involved.\n\n## Contact\n - GitHub: https://github.com/wintoncode/\n - Email: opensource@winton.com\n - Twitter: @wintoncapital\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fwintoncode%2Fwinton-kafka-streams","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fwintoncode%2Fwinton-kafka-streams","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fwintoncode%2Fwinton-kafka-streams/lists"}