{"id":43823595,"url":"https://github.com/bhftbootcamp/librdkafka.jl","last_synced_at":"2026-03-06T19:22:06.882Z","repository":{"id":336825456,"uuid":"1151288482","full_name":"bhftbootcamp/Librdkafka.jl","owner":"bhftbootcamp","description":"Lightweight Julia wrapper for librdkafka (Apache Kafka)","archived":false,"fork":false,"pushed_at":"2026-02-06T11:07:52.000Z","size":294,"stargazers_count":1,"open_issues_count":0,"forks_count":0,"subscribers_count":0,"default_branch":"master","last_synced_at":"2026-02-06T17:39:08.523Z","etag":null,"topics":["kafka","rdkafka"],"latest_commit_sha":null,"homepage":"","language":"C++","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/bhftbootcamp.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":".github/CODEOWNERS","security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null,"notice":null,"maintainers":null,"copyright":null,"agents":null,"dco":null,"cla":null}},"created_at":"2026-02-06T09:27:27.000Z","updated_at":"2026-02-06T12:44:17.000Z","dependencies_parsed_at":null,"dependency_job_id":null,"html_url":"https://github.com/bhftbootcamp/Librdkafka.jl","commit_stats":null,"previous_names":["bhftbootcamp/librdkafka.jl"],"tags_count":1,"template":false,"template_full_name":null,"purl":"pkg:github/bhftbootcamp/Librdkafka.jl","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/bhftbootcamp%2FLibrdkafka.jl","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/bhftbootcamp%2FLibrdkafka.jl/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/bhftbootcamp%2FLibrdkafka.jl/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/bhftbootcamp%2FLibrdkafka.jl/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/bhftbootcamp","download_url":"https://codeload.github.com/bhftbootcamp/Librdkafka.jl/tar.gz/refs/heads/master","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/bhftbootcamp%2FLibrdkafka.jl/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":29371387,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-02-12T08:51:36.827Z","status":"ssl_error","status_checked_at":"2026-02-12T08:51:26.849Z","response_time":55,"last_error":"SSL_read: unexpected eof while reading","robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":false,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["kafka","rdkafka"],"created_at":"2026-02-06T02:12:32.520Z","updated_at":"2026-03-06T19:22:06.870Z","avatar_url":"https://github.com/bhftbootcamp.png","language":"C++","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Librdkafka.jl\n\n[![Ask DeepWiki](https://deepwiki.com/badge.svg)](https://deepwiki.com/bhftbootcamp/Librdkafka.jl)\n[![Stable](https://img.shields.io/badge/docs-stable-blue.svg)](https://bhftbootcamp.github.io/Librdkafka.jl/stable/)\n[![Dev](https://img.shields.io/badge/docs-dev-blue.svg)](https://bhftbootcamp.github.io/Librdkafka.jl/dev/)\n[![Build Status](https://github.com/bhftbootcamp/Librdkafka.jl/actions/workflows/ci.yml/badge.svg?branch=master)](https://github.com/bhftbootcamp/Librdkafka.jl/actions/workflows/ci.yml?query=branch%3Amaster)\n[![Coverage](https://codecov.io/gh/bhftbootcamp/Librdkafka.jl/branch/master/graph/badge.svg)](https://codecov.io/gh/bhftbootcamp/Librdkafka.jl)\n[![Registry](https://img.shields.io/badge/registry-Green-green)](https://github.com/bhftbootcamp/Green)\n\nJulia wrapper for librdkafka for producing and consuming Apache Kafka messages from Julia.\nLibrary based on [modern-cpp-kafka](https://github.com/morganstanley/modern-cpp-kafka).\n\n\u003chtml\u003e\n  \u003cbody\u003e\n    \u003ctable\u003e\n      \u003ctr\u003e\n        \u003cth\u003ePlatform\u003c/th\u003e\n        \u003cth\u003e\u003cdiv align=center\u003ex86_64\u003c/div\u003e\u003c/th\u003e\n        \u003cth\u003e\u003cdiv align=center\u003eaarch64\u003c/div\u003e\u003c/th\u003e\n        \u003cth\u003e\u003cdiv align=center\u003eNotes\u003c/div\u003e\u003c/th\u003e\n      \u003c/tr\u003e\n      \u003ctr\u003e\n        \u003ctd\u003eLinux (glibc)\u003c/td\u003e\n        \u003ctd\u003e\u003cdiv align=center\u003e✓\u003c/div\u003e\u003c/td\u003e\n        \u003ctd\u003e\u003cdiv align=center\u003e(planned)\u003c/div\u003e\u003c/td\u003e\n        \u003ctd\u003eMainstream Linux distributions (x86_64 supported)\u003c/td\u003e\n      \u003c/tr\u003e\n      \u003ctr\u003e\n        \u003ctd\u003eLinux (musl)\u003c/td\u003e\n        \u003ctd\u003e\u003cdiv align=center\u003e(planned)\u003c/div\u003e\u003c/td\u003e\n        \u003ctd\u003e\u003cdiv align=center\u003e(planned)\u003c/div\u003e\u003c/td\u003e\n        \u003ctd\u003eAlpine / minimal containers\u003c/td\u003e\n      \u003c/tr\u003e\n      \u003ctr\u003e\n        \u003ctd\u003emacOS\u003c/td\u003e\n        \u003ctd\u003e\u003cdiv align=center\u003e(planned)\u003c/div\u003e\u003c/td\u003e\n        \u003ctd\u003e\u003cdiv align=center\u003e✓\u003c/div\u003e\u003c/td\u003e\n        \u003ctd\u003eApple Silicon supported, Intel planned\u003c/td\u003e\n      \u003c/tr\u003e\n      \u003ctr\u003e\n        \u003ctd\u003eFreeBSD\u003c/td\u003e\n        \u003ctd\u003e\u003cdiv align=center\u003e(planned)\u003c/div\u003e\u003c/td\u003e\n        \u003ctd\u003e\u003cdiv align=center\u003e(planned)\u003c/div\u003e\u003c/td\u003e\n        \u003ctd\u003eCommunity interest\u003c/td\u003e\n      \u003c/tr\u003e\n      \u003ctr\u003e\n        \u003ctd\u003eWindows\u003c/td\u003e\n        \u003ctd\u003e\u003cdiv align=center\u003e(planned)\u003c/div\u003e\u003c/td\u003e\n        \u003ctd\u003e\u003cdiv align=center\u003e(planned)\u003c/div\u003e\u003c/td\u003e\n        \u003ctd\u003eFuture support\u003c/td\u003e\n      \u003c/tr\u003e\n    \u003c/table\u003e\n  \u003c/body\u003e\n\u003c/html\u003e\n\nPrebuilt binaries are published automatically for supported platforms. If you need to build the wrapper from source, run:\n```\ncmake -S deps/src -B deps/src/build \u0026\u0026 cmake --build deps/src/build\n```\n\n## Installation\n\nIf you haven't installed our local registry yet, do that first:\n\n```\n] registry add https://github.com/bhftbootcamp/Green.git\n```\n\nTo install Librdkafka, simply use the Julia package manager:\n\n```\n] add Librdkafka\n```\n\n## Usage\n\n### Producer\n\n```julia\nusing Librdkafka\n\ntopic = \"julia-demo\"\n\np = KafkaProducer(\"localhost:9092\")\n\ntry\n    i = 1\n    while true\n        msg = \"hello #$i from julia\"\n        produce(p, topic, 0, \"key\", msg)\n        @info \"Sent\" msg\n        i += 1\n        sleep(1)\n    end\nfinally\n    close(p) # unreachable here, Ctrl+C to stop\nend\n```\n\n### Consumer\n\n```julia\nusing Librdkafka\n\ntopic = \"julia-demo\"\n\nc = KafkaConsumer(\n    \"localhost:9092\";\n    group_id = \"julia-demo-consumer\",\n    config = Dict(\n        AUTO_OFFSET_RESET =\u003e \"earliest\",\n        ENABLE_AUTO_COMMIT =\u003e \"false\",\n    ),\n)\n\nsubscribe!(c, [topic])\n\ntry\n    while true\n        for r in poll(c; timeout_ms=1000)\n            @info \"Got\" key=r.key value=r.value offset=r.offset\n            commit_record(c, r)\n        end\n    end\nfinally\n    close(c) # unreachable here, Ctrl+C to stop\nend\n```\n\n## Useful Links\n\n- [librdkafka](https://github.com/confluentinc/librdkafka) – Official library repository.\n- [librdkafka_jll](https://github.com/JuliaBinaryWrappers/librdkafka_jll.jl) – Julia binary wrapper for librdkafka.\n- [modern-cpp-kafka](https://github.com/morganstanley/modern-cpp-kafka) – a layer of C++ wrapper based on librdkafka.\n- [doc kafka-clients](https://docs.confluent.io/kafka-clients/python/current/overview.html) – configuration refers to the various settings and parameters that can be adjusted to optimize the performance, reliability, and security of a Kafka cluster and its clients.\n\n## Contributing\n\nContributions to Librdkafka are welcome! If you encounter a bug, have a feature request, or would like to contribute code, please open an issue or a pull request on GitHub.\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fbhftbootcamp%2Flibrdkafka.jl","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fbhftbootcamp%2Flibrdkafka.jl","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fbhftbootcamp%2Flibrdkafka.jl/lists"}