{"id":13420286,"url":"https://github.com/confluentinc/librdkafka","last_synced_at":"2026-03-27T04:04:23.983Z","repository":{"id":4721741,"uuid":"5870069","full_name":"confluentinc/librdkafka","owner":"confluentinc","description":"The Apache Kafka C/C++ library","archived":false,"fork":false,"pushed_at":"2026-03-20T00:05:52.000Z","size":50102,"stargazers_count":930,"open_issues_count":560,"forks_count":3238,"subscribers_count":143,"default_branch":"master","last_synced_at":"2026-03-20T01:25:42.213Z","etag":null,"topics":["apache-kafka","c","c-plus-plus","consumer","high-performance","kafka","kafka-consumer","kafka-producer","librdkafka"],"latest_commit_sha":null,"homepage":"","language":"C","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"other","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/confluentinc.png","metadata":{"files":{"readme":"README.md","changelog":"CHANGELOG.md","contributing":"CONTRIBUTING.md","funding":null,"license":"LICENSE","code_of_conduct":"CODE_OF_CONDUCT.md","threat_model":null,"audit":null,"citation":null,"codeowners":".github/CODEOWNERS","security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null,"notice":null,"maintainers":null,"copyright":null,"agents":null,"dco":null,"cla":null}},"created_at":"2012-09-19T10:14:00.000Z","updated_at":"2026-03-19T05:46:26.000Z","dependencies_parsed_at":"2023-09-22T23:05:31.449Z","dependency_job_id":"e8c765b7-4aea-47c7-8701-3500376be3f2","html_url":"https://github.com/confluentinc/librdkafka","commit_stats":{"total_commits":4252,"total_committers":277,"mean_commits":"15.350180505415162","dds":"0.19873000940733776","last_synced_commit":"d86b001bef29aaa5955fb8645865ff34ed516653"},"previous_names":["edenhill/librdkafka"],"tags_count":367,"template":false,"template_full_name":null,"purl":"pkg:github/confluentinc/librdkafka","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/confluentinc%2Flibrdkafka","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/confluentinc%2Flibrdkafka/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/confluentinc%2Flibrdkafka/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/confluentinc%2Flibrdkafka/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/confluentinc","download_url":"https://codeload.github.com/confluentinc/librdkafka/tar.gz/refs/heads/master","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/confluentinc%2Flibrdkafka/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":31018545,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-03-27T03:51:26.850Z","status":"ssl_error","status_checked_at":"2026-03-27T03:51:09.693Z","response_time":164,"last_error":"SSL_read: unexpected eof while reading","robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":false,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["apache-kafka","c","c-plus-plus","consumer","high-performance","kafka","kafka-consumer","kafka-producer","librdkafka"],"created_at":"2024-07-30T22:01:30.455Z","updated_at":"2026-03-27T04:04:23.963Z","avatar_url":"https://github.com/confluentinc.png","language":"C","readme":"librdkafka - the Apache Kafka® C/C++ client library\n===================================================\n\nCopyright (c) 2012-2022, [Magnus Edenhill](http://www.edenhill.se/).\n              2023 [Confluent Inc.](https://www.confluent.io/).\n\n[https://github.com/confluentinc/librdkafka](https://github.com/confluentinc/librdkafka)\n\n**librdkafka** is a C library implementation of the\n[Apache Kafka](https://kafka.apache.org/) protocol, providing Producer, Consumer\nand Admin clients. It was designed with message delivery reliability\nand high performance in mind, current figures exceed 1 million msgs/second for\nthe producer and 3 million msgs/second for the consumer.\n\n**librdkafka** is licensed under the 2-clause BSD license.\n\nKAFKA is a registered trademark of The Apache Software Foundation and\nhas been licensed for use by librdkafka. librdkafka has no\naffiliation with and is not endorsed by The Apache Software Foundation.\n\n\n# Features\n  * Full Exactly-Once-Semantics (EOS) support\n  * High-level producer, including Idempotent and Transactional producers\n  * High-level balanced KafkaConsumer (requires broker \u003e= 0.9)\n  * Simple (legacy) consumer\n  * Admin client\n  * Compression: snappy, gzip, lz4, zstd\n  * [SSL](https://github.com/confluentinc/librdkafka/wiki/Using-SSL-with-librdkafka) support\n  * [SASL](https://github.com/confluentinc/librdkafka/wiki/Using-SASL-with-librdkafka) (GSSAPI/Kerberos/SSPI, PLAIN, SCRAM, OAUTHBEARER) support\n  * Full list of [supported KIPs](INTRODUCTION.md#supported-kips)\n  * Broker version support: \u003e=0.8 (see [Broker version compatibility](INTRODUCTION.md#broker-version-compatibility))\n  * Guaranteed API stability for C \u0026 C++ APIs (ABI safety guaranteed for C)\n  * [Statistics](STATISTICS.md) metrics\n  * Debian package: librdkafka1 and librdkafka-dev in Debian and Ubuntu\n  * RPM package: librdkafka and librdkafka-devel\n  * Gentoo package: dev-libs/librdkafka\n  * Portable: runs on Linux, MacOS X, Windows, Solaris, FreeBSD, AIX, ...\n\n# Documentation\n\n * Public API in [C header](src/rdkafka.h) and [C++ header](src-cpp/rdkafkacpp.h).\n * Introduction and manual in [INTRODUCTION.md](https://github.com/confluentinc/librdkafka/blob/master/INTRODUCTION.md).\n * Configuration properties in\n[CONFIGURATION.md](https://github.com/confluentinc/librdkafka/blob/master/CONFIGURATION.md).\n * Statistics metrics in [STATISTICS.md](https://github.com/confluentinc/librdkafka/blob/master/STATISTICS.md).\n * [Frequently asked questions](https://github.com/confluentinc/librdkafka/wiki).\n * Step-by-step tutorial [Getting Started with Apache Kafka and C/C++](https://developer.confluent.io/get-started/c/).\n\n**NOTE**: The `master` branch is actively developed, use latest [release](https://github.com/confluentinc/librdkafka/releases) for production use.\n\n\n# Installation\n\n## Installing prebuilt packages\n\nOn Mac OSX, install librdkafka with homebrew:\n\n```bash\n$ brew install librdkafka\n```\n\nOn Debian and Ubuntu, install librdkafka from the Confluent APT repositories,\nsee instructions [here](https://docs.confluent.io/current/installation/installing_cp/deb-ubuntu.html#get-the-software) and then install librdkafka:\n\n ```bash\n $ apt install librdkafka-dev\n ```\n\nOn RedHat, CentOS, Fedora, install librdkafka from the Confluent YUM repositories,\ninstructions [here](https://docs.confluent.io/current/installation/installing_cp/rhel-centos.html#get-the-software) and then install librdkafka:\n\n```bash\n$ yum install librdkafka-devel\n```\n\nOn Windows, reference [librdkafka.redist](https://www.nuget.org/packages/librdkafka.redist/) NuGet package in your Visual Studio project.\n\n\nFor other platforms, follow the source building instructions below.\n\n\n## Installing librdkafka using vcpkg\n\nYou can download and install librdkafka using the [vcpkg](https://github.com/Microsoft/vcpkg) dependency manager:\n\n```bash\n# Install vcpkg if not already installed\n$ git clone https://github.com/Microsoft/vcpkg.git\n$ cd vcpkg\n$ ./bootstrap-vcpkg.sh\n$ ./vcpkg integrate install\n\n# Install librdkafka\n$ vcpkg install librdkafka\n```\n\nThe librdkafka package in vcpkg is kept up to date by Microsoft team members and community contributors.\nIf the version is out of date, please [create an issue or pull request](https://github.com/Microsoft/vcpkg) on the vcpkg repository.\n\n\n## Build from source\n\n### Requirements\n\tThe GNU toolchain\n\tGNU make\n   \tpthreads\n\tzlib-dev (optional, for gzip compression support)\n\tlibssl-dev (optional, for SSL and SASL SCRAM support)\n\tlibsasl2-dev (optional, for SASL GSSAPI support)\n\tlibzstd-dev (optional, for ZStd compression support)\n\tlibcurl-dev (optional, for SASL OAUTHBEARER OIDC support)\n\n**NOTE**: Static linking of ZStd (requires zstd \u003e= 1.2.1) in the producer\n          enables encoding the original size in the compression frame header,\n          which will speed up the consumer.\n          Use `STATIC_LIB_libzstd=/path/to/libzstd.a ./configure --enable-static`\n          to enable static ZStd linking.\n          MacOSX example:\n          `STATIC_LIB_libzstd=$(brew ls -v zstd | grep libzstd.a$) ./configure --enable-static`\n\n\n### Building\n\n      ./configure\n      # Or, to automatically install dependencies using the system's package manager:\n      # ./configure --install-deps\n      # Or, build dependencies from source:\n      # ./configure --install-deps --source-deps-only\n\n      make\n      sudo make install\n\n\n**NOTE**: See [README.win32](README.win32) for instructions how to build\n          on Windows with Microsoft Visual Studio.\n\n**NOTE**: See [CMake instructions](packaging/cmake/README.md) for experimental\n          CMake build (unsupported).\n\n\n## Usage in code\n\nSee [getting Started with Apache Kafka and C/C++](https://developer.confluent.io/get-started/c/) for a basic tutorial.\n\n1. Refer to the [examples directory](examples/) for code using:\n\n    * Producers: basic producers, idempotent producers, transactional producers.\n    * Consumers: basic consumers, reading batches of messages.\n    * Performance and latency testing tools.\n\n2. Refer to the [examples GitHub repo](https://github.com/confluentinc/examples/tree/master/clients/cloud/c) for code connecting to a cloud streaming data service based on Apache Kafka\n\n3. Link your program with `-lrdkafka` (C) or `-lrdkafka++` (C++).\n\n\n## Commercial support\n\nCommercial support is available from [Confluent Inc](https://www.confluent.io/)\n\n\n## Community support\n\n**Only the [latest official release](https://github.com/confluentinc/librdkafka/releases) is supported for community members.**\n\nFile bug reports and feature requests using [GitHub Issues](https://github.com/confluentinc/librdkafka/issues).\n\nQuestions and discussions are welcome on the [Discussions](https://github.com/confluentinc/librdkafka/discussions) forum, and on the [Confluent Community slack](https://launchpass.com/confluentcommunity) #clients channel.\n\n\n# Language bindings\n\n  * C#/.NET: [confluent-kafka-dotnet](https://github.com/confluentinc/confluent-kafka-dotnet) (based on [rdkafka-dotnet](https://github.com/ah-/rdkafka-dotnet))\n  * C++: [cppkafka](https://github.com/mfontanini/cppkafka)\n  * C++: [modern-cpp-kafka](https://github.com/Morgan-Stanley/modern-cpp-kafka)\n  * Common Lisp: [cl-rdkafka](https://github.com/SahilKang/cl-rdkafka)\n  * D (C-like): [librdkafka](https://github.com/DlangApache/librdkafka/)\n  * D (C++-like): [librdkafkad](https://github.com/tamediadigital/librdkafka-d)\n  * Erlang: [erlkaf](https://github.com/silviucpp/erlkaf)\n  * Go: [confluent-kafka-go](https://github.com/confluentinc/confluent-kafka-go)\n  * Haskell (kafka, conduit, avro, schema registry): [hw-kafka](https://github.com/haskell-works/hw-kafka)\n  * Kotlin Native: [Kafka-Kotlin-Native](https://github.com/icemachined/kafka-kotlin-native)\n  * Lua: [luardkafka](https://github.com/mistsv/luardkafka)\n  * Node.js: [node-rdkafka](https://github.com/Blizzard/node-rdkafka)\n  * OCaml: [ocaml-kafka](https://github.com/didier-wenzek/ocaml-kafka)\n  * Perl: [Net::Kafka](https://github.com/bookingcom/perl-Net-Kafka)\n  * PHP: [php-rdkafka](https://github.com/arnaud-lb/php-rdkafka)\n  * PHP: [php-simple-kafka-client](https://github.com/php-kafka/php-simple-kafka-client)\n  * Python: [confluent-kafka-python](https://github.com/confluentinc/confluent-kafka-python)\n  * Python: [PyKafka](https://github.com/Parsely/pykafka)\n  * Ruby: [Hermann](https://github.com/reiseburo/hermann)\n  * Ruby: [rdkafka-ruby](https://github.com/appsignal/rdkafka-ruby)\n  * Rust: [rust-rdkafka](https://github.com/fede1024/rust-rdkafka)\n  * Tcl: [KafkaTcl](https://github.com/flightaware/kafkatcl)\n  * Shell: [kafkacat](https://github.com/edenhill/kafkacat) - Apache Kafka command line tool\n  * Swift: [Perfect-Kafka](https://github.com/PerfectlySoft/Perfect-Kafka)\n\n\nSee [Powered by librdkafka](https://github.com/confluentinc/librdkafka/wiki/Powered-by-librdkafka) for an incomplete list of librdkafka users.\n","funding_links":[],"categories":["TODO scan for Android support in followings","C","Clients"],"sub_categories":["C/C++"],"project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fconfluentinc%2Flibrdkafka","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fconfluentinc%2Flibrdkafka","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fconfluentinc%2Flibrdkafka/lists"}