{"id":13430331,"url":"https://github.com/confluentinc/confluent-kafka-dotnet","last_synced_at":"2026-04-02T23:29:18.500Z","repository":{"id":37251639,"uuid":"72554578","full_name":"confluentinc/confluent-kafka-dotnet","owner":"confluentinc","description":"Confluent's Apache Kafka .NET client","archived":false,"fork":false,"pushed_at":"2025-05-08T18:22:49.000Z","size":6602,"stargazers_count":155,"open_issues_count":498,"forks_count":879,"subscribers_count":191,"default_branch":"master","last_synced_at":"2025-05-08T19:37:45.098Z","etag":null,"topics":["c-sharp","confluent","dotnet","kafka","kafka-client","kafka-clients","nuget"],"latest_commit_sha":null,"homepage":"https://github.com/confluentinc/confluent-kafka-dotnet/wiki","language":"C#","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/confluentinc.png","metadata":{"files":{"readme":"README.md","changelog":"CHANGELOG.md","contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":".github/CODEOWNERS","security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null}},"created_at":"2016-11-01T16:25:52.000Z","updated_at":"2025-05-07T05:55:35.000Z","dependencies_parsed_at":"2023-10-16T16:41:44.656Z","dependency_job_id":"99e92d46-3970-43b3-aee3-d639c42199ba","html_url":"https://github.com/confluentinc/confluent-kafka-dotnet","commit_stats":{"total_commits":779,"total_committers":98,"mean_commits":7.948979591836735,"dds":0.6854942233632862,"last_synced_commit":"b9ec9e56cb6f4253f748f23bb6e8d2930562aa72"},"previous_names":[],"tags_count":148,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/confluentinc%2Fconfluent-kafka-dotnet","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/confluentinc%2Fconfluent-kafka-dotnet/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/confluentinc%2Fconfluent-kafka-dotnet/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/confluentinc%2Fconfluent-kafka-dotnet/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/confluentinc","download_url":"https://codeload.github.com/confluentinc/confluent-kafka-dotnet/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":253820024,"owners_count":21969460,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["c-sharp","confluent","dotnet","kafka","kafka-client","kafka-clients","nuget"],"created_at":"2024-07-31T02:00:52.291Z","updated_at":"2026-04-02T23:29:18.493Z","avatar_url":"https://github.com/confluentinc.png","language":"C#","funding_links":[],"categories":["Frameworks, Libraries and Tools","Libraries","框架, 库和工具","Queue","队列","Database Drivers","Identifiers","Clients","🗒️ Cheatsheets"],"sub_categories":["Database Drivers","Messaging and Queue","数据库驱动程序",".NET","GUI - other",".NET / C#","📦 Libraries"],"readme":"Confluent's .NET Client for Apache Kafka®\n=========================================\n\n[![Chat on Slack](https://img.shields.io/badge/chat-on%20slack-7A5979.svg)](https://launchpass.com/confluentcommunity)\n\n**confluent-kafka-dotnet** is Confluent's .NET client for [Apache Kafka](http://kafka.apache.org/) and the\n[Confluent Platform](https://www.confluent.io/product/).\n\nFeatures:\n\n- **High performance** - confluent-kafka-dotnet is a lightweight wrapper around\n[librdkafka](https://github.com/edenhill/librdkafka), a finely tuned C\nclient.\n\n- **Reliability** - There are a lot of details to get right when writing an Apache Kafka\nclient. We get them right in one place (librdkafka) and leverage this work\nacross all of our clients (also [confluent-kafka-python](https://github.com/confluentinc/confluent-kafka-python)\nand [confluent-kafka-go](https://github.com/confluentinc/confluent-kafka-go)).\n\n- **Supported** - Commercial support is offered by\n[Confluent](https://confluent.io/).\n\n- **Future proof** - Confluent, founded by the\noriginal creator/co-creator of Kafka, is building a [streaming platform](https://www.confluent.io/product/)\nwith Apache Kafka at its core. It's high priority for us that client features keep\npace with core Apache Kafka and components of the [Confluent Platform](https://www.confluent.io/product/).\n\nconfluent-kafka-dotnet is derived from Andreas Heider's [rdkafka-dotnet](https://github.com/ah-/rdkafka-dotnet).\nWe're fans of his work and were very happy to have been able to leverage rdkafka-dotnet as the basis of this\nclient. Thanks Andreas!\n\n## Referencing\n\nconfluent-kafka-dotnet is distributed via NuGet. We provide the following  packages:\n\n- [Confluent.Kafka](https://www.nuget.org/packages/Confluent.Kafka/) *[netstandard2.0, net462, net6.0, net8.0]* - The core client library.\n- [Confluent.SchemaRegistry.Serdes.Avro](https://www.nuget.org/packages/Confluent.SchemaRegistry.Serdes.Avro/) *[netstandard2.0, net6.0, net8.0]* - Provides a serializer and deserializer for working with Avro serialized data with Confluent Schema Registry integration.\n- [Confluent.SchemaRegistry.Serdes.Protobuf](https://www.nuget.org/packages/Confluent.SchemaRegistry.Serdes.Protobuf/) *[netstandard2.0, net6.0, net8.0]* - Provides a serializer and deserializer for working with Protobuf serialized data with Confluent Schema Registry integration.\n- [Confluent.SchemaRegistry.Serdes.Json](https://www.nuget.org/packages/Confluent.SchemaRegistry.Serdes.Json/) *[netstandard2.0, net6.0, net8.0]* - Provides a serializer and deserializer for working with Json serialized data with Confluent Schema Registry integration.\n- [Confluent.SchemaRegistry](https://www.nuget.org/packages/Confluent.SchemaRegistry/) *[netstandard2.0, net6.0, net8.0]* - Confluent Schema Registry client (a dependency of the Confluent.SchemaRegistry.Serdes packages).\n- [Confluent.SchemaRegistry.Encryption](https://www.nuget.org/packages/Confluent.SchemaRegistry.Encryption/) *[net6.0, net8.0]* - Confluent Schema Registry client-side field-level encryption client (a dependency of the other Confluent.SchemaRegistry.Encryption.* packages).\n- [Confluent.SchemaRegistry.Encryption.Aws](https://www.nuget.org/packages/Confluent.SchemaRegistry.Encryption.Aws/) *[net6.0, net8.0]* - Confluent Schema Registry client-side field-level encryption client for AWS KMS.\n- [Confluent.SchemaRegistry.Encryption.Azure](https://www.nuget.org/packages/Confluent.SchemaRegistry.Encryption.Azure/) *[net6.0, net8.0]* - Confluent Schema Registry client-side field-level encryption client for Azure Key Vault.\n- [Confluent.SchemaRegistry.Encryption.Gcp](https://www.nuget.org/packages/Confluent.SchemaRegistry.Encryption.Gcp/) *[net6.0, net8.0]* - Confluent Schema Registry client-side field-level encryption client for Google Cloud KMS.\n- [Confluent.SchemaRegistry.Encryption.HcVault](https://www.nuget.org/packages/Confluent.SchemaRegistry.Encryption.HcVault/) *[net6.0, net8.0]* - Confluent Schema Registry client-side field-level encryption client for Hashicorp Vault.\n- [Confluent.SchemaRegistry.Rules](https://www.nuget.org/packages/Confluent.SchemaRegistry.Rules/) *[net6.0, net8.0]* - Confluent Schema Registry client-side support for data quality rules (via the Common Expression Language) and schema migration rules (via JSONata).\n\nTo install Confluent.Kafka from within Visual Studio, search for Confluent.Kafka in the NuGet Package Manager UI, or run the following command in the Package Manager Console:\n\n```\nInstall-Package Confluent.Kafka -Version 2.14.0\n```\n\nTo add a reference to a dotnet core project, execute the following at the command line:\n\n```\ndotnet add package -v 2.14.0 Confluent.Kafka\n```\n\nNote: `Confluent.Kafka` depends on the `librdkafka.redist` package which provides a number of different builds of `librdkafka` that are compatible with [common platforms](https://github.com/edenhill/librdkafka/wiki/librdkafka.redist-NuGet-package-runtime-libraries). If you are on one of these platforms this will all work seamlessly (and you don't need to explicitly reference `librdkafka.redist`). If you are on a different platform, you may need to [build librdkafka](https://github.com/edenhill/librdkafka#building) manually (or acquire it via other means) and load it using the [Library.Load](https://docs.confluent.io/current/clients/confluent-kafka-dotnet/api/Confluent.Kafka.Library.html#Confluent_Kafka_Library_Load_System_String_) method.\n\n### Branch builds\n\nNuget packages corresponding to all commits to release branches are available from the following nuget package source (Note: this is not a web URL - you\nshould specify it in the nuget package manager):\n[https://ci.appveyor.com/nuget/confluent-kafka-dotnet](https://ci.appveyor.com/nuget/confluent-kafka-dotnet). The version suffix of these nuget packages\nmatches the appveyor build number. You can see which commit a particular build number corresponds to by looking at the\n[AppVeyor build history](https://ci.appveyor.com/project/ConfluentClientEngineering/confluent-kafka-dotnet/history)\n\n\n## Usage\n\nFor a step-by-step guide and code samples, see [Getting Started with Apache Kafka and .NET](https://developer.confluent.io/get-started/dotnet/) on [Confluent Developer](https://developer.confluent.io/).\n\nYou can also take the free self-paced training course [Apache Kafka for .NET Developers](https://developer.confluent.io/learn-kafka/apache-kafka-for-dotnet/) on [Confluent Developer](https://developer.confluent.io/).\n\nTake a look in the [examples](examples) directory and at the [integration tests](test/Confluent.Kafka.IntegrationTests/Tests) for further examples.\n\nFor an overview of configuration properties, refer to the [librdkafka documentation](https://github.com/edenhill/librdkafka/blob/master/CONFIGURATION.md).\n\n### Basic Producer Examples\n\nYou should use the `ProduceAsync` method if you would like to wait for the result of your produce\nrequests before proceeding. You might typically want to do this in highly concurrent scenarios,\nfor example in the context of handling web requests. Behind the scenes, the client will manage\noptimizing communication with the Kafka brokers for you, batching requests as appropriate.\n\n```csharp\nusing System;\nusing System.Threading.Tasks;\nusing Confluent.Kafka;\n\nclass Program\n{\n    public static async Task Main(string[] args)\n    {\n        var config = new ProducerConfig { BootstrapServers = \"localhost:9092\" };\n\n        // If serializers are not specified, default serializers from\n        // `Confluent.Kafka.Serializers` will be automatically used where\n        // available. Note: by default strings are encoded as UTF8.\n        using (var p = new ProducerBuilder\u003cNull, string\u003e(config).Build())\n        {\n            try\n            {\n                var dr = await p.ProduceAsync(\"test-topic\", new Message\u003cNull, string\u003e { Value = \"test\" });\n                Console.WriteLine($\"Delivered '{dr.Value}' to '{dr.TopicPartitionOffset}'\");\n            }\n            catch (ProduceException\u003cNull, string\u003e e)\n            {\n                Console.WriteLine($\"Delivery failed: {e.Error.Reason}\");\n            }\n        }\n    }\n}\n```\n\nNote that a server round-trip is slow (3ms at a minimum; actual latency depends on many factors).\nIn highly concurrent scenarios you will achieve high overall throughput out of the producer using\nthe above approach, but there will be a delay on each `await` call. In stream processing\napplications, where you would like to process many messages in rapid succession, you would typically\nuse the `Produce` method instead:\n\n```csharp\nusing System;\nusing Confluent.Kafka;\n\nclass Program\n{\n    public static void Main(string[] args)\n    {\n        var conf = new ProducerConfig { BootstrapServers = \"localhost:9092\" };\n\n        Action\u003cDeliveryReport\u003cNull, string\u003e\u003e handler = r =\u003e\n            Console.WriteLine(!r.Error.IsError\n                ? $\"Delivered message to {r.TopicPartitionOffset}\"\n                : $\"Delivery Error: {r.Error.Reason}\");\n\n        using (var p = new ProducerBuilder\u003cNull, string\u003e(conf).Build())\n        {\n            for (int i = 0; i \u003c 100; ++i)\n            {\n                p.Produce(\"my-topic\", new Message\u003cNull, string\u003e { Value = i.ToString() }, handler);\n            }\n\n            // wait for up to 10 seconds for any inflight messages to be delivered.\n            p.Flush(TimeSpan.FromSeconds(10));\n        }\n    }\n}\n```\n\n### Basic Consumer Example\n\n```csharp\nusing System;\nusing System.Threading;\nusing Confluent.Kafka;\n\nclass Program\n{\n    public static void Main(string[] args)\n    {\n        var conf = new ConsumerConfig\n        {\n            GroupId = \"test-consumer-group\",\n            BootstrapServers = \"localhost:9092\",\n            // Note: The AutoOffsetReset property determines the start offset in the event\n            // there are not yet any committed offsets for the consumer group for the\n            // topic/partitions of interest. By default, offsets are committed\n            // automatically, so in this example, consumption will only start from the\n            // earliest message in the topic 'my-topic' the first time you run the program.\n            AutoOffsetReset = AutoOffsetReset.Earliest\n        };\n\n        using (var c = new ConsumerBuilder\u003cIgnore, string\u003e(conf).Build())\n        {\n            c.Subscribe(\"my-topic\");\n\n            CancellationTokenSource cts = new CancellationTokenSource();\n            Console.CancelKeyPress += (_, e) =\u003e {\n                // Prevent the process from terminating.\n                e.Cancel = true;\n                cts.Cancel();\n            };\n\n            try\n            {\n                while (true)\n                {\n                    try\n                    {\n                        var cr = c.Consume(cts.Token);\n                        Console.WriteLine($\"Consumed message '{cr.Value}' at: '{cr.TopicPartitionOffset}'.\");\n                    }\n                    catch (ConsumeException e)\n                    {\n                        Console.WriteLine($\"Error occured: {e.Error.Reason}\");\n                    }\n                }\n            }\n            catch (OperationCanceledException)\n            {\n                // Ensure the consumer leaves the group cleanly and final offsets are committed.\n                c.Close();\n            }\n        }\n    }\n}\n```\n\n### IHostedService and Web Application Integration\n\nThe [Web](https://github.com/confluentinc/confluent-kafka-dotnet/tree/master/examples/Web) example demonstrates how to integrate\nApache Kafka with a web application, including how to implement `IHostedService` to realize a long running consumer poll loop, how to\nregister a producer as a singleton service, and how to bind configuration from an injected `IConfiguration` instance.\n\n### Exactly Once Processing\n\nThe .NET Client has full support for transactions and idempotent message production, allowing you to write horizontally scalable stream\nprocessing applications with exactly once semantics. The [ExactlyOnce](examples/ExactlyOnce) example demonstrates this capability by way\nof an implementation of the classic \"word count\" problem, also demonstrating how to use the [FASTER](https://github.com/microsoft/FASTER)\nKey/Value store (similar to RocksDb) to materialize working state that may be larger than available memory, and incremental rebalancing\nto avoid stop-the-world rebalancing operations and unnecessary reloading of state when you add or remove processing nodes.\n\n### Schema Registry Integration\n\nThe three \"Serdes\" packages provide serializers and deserializers for Avro, Protobuf and JSON with [Confluent Schema Registry](https://docs.confluent.io/current/schema-registry/docs/index.html) integration. The `Confluent.SchemaRegistry` nuget package provides a client for interfacing with\nSchema Registry's REST API.\n\n**Note:** All three serialization formats are supported across Confluent Platform. They each make different tradeoffs, and you should use the one that best matches to your requirements. Avro is well suited to the streaming data use-case, but the **quality** and **maturity** of the non-Java implementations lags that of Java - this is an important consideration. Protobuf and JSON both have great support in .NET.\n\n### Error Handling\n\nErrors delivered to a client's error handler should be considered informational except when the `IsFatal` flag\nis set to `true`, indicating that the client is in an un-recoverable state. Currently, this can only happen on\nthe producer, and only when `enable.idempotence` has been set to `true`. In all other scenarios, clients will\nattempt to recover from all errors automatically.\n\nAlthough calling most methods on the clients will result in a fatal error if the client is in an un-recoverable\nstate, you should generally only need to explicitly check for fatal errors in your error handler, and handle\nthis scenario there.\n\n#### Producer\n\nWhen using `Produce`, to determine whether a particular message has been successfully delivered to a cluster,\ncheck the `Error` field of the `DeliveryReport` during the delivery handler callback.\n\nWhen using `ProduceAsync`, any delivery result other than `NoError` will cause the returned `Task` to be in the\nfaulted state, with the `Task.Exception` field set to a `ProduceException` containing information about the message\nand error via the `DeliveryResult` and `Error` fields. Note: if you `await` the call, this means a `ProduceException`\nwill be thrown.\n\n#### Consumer\n\nAll `Consume` errors will result in a `ConsumeException` with further information about the error and context\navailable via the `Error` and `ConsumeResult` fields.\n\n\n### 3rd Party\n\nThere are numerous libraries that expand on the capabilities provided by Confluent.Kafka, or use Confluent.Kafka\nto integrate with Kafka. For more information, refer to the [3rd Party Libraries](3RD_PARTY.md) page.\n\n### Confluent Cloud\n\nFor a step-by-step guide on using the .NET client with Confluent Cloud see [Getting Started with Apache Kafka and .NET](https://developer.confluent.io/get-started/dotnet/) on [Confluent Developer](https://developer.confluent.io/).\n\nYou can also refer to the [Confluent Cloud example](examples/ConfluentCloud) which demonstrates how to configure the .NET client for use with\n[Confluent Cloud](https://www.confluent.io/confluent-cloud/).\n\n### Developer Notes\n\nInstructions on building and testing confluent-kafka-dotnet can be found [here](DEVELOPER.md).\n\nCopyright (c)\n2016-2019 [Confluent Inc.](https://www.confluent.io)\n2015-2016 [Andreas Heider](mailto:andreas@heider.io)\n\nKAFKA is a registered trademark of The Apache Software Foundation and has been licensed for use\nby confluent-kafka-dotnet. confluent-kafka-dotnet has no affiliation with and is not endorsed by\nThe Apache Software Foundation.\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fconfluentinc%2Fconfluent-kafka-dotnet","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fconfluentinc%2Fconfluent-kafka-dotnet","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fconfluentinc%2Fconfluent-kafka-dotnet/lists"}