https://github.com/lsst-sqre/kafkit

Asyncio-based Python library for working with aiokafka, Confluent Schema Registry, and Kafka Broker APIs.
https://github.com/lsst-sqre/kafkit

kafka roundtable

Last synced: about 2 months ago
JSON representation

Asyncio-based Python library for working with aiokafka, Confluent Schema Registry, and Kafka Broker APIs.

• Host: GitHub
• URL: https://github.com/lsst-sqre/kafkit
• Owner: lsst-sqre
• License: mit
• Created: 2019-01-07T20:12:04.000Z (over 7 years ago)
• Default Branch: main
• Last Pushed: 2026-02-16T12:53:42.000Z (2 months ago)
• Last Synced: 2026-02-16T21:17:36.668Z (2 months ago)
• Topics: kafka, roundtable
• Language: Python
• Homepage: https://kafkit.lsst.io
• Size: 315 KB
• Stars: 24
• Watchers: 5
• Forks: 2
• Open Issues: 6
• Metadata Files:
  • Readme: README.md
  • Changelog: CHANGELOG.md
  • License: LICENSE

Awesome Lists containing this project

README

          
# Kafkit

> [!IMPORTANT]

> This package has been deprecated by the SQuaRE team and will only receive maintenance updates on the 0.3 branch. Kafkit is superseded by the following packages:

>

> - [safir.kafka](https://safir.lsst.io/user-guide/kafka/index.html) provides a Schema Manager for Pydantic models that integrates with the Confluent Schema Registry.

> - [dataclasses-avroschema](https://github.com/marcosschroh/dataclasses-avroschema) from Marcos Schroh provides core support for integrating Avro with Python dataclasses and Pydantic models.

> - [python-schema-registry-client](https://github.com/marcosschroh/python-schema-registry-client) also from Marcos Schroh provides a client for the Confluent Schema Registry.

---

Kafkit helps you write Kafka producers and consumers in Python with asyncio:

- Kafkit provides a client for the Confluent Schema Registry's HTTP API.

  The `RegistryApi` client includes both high-level methods for managing subjects and schemas in a Registry, and direct low-level access to HTTP methods (GET, POST, PUT, PATCH, and DELETE).

  The high-level methods use caching so you can use the client as an integral part of your application's schema management.

  `RegistryApi` is implemented around [aiohttp](https://aiohttp.readthedocs.io/en/stable/), but since the base class is designed with a [sans IO architecture](https://sans-io.readthedocs.io), a Registry client can be implemented with any asyncio HTTP library.

- Kafkit provides Avro message serializers and deserializers that integrate with the [Confluent Schema Registry](https://docs.confluent.io/current/schema-registry/docs/index.html): `Deserializer`, `Serializer`, and `PolySerializer`.

- The `RecordNameSchemaManager` is a streamlined tool for serializing messages using the schemas maintained by your app, while also integrating with the [Confluent Schema Registry](https://docs.confluent.io/current/schema-registry/docs/index.html).

- The `kafkit.ssl` module helps you connect to SSL-secured Kafka brokers.

Learn more about Kafkit at https://kafkit.lsst.io.