Projects in Awesome Lists tagged with avro-schema

https://github.com/confluentinc/schema-registry

Confluent Schema Registry for Kafka

avro avro-schema confluent json json-schema kafka protobuf protobuf-schema rest-api schema schema-registry schemas

Last synced: 09 Apr 2025

https://github.com/sksamuel/avro4s

Avro schema generation and serialization / deserialization for Scala

avro avro-schema coproduct scala scala-macros schema-generation serialization

Last synced: 25 Apr 2025

https://github.com/uber/marmaray

Generic Data Ingestion & Dispersal Library for Hadoop

avro-schema data-lake hadoop ingest-data schema-format spark

Last synced: 23 Mar 2025

https://github.com/absaoss/abris

Avro SerDe for Apache Spark structured APIs.

avro avro-schema kafka schema-registry spark

Last synced: 04 Apr 2025

https://github.com/sngular/kloadgen

KLoadGen is kafka load generator plugin for jmeter designed to work with AVRO, JSON and PROTOL-BUFFERS schema Registries.

avro-schema java jmeter-plugin json-schema kafka load-testing protobuf protocol-buffers

Last synced: 07 Apr 2025

https://github.com/learningjournal/kafka-streams-real-time-stream-processing

This is the central repository for all materials related to Kafka Streams : Real-time Stream Processing! Book by Prashant Pandey.

apache-kafka avro-kafka avro-schema java-8 json-kafka kafka kafka-client kafka-consumer kafka-examples kafka-producer kafka-streams messaging-system real-time-stream-processing stream-processing streams

Last synced: 13 Apr 2025

https://github.com/pennsignals/aptos

:sunny: A tool for validating data using JSON Schema and converting JSON Schema documents into different data-interchange formats

avro avro-schema cli command-line-tool data-interchange json-schema python3 schema-conversion validation

Last synced: 28 Mar 2025

https://github.com/erikerlandson/coulomb

coulomb: unit analysis for Scala

avro-schema configuration configuration-management dimensional-analysis numeric pureconfig refined scala static-types type-safety typechecking typeclass typelevel unit-analysis unit-conversion unit-quantity units units-of-measure

Last synced: 07 Apr 2025

https://github.com/strech/avrora

A convenient Elixir library to work with Avro messages, schemas and Confluent® Schema Registry

avro avro-schema confluent elixir kafka schema-registry

Last synced: 07 Apr 2025

https://github.com/clemensv/avrotize

Avrotize is a command-line tool for converting data structure definitions between different schema formats, using Apache Avro Schema as the integration schema model.

asn1 avro avro-schema avro-schemas csharp java javascript json-schema protobuf protocol-buffers typescript xsd xsd-schema

Last synced: 09 Apr 2025

https://github.com/hifly81/kafka-examples

Practical examples with Apache Kafka®

avro avro-schema avroserializer confluent confluent-kafka flink graalvm kafka kafka-client kafka-consumer kafka-consumers kafka-events kafka-installation kafka-producer kafka-producers kafka-streams kafka-topic ksql ktable microprofile

Last synced: 07 Apr 2025

https://github.com/flix-tech/avro-serde-php

Avro Serialisation/Deserialisation (SerDe) library for PHP 8.1+ with a Symfony Serializer integration

avro avro-format avro-schema confluent confluent-platform deserialization php serde serialization symfony symfony-serializer

Last synced: 08 Apr 2025

https://github.com/farmdawgnation/registryless-avro-converter

An avro converter for Kafka Connect without a Schema Registry

avro avro-schema kafka kafka-connect

Last synced: 03 Dec 2024

https://github.com/flix-tech/schema-registry-php-client

A PHP 8+ API client for the Confluent Schema Registry REST API based on Guzzle 7 - http://docs.confluent.io/current/schema-registry/docs/index.html

api-client avro avro-schema confluent event-driven-architecture guzzlehttp php schema-evolution schema-registry

Last synced: 05 Apr 2025

https://github.com/lerouxrgd/rsgen-avro

Command line and library for generating Rust types from Avro schemas

avro-schema code-generation command-line rust

Last synced: 12 Apr 2025

https://github.com/joewood/avro-typescript

TypeScript Code Generator for Apache Avro Schema Types

avro avro-schema typescript typescript-library

Last synced: 04 Apr 2025

https://github.com/agile-lab-dev/darwin

Avro Schema Evolution made easy

avro avro-schema hadoop hbase scala schema-evolution spark

Last synced: 13 Apr 2025

https://github.com/gamussa/springboot-kafka-avro

A simple Spring Boot app that talks to Kafka using Avro and Schema Registry

avro avro-schema confluent kafka schema-registry

Last synced: 06 Dec 2024

https://github.com/asyncapi/avro-schema-parser

An AsyncAPI schema parser for Avro 1.x schemas.

avro avro-schema avro-schema-registry get-global-node-release-workflows get-global-releaserc nodejs parser

Last synced: 09 Dec 2024

https://github.com/creativcoder/avrow

Avrow is a pure Rust implementation of the avro specification https://avro.apache.org/docs/current/spec.html with Serde support.

avro avro-schema deserialization encoding-library rust rust-lang schema serialization

Last synced: 12 Apr 2025

https://github.com/bolcom/avro-schema-viewer

Visualizer for Avro Schemas (.avsc) - Try it yourself at:

angular angular-material avro avro-schema

Last synced: 14 Dec 2024

https://github.com/piotr-kalanski/data-model-generator

Data model generator based on Scala case classes

avro-schema data-model ddl elasticsearch generator scala

Last synced: 19 Mar 2025

https://github.com/piotr-yuxuan/dove

Infer specs from SpecificRecord Java classes of any Avro named type (record, fixed, or enum)

avro avro-format avro-schema clojure clojure-spec clojure-specs spec specific-schemas

Last synced: 18 Nov 2024

https://github.com/charlescol/schema-manager

Centralize in a Repository and Automate Schema Management for Microservices with a Schema Registry. It’s especially useful for Kafka projects requiring structured and scalable schema management.

avro avro-schema confluent-schema-registry devops grpc json json-schema kafka microservices protobuf protobuf-schema schema-registry

Last synced: 13 Apr 2025

https://github.com/imrafaelmerino/json-values

Persistent Json in Java

avro-schema functional-programming immutable immutable-objects java json json-api json-generator json-schema json-values persistent-data-structure prng property-based-testing

Last synced: 25 Apr 2025

https://github.com/rightlag/aptos

:sunny: Avro, Protobuf, Thrift on Swagger

avro avro-schema swagger swagger-specification swagger3

Last synced: 12 Apr 2025

https://github.com/opwvhk/avro-schema-support

Extend IntelliJ, PyCharm and other JetBrains IDEs to more easily work with Avro schemata and protocols in both IDL and JSON format.

avro avro-format avro-idl-files avro-schema gradle intellij intellij-platform intellij-plugin intellij-plugins

Last synced: 31 Mar 2025

https://github.com/nlopes/avro-schema-registry

Avro Schema Registry (mostly) compatible with salsify/avro-schema-registry

avro avro-schema avro-schema-registry registry rust-lang

Last synced: 17 Feb 2025

https://github.com/goodforgod/dummymapper

IntelliJ IDEA plugin for mapping Java class to JSON/AVRO/GraphQL.

avro avro-schema code-tools graphql graphql-schema intellij intellij-idea intellij-plugin java json json-mapping json-schema kotlin mapping mapping-tools plugin pojo-to-avro pojo-to-graphql pojo-to-json

Last synced: 12 Feb 2025

https://github.com/mossabtn/quarkus-kafka-avro

using quarkus with Confluent SchemaRegistry

avro avro-schema kafka quarkus schema-registry

Last synced: 13 Nov 2024

https://github.com/malcolmgreaves/avro-codegen

Scala code generator for Avro schemas.

avro avro-schema codegen data scala serialization

Last synced: 13 Dec 2024

https://github.com/ashutoshsahoo/distributed-transactions-kafka

Distributed Transactions in Microservices with Kafka Streams and Spring Boot

avro-format avro-kafka avro-schema avro-schema-registry ditributed-tracing ditributed-transactions kafka kafka-registry kafka-streams kafka-ui microservices spring-boot spring-boot-kafka spring-boot-kafka-streams spring-sleuth

Last synced: 12 Apr 2025

https://github.com/nryanov/schemakeeper

Schemakeeper - yet another schema registry for Avro, Thrift and Protobuf schemas

avro avro-schema java kafka metadata protobuf scala schema-registry schemakeeper schemas thrift

Last synced: 09 Feb 2025

https://github.com/sourcemeta-research/json-size-benchmark

An automated and extensible space-efficiency benchmark of JSON-compatible serialization specifications

avro avro-format avro-schema benchmark bson capnp capnproto cbor flatbuffers flexbuffers json messagepack msgpack protobuf protobuf3 protocol-buffers smile space-efficiency thrift ubjson

Last synced: 14 Apr 2025

https://github.com/supermodel/supermodel-cli

Boring data modeling

avro avro-schema graphql json json-ld json-schema openapi swagger

Last synced: 23 Mar 2025

https://github.com/anupkumarsharma/kafkaavronet

.Net based solution for using Kafka using Avro and Schema Registry

avro avro-schema kafka kafka-consumer kafka-producer net netcore2 reflection schema-registry

Last synced: 12 Jan 2025

https://github.com/researchgate/mongoose-avro-schema-generator

Generates Apache avro schemas from mongoose schemas.

avro avro-schema mongoose mongoose-schema nodejs

Last synced: 23 Apr 2025

https://github.com/kivanval/gravrity

A Gradle plugin that compiles Apache Avro files (*.avpr, *.avsc, *.avdl) into the corresponding Scala files in your project using the Avrohugger.

avro avro-schema gradle-plugin groovy scala spock

Last synced: 10 Apr 2025

https://github.com/rudikone/avroschema-wizard-plugin

Streamline Avro schema registration and compatibility checks in Kafka with the avroschema-wizard-plugin, simplifying testing and integration with ease!

avro avro-kafka avro-schema confluent gradle java kafka kafka-schema-registry kotlin schema-registry

Last synced: 27 Feb 2025

https://github.com/chop-dbhi/schema-registry

General purpose schema registry.

avro-schema jsonschema microservice schema-registry versioning

Last synced: 19 Feb 2025

https://github.com/joewood/fix-avro

QuickfixJ Avro Schema Generator

avro avro-schema fix fix-protocol

Last synced: 17 Nov 2024

https://github.com/bartkl/metamorph

Metamorph is a Clojure libary that enables the generation of an Avro schema from a given input SHACL model.

avro-schema data-modeling logical-data-model rdf schema-generation schema-transformations semantic-modeling shacl

Last synced: 11 Apr 2025

https://github.com/dariocm/kafka-producer-example

kafka producer example

avro avro-schema docker gradle kafka-producer lombok-gradle spring-boot

Last synced: 28 Mar 2025

https://github.com/imrafaelmerino/avro-spec

avro-spec empowers you to create Avro schemas with the specs from json-values. Leveraging the simplicity and composability of creating specs allows you to efficiently define Avro schemas. The provided serializers/deserializers enable the transmission of the immutable and persistent JSON from json-values through the wire in Avro format

avro avro-schema confluent confluent-schema-registry java json json-values kafka kafka-deserializer kafka-serializer persistent-data-structure

Last synced: 15 Apr 2025

https://github.com/geekcell/kafka-symfony-bundle

An opinionated Symfony bundle for a painless integration of Apache Kafka.

apache-kafka avro avro-schema avro-schema-registry php php8 symfony symfony-bundle

Last synced: 10 Apr 2025

https://github.com/justinbob39/streamsystem

ETL

avro-schema confluent-platform influxdb kafka kafka-streams mqtt serilization

Last synced: 03 Apr 2025

https://github.com/oalles/avro-schema-from-bq-table

Get Avro Schema from Google Cloud Big Query table

avro avro-schema bigquery google-cloud java spring spring-boot

Last synced: 31 Mar 2025

https://github.com/jeffbr13/avdoc

CLI tool to generate HTML documentation for an Apache Avro schema

avro avro-schema

Last synced: 12 Apr 2025

https://github.com/j3-signalroom/ccaf-avro_schema_helpers-python_lib

Utilize your Avro schema to identify which records require unnesting, and convert that into dynamic Flink SQL statements.

avro-schema confluent-flink

Last synced: 02 Mar 2025

https://github.com/banditopazzo/avro-akka-stream

avro akka stream source and sink

akka-streams avro avro-schema hdfs java-io streams

Last synced: 22 Mar 2025

https://github.com/elauso/spring-cloud-stream-kafka-avro

Uma aplicação spring-boot que publica e consome mensagens no kafka utilizando o formato avro.

avro-schema kafka spring-boot spring-cloud-stream

Last synced: 20 Feb 2025

https://github.com/dariocm/kafka-consumer

kafka-consumer example

avro avro-schema docker gradle java kafka-consumer lombok-gradle spring-boot

Last synced: 12 Apr 2025

https://github.com/fluent-plugins-nursery/fluent-plugin-parser-avro

Avro parser plugin for Fluentd.

avro avro-parser-plugin avro-schema fluentd fluentd-plugin

Last synced: 14 Mar 2025

https://github.com/aayushi-as/newsletter-notification-service

Newsletter Notification Service is a backend service built with Spring Boot that facilitates sending bulk emails to users subscribed to various newsletter categories.

avro-schema java maven mysql spring-boot spring-data-jpa spring-kafka spring-security