{"id":23461330,"url":"https://github.com/hhromic/kadumper","last_synced_at":"2026-02-12T23:19:19.693Z","repository":{"id":204568193,"uuid":"710519446","full_name":"hhromic/kadumper","owner":"hhromic","description":"Kafka Avro dumping utility written in Go.","archived":false,"fork":false,"pushed_at":"2025-11-23T22:34:53.000Z","size":99,"stargazers_count":0,"open_issues_count":0,"forks_count":0,"subscribers_count":1,"default_branch":"master","last_synced_at":"2025-11-24T00:19:43.718Z","etag":null,"topics":["avro","dumper","golang","json","kafka","redpanda","schema-registry"],"latest_commit_sha":null,"homepage":"","language":"Go","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/hhromic.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null,"notice":null,"maintainers":null,"copyright":null,"agents":null,"dco":null,"cla":null}},"created_at":"2023-10-26T21:35:02.000Z","updated_at":"2025-11-23T22:34:57.000Z","dependencies_parsed_at":"2023-11-17T20:09:35.196Z","dependency_job_id":"0be1c5a5-a19d-490a-bc17-acbde5eb93e7","html_url":"https://github.com/hhromic/kadumper","commit_stats":null,"previous_names":["hhromic/kadumper"],"tags_count":9,"template":false,"template_full_name":null,"purl":"pkg:github/hhromic/kadumper","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/hhromic%2Fkadumper","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/hhromic%2Fkadumper/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/hhromic%2Fkadumper/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/hhromic%2Fkadumper/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/hhromic","download_url":"https://codeload.github.com/hhromic/kadumper/tar.gz/refs/heads/master","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/hhromic%2Fkadumper/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":29386052,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-02-12T22:07:52.078Z","status":"ssl_error","status_checked_at":"2026-02-12T22:07:49.026Z","response_time":55,"last_error":"SSL_connect returned=1 errno=0 peeraddr=140.82.121.6:443 state=error: unexpected eof while reading","robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":false,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["avro","dumper","golang","json","kafka","redpanda","schema-registry"],"created_at":"2024-12-24T07:34:28.171Z","updated_at":"2026-02-12T23:19:19.688Z","avatar_url":"https://github.com/hhromic.png","language":"Go","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Kafka Avro Dumper\n\nKafka Avro dumping utility written in Go.\n\nMost command-line tools that can consume Avro records from Kafka output data using\n[Avro JSON encoding](https://avro.apache.org/docs/1.12.0/specification/#json-encoding).\nWhen using Avro [union types](https://avro.apache.org/docs/1.12.0/specification/#unions),\nthe Avro JSON encoding includes the specific type in the field to disambiguate.\n\nFor example, for a `bar` field defined as type `[\"null\", \"string\"]` in Avro:\n```json\n{\"foo\":100,\"bar\":{\"string\":\"hello\"}}\n```\n\nWhile the above is necessary for correctly encoding JSON data into Avro, it becomes inconvenient\nwhen decoding plain JSON data from Avro and feeding it into non-Avro applications for processing.\n\nFor a more convenient plain JSON data decoding, this tool uses the\n[`goavro`](https://pkg.go.dev/github.com/linkedin/goavro/v2) library. More specifically, `kadumper`\nuses the [Standard Full JSON](https://pkg.go.dev/github.com/linkedin/goavro/v2#NewCodecForStandardJSONFull)\ncodec which (from the documentation) _provides full serialization/deserialization for JSON data that\nmeets the expectations of regular internet JSON_.\n\nFor the same example `bar` field shown above, `kadumper` outputs the following JSON data:\n```json\n{\"foo\":100,\"bar\":\"hello\"}\n```\n\nIn addition, `kadumper` can also output raw textual data (non-Avro) from Kafka.\n\n## Usage\n\nAll currently available command-line arguments can be seen with `-h/--help`.\n\nConsuming Avro data from Kafka is currently only supported in\n[Confluent Wire format](https://docs.confluent.io/platform/current/schema-registry/fundamentals/serdes-develop/index.html#wire-format)\nwith schemas automatically downloaded from a Schema Registry service.\nDownloaded schemas are cached with a configurable maximum caching age.\n[Confluent Platform](https://docs.confluent.io/platform/current/overview.html) and\n[Redpanda](https://redpanda.com/) have both been tested.\n\nTo output raw textual data (non-Avro) from Kafka, omit the `--schema-registry-url` argument.\n\nOutput Kafka records are separated by a newline `\\n` character. For each record, output timestamps,\npartitions, offsets, keys and values are separated by a TAB `\\t` character. All output is sent to\nthe standard output.\n\nCurrently, only anonymous plain-text and mutual TLS authentication connections are supported.\n\n## Building\n\n\u003e [!NOTE]\n\u003e Ready-to-use binaries are available in the\n\u003e [releases page](https://github.com/hhromic/kadumper/releases).\n\nTo build a snapshot locally using [GoReleaser](https://goreleaser.com/):\n```bash\ngoreleaser build --clean --single-target --snapshot\n```\n\n## Releasing\n\nTo release a new version in GitHub using [GoReleaser](https://goreleaser.com/):\n```bash\ngit tag vX.Y.Z\nCGO_ENABLED=0 GITHUB_TOKEN=$(\u003c /path/to/token) goreleaser release --clean\n```\n\n## License\n\nThis project is licensed under the [Apache License Version 2.0](LICENSE).\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fhhromic%2Fkadumper","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fhhromic%2Fkadumper","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fhhromic%2Fkadumper/lists"}