{"id":15111283,"url":"https://github.com/inozpavel/kafka-reader","last_synced_at":"2026-02-22T23:04:37.431Z","repository":{"id":257306412,"uuid":"857690908","full_name":"Inozpavel/kafka-reader","owner":"Inozpavel","description":"Web api for reading and filtering kafka messages in different formats","archived":false,"fork":false,"pushed_at":"2024-12-10T20:49:07.000Z","size":287,"stargazers_count":2,"open_issues_count":0,"forks_count":0,"subscribers_count":1,"default_branch":"master","last_synced_at":"2025-04-12T02:24:42.509Z","etag":null,"topics":["json","kafka","kafka-consumer","librdkafka","protobuf","rust","tonic"],"latest_commit_sha":null,"homepage":"","language":"Rust","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/Inozpavel.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2024-09-15T10:54:19.000Z","updated_at":"2024-12-10T20:49:10.000Z","dependencies_parsed_at":null,"dependency_job_id":"c7bf2926-6a00-40f2-bdc9-269fae7732e0","html_url":"https://github.com/Inozpavel/kafka-reader","commit_stats":{"total_commits":114,"total_committers":2,"mean_commits":57.0,"dds":0.02631578947368418,"last_synced_commit":"36ecec7d0eff6002a0b48903eb5258067149f70b"},"previous_names":["inozpavel/kafka-reader"],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Inozpavel%2Fkafka-reader","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Inozpavel%2Fkafka-reader/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Inozpavel%2Fkafka-reader/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Inozpavel%2Fkafka-reader/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/Inozpavel","download_url":"https://codeload.github.com/Inozpavel/kafka-reader/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":248506310,"owners_count":21115416,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["json","kafka","kafka-consumer","librdkafka","protobuf","rust","tonic"],"created_at":"2024-09-26T00:03:02.398Z","updated_at":"2025-10-28T21:08:27.967Z","avatar_url":"https://github.com/Inozpavel.png","language":"Rust","funding_links":[],"categories":[],"sub_categories":[],"readme":"# kafka-reader\n\nWeb api service for debugging, reading, producing and filtering kafka messages in different formats\n\n## Features\n\nService has grpc api with streaming endpoint for\nmessages ([proto file contract](kafka_reader_api/src/protos/kafka_service.proto)). Grpc service supports\nreflection\n\nSupported message decode formats, separated for key and body:\n\n+ Ignore (null)\n+ String\n+ Hex\n+ Protobuf\n    + Single proto file (add to request)\n\nSupported topic read start settings:\n\n+ From beginning\n+ From latest\n+ From today\n+ From time\n\nSupported topic read limit filters:\n\n+ No limit - steaming will be infinite, will parse new messages\n+ Message count - certain message count from all partition in sum\n+ To time\n\nSupported value filters for key and body:\n\n+ Filter kind\n    + String\n    + Regex\n\n+ Conditions:\n    + Contains\n    + Not contains\n\nSupported produce formats:\n\n+ String\n+ Base64\n+ Hex\n+ Protobuf\n\nSupported security protocols:\n\n+ Plaintext\n+ Ssl\n\n## Settings\n\nEnvironment variables:\n\n`APP__HOST` - listener ip\n`APP__PORT` - listener port\n`RUST_LOG` = log level, format: https://docs.rs/env_logger/latest/env_logger/#enabling-logging\n`RD_KAFKA_DEBUG` - debug value for librdkafka. For values\nsee [official docs](https://raw.githubusercontent.com/confluentinc/librdkafka/master/CONFIGURATION.md)\n\n## Build from source\n\nInstall rust https://www.rust-lang.org/tools/install\nInstall cmake https://cmake.org/\n\n### Windows\n\n```bash\ngit clone https://github.com/microsoft/vcpkg\ncd vcpkg\n./bootstrap-vcpkg.bat\n\nvcpkg install --triplet=x64-windows-static openssl\n\nset OPENSSL_ROOT_DIR=С:\\path\\to\\vcpkg\\installed # example C:\\vcpkg\\installed\\x64-windows-static\n\ncargo build --release\n```\n\n### Linux\n\n```bash\nsudo apt install opensll cmake\n\ncargo build --release\n```\n\nApp will be available in ./target/release","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Finozpavel%2Fkafka-reader","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Finozpavel%2Fkafka-reader","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Finozpavel%2Fkafka-reader/lists"}