{"id":22096888,"url":"https://github.com/streamnative/logstash-input-pulsar","last_synced_at":"2025-07-24T22:32:38.070Z","repository":{"id":37703083,"uuid":"380391785","full_name":"streamnative/logstash-input-pulsar","owner":"streamnative","description":null,"archived":false,"fork":false,"pushed_at":"2022-12-14T16:37:14.000Z","size":81,"stargazers_count":12,"open_issues_count":8,"forks_count":17,"subscribers_count":15,"default_branch":"master","last_synced_at":"2024-04-17T17:13:13.683Z","etag":null,"topics":["logstash-input","logstash-plugin","pulsar-io"],"latest_commit_sha":null,"homepage":"","language":"Java","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/streamnative.png","metadata":{"files":{"readme":"README.md","changelog":"CHANGELOG.md","contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":".github/CODEOWNERS","security":null,"support":null}},"created_at":"2021-06-26T01:51:57.000Z","updated_at":"2023-08-11T10:13:21.000Z","dependencies_parsed_at":"2023-01-29T00:04:13.843Z","dependency_job_id":null,"html_url":"https://github.com/streamnative/logstash-input-pulsar","commit_stats":null,"previous_names":[],"tags_count":1,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/streamnative%2Flogstash-input-pulsar","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/streamnative%2Flogstash-input-pulsar/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/streamnative%2Flogstash-input-pulsar/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/streamnative%2Flogstash-input-pulsar/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/streamnative","download_url":"https://codeload.github.com/streamnative/logstash-input-pulsar/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":227482463,"owners_count":17779968,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["logstash-input","logstash-plugin","pulsar-io"],"created_at":"2024-12-01T04:13:07.959Z","updated_at":"2024-12-01T04:13:08.799Z","avatar_url":"https://github.com/streamnative.png","language":"Java","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Logstash Input Pulsar Plugin\n\nThis is a Java plugin for [Logstash](https://github.com/elastic/logstash).\n\nIt is fully free and fully open source. The license is Apache 2.0, meaning you are free to use it however you want.\n\nThis input will read events from a Pulsar topic.\n\nThis plugin uses Pulsar Client 2.10.2. For broker compatibility, see the official Pulsar compatibility reference. If the compatibility wiki is not up-to-date, please contact Pulsar support/community to confirm compatibility.\n\nIf you require features not yet available in this plugin (including client version upgrades), please file an issue with details about what you need.\n\n# Pulsar Input Configuration Options\nThis plugin supports these configuration options. \n\n| Settings                         |                          Input type                          |  Required |\n|----------------------------------|:------------------------------------------------------------:|----------:|\n| serviceUrl                       |                            string                            |       Yes |\n| topics                           |                            array                             |       Yes |\n| subscriptionName                 |                            string                            |       Yes |\n| consumerName                     |                            string                            |       Yes |\n| subscriptionType                 | string, one of[\"Shared\",\"Exclusive\",\"Failover\",\"Key_shared\"] |        No |\n| subscriptionInitialPosition      |             string, one of[\"Latest\",\"Earliest\"]              |        No |\n| codec                            |               string, one of [\"plain\",\"json\"]                |        No |\n| protocols                        |           array, ciphers list. default is TLSv1.2            |        No |\n| ciphers                          |                      array,ciphers list                      |        No |\n| enable_tls                       |       boolean, one of [true, false]. default is false        |        No |\n| tls_trust_store_path             |        string, required if enable_tls is set to true         |        No |\n| tls_trust_store_password         |                   string, default is empty                   |        No |\n| enable_tls_hostname_verification |       boolean, one of [true, false]. default is false        |        No |\n| allow_tls_insecure_connection    |        boolean, one of [true, false].default is false        |        No |\n| auth_plugin_class_name           |                            string                            |        No |\n| auth_params                      |                            string                            |        No |\n\n\n# Example\npulsar without tls \u0026 token\n```\ninput{\n  pulsar{\n    serviceUrl =\u003e \"pulsar://127.0.0.1:6650\"\n    codec =\u003e \"json\"\n    topics =\u003e [ \n        \"persistent://public/default/topic1\", \n        \"persistent://public/default/topic2\"\n    ]\n    subscriptionName =\u003e \"my_consumer\"\n    subscriptionType =\u003e \"Shared\"\n    subscriptionInitialPosition =\u003e \"Earliest\"\n  }\n}\n```\n\npulsar with token\n```\ninput{\n  pulsar{\n    serviceUrl =\u003e \"pulsar://127.0.0.1:6650\"\n    codec =\u003e \"plain\"\n    topics =\u003e [ \n        \"persistent://public/default/topic1\", \n        \"persistent://public/default/topic2\"\n    ]\n    subscriptionName =\u003e \"my_subscription\"\n    subscriptionType =\u003e \"Shared\"\n    subscriptionInitialPosition =\u003e \"Earliest\"\n    auth_plugin_class_name =\u003e \"org.apache.pulsar.client.impl.auth.AuthenticationToken\"\n    auth_params =\u003e \"token:${token}\"\n  }\n}\n```\n\n\n# Installation\n\n1. Get the latest zip file from release page.\nhttps://github.com/streamnative/logstash-input-pulsar/releases\n\n2. Install this plugin using logstash preoffline command.\n\n```\nbin/logstash-plugin install file://{PATH_TO}/logstash-input-pulsar-2.7.1.zip\n```\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fstreamnative%2Flogstash-input-pulsar","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fstreamnative%2Flogstash-input-pulsar","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fstreamnative%2Flogstash-input-pulsar/lists"}