{"id":15323756,"url":"https://github.com/mvrilo/conduit-connector-pulsar","last_synced_at":"2025-10-09T10:31:35.803Z","repository":{"id":232387772,"uuid":"727210274","full_name":"mvrilo/conduit-connector-pulsar","owner":"mvrilo","description":null,"archived":true,"fork":false,"pushed_at":"2023-12-12T23:05:45.000Z","size":74,"stargazers_count":2,"open_issues_count":2,"forks_count":0,"subscribers_count":0,"default_branch":"main","last_synced_at":"2025-03-26T19:02:13.682Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":null,"language":"Go","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/mvrilo.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE.md","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":".github/CODEOWNERS","security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2023-12-04T12:10:45.000Z","updated_at":"2023-12-13T12:38:10.000Z","dependencies_parsed_at":null,"dependency_job_id":"1729a56f-5db1-4a58-be75-0577e859c0a2","html_url":"https://github.com/mvrilo/conduit-connector-pulsar","commit_stats":null,"previous_names":["mvrilo/conduit-connector-pulsar"],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/mvrilo/conduit-connector-pulsar","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/mvrilo%2Fconduit-connector-pulsar","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/mvrilo%2Fconduit-connector-pulsar/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/mvrilo%2Fconduit-connector-pulsar/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/mvrilo%2Fconduit-connector-pulsar/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/mvrilo","download_url":"https://codeload.github.com/mvrilo/conduit-connector-pulsar/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/mvrilo%2Fconduit-connector-pulsar/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":279001275,"owners_count":26083040,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","status":"online","status_checked_at":"2025-10-09T02:00:07.460Z","response_time":59,"last_error":null,"robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":true,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-10-01T09:21:41.312Z","updated_at":"2025-10-09T10:31:35.797Z","avatar_url":"https://github.com/mvrilo.png","language":"Go","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Conduit Connector Pulsar\n\nThe Apache Pulsar connector is one of [Conduit](https://github.com/ConduitIO/conduit) builtin plugins. It provides both, a\nsource and a destination connector for [Apache Pulsar](https://pulsar.apache.org).\n\n## How to build?\n\nRun `make build` to build the connector.\n\n## Testing\n\nRun `make test` to run all the unit and integration tests. Tests require Docker to be installed and running. The command\nwill handle starting and stopping docker containers for you.\n\nTests will run twice, once against an Apache Pulsar instance.\n\n## Source\n\nA Pulsar source connector is represented by a single consumer. By virtue of that, a source's\nlogical position is the respective consumer's offset in Pulsar. Internally, though, we're not saving the offset as the\nposition: instead, we're saving the consumer group ID, since that's all which is needed for Pulsar to find the offsets\nfor our consumer.\n\nA source is getting associated with a consumer group ID the first time the `Read()` method is called.\n\n### Configuration\n\n| name                 | description                                                                                                                                                                                                  | required | default value             |\n|----------------------|--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|----------|---------------------------|\n| `url`             | URLs is the address of Apache Pulsar server.                                                                                                                                                              | true     |                           |\n| `topic`              | Topic is the Pulsar topic from which records will be read.                                                                                                                                                   | true     |                           |\n| `subscriptionName`   | A subscription name.                                                                                                                                                                                           | false    | `conduit-connector-pulsar` |\n| `groupID`            | Defines the consumer group ID.                                                                                                                                                                               | false    |                           |\n| `clientCert`         | A certificate for the Pulsar client, in PEM format. If provided, the private key needs to be provided too.                                                                                                    | false    |                           |\n| `clientKey`          | A private key for the Pulsar client, in PEM format. If provided, the certificate needs to be provided too.                                                                                                    | false    |                           |\n| `caCert`             | The Pulsar broker's certificate, in PEM format.                                                                                                                                                               | false    |                           |\n| `insecureSkipVerify` | Controls whether a client verifies the server's certificate chain and host name. If `true`, accepts any certificate presented by the server and any host name in that certificate.                           | false    | `false`                   |\n\n## Destination\n\nThe destination connector sends records to Pulsar.\n\n### Configuration\n\nThere's no global, connector configuration. Each connector instance is configured separately.\n\n| name                 | description                                                                                                                                                                                                                                                          | required | default value             |\n|----------------------|----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|----------|---------------------------|\n| `url`            | URLs is the address of Apache Pulsar server.                                                                                                                                                                            | true     |                           |\n| `topic`              | Topic is the Pulsar topic into which records will be written.                                                                                                                                                                                                         | true     |                           |\n| `clientID`           | A Pulsar client ID.                                                                                                                                                                                                                                                   | false    | `conduit-connector-pulsar` |\n| `acks`               | Acks defines the number of acknowledges from partition replicas required before receiving a response to a produce request. `none` = fire and forget, `one` = wait for the leader to acknowledge the writes, `all` = wait for the full ISR to acknowledge the writes. | false    | `all`                     |\n| `deliveryTimeout`    | Message delivery timeout.                                                                                                                                                                                                                                            | false    |                           |\n| `clientCert`         | A certificate for the Pulsar client, in PEM format. If provided, the private key needs to be provided too.                                                                                                                                                            | false    |                           |\n| `clientKey`          | A private key for the Pulsar client, in PEM format. If provided, the certificate needs to be provided too.                                                                                                                                                            | false    |                           |\n| `caCert`             | The Pulsar broker's certificate, in PEM format.                                                                                                                                                                                                                       | false    |                           |\n| `insecureSkipVerify` | Controls whether a client verifies the server's certificate chain and host name. If `true`, accepts any certificate presented by the server and any host name in that certificate.                                                                                   | false    | `false`                   |\n\n### Output format\n\nThe output format can be adjusted using configuration options provided by the connector SDK:\n\n- `sdk.record.format`: used to choose the format\n- `sdk.record.format.options`: used to configure the specifics of the chosen format\n\nSee [this article](https://conduit.io/docs/connectors/output-formats) for more info\non configuring the output format.\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fmvrilo%2Fconduit-connector-pulsar","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fmvrilo%2Fconduit-connector-pulsar","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fmvrilo%2Fconduit-connector-pulsar/lists"}