{"id":14994555,"url":"https://github.com/jcustenborder/puppet-confluent","last_synced_at":"2025-07-09T15:40:24.227Z","repository":{"id":45649419,"uuid":"55732504","full_name":"jcustenborder/puppet-confluent","owner":"jcustenborder","description":"Puppet Module for installing and configuring the Confluent Platform","archived":false,"fork":false,"pushed_at":"2021-12-02T17:55:51.000Z","size":350,"stargazers_count":14,"open_issues_count":12,"forks_count":15,"subscribers_count":4,"default_branch":"master","last_synced_at":"2025-05-30T04:57:39.308Z","etag":null,"topics":["confluent","kafka","puppet","schema-registry"],"latest_commit_sha":null,"homepage":"http://www.confluent.io","language":"Puppet","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/jcustenborder.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null}},"created_at":"2016-04-07T22:31:47.000Z","updated_at":"2021-04-07T18:14:15.000Z","dependencies_parsed_at":"2022-09-02T13:31:22.127Z","dependency_job_id":null,"html_url":"https://github.com/jcustenborder/puppet-confluent","commit_stats":null,"previous_names":[],"tags_count":1,"template":false,"template_full_name":null,"purl":"pkg:github/jcustenborder/puppet-confluent","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/jcustenborder%2Fpuppet-confluent","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/jcustenborder%2Fpuppet-confluent/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/jcustenborder%2Fpuppet-confluent/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/jcustenborder%2Fpuppet-confluent/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/jcustenborder","download_url":"https://codeload.github.com/jcustenborder/puppet-confluent/tar.gz/refs/heads/master","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/jcustenborder%2Fpuppet-confluent/sbom","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":263758218,"owners_count":23506844,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["confluent","kafka","puppet","schema-registry"],"created_at":"2024-09-24T16:03:51.261Z","updated_at":"2025-07-09T15:40:24.152Z","avatar_url":"https://github.com/jcustenborder.png","language":"Puppet","funding_links":[],"categories":[],"sub_categories":[],"readme":"## Introduction\n\nThis puppet module is used to install and configure the Confluent Platform. The documentation is available [here](http://jcustenborder.github.io/puppet-confluent/).\n\n## Note on versioning\n\nPuppet only allows version numbers in `\u003cmajor\u003e.\u003cminor\u003e.\u003cversion\u003e` format. Due to this limitation the versioning schema matches \nthe major and minor versions of the Confluent Platform. Meaning 3.2.1234 of the puppet module is for 3.2.x of the Confluent platform.\n\n### Usage\n\n## Zookeeper\n\n### Class installation\n\n```puppet\nclass{'confluent::zookeeper':\n  zookeeper_id =\u003e '1',\n  heap_size =\u003e '4000M'\n}\n```\n\n### Hiera Installation\n\n```puppet\ninclude ::confluent::zookeeper\n```\n\n```yaml\nconfluent::zookeeper::zookeeper_id: '1'\nconfluent::zookeeper::config:\n  server.1:\n    value: 'zookeeper-01.example.com:2888:3888'\n  server.2:\n    value: 'zookeeper-02.example.com:2888:3888'\n  server.3:\n    value: 'zookeeper-03.example.com:2888:3888'\nconfluent::zookeeper::heap_size: '4000M'\n```\n\n## Kafka Broker\n\n### Class installation\n\n```puppet\nclass{'confluent::kafka::broker':\n  broker_id =\u003e '1',\n  zookeeper_connect =\u003e [\n    'zookeeper-01:2181',\n    'zookeeper-02:2181',\n    'zookeeper-03:2181'\n  ],\n  heap_size =\u003e '4000M'\n}\n```\n\n### Heira installation\n\n```puppet\ninclude ::confluent::kafka::broker\n```\n\n```yaml\nconfluent::kafka::broker::broker_id: '1'\nconfluent::kafka::broker::heap_size: '4000M'\nconfluent::kafka::broker::zookeeper_connect:\n  - 'zookeeper-01:2181',\n  - 'zookeeper-02:2181',\n  - 'zookeeper-03:2181'\nconfluent::kafka::broker::data_path: '/var/lib/kafka'\n```\n\n## Kafka Connect\n\n### Distributed\n\n#### Class Installation\n\n```puppet\nclass{'confluent::kafka::connect::distributed':\n  heap_size =\u003e '4000M',\n  bootstrap_servers =\u003e [\n    'broker-01:9092',\n    'broker-02:9092',\n    'broker-03:9092'\n  ],\n  config =\u003e {\n    'key.converter' =\u003e {\n      'value' =\u003e 'io.confluent.connect.avro.AvroConverter'\n    },\n    'value.converter' =\u003e {\n      'value' =\u003e 'io.confluent.connect.avro.AvroConverter'\n    },\n    'key.converter.schema.registry.url' =\u003e {\n      'value' =\u003e 'http://schema-registry-01:8081'\n    },\n    'value.converter.schema.registry.url' =\u003e {\n      'value' =\u003e 'http://schema-registry-01:8081'\n    },\n  },\n}\n```\n\n#### Heira installation\n\n```puppet\ninclude ::confluent::kafka::connect::distributed\n```\n\n```yaml\n confluent::kafka::connect::distributed::heap_size: '4000M'\n confluent::kafka::connect::distributed::bootstrap_servers:\n  - broker-01:9092\n  - broker-02:9092\n  - broker-03:9092\n confluent::kafka::connect::distributed::config:\n   'key.converter':\n     value: 'io.confluent.connect.avro.AvroConverter'\n   'value.converter':\n     value: 'io.confluent.connect.avro.AvroConverter'\n   'key.converter.schema.registry.url':\n     value: 'http://schema-registry-01.example.com:8081'\n   'value.converter.schema.registry.url':\n     value: 'http://schema-registry-01.example.com:8081'\n```\n\n### Standalone\n\n#### Class Installation\n\n```puppet\nclass{'confluent::kafka::connect::standalone':\n  heap_size =\u003e '4000M',\n  bootstrap_servers =\u003e [\n    'broker-01:9092',\n    'broker-02:9092',\n    'broker-03:9092'\n  ],\n  config =\u003e {\n    'key.converter' =\u003e {\n      'value' =\u003e 'io.confluent.connect.avro.AvroConverter'\n    },\n    'value.converter' =\u003e {\n      'value' =\u003e 'io.confluent.connect.avro.AvroConverter'\n    },\n    'key.converter.schema.registry.url' =\u003e {\n      'value' =\u003e 'http://schema-registry-01:8081'\n    },\n    'value.converter.schema.registry.url' =\u003e {\n      'value' =\u003e 'http://schema-registry-01:8081'\n    },\n  },\n}\n```\n\n#### Heira installation\n\n```puppet\ninclude ::confluent::kafka::connect::standalone\n```\n\n```yaml\n confluent::kafka::connect::standalone::heap_size: '4000M'\n confluent::kafka::connect::standalone::bootstrap_servers:\n  - broker-01:9092\n  - broker-02:9092\n  - broker-03:9092\n confluent::kafka::connect::standalone::config:\n   'key.converter':\n     value: 'io.confluent.connect.avro.AvroConverter'\n   'value.converter':\n     value: 'io.confluent.connect.avro.AvroConverter'\n   'key.converter.schema.registry.url':\n     value: 'http://schema-registry-01.example.com:8081'\n   'value.converter.schema.registry.url':\n     value: 'http://schema-registry-01.example.com:8081'\n```\n\n## Schema Registry\n\n### Class installation\n```puppet\nclass {'confluent::schema::registry':\n  heap_size =\u003e '1024M',\n  kafkastore_connection_url =\u003e [\n      'zookeeper-01:2181',\n      'zookeeper-02:2181',\n      'zookeeper-03:2181'\n  ]\n}\n```\n\n### Hiera installation\n\n```puppet\ninclude ::confluent::schema::registry\n```\n\n```yaml\nconfluent::schema::registry::heap_size: '1024M'\nconfluent::schema::registry::kafkastore_connection_url:\n  - 'zookeeper-01:2181'\n  - 'zookeeper-02:2181'\n  - 'zookeeper-03:2181'\n```\n\n## Confluent Control Center\n\n### Class installation\n\n```puppet\nclass {'confluent::control::center':\n  heap_size =\u003e '6g',\n  zookeeper_connect =\u003e [\n    'zookeeper-01:2181',\n    'zookeeper-02:2181',\n    'zookeeper-03:2181'\n  ],\n  bootstrap_servers =\u003e [\n    'broker-01:9092',\n    'broker-02:9092',\n    'broker-03:9092'\n  ],\n  connect_cluster =\u003e [\n    'kafka-connect-01.example.com:8083',\n    'kafka-connect-02.example.com:8083',\n    'kafka-connect-03.example.com:8083'\n  ]\n}\n```\n\n### Hiera installation\n\n```puppet\ninclude ::confluent::control::center\n```\n\n```yaml\nconfluent::control::center::heap_size: '6g'\nconfluent::control::center::zookeeper_connect: \n  - 'zookeeper-01:2181'\n  - 'zookeeper-02:2181'\n  - 'zookeeper-03:2181'\nconfluent::control::center::bootstrap_servers: \n  - 'broker-01:9092'\n  - 'broker-02:9092'\n  - 'broker-03:9092'\nconfluent::control::center::connect_cluster: \n  - 'kafka-connect-01.example.com:8083'\n  - 'kafka-connect-02.example.com:8083'\n  - 'kafka-connect-03.example.com:8083'\n```\n\n# Run tests\n\n```bash\nrake spec\n```\n\n# Rebuild github pages\n\n```bash\nrake strings:gh_pages:update\n```","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fjcustenborder%2Fpuppet-confluent","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fjcustenborder%2Fpuppet-confluent","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fjcustenborder%2Fpuppet-confluent/lists"}