{"id":14984560,"url":"https://github.com/sansible/kafka","last_synced_at":"2025-04-10T21:20:21.005Z","repository":{"id":74439392,"uuid":"51325012","full_name":"sansible/kafka","owner":"sansible","description":null,"archived":false,"fork":false,"pushed_at":"2020-09-09T08:29:53.000Z","size":94,"stargazers_count":14,"open_issues_count":6,"forks_count":15,"subscribers_count":8,"default_branch":"develop","last_synced_at":"2025-03-24T18:49:35.161Z","etag":null,"topics":["ansible","ansible-role","ansible-roles","kafka"],"latest_commit_sha":null,"homepage":null,"language":"HTML","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/sansible.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2016-02-08T20:31:19.000Z","updated_at":"2020-10-21T20:22:14.000Z","dependencies_parsed_at":"2023-05-04T02:32:32.048Z","dependency_job_id":null,"html_url":"https://github.com/sansible/kafka","commit_stats":{"total_commits":33,"total_committers":11,"mean_commits":3.0,"dds":0.7272727272727273,"last_synced_commit":"8a975143238dd7a7c9e0d729cbeeba0084e0b25d"},"previous_names":[],"tags_count":39,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/sansible%2Fkafka","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/sansible%2Fkafka/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/sansible%2Fkafka/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/sansible%2Fkafka/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/sansible","download_url":"https://codeload.github.com/sansible/kafka/tar.gz/refs/heads/develop","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":248298773,"owners_count":21080396,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["ansible","ansible-role","ansible-roles","kafka"],"created_at":"2024-09-24T14:09:16.258Z","updated_at":"2025-04-10T21:20:20.988Z","avatar_url":"https://github.com/sansible.png","language":"HTML","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Kafka\n\nMaster: [![Build Status](https://travis-ci.org/sansible/kafka.svg?branch=master)](https://travis-ci.org/sansible/kafka)\nDevelop: [![Build Status](https://travis-ci.org/sansible/kafka.svg?branch=develop)](https://travis-ci.org/sansible/kafka)\n\n* [Installation and Dependencies](#installation-and-dependencies)\n* [Tags](#tags)\n* [Examples](#examples)\n\nThis roles installs Apache Kafka server.\n\nFor more information about Kafka please visit\n[zookeeper.apache.org/](http://kafka.apache.org/).\n\n\n\n## Installation and Dependencies\n\nThis role will install `sansible.users_and_groups` for managing `kafka`\nuser.\n\nTo install run `ansible-galaxy install sansible.kafka` or add this to your\n`roles.yml`\n\n```YAML\n- name: sansible.kafka\n  version: v2.0\n```\n\nand run `ansible-galaxy install -p ./roles -r roles.yml`\n\n### AWS Setup\n\nThis role has AWS support built in for deployment/discovery.\n\n#### AWS Tag Discovery\n\nDesigned for instances that are statically defined either as direct EC2\ninstances or via a single ASG per instance.\n\nThe broker.id is derived from a tag attached to the instance, you can turn on\nthis behaviour and specify the tag to lookup like so:\n\n```YAML\n- role: sansible.kafka\n  sansible_kafka_aws_cluster_assigned_id_enabled: yes\n  sansible_kafka_aws_cluster_assigned_id_tag_name: instanceindex\n  # A ZK cluster behind an ELB\n  sansible_kafka_zookeeper_hosts:\n    - zookeeper.app.internal\n```\n\n\n## Tags\n\nThis role uses two tags: **build** and **configure**\n\n* `build` - Installs Kafka server and all its dependencies.\n* `configure` - Configure and ensures that the Kafka service is running.\n\n\n## Examples\n\n```YAML\n- name: Install Kafka Server\n  hosts: sandbox\n\n  pre_tasks:\n    - name: Update apt\n      become: yes\n      apt:\n        cache_valid_time: 1800\n        update_cache: yes\n      tags:\n        - build\n\n  roles:\n    - name: sansible.kafka\n      sansible_kafka_zookeeper_hosts:\n        - my.zookeeper.host\n```\n\n```YAML\n- name: Install Kafka with NewRelic integration\n  hosts: sandbox\n\n  pre_tasks:\n    - name: Update apt\n      become: yes\n      apt:\n        cache_valid_time: 1800\n        update_cache: yes\n      tags:\n        - build\n\n  roles:\n    - name: sansible.kafka\n      sansible_kafka_environment_vars:\n        - \"NEWRELIC_OPTS=\\\"-javaagent:/home/{{ sansible_kafka_user }}/newrelic/newrelic.jar\\\"\"\n        - \"export KAFKA_OPTS=\\\"${KAFKA_OPTS} ${NEWRELIC_OPTS}\\\"\"\n```\n\nIf you just want to test Kafka service build both Zookeeper and Kafka on the\nsame machine.\n\n```YAML\n- name: Install Kafka Server\n  hosts: sandbox\n\n  pre_tasks:\n    - name: Update apt\n      become: yes\n      apt:\n        cache_valid_time: 1800\n        update_cache: yes\n      tags:\n        - build\n\n  roles:\n    - name: sansible.zookeeper\n    - name: sansible.kafka\n```\n\nLogging access denied. These access logs will be placed in `{{ sansible_kafka_log_dir }}/kafka-authorizer.log`.\n```YAML\n- role: sansible.kafka\nsansible_kafka_authorizer_log_level: INFO\n```\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fsansible%2Fkafka","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fsansible%2Fkafka","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fsansible%2Fkafka/lists"}