{"id":15080941,"url":"https://github.com/ait-testbed/atb-ansible-kafka","last_synced_at":"2026-03-04T14:32:29.768Z","repository":{"id":233557081,"uuid":"787443902","full_name":"ait-testbed/atb-ansible-kafka","owner":"ait-testbed","description":"Ansible role for installing a kafka broker on testbeds","archived":false,"fork":false,"pushed_at":"2025-04-30T15:06:12.000Z","size":32,"stargazers_count":0,"open_issues_count":0,"forks_count":2,"subscribers_count":2,"default_branch":"main","last_synced_at":"2025-09-10T06:13:52.542Z","etag":null,"topics":["aecid","ansible","ansible-role","atb","logs","pipeline","testbed"],"latest_commit_sha":null,"homepage":"","language":"Jinja","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/ait-testbed.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null,"notice":null,"maintainers":null,"copyright":null,"agents":null,"dco":null,"cla":null}},"created_at":"2024-04-16T14:31:20.000Z","updated_at":"2025-04-30T15:05:39.000Z","dependencies_parsed_at":null,"dependency_job_id":"12d26624-5b27-41ab-a33c-c85c694cb176","html_url":"https://github.com/ait-testbed/atb-ansible-kafka","commit_stats":null,"previous_names":["ait-testbed/atb-ansible-kafka"],"tags_count":3,"template":false,"template_full_name":null,"purl":"pkg:github/ait-testbed/atb-ansible-kafka","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ait-testbed%2Fatb-ansible-kafka","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ait-testbed%2Fatb-ansible-kafka/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ait-testbed%2Fatb-ansible-kafka/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ait-testbed%2Fatb-ansible-kafka/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/ait-testbed","download_url":"https://codeload.github.com/ait-testbed/atb-ansible-kafka/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ait-testbed%2Fatb-ansible-kafka/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":30083761,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-03-04T13:22:36.021Z","status":"ssl_error","status_checked_at":"2026-03-04T13:20:45.750Z","response_time":59,"last_error":"SSL_read: unexpected eof while reading","robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":false,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["aecid","ansible","ansible-role","atb","logs","pipeline","testbed"],"created_at":"2024-09-25T05:33:52.904Z","updated_at":"2026-03-04T14:32:29.750Z","avatar_url":"https://github.com/ait-testbed.png","language":"Jinja","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Ansible role for kafka\n\nThis role installs the kafka message broker. This installation \nis rather meant for testbeds and not for production use cases.\n\n# Requirements\n- Ubuntu\n\n# Configuration\n\nThe following defaults can be used:\n\n```\nkafka_openjdk: 'openjdk-21-jdk'\nkafka_server_template: server.properties.j2\nkafka_url: https://downloads.apache.org/kafka/3.7.0/kafka_2.13-3.7.0.tgz\nkafka_version: kafka_2.13-3.7.0\nkafka_heapopts: '-Xmx1G -Xms1G'\nkafka_dir: '/usr/local/kafka'\nkafka_keydir: '{{kafka_dir}}/keydir'\nkafka_ssl_serverkeystorepw: 'Enoog9queiHeecu'\nkafka_ssl_serverkeypass: '{{kafka_ssl_serverkeystorepw}}'\nkafka_ssl_cakeypw: 'iceDaig8Ahghija'\nkafka_ssl_servertruststorepw: 'thaeFa9genguu1o'\nkafka_ssl_clienttruststorepw: 'eexuongeeWah3vi'\nkafka_logdir: '/var/lib/kafka'\nkafka_zoodir: '/var/lib/zookeeper'\nkafka_brokerid: 0\nkafka_auto_create_topics: true\n# The minimum age of a log file to be eligible for deletion due to age (in hours)\nkafka_log_retention: 96\nkafka_zookeeper: localhost:2181\nkafka_logsegment_bytes: 1073741824\nkafka_log_retention_check_interval: 300000\nkafka_listeners: 'INTERNAL://localhost:9093,EXTERNAL://:9092'\nkafka_advertised_listeners: 'INTERNAL://localhost:9093,EXTERNAL://:9092'\nkafka_listener_security_proto_map: 'INTERNAL:SSL,EXTERNAL:PLAINTEXT,CONTROLLER:SSL'\n```\n\n# Usage\n\nSimply put this role to the \"roles\"-folder and use the following playbook.yml:\n```\n---\n\n- hosts: localhost\n  become: true\n  roles:\n    - kafka\n\n```\n\n## Install Ansible and deploy Kafka:\n\nUbuntu:\n```\napt install ansible git\n\ngit clone https://github.com/ait-testbed/atb-ansible-kafka.git /etc/ansible/roles/kafka\n\ncat \u003e /etc/ansible/kafka.yml \u003c\u003c EOF\n---\n- hosts: localhost\n  become: true\n  roles:\n    - kafka\nEOF\n\ncd /etc/ansible\nansible-playbook kafka.yml\n```\n\n\n# Testing Kafka\n\n## Using the PLAINTEXT-Listener:\n\n```\nroot@localhost ~]# /usr/local/kafka/bin/kafka-topics.sh --create --bootstrap-server localhost:9092 --topic TestTopic\nCreated topic \"TestTopic\".\n[root@localhost ~]# cd /usr/local/kafka/\n[root@localhost kafka]# echo \"Hello, World\" | /usr/local/kafka/bin/kafka-console-producer.sh --broker-list localhost:9092 --producer.config /usr/local/kafka/config/producer.properties --topic TestTopic \u003e /dev/null\n[root@localhost kafka]# /usr/local/kafka/bin/kafka-console-consumer.sh --bootstrap-server localhost:9092 --consumer.config /usr/local/kafka/config/consumer.properties --topic TestTopic --from-beginning\nHello, World\n^CProcessed a total of 1 messages\n```\n\n## Using the SSL-Listener:\n\n```\nroot@localhost ~]# /usr/local/kafka/bin/kafka-topics.sh --create --bootstrap-server localhost:9092 --topic TestTopic\nCreated topic \"TestTopic\".\n[root@localhost ~]# cd /usr/local/kafka/\n[root@localhost kafka]# echo \"Hello, World\" | /usr/local/kafka/bin/kafka-console-producer.sh --broker-list localhost:9093 --producer.config /usr/local/kafka/config/client-ssl.properties --topic TestTopic \u003e /dev/null\n[root@localhost kafka]# /usr/local/kafka/bin/kafka-console-consumer.sh --bootstrap-server localhost:9093 --consumer.config /usr/local/kafka/config/client-ssl.properties --topic TestTopic --from-beginning\nHello, World\n^CProcessed a total of 1 messages\n```\n\n## Starting a consumer:\n\n```\n/usr/local/kafka/bin/kafka-console-consumer.sh --topic TestTopic --bootstrap-server localhost:9092\n```\n\n## Starting a producer:\n\n```\necho \"Hallo Welt\" | /usr/local/kafka/bin/kafka-console-producer.sh --topic TestTopic --bootstrap-server localhost:9092\n```\n## Example playbook:\n\n```yaml\n- name: Install Kafka Host\n  hosts: all\n  remote_user: ubuntu\n  become: true\n  tasks:\n    - name: Install Reposerver Packages\n      ansible.builtin.apt:\n          pkg:\n            - curl\n            - netcat-traditional\n          update_cache: yes\n  roles:\n          - role: hostname\n            vars:\n                  hostname: kafka\n                  hostname_ip: 192.168.100.10\n                  hostname_fqdn: kafka.aecid-testbed.local\n          - role: kafka\n```\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fait-testbed%2Fatb-ansible-kafka","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fait-testbed%2Fatb-ansible-kafka","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fait-testbed%2Fatb-ansible-kafka/lists"}