{"id":17553976,"url":"https://github.com/mihaibogdaneugen/confluent-platform-scripts","last_synced_at":"2025-04-24T03:45:18.419Z","repository":{"id":90361245,"uuid":"102768050","full_name":"MihaiBogdanEugen/confluent-platform-scripts","owner":"MihaiBogdanEugen","description":"Docker and Kubernetes scripts for using the Confluent Open Source Platform with Oracle JDK","archived":false,"fork":false,"pushed_at":"2017-11-28T12:15:44.000Z","size":89,"stargazers_count":6,"open_issues_count":0,"forks_count":0,"subscribers_count":1,"default_branch":"master","last_synced_at":"2025-04-24T03:45:12.789Z","etag":null,"topics":["confluent-kafka","docker-compose","oracle-jdk"],"latest_commit_sha":null,"homepage":"","language":"Shell","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/MihaiBogdanEugen.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2017-09-07T17:47:41.000Z","updated_at":"2020-02-14T19:55:20.000Z","dependencies_parsed_at":null,"dependency_job_id":"c2bc45d3-4f58-47ef-acbb-28d358bd45c4","html_url":"https://github.com/MihaiBogdanEugen/confluent-platform-scripts","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/MihaiBogdanEugen%2Fconfluent-platform-scripts","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/MihaiBogdanEugen%2Fconfluent-platform-scripts/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/MihaiBogdanEugen%2Fconfluent-platform-scripts/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/MihaiBogdanEugen%2Fconfluent-platform-scripts/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/MihaiBogdanEugen","download_url":"https://codeload.github.com/MihaiBogdanEugen/confluent-platform-scripts/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":250559995,"owners_count":21450168,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["confluent-kafka","docker-compose","oracle-jdk"],"created_at":"2024-10-21T06:44:05.921Z","updated_at":"2025-04-24T03:45:18.406Z","avatar_url":"https://github.com/MihaiBogdanEugen.png","language":"Shell","funding_links":[],"categories":[],"sub_categories":[],"readme":"## Scripts for the [Confluent Open Source Platform] using [Oracle JDK] ##\n\n### Running using Docker-Compose ###\n\n#### Versions used: ####\n\n```shell\ndocker --version \u0026\u0026 docker-compose --version \u0026\u0026 docker-machine --version\n```\n\n```\nDocker version 17.09.0-ce, build afdb6d4\ndocker-compose version 1.16.1, build 6d1ac21\ndocker-machine version 0.12.2, build 9371605\n```\n\n#### Prerequisites: ####\n\nIf you’re running on Windows or Mac OS X, you’ll need to use [Docker Machine] to start the Docker host. Docker runs natively on Linux, so the Docker host will be your local machine if you go that route. Otherwise, be sure to allocate at least 6 GBs RAM to the [Docker Machine].\n\n- Create the [Docker Machine], using 6 GBs and 2 CPUs - [docker-machine-create.sh](https://github.com/MihaiBogdanEugen/confluent-platform-scripts/blob/master/docker-compose/docker-machine-create.sh)\n- Start the [Docker Machine] - [docker-machine-start.sh](https://github.com/MihaiBogdanEugen/confluent-platform-scripts/blob/master/docker-compose/docker-machine-start.sh)\n- Status of the [Docker Machine] - [docker-machine-status.sh](https://github.com/MihaiBogdanEugen/confluent-platform-scripts/blob/master/docker-compose/docker-machine-status.sh)\n- Stop the [Docker Machine] - [docker-machine-stop.sh](https://github.com/MihaiBogdanEugen/confluent-platform-scripts/blob/master/docker-compose/docker-machine-stop.sh)\n- Remove the [Docker Machine] - [docker-machine-rm.sh](https://github.com/MihaiBogdanEugen/confluent-platform-scripts/blob/master/docker-compose/docker-machine-rm.sh)\n\nDon't forget to check the [Important Notes/Caveats] from the [Official Documentation].\n\n#### 1. ZooKeeper: ####\n\n1.1. Single [Apache ZooKeeper] node - [docker-compose.yml](https://github.com/MihaiBogdanEugen/confluent-platform-scripts/blob/master/docker-compose/single-zk/docker-compose.yml)\n\n1.2. Cluster of 3 [Apache ZooKeeper] nodes - [docker-compose.yml](https://github.com/MihaiBogdanEugen/confluent-platform-scripts/blob/master/docker-compose/cluster-zkX3/docker-compose.yml)\n- Check if leader election succeded - [cluster-zkX3-check.sh](https://github.com/MihaiBogdanEugen/confluent-platform-scripts/blob/master/docker-compose/cluster-zkX3/cluster-zkX3-check.sh)\n\n#### 2. Kafka: ####\n\n2.1. A single [Apache ZooKeeper] node, plus a single [Apache Kafka] node - [docker-compose.yml](https://github.com/MihaiBogdanEugen/confluent-platform-scripts/blob/master/docker-compose/single-zk-kfk/docker-compose.yml)\n\n2.2. Cluster of 3 [Apache ZooKeeper] nodes, plus 5 [Apache Kafka] nodes - [docker-compose.yml](https://github.com/MihaiBogdanEugen/confluent-platform-scripts/blob/master/docker-compose/cluster-zkX3-kfkX5/docker-compose.yml)\n- Check if ZooKeeper leader election succeded and if all Kafka brokers know about each other - [cluster-zkX3-kfkX3-check.sh](https://github.com/MihaiBogdanEugen/confluent-platform-scripts/blob/master/docker-compose/cluster-zkX3-kfkX5/cluster-zkX3-kfkX5-check.sh)\n\n#### 3. Kafka, Schema Registry and REST Proxy: #####\n\n3.1. A single [Apache ZooKeeper] node, plus a single [Apache Kafka] node, a [Schema Registry] node and a [REST Proxy] node - [docker-compose.yml](https://github.com/MihaiBogdanEugen/confluent-platform-scripts/blob/master/docker-compose/single-zk-kfk-sr-rp/docker-compose.yml)\n\n3.2. Cluster of 3 [Apache ZooKeeper] nodes, plus 5 [Apache Kafka] nodes, a [Schema Registry] node and a [REST Proxy] node - [docker-compose.yml](https://github.com/MihaiBogdanEugen/confluent-platform-scripts/blob/master/docker-compose/cluster-zkX3-kfkX5-sr-rp/docker-compose.yml)\n- Check if ZooKeeper leader election succeded and if all Kafka brokers know about each other - [cluster-zkX3-kfkX3-sr-rp-check.sh](https://github.com/MihaiBogdanEugen/confluent-platform-scripts/blob/master/docker-compose/cluster-zkX3-kfkX5-sr-rp/cluster-zkX3-kfkX5-sr-rp-check.sh)\n\n### Running using Kubernetes: ###\n\n#### Versions used: ####\n\n```shell\nkubectl version\n```\n\n```\nClient Version: version.Info{Major:\"1\", Minor:\"8\", GitVersion:\"v1.8.3\", GitCommit:\"f0efb3cb883751c5ffdbe6d515f3cb4fbe7b7acd\", GitTreeState:\"clean\", BuildDate:\"2017-11-09T07:27:47Z\", GoVersion:\"go1.9.2\", Compiler:\"gc\", Platform:\"darwin/amd64\"}\nServer Version: version.Info{Major:\"1\", Minor:\"7\", GitVersion:\"v1.7.8\", GitCommit:\"bc6162cc70b4a39a7f39391564e0dd0be60b39e9\", GitTreeState:\"clean\", BuildDate:\"2017-10-05T06:35:40Z\", GoVersion:\"go1.8.3\", Compiler:\"gc\", Platform:\"linux/amd64\"}\n```\n\n#### 0. Prerequisites: ####\n\nCreate a dedicated namespace - [Namespace](https://github.com/MihaiBogdanEugen/confluent-platform-scripts/blob/master/kubernetes/0_prerequisites/namespace.yml)\n\n#### 1. ZooKeeper: ####\n- [Service](https://github.com/MihaiBogdanEugen/confluent-platform-scripts/blob/master/kubernetes/1_zookeeper/zookeeper-service.yml)\n- [ConfigMap](https://github.com/MihaiBogdanEugen/confluent-platform-scripts/blob/master/kubernetes/1_zookeeper/zookeeper-configmap.yml)\n- [PodDisruptionBudget](https://github.com/MihaiBogdanEugen/confluent-platform-scripts/blob/master/kubernetes/1_zookeeper/zookeeper-poddisruptionbudget.yml)\n- [Deployment](https://github.com/MihaiBogdanEugen/confluent-platform-scripts/blob/master/kubernetes/1_zookeeper/zookeeper-deployment.yml) or [StatefulSet](https://github.com/MihaiBogdanEugen/confluent-platform-scripts/blob/master/kubernetes/1_zookeeper/zookeeper-statefulset.yml)\n\n#### 2. Kafka: ####\n- [Service](https://github.com/MihaiBogdanEugen/confluent-platform-scripts/blob/master/kubernetes/2_kafka/kafka-service.yml)\n- [ConfigMap](https://github.com/MihaiBogdanEugen/confluent-platform-scripts/blob/master/kubernetes/2_kafka/kafka-configmap.yml)\n- [PodDisruptionBudget](https://github.com/MihaiBogdanEugen/confluent-platform-scripts/blob/master/kubernetes/2_kafka/kafka-poddisruptionbudget.yml)\n- [Deployment](https://github.com/MihaiBogdanEugen/confluent-platform-scripts/blob/master/kubernetes/2_kafka/kafka-deployment.yml) or [StatefulSet](https://github.com/MihaiBogdanEugen/confluent-platform-scripts/blob/master/kubernetes/2_kafka/kafka-statefulset.yml)\n\n#### 3. Schema Registry: ####\n- [Service](https://github.com/MihaiBogdanEugen/confluent-platform-scripts/blob/master/kubernetes/3_schema-registry/schema-registry-service.yml)\n- [Ingress](https://github.com/MihaiBogdanEugen/confluent-platform-scripts/blob/master/kubernetes/3_schema-registry/schema-registry-ingress.yml)    \n- [ConfigMap](https://github.com/MihaiBogdanEugen/confluent-platform-scripts/blob/master/kubernetes/3_schema-registry/schema-registry-configmap.yml)\n- [PodDisruptionBudget](https://github.com/MihaiBogdanEugen/confluent-platform-scripts/blob/master/kubernetes/3_schema-registry/schema-registry-poddisruptionbudget.yml)\n- [Deployment](https://github.com/MihaiBogdanEugen/confluent-platform-scripts/blob/master/kubernetes/3_schema-registry/schema-registry-deployment.yml)\n\n#### 4. REST Proxy: ####\n- [Service](https://github.com/MihaiBogdanEugen/confluent-platform-scripts/blob/master/kubernetes/4_rest-proxy/rest-proxy-service.yml)\n- [Ingress](https://github.com/MihaiBogdanEugen/confluent-platform-scripts/blob/master/kubernetes/4_rest-proxy/rest-proxy-ingress.yml)    \n- [ConfigMap](https://github.com/MihaiBogdanEugen/confluent-platform-scripts/blob/master/kubernetes/4_rest-proxy/rest-proxy-configmap.yml)\n- [PodDisruptionBudget](https://github.com/MihaiBogdanEugen/confluent-platform-scripts/blob/master/kubernetes/4_rest-proxy/rest-proxy-poddisruptionbudget.yml)\n- [Deployment](https://github.com/MihaiBogdanEugen/confluent-platform-scripts/blob/master/kubernetes/4_rest-proxy/rest-proxy-deployment.yml)\n\n### Running using Minikube: ###\n\n#### Versions used: ####\n\n```shell\nminikube version \u0026\u0026 kubectl version\n```\n\n```\nminikube version: v0.23.0\nClient Version: version.Info{Major:\"1\", Minor:\"8\", GitVersion:\"v1.8.3\", GitCommit:\"f0efb3cb883751c5ffdbe6d515f3cb4fbe7b7acd\", GitTreeState:\"clean\", BuildDate:\"2017-11-09T07:27:47Z\", GoVersion:\"go1.9.2\", Compiler:\"gc\", Platform:\"darwin/amd64\"}\nServer Version: version.Info{Major:\"1\", Minor:\"8\", GitVersion:\"v1.8.0\", GitCommit:\"0b9efaeb34a2fc51ff8e4d34ad9bc6375459c4a4\", GitTreeState:\"dirty\", BuildDate:\"2017-10-17T15:09:55Z\", GoVersion:\"go1.8.3\", Compiler:\"gc\", Platform:\"linux/amd64\"}\n```\n\n#### Prerequisites: ####\n\nOne has to start the minikube using the xhyve driver. \n\n- Start Minikube [minikube-start.sh](https://github.com/MihaiBogdanEugen/confluent-platform-scripts/blob/master/minikube/minikube-start.sh)\n- Stop Minikube [minikube-stop.sh](https://github.com/MihaiBogdanEugen/confluent-platform-scripts/blob/master/minikube/minikube-stop.sh)\n- Delete Minikube [minikube-delete.sh](https://github.com/MihaiBogdanEugen/confluent-platform-scripts/blob/master/minikube/minikube-delete.sh)\n- Check Minikube dashboard [minikube-dashboard.sh](https://github.com/MihaiBogdanEugen/confluent-platform-scripts/blob/master/minikube/minikube-dashboard.sh)\n- Check kubectl's current context [minikube-check.sh](https://github.com/MihaiBogdanEugen/confluent-platform-scripts/blob/master/minikube/minikube-check.sh)\n\n#### 1. ZooKeeper: ####\n- [Service #1](https://github.com/MihaiBogdanEugen/confluent-platform-scripts/blob/master/minikube/1_zookeeper/zookeeper1-service.yml)\n- [Service #2](https://github.com/MihaiBogdanEugen/confluent-platform-scripts/blob/master/minikube/1_zookeeper/zookeeper2-service.yml)\n- [Service #3](https://github.com/MihaiBogdanEugen/confluent-platform-scripts/blob/master/minikube/1_zookeeper/zookeeper3-service.yml)\n- [Pod #1](https://github.com/MihaiBogdanEugen/confluent-platform-scripts/blob/master/minikube/1_zookeeper/zookeeper1-pod.yml)\n- [Pod #2](https://github.com/MihaiBogdanEugen/confluent-platform-scripts/blob/master/minikube/1_zookeeper/zookeeper2-pod.yml)\n- [Pod #3](https://github.com/MihaiBogdanEugen/confluent-platform-scripts/blob/master/minikube/1_zookeeper/zookeeper3-pod.yml)\n\n#### 2. Kafka: ####\n- [Service #1](https://github.com/MihaiBogdanEugen/confluent-platform-scripts/blob/master/minikube/2_kafka/kafka1-service.yml)\n- [Service #2](https://github.com/MihaiBogdanEugen/confluent-platform-scripts/blob/master/minikube/2_kafka/kafka2-service.yml)\n- [Service #3](https://github.com/MihaiBogdanEugen/confluent-platform-scripts/blob/master/minikube/2_kafka/kafka3-service.yml)\n- [Service #4](https://github.com/MihaiBogdanEugen/confluent-platform-scripts/blob/master/minikube/2_kafka/kafka4-service.yml)\n- [Service #5](https://github.com/MihaiBogdanEugen/confluent-platform-scripts/blob/master/minikube/2_kafka/kafka5-service.yml)\n- [Pod #1](https://github.com/MihaiBogdanEugen/confluent-platform-scripts/blob/master/minikube/2_kafka/kafka1-pod.yml)\n- [Pod #2](https://github.com/MihaiBogdanEugen/confluent-platform-scripts/blob/master/minikube/2_kafka/kafka2-pod.yml)\n- [Pod #3](https://github.com/MihaiBogdanEugen/confluent-platform-scripts/blob/master/minikube/2_kafka/kafka3-pod.yml)\n- [Pod #4](https://github.com/MihaiBogdanEugen/confluent-platform-scripts/blob/master/minikube/2_kafka/kafka4-pod.yml)\n- [Pod #5](https://github.com/MihaiBogdanEugen/confluent-platform-scripts/blob/master/minikube/2_kafka/kafka5-pod.yml)\n\n#### 3. Schema Registry: ####\n- [Service #1](https://github.com/MihaiBogdanEugen/confluent-platform-scripts/blob/master/minikube/3_schema-registry/schema-registry-service.yml)\n- [Pod #1](https://github.com/MihaiBogdanEugen/confluent-platform-scripts/blob/master/minikube/3_schema-registry/schema-registry-pod.yml)\n\n#### 4. REST Proxy: ####\n- [Service #1](https://github.com/MihaiBogdanEugen/confluent-platform-scripts/blob/master/minikube/4_rest-proxy/rest-proxy-service.yml)\n- [Pod #1](https://github.com/MihaiBogdanEugen/confluent-platform-scripts/blob/master/minikube/4_rest-proxy/rest-proxy-pod.yml)\n\n### Dual licensed under: ###\n\n* [MIT License]\n* [Oracle Binary Code License Agreement]\n\n   [Confluent Open Source Platform]: \u003chttps://www.confluent.io/product/confluent-open-source/\u003e\n   [Oracle JDK]: \u003chttp://www.oracle.com/technetwork/java/javase/downloads/index.html\u003e\n   [Docker Machine]: \u003chttps://docs.docker.com/machine/install-machine/\u003e\n   [Important Notes/Caveats]: \u003chttp://docs.confluent.io/current/cp-docker-images/docs/intro.html#important-notes-caveats\u003e\n   [Official Documentation]: \u003chttp://docs.confluent.io/\u003e\n   [Apache ZooKeeper]: \u003chttps://zookeeper.apache.org/\u003e\n   [Apache Kafka]: \u003chttps://kafka.apache.org/\u003e\n   [Schema Registry]: \u003chttp://docs.confluent.io/current/schema-registry/docs/index.html\u003e  \n   [REST Proxy]: \u003chttp://docs.confluent.io/current/kafka-rest/docs/index.html\u003e   \n   [Apache Kafka Connect]: \u003chttps://kafka.apache.org/documentation/#connect\u003e\n   [MIT License]: \u003chttps://github.com/MihaiBogdanEugen/confluent-platform-scripts/blob//master/LICENSE\u003e\n   [Oracle Binary Code License Agreement]: \u003chttps://github.com/MihaiBogdanEugen/confluent-platform-scripts/blob//master/Oracle_Binary_Code_License_Agreement%20for%20the%20Java%20SE%20Platform_Products_and_JavaFX\u003e","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fmihaibogdaneugen%2Fconfluent-platform-scripts","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fmihaibogdaneugen%2Fconfluent-platform-scripts","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fmihaibogdaneugen%2Fconfluent-platform-scripts/lists"}