{"id":15349509,"url":"https://github.com/ravening/cloudstack-events-kafka","last_synced_at":"2026-05-04T11:34:35.840Z","repository":{"id":117364301,"uuid":"339143117","full_name":"ravening/Cloudstack-Events-Kafka","owner":"ravening","description":"Project to read events from cloudstack kafka broker and send it to elasticsearch","archived":false,"fork":false,"pushed_at":"2021-02-15T16:48:17.000Z","size":12,"stargazers_count":0,"open_issues_count":0,"forks_count":0,"subscribers_count":1,"default_branch":"main","last_synced_at":"2025-10-10T01:34:30.428Z","etag":null,"topics":["cloudstack","elasticsearch","events","java","kafka","kafka-consumer","spring-boot"],"latest_commit_sha":null,"homepage":"","language":"Java","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/ravening.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2021-02-15T16:48:05.000Z","updated_at":"2021-02-15T16:49:13.000Z","dependencies_parsed_at":null,"dependency_job_id":"541f07f4-5249-4edf-9e5c-f5372062f4cd","html_url":"https://github.com/ravening/Cloudstack-Events-Kafka","commit_stats":{"total_commits":1,"total_committers":1,"mean_commits":1.0,"dds":0.0,"last_synced_commit":"96f5b56416697c3db2eb7039456614f619a70101"},"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/ravening/Cloudstack-Events-Kafka","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ravening%2FCloudstack-Events-Kafka","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ravening%2FCloudstack-Events-Kafka/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ravening%2FCloudstack-Events-Kafka/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ravening%2FCloudstack-Events-Kafka/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/ravening","download_url":"https://codeload.github.com/ravening/Cloudstack-Events-Kafka/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ravening%2FCloudstack-Events-Kafka/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":279002404,"owners_count":26083374,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","status":"online","status_checked_at":"2025-10-09T02:00:07.460Z","response_time":59,"last_error":null,"robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":true,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["cloudstack","elasticsearch","events","java","kafka","kafka-consumer","spring-boot"],"created_at":"2024-10-01T11:54:50.732Z","updated_at":"2025-10-10T01:34:31.992Z","avatar_url":"https://github.com/ravening.png","language":"Java","funding_links":[],"categories":[],"sub_categories":[],"readme":"# kafka-elasticsearch-connector\n\nJava application to read messages from Apache Kafka topics and stream it to\\\nElasticsearch cluster\n\n## Prerequisites\n\nRunning Apache Kafka server\nElasticsearch cluster\nJava 11 or docker installed\n\n## Assumptions\n\nFirst setup beans in Cloudstack and connect it to kafka by following steps under `Kafka Configuration` section in\\\nhttps://docs.cloudstack.apache.org/en/latest/adminguide/events.html\n\n\nIt is assumed that both Apache Kafka and Elasticsearch are running in the same machine\\\nas this application. If not you need to specify the hostname in `application.yml` file.\n\nIt is also assumed that all messages will be sent and read from `cloudstack` topic on kafka\\\nand 'cloudstack-kafka' index name is used as default\n\nIf you want to receive messages on different topics then change the topic name in\\\n`KafkaTopicListener.java` file.\\\nIf you want to change the index name for elasticsearch then change the value in\\\n`Message.java` file.\n\nOnce all these changes are done, you can build the entire project or docker image.\n\n## Building project\n\nThe application can be built using\\\n`mvn clean project -DskipTests`\n\nDocker image can be built using\\\n`./mvnw spring-boot:build-image`\n\n## Running the project\n\nYou can run the jar file using\\\n`java -jar target/kafka-elasticsearch-connector.jar`\n\nor start the docker container using\\\n`docker run -d -it -p 8080:8080 --network host --name kafka-elasticksearch-connector \u003cYOUR docker hub USERNAME\u003e/kafka-elasticsearch-connector`\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fravening%2Fcloudstack-events-kafka","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fravening%2Fcloudstack-events-kafka","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fravening%2Fcloudstack-events-kafka/lists"}