{"id":15322582,"url":"https://github.com/dbgjerez/workshop-cdc","last_synced_at":"2025-04-15T02:37:23.733Z","repository":{"id":198702948,"uuid":"701355971","full_name":"dbgjerez/workshop-cdc","owner":"dbgjerez","description":"Worshop Change Data Capture with AMQ Streams and Camel","archived":false,"fork":false,"pushed_at":"2023-12-12T06:39:06.000Z","size":79186,"stargazers_count":4,"open_issues_count":5,"forks_count":4,"subscribers_count":3,"default_branch":"main","last_synced_at":"2025-03-28T14:22:23.169Z","etag":null,"topics":["amq-streams","camel","cdc","change-data-capture","kafka","kafka-connect","openshift","quarkus","reactjs"],"latest_commit_sha":null,"homepage":"","language":"JavaScript","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/dbgjerez.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null}},"created_at":"2023-10-06T13:19:39.000Z","updated_at":"2024-02-06T15:57:02.000Z","dependencies_parsed_at":"2023-10-20T17:06:16.668Z","dependency_job_id":null,"html_url":"https://github.com/dbgjerez/workshop-cdc","commit_stats":null,"previous_names":["dbgjerez/workshop-cdc"],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/dbgjerez%2Fworkshop-cdc","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/dbgjerez%2Fworkshop-cdc/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/dbgjerez%2Fworkshop-cdc/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/dbgjerez%2Fworkshop-cdc/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/dbgjerez","download_url":"https://codeload.github.com/dbgjerez/workshop-cdc/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":248995103,"owners_count":21195497,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["amq-streams","camel","cdc","change-data-capture","kafka","kafka-connect","openshift","quarkus","reactjs"],"created_at":"2024-10-01T09:16:51.977Z","updated_at":"2025-04-15T02:37:23.703Z","avatar_url":"https://github.com/dbgjerez.png","language":"JavaScript","funding_links":[],"categories":[],"sub_categories":[],"readme":"Change Data Capture (CDC) is a design pattern that captures changes made at a source and replicates them to a destination.\n\nIn this example, we'll move data from some databases to a Kafka topic, the data will be transformed and saved into another destination database.\n\n![Architecture](images/architecture.png)\n\n# Components\n\nWe will use a lot of components and tools to conduct this workshop. The main components are:\n* **Kafka:** A distributed streaming platform used to build real-time data pipelines and streaming apps.\n* **Kafka Connect:** An integration framework for connecting Kafka with external systems such as databases, key-value stores, and search indexes.\n* **Camel:** An open-source integration framework that provides a standardized way to connect to different protocols and technologies.\n* **Quarkus:** A Kubernetes-native Java framework tailored for GraalVM and HotSpot, offering fast boot times and low memory usage.\n* **ReactJS:** A JavaScript library for building user interfaces, particularly known for its efficient rendering and the concept of component-based architecture.\"\n\n# Start up\n\nOperator installation:\n\n```bash\noc apply -f gitops/bootstrap/openshift-gitops.yaml\n```\n\nRetrieve ArgoCD route: \n\n```bash\noc get route -A | grep openshift-gitops-server | awk '{print $3}'\n```\n\nGet the ArgoCD admin password: \n\n```bash\noc -n openshift-gitops get secret openshift-gitops-cluster -o json | jq -r '.data[\"admin.password\"]' | base64 -d\n```\n\nArgoCD needs some privileges to create specific resources. In this demo, we'll apply cluster-role to ArgoCD to avoid the fine-grain RBAC.\n\n```bash\noc apply -f gitops/bootstrap/cluster-role.yaml\n```\n\nNow, we apply the bootstrap application:\n\n```bash\noc apply -f gitops/bootstrap/bootstrap.yaml\n```","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fdbgjerez%2Fworkshop-cdc","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fdbgjerez%2Fworkshop-cdc","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fdbgjerez%2Fworkshop-cdc/lists"}