{"id":21404737,"url":"https://github.com/feluelle/kind-data-platform","last_synced_at":"2025-10-28T16:40:07.823Z","repository":{"id":37045273,"uuid":"432096639","full_name":"feluelle/kind-data-platform","owner":"feluelle","description":"A kind data platform on your local machine. 🤗","archived":false,"fork":false,"pushed_at":"2025-07-07T17:54:31.000Z","size":1083,"stargazers_count":11,"open_issues_count":5,"forks_count":0,"subscribers_count":2,"default_branch":"main","last_synced_at":"2025-07-07T18:56:15.011Z","etag":null,"topics":["data-platform","docker","helm","kind","terraform"],"latest_commit_sha":null,"homepage":"","language":"HCL","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/feluelle.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null}},"created_at":"2021-11-26T07:52:48.000Z","updated_at":"2025-07-04T12:38:10.000Z","dependencies_parsed_at":"2023-09-23T09:55:23.081Z","dependency_job_id":"b098b043-18a6-48ed-a008-da27e3afac4e","html_url":"https://github.com/feluelle/kind-data-platform","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/feluelle/kind-data-platform","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/feluelle%2Fkind-data-platform","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/feluelle%2Fkind-data-platform/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/feluelle%2Fkind-data-platform/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/feluelle%2Fkind-data-platform/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/feluelle","download_url":"https://codeload.github.com/feluelle/kind-data-platform/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/feluelle%2Fkind-data-platform/sbom","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":265220050,"owners_count":23729750,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["data-platform","docker","helm","kind","terraform"],"created_at":"2024-11-22T16:17:51.140Z","updated_at":"2025-10-28T16:40:02.786Z","avatar_url":"https://github.com/feluelle.png","language":"HCL","readme":"# kind-data-platform\n\n[![Github commit activity](https://img.shields.io/github/commit-activity/w/feluelle/kind-data-platform)](https://github.com/feluelle/kind-data-platform/pulse)\n[![Pre-commit.ci status](https://results.pre-commit.ci/badge/github/feluelle/kind-data-platform/main.svg)](https://results.pre-commit.ci/latest/github/feluelle/kind-data-platform/main)\n![Docker workflow](https://github.com/feluelle/kind-data-platform/actions/workflows/docker.yml/badge.svg)\n![Terraform workflow](https://github.com/feluelle/kind-data-platform/actions/workflows/terraform.yml/badge.svg)\n[![License](https://img.shields.io/:license-Apache%202-blue.svg)](https://www.apache.org/licenses/LICENSE-2.0.txt)\n[![Code style: black](https://img.shields.io/badge/code%20style-black-000000.svg)](https://github.com/psf/black)\n\n\u003e A kind data platform on your local machine. 🤗\n\nThe objective of this project is to be able to quickly setup a data platform on your local machine via kind. It should also help you get familiar with production-ready setup and tools such as terraform, kubernetes and helm.\n\n## 🏛️ Architecture\n\nThe following diagram shows the services currently being used, all running in a kind cluster:\n\n![architecture](diagrams/kind-data-platform.png)\n\n## 🚀 Get started\n\n### Prerequisites\n\nInstall the following tools:\n\n- [awscli](https://aws.amazon.com/cli/)\n- [docker](https://www.docker.com/)\n- [kind](https://kind.sigs.k8s.io/)\n- [kubectl](https://kubernetes.io/docs/tasks/tools/)\n- [task](https://taskfile.dev/)\n- [terraform](https://www.terraform.io/)\n\nMy docker setup i.e. `docker info`\n\n```text\n...\nCPUs: 10\nTotal Memory: 15.6GiB\n...\n```\n\nIf you give the docker daemon less resources, make sure to adjust the `timeout` parameter in the helm releases as creating them can take up more time.\n\n### Setup\n\nFirst create the main infrastructure by running the following command:\n\n```bash\ntask -t infra/Taskfile.yml setup\n```\n\nThen create the localstack services, for this you first need to expose localstack first by running the following:\n\n```bash\ntask -t infra/Taskfile.yml expose:localstack\n```\n\nand then create the services by running the following:\n\n```bash\ntask -t infra/Taskfile.yml setup:localstack-services\n```\n\n_See [infra](infra/README.md) for more information about the projects infrastructure._\n\n## 📜 Roadmap\n\nYou can find what is being worked on and what is to do in the [project](https://github.com/feluelle/kind-data-platform/projects/1).\n\n## ❤️ Contributing\n\nYou're welcome to join this project and I would be more than happy to have you on board. Feel free to raise any issue you might encounter or open a PR to address it. Check out [CI](CI.md) to learn more about how we develop and test code.\n\nIf you want to jump right into it, here are..\n\n[![Good first issues open](https://img.shields.io/github/issues/feluelle/kind-data-platform/good%20first%20issue.svg?label=good%20first%20issues)](https://github.com/feluelle/kind-data-platform/issues?q=is%3Aopen+is%3Aissue+label%3A\"good+first+issue\")\n\n## 💬 Feedback\n\nIn case you like the project, just follow me..\n\n[![Github followers](https://img.shields.io/github/followers/feluelle?label=Follow\u0026style=social)](https://github.com/feluelle)\n\nIn case you don't like the project or have any feedback for me drop me a mail at feluelle@pm.me.\n","funding_links":[],"categories":[],"sub_categories":[],"project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Ffeluelle%2Fkind-data-platform","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Ffeluelle%2Fkind-data-platform","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Ffeluelle%2Fkind-data-platform/lists"}