{"id":35042350,"url":"https://github.com/anelendata/dbt-ksql","last_synced_at":"2026-04-06T05:31:07.316Z","repository":{"id":59366272,"uuid":"536869231","full_name":"anelendata/dbt-ksql","owner":"anelendata","description":"dbt ksqlDB adapter","archived":false,"fork":false,"pushed_at":"2022-09-20T06:25:38.000Z","size":44,"stargazers_count":19,"open_issues_count":0,"forks_count":3,"subscribers_count":2,"default_branch":"main","last_synced_at":"2023-08-02T03:35:23.217Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":null,"language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/anelendata.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":"CONTRIBUTING.md","funding":null,"license":"LICENSE","code_of_conduct":"CODE_OF_CONDUCT.md","threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null}},"created_at":"2022-09-15T04:54:57.000Z","updated_at":"2023-05-03T15:22:17.000Z","dependencies_parsed_at":"2023-01-18T15:30:50.414Z","dependency_job_id":null,"html_url":"https://github.com/anelendata/dbt-ksql","commit_stats":null,"previous_names":[],"tags_count":0,"template":null,"template_full_name":null,"purl":"pkg:github/anelendata/dbt-ksql","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/anelendata%2Fdbt-ksql","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/anelendata%2Fdbt-ksql/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/anelendata%2Fdbt-ksql/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/anelendata%2Fdbt-ksql/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/anelendata","download_url":"https://codeload.github.com/anelendata/dbt-ksql/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/anelendata%2Fdbt-ksql/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":31461527,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-04-05T21:22:52.476Z","status":"online","status_checked_at":"2026-04-06T02:00:07.287Z","response_time":112,"last_error":null,"robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":true,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2025-12-27T08:25:10.935Z","updated_at":"2026-04-06T05:31:07.310Z","avatar_url":"https://github.com/anelendata.png","language":"Python","readme":"# dbt-ksql\n\nA dbt adapter for ksqlDB\n\nLike in many database projects, managing models becomes increasingly challenging.\ndbt-ksql helps to modularize the code, manage the model dependency, and facilitate the model deployment.\n\n## Concepts\n\nThis project is in a proof-of-concept phase.\n\nWe are using part of dbt features to manage ksqlDB by\n- Separating production/staging/development environments through dbt's profile and target.\n- Modularize the SQL with dbt's variable, reference, macro, etc.\n\nNot all dbt features are supported. ksqlDB transforms streaming data. Some of\ndbt features are assuming batch operation (e.g. incremental and snapshot).\n\n### Materialization types\n\nSupported:\n- stream\n- table\n\nNot-suported:\n- ephemeral\n- incremental\n\n## Example project\n\nSee [example](./example) folder for a dbt project.\nIt has examples for creating stream, stream as, table.\nIt also has a example of using macros.\n\n## Pre-release warning\n\n- This project is an experimental phase.\n- This has not been published to pypi.\n\n## Pre-release install steps\n\nTo install, fetch this repository and run a local install:\n\n```\ngit clone git@github.com:anelendata/dbt-ksql.git\ncd dbt-ksql\npython -m venv venv\nsource venv/bin/activate\npip install -U pip\npip install -e .\n```\n\nAfter the successful instsall, the following command will show\n```\ndbt --version\n```\n\nSomething like this:\n```\nCore:\n  - installed: 1.1.2\n  - latest:    1.2.1 - Update available!\n\n  Your version of dbt-core is out of date!\n  You can find instructions for upgrading here:\n  https://docs.getdbt.com/docs/installation\n\n  Plugins:\n  - ksqldb: 1.1.0 - Could not determine latest version\n```\n\n## Example commands\n\nAfter set up profiles.yml try running the following commands:\n- compile: `dbt compile --profiles-dir . --profile prod`\n- run: `dbt run --profiles-dir . --profile prod`\n\n## Helper macro\n\n- drop stream: `dbt run-operation drop_stream --args \"{relation: some_stream, delete_topic: true}\" --profiles-dir . --profile dev`\n \n## About dbt\n\n**[dbt](https://www.getdbt.com/)** enables data analysts and engineers to transform their data using the same practices that software engineers use to build applications.\n\ndbt is the T in ELT. Organize, cleanse, denormalize, filter, rename, and pre-aggregate the raw data in your warehouse so that it's ready for analysis.\n\n# About this project\n\nThis project is developed by \nANELEN and friends. Please check out the ANELEN's\n[open innovation philosophy and other projects](https://anelen.co/open-source.html)\n\n![ANELEN](https://avatars.githubusercontent.com/u/13533307?s=400\u0026u=a0d24a7330d55ce6db695c5572faf8f490c63898\u0026v=4)\n---\n\nCopyright \u0026copy; 2022~ Anelen Co., LLC\n","funding_links":[],"categories":["\u003ca name=\"Python\"\u003e\u003c/a\u003ePython"],"sub_categories":[],"project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fanelendata%2Fdbt-ksql","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fanelendata%2Fdbt-ksql","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fanelendata%2Fdbt-ksql/lists"}