{"id":27163060,"url":"https://github.com/ddeutils/deflow","last_synced_at":"2025-04-09T01:40:58.881Z","repository":{"id":285857304,"uuid":"959285643","full_name":"ddeutils/deflow","owner":"ddeutils","description":"⚡ Lightweight Declarative Data Workflow Framework","archived":false,"fork":false,"pushed_at":"2025-04-05T04:23:37.000Z","size":41,"stargazers_count":0,"open_issues_count":0,"forks_count":0,"subscribers_count":0,"default_branch":"main","last_synced_at":"2025-04-05T05:23:12.943Z","etag":null,"topics":["data-framework","declarative-workflows"],"latest_commit_sha":null,"homepage":"","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/ddeutils.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2025-04-02T14:43:55.000Z","updated_at":"2025-04-05T04:17:48.000Z","dependencies_parsed_at":"2025-04-05T05:23:16.175Z","dependency_job_id":null,"html_url":"https://github.com/ddeutils/deflow","commit_stats":null,"previous_names":["ddeutils/fastflow","ddeutils/deflow"],"tags_count":1,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ddeutils%2Fdeflow","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ddeutils%2Fdeflow/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ddeutils%2Fdeflow/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ddeutils%2Fdeflow/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/ddeutils","download_url":"https://codeload.github.com/ddeutils/deflow/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":247958720,"owners_count":21024821,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["data-framework","declarative-workflows"],"created_at":"2025-04-09T01:40:57.894Z","updated_at":"2025-04-09T01:40:58.869Z","avatar_url":"https://github.com/ddeutils.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"# DeFlow\n\nA **Lightweight Declarative Data Workflow Framework** that build on the\n[🏃 Workflow](https://github.com/ddeutils/ddeutil-workflow) package.\n\n\u003e [!WARNING]\n\u003e This framework does not allow you to custom your pipeline yet. If you want to\n\u003e create you workflow, you can use the [🏃 Workflow](https://github.com/ddeutils/ddeutil-workflow)\n\u003e package instead that already installed.\n\n## 📦 Installation\n\n```shell\npip install -U deflow\n```\n\n## 🍻 Usage\n\nAfter initialize data framework project with **Version 1**, your data pipeline\nconfig files will store with this file structure:\n\n```text\nconf/\n ├─ conn/\n │   ├─ c_conn_01.yml\n │   ╰─ c_conn_02.yml\n ╰─ stream/\n     ╰─ s_stream_01/\n         ├─ g_group_01.tier.priority/\n         │   ├─ p_proces_01.yml\n         │   ╰─ p_proces_02.yml\n         ├─ g_group_02.tier.priority/\n         │   ├─ p_proces_01.yml\n         │   ╰─ p_proces_02.yml\n         ╰─ config.yml\n```\n\nYou can run the data flow by:\n\n```python\nfrom deflow.flow import Flow\nfrom ddeutil.workflow import Result\n\nflow: Result = Flow(name=\"s_stream_01\").run(mode=\"N\")\n```\n\n## :cookie: Configuration\n\nSupport data framework version:\n\n|  Version  |  Supported  | Description                                              |\n|:---------:|:-----------:|----------------------------------------------------------|\n|     1     |     Yes     | A data framework that base on stream, group, and process |\n\n## 💬 Contribute\n\nI do not think this project will go around the world because it has specific propose,\nand you can create by your coding without this project dependency for long term\nsolution. So, on this time, you can open [the GitHub issue on this project 🙌](https://github.com/ddeutils/fastflow/issues)\nfor fix bug or request new feature if you want it.\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fddeutils%2Fdeflow","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fddeutils%2Fdeflow","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fddeutils%2Fdeflow/lists"}