{"id":47595701,"url":"https://github.com/mikevan666/opendataworks","last_synced_at":"2026-05-11T11:05:14.142Z","repository":{"id":319491891,"uuid":"1078841590","full_name":"mikevan666/opendataworks","owner":"mikevan666","description":"opendataworks 是一个面向大数据平台的统一数据门户系统，基于DolphinScheduler、Doris等开源项目,旨在为企业提供一站式的数据资产管理、任务调度编排和血缘关系追踪解决方案。","archived":false,"fork":false,"pushed_at":"2026-05-06T05:12:35.000Z","size":4929,"stargazers_count":24,"open_issues_count":3,"forks_count":8,"subscribers_count":4,"default_branch":"main","last_synced_at":"2026-05-06T07:34:32.949Z","etag":null,"topics":["data-engineering","datax","dolphinscheduler","doris"],"latest_commit_sha":null,"homepage":"https://opendataworks-demo.vercel.app","language":"Java","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"gpl-3.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/mikevan666.png","metadata":{"files":{"readme":"README.md","changelog":"CHANGELOG.md","contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null,"notice":null,"maintainers":null,"copyright":null,"agents":"AGENTS.md","dco":null,"cla":null}},"created_at":"2025-10-18T14:39:52.000Z","updated_at":"2026-05-06T05:02:37.000Z","dependencies_parsed_at":"2026-02-12T05:08:21.537Z","dependency_job_id":"e4aaf1a2-a2d8-4fc0-83d7-7c400a63bf6b","html_url":"https://github.com/mikevan666/opendataworks","commit_stats":null,"previous_names":["mingkevan/opendataworks","mikevan666/opendataworks"],"tags_count":32,"template":false,"template_full_name":null,"purl":"pkg:github/mikevan666/opendataworks","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/mikevan666%2Fopendataworks","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/mikevan666%2Fopendataworks/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/mikevan666%2Fopendataworks/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/mikevan666%2Fopendataworks/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/mikevan666","download_url":"https://codeload.github.com/mikevan666/opendataworks/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/mikevan666%2Fopendataworks/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":32891974,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-05-10T13:40:02.631Z","status":"online","status_checked_at":"2026-05-11T02:00:05.975Z","response_time":120,"last_error":null,"robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":true,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["data-engineering","datax","dolphinscheduler","doris"],"created_at":"2026-04-01T18:03:47.304Z","updated_at":"2026-05-11T11:05:14.136Z","avatar_url":"https://github.com/mikevan666.png","language":"Java","funding_links":[],"categories":[],"sub_categories":[],"readme":"# OpenDataWorks\n\n\u003cp align=\"center\"\u003e\n  \u003cpicture\u003e\n    \u003csource media=\"(prefers-color-scheme: dark)\" srcset=\"frontend/public/opendataworks-icon-dark.svg\"\u003e\n    \u003cimg src=\"frontend/public/opendataworks-icon-light.svg\" alt=\"OpenDataWorks icon\" width=\"180\"\u003e\n  \u003c/picture\u003e\n\u003c/p\u003e\n\n\u003cdiv align=\"center\"\u003e\n\n\u003cp align=\"center\"\u003e\n  \u003ca href=\"https://github.com/MingkeVan/opendataworks/stargazers\"\u003e\u003cimg src=\"https://img.shields.io/github/stars/MingkeVan/opendataworks\" alt=\"Stars Badge\"/\u003e\u003c/a\u003e\n  \u003ca href=\"https://github.com/MingkeVan/opendataworks/network/members\"\u003e\u003cimg src=\"https://img.shields.io/github/forks/MingkeVan/opendataworks\" alt=\"Forks Badge\"/\u003e\u003c/a\u003e\n  \u003ca href=\"https://github.com/MingkeVan/opendataworks/pulls\"\u003e\u003cimg src=\"https://img.shields.io/github/issues-pr/MingkeVan/opendataworks\" alt=\"Pull Requests Badge\"/\u003e\u003c/a\u003e\n  \u003ca href=\"https://github.com/MingkeVan/opendataworks/issues\"\u003e\u003cimg src=\"https://img.shields.io/github/issues/MingkeVan/opendataworks\" alt=\"Issues Badge\"/\u003e\u003c/a\u003e\n  \u003ca href=\"https://github.com/MingkeVan/opendataworks/blob/main/LICENSE\"\u003e\u003cimg src=\"https://img.shields.io/github/license/MingkeVan/opendataworks\" alt=\"License Badge\"/\u003e\u003c/a\u003e\n  \u003ca href=\"https://github.com/MingkeVan/opendataworks/releases\"\u003e\u003cimg src=\"https://img.shields.io/github/downloads/MingkeVan/opendataworks/total\" alt=\"Downloads\"\u003e\u003c/a\u003e\n  \u003ca href=\"https://deepwiki.com/MingkeVan/opendataworks\"\u003e\u003cimg src=\"https://deepwiki.com/badge.svg\" alt=\"Ask DeepWiki\"\u003e\u003c/a\u003e\n  \u003ca href=\"https://opendataworkshq.slack.com/\"\u003e\u003cimg src=\"https://img.shields.io/badge/Slack-OpenDataWorks-4A154B?logo=slack\u0026logoColor=white\" alt=\"Slack Community\"\u003e\u003c/a\u003e\n\u003c/p\u003e\n\n**A unified data portal for workflow orchestration, intelligent query, and data lineage visualization.**\n\nEnglish | [简体中文](README_zh-CN.md)\n\n[Website](https://mingkevan.github.io/opendataworks/) · [Quick Start](docs/guide/start/quick-start.md) · [Features](docs/guide/manual/features.md) · [Architecture](docs/guide/architecture/design.md) · [Configuration](docs/guide/configuration/index.md) · [Contributing](docs/guide/contribution/guide.md) · [Slack](https://opendataworkshq.slack.com/)\n\n\u003c/div\u003e\n\n---\n\n## Overview\n\nOpenDataWorks is an open-source data platform portal for teams that need one place to manage metadata, orchestrate data workflows, analyze lineage, and ask data questions with natural language.\n\nIt brings the core pieces of a modern data platform into a deployable full-stack application: a Java backend, a Vue frontend, a Python DataAgent service for intelligent query, and Docker Compose assets for local and production environments.\n\n## Why OpenDataWorks\n\n- **Unified data asset management**: organize table metadata, data domains, business domains, and layered data models.\n- **Workflow orchestration**: configure batch and streaming jobs visually, with deep DolphinScheduler integration.\n- **Lineage analysis**: parse SQL lineage automatically and explore upstream/downstream relationships in an interactive graph.\n- **Intelligent query**: use natural language to generate SQL, execute analysis, and review results from the main portal.\n- **Ready to deploy**: run the frontend, backend, DataAgent backend, Redis, MySQL, and Portal MCP from the provided Docker Compose setup.\n\n## Feature Highlights\n\n- Metadata management for ODS, DWD, DIM, DWS, and ADS layers\n- Workflow authoring, publishing, scheduling, and execution monitoring\n- SQL and Shell task support\n- Data lineage visualization with ECharts\n- Data Studio with catalog browsing, SQL editing, and table-level metadata context\n- Built-in NL2SQL intelligent-query entrypoint\n- Runtime logs, execution history, and operational statistics\n\n## Demo\n\n[https://opendataworks-demo.vercel.app](https://opendataworks-demo.vercel.app)\n\n## Screenshots\n\n### Workflow Orchestration\n\n![OpenDataWorks workflow orchestration screen](docs/assets/screenshots/readme-workflows.png)\n\nManage workflow lists, publishing status, and common workflow actions.\n\n### Data Lineage\n\n![OpenDataWorks data lineage screen](docs/assets/screenshots/readme-lineage.png)\n\nExplore upstream and downstream table relationships around a selected table.\n\n### Data Studio\n\n![OpenDataWorks Data Studio screen](docs/assets/screenshots/readme-datastudio.png)\n\nBrowse catalogs, write SQL, and inspect table metadata in one workspace.\n\n## Docker Deployment\n\n### Start the Development Environment\n\nUse the development Docker Compose profile to start the frontend, backend, DataAgent backend, Redis, MySQL, and Portal MCP together:\n\n```bash\n# 1. Prepare configuration\ncp deploy/.env.example deploy/.env\n\n# 2. Pull the latest images\ndocker compose -f deploy/docker-compose.dev.yml pull\n\n# 3. Start services\ndocker compose -f deploy/docker-compose.dev.yml up -d\n\n# Access points\n# Frontend: http://localhost:8081\n# Backend: http://localhost:8080/api\n# DataAgent Backend: http://localhost:8900\n# Portal MCP: http://localhost:8801/mcp\n```\n\n### Production and Offline Deployment\n\nSee the [deployment guide](deploy/README.md) for production deployment and offline package instructions.\n\n## Quick Start\n\nFollow the [quick start guide](docs/guide/start/quick-start.md) to deploy and run OpenDataWorks locally.\n\n## Documentation\n\nProject documentation lives under [docs/](docs/):\n\n- [Quick Start](docs/guide/start/quick-start.md)\n- [Architecture](docs/guide/architecture/design.md)\n- [Configuration](docs/guide/configuration/index.md)\n- [FAQ](docs/guide/faq/faq.md)\n\n## Community\n\n- Join the [OpenDataWorks Slack community](https://opendataworkshq.slack.com/) to discuss usage, deployment, roadmap ideas, and contributions.\n- Open a [GitHub Issue](https://github.com/MingkeVan/opendataworks/issues) for bugs, feature requests, or documentation feedback.\n\n## Contributing\n\nContributions are welcome. Please read the [contribution guide](docs/guide/contribution/guide.md) before opening a pull request.\n\n## License\n\nOpenDataWorks is licensed under the [GNU General Public License v3.0 only](LICENSE).\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fmikevan666%2Fopendataworks","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fmikevan666%2Fopendataworks","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fmikevan666%2Fopendataworks/lists"}