{"id":49932659,"url":"https://github.com/opendata-lab/opendataworks","last_synced_at":"2026-06-10T05:00:54.339Z","repository":{"id":319491891,"uuid":"1078841590","full_name":"opendata-lab/opendataworks","owner":"opendata-lab","description":"opendataworks 是一个面向大数据平台的统一数据门户系统，基于DolphinScheduler、Doris等开源项目,旨在为企业提供一站式的数据资产管理、任务调度编排和血缘关系追踪解决方案。","archived":false,"fork":false,"pushed_at":"2026-06-09T01:49:42.000Z","size":6906,"stargazers_count":40,"open_issues_count":5,"forks_count":15,"subscribers_count":6,"default_branch":"main","last_synced_at":"2026-06-09T02:09:13.575Z","etag":null,"topics":["data-engineering","datax","dolphinscheduler","doris"],"latest_commit_sha":null,"homepage":"https://opendataworks.vercel.app","language":"Java","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"gpl-3.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/opendata-lab.png","metadata":{"files":{"readme":"README.md","changelog":"CHANGELOG.md","contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null,"notice":null,"maintainers":null,"copyright":null,"agents":"AGENTS.md","dco":null,"cla":null}},"created_at":"2025-10-18T14:39:52.000Z","updated_at":"2026-06-09T01:37:09.000Z","dependencies_parsed_at":"2026-02-12T05:08:21.537Z","dependency_job_id":"e4aaf1a2-a2d8-4fc0-83d7-7c400a63bf6b","html_url":"https://github.com/opendata-lab/opendataworks","commit_stats":null,"previous_names":["mingkevan/opendataworks","mikevan666/opendataworks","opendata-lab/opendataworks"],"tags_count":33,"template":false,"template_full_name":null,"purl":"pkg:github/opendata-lab/opendataworks","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/opendata-lab%2Fopendataworks","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/opendata-lab%2Fopendataworks/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/opendata-lab%2Fopendataworks/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/opendata-lab%2Fopendataworks/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/opendata-lab","download_url":"https://codeload.github.com/opendata-lab/opendataworks/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/opendata-lab%2Fopendataworks/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":34137570,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-05-26T15:22:16.424Z","status":"online","status_checked_at":"2026-06-10T02:00:07.152Z","response_time":89,"last_error":null,"robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":true,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["data-engineering","datax","dolphinscheduler","doris"],"created_at":"2026-05-17T04:02:56.026Z","updated_at":"2026-06-10T05:00:54.303Z","avatar_url":"https://github.com/opendata-lab.png","language":"Java","funding_links":[],"categories":["大数据"],"sub_categories":["微服务框架"],"readme":"# OpenDataWorks\n\n\u003cp align=\"center\"\u003e\n  \u003cpicture\u003e\n    \u003csource media=\"(prefers-color-scheme: dark)\" srcset=\"frontend/public/opendataworks-icon-dark.svg\"\u003e\n    \u003cimg src=\"frontend/public/opendataworks-icon-light.svg\" alt=\"OpenDataWorks icon\" width=\"180\"\u003e\n  \u003c/picture\u003e\n\u003c/p\u003e\n\n\u003cdiv align=\"center\"\u003e\n\n\u003cp align=\"center\"\u003e\n  \u003ca href=\"https://github.com/MingkeVan/opendataworks/stargazers\"\u003e\u003cimg src=\"https://img.shields.io/github/stars/MingkeVan/opendataworks\" alt=\"Stars Badge\"/\u003e\u003c/a\u003e\n  \u003ca href=\"https://github.com/MingkeVan/opendataworks/network/members\"\u003e\u003cimg src=\"https://img.shields.io/github/forks/MingkeVan/opendataworks\" alt=\"Forks Badge\"/\u003e\u003c/a\u003e\n  \u003ca href=\"https://github.com/MingkeVan/opendataworks/pulls\"\u003e\u003cimg src=\"https://img.shields.io/github/issues-pr/MingkeVan/opendataworks\" alt=\"Pull Requests Badge\"/\u003e\u003c/a\u003e\n  \u003ca href=\"https://github.com/MingkeVan/opendataworks/issues\"\u003e\u003cimg src=\"https://img.shields.io/github/issues/MingkeVan/opendataworks\" alt=\"Issues Badge\"/\u003e\u003c/a\u003e\n  \u003ca href=\"https://github.com/MingkeVan/opendataworks/blob/main/LICENSE\"\u003e\u003cimg src=\"https://img.shields.io/github/license/MingkeVan/opendataworks\" alt=\"License Badge\"/\u003e\u003c/a\u003e\n  \u003ca href=\"https://github.com/MingkeVan/opendataworks/releases\"\u003e\u003cimg src=\"https://img.shields.io/github/downloads/MingkeVan/opendataworks/total\" alt=\"Downloads\"\u003e\u003c/a\u003e\n  \u003ca href=\"https://deepwiki.com/MingkeVan/opendataworks\"\u003e\u003cimg src=\"https://deepwiki.com/badge.svg\" alt=\"Ask DeepWiki\"\u003e\u003c/a\u003e\n  \u003ca href=\"https://opendataworkshq.slack.com/\"\u003e\u003cimg src=\"https://img.shields.io/badge/Slack-OpenDataWorks-4A154B?logo=slack\u0026logoColor=white\" alt=\"Slack Community\"\u003e\u003c/a\u003e\n\u003c/p\u003e\n\n**A unified data portal for workflow orchestration, intelligent query, and data lineage visualization.**\n\nEnglish | [简体中文](README_zh-CN.md)\n\n[Website](https://opendataworks.vercel.app/) · [Quick Start](https://opendataworks.vercel.app/guide/quick-start.html) · [Features](https://opendataworks.vercel.app/guide/features.html) · [Architecture](https://opendataworks.vercel.app/architecture/overview.html) · [Configuration](https://opendataworks.vercel.app/guide/configuration.html) · [Contributing](https://opendataworks.vercel.app/guide/contribution.html) · [Slack](https://opendataworkshq.slack.com/)\n\n\u003c/div\u003e\n\n---\n\n## Overview\n\nOpenDataWorks is an open-source data platform portal for teams that need one place to manage metadata, orchestrate data workflows, analyze lineage, and ask data questions with natural language.\n\nIt brings the core pieces of a modern data platform into a deployable full-stack application: a Java backend, a Vue frontend, a Python DataAgent service for intelligent query, and Docker Compose assets for local and production environments.\n\n## Why OpenDataWorks\n\n- **Unified data asset management**: organize table metadata, data domains, business domains, and layered data models.\n- **Workflow orchestration**: configure batch and streaming jobs visually, with deep DolphinScheduler integration.\n- **Lineage analysis**: parse SQL lineage automatically and explore upstream/downstream relationships in an interactive graph.\n- **Intelligent query**: use natural language to generate SQL, execute analysis, and review results from the main portal.\n- **Ready to deploy**: run the frontend, backend, DataAgent backend, Redis, MySQL, and Portal MCP from the provided Docker Compose setup.\n\n## Feature Highlights\n\n- Metadata management for ODS, DWD, DIM, DWS, and ADS layers\n- Workflow authoring, publishing, scheduling, and execution monitoring\n- SQL and Shell task support\n- Data lineage visualization with ECharts\n- Data Studio with catalog browsing, SQL editing, and table-level metadata context\n- Built-in NL2SQL intelligent-query entrypoint\n- Runtime logs, execution history, and operational statistics\n\n## Demo\n\n[https://opendataworks-demo.vercel.app](https://opendataworks-demo.vercel.app)\n\n## Screenshots\n\n### Workflow Orchestration\n\n![OpenDataWorks workflow orchestration screen](website/public/readme-workflows.png)\n\nManage workflow lists, publishing status, and common workflow actions.\n\n### Data Lineage\n\n![OpenDataWorks data lineage screen](website/public/readme-lineage.png)\n\nExplore upstream and downstream table relationships around a selected table.\n\n### Data Studio\n\n![OpenDataWorks Data Studio screen](website/public/readme-datastudio.png)\n\nBrowse catalogs, write SQL, and inspect table metadata in one workspace.\n\n## Docker Deployment\n\n### Start the Development Environment\n\nUse the development Docker Compose profile to start the frontend, backend, DataAgent backend, Redis, MySQL, and Portal MCP together:\n\n```bash\n# 1. Prepare configuration\ncp deploy/.env.example deploy/.env\n\n# 2. Pull the latest images\ndocker compose -f deploy/docker-compose.dev.yml pull\n\n# 3. Start services\ndocker compose -f deploy/docker-compose.dev.yml up -d\n\n# Access points\n# Frontend: http://localhost:8081\n# Backend: http://localhost:8080/api\n# DataAgent Backend: http://localhost:8900\n# Portal MCP: http://localhost:8801/mcp\n```\n\n### Production and Offline Deployment\n\nSee the [deployment guide](deploy/README.md) for production deployment and offline package instructions.\n\n## Quick Start\n\nFollow the [quick start guide](https://opendataworks.vercel.app/guide/quick-start.html) to deploy and run OpenDataWorks locally.\n\n## Documentation\n\nFull documentation is available at: **https://opendataworks.vercel.app/**\n\n- [Quick Start](https://opendataworks.vercel.app/guide/quick-start.html)\n- [Architecture](https://opendataworks.vercel.app/architecture/overview.html)\n- [Configuration](https://opendataworks.vercel.app/guide/configuration.html)\n- [FAQ](https://opendataworks.vercel.app/guide/faq.html)\n\n## Community\n\n- Join the [OpenDataWorks Slack community](https://opendataworkshq.slack.com/) to discuss usage, deployment, roadmap ideas, and contributions.\n- Open a [GitHub Issue](https://github.com/opendata-lab/opendataworks/issues) for bugs, feature requests, or documentation feedback.\n\n## Contributing\n\nContributions are welcome. Please read the [contribution guide](https://opendataworks.vercel.app/guide/contribution.html) before opening a pull request.\n\n## License\n\nOpenDataWorks is licensed under the [GNU General Public License v3.0 only](LICENSE).\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fopendata-lab%2Fopendataworks","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fopendata-lab%2Fopendataworks","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fopendata-lab%2Fopendataworks/lists"}