{"id":14065657,"url":"https://github.com/sqlparser/sqlflow_public","last_synced_at":"2025-07-29T21:32:41.956Z","repository":{"id":40853091,"uuid":"216718494","full_name":"sqlparser/sqlflow_public","owner":"sqlparser","description":"Document, sample code and other materials for SQLFlow","archived":false,"fork":false,"pushed_at":"2025-04-29T06:22:18.000Z","size":101830,"stargazers_count":967,"open_issues_count":11,"forks_count":182,"subscribers_count":19,"default_branch":"master","last_synced_at":"2025-04-29T07:32:37.171Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":null,"language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/sqlparser.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null}},"created_at":"2019-10-22T03:48:01.000Z","updated_at":"2025-04-29T06:22:24.000Z","dependencies_parsed_at":"2024-03-27T04:21:32.876Z","dependency_job_id":"279c5318-8bc0-4a1c-bc6a-14c39513e065","html_url":"https://github.com/sqlparser/sqlflow_public","commit_stats":null,"previous_names":[],"tags_count":26,"template":false,"template_full_name":null,"purl":"pkg:github/sqlparser/sqlflow_public","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/sqlparser%2Fsqlflow_public","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/sqlparser%2Fsqlflow_public/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/sqlparser%2Fsqlflow_public/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/sqlparser%2Fsqlflow_public/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/sqlparser","download_url":"https://codeload.github.com/sqlparser/sqlflow_public/tar.gz/refs/heads/master","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/sqlparser%2Fsqlflow_public/sbom","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":267763557,"owners_count":24140824,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","status":"online","status_checked_at":"2025-07-29T02:00:12.549Z","response_time":2574,"last_error":null,"robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":true,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-08-13T07:04:37.188Z","updated_at":"2025-07-29T21:32:39.761Z","avatar_url":"https://github.com/sqlparser.png","language":"Python","funding_links":[],"categories":["Python","大数据"],"sub_categories":["Spring Cloud框架"],"readme":"## [SQLFlow](https://sqlflow.gudusoft.com) - A tool that tracks column-level data lineage\r\n\r\nTrack Column-Level Data Lineage for [more than 20 major databases](/databases/readme.md) including \r\nSnowflake, Hive, SparkSQL, Teradata, Oracle, SQL Server, AWS redshift, BigQuery, etc.\r\n\r\nBuild and visualize lineage from SQL script from query history, ETL script,\r\nGithub/Bitbucket, Local filesystem and remote databases.\r\n\r\n[Exploring lineage using an interactive diagram](https://sqlflow.gudusoft.com) or programmatically using [Restful APIs](/api) or [SDKs](https://www.gudusoft.com/sqlflow-java-library-2/).\r\n\r\nDiscover data lineage in this query:\r\n```sql\r\ninsert into emp (id,first_name,last_name,city,postal_code,ph)\r\n  select a.id,a.first_name,a.last_name,a.city,a.postal_code,b.ph\r\n  from emp_addr a\r\n  inner join emp_ph b on a.id = b.id;\r\n```\r\n\r\nSQLFlow presents a nice clean graph to you that tells\r\nwhere the data came from, what transformations it underwent along the way, \r\nand what other data items are derived from this data value.\r\n\r\n[![SQLFlow Introduce](images/sqlflow_introduce1.png)](https://sqlflow.gudusoft.com)\r\n\r\n### What SQLFlow can do for you\r\n- Scan your database and discover the data lineage instantly.\r\n- Automatically collect SQL script from github/bitbucket or local file system.\r\n- Provide a nice cleam diagram to the end-user to understand the data lineage quickly.\r\n- programmatically using [Restful APIs](/api) or [SDKs](https://www.gudusoft.com/sqlflow-java-library-2/) to get lineage in CSV, JSON, Graphml format.\r\n- Incorporate the lineage metadata decoded from the complex SQL script into your own metadata database for further processing.\r\n- Visualize the metadata already existing in your database to release the power of data.\r\n- Perform impact analysis and root-cause analysis by tracing lineage backwards or forwards with several mouse click.\r\n- Able to process SQL script from more than 20 major database vendors.\r\n\r\n### How to use SQLFlow\r\n- Open [the official website](https://gudusoft.com/sqlflow/#/) of the SQLFlow and paste your SQL script or metadata to get a nice clean lineage diagram.\r\n- Call the [Restful API](/api) of the SQLFlow in your own code to get data lineage metadata decoded by the SQLFlow from the SQL script.\r\n- The [on-premise version](https://github.com/sqlparser/sqlflow_public/blob/master/install_sqlflow.md) of SQLflow enables you to use it on your own server to keep the data safer.\r\n\r\n\r\n### Restful APIs\r\n- [SQLFlow API document](https://github.com/sqlparser/sqlflow_public/blob/master/api/sqlflow_api.md)\r\n- [Client in C#](https://github.com/sqlparser/sqlflow_public/tree/master/api/client/csharp)\r\n\r\n### SQLFlow architecture\r\n- [Architecture document](sqlflow_architecture.md)\r\n\r\n### User manual and FAQ\r\n- [User guide](sqlflow_guide.md)\r\n- [SQLFlow FAQ](sqlflow_faq.md)\r\n\r\n\r\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fsqlparser%2Fsqlflow_public","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fsqlparser%2Fsqlflow_public","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fsqlparser%2Fsqlflow_public/lists"}