{"id":16599176,"url":"https://github.com/collabh/hephaestus","last_synced_at":"2026-03-09T17:14:57.940Z","repository":{"id":214126587,"uuid":"735768334","full_name":"collabH/hephaestus","owner":"collabH","description":"hephaestus is a scalable and general real-time data processing engine based on Flink, including the configuration of setting, source, sink, dag and other modules, supporting the ability to quickly build real-time ETL tasks through the custom configuration of each module \u0026Flink SQL configuration.","archived":false,"fork":false,"pushed_at":"2024-06-27T12:11:50.000Z","size":16,"stargazers_count":0,"open_issues_count":0,"forks_count":0,"subscribers_count":2,"default_branch":"main","last_synced_at":"2025-12-08T10:31:14.033Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":"","language":null,"has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/collabH.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null,"notice":null,"maintainers":null,"copyright":null,"agents":null,"dco":null,"cla":null}},"created_at":"2023-12-26T03:00:22.000Z","updated_at":"2024-07-04T08:00:28.000Z","dependencies_parsed_at":"2023-12-26T04:20:02.538Z","dependency_job_id":"aae3d0cd-c8d5-4a29-8e7b-bf578ba45501","html_url":"https://github.com/collabH/hephaestus","commit_stats":null,"previous_names":["collabh/tiangong","collabh/hephaestus"],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/collabH/hephaestus","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/collabH%2Fhephaestus","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/collabH%2Fhephaestus/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/collabH%2Fhephaestus/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/collabH%2Fhephaestus/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/collabH","download_url":"https://codeload.github.com/collabH/hephaestus/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/collabH%2Fhephaestus/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":30304076,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-03-09T14:33:48.460Z","status":"ssl_error","status_checked_at":"2026-03-09T14:33:48.027Z","response_time":61,"last_error":"SSL_read: unexpected eof while reading","robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":false,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-10-12T00:10:36.795Z","updated_at":"2026-03-09T17:14:57.917Z","avatar_url":"https://github.com/collabH.png","language":null,"funding_links":[],"categories":[],"sub_categories":[],"readme":"# 概览\n## 背景\n* 基于Flink建设一个可扩展通用的实时数据处理引擎，包含对于setting、source、sink、dag等模块的配置，支持通过各个模块的自定义配置\u0026Flink SQL配置快速构建实时ETL任务的能力。\n## 为什么我们要使用Hephaestus\n* Hephaestus目前已在多个场景广泛应用,并支持数百万亿的大流量场景。\n  * 多种数据集成解决方案, 覆盖离线、实时、增量场景\n  * 分布式架构, 支持水平扩展，动态扩缩容；\n  * 在准确性、稳定性、性能上，成熟度更好\n  * 丰富的基础功能，例如配置化任务接入、异构数据源接入、自定义SQL拓扑等；\n  * 完善的任务运行状态监控，例如流量、QPS、延迟等\n## 愿景\n* 希望人人都可以快速、便捷、低代码、配置化方式的接入Flink，快速构建实时数据处理任务；\n## 适用场景\n* 异构数据源海量数据同步\n* 流批一体数据处理能力\n* 湖仓一体数据处理能力\n* 高性能、高可靠的数据同步\n* 分布式架构数据集成引擎\n## 支持能力\n* 支持开源版本Flink所有功能\n* 支持Datastream API+Table API+Flink SQL灵活组合，屏蔽底层Flink接入细节，支持快速接入Flink\n* 支持Flink SQL自定义算子拓扑能力，例如自定义算子并行度、uid、算子名、算子描述、上下游选择分区策略等；\n* 支持时间宏函数、UDF、灵活任务配置能力等；\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fcollabh%2Fhephaestus","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fcollabh%2Fhephaestus","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fcollabh%2Fhephaestus/lists"}