{"id":18615391,"url":"https://github.com/8treenet/cdp-service","last_synced_at":"2025-06-14T10:39:13.084Z","repository":{"id":65621340,"uuid":"372503265","full_name":"8treenet/cdp-service","owner":"8treenet","description":"cdp数据平台，帮助企业充分了解客户，实现千人千面的精准营销。","archived":false,"fork":false,"pushed_at":"2021-11-11T04:04:12.000Z","size":1069,"stargazers_count":41,"open_issues_count":0,"forks_count":12,"subscribers_count":4,"default_branch":"master","last_synced_at":"2025-03-25T06:51:16.760Z","etag":null,"topics":["big-data","cdp","crm","dmp","portrait"],"latest_commit_sha":null,"homepage":"","language":"Go","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/8treenet.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null}},"created_at":"2021-05-31T12:43:28.000Z","updated_at":"2025-03-07T09:45:36.000Z","dependencies_parsed_at":"2023-02-01T06:30:55.090Z","dependency_job_id":null,"html_url":"https://github.com/8treenet/cdp-service","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/8treenet%2Fcdp-service","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/8treenet%2Fcdp-service/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/8treenet%2Fcdp-service/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/8treenet%2Fcdp-service/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/8treenet","download_url":"https://codeload.github.com/8treenet/cdp-service/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":248322247,"owners_count":21084334,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["big-data","cdp","crm","dmp","portrait"],"created_at":"2024-11-07T03:29:13.067Z","updated_at":"2025-04-11T00:31:10.557Z","avatar_url":"https://github.com/8treenet.png","language":"Go","funding_links":[],"categories":[],"sub_categories":[],"readme":"# cdp-service\ncdp数据平台，帮助企业充分了解客户，实现千人千面的精准营销。\n\n#### 开发中....\n\n## 功能预览\n\n提供API、MQ、SDK埋点方式，以及文件方式的导入数据。\n\n提供实时计算的用户画像、经营报表、广告推荐以及通过CRM系统的用户触达。\n\n![](https://tcs.teambition.net/storage/3127f48b96de8f842d52457fbf80112b1814?Signature=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJBcHBJRCI6IjU5Mzc3MGZmODM5NjMyMDAyZTAzNThmMSIsIl9hcHBJZCI6IjU5Mzc3MGZmODM5NjMyMDAyZTAzNThmMSIsIl9vcmdhbml6YXRpb25JZCI6IiIsImV4cCI6MTYyNjQyMjA4NywiaWF0IjoxNjI1ODE3Mjg3LCJyZXNvdXJjZSI6Ii9zdG9yYWdlLzMxMjdmNDhiOTZkZThmODQyZDUyNDU3ZmJmODAxMTJiMTgxNCJ9.jYduJSu8BrxjLX5VjWA_R_TyuVYqblBXpSiJQ0z5ANA\u0026download=preview.png \"\")\n\n\n\n## 架构预览\n\n本项目以2个服务组成，cdp-service是核心服务，backend-service是围绕管理后台的服务，如果有自己的管理后台服务，可以直接接入cdp-service。\n\n![](https://tcs.teambition.net/storage/3127e711963dc6c3d194e488c0408f482aab?Signature=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJBcHBJRCI6IjU5Mzc3MGZmODM5NjMyMDAyZTAzNThmMSIsIl9hcHBJZCI6IjU5Mzc3MGZmODM5NjMyMDAyZTAzNThmMSIsIl9vcmdhbml6YXRpb25JZCI6IiIsImV4cCI6MTYyNjQyMjA4NywiaWF0IjoxNjI1ODE3Mjg3LCJyZXNvdXJjZSI6Ii9zdG9yYWdlLzMxMjdlNzExOTYzZGM2YzNkMTk0ZTQ4OGMwNDA4ZjQ4MmFhYiJ9.YaK-VfihPJ_oDccyplShDhyDFcsmV30x0FL4zW0K1Ys\u0026download=map.png \"\")\n\n## 中间件模块介绍\n\n### Kafka模块\n\n用于行为埋点的消峰，在上万同时埋点的情况下使用mq方式。\n\n### Prometheus模块\n\n用于系统的监控，大数据环境的数据操作和读取较慢，需要普罗米修斯监控性能。\n\n### JWT模块\n\n用于后台的管理员账户鉴权。\n\n### Echarts模块\n\n可视化图表的HTML的处理，用于展示各种图形的汇总数据\n\n### Flink模块\n\n用于各种行为埋点的数据合并和数据清洗。\n\n### Istio模块\n\n用于系统的灰度发布，负载均衡的流量控制。\n\n\n\n## backend-service模块介绍\n\n### 菜单管理、权限管理、角色管理模块\n\n动态路由，动态菜单，角色增删查改，用户增删查改，casbin鉴权。\n\n### 文件导入、文件导出模块\n\n转换文件形式的埋点数据，并导入cdp-service，以及导出报表数据。\n\n### dict模块\n\n字典常用功能，可以支持枚举等数据转换。\n\n### 可视化报表模块\n\n组织cdp-service服务计算出的汇总数据并且使用Echarts模块展示各种图形报表。\n\n### 条件编辑模块\n\n主要用来转移图形化的条件。为画像、触达、等事件图形化转移后输入到cdp-service。\n\n### 活动管理模块\n\n促销优惠、拉新、转化等活动创建和管理。\n\n### 事件编辑模块\n\n画像、触达、推荐等事件管理。\n\n### 元数据编辑模块\n\n创建和管理客户、行为等元数据。\n\n### 配置管理模块\n\n管理cdp-service的配置。\n\n\n\n## cdp-service模块介绍\n\n### 行为管理模块\n\n- 创建行为\n\n- 管理行为的元数据\n\n- 行为缓冲区\n\n- 批量行为入数仓\n\n- 系统行为/通用行为/行业行为的抽象处理\n\n### 客户管理模块\n\n- 创建客户\n\n- 管理客户的元数据\n\n- 批量客户入数仓\n\n### 事件管理和事件引擎模块\n\n- 创建和修改事件\n\n- 定时器执行事件\n\n- 抽象设计事件引擎为活动、画像、推荐提供支持\n\n- 智能触达\n\n### 推送模块\n\n- 抽象可扩展的第三方接入设计\n\n- 提供默认推送功能短信、微信、scrm\n\n### 画像分析模块\n\n- 基于事件引擎的离线标签(可配置权重)。\n\n- 查询引擎的实时计算(可配置权重)。\n\n- 画像条件管理。\n\n- 查询满足画像客户列表。\n\n- 手动打标签。\n\n### 相似推荐模块\n\n- 基于相似画像客户的行为推荐(可配置权重)。\n\n- 基于相似推荐条件的行为推荐(可配置权重)。\n\n- 基于CatBoots机器学习的行为推荐(可配置权重)。\n\n### 数据清洗、和数据合并模块\n\n使用Flink做数据清洗和数据合并，可在backend-service服务配置条件。\n\n### GEO模块\n\n- 为行为的IP地址提供地理位置查询。\n\n- 为行为的经纬度提供地理位置查询。\n\n### AB/Test\n\n- 增删查改管理。\n\n- 为事件引擎提供分流。\n\n- 提供实验结果报表\n\n### 查询引擎\n\n- 解析步骤、条件、关联成查询对象。\n\n- 解析查询对象为SQL。\n\n- 可扩展、抽象的链式对象设计。\n\n- Clickhouse特性封装。\n\n- DSL查询描述层。","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2F8treenet%2Fcdp-service","html_url":"https://awesome.ecosyste.ms/projects/github.com%2F8treenet%2Fcdp-service","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2F8treenet%2Fcdp-service/lists"}