{"id":19991509,"url":"https://github.com/qwqcode/Nacollector","last_synced_at":"2025-05-04T10:32:02.258Z","repository":{"id":38009302,"uuid":"98152060","full_name":"qwqcode/Nacollector","owner":"qwqcode","description":"Nacollector is a platform for web data collection.","archived":true,"fork":false,"pushed_at":"2025-01-06T14:20:01.000Z","size":8344,"stargazers_count":194,"open_issues_count":2,"forks_count":67,"subscribers_count":15,"default_branch":"master","last_synced_at":"2025-03-06T06:48:15.489Z","etag":null,"topics":["cef","cefsharp","collector","download-manager","downloader","image-downloader","material-design","webapp"],"latest_commit_sha":null,"homepage":"https://qwqaq.com/65c99d88.html","language":"C#","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"other","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/qwqcode.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null}},"created_at":"2017-07-24T05:27:06.000Z","updated_at":"2025-01-06T14:24:39.000Z","dependencies_parsed_at":"2023-01-24T10:15:30.032Z","dependency_job_id":null,"html_url":"https://github.com/qwqcode/Nacollector","commit_stats":null,"previous_names":[],"tags_count":5,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/qwqcode%2FNacollector","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/qwqcode%2FNacollector/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/qwqcode%2FNacollector/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/qwqcode%2FNacollector/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/qwqcode","download_url":"https://codeload.github.com/qwqcode/Nacollector/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":252320432,"owners_count":21729126,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["cef","cefsharp","collector","download-manager","downloader","image-downloader","material-design","webapp"],"created_at":"2024-11-13T04:51:47.527Z","updated_at":"2025-05-04T10:31:57.243Z","avatar_url":"https://github.com/qwqcode.png","language":"C#","funding_links":[],"categories":["C\\#"],"sub_categories":[],"readme":"\u003cp align=\"center\"\u003e\u003cimg src=\"./docs/NacollectorLogo_2.png\"\u003e\u003c/p\u003e\n\n# Nacollector\n\n[![](https://img.shields.io/github/release/qwqcode/Nacollector.svg?style=flat-square)](https://github.com/qwqcode/Nacollector/releases/latest) ![](https://img.shields.io/badge/NET-%3E%3D%204.6.2-green.svg?style=flat-square) [![](https://img.shields.io/github/downloads/qwqcode/Nacollector/total.svg?style=flat-square)](https://github.com/qwqcode/Nacollector/releases) [![](https://img.shields.io/github/last-commit/qwqcode/Nacollector.svg?style=flat-square)](https://github.com/qwqcode/Nacollector/commits) [![](https://img.shields.io/github/issues/qwqcode/Nacollector.svg?style=flat-square)](https://github.com/qwqcode/Nacollector/issues) [![](https://img.shields.io/github/issues-pr/qwqcode/Nacollector.svg?style=flat-square)](https://github.com/qwqcode/Nacollector/pulls) [![](https://img.shields.io/gitter/room/qwqcode/Nacollector.svg?style=flat-square)](https://gitter.im/Nacollector/community) [![](https://img.shields.io/badge/%24-donate-ff69b4.svg?style=flat-square)](https://github.com/qwqcode/donate-qwqaq)\n\n\u003e Nacollector 可以说是一个用于采集各种 WEB 资源的工作站？！ #(滑稽)\n\n注：在使用 Nacollector 前，请仔细阅读[《Nacollector 用户使用许可协议》](./LICENSE)\n\n#### 特性\n- Material Design\n- [CefSharp](https://github.com/cefsharp/CefSharp) 嵌入 Chromium，用 HTML/CSS/JS 制作前端 Ui\n- 前后端分离，[NacollectorFrontend](https://github.com/qwqcode/NacollectorFrontend)\n- 前端 Console 实时采集日志\n- 多任务管理器，多个采集任务同时进行\n- 下载内容管理器，具有和 Chrome 一样的功能\n- Cookie 获取器（可手动导入 Cookie，自动填充，Cookie 记录，正则表达式配置规则）\n- 多线程异步采集实例\n- 资源快速预览\n- 支持使用代理\n- 在线/离线 自动更新\n- 以及更多...\n\n#### Features\n- Material Design\n- [CefSharp](https://github.com/cefsharp/CefSharp) embed Chromium in the .NET app to use JS/HTML/CSS as Front-end UI\n- Separate Front-end and Back-end, [see NacollectorFrontend](https://github.com/qwqcode/NacollectorFrontend)\n- Real-time collection logs in the Front-end Console\n- Multitasking Manager to manage multiple collection tasks\n- Download Content Manager like chrome browser\n- Cookie getter (manually import cookies, input auto-complete, keep cookies fresh longer, using regular expressions)\n- Multiple Async Tasks example\n- Resources Preview\n- Support for using proxy\n- Automatically update online/offline\n- And more...\n\n#### Requirements\n- NET \u003e= 4.6.2\n- [CefSharp](https://github.com/cefsharp/CefSharp)\n- [CsQuery](https://github.com/jamietre/CsQuery)\n- Selenium.WebDriver\n\n#### 功能\n\n- 商品详情页图片解析\n  - 支持网站： 淘宝、天猫、苏宁、国美\n  - 支持图片类型：主图、分类图、详情图\n  - 支持即时预览 显示 URL\n  - 支持下载单张图片 右键另存为\n  - 支持下载所有图片 打包为压缩文件并保存\n- 商品详情页视频抓取\n- 淘宝店铺搜索卖家ID名采集\n  - 支持忽略天猫店铺\n- 天猫供销平台分销商一键邀请\n  - 支持卖家账号登录 得到 Cookie（也可以手动输入 Cookie 字符串）\n- 天猫供销平台分销商一键撤回\n- 将来会有更多功能，随缘更新\n\n## Development\n\n#### Get the sources\n\n\nIn order to make development easier, the frontend is included in the backend as a [git submodule](https://git-scm.com/book/en/v2/Git-Tools-Submodules).\n\nThen, in order to tinker with the sources, start by getting both repos at once with:\n\n``` bash\ngit clone --recurse-submodules https://github.com/qwqcode/Nacollector.git\n```\n\n\u003e NOTE: since it is a submodule, when developing the frontend remember to update the backend repo accordingly.\n\n#### Quick Start\n\n```bash\n# 1. clone\ngit clone --recurse-submodules https://github.com/qwqcode/Nacollector.git\ncd Nacollector\n\n# 2. copy config files\ncp ./Nacollector/GlobalConstant.cs.example ./Nacollector/GlobalConstant.cs\n\n# 3. download `https://github.com/qwqcode/Nacollector/releases/download/1.3.0.0/CefSharp_v69.7z` to `./CefSharp/` and unpack\n\n# 4. open .sln by vs\nstart Nacollector.sln\n```\n\n## Donate\n如果您觉得我的项目对您有帮助，并且您愿意给予我一点小小的支持，您可以通过以下方式向我捐赠，这样可以维持项目持续地发展，非常感谢！ヽ(•̀ω•́ )ゝ\n\nIf you are enjoying this app, please consider making a donation to keep it alive.\n\n| Alipay | Wechat | \n| :------: | :------: | \n| \u003cimg width=\"150\" src=\"./docs/donate/alipay.png\"\u003e | \u003cimg width=\"150\" src=\"./docs/donate/wechat.png\"\u003e | \n\n捐赠者的名字将保存于 [捐赠者列表](https://github.com/qwqcode/donate-qwqaq)，非常感谢你们的支持\n\n## License\n\n请务必仔细阅读 [《Nacollector 用户使用许可协议》](./LICENSE)\n\n[Nacollector](https://github.com/qwqcode/Nacollector) Copyright (C) 2018 [qwqaq.com](https://qwqaq.com)\n\n禁止擅自以任何收费形式盈利，禁止擅自修改版权信息，侵权必究！\n\n## Stargazers over time\n\n[![Stargazers over time](https://starchart.cc/qwqcode/Nacollector.svg)](https://starchart.cc/qwqcode/Nacollector)\n\n## Screenshots\n\u003cp align=\"center\"\u003e\n\u003cimg src=\"./docs/screenshots/home.png\"\u003e\n\u003cimg src=\"./docs/screenshots/terminal.png\"\u003e\n\u003cimg src=\"./docs/screenshots/terminal1.png\"\u003e\n\u003cimg src=\"./docs/screenshots/terminal2.png\"\u003e\n\u003cimg src=\"./docs/screenshots/terminal3.png\"\u003e\n\u003cimg src=\"./docs/screenshots/terminal4.png\"\u003e\n\u003cimg src=\"./docs/screenshots/terminal5.png\"\u003e\n\u003cimg src=\"./docs/screenshots/terminal6.png\"\u003e\n\u003cimg src=\"./docs/screenshots/action.gif\"\u003e\n\u003cimg src=\"./docs/screenshots/cookie_getter.png\"\u003e\n\u003cimg src=\"./docs/screenshots/tasks.png\"\u003e\n\u003cimg src=\"./docs/screenshots/downloading.png\"\u003e\n\u003cimg src=\"./docs/screenshots/downloading1.png\"\u003e\n\u003cimg src=\"./docs/screenshots/settings.png\"\u003e\n\u003cimg src=\"./docs/screenshots/panel.gif\"\u003e\n\u003c/p\u003e\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fqwqcode%2FNacollector","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fqwqcode%2FNacollector","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fqwqcode%2FNacollector/lists"}