{"id":27381498,"url":"https://github.com/jsrep/crawler-leetcode","last_synced_at":"2025-04-13T14:57:05.532Z","repository":{"id":287536108,"uuid":"628357926","full_name":"JSREP/crawler-leetcode","owner":"JSREP","description":"Crawler LeetCode，爬虫挑战合集","archived":false,"fork":false,"pushed_at":"2025-04-13T14:27:42.000Z","size":20844,"stargazers_count":12,"open_issues_count":0,"forks_count":1,"subscribers_count":1,"default_branch":"main","last_synced_at":"2025-04-13T14:56:49.429Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":"https://jsrep.github.io/crawler-leetcode/","language":"TypeScript","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/JSREP.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null}},"created_at":"2023-04-15T17:40:02.000Z","updated_at":"2025-04-13T14:25:27.000Z","dependencies_parsed_at":"2025-04-12T10:51:30.806Z","dependency_job_id":null,"html_url":"https://github.com/JSREP/crawler-leetcode","commit_stats":null,"previous_names":["jsrep/crawler-leetcode"],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/JSREP%2Fcrawler-leetcode","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/JSREP%2Fcrawler-leetcode/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/JSREP%2Fcrawler-leetcode/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/JSREP%2Fcrawler-leetcode/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/JSREP","download_url":"https://codeload.github.com/JSREP/crawler-leetcode/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":248732481,"owners_count":21152851,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2025-04-13T14:57:04.871Z","updated_at":"2025-04-13T14:57:05.511Z","avatar_url":"https://github.com/JSREP.png","language":"TypeScript","funding_links":[],"categories":[],"sub_categories":[],"readme":"# LeetCode 爬虫挑战\n\n[![部署GitHub Pages](https://github.com/JSREP/crawler-leetcode/actions/workflows/deploy-github-pages.yml/badge.svg)](https://github.com/JSREP/crawler-leetcode/actions/workflows/deploy-github-pages.yml)\n[![部署Vercel](https://vercelbadge.vercel.app/api/jsrep/crawler-leetcode)](https://crawler-leetcode.vercel.app/)\n\n这个仓库收集了各种网站的爬虫挑战案例，展示了不同类型的反爬虫技术和解决方案。项目使用React+TypeScript开发，同时部署在GitHub Pages和Vercel平台上。\n\n**在线访问**: \n- GitHub Pages (需要VPN): [https://jsrep.github.io/crawler-leetcode/](https://jsrep.github.io/crawler-leetcode/)\n- Vercel (国内直接访问): [https://crawler-leetcode.vercel.app/](https://crawler-leetcode.vercel.app/)\n\n![image-20250413185708120](./README.assets/image-20250413185708120.png)\n\n## 项目结构\n\n```\ncrawler-leetcode/\n├── .github/             # GitHub相关配置\n│   └── workflows/       # GitHub Actions工作流配置\n├── docs/                # 文档和挑战定义\n│   └── challenges/      # 爬虫挑战YAML定义文件\n├── public/              # 静态资源\n├── src/                 # 源代码\n│   ├── components/      # React组件\n│   ├── pages/           # 页面组件\n│   ├── plugins/         # 项目插件\n│   ├── utils/           # 工具函数\n│   └── App.tsx          # 应用入口\n├── package.json         # 项目依赖\n└── vite.config.ts       # Vite配置\n```\n\n## 爬虫挑战\n\n所有爬虫挑战都定义在 `docs/challenges/` 目录中，使用YAML格式描述挑战的特点、难度和解决方案。详细的贡献指南请参考 [挑战贡献指南](docs/challenges/README.md)。\n\n目前包含的挑战类型：\n\n- 验证码挑战（如reCAPTCHA、hCaptcha）\n- 浏览器指纹识别\n- JavaScript混淆与加密\n- API限流与保护\n- WebAssembly保护\n- 设备指纹和行为分析\n\n## 本地开发\n\n```bash\n# 克隆项目\ngit clone https://github.com/JSREP/crawler-leetcode.git\ncd crawler-leetcode\n\n# 安装依赖\nnpm install\n\n# 启动开发服务器\nnpm run dev\n\n# 构建项目\nnpm run build\n\n# 预览构建结果\nnpm run preview\n```\n\n## 自动部署\n\n本项目配置了GitHub Actions自动部署流程，当代码推送到主分支时，会自动构建并部署到GitHub Pages：\n\n1. 检出代码\n2. 设置Node.js环境\n3. 安装依赖\n4. 构建项目\n5. 部署到gh-pages分支\n\n你可以在 `.github/workflows/deploy-github-pages.yml` 文件中查看完整的工作流配置。\n\n## 贡献指南\n\n1. Fork本仓库\n2. 创建新分支 (`git checkout -b feature/new-challenge`)\n3. 提交更改 (`git commit -m 'Add new challenge: XXX'`)\n4. 推送到分支 (`git push origin feature/new-challenge`)\n5. 创建Pull Request\n\n欢迎贡献新的爬虫挑战案例、改进文档或代码！\n\n## 许可证\n\nMIT\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fjsrep%2Fcrawler-leetcode","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fjsrep%2Fcrawler-leetcode","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fjsrep%2Fcrawler-leetcode/lists"}