{"id":13671400,"url":"https://github.com/qieguo2016/spiders","last_synced_at":"2025-06-26T05:02:19.715Z","repository":{"id":45813956,"uuid":"69654500","full_name":"qieguo2016/spiders","owner":"qieguo2016","description":"一个NodeJs爬虫集，包括知乎、豆瓣、拉勾等网站爬虫","archived":false,"fork":false,"pushed_at":"2017-02-15T16:00:57.000Z","size":1465,"stargazers_count":275,"open_issues_count":1,"forks_count":98,"subscribers_count":7,"default_branch":"master","last_synced_at":"2025-06-02T11:55:51.983Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":"","language":"JavaScript","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/qieguo2016.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"License","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null}},"created_at":"2016-09-30T09:42:27.000Z","updated_at":"2025-03-19T21:36:38.000Z","dependencies_parsed_at":"2022-08-27T06:10:13.742Z","dependency_job_id":null,"html_url":"https://github.com/qieguo2016/spiders","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/qieguo2016/spiders","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/qieguo2016%2Fspiders","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/qieguo2016%2Fspiders/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/qieguo2016%2Fspiders/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/qieguo2016%2Fspiders/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/qieguo2016","download_url":"https://codeload.github.com/qieguo2016/spiders/tar.gz/refs/heads/master","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/qieguo2016%2Fspiders/sbom","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":262003915,"owners_count":23243346,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-08-02T09:01:08.639Z","updated_at":"2025-06-26T05:02:19.660Z","avatar_url":"https://github.com/qieguo2016.png","language":"JavaScript","funding_links":[],"categories":["JavaScript"],"sub_categories":[],"readme":"A Store of Spiders\n------\n\n- 知乎爬虫\n\n    有两个版本，数据库版本和JSON文件版本。具体说明参见项目内部说明文档。\n    ![知乎爬虫效果](https://github.com/qieguo2016/spiders/blob/master/resource/zhihu.jpg)\n\n- 拉勾爬虫\n\n    主要是统计不同岗位在不同城市的分布情况：公司规模，需求年限等，本来想结合地图做热力图分布图啥的，还是太懒。。。\n     ![知乎爬虫效果](https://github.com/qieguo2016/spiders/blob/master/resource/lagou.png)\n\n- 豆瓣爬虫\n\n    根据标题关键词筛选选定小组内的帖子。\n     ![知乎爬虫效果](https://github.com/qieguo2016/spiders/blob/master/resource/douban.png)\n\n**PS：欢迎大家把自己手上的爬虫拿出来分享哈!**\n\n**另外，还请顺手给个star呗！\u003c(￣ˇ￣)/**\n\n*上面的图有点问题？我什么也不知道呀！(*/ω╲*)纯真脸*\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fqieguo2016%2Fspiders","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fqieguo2016%2Fspiders","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fqieguo2016%2Fspiders/lists"}