{"id":23035814,"url":"https://github.com/blackchef/job","last_synced_at":"2026-06-30T11:31:32.124Z","repository":{"id":77548129,"uuid":"53257439","full_name":"blackChef/job","owner":"blackChef","description":"找工作用的爬虫","archived":false,"fork":false,"pushed_at":"2017-05-25T05:19:48.000Z","size":304,"stargazers_count":3,"open_issues_count":0,"forks_count":0,"subscribers_count":1,"default_branch":"master","last_synced_at":"2025-04-02T22:42:04.154Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":"","language":"JavaScript","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/blackChef.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2016-03-06T13:57:07.000Z","updated_at":"2022-05-17T09:01:17.000Z","dependencies_parsed_at":null,"dependency_job_id":"0b581c26-ff81-418f-9841-9d0299bf0630","html_url":"https://github.com/blackChef/job","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/blackChef/job","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/blackChef%2Fjob","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/blackChef%2Fjob/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/blackChef%2Fjob/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/blackChef%2Fjob/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/blackChef","download_url":"https://codeload.github.com/blackChef/job/tar.gz/refs/heads/master","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/blackChef%2Fjob/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":34965642,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-05-26T15:22:16.424Z","status":"online","status_checked_at":"2026-06-30T02:00:05.919Z","response_time":92,"last_error":null,"robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":true,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-12-15T16:47:05.888Z","updated_at":"2026-06-30T11:31:32.101Z","avatar_url":"https://github.com/blackChef.png","language":"JavaScript","funding_links":[],"categories":[],"sub_categories":[],"readme":"##Getting start\nnode index 启动服务。访问 http://localhost:5000/ 使用应用。\n\n##背景介绍\n我希望知道每天都有哪些公司发布新的招聘广告。但是招聘网站现有的模式是谁刷新谁就排在列表前面，而且并不是每个公司都会在所有招聘网站上打广告。所以我每天都需要花很多时间一个网站一个网站的翻页看，浪费时间。于是写了这个爬虫\n\n##功能介绍\n\n###服务端\n应用会抓取51job，智联，拉钩，新安人才网（安徽本地招聘网站）的招聘信息。\n每一次请求，都会重新抓取。抓取结果先按公司名称去重，再与之前的抓取结果对比，找出新的部分。打上此次抓取的时间戳，保存在本地文件（allResult.json）里。\n\n###前端\n前端拿到结果后，以时间轴的方式展现。前端可以对条目进行隐藏和添加备注操作。还可以通过修改代码的方式添加关键字，隐藏条目。\n\n##How to\n- 如何修改搜索关键字：在 index.js 里直接修改 src。\n- 如何修改城市：在 dataSrc/网站名.js 里修改 options.urlTpl 这一项。\n- 如何修改关键字过滤：在 public/index.js 里修改 ignoredTitles。\n\n##技术特点\n用 rxJs 帮助处理异步问题。抓取时会先**同时抓**某个网站5页信息，**5页完成之后再抓**取下个网站的5页，全部结束之后返回结果。\n\n##已知问题\n- 配置需要修改代码，前端没有修改的地方。\n- 前端进行隐藏、备注的操作结果以 localStorage 的形式保存在浏览器里，没有存到服务端。\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fblackchef%2Fjob","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fblackchef%2Fjob","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fblackchef%2Fjob/lists"}