{"id":21421393,"url":"https://github.com/anshiii/pixder","last_synced_at":"2025-08-09T23:34:53.751Z","repository":{"id":128373478,"uuid":"97465035","full_name":"Anshiii/pixder","owner":"Anshiii","description":"🤔 A spider for pixiv.net ","archived":false,"fork":false,"pushed_at":"2017-08-24T07:04:51.000Z","size":44,"stargazers_count":0,"open_issues_count":0,"forks_count":0,"subscribers_count":1,"default_branch":"master","last_synced_at":"2025-03-16T20:13:55.408Z","etag":null,"topics":["crawler","pixiv","spider"],"latest_commit_sha":null,"homepage":"","language":"JavaScript","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/Anshiii.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2017-07-17T10:38:00.000Z","updated_at":"2017-08-24T07:04:20.000Z","dependencies_parsed_at":null,"dependency_job_id":"a3bbec0a-d502-400c-b66c-3689fafbda28","html_url":"https://github.com/Anshiii/pixder","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/Anshiii/pixder","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Anshiii%2Fpixder","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Anshiii%2Fpixder/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Anshiii%2Fpixder/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Anshiii%2Fpixder/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/Anshiii","download_url":"https://codeload.github.com/Anshiii/pixder/tar.gz/refs/heads/master","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Anshiii%2Fpixder/sbom","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":269653934,"owners_count":24454317,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","status":"online","status_checked_at":"2025-08-09T02:00:10.424Z","response_time":111,"last_error":null,"robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":true,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["crawler","pixiv","spider"],"created_at":"2024-11-22T20:33:53.008Z","updated_at":"2025-08-09T23:34:53.727Z","avatar_url":"https://github.com/Anshiii.png","language":"JavaScript","funding_links":[],"categories":[],"sub_categories":[],"readme":"\n# pixider \n一个用于将 pixiv.net 的图片下载并保存到本地的小爬虫工具。\n默认的任务是爬取个人关注画师的插画投稿类作品，并保存在项目下的 Data 目录。\n\n\n## 使用\n不好意思...暂时只写了个半自动的  \n需要先自行登录，将主页响应的cookie写在 `config/config.js` 的配置里。 \n \n```\nlet cookie = COOKIES.cookie;  //input your cookies here\n```\n\n## 运行\n注：为避免访问过于频繁，限制了同时间 http 请求数，默认的最大值为5。\n\n```\nnpm run app.js\n```\n\u003enode 7.6+\n\n\n\n\n## Api\n * [x] getFollowingIllusts(id,option)\n 获取关注的用户的投稿作品  \n * [ ] getImageFromRank(option)  \n 获取插画排行榜上的投稿作品，默认为当时的排行榜。\n * [ ] getImageByKeyWord(key，option) //未完成  \n 获取搜索关键词返回的作品，默认只返回前50项。\n * Option\u003cpre\u003e\n  {\n  rate:Number,\t\t     //返回大于该分数的图片\n  time:String/Array, \t//格式如'20170707'如果参数为字符串，则默认为该从日期至今的作品，如果为数组，则为数组内两个日期之间的作品\n  day:String,\t\t   //仅获取该日期的数据\n  type:['illust','manga','ugoira']      //限定爬取的图片类型，插画，漫画，动图。默认为插画。\n  }\n\u003c/pre\u003e\n\n## 待完成的功能\n比起莫名的优化，不如多完善项目吧 孩子...  \n\n* [ ]  进程中断后，重启进程能从之前进度开始/判断已下载项目重来\n\n## 个人心得\n重构了2次，但是哪怕是现在的代码，阅读起来还是不那么直接明了；\n虽然用上了 promise + async/wait ,也亏这个项目，对 Event loop 算是有了更深层次的理解。\n还想装逼用多进程...还需了解异步的优点到底是什么...\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fanshiii%2Fpixder","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fanshiii%2Fpixder","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fanshiii%2Fpixder/lists"}