{"id":27218025,"url":"https://github.com/nahco3-code/box-users-mapper","last_synced_at":"2025-07-22T20:03:59.340Z","repository":{"id":255172336,"uuid":"848743024","full_name":"NaHCO3-code/box-users-mapper","owner":"NaHCO3-code","description":null,"archived":false,"fork":false,"pushed_at":"2024-08-29T08:56:27.000Z","size":80,"stargazers_count":2,"open_issues_count":0,"forks_count":0,"subscribers_count":1,"default_branch":"master","last_synced_at":"2025-04-10T05:41:55.278Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":null,"language":"Rust","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/NaHCO3-code.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2024-08-28T10:24:58.000Z","updated_at":"2025-04-09T15:11:51.000Z","dependencies_parsed_at":null,"dependency_job_id":"7284aaea-b1b9-4e15-9b0f-c0f300d94157","html_url":"https://github.com/NaHCO3-code/box-users-mapper","commit_stats":null,"previous_names":["nahco3-code/box-users-mapper"],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/NaHCO3-code/box-users-mapper","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/NaHCO3-code%2Fbox-users-mapper","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/NaHCO3-code%2Fbox-users-mapper/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/NaHCO3-code%2Fbox-users-mapper/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/NaHCO3-code%2Fbox-users-mapper/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/NaHCO3-code","download_url":"https://codeload.github.com/NaHCO3-code/box-users-mapper/tar.gz/refs/heads/master","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/NaHCO3-code%2Fbox-users-mapper/sbom","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":266563915,"owners_count":23948689,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","status":"online","status_checked_at":"2025-07-22T02:00:09.085Z","response_time":66,"last_error":null,"robots_txt_status":null,"robots_txt_updated_at":null,"robots_txt_url":"https://github.com/robots.txt","online":true,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2025-04-10T05:35:46.152Z","updated_at":"2025-07-22T20:03:59.325Z","avatar_url":"https://github.com/NaHCO3-code.png","language":"Rust","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Box Users Mapper\n\n爬取box3的用户数据，以便查询之用。\n\n# 使用方法\n## 查询用户/统计数据\n直接下载项目目录里的box3-user-data.csv\n\n## 爬取用户数据\n见下文贡献方法\n\n# 贡献方法\n\nbox3的用户数量很多，而且需要考虑反爬，经过测试，每秒最多发送两个请求。\n\n目前只爬取了非常小一部分的用户数据。欢迎各位帮助壮大数据库。\n\n## 1. 配置环境并编译代码\n1. [安装rust](https://course.rs/first-try/installation.html)\n2. 配置 rust 环境：打开终端 (cmd) ，运行`rustup default stable`\n3. 下载项目：`git clone git@github.com:NaHCO3-code/box-users-mapper.git`\n4. 编译代码：`cargo build --release`\n\n## 2. 爬取数据\n`cargo run --release -- query \u003cstartid\u003e \u003cendid\u003e`\n这表示，扫描id从`startid`到`endid`的box3用户数据。\nid尽量和已有的数据错开。\n\n## 3. 提交\n### 提交代码\n我只是 rust 初学者，如果你有代码方面的建议欢迎提pull request。\n### 提交数据\n非常欢迎补全数据库。在提交数据时，请注意以下几点：\n- 提交信息请写明你爬取的数据的起始和终止id。例如：1000-5000\n- 请不要运行`cargo run --release -- merge`。这个命令会整合所有已经爬取的数据到一个文件里，但是这可能会导致代码冲突。我会定期进行整合。如果你有整合数据的需要，可以将原来的csv文件备份复制到其他地方，提交的时候再复制回来。\n- 请不要删除已有的数据，哪怕你发现部分数据发生了重叠或者其他异常情况。如果发现了这类问题，请提issue。\n- 如果你对这些数据感兴趣，可以将csv文件直接导入到你的电子表格软件。但是，如果你对这些数据进行了分析或者排序，请保存到其他位置，不要覆盖原始数据。同样，这可能导致代码冲突。\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fnahco3-code%2Fbox-users-mapper","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fnahco3-code%2Fbox-users-mapper","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fnahco3-code%2Fbox-users-mapper/lists"}