{"id":13432393,"url":"https://github.com/96bearli/biliup_record","last_synced_at":"2025-03-16T23:31:17.598Z","repository":{"id":180444110,"uuid":"473302798","full_name":"96bearli/biliup_record","owner":"96bearli","description":"对bilibili的up动态留档","archived":false,"fork":false,"pushed_at":"2024-03-22T05:45:10.000Z","size":47,"stargazers_count":12,"open_issues_count":0,"forks_count":1,"subscribers_count":1,"default_branch":"main","last_synced_at":"2024-10-27T11:51:24.729Z","etag":null,"topics":["bili","crawler","python"],"latest_commit_sha":null,"homepage":"","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/96bearli.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2022-03-23T18:02:37.000Z","updated_at":"2024-10-26T13:33:28.000Z","dependencies_parsed_at":null,"dependency_job_id":"948ab039-0025-4278-806a-28b1f66e5d0f","html_url":"https://github.com/96bearli/biliup_record","commit_stats":null,"previous_names":["96bearli/biliup_record"],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/96bearli%2Fbiliup_record","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/96bearli%2Fbiliup_record/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/96bearli%2Fbiliup_record/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/96bearli%2Fbiliup_record/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/96bearli","download_url":"https://codeload.github.com/96bearli/biliup_record/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":243949895,"owners_count":20373654,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["bili","crawler","python"],"created_at":"2024-07-31T02:01:11.067Z","updated_at":"2025-03-16T23:31:17.324Z","avatar_url":"https://github.com/96bearli.png","language":"Python","funding_links":[],"categories":["其他"],"sub_categories":["直播脚本"],"readme":"# biliup_record\n\n**warn**: 20240322发现历史动态接口`api.vc.bilibili.com/dynamic_svr/v1/dynamic_svr/space_history`已部分功能失效,本程序故障,待作者有时间进行修复和重构\n\n对bilibili的**up动态进行留档**，对动态自动分类标记保存到csv文件\n\n处理得到的数据，整理得到有一定格式的markdown文件\n\n使用**协程**下载动态中涉及的图片和视频封面\n\n使用**httpx**模块，请自行pip install\n\n目前能将就用了，有些小BUG，代码还是很乱\n**偶然发现本脚本使用的接口对已注销用户同样生效**\n## 使用\n### 获取数据\nfile  **main_get.py**\n```shell\n# 两个参数\n# parm1 uids：一个用英文','隔开的字符串（无空格）\n# parm2 是否下载图片：1或0（不输入第二项参数默认不下载）\npython main_get.py \u003c\",\".join(uids)\u003e \u003cdownload_img?\u003e\n# 两个示例\n# uids:[1111,22222,333333] download_img?:False\npython main_get.py 1111,22222,333333 0   #\n# uids:[1111] download_img?:False\npython main_get.py 1111\n# out: ./data/1111\n```\n### 处理数据\nfile  **main_data.py**\n~~~shell\n# 参数 单个UID\npython main_data.py \u003cUID\u003e\n# 示例 整理./data/1111内的数据\npython main_data.py 1111\n# out: ./data/1111/data.md\n\n# 如果有pandoc可以把markdown文件转为html\n# 脚本根目录，下面命令三选一\nbash ./2html.sh \u003cUID\u003e # linux下\n.\\2html.cmd \u003cUID\u003e # windows下\npandoc -f markdown -t html -o data/\u003cUID\u003e/index.html data/\u003cUID\u003e/data.md # All\n~~~\n\n## Future\n\n* ~~进行数据处理，**markdown**格式整理动态和图片~~ (Done)\n* 使用json存放参数\n* ~~sys指定参数（uid~~ (Done)\n* 放弃CSV的数据储存方式\n* 美化代码，优化逻辑\n* 修复BUG\n* 检测img文件夹，如果图片存在不会重新下载\n* 指定动态类型\n* 指定关键词\n* 代码重构2.0\n* 数据分析、信息挖掘模式\n\n## Update\n\n|Time|Content|\n|----|----|\n|2022-3-23|协程爬虫主程序|\n|2022-3-24|.md生成主程序|\n|2022-3-24|修复.md处理BUG|\n|2022-3-24|Fix type \u0026 More strong|\n|2022-3-24|常用的动态转发已修复|\n|2022-3-24|修改文件名|\n|2022-3-25|pandoc md2html shell|\n|2022-3-25|改变两个主程序参数获取方式|\n|2022-3-25|完善生成的.md格式|\n|2022-3-26|修复转发带图动态内容（默认不下动态图）|\n|2022-3-26|pandoc md2html cmd|\n|2022-4-11|loguru 记录日志|\n\n\n## Need to fix\n\n- [x] 新card_type：audio(au)\n- [x] markdown处理: pic_data有空数据无法识别\n- [x] markdown处理: pic_data识别成功的多一'\n- [x] ~~Type:text 真实url 404（rid）~~\n- [x] Type:reprint 时间戳为0\n- [x] Type:reprint 真实url 404（rid）\n- [x] Type:reprint_2 转发文字动态无法识别\n- [ ] Type:reprint_3 转发cv无法正确识别\n- [ ] Type:reprint_4 转发音频无法正确识别-猜测\n- [ ] Type:reprint_5 转发装扮无法正确识别-猜测\n- [ ] Type:reprint_6 转发带图动态无法获得时间戳\n\n## 欢迎参与本项目\n如何参与\n1. Fork 本仓库\n2. clone fork的仓库\n3. new branch\n4. git push\n5. Pull Request\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2F96bearli%2Fbiliup_record","html_url":"https://awesome.ecosyste.ms/projects/github.com%2F96bearli%2Fbiliup_record","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2F96bearli%2Fbiliup_record/lists"}