{"id":23357520,"url":"https://github.com/cs-magic-open/auto-gui","last_synced_at":"2026-03-04T09:02:32.596Z","repository":{"id":263924973,"uuid":"891805622","full_name":"cs-magic-open/auto-gui","owner":"cs-magic-open","description":"AI Browser Assistant (experimental) 基于大语言模型的浏览器自动化助手，能够通过自然语言指令完成各种浏览器操作任务。","archived":false,"fork":false,"pushed_at":"2024-11-21T02:01:21.000Z","size":67,"stargazers_count":1,"open_issues_count":0,"forks_count":0,"subscribers_count":1,"default_branch":"main","last_synced_at":"2025-11-27T15:28:31.060Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":"","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/cs-magic-open.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2024-11-21T01:37:46.000Z","updated_at":"2025-01-15T11:28:06.000Z","dependencies_parsed_at":"2024-11-21T03:17:21.643Z","dependency_job_id":"d9cac66a-a40f-4327-a5d9-fc02a6b2cd06","html_url":"https://github.com/cs-magic-open/auto-gui","commit_stats":null,"previous_names":["cs-magic/auto-gui","cs-magic-open/auto-gui"],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/cs-magic-open/auto-gui","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/cs-magic-open%2Fauto-gui","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/cs-magic-open%2Fauto-gui/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/cs-magic-open%2Fauto-gui/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/cs-magic-open%2Fauto-gui/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/cs-magic-open","download_url":"https://codeload.github.com/cs-magic-open/auto-gui/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/cs-magic-open%2Fauto-gui/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":30076935,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-03-04T08:01:56.766Z","status":"ssl_error","status_checked_at":"2026-03-04T08:00:42.919Z","response_time":59,"last_error":"SSL_connect returned=1 errno=0 peeraddr=140.82.121.5:443 state=error: unexpected eof while reading","robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":false,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-12-21T10:29:21.284Z","updated_at":"2026-03-04T09:02:32.577Z","avatar_url":"https://github.com/cs-magic-open.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"# AI Browser Assistant (experimental)\n\n\u003e 用 cursor 两小时试了一下，目前还需要进一步优化，暂时仅供学习使用。\n\n基于大语言模型的浏览器自动化助手，能够通过自然语言指令完成各种浏览器操作任务。\n\n## 功能特点\n\n- 支持自然语言输入任务指令\n- 基于 Claude-3.5 大语言模型的智能决策\n- 实时屏幕截图分析\n- 自动化鼠标和键盘操作\n- 任务进度实时监控\n- 支持任务中断和取消\n\n## 工作原理\n\n1. 用户输入自然语言任务描述\n2. 系统启动任务循环:\n   - 捕获当前屏幕截图\n   - 将截图发送给 Claude-3.5 分析\n   - 模型根据当前界面状态决定下一步操作\n   - 执行相应的鼠标/键盘操作\n   - 评估任务完成状态\n3. 任务完成或用户手动中断时结束\n\n## 使用示例 (TODO)\n\n```python\n# 示例任务: 在京东购买帽子\ntask = \"在京东上找一顶好看且性价比高的帽子并完成购买\"\nassistant = BrowserAssistant()\nassistant.run_task(task)\n```\n\n\n## 环境要求\n\n- Python 3.8+\n- 依赖包:\n  - opencv-python\n  - pyautogui\n  - anthropic-sdk\n  - pillow\n\n## 安装说明\n\n\n```bash\ngit clone https://github.com/yourusername/ai-browser-assistant\ncd ai-browser-assistant\npip install -r requirements.txt\n```\n\n\n## 配置说明\n\n1. 在 `config.yaml` 中配置你的 Claude API 密钥:\n\n```yaml\nclaude:\napi_key: \"your-api-key-here\"\n```\n\n2. 根据需要调整截图间隔和其他参数\n\n## 使用注意\n\n- 确保良好的网络连接以保证与 Claude API 的通信\n- 建议在操作过程中不要移动鼠标或使用键盘\n- 如需中断任务，按 Ctrl+C\n\n## 开发计划\n\n- [ ] 支持更多浏览器操作\n- [ ] 优化模型决策准确性\n- [ ] 添加任务历史记录\n- [ ] 支持并行任务处理\n- [ ] 添加 GUI 界面\n\n## 贡献指南\n\n欢迎提交 Issue 和 Pull Request 来帮助改进项目。\n\n## 许可证\n\nMIT License\n\n## 联系方式\n\n- 项目主页: https://github.com/cs-magic/auto-gui\n- 问题反馈: https://github.com/cs-magic/auto-gui/issues\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fcs-magic-open%2Fauto-gui","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fcs-magic-open%2Fauto-gui","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fcs-magic-open%2Fauto-gui/lists"}