Projects in Awesome Lists tagged with gui-agents
A curated list of projects in awesome lists tagged with gui-agents .
https://github.com/bytedance/ui-tars-desktop
A GUI Agent application based on UI-TARS(Vision-Language Model) that allows you to control your computer using natural language.
agent browser-use computer-use electron gui-agents mcp mcp-server vision vite vlm
Last synced: 09 Sep 2025
https://github.com/simular-ai/Agent-S
Agent S: an open agentic framework that uses computers like a human
agent-computer-interface ai-agents computer-automation computer-use grounding gui-agents in-context-reinforcement-learning memory mllm planning retrieval-augmented-generation
Last synced: 07 May 2025
https://github.com/stepfun-ai/gelab-zero
STEP-GUI: The top GUI agent solution in the galaxy. Developed by the StepFun-GELab team and powered by StepFun’s cutting-edge research capabilities.
agent gui-agents phone-use-agent pua
Last synced: 10 Jun 2026
https://github.com/OpenGVLab/ScaleCUA
ScaleCUA is the open-sourced computer use agents that can operate on cross-platform environments (Windows, macOS, Ubuntu, Android).
computer-use-agents data gui-agents models online-evaluation-suite scalecua
Last synced: 08 Jul 2026
https://github.com/opengvlab/scalecua
ScaleCUA is the open-sourced computer use agents that can operate on corss-platform environments (Windows, macOS, Ubuntu, Android).
computer-use-agents data gui-agents models online-evaluation-suite scalecua
Last synced: 28 Oct 2025
https://github.com/osu-nlp-group/uground
[ICLR'25 Oral] UGround: Universal GUI Visual Grounding for GUI Agents
artificial-intelligence gui-agents web-agents
Last synced: 16 May 2025
https://github.com/OSU-NLP-Group/UGround
[ICLR'25 Oral] UGround: Universal GUI Visual Grounding for GUI Agents
artificial-intelligence gui-agents web-agents
Last synced: 19 Jun 2026
https://github.com/zju-real/gui-rcpo
[AAAI 2026] Test-Time Reinforcement Learning for GUI Grounding via Region Consistency https://arxiv.org/abs/2508.05615
Last synced: 27 Jul 2026
https://github.com/UCSB-AI/Screen-Point-and-Read
Code repo for "Read Anywhere Pointed: Layout-aware GUI Screen Reading with Tree-of-Lens Grounding"
ai-agents grounding gui-agents layout-understanding screen-reader tree-of-lens
Last synced: 08 Jul 2026
https://github.com/philfung/awesome-computer-use
Curated resources about automated GUI computer-use via LLMs. Highly opinionated, focus is on quality vs quantity.
anthropic anthropic-claude computer-use computer-vision gpt-4-vision gui-agents llm rpa rpa-robotic-process-automation tool-use vision
Last synced: 27 Jan 2026
https://github.com/osu-nlp-group/explorer
[ACL'25 (Findings)] Explorer: Scaling Exploration-driven Web Trajectory Synthesis for Multimodal Web Agents
gui-agents machine-learning synthetic-dataset-generation web-agents
Last synced: 03 Feb 2026
https://github.com/jin-s13/awesome-gui-agent-hub
A curated hub for GUI agent papers, benchmarks, datasets, projects, and computer-use research.
awesome awesome-list computer-use computer-use-agent gui gui-agent gui-agents
Last synced: 26 Jul 2026
https://github.com/19pine-ai/preact
PreAct: Computer-Using Agents that Get Faster on Repeated Tasks (arXiv:2606.17929). Compile successful runs into verified state-machine programs and replay them 8.5–13× faster with no per-step LLM calls.
android-world computer-use gui-agents llm-agents osworld webarena
Last synced: 25 Jul 2026