Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/showlab/assistgui

Last synced: about 2 months ago
JSON representation

Host: GitHub
URL: https://github.com/showlab/assistgui
Owner: showlab
Created: 2023-12-22T15:39:54.000Z (about 1 year ago)
Default Branch: main
Last Pushed: 2024-04-16T16:04:38.000Z (9 months ago)
Last Synced: 2024-04-28T05:08:04.686Z (8 months ago)
Language: JavaScript
Size: 16.2 MB
Stars: 9
Watchers: 10
Forks: 1
Open Issues: 0
Metadata Files:
- Readme: README.md

Awesome Lists containing this project

README

# AssistGUI: Task-Oriented Desktop Graphical User Interface Automation
Difei Gao, Lei Ji, Zechen Bai, Mingyu Ouyang, Peiran Li, Dongxing Mao, Qinchen Wu, Weichen Zhang, Peiyi Wang, Xiangwu Guo, Hengxu Wang, Luowei Zhou, Mike Zheng Shou

[![Project Website](https://img.shields.io/badge/Project-Website-orange)](https://showlab.github.io/assistgui/)

## :rocket: Introduction

![overview](./assets/fig1.gif)

AssistGUI is an LLM-based GUI assistant designed to automate operations within desktop productivity software. It achieves this by monitoring the user's screen and executing commands to control the mouse and keyboard, thereby enhancing efficiency and streamlining tasks.

## :newspaper: News
The code will be released soon.