https://github.com/suitedaces/computer-agent
Desktop app to control your computer with AI, written in Rust
https://github.com/suitedaces/computer-agent
ai ai-tools anthropic claude-3-5-sonnet claude-4-5-sonnet computer-use gui react reactjs rust typescript
Last synced: 2 months ago
JSON representation
Desktop app to control your computer with AI, written in Rust
- Host: GitHub
- URL: https://github.com/suitedaces/computer-agent
- Owner: suitedaces
- License: other
- Created: 2024-10-25T18:54:19.000Z (over 1 year ago)
- Default Branch: main
- Last Pushed: 2025-12-30T03:33:49.000Z (4 months ago)
- Last Synced: 2025-12-30T03:59:26.315Z (4 months ago)
- Topics: ai, ai-tools, anthropic, claude-3-5-sonnet, claude-4-5-sonnet, computer-use, gui, react, reactjs, rust, typescript
- Language: Rust
- Homepage:
- Size: 949 KB
- Stars: 518
- Watchers: 10
- Forks: 62
- Open Issues: 9
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
- StarryDivineSky - suitedaces/computer-agent
- acu - Grunty
README
# Taskhomie (Computer Use AI Agent)
Local AI agent that controls your computer. Give it natural language instructions and watch it take screenshots, move your mouse, click, type, and run terminal commands.
Built with Tauri, React, and Rust.
## Demo
https://github.com/user-attachments/assets/8edd92a7-7d3e-472a-9e48-3b561f0257d6
Here, I used it to autonomously read and reply to tweets, lol. This is purely for demonstration/research, you should not attempt to do the same, lol.
## Modes
**Computer Use Mode** - Takes over your screen. Sees what you see via screenshots and controls your cursor and keyboard directly. Use when the task spans multiple apps or needs full desktop access. You step away while it works.
**Background Mode** - Runs async while you do other things. Uses Chrome DevTools Protocol for web automation and terminal for everything else. Doesn't touch your mouse or keyboard. Faster and more reliable for web + terminal tasks.
## Setup
**Requirements:**
- Rust & Cargo
- Node.js & npm
- Anthropic API key
```bash
# install deps
npm install
# add your api key
echo "ANTHROPIC_API_KEY=your-key-here" > .env
# run dev
npm run tauri dev
# or build for production
npm run tauri build
```
On macOS, you'll need to grant accessibility permissions when prompted (System Settings → Privacy & Security → Accessibility).
## Shortcuts
- `⌃⇧C` - push-to-talk → computer use mode
- `⌃⇧B` - push-to-talk → background mode
- `⌘⇧H` - help mode (screenshot + quick prompt)
- `⌘⇧S` - stop agent
## Stack
- **Frontend**: React, TypeScript, Tailwind, Zustand, Framer Motion
- **Backend**: Rust, Tauri 2, Tokio
- **Models**: Haiku, Sonnet, Opus (selectable in UI)
## Contributing
PRs welcome. Hit me up on Twitter @ishanxnagpal.
## License
[Apache License 2.0](LICENSE)