https://github.com/mediar-ai/terminator
Playwright but for your desktop. Automate your Windows computer in JS or Python. 100x faster and cheaper than OpenAI Operator or Anthropic Computer Use. Not relying on vision
https://github.com/mediar-ai/terminator
agent agents ai llm ml native py rust ts vercel vercel-ai-sdk
Last synced: 1 day ago
JSON representation
Playwright but for your desktop. Automate your Windows computer in JS or Python. 100x faster and cheaper than OpenAI Operator or Anthropic Computer Use. Not relying on vision
- Host: GitHub
- URL: https://github.com/mediar-ai/terminator
- Owner: mediar-ai
- License: other
- Created: 2025-04-11T02:48:04.000Z (20 days ago)
- Default Branch: main
- Last Pushed: 2025-04-29T19:30:49.000Z (1 day ago)
- Last Synced: 2025-04-30T03:53:37.925Z (1 day ago)
- Topics: agent, agents, ai, llm, ml, native, py, rust, ts, vercel, vercel-ai-sdk
- Language: Rust
- Homepage: https://docs.screenpi.pe/terminator/introduction
- Size: 1.08 MB
- Stars: 78
- Watchers: 2
- Forks: 12
- Open Issues: 4
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# terminator 🤖
### videos
- [📹 Enterprise PDF to windows legacy app form](https://github.com/user-attachments/assets/024c06fa-19f2-4fc9-b52d-329768ee52d0)
- [📹 Technical overview video](https://youtu.be/ycS9G_jpl04)
- [📹 Technical overview PDF to windows legacy app form](https://www.youtube.com/watch?v=CMw3iexyCMI)
**terminator** is an ai-first cross-platform ui automation library for rust, designed to interact with native gui applications on windows and macos using a playwright-like api.
it provides a unified api to find and control ui elements like buttons, text fields, windows, and more. because it uses os-level accessibility apis, it is **100x faster and more reliable** for ai agents than vision-based approaches.
`terminator` can also parse and interact with background apps/windows, unlike vision based approach.
> **⚠️ Note 1 ⚠️:** while we support macos and windows, we are currently focusing development efforts on windows, so you will have to figure out yourself how to use the macos version.
> **⚠️ Note 2 ⚠️:** keep in mind it's very experimental, expect many bugs, report it and we'll fix in minutes.
## documentation
for detailed information on features, installation, usage, and the api, please visit the **[official documentation](https://docs.screenpi.pe/terminator/introduction)**.
## quick start
1. **clone the repo:**
```bash
git clone https://github.com/mediar-ai/terminator
cd terminator
```
2. **download & unzip the server (windows cli):**
```powershell
powershell -ExecutionPolicy Bypass -File .\setup_windows.ps1
```
3. **run the server:**
```powershell
./server_release/server.exe --debug
```
4. **run an example client (in another terminal):**
```bash
cd examples/hello-world
npm i
npm run dev
# open http://localhost:3000
```
*check the [getting started guide](https://docs.screenpi.pe/terminator/getting-started) in the docs for more details.*
*check the [Vercel's AI SDK tool call example](https://github.com/mediar-ai/terminator/tree/main/examples/pdf-to-form) to use AI with `terminator`.*
*check [how to Vibe Work using MCP](https://github.com/mediar-ai/terminator/tree/main/mcp).*
## key dependencies
* windows: [uiautomation-rs](https://github.com/leexgone/uiautomation-rs)
* macos: [macos accessibility api](https://developer.apple.com/documentation/appkit/nsaccessibility) (considering switch to [cidre](https://github.com/yury/cidre))
* debugging(windows): [accessibility insights for windows](https://accessibilityinsights.io/downloads/)
#### 🔍 alternative debugging tool: FlaUInspect
If you want a slicker tool than Accessibility Insights for inspecting UI Automation properties on windows, try [**FlaUInspect**](https://github.com/FlaUI/FlaUInspect).
**Installation**:
```powershell
choco install flauinspect
```
Or grab a release from: https://github.com/FlaUI/FlaUInspect/releases
**Usage**:
- Launch the app
```powershell
FlaUInspect.exe
```
- Hover or click on elements
- See properties like:
- `AutomationId`
- `Name`
- `ControlType`
Great for debugging selectors and making your automation more reliable.
## contributing
contributions are welcome! please feel free to submit issues and pull requests. many parts are experimental, and help is appreciated. join our [discord](https://discord.gg/dU9EBuw7Uq) to discuss.
## businesses
if you want desktop automation at scale for your business, [let's talk](https://screenpi.pe/enterprise)