https://github.com/debanjum/vitrave
Use visual landmarks to simplify UI traversal in automation scripts
https://github.com/debanjum/vitrave
automation computer-vision opencv xdotool
Last synced: 3 months ago
JSON representation
Use visual landmarks to simplify UI traversal in automation scripts
- Host: GitHub
- URL: https://github.com/debanjum/vitrave
- Owner: debanjum
- License: bsd-2-clause
- Created: 2017-02-13T00:14:49.000Z (over 9 years ago)
- Default Branch: master
- Last Pushed: 2017-02-13T00:27:55.000Z (over 9 years ago)
- Last Synced: 2025-10-18T16:50:01.305Z (9 months ago)
- Topics: automation, computer-vision, opencv, xdotool
- Language: C++
- Size: 3.91 KB
- Stars: 0
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
Vitrave
=============
> Use visual landmarks to simplify UI traversal in automation scripts
This repo is based on [Erikb' gist](https://gist.github.com/eirikb/ac8196beb0b57577a8fc47eb18427bd4) and [Szanni's findimage](https://szanni.org/findimage/)
It integrates sensing of visual landmark to simplify creating automation scripts.
We use `findimage` to identify the visual landmarks on screen and `xdotool` for actually traversing the GUI.
DEPENDENCIES
---------------
1. Xdotool
3. Scrot
2. OpenCV
QUICK-START
---------------
```sh
git clone https://github.com/debanjum/vitrave.git # clone repository
cd findimage && make && sudo make install # compile and install findimage
cd ../demo && chmod +x demo.sh && ./demo.sh # run sample automation script
```
DEMO
---------------
##About
The demo is meant to show how to make an automated answer to a hn comment, translated from Norwegian to English with these steps:
1. Click on Chrome address bar.
2. Type translate.google.com and press enter.
3. Click on input field.
4. Type the text for translation and wait for it to translate.
5. Click "Copy"-button to copy text to clipboard.
6. Open new tab.
7. Type hn comment url and press enter.
8. Click on input field.
9. Paste translated text.
##Images
1.png
---
2.png
---
3.png
---
4.png
---
5.png
CONTRIBUTING
---------------
Fork, Edit and Submit [pull request](https://github.com/debanjum/vitrave/pulls)
BUGS
---------------
Please file bug reports at [issues](https://github.com/debanjum/vitrave/issues)