Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/garywill/vimouse

Let's do some tries to dump traditional mouse (experimental). Inspired by Vim/Vimium
https://github.com/garywill/vimouse

keyboard keyboard-mouse mouse vi vim vimium

Last synced: about 1 month ago
JSON representation

Let's do some tries to dump traditional mouse (experimental). Inspired by Vim/Vimium

Awesome Lists containing this project

README 

        
Let's do some tries to dump traditional mouse. Inspired by Vim & Vimium.



# viMouse



Use keyboard to click anywhere of screen. OpenCV based screenshot **visual recognition**. 



> The **vi** in the name here can mean "Vim", "Vision-recognition" or whatever



![screenshot](demo.gif)



Dependencies:



- python3 and: opencv , qt5 , numpy , pynput



Theoretically works cross-platform. Tested on Linux X11 and Windows. Welcome feedback the result on your machine.



This is still very simple and **in alpha preview** stage currently. Anything could change.



## Usage



cd into folder and run `python3 main.py` to start.



1. Hit `ctrl + meta` to find clickable objects on screen and show keys 

   

   > meta key = win key = super key

   

   > During keys shown, any key events are blocked from being sent to any other apps 

   

   To cancel, press ESC or `,`(comma). To return to last step, press backspace



2. Press keys to move mouse to that position



3. It triggers click (if `autoClick=True`. Otherwise hit `meta + ctrl` to trigger click)



> Edit file `g.py` and configure for your need: screenshotDelay, whole screen, autoClick ...



Algorithm (filtering, recognizing,  parameters... ) can be improved. If you don't have a high contrast GUI, or some icons or buttons don't have clear contour, or two objects too close, it may fail to recognize.



We're expecting experts comming !



## Other vi / keybinding projects



Keyboard clicking:



- [hunt-and-peck](https://github.com/zsims/hunt-and-peck) Simple vimium/vimperator style navigation for Windows applications based on the UI Automation framework.



- [warpd](https://github.com/rvaiya/warpd) A modal keyboard driven interface for mouse manipulation.



- [vimac](https://github.com/dexterleng/vimac) keyboard-driven navigation and control of the macOS Graphical User Interface (GUI)



- [vimium-everywhere](https://github.com/phil294/vimium-everywhere) OS-wide Keyboard navigation for Linux and Windows



- [keynav](https://github.com/jordansissel/keynav) Control the mouse with the keyboard. only works on X11



- [Vimperator](https://github.com/vimperator/vimperator-labs) (discontinued) Make Firefox/Thunderbird look and behave like Vim



- [vimkey](https://github.com/Haojen/vimkey) Browser extension. Use the keyboard trigger click button or open a link



- [Vimium](https://github.com/philc/vimium) browser extension that provides keyboard-based navigation and control of the web in the spirit of the Vim editor.



- [Vimium C](https://github.com/gdh1995/vimium-c) A Customized Vimium having contextual mapping, global shortcuts, command sequences



- [vimb](https://github.com/fanglingsu/vimb) Vim-like web browser. The goal of Vimb is to build a completely keyboard-driven, efficient and pleasurable browsing-experience with low memory and CPU usage that is intuitive to use for Vim users.



- [Big Search](https://github.com/garywill/BigSearch) A multiple-search-engine browser extension that has keyboard clicking feature on its UI



Edit text using vi-like keybinding on non-vi app:



- [gtk-vikb](https://github.com/polachok/gtk-vikb) (discontinued) add vi keybindings to gtk (2/3) text areas

- [Firenvim](https://github.com/glacambre/firenvim) Turn browser  into a Neovim client

- [wasavi](https://github.com/akahuku/wasavi) Transforms browser  into a VI editor

- [emacs-anywhere](https://github.com/zachcurry/emacs-anywhere)

- [Emacs Everywhere](https://github.com/tecosaur/emacs-everywhere)

- [vime](https://github.com/algon-320/vime) Using Vim as an input method editor for X11 applications

- [vim_ahk](https://github.com/rcmdnk/vim_ahk) Based on AutoHotKey

- [tsf-vim](https://github.com/deton/tsf-vim) (discontinued) Windows IME to edit text like vim editor