https://github.com/hrishibawane/hand-gesture-mouse-control

A Deep Learning based project for controlling mouse events like movement, click and drag
https://github.com/hrishibawane/hand-gesture-mouse-control

computer-vision convolutional-neural-networks deep-learning mouse-events

Last synced: over 1 year ago
JSON representation

A Deep Learning based project for controlling mouse events like movement, click and drag

• Host: GitHub
• URL: https://github.com/hrishibawane/hand-gesture-mouse-control
• Owner: hrishibawane
• Created: 2020-05-22T13:18:03.000Z (about 6 years ago)
• Default Branch: master
• Last Pushed: 2022-12-08T07:28:33.000Z (over 3 years ago)
• Last Synced: 2025-03-18T05:34:58.503Z (over 1 year ago)
• Topics: computer-vision, convolutional-neural-networks, deep-learning, mouse-events
• Language: Jupyter Notebook
• Size: 1.89 MB
• Stars: 6
• Watchers: 1
• Forks: 2
• Open Issues: 27
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

          
# Hand Gesture Mouse Control

A Deep Learning based attempt at developing a computer vision based software for controlling mouse events like clicks, drags and movement. 

## Requirements

To run this project locally on your system:

- Clone this repository in your system

- cd into the cloned directory and run ```pip install -r requirements.txt``` in your terminal

- Run main.py file using ```python3 main.py```

## Usage

- Gesture: Zero => Action: Drag

- Gesture: Two => Action: Left Click

- Gesture: One (or any other) => Move Pointer

![Drag](images/ss_0.png?raw=true)

![Left Click](images/ss_2.png)

![Move](images/ss_1.png)

**Note:** The hand detection works on skin detection. Thus, any background noise should be avoided.

## Tech Stack

Some important packages or modules used in the project:

- Keras

- OpenCV

- PyAutoGui

- Pillow

## Dataset

Can be downloaded from [here](https://www.kaggle.com/muhammadkhalid/sign-language-for-numbers)

## Scope of Improvement

There is a lot of scope for improvement like:

- Smooth movement

- More accurate detection of gestures

- Add more functionalities of mouse events

- Hand detection in various lighting environments

Any suggestions, ideas or contributions are welcomed.