Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/sergeichestakov/nosegoes
Browse the web with just your face and voice!
https://github.com/sergeichestakov/nosegoes
Last synced: about 1 month ago
JSON representation
Browse the web with just your face and voice!
- Host: GitHub
- URL: https://github.com/sergeichestakov/nosegoes
- Owner: sergeichestakov
- License: mit
- Created: 2018-02-03T22:59:59.000Z (almost 7 years ago)
- Default Branch: master
- Last Pushed: 2022-12-08T00:54:57.000Z (almost 2 years ago)
- Last Synced: 2023-03-23T22:40:07.721Z (over 1 year ago)
- Language: Python
- Homepage: https://devpost.com/software/nosegoes-45g87z
- Size: 4.38 MB
- Stars: 2
- Watchers: 2
- Forks: 0
- Open Issues: 7
-
Metadata Files:
- Readme: README.md
- License: LICENSE.md
Awesome Lists containing this project
README
# NoseGoes
## Overview
NoseGoes is an application that allows a user to control their web browser using facial gestures and voice commands. The goal is to make it easier for disabled and paraplegic people to use the internet.
Created by Sergei Chestakov and Kaelan Mikowicz
#### Accepted facial gestures:
* Scroll (look up and down)
* Switch tabs (look left and right)
Gestures are implemented by comparing the position of the blue dot at the center of the user's face relative to the readjusting box in the middle, and require a change in tilt/pan of > 10 degrees.
#### Accepted voice commands:
* Open new tabs - "Open tab"
* Navigate to a web page - "Go to *website*" (appends .com)
* Make a Google search - "Search *query*"
* Navigate to previous page in history - "Go back"
* Navigate to next page in history - "Go Forward"
## Installation
Make sure you are using Python 3.6 or higher
#### Step 1: Clone the repo
```bash
git clone https://github.com/sergeichestakov/NoseGoes.git
cd NoseGoes
```
#### Step 2: Set up Virtual Environment
```bash
pip3 install virtualenv
virtualenv venv
. venv/bin/activate (MacOS/Linux)
venv\Scripts\activate (Windows)
# Use 'deactivate' to exit virtual environment
```
#### Step 3: Install dependencies
```bash
pip3 install -r requirements.txt
```
#### Step 4: Move assets/geckodriver executable to path
This is the file that Selenium needs to launch Firefox so make sure you have Firefox installed and move geckodriver to a directory in your system path.
To print path you can type:
```bash
echo $PATH
```
## Running
To launch the application simply enter:
```bash
python3 run.py
```
## To Do
We built the first version of NoseGoes at a 24 hour hackathon, but plan to continue development.
Next Steps include the following in no particular order:
* Refactor code for readability and speed
* Add features including the ability to click on links and interact with the webpage
* Improve facial gesture implementation and ease of use
* Replace Google Cloud with other modules for using microphone and detecting changes in orientation of the face
* Create an executable for easy download and distribution
Contributions are welcome! Enjoy :blush: