https://github.com/senthilsk10/vision-assist
web app for visually challenged people
https://github.com/senthilsk10/vision-assist
classification computer-vision hackathon-project helper-tool mediapipe object-detection tensorflowjs voice-control webapplication
Last synced: about 2 months ago
JSON representation
web app for visually challenged people
- Host: GitHub
- URL: https://github.com/senthilsk10/vision-assist
- Owner: Senthilsk10
- Created: 2024-04-26T15:35:29.000Z (about 1 year ago)
- Default Branch: main
- Last Pushed: 2024-04-28T04:54:26.000Z (about 1 year ago)
- Last Synced: 2024-04-28T07:14:36.089Z (about 1 year ago)
- Topics: classification, computer-vision, hackathon-project, helper-tool, mediapipe, object-detection, tensorflowjs, voice-control, webapplication
- Language: JavaScript
- Homepage: https://senthilsk10.github.io/Vision-Assist/src/index.html
- Size: 29.3 KB
- Stars: 0
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# Vision Assist - web app for visually challenged people
### continue to app (* Please refer the [user guide](https://docs.google.com/document/d/19ZjSXKzkM2zxilgtFTOCV8nwzfbrik4Z9lWW0cycq40/edit?usp=sharing) for best use * ) - [Click Here](https://senthilsk10.github.io/Vision-Assist/src/index.html)
# Domain : Computer Vision
### Project made for Hack2techsustain Hackathon 2024 based on computer vision to assist visually challenged people to get a overview of their home sorounding using web app
## Abstract :
VisionAssist project aims to addresses the following two major needs for visually impaired individuals:
1. **Frequent Object Search:** Users can input data about their frequently used objects into VisionAssist. The system utilizes this information to assist users in locating these objects within their homes. By leveraging object detection and localization technologies, VisionAssist provides real-time guidance to help users navigate to their desired items.
2. **Surroundings Understanding:** Through voice commands, users can request VisionAssist to identify specific objects in their surroundings. The system's object detection module scans the environment for relevant objects and provides real-time positional information about their locations. This feature enables users to gain a better understanding of their surroundings and interact with them more confidently.
## Development Tools Utilized:
- HTML/CSS/JavaScript: Frontend development for user interaction
- Git: Version control for collaborative development
## SDKs and APIs:
- Web Speech API: For speech recognition and synthesis
- TensorFlow.js: Machine learning library for AI model execution in the browser
## Libraries:
- Mediapipe: Framework for building cross-platform AI pipelines
- Teachable Machine: Tool for creating custom machine
-
## Assets :
- Trained Classification model weights hosted on google cloud - [Get it here](https://teachablemachine.withgoogle.com/models/c6Gv0UQsF/)
- Weights for object detection using Tflite format weights stored on cloud - [Get it here](https://storage.googleapis.com/mediapipe-models/object_detector/efficientdet_lite0/float16/1/efficientdet_lite0.tflite)
## Run Locally
Clone the project
```bash
git clone https://github.com/Senthilsk10/Vision-Assist.git
```
Go to the project directory
```bash
cd src
```
Start the server
(*Requires Python > 3.0*)
```bash
python -m http.server
```
You can visit the website in http://127.0.0.1:8000/
### For more User Guide refer the following [link](https://docs.google.com/document/d/19ZjSXKzkM2zxilgtFTOCV8nwzfbrik4Z9lWW0cycq40/edit?usp=sharing)
## Collabrated work of:
1. Senthil Kumaran S - [profile](https://github.com/Senthilsk10/)
2. Sharun Ashwanth K V - [profile](https://github.com/sharunashwanth/)