https://github.com/shubhammore1251/sign-language-recognition-using-mediapipe-and-react

A Sign Language Learning Platform where who know sign language can come and practice Sign Language and also people who don't know can learn through this
https://github.com/shubhammore1251/sign-language-recognition-using-mediapipe-and-react

firebase firebase-auth firebase-realtime-database hand-gesture-recognition machine-learning mediapipe mediapipe-models reactjs sign-language-recognition-system

Last synced: about 2 months ago
JSON representation

A Sign Language Learning Platform where who know sign language can come and practice Sign Language and also people who don't know can learn through this

• Host: GitHub
• URL: https://github.com/shubhammore1251/sign-language-recognition-using-mediapipe-and-react
• Owner: shubhammore1251
• Created: 2023-05-05T07:12:04.000Z (over 1 year ago)
• Default Branch: main
• Last Pushed: 2024-08-19T16:58:17.000Z (4 months ago)
• Last Synced: 2024-08-19T19:38:03.495Z (4 months ago)
• Topics: firebase, firebase-auth, firebase-realtime-database, hand-gesture-recognition, machine-learning, mediapipe, mediapipe-models, reactjs, sign-language-recognition-system
• Language: JavaScript
• Homepage: https://sign-language-ai.web.app/
• Size: 13.9 MB
• Stars: 20
• Watchers: 1
• Forks: 6
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
# **Sign Language Recognition for Deaf and Dumb**

![Banner](./public/banner.png)

- Our sign language recognition project involved creating a custom dataset, preprocessing images, training a model, integrating with React, and hosting with Firebase. 

- The result is a real-time sign language recognition application that recognizes a variety of sign language gestures.

- Our Model is trained for 26 alphabets and 16 words of ASL and which are commonly used in general communication.

## Features

- Real-Time Recognition

- Easy-to-Use Interface

- Adaptive Learning

- High Accuracy

- Real Time User Progress Data

## Tech Stack

**Front-end:**

- React

- Redux

**Back-end:**

- Firebase (for hosting, authentication, and storage)

**Machine Learning Framework:**

- MediaPipe

**NPM Packages:**

- @mediapipe/drawing_utils

- @mediapipe/hands

- @mediapipe/tasks-vision

- @redux-devtools/extension

- chart.js

- firebase

- js-cookie

- react-chartjs-2

- react-icons

- react-redux

- react-router-dom

- react-toastify

- react-webcam

- redux

- redux-thunk

- uuid

## Team Members

- So this project is a group project done in collaboration with the members mentioned below.

| Name            | Email-id                      |

| :-------------- | :---------------------------- |

| Shubham More    | `[email protected]`      |

| Sameer Metkar   | `[email protected]`      |

| Omkar Mandavkar | `[email protected]` |

| Durgesh Kolhe   | `[email protected]`         |

## Project Details

- **Our Project Report:** [Report.pdf](https://drive.google.com/file/d/1A_gBXKfEjNwHZbtnanu82jgLrbtblQ38/view?usp=sharing)

- **Published Paper:** [Paper.pdf](https://drive.google.com/file/d/1KEP_kAessP08Zo8zHsG9IqlP4Yuj9SO0/view?usp=sharing)

- **Dataset Link:** [Sign_Dataset](https://drive.google.com/drive/folders/1LUUknqqRNHAmIZYrcgo-4n2HrM37uFa3?usp=share_link)

- **Gesture Recogition Documentation:** [Mediapipe](https://developers.google.com/mediapipe/solutions/vision/gesture_recognizer)

- **The Model Training File is located in root folder**

## Steps to set up the project

- **Check this document for project setup:** [SetUpDoc.docx](https://docs.google.com/document/d/1siwZjc0LJQgKTn__vtzs8tMfr9OElrsThmqmRJc9dHE/edit?usp=sharing)

## Authors

- [@shubham-more](https://github.com/shubhammore1251/)

- [@sameer-metkar](https://github.com/sameermetkar/)

- [@omkar-mandavkar](https://github.com/omkarmandavkar/)

- [@durgesh-kolhe](https://github.com/Durgesh240)

## Acknowledgements

- [React](https://react.dev/)

- [mediapipe](https://developers.google.com/mediapipe)

- [Firebase](https://firebase.google.com/)

- [NPM](https://www.npmjs.com/)

## Screenshots

![Hello Image](./public/screenshots/Hello.jpg)

![Meet Image](./public/screenshots/Meet.jpg)

![Deaf Image](./public/screenshots/Deaf.jpg)

![Bye Image](./public/screenshots/Bye.jpg)

![D Image](./public/screenshots/D.jpg)

![Dashboard Image](./public/screenshots/dasboard.jpeg)

## Support

For support, contact

- email: [email protected]

- LinkedIn: [Shubham More](https://www.linkedin.com/in/shubham-more1251/)