https://github.com/soumyagautam/sign-sense

Deep Learning and Neural Network based Sign Sense or 'Sign Language' to Speech converter is an desktop app which can detect hand signs in a frame and can convert them to Speech, according to their respective meaning. Opposite to this, it can also recognise your voice and can convert it to sign language.
https://github.com/soumyagautam/sign-sense

ai cv2 dataprocessing deep-learning keras machine-learning mediapipe moviepy-library neural-network openai-whisper scikit-learn tensorflow tkinter-python

Last synced: 5 days ago
JSON representation

Deep Learning and Neural Network based Sign Sense or 'Sign Language' to Speech converter is an desktop app which can detect hand signs in a frame and can convert them to Speech, according to their respective meaning. Opposite to this, it can also recognise your voice and can convert it to sign language.

• Host: GitHub
• URL: https://github.com/soumyagautam/sign-sense
• Owner: soumyagautam
• Created: 2023-11-06T15:43:50.000Z (about 1 year ago)
• Default Branch: main
• Last Pushed: 2024-06-08T08:37:52.000Z (7 months ago)
• Last Synced: 2024-06-08T09:32:00.264Z (7 months ago)
• Topics: ai, cv2, dataprocessing, deep-learning, keras, machine-learning, mediapipe, moviepy-library, neural-network, openai-whisper, scikit-learn, tensorflow, tkinter-python
• Language: Python
• Homepage:
• Size: 8.81 MB
• Stars: 1
• Watchers: 2
• Forks: 1
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
# Sign-Sense

Deep Learning and Neural Network based Sign Sense is a desktop app made for deaf/ dumb people. This will allow them to talk to anybody rather than just those who can understand their language. There is also a Web version for the same so that app can reach to more people.

Features:

  1. **Sign2Speech** can detect hand signs in a frame and can convert them to Speech, according to their respective meaning using mediapipe, keras, cv2, numpy, etc.

  2. Opposite to this, **Speech2Sign** can also recognise your voice and can convert it to sign language using speech recognition and OpenAI's Whisper API. It will show an AI-generated video for the signs detected.