Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/farzadforuozanfar/speech-recognition
I recorded 10 voices with the same words from myself and compared them with another 10 words from another person. I was able to find a threshold level that acknowledges and recognizes my own voice.
https://github.com/farzadforuozanfar/speech-recognition
distance dtw dtw-algorithm jupyter-notebook python3 speech-processing speech-recognition speech-to-text
Last synced: 28 days ago
JSON representation
I recorded 10 voices with the same words from myself and compared them with another 10 words from another person. I was able to find a threshold level that acknowledges and recognizes my own voice.
- Host: GitHub
- URL: https://github.com/farzadforuozanfar/speech-recognition
- Owner: FarzadForuozanfar
- License: mit
- Created: 2022-04-25T09:21:00.000Z (over 2 years ago)
- Default Branch: main
- Last Pushed: 2022-04-26T18:48:09.000Z (over 2 years ago)
- Last Synced: 2024-05-11T05:49:27.159Z (8 months ago)
- Topics: distance, dtw, dtw-algorithm, jupyter-notebook, python3, speech-processing, speech-recognition, speech-to-text
- Language: Jupyter Notebook
- Homepage:
- Size: 7.48 MB
- Stars: 25
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
## **Project Description:**
In this project, I first converted my recorded sounds to text using `librosa`, `dtw`, and `speech_recognition` libraries, which can also be a way of recognizing speech, so-called text-dependency. A more reliable way is done using the **coefficient** of `Mel` or `Capstral`.
## DTW (Dynamic time warping) :
![1_BaDgYjm9WHd1Y6aelzPfZw](https://user-images.githubusercontent.com/91725214/165158918-8743e3ae-7257-4e1d-9ec4-dcfa948bb71f.png)
####
In time series analysis, dynamic time warping (DTW) is an algorithm for measuring similarity between two temporal sequences, which may vary in speed. For instance, similarities in walking could be detected using DTW, even if one person was walking faster than the other, or if there were accelerations and decelerations during the course of an observation. DTW has been applied to temporal sequences of video, audio, and graphics data — indeed, any data that can be turned into a linear sequence can be analyzed with DTW. A well-known application has been automatic speech recognition, to cope with different speaking speeds. Other applications include speaker recognition and online signature recognition. It can also be used in partial shape matching applications.
In general, DTW is a method that calculates an optimal match between two given sequences (e.g. time series) with certain restriction and rules:
- `Every index` from the first sequence must be matched with one or more indices from the other sequence, and vice versa
- `The first index` from the first sequence must be matched with the first index from the other sequence (but it does not have to be its only match)
- `The last index` from the first sequence must be matched with the last index from the other sequence (but it does not have to be its only match)- The mapping of the indices from the first sequence to indices from the other sequence must be monotonically increasing, and vice versa, i.e. if ***j>i*** are indices from the first sequence, then there must not be two indices ***l>k*** in the other sequence, such that index ***i*** is matched with index ***l*** and index ***j*** is matched with index ***k***, and vice versa
####
![1_xC66E1ENK6HO2Z_FRFv25A](https://user-images.githubusercontent.com/91725214/165158949-45813901-40c8-4139-a080-ff29ca93a3f1.png)
###### My voice signals using the `matplotlib.pyplot` chart drawing function:
![download](https://user-images.githubusercontent.com/91725214/165159557-a40b9724-f9e5-41e1-a668-c988a512eb9a.png)
## Another person voice signals using the `matplotlib.pyplot` chart drawing function:
![download (1)](https://user-images.githubusercontent.com/91725214/165159773-b6b5c240-21e5-4b1a-9953-66194afe06c0.png)
## Compare two(me & another person) audio signals using dtw.plot():
![download (2)](https://user-images.githubusercontent.com/91725214/165162671-291e6924-8712-456f-ab3f-b8b619fdaf67.png)
## Calculate distance between my voices to each other with dtw.distance() :
![table-chart](https://user-images.githubusercontent.com/91725214/165356940-9be67e0b-97e6-40c4-8186-58cae883e4d5.png)
## Calculate distance between my voices and another person voice to each other with dtw.distance() :
![table-chart (1)](https://user-images.githubusercontent.com/91725214/165357031-540430c9-2a83-4494-aeda-e694847d14c8.png)