https://github.com/jonas-scholz123/hearing-images
Allowing visually impaired users to hear images live as they are recorded by transforming greyscale image data into sounds by mapping brightness → amplitude, pixels(x, y) → frequency (using pseudo-Hilbert-curves and Fourier transformations for 2D → 1D mapping)
https://github.com/jonas-scholz123/hearing-images
audio disability-assistance fourier-transform gui hilbert-curve video
Last synced: 4 months ago
JSON representation
Allowing visually impaired users to hear images live as they are recorded by transforming greyscale image data into sounds by mapping brightness → amplitude, pixels(x, y) → frequency (using pseudo-Hilbert-curves and Fourier transformations for 2D → 1D mapping)
- Host: GitHub
- URL: https://github.com/jonas-scholz123/hearing-images
- Owner: jonas-scholz123
- Created: 2020-02-09T20:02:24.000Z (over 5 years ago)
- Default Branch: master
- Last Pushed: 2020-11-28T12:02:38.000Z (over 4 years ago)
- Last Synced: 2025-01-12T23:46:14.328Z (5 months ago)
- Topics: audio, disability-assistance, fourier-transform, gui, hilbert-curve, video
- Language: Python
- Homepage:
- Size: 48.8 KB
- Stars: 1
- Watchers: 3
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# hearing-images
This application allows for images/videos to be converted into sound by weaving a 2-D pseudo Hilbert curve through the 2-D image to create a 1-D representation. Every pixel's position is then mapped to a sound frequency, and every pixel's brightness is mapped to an amplitude.
By inversely Fourier transforming, this spectrum of frequencies/amplitudes is turned into a time-basis audio signal which can be played through headphones.
This could potentially allow visually impaired people to substitute vision through audio signals.
This is based on the video: https://www.youtube.com/watch?v=3s7h2MHQtxc&t=461s&ab_channel=3Blue1Brown
Special requirements:
```
pip install hilbertcurve
```
To run:
```
python3 gui.py
```