Blind and Visually Impaired Community
↑
2
↓
Pretend I take a picture, and I know how far away each part of the image is. Can I turn it into a sound where you can realize the scene? (self.Blind)
submitted by Challenger4664A
KillerLag 2 points 2y ago
A few questions regarding a system like that. Let's say you use pitch to indicate distance. At a certain point, there would be too many pitches to discern. Different people can discern different number of pitches, but I would guess that most people can't discern over a dozen pitches simultaneously. You can do it sequentially, but would need a system to discern what an "item" would be.
Also, if an item is large enough the sensor can discern multiple parts that are different distances (a large sphere, or a wall that is angled away), how would the sound indicate that? The pitch going up/down could be used, but it may be hard to indicate it is an object versus multiple objects that are getting closer.
The third would be partially technical. If you take a picture of an object through glass (a purse in a store windowfront), would the system be detecting the distance of the glass, or the object? What about something like a mirror/reflection?
Also, if an item is large enough the sensor can discern multiple parts that are different distances (a large sphere, or a wall that is angled away), how would the sound indicate that? The pitch going up/down could be used, but it may be hard to indicate it is an object versus multiple objects that are getting closer.
The third would be partially technical. If you take a picture of an object through glass (a purse in a store windowfront), would the system be detecting the distance of the glass, or the object? What about something like a mirror/reflection?
retrolental_morose 1 points 2y ago
This has already been modelled of course.
See https://www.seeingwithsound.com
See https://www.seeingwithsound.com
siriuslylupin6 1 points 2y ago
It’s sometimes a concept but not very much used there’s an picture app which uses this. It’s a photo one but I also don’t know how pragmatic or actually useful it is. Definitely interesting idea. If you can make it work then by all means good luck!!!
spacelibby 1 points 2y ago
I actually did a project like this for a computer vision class. I ran into a few problems with it. The first problem is resolution. Like what /u/KillerLag said, If you have too many different pitches, then it's impossible to distinguish, and ends up sounding like noise.
There's also another problem I didn't expect (although I really should have). Images are fundamentally 2 dimensional, but sounds are 1 dimensional. So even if you have a system of mapping positions to frequencies, you're still losing a dimension.
There's also another problem I didn't expect (although I really should have). Images are fundamentally 2 dimensional, but sounds are 1 dimensional. So even if you have a system of mapping positions to frequencies, you're still losing a dimension.
impablomations 1 points 2y ago
> There's also another problem I didn't expect (although I really should have). Images are fundamentally 2 dimensional, but sounds are 1 dimensional. So even if you have a system of mapping positions to frequencies, you're still losing a dimension.
It is possible to convey 3d information in a 2d image. They are frequently used in computer games and movie VFX work.
Usually called depth maps. It's a greyscale image where points closest to the 'camera' are white and those furthest away are black, with varying shades in between.
There's another type called a Normal Map, which does something similar but uses Red, Green, Blue and used to store depth info for finer detail on 3d model textures.
But, like you say there would be far to much info convey by sound to make it anywhere near useful.
It is possible to convey 3d information in a 2d image. They are frequently used in computer games and movie VFX work.
Usually called depth maps. It's a greyscale image where points closest to the 'camera' are white and those furthest away are black, with varying shades in between.
There's another type called a Normal Map, which does something similar but uses Red, Green, Blue and used to store depth info for finer detail on 3d model textures.
But, like you say there would be far to much info convey by sound to make it anywhere near useful.
spacelibby 1 points 2y ago
That's a good point. Technically sound is 2 dimensional (frequency + amplitude). So a depth map is actually going to be 3 dimensional (2 spacial 1 color), and a normal map (or even a colored picture) is 5 dimensional.
It's still the same problem though. Dimensional reduction is generally confusing and hard to navigate.
It's still the same problem though. Dimensional reduction is generally confusing and hard to navigate.
This nonprofit website is run by volunteers.
Please contribute if you can. Thank you!
Our mission is to provide everyone with access to large-
scale community websites for the good of humanity.
Without ads, without tracking, without greed.
scale community websites for the good of humanity.
Without ads, without tracking, without greed.
©2023 HumbleCat Inc • HumbleCat is a 501(c)3 nonprofit based in Michigan, USA.