Bring your karma
Join the waitlist today
HUMBLECAT.ORG

Blind and Visually Impaired Community

Full History - 2021 - 03 - 29 - ID#mfo2io
14
Feedback on an old experiment to "hear what your phone sees" (self.Blind)
submitted by bob-a-fett
As an experimental project a few years ago, I created a prototype app that converts what the iPhone depth-camera sees into 3d audio. I was able to demonstrate that we could navigate crowded areas using sound to hear what was visually around us.

Here is a demo video that demonstrates walking a NYC sidewalk. You'll want headphones to hear the audio effects. Youtube removes a lot of the "3d spatial audio" effects from the original app but you can still get an idea of what it was trying to do: $1

The visuals were just for debugging, it's demonstrating the depth the camera was detecting. And the frequency changes indicate movement of an object. Apologies for the audio in the original, it was a first test. I also had a version I was experimenting with that translated different colors to different frequencies in 3d audio space.

I never knew if this was a dumb idea, an idea that already exists out there, or if anyone would care or would be interested in such a thing. It's been a few years and I've always wondered if it had any value.
AnFaithne 4 points 2y ago
Is this kind of like visual sonar?
bob-a-fett [OP] 2 points 2y ago
Sure that's not a bad way to describe it!
chinakow 1 points 2y ago
Interesting but Either I am going deaf in my left ear or there was a bias to detection on the right channel. It is an interesting concept since the depth camera is more common than LIDAR at this point. I"m partially sighted so it would be nice to know when people are walking at me and I don't see them(Which is often)
This nonprofit website is run by volunteers.
Please contribute if you can. Thank you!
Our mission is to provide everyone with access to large-
scale community websites for the good of humanity.
Without ads, without tracking, without greed.
©2023 HumbleCat Inc   •   HumbleCat is a 501(c)3 nonprofit based in Michigan, USA.