Blind and Visually Impaired Community
↑
2
↓
How could computer vision tools help you? (self.Blind)
submitted 8y ago by BobTheTurtle91
Hello everyone!
I’m a researcher at the University of Washington and my work focuses on projects at the intersection of natural language processing and computer vision. My current project looks to take advantage of recent advances in these two fields to build tools that can aid in the day-to-day lives of the blind and visually impaired.
In that regard, I’d like to ask your help in brainstorming some of the functionality and capabilities that you would like to see from such a tool. I don’t want to structure your feedback, so feel free to answer in any form.
Here are some questions that I have that maybe can help your responses:
1) Would you be interested in a tool that can use computer vision algorithms to map the space and objects around you and then relay that information back to you using natural language?
2) Do you use mobile applications such as VizWiz or oMoby for everyday tasks? There’s probably more, but these are two I’ve found information about. What are the strengths of these mobile applications? What functionality do they lack that you would appreciate? How could their offerings be better?
3) How would you prefer to interact with such a tool? Would you prefer to snap pictures and ask the tool questions about them? This is the VizWhiz model. Would you like it to ubiquitously record video and describe your surroundings to you? Would you like it to to take snapshots at consistent intervals and describe how your surroundings have changed from before?
4) How much do you use or would want to use these types of applications? Are you interested in a tool that you can use whenever you need it such as pulling out a phone at the grocery store to check the price of an item? Or would you be more interested in technology that becomes a far more integrated in your life such as the ubiquitous video example above.
5) What are some tasks that you perform that you think would be easier with a tool that could describe your surroundings to you? In what way would you foresee yourself interacting with the tool to simplify the task?
I hope these questions help clarify the type of information I’m looking to gather. Once again, though, feel free to describe anything that comes to mind. I’m interested in any and every way that you feel computer vision and computer-generated language tools could enhance your everyday life. I’m very excited about your responses!
Here are some articles on the existing applications I described above:
1. VizWiz. http://www.vizwiz.org/
2. oMoby. http://assistivetechnology.about.com/od/GoogleAndroidAccessibility/a/Omoby-Sends-Product-Information-To-Mobile-Devices-Based-On-Photos-And-Bar-Codes.htm.
I’m a researcher at the University of Washington and my work focuses on projects at the intersection of natural language processing and computer vision. My current project looks to take advantage of recent advances in these two fields to build tools that can aid in the day-to-day lives of the blind and visually impaired.
In that regard, I’d like to ask your help in brainstorming some of the functionality and capabilities that you would like to see from such a tool. I don’t want to structure your feedback, so feel free to answer in any form.
Here are some questions that I have that maybe can help your responses:
1) Would you be interested in a tool that can use computer vision algorithms to map the space and objects around you and then relay that information back to you using natural language?
2) Do you use mobile applications such as VizWiz or oMoby for everyday tasks? There’s probably more, but these are two I’ve found information about. What are the strengths of these mobile applications? What functionality do they lack that you would appreciate? How could their offerings be better?
3) How would you prefer to interact with such a tool? Would you prefer to snap pictures and ask the tool questions about them? This is the VizWhiz model. Would you like it to ubiquitously record video and describe your surroundings to you? Would you like it to to take snapshots at consistent intervals and describe how your surroundings have changed from before?
4) How much do you use or would want to use these types of applications? Are you interested in a tool that you can use whenever you need it such as pulling out a phone at the grocery store to check the price of an item? Or would you be more interested in technology that becomes a far more integrated in your life such as the ubiquitous video example above.
5) What are some tasks that you perform that you think would be easier with a tool that could describe your surroundings to you? In what way would you foresee yourself interacting with the tool to simplify the task?
I hope these questions help clarify the type of information I’m looking to gather. Once again, though, feel free to describe anything that comes to mind. I’m interested in any and every way that you feel computer vision and computer-generated language tools could enhance your everyday life. I’m very excited about your responses!
Here are some articles on the existing applications I described above:
1. VizWiz. http://www.vizwiz.org/
2. oMoby. http://assistivetechnology.about.com/od/GoogleAndroidAccessibility/a/Omoby-Sends-Product-Information-To-Mobile-Devices-Based-On-Photos-And-Bar-Codes.htm.
Unuhi 2 points
Hi,
I don't currently use any tools like that.
I use blindsquare, bemyeyes etc and am considering knfbreader.
And a bunch of others for reading, voices, and braille.
Those work pretty well.
Blindsquare is brilliant (as is apple maps); find a way to get where you are going. (Then blame the app when the map makes you walk back and be late)
Bemyeyes is nice: you can talk with a person. So whether you are cleaning your fridge (what's that item amd when did it expire?) or just chat while walking your usual route and enjoying someone giving you an audiodescription or seeing what it looks like "over here". Or helping you with shopping.
I like the aspect of human connection. Talking to a real person is nice.
Otherwise, a basic screenreader with the option to select the languages.
But I admit, quite a few things would be nice to figure better in life - like how to organize the home.
I don't currently use any tools like that.
I use blindsquare, bemyeyes etc and am considering knfbreader.
And a bunch of others for reading, voices, and braille.
Those work pretty well.
Blindsquare is brilliant (as is apple maps); find a way to get where you are going. (Then blame the app when the map makes you walk back and be late)
Bemyeyes is nice: you can talk with a person. So whether you are cleaning your fridge (what's that item amd when did it expire?) or just chat while walking your usual route and enjoying someone giving you an audiodescription or seeing what it looks like "over here". Or helping you with shopping.
I like the aspect of human connection. Talking to a real person is nice.
Otherwise, a basic screenreader with the option to select the languages.
But I admit, quite a few things would be nice to figure better in life - like how to organize the home.
BobTheTurtle91 [OP] 1 points
Thanks for you response! I greatly appreciate the insights. I hadn't considered some of the points you raised.
Do you mind elaborating on some of the "few things" you mentioned near the end?
Do you mind elaborating on some of the "few things" you mentioned near the end?
Unuhi 2 points
How to organize the home.
Should be pretty easy, the same as for anyone.
How to organize anything and keep anything in a place you can locate quick is not always as simple as said.
I rely too much on my memory for what's where, as too much is still in storage after the last move.
I want to get a nice order for my home. Not toomuch stuff, and everything to have its place so nothing gets lost.
Should be pretty easy, the same as for anyone.
How to organize anything and keep anything in a place you can locate quick is not always as simple as said.
I rely too much on my memory for what's where, as too much is still in storage after the last move.
I want to get a nice order for my home. Not toomuch stuff, and everything to have its place so nothing gets lost.
BobTheTurtle91 [OP] 1 points
Thank you so much for your responses! Do you mind if I pm you in the future if I have more questions?
Unuhi 1 points
Nope, so ask if you want. :)
This nonprofit website is run by volunteers.
Please contribute if you can. Thank you!
Our mission is to provide everyone with access to large-
scale community websites for the good of humanity.
Without ads, without tracking, without greed.
scale community websites for the good of humanity.
Without ads, without tracking, without greed.
©2023 HumbleCat Inc • HumbleCat is a 501(c)3 nonprofit based in Michigan, USA.