Need some advice on making a app for the visually impaired(self.Blind)
submitted by khan9813
So I’m making this open source app that uses machine learning to read text and identify objects using the camera. What are some must have features?
This app uses gesture control and voice feed back.
Also any tips would be appreciated.
K-R-Rose3 points2y ago
I’m not sure if this is what you mean by “read text” but if it could read food labels and price tags, that would be pretty neat
khan9813 [OP]2 points2y ago
That’s a great idea! I’ll see what I can do. When I say read text, it literally just read any text that the camera sees.
zersiax2 points2y ago
You can take some cues from projects like Seeing AI, Supersense AI and Envision AI. What you'll mainly want to tackle is that likely, the text will not be in proper alignment / full view. After all, a blind person wouldn't know exactly where the text / object is, or how to best get it fully into the camera's view. Also kudos for actually asking the blind what they need and not just assuming you probably know already :)
[deleted]2 points2y ago
[deleted]
siriuslylupin61 points2y ago
Why reinvent the wheel about 60 different apps can already do this stuff maybe that’s an exaggeration but there’s a good handful. I would say work on something else that’s not already well represented.
napoleon881 points2y ago
yeah I'm confused at what a new app in this space would be good for, what it would do that the others don't?
khan9813 [OP]1 points2y ago
Just something I want to make. Also it’s completely open source so it can be moded by anyone.
Blindgamerpl1 points2y ago
Open source is the best because everyone can help you with the app if knows the programming language which you will use to make it I wish you well. For which system it will be?
Marconius1 points2y ago
Whatever you do, please follow the Best Practices for inclusive design docs provided by Apple and Google. You mentioned that it uses gestures and voice feedback, do you mean you are programming in your own gestures for users to use and your own voice synthesis? Or that it will work seamlessly with the screen readers that are already on board our devices? Do not attempt to override screen reader gestures that are already in place and do not expect users to shut off their screen readers when using the app.
Also, research what's already out there. SeeingAI, KNFB Reader, DigitEyes, and a few others are already well-established in this space and are very widely used.
Our mission is to provide everyone with access to large- scale community websites for the good of humanity. Without ads, without tracking, without greed.