I've had situations on both sides of the fence.

When I was training to become an O&M instructor, I did my placement at a school for the blind. There is an inner courtyard surrounded by the school building, where many of the kids would hang out during the lunch break. While I was walking down the hall, I could see two teens who were making out on a bench in the courtyard. When I ran into the guy later, I spoke to him a bit and happened to mention I saw him making out with someone. His response was "You could see through windows?!?!". I was kind of surprised that he was in his teens and didn't realize that (He also had a cognitive delay, so perhaps that may have been a contributing factor).

One of my clients a few years ago lost some peripheral vision due to a brain injury, and had a few other issues as well (balance being one, and some visual confusion with her remaining vision). When walking down the sidewalk, she had trouble judging where to walk (she would waver left and right significantly). I suggested she look at a landmark down the sidewalk, and walk towards that, so she could walk in a straight line. She says "like that red sign?". I look down the sidewalk, but couldn't see the sign she was talking about. It wasn't until we walked halfway down the block that I could finally see the sign. I was like "How the heck did you see that far?"

When I was in boarding school for the blind, there was a lot of pressure put on me to lead and guide my peers because I had the most vision, though my vision is still pretty bad. I had even been yelled at for not doing it right because the teachers just assumed I could see better than I could. As a result, I sometimes catch myself trying to guide my Mom and brothers around who are perfectly sighted

When my (legally blind) sister was about 6 my cousins and I were arguing over what colors the flowers in the garden were and she just could not believe that one can't just look at a color and have a set idea. Like what I think of as "magenta" is not universally seen as magenta, even though we're thinking of the same color. So what I would call sky blue someone else might call baby blue. She still forgets this, because she'll go into a craft store and ask the associate to help her find Magenta paint, and comes out with a mauve. That's how she ended up painting me an almost entirely mauve and blue garden scene.

On the other side, we were walking past a lightbulb display and she just started listing off the types of lightbulbs as we passed. Apparently she can tell the difference because of her photophobia and over time learned her preference of lightbulbs. We call it "the world's lamest party trick." She asked me to pick up a specific type of bulb for her appartment, but they didn't have it. I found one completely identical though. I couldn't tell you the difference with a gun to my head. I installed it for her while she was at work. Later, not 10 minutes after she got home, she called me and told me I had the wrong bulb and that I need to return it. I still cannot fathom how she can tell the difference.