Doesn't Youtube's caption system have an API? Then again, the captions may be exactly the opposite of what you want to convey since that stuff is already spoken.
Also, it's not exactly the same thing, but you may be interested in a research project/website called
$1 which seeks to add audio descriptions to Youtube vids. Would be another way to convey the same info.