Facebook Will Use Artificial Intelligence to Help the Blind ‘See’ Visual Content

Facebook is working to help the blind use (and experience) Facebook the way others do.

4. 6. 16 by June Javelosa
Reuters
Image by Reuters

Two Billion

On any given day, Facebook, Instagram, Messenger and WhatsApp users send and share more than two billion photos. But for those who are blind or visually impaired, this is an experience that they are largely left out of.

This has prompted the Facebook team to try and create technology that will enable this community to experience, and enjoy, Facebook the way that others do.

Automatic Alternative Text

Automatic alternative text is an advanced neural network that basically generates a description of an image. It uses Facebook’s sophisticated object recognition that runs down items on the photo—which means anyone using screen readers can hear a basic description of the photo, painting a visual image of each.

Prior to this technology, users of screen readers could only hear the name of the person who shared the image and identify it as a photo when they come across it on their feeds.

Advertisement

“Now we can offer a richer description of what’s in a photo, thanks to automatic alt text. For instance, someone could now hear, ‘Image may contain three people, smiling, outdoors,’” Facebook asserts. True, this isn’t exactly ideal, but it is a step forward, and could lead to even better technologies in the coming years.

The technology will first be available on iOS screen readers set to English, but Facebook has plans of rolling it out on more platforms and more languages.


As a Futurism reader, we invite you join the Singularity Global Community, our parent company’s forum to discuss futuristic science & technology with like-minded people from all over the world. It’s free to join, sign up now!

Share This Article

Keep up.
Subscribe to our daily newsletter to keep in touch with the subjects shaping our future.
I understand and agree that registration on or use of this site constitutes agreement to its User Agreement and Privacy Policy

Advertisement

Copyright ©, Singularity Education Group All Rights Reserved. See our User Agreement, Privacy Policy and Cookie Statement. The material on this site may not be reproduced, distributed, transmitted, cached or otherwise used, except with prior written permission of Futurism. Fonts by Typekit and Monotype.