Business Standard

This blind Facebook employee is developing tech for sightless

IANS  |  San Francisco 

A blind employee is developing a that will use (AI) to verbalise the content of an image or video and enable the visually impaired to "see" and determine appropriate content for and advertisers.

Matt is leading a project that is making solutions for visually impaired on the platform that could eventually be used to identify images and videos that violate Facebook's terms of use or that advertisers want to avoid.

"More than two billion photos are shared across every single day. That's a situation where a machine-based solution adds a lot more value than a human-based solution ever could," CNBC quoted as saying late on Saturday.

King, who was born with a degenerative eye disease called retinitis pigmentosa, lost his vision by the time he got his degree and started working at with the tech giant's accessibility projects.

He worked on a screen reader to help visually impaired "see" what is on their screens either through audio cues or a eventually developed the first screen reader for a graphical interface.

He worked with the accessibility team till Facebook hired him from in 2015.

At Facebook, he works on features to help people with disabilities use the platform, like adding captions to videos or coming up with ways to navigate the site using only audio cues.

"Anybody who has any kind of disability can benefit from Facebook. They can develop beneficial connections and understand their disability doesn't have to define them, to limit them," said.

One of his main projects is "automated alt-text," which describes audibly what is in Facebook images.

When automated alt-text was launched in April 2016, it was only available in five languages on the iOS app. Today it is available in over 29 languages on Facebook on the web, iOS and

"The things people post most frequently kind of has a limited vocabulary associated with it," the Facebook said.

"It makes it possible for us to have one of those situations where if you can tackle 20 per cent of the solution, it tackles 80 per cent of the problem. It's getting that last 20 per cent which is a lot of work, but we're getting there," he said.

In December 2017, Facebook pushed an automatic alt-text update that used to help visually impaired people find out who is in photos.

--IANS

sku/nks/bg

(This story has not been edited by Business Standard staff and is auto-generated from a syndicated feed.)

First Published: Sun, January 21 2018. 17:42 IST
RECOMMENDED FOR YOU
RECOMMENDED FOR YOU