New AI system can tell stories based on photos

Image
Press Trust of India New York
Last Updated : Jun 05 2016 | 5:32 PM IST
Scientists at Microsoft Research are developing a new artificial intelligence (AI) system that, like humans, can tell stories based on images.
Future computers may be able to explain what is happening in videos just as people can, researchers said.
The system is capable of automatically describing a series of images in much the same way a person would by telling a story.
The aim is not just to explain what items are in the picture, but also what appears to be happening and how it might potentially make a person feel, researchers said.
"The goal is to help give AIs more human-like intelligence, to help it understand things on a more abstract level - what it means to be fun or creepy or weird or interesting," said Margaret Mitchell, a computer scientist at Microsoft Research.
To build a visual storytelling system, researchers used deep neural networks, computer systems that learn by example - for instance, learning how to identify cats in photos by analysing thousands of examples of cat images, 'Live Science' reported.
The system is similar to those used for automated language translation, but instead of teaching the system to translate from one language to another, the scientists trained it to translate images into sentences.
Researchers fed their system more than 8,100 new images to examine what stories it generated.
The computer generated thousands of stories that would take people a lot of time and effort to examine.
*Subscribe to Business Standard digital and get complimentary access to The New York Times

Smart Quarterly

₹900

3 Months

₹300/Month

SAVE 25%

Smart Essential

₹2,700

1 Year

₹225/Month

SAVE 46%
*Complimentary New York Times access for the 2nd year will be given after 12 months

Super Saver

₹3,900

2 Years

₹162/Month

Subscribe

Renews automatically, cancel anytime

Here’s what’s included in our digital subscription plans

Exclusive premium stories online

  • Over 30 premium stories daily, handpicked by our editors

Complimentary Access to The New York Times

  • News, Games, Cooking, Audio, Wirecutter & The Athletic

Business Standard Epaper

  • Digital replica of our daily newspaper — with options to read, save, and share

Curated Newsletters

  • Insights on markets, finance, politics, tech, and more delivered to your inbox

Market Analysis & Investment Insights

  • In-depth market analysis & insights with access to The Smart Investor

Archives

  • Repository of articles and publications dating back to 1997

Ad-free Reading

  • Uninterrupted reading experience with no advertisements

Seamless Access Across All Devices

  • Access Business Standard across devices — mobile, tablet, or PC, via web or app

More From This Section

First Published: Jun 05 2016 | 5:32 PM IST

Next Story