Deep learning machine beats humans in IQ test

Image
Press Trust of India Beijing
Last Updated : Jun 21 2015 | 3:48 PM IST
In a first, a deep learning machine developed by Chinese researchers has outperformed humans in verbal reasoning questions of an IQ test.
Computers perform much worse than average humans at verbal reasoning questions, which are based around analogies, classifications, as well as synonyms and antonyms.
Huazheng Wang and colleagues at the University of Science and Technology of China and Bin Gao's team at Microsoft Research in Beijing have built a deep learning machine that outperforms the average human ability to answer verbal reasoning questions for the first time.
Until now, the furthest programmers had gotten was to build machines that were capable of analysing millions of texts to figure out which words are often associated with each other, essentially turning words into vectors that could be compared, added and subtracted.
But this approach has a well-known shortcoming: it assumes that each word has a single meaning represented by a single vector. Not only is that often not the case, verbal tests tend to focus on words with more than one meaning as a way of making questions harder, according to 'MIT Technology Review'.
Huazheng and colleagues tackle this by taking each word and looking for other words that often appear nearby in a large corpus of text. They then use an algorithm to see how these words are clustered.
The final step is to look up the different meanings of a word in a dictionary and then to match the clusters to each meaning.
This can help a machine recognise the multiple different senses that some words can have.
The researchers further enhanced their technique by identifying the category of each question so that the computer then knows which answering strategy it should employ.
Spotting each type of question is relatively straightforward for a machine learning algorithm, given enough to examples to learn from.
The researchers then tested the deep learning technique against 200 human participants of various ages and educational backgrounds.
"To our surprise, the average performance of human beings is a little lower than that of our proposed method," researchers said.
*Subscribe to Business Standard digital and get complimentary access to The New York Times

Smart Quarterly

₹900

3 Months

₹300/Month

SAVE 25%

Smart Essential

₹2,700

1 Year

₹225/Month

SAVE 46%
*Complimentary New York Times access for the 2nd year will be given after 12 months

Super Saver

₹3,900

2 Years

₹162/Month

Subscribe

Renews automatically, cancel anytime

Here’s what’s included in our digital subscription plans

Exclusive premium stories online

  • Over 30 premium stories daily, handpicked by our editors

Complimentary Access to The New York Times

  • News, Games, Cooking, Audio, Wirecutter & The Athletic

Business Standard Epaper

  • Digital replica of our daily newspaper — with options to read, save, and share

Curated Newsletters

  • Insights on markets, finance, politics, tech, and more delivered to your inbox

Market Analysis & Investment Insights

  • In-depth market analysis & insights with access to The Smart Investor

Archives

  • Repository of articles and publications dating back to 1997

Ad-free Reading

  • Uninterrupted reading experience with no advertisements

Seamless Access Across All Devices

  • Access Business Standard across devices — mobile, tablet, or PC, via web or app

More From This Section

First Published: Jun 21 2015 | 3:48 PM IST

Next Story