Computers perform much worse than average humans at verbal reasoning questions, which are based around analogies, classifications, as well as synonyms and antonyms.
Huazheng Wang and colleagues at the University of Science and Technology of China and Bin Gao's team at Microsoft Research in Beijing have built a deep learning machine that outperforms the average human ability to answer verbal reasoning questions for the first time.
Until now, the furthest programmers had gotten was to build machines that were capable of analysing millions of texts to figure out which words are often associated with each other, essentially turning words into vectors that could be compared, added and subtracted.
Huazheng and colleagues tackle this by taking each word and looking for other words that often appear nearby in a large corpus of text. They then use an algorithm to see how these words are clustered.
The final step is to look up the different meanings of a word in a dictionary and then to match the clusters to each meaning.
The researchers further enhanced their technique by identifying the category of each question so that the computer then knows which answering strategy it should employ.
Spotting each type of question is relatively straightforward for a machine learning algorithm, given enough to examples to learn from.
The researchers then tested the deep learning technique against 200 human participants of various ages and educational backgrounds.
"To our surprise, the average performance of human beings is a little lower than that of our proposed method," researchers said.
You’ve reached your limit of {{free_limit}} free articles this month.
Subscribe now for unlimited access.
Already subscribed? Log in
Subscribe to read the full story →
Smart Quarterly
₹900
3 Months
₹300/Month
Smart Essential
₹2,700
1 Year
₹225/Month
Super Saver
₹3,900
2 Years
₹162/Month
Renews automatically, cancel anytime
Here’s what’s included in our digital subscription plans
Exclusive premium stories online
Over 30 premium stories daily, handpicked by our editors


Complimentary Access to The New York Times
News, Games, Cooking, Audio, Wirecutter & The Athletic
Business Standard Epaper
Digital replica of our daily newspaper — with options to read, save, and share


Curated Newsletters
Insights on markets, finance, politics, tech, and more delivered to your inbox
Market Analysis & Investment Insights
In-depth market analysis & insights with access to The Smart Investor


Archives
Repository of articles and publications dating back to 1997
Ad-free Reading
Uninterrupted reading experience with no advertisements


Seamless Access Across All Devices
Access Business Standard across devices — mobile, tablet, or PC, via web or app
