Computers are good at identifying patterns in huge data sets while humans are good at inferring patterns from just a few examples.
The new system bridges these two ways of processing information, so that humans and computers can collaborate to make better decisions.
The system learns to make judgments by crunching data but distills what it learns into simple examples.
In experiments, human subjects using the system were more than 20 per cent better at classification tasks than those using a similar system based on existing algorithms.
"That's the type of decision-making people do when they make tactical decisions - like in fire crews or field operations.
"When they're presented with a new scenario, they don't do search the way machines do. They try to match their current scenario with examples from their previous experience, and then they think, 'OK, that worked in a previous scenario,' and they adapt it to the new scenario," Shah said.
In supervised machine learning, a computer is fed a slew of training data that's been labelled by humans and tries to find correlations - say, those visual features that occur most frequently in images labelled 'car'.
In unsupervised machine learning, on the other hand, the computer simply looks for commonalities in unstructured data. The result is a set of data clusters whose members are in some way related, but it may not be obvious how.
The MIT researchers made two major modifications to the type of algorithm commonly used in unsupervised learning.
The other is that rather than simply ranking shared features according to importance, the way a topic-modelling algorithm might, the new algorithm tries to winnow the list of features down to a representative set, which the researchers dubbed a 'subspace'.
You’ve reached your limit of {{free_limit}} free articles this month.
Subscribe now for unlimited access.
Already subscribed? Log in
Subscribe to read the full story →
Smart Quarterly
₹900
3 Months
₹300/Month
Smart Essential
₹2,700
1 Year
₹225/Month
Super Saver
₹3,900
2 Years
₹162/Month
Renews automatically, cancel anytime
Here’s what’s included in our digital subscription plans
Exclusive premium stories online
Over 30 premium stories daily, handpicked by our editors


Complimentary Access to The New York Times
News, Games, Cooking, Audio, Wirecutter & The Athletic
Business Standard Epaper
Digital replica of our daily newspaper — with options to read, save, and share


Curated Newsletters
Insights on markets, finance, politics, tech, and more delivered to your inbox
Market Analysis & Investment Insights
In-depth market analysis & insights with access to The Smart Investor


Archives
Repository of articles and publications dating back to 1997
Ad-free Reading
Uninterrupted reading experience with no advertisements


Seamless Access Across All Devices
Access Business Standard across devices — mobile, tablet, or PC, via web or app
