You are here: Home » PTI Stories » National » News
Business Standard

Novel algorithm can 'de-bias' data for artificial intelligence

Technology Internet

Press Trust of India  |  Boston 

Scientists at MIT have developed an algorithm that can automatically identify and minimise any hidden biases in the data used by artificial intelligence (AI) systems.

In recent years, AI systems have been shown to be unfair sometimes, said researchers at Massachusetts Institute of Technology (MIT) in the US.

This is dangerous as such systems are increasingly being used to do everything from predicting crime to determining what we consume, they said.

"Last year's study showing the racism of face-recognition algorithms demonstrated a fundamental truth about AI: if you train with biased data, you will get biased results," said MIT PhD student Alexander Amini.

The new algorithm can learn both a specific task like face detection, as well as the underlying structure of the training data, which allows it to identify and minimise any hidden biases.

In tests, the algorithm decreased "categorical bias" by over 60 per cent compared to state-of-the-art facial detection models -- while simultaneously maintaining the overall precision of these systems.

A lot of existing approaches in this field require at least some level of human input into the system to define specific biases that researchers want it to learn.

In contrast, the MIT team's algorithm can look at a dataset, learn what is intrinsically hidden inside it, and automatically resample it to be more fair without needing a programmer in the loop.

"Facial classification in particular is a technology that's often seen as 'solved,' even as it's become clear that the datasets being used often aren't properly vetted," said Amini.

"Rectifying these issues is especially important as we start to see these kinds of algorithms being used in security, law enforcement and other domains," he said.

The system would be particularly relevant for larger datasets that are too big to vet manually and also extends to other computer vision applications beyond facial detection, reserachers said.

(This story has not been edited by Business Standard staff and is auto-generated from a syndicated feed.)

Dear Reader,

Business Standard has always strived hard to provide up-to-date information and commentary on developments that are of interest to you and have wider political and economic implications for the country and the world. Your encouragement and constant feedback on how to improve our offering have only made our resolve and commitment to these ideals stronger. Even during these difficult times arising out of Covid-19, we continue to remain committed to keeping you informed and updated with credible news, authoritative views and incisive commentary on topical issues of relevance.
We, however, have a request.

As we battle the economic impact of the pandemic, we need your support even more, so that we can continue to offer you more quality content. Our subscription model has seen an encouraging response from many of you, who have subscribed to our online content. More subscription to our online content can only help us achieve the goals of offering you even better and more relevant content. We believe in free, fair and credible journalism. Your support through more subscriptions can help us practise the journalism to which we are committed.

Support quality journalism and subscribe to Business Standard.

Digital Editor

First Published: Wed, January 30 2019. 13:00 IST