You are here: Home » News-IANS » Health-Medicine
Business Standard

AI tools may fail during key medical diagnosis: Researchers

IANS  |  New York 

In a first such warning when it comes to the role of in making sense of critical health data, a team of US researchers has said AI in the medical space must be carefully tested for performance across a wide range of populations as the models may fall short.

The findings should give pause to those considering rapid deployment of AI platforms without rigorously assessing their performance in real-world clinical settings reflective of where they are being deployed, observed the team from the at

AI tools trained to detect on chest X-rays suffered significant decreases in performance when tested on data from outside health systems, according to the study published in a special issue of on and health care.

These findings suggest that the models may not perform as accurately as expected.

"models trained to perform medical diagnosis can generalise well, but this cannot be taken for granted since patient populations and techniques differ significantly across institutions," said Senior Eric Oermann, MD, Instructor in at the at Mount Sinai.

To reach this conslusion, the researchers assessed how AI models identified in 158,000 chest X-rays across three medical institutions -- the National Institutes of Health, The and

In three out of five comparisons, the convolutional neural networks' (CNNs) performance in diagnosing on X-rays from hospitals outside of its own network was significantly lower than on X-rays from the original health system.

However, CNNs were able to detect the hospital system where an was acquired with a high-degree of accuracy, and cheated at their predictive task based on the prevalence of at the training institution.

"If AI systems are to be used for medical diagnosis, they must be tailored to carefully consider clinical questions, tested for a variety of real-world scenarios, and carefully assessed to determine how they impact accurate diagnosis," explained Study's First



(This story has not been edited by Business Standard staff and is auto-generated from a syndicated feed.)

First Published: Sat, November 10 2018. 13:56 IST