IIIT-H study caution doctors against relying entirely on AI for medical diagnosis
Researchers at IIIT-Hyderabad found that vision-language models often highlight incorrect regions in chest X-rays compared to human radiologists. The study suggests that doctors should treat AI-generated diagnostic heatmaps as supplementary tools rather than definitive evidence.
Why it matters
As AI integration in healthcare grows, this study highlights critical safety risks and the necessity of human oversight in medical diagnostics.
Doctors should exercise caution when using artificial intelligence (AI) tools to interpret medical images, as areas highlighted by AI models may not always align with those identified by radiologists , according to a study by researchers at the International Institute of Information Technology, Hyderabad (IIIT-H).
The study, conducted by the Language Technologies Research Centre (LTRC) at IIIT-H, examined four vision-language models for analysing chest X-rays and found discrepancies between the regions highlighted by the models and those identified by radiologists.
The findings underscore the need for doctors to independently assess AI-generated outputs rather than relying on them entirely for diagnosis.
The research team, led by Parameswari Krishnamurthy, sought to determine whether AI-generated heatmaps accurately represented the regions of an image that radiologists would identify as disease-related.
However, the researchers questioned whether these visual indicators necessarily reflected the models’ ability to identify the actual location of a disease.
Get smarter about the news
Sign up free for a feed built around what you actually care about, Dive Deeper research on any story, and the full text of every article.
Create free accountAlready have an account? Sign in