AI equal with human experts in medical diagnosis, study finds

The Guardian Technology 1 month ago

Artificial intelligence is on a par with human experts when it comes to making medical diagnoses based on images, a review has found.

The potential for artificial intelligence in healthcare has caused excitement, with advocates saying it will ease the strain on resources, free up time for doctor-patient interactions and even aid the development of tailored treatment. Last month the government announced £250m of funding for a new NHS artificial intelligence laboratory.

However, experts have warned the latest findings are based on a small number of studies, since the field is littered with poor-quality research.

One burgeoning application is the use of AI in interpreting medical images – a field that relies on deep learning, a sophisticated form of machine learning in which a series of labelled images are fed into algorithms that pick out features within them and learn how to classify similar images. This approach has shown promise in diagnosis of diseases from cancers to eye conditions.

However questions remain about how such deep learning systems measure up to human skills. Now researchers say they have conducted the first comprehensive review of published studies on the issue, and found humans and machines are on a par.

Prof Alastair Denniston, at the University Hospitals Birmingham NHS foundation trust and a co-author of the study, said the results were encouraging but the study was a reality check for some of the hype about AI.

Dr Xiaoxuan Liu, the lead author of the study and from the same NHS trust, agreed. “There are a lot of headlines about AI outperforming humans, but our message is that it can at best be equivalent,” she said.

Writing in the Lancet Digital Health, Denniston, Liu and colleagues reported how they focused on research papers published since 2012 – a pivotal year for deep learning.

An initial search turned up more than 20,000 relevant studies. However, only 14 studies – all based on human disease – reported good quality data, tested the deep learning system with images from a separate dataset to the one used to train it, and showed the same images to human experts.

The team pooled the most promising results from within each of the 14 studies to reveal that deep learning systems correctly detected a disease state 87% of the time – compared with 86% for healthcare professionals – and correctly gave the all-clear 93% of the time, compared with 91% for human experts.

However, the healthcare professionals in these scenarios were not given additional patient information they would have in the real world which could steer their diagnosis.

Prof David Spiegelhalter, the chair of the Winton centre for risk and evidence communication at the University of Cambridge, said the field was awash with poor research.

“This excellent review demonstrates that the massive hype over AI in medicine obscures the lamentable quality of almost all evaluation studies,” he said. “Deep learning can be a powerful and impressive technique, but clinicians and commissioners should be asking the crucial question: what does it actually add to clinical practice?”

However, Denniston remained optimistic about the potential of AI in healthcare, saying such deep learning systems could act as a diagnostic tool and help tackle the backlog of scans and images. What’s more, said Liu, they could prove useful in places which lack experts to interpret images.

Liu said it would be important to use deep learning systems in clinical trials to assess whether patient outcomes improved compared with current practices.

Dr Raj Jena, an oncologist at Addenbrooke’s hospital in Cambridge who was not involved in the study, said deep learning systems would be important in the future, but stressed they needed robust real-world testing. He also said it was important to understand why such systems sometimes make the wrong assessment.

“If you are a deep learning algorithm, when you fail you can often fail in a very unpredictable and spectacular way,” he said.


Source link
Read also:
The Sun › 2 days ago
THIS Thursday marks Equal Pay Day in the UK, but what does the phrase mean? Here’s what you need to know. Getty - Contributor What is Equal Pay Day? Equal Pay Day is the point in the year at which the average man has earned the amount the average...
Business Insider › 2 months ago
This is a preview of the AI in Medical Diagnosis research report from Business Insider Intelligence. Purchase this report. Business Insider Intelligence offers even more healthcare coverage with Digital Health Pro. Subscribe today to receive industry...
The Sun › Lifestyle › 1 month ago
THOUSANDS of women suffer a delayed diagnosis of incurable breast cancer because of failings in care, a report reveals. One in four patients who saw their breast cancer return and spread had to visit a GP at least three times before diagnosis. And just...
CNN › Traveling › 1 month ago
Fall equinox for 2019 is here, that day when you get equal amounts of daylight and darkness. Except it's not as equal as you think. Find out whether you get bonus sunlight and read up on myths and celebrations.
The Independent › Lifestyle › 1 day ago
Equal Pay Day marks the day of the year women are effectively working for free due to the gender pay gap
Fox News › Politics › 1 month ago
Venezuela, a country riddled with human rights abuses and that has forced the migration of millions of people, is set to join a host of other countries with similarly poor human rights records on the controversial Human Rights Council.
CBS News › 1 month ago
A new study published in the Annals of Internal Medicine claims eating red meat may not be as unhealthy as previously thought, but not all experts agree. CBS News medical contributor and cardiologist Dr. Tara Narula joined CBSN to discuss what...
Telegraph › Lifestyle › 2 weeks ago
The single biggest genome study of African people has been completed in Uganda, which experts hope will help overturn an “inherent bias” in DNA datasets.
Business Insider › Politics › 1 month ago
A nonprofit speaking at a UN Human Rights hearing said that China is engaged in widespread harvesting of human organs from persecuted religious and ethnic minorities. The China Tribunal made the accusation at a meeting of the UN Human Rights Council in...
CNN › Lifestyle › 1 week ago
There have been increasing rates of adults diagnosed with ADHD within the Kaiser Permanente Northern California health system between 2007 and 2016, regardless of whether they were diagnosed as a child or adult, a new study finds.
Sign In

Sign in to follow sources and tags you love, and get personalized stories.

Continue with Google
OR