Babylon Health says AI abilities ‘on par with human doctors’

  • 2 July 2018
Babylon Health says AI abilities ‘on par with human doctors’

Babylon Health claims its artificial intelligence (AI) system has demonstrated diagnostic ability that is “on-par with human doctors” after scoring 81% in a Membership of the Royal College of General Practitioners (MRCGP) exam.

The AI was fed a “representative sample-set” of questions from the MRCGP test, which represents the final assessment for GPs in training.

According to Babylon Health, its AI beat the average pass mark for the assessment – 72% – in its first sitting.

Speaking to Digital Health News, Ali Parsa – founder and chief executive of Babylon Health – called the results “phenomenal”.

“You study your whole life to become a GP… For a machine to be able to pass this with flying colours in its first go; that is incredible,” said Parsa.

Babylon’s AI was also tested against seven “experienced” primary care doctors to determine its ability to accurately diagnose a wider range of health conditions.

Faced with 100 independently-devised symptom sets, the AI scored 80% accuracy in its diagnostics capabilities, while the seven doctors achieved an accuracy ranging from 64% to 94%.

When assessed against conditions seen most frequently in primary care medicine, Babylon said its AI system displayed a 98% accuracy rate, compared with the 52-99% scored by human doctors.

Asked how the score matched up to predictions, Parsa said he was surprised by the speed at which the AI learnt.

“The way we train the machine is very novel. No-one else in the world is doing it,” he said.

“Our approach of mixing a knowledge base with natural language processing, a probabilistic graphical model and inference engine – put on top of a deep learning engine – allowed us to achieve the results at a speed that nobody else could.”

Looking further ahead, Parsa suggested that Babylon was exploring how facial recognition and voice analysis capabilities could be built into the AI. The idea is this would enable it to assess the level of pain a patient is experiencing, and potentially even determine whether an individual is making up their symptoms.

He also indicated that the AI would be localised to some extent to make it more relevant to international markets, as Babylon expanded into them.

The firm recently signed deals with Tencent and Samsung as part of efforts to expand its business outside of the UK.

“We are now using this central engine, this central brain, but we are also broadening the scope to teach us how to become an Asian doctor, an American doctor,” he said.

However, not everybody was convinced by the assessment of Babylon Health’s AI.

Speaking on BBC Radio 4’s Today Programme, Helen Stokes-Lampard, chair of the Royal College of General Practitioners, said: “We need to be cautious about the claims being made at the moment. It’s really exciting to see AI evolving and there will be great applications as its gets better, but right now we don’t have independently-verified, peer-reviewed research – the scientific standard for accepting innovation and moving forward.

“What we have is some in-house research from Ali and his team. I am delighted that they are using partners and academic institutions to increase the robustness of their research, but it’s still very early days.

“I’m concerned about the hype surrounding this right now. We need to be cautious, we need to demand evidence because we have to be sure that anything we introduce is safe.”

Subscribe to our newsletter

Subscribe To Our Newsletter

Subscribe To Our Newsletter

Sign up

Related News

AI platform for arthritis detection secures £1.2m grant

AI platform for arthritis detection secures £1.2m grant

Henley Business School has been awarded an £1.2m grant to develop an AI system for early detection of rheumatic and musculoskeletal diseases. 
Huma acquires eConsult to become ‘end-to-end tech platform’

Huma acquires eConsult to become ‘end-to-end tech platform’

Global healthcare AI firm Huma has announced its acquisition of GP online consultation and digital triage startup eConsult.
NHSE says IT should flag patient safety issues in primary care

NHSE says IT should flag patient safety issues in primary care

New patient safety guidance from NHS England says that primary care’s IT systems should automatically flag patient safety issues.

2 Comments

  • I believe AI will eventually surpasss us and in fact become part of us. It will Allow us to enjoy our lifes more . Maybe a universal wage would be an option in the future.

  • Somewhere a Rob Otic is about to graduate from medical school and has decided to call himself Dr Robert Otic.

Comments are closed.