Medical AIDiagnostic BreakthroughJun 23, 2026, 12:42 AM· 5 min read· #6 of 6 in ai

AI Models Surpass Physicians in Complex Diagnostics as Healthcare Enters a New Era

Recent benchmark studies reveal that advanced AI models now outperform expert physicians in diagnosing complex medical cases, paving the way for AI to serve as a reliable clinical second opinion. Concurrently, new foundation models are mapping genetic interactions and population health, promising to close the gap between medical discovery and patient care.

By Factlen Editorial Team

Clinical Researchers 35%Public Health Advocates 35%Biotech Innovators 30%
Clinical Researchers
Argue that AI has definitively crossed the threshold of clinical reasoning and should be integrated as a standard second opinion to reduce diagnostic errors.
Public Health Advocates
Emphasize that AI's greatest value is in population-level case finding and ensuring proven treatments reach missed patients.
Biotech Innovators
Focus on AI's ability to map biology at the cellular level and radically accelerate the timeline for discovering new drugs.

What's not represented

  • · Patient Advocacy Groups
  • · Medical Malpractice Insurers
  • · Frontline Nurses and Technicians

Why this matters

For decades, the bottleneck in healthcare has been the human capacity to synthesize vast amounts of complex patient data in real time. As AI systems prove capable of matching or exceeding specialist diagnostic accuracy, patients stand to benefit from faster, more accurate diagnoses and fewer missed conditions, fundamentally democratizing access to expert-level medical insights.

Key points

  • A landmark study published in Science found OpenAI's o1 model outperformed physicians on complex diagnostic reasoning tasks.
  • The AI achieved 89% accuracy on complex clinical vignettes, compared to 34% for human physicians using conventional resources.
  • In real-world emergency room scenarios, the AI correctly identified diagnoses 72.4% of the time, beating expert physicians.
  • Finland is developing a nationwide healthcare foundation model to predict disease risk for over 200 conditions across its population.
  • Mount Sinai researchers launched a Gene Set Foundation Model to map genetic interactions and accelerate biological discoveries.
  • AI is drastically reducing drug discovery timelines, with companies like Insilico Medicine cutting preclinical phases to 12-18 months.
89%
AI accuracy on complex clinical vignettes
34%
Physician accuracy on same vignettes
78.3%
AI correct diagnosis rate in NEJM CPC challenges
200+
Conditions predicted by Finland's new AI model

For decades, the medical community has sought computational systems capable of the nuanced logic required to diagnose complex diseases. That threshold appears to have been crossed. A landmark study published in the journal Science reveals that advanced artificial intelligence models now match or exceed the performance of human physicians on challenging diagnostic tasks. The findings signal a profound shift in healthcare, moving AI from a tool for administrative efficiency to a highly capable partner in clinical reasoning.[1][2]

Researchers from Harvard Medical School and Beth Israel Deaconess Medical Center pitted OpenAI’s o1 large language model against hundreds of physicians, ranging from residents to attending specialists. The evaluation spanned six distinct experiments, including "gold standard" medical puzzles from the New England Journal of Medicine (NEJM) and real-world emergency room scenarios. Across virtually every benchmark, the AI eclipsed both prior models and the human physician baselines.[1]

The performance gap on complex clinical vignettes was particularly striking. The AI model achieved a median accuracy of 89%, while physicians—who were permitted to use search engines and conventional medical databases—scored just 34%. In the rigorous NEJM Healer diagnostic cases, the AI achieved a perfect reasoning score in 78 out of 80 instances, significantly outperforming both attending physicians and residents.[1]

In recent benchmark tests, AI models significantly outperformed human physicians on complex clinical vignettes.
In recent benchmark tests, AI models significantly outperformed human physicians on complex clinical vignettes.

The model’s capabilities extended beyond theoretical puzzles into the chaotic environment of real-world care. In a blinded study using unstructured clinical data from 76 randomly selected emergency room cases, the AI was tested on initial triage, evaluation, and hospital admission phases. During the emergency encounter, the AI identified the correct diagnosis 72.4% of the time, compared to 61.8% and 52.6% for two expert human physicians.[1][2]

While the headlines are striking, researchers caution that the results require context. The AI model was evaluated entirely on text-based inputs, meaning the clinical vignettes and electronic health records had already been transcribed and structured by humans. In a real clinic, doctors rely on multimodal signals—listening to a patient's lungs, observing their pallor, and interpreting their expressions. The gap between the AI and specialists shrank in the real-world emergency department comparison, highlighting that AI is best positioned as a powerful second opinion rather than a standalone diagnostician.[1][2]

Beyond solving rare medical mysteries, public health experts argue that AI’s most immediate impact will be felt in routine care. Speaking at the New York Academy of Sciences, Dr. Dave Chokshi, former New York City Health Commissioner, emphasized that AI’s greatest promise is "case finding." Rather than discovering miracle cures, AI can scan vast health systems to identify patients who have an undiagnosed common condition, qualify for a proven intervention, or have fallen out of care before completing treatment.[3]

"We know how to control blood pressure. This is not rocket science," Dr. Chokshi noted. By using AI to surface the patients most likely to be missed, health systems can connect them sooner to care that is already known to work, fundamentally closing the gap between medical knowledge and actual care delivery.[3]

Public health experts emphasize that AI's greatest immediate value lies in 'case finding'—identifying patients who have fallen out of care.
Public health experts emphasize that AI's greatest immediate value lies in 'case finding'—identifying patients who have fallen out of care.

This population-level approach is already being operationalized on a national scale. In June 2026, Finland launched the FINe-Health Foundry, a project designed to build the world’s first nationwide healthcare foundation model. Backed by millions in funding, this "Swiss Army knife" AI model will integrate multimodal health data—from medical images to genomic profiles—for a large portion of the Finnish population.

This population-level approach is already being operationalized on a national scale.

The Finnish foundation model aims to predict disease risk for over 200 conditions for every living person in the country. By running AI agents within virtual laboratories, the system will provide doctors with real-time clinical decision support and allow policymakers to simulate the population-level impact of different health interventions before they are rolled out.

While population models track disease at a macro level, other AI breakthroughs are mapping biology at its most fundamental scale. Scientists at the Icahn School of Medicine at Mount Sinai recently introduced a Gene Set Foundation Model (GSFM). Unlike previous models that rely primarily on gene expression data, the GSFM is designed to learn patterns in how genes are grouped and function together across thousands of biological contexts.[4]

New foundation models are mapping how genes function together, acting like a puzzle solver to uncover biological insights.
New foundation models are mapping how genes function together, acting like a puzzle solver to uncover biological insights.

The Mount Sinai researchers compiled millions of gene sets from published scientific studies, training the AI much like a puzzle. By giving the model part of a gene set and asking it to predict the missing pieces, the system learned the underlying patterns of genetic interaction. The result is a new, unified map of how genes work together in different diseases, offering a powerful tool to uncover new biological insights from existing data.[4]

These foundational biological maps are radically accelerating the pace of pharmaceutical innovation. At the BIO 2026 International Convention, Insilico Medicine and SK Biopharmaceuticals announced a major collaboration to discover AI-enabled drug candidates for central nervous system disorders. By leveraging generative AI across target validation, chemistry, and molecule optimization, the partnership aims to design next-generation therapies for neuroimmune conditions.

The impact of AI on drug discovery timelines is already measurable. Traditional early-stage drug discovery typically takes up to four years to identify a viable molecule. Using its advanced AI and automation platform, Insilico has consistently reached the preclinical candidate nomination stage in an average of just 12 to 18 months, synthesizing and testing a fraction of the molecules usually required.

Generative AI and automation are slashing the time required to discover viable preclinical drug candidates from years to months.
Generative AI and automation are slashing the time required to discover viable preclinical drug candidates from years to months.

Across the healthcare spectrum—from the emergency room to the genetics lab and the pharmaceutical pipeline—artificial intelligence is proving its capacity to handle the sheer volume and complexity of modern medical data. The technology is no longer a future concept; it is actively reshaping how diseases are diagnosed, how drugs are discovered, and how patient care is delivered.[1][4]

The consensus among medical researchers and technologists is not that artificial intelligence will replace human doctors. Instead, the emerging paradigm is one of profound augmentation. By serving as an always-on, highly accurate clinical collaborator, AI promises to reduce diagnostic errors, accelerate life-saving research, and ensure that fewer patients fall through the cracks of an increasingly complex healthcare system.[2][3]

How we got here

  1. Dec 2025

    Researchers develop AI models capable of diagnosing complex heart conditions from simple 10-second EKG strips.

  2. May 2026

    Science publishes a landmark study showing OpenAI's o1 model outperforming hundreds of physicians on clinical reasoning benchmarks.

  3. May 2026

    Mount Sinai introduces the Gene Set Foundation Model to map genetic interactions across thousands of biological contexts.

  4. June 2026

    Finland launches the FINe-Health Foundry to build a nationwide AI model predicting disease risk for its entire population.

  5. June 2026

    Insilico Medicine and SK Biopharmaceuticals announce a major partnership at BIO 2026 to use generative AI for central nervous system drug discovery.

Viewpoints in depth

Clinical Researchers

Argue that AI has definitively crossed the threshold of clinical reasoning and should be integrated as a standard second opinion.

Researchers who conducted the recent benchmark studies argue that the data is now unequivocal: advanced large language models possess a level of clinical reasoning that matches or exceeds human specialists. By consistently outperforming physicians on complex diagnostic vignettes and real-world emergency room scenarios, these systems have proven their potential utility. Proponents in this camp emphasize that integrating AI as an always-available second opinion could drastically reduce diagnostic errors, catch rare conditions that a busy clinician might overlook, and ultimately save lives.

Public Health Advocates

Emphasize that AI's greatest immediate value lies in "case finding" and population health.

Public health officials and epidemiologists view the AI breakthrough through a different lens. Rather than focusing on the technology's ability to solve rare medical mysteries, they highlight its capacity to scan vast databases of electronic health records to identify patients who have fallen out of care. By surfacing individuals with undiagnosed common conditions—such as hypertension or early-stage diabetes—AI can ensure that proven, existing treatments reach the people who need them most, effectively closing the gap between medical knowledge and actual care delivery.

Biotech Innovators

Focus on the upstream applications of foundation models in mapping biology and accelerating drug discovery.

For the biotechnology sector, the true revolution is happening at the cellular level. Innovators point to the development of Gene Set Foundation Models and generative AI platforms that are mapping genetic interactions and designing novel molecules in a fraction of the traditional time. By cutting the preclinical drug discovery phase from four years down to 12 to 18 months, these AI systems are fundamentally altering the economics of pharmaceutical development, making it feasible to pursue treatments for a wider array of diseases with unprecedented speed.

What we don't know

  • How these text-based AI models will perform when directly integrating raw, multimodal clinical data like live audio auscultation and visual patient cues.
  • The long-term legal and regulatory frameworks for liability when an AI system provides a diagnostic second opinion that contradicts a human physician.
  • Whether the rapid deployment of AI in healthcare will exacerbate existing disparities if advanced tools are initially concentrated in well-funded academic medical centers.

Key terms

Large Language Model (LLM)
A type of artificial intelligence trained on vast amounts of text data, capable of understanding and generating human-like language and reasoning.
Clinical Reasoning
The cognitive process by which healthcare professionals gather patient information, synthesize it, and make diagnostic and treatment decisions.
Foundation Model
A large-scale AI model trained on a broad quantity of unlabeled data that can be adapted to a wide range of downstream tasks, such as predicting disease or mapping genes.
Case Finding
A public health strategy that involves actively searching for individuals with a specific disease or condition who are not currently receiving care.
Preclinical Candidate (PCC)
A newly discovered drug molecule that has shown enough promise in laboratory testing to advance to human clinical trials.

Frequently asked

Will AI replace human doctors?

No. Researchers emphasize that AI is designed to serve as a highly capable clinical second opinion, augmenting a physician's judgment rather than replacing the human elements of physical examination and patient empathy.

How did the AI perform in real emergency rooms?

In a blinded study of real emergency room cases, the AI model identified the correct diagnosis 72.4% of the time, outperforming two expert physicians who scored 61.8% and 52.6%.

What is a Gene Set Foundation Model?

It is an AI system developed by Mount Sinai that learns how genes group and function together across different biological contexts, acting like a map to uncover new insights into biology and disease.

How is AI changing drug discovery?

AI is drastically accelerating the timeline. Companies using generative AI can now identify viable preclinical drug candidates in 12 to 18 months, a process that traditionally took up to four years.

Sources

Source coverage

4 outlets

3 viewpoints surfaced

Clinical Researchers 35%Public Health Advocates 35%Biotech Innovators 30%
  1. [1]News-MedicalClinical Researchers

    AI model outperforms doctors in clinical reasoning tests

    Read on News-Medical
  2. [2]The BMJClinical Researchers

    Artificial intelligence is better than humans at emergency triage diagnoses, a study has suggested

    Read on The BMJ
  3. [3]New York Academy of SciencesPublic Health Advocates

    Healthcare's Real AI Breakthrough May Be Getting Proven Care to More Patients

    Read on New York Academy of Sciences
  4. [4]Mount SinaiBiotech Innovators

    Scientists Create New AI Model to Reveal How Genes Function Together

    Read on Mount Sinai
Stay informed

Every angle. Every day.

Get ai stories with full source coverage and perspective breakdowns delivered to your inbox.