AI Models Surpass Physicians in Complex Diagnostics as Healthcare Enters a New Era
Recent benchmark studies reveal that advanced AI models now outperform expert physicians in diagnosing complex medical cases, paving the way for AI to serve as a reliable clinical second opinion. Concurrently, new foundation models are mapping genetic interactions and population health, promising to close the gap between medical discovery and patient care.
By Factlen Editorial Team
- Clinical Researchers
- Argue that AI has definitively crossed the threshold of clinical reasoning and should be integrated as a standard second opinion to reduce diagnostic errors.
- Public Health Advocates
- Emphasize that AI's greatest value is in population-level case finding and ensuring proven treatments reach missed patients.
- Biotech Innovators
- Focus on AI's ability to map biology at the cellular level and radically accelerate the timeline for discovering new drugs.
What's not represented
- · Patient Advocacy Groups
- · Medical Malpractice Insurers
- · Frontline Nurses and Technicians
Why this matters
For decades, the bottleneck in healthcare has been the human capacity to synthesize vast amounts of complex patient data in real time. As AI systems prove capable of matching or exceeding specialist diagnostic accuracy, patients stand to benefit from faster, more accurate diagnoses and fewer missed conditions, fundamentally democratizing access to expert-level medical insights.
Key points
- A landmark study published in Science found OpenAI's o1 model outperformed physicians on complex diagnostic reasoning tasks.
- The AI achieved 89% accuracy on complex clinical vignettes, compared to 34% for human physicians using conventional resources.
- In real-world emergency room scenarios, the AI correctly identified diagnoses 72.4% of the time, beating expert physicians.
- Finland is developing a nationwide healthcare foundation model to predict disease risk for over 200 conditions across its population.
- Mount Sinai researchers launched a Gene Set Foundation Model to map genetic interactions and accelerate biological discoveries.
- AI is drastically reducing drug discovery timelines, with companies like Insilico Medicine cutting preclinical phases to 12-18 months.
For decades, the medical community has sought computational systems capable of the nuanced logic required to diagnose complex diseases. That threshold appears to have been crossed. A landmark study published in the journal Science reveals that advanced artificial intelligence models now match or exceed the performance of human physicians on challenging diagnostic tasks. The findings signal a profound shift in healthcare, moving AI from a tool for administrative efficiency to a highly capable partner in clinical reasoning.[1][2]
Researchers from Harvard Medical School and Beth Israel Deaconess Medical Center pitted OpenAI’s o1 large language model against hundreds of physicians, ranging from residents to attending specialists. The evaluation spanned six distinct experiments, including "gold standard" medical puzzles from the New England Journal of Medicine (NEJM) and real-world emergency room scenarios. Across virtually every benchmark, the AI eclipsed both prior models and the human physician baselines.[1]
The performance gap on complex clinical vignettes was particularly striking. The AI model achieved a median accuracy of 89%, while physicians—who were permitted to use search engines and conventional medical databases—scored just 34%. In the rigorous NEJM Healer diagnostic cases, the AI achieved a perfect reasoning score in 78 out of 80 instances, significantly outperforming both attending physicians and residents.[1]

The model’s capabilities extended beyond theoretical puzzles into the chaotic environment of real-world care. In a blinded study using unstructured clinical data from 76 randomly selected emergency room cases, the AI was tested on initial triage, evaluation, and hospital admission phases. During the emergency encounter, the AI identified the correct diagnosis 72.4% of the time, compared to 61.8% and 52.6% for two expert human physicians.[1][2]
While the headlines are striking, researchers caution that the results require context. The AI model was evaluated entirely on text-based inputs, meaning the clinical vignettes and electronic health records had already been transcribed and structured by humans. In a real clinic, doctors rely on multimodal signals—listening to a patient's lungs, observing their pallor, and interpreting their expressions. The gap between the AI and specialists shrank in the real-world emergency department comparison, highlighting that AI is best positioned as a powerful second opinion rather than a standalone diagnostician.[1][2]
Beyond solving rare medical mysteries, public health experts argue that AI’s most immediate impact will be felt in routine care. Speaking at the New York Academy of Sciences, Dr. Dave Chokshi, former New York City Health Commissioner, emphasized that AI’s greatest promise is "case finding." Rather than discovering miracle cures, AI can scan vast health systems to identify patients who have an undiagnosed common condition, qualify for a proven intervention, or have fallen out of care before completing treatment.[3]
"We know how to control blood pressure. This is not rocket science," Dr. Chokshi noted. By using AI to surface the patients most likely to be missed, health systems can connect them sooner to care that is already known to work, fundamentally closing the gap between medical knowledge and actual care delivery.[3]

This population-level approach is already being operationalized on a national scale. In June 2026, Finland launched the FINe-Health Foundry, a project designed to build the world’s first nationwide healthcare foundation model. Backed by millions in funding, this "Swiss Army knife" AI model will integrate multimodal health data—from medical images to genomic profiles—for a large portion of the Finnish population.
This population-level approach is already being operationalized on a national scale.
The Finnish foundation model aims to predict disease risk for over 200 conditions for every living person in the country. By running AI agents within virtual laboratories, the system will provide doctors with real-time clinical decision support and allow policymakers to simulate the population-level impact of different health interventions before they are rolled out.
While population models track disease at a macro level, other AI breakthroughs are mapping biology at its most fundamental scale. Scientists at the Icahn School of Medicine at Mount Sinai recently introduced a Gene Set Foundation Model (GSFM). Unlike previous models that rely primarily on gene expression data, the GSFM is designed to learn patterns in how genes are grouped and function together across thousands of biological contexts.[4]

The Mount Sinai researchers compiled millions of gene sets from published scientific studies, training the AI much like a puzzle. By giving the model part of a gene set and asking it to predict the missing pieces, the system learned the underlying patterns of genetic interaction. The result is a new, unified map of how genes work together in different diseases, offering a powerful tool to uncover new biological insights from existing data.[4]
These foundational biological maps are radically accelerating the pace of pharmaceutical innovation. At the BIO 2026 International Convention, Insilico Medicine and SK Biopharmaceuticals announced a major collaboration to discover AI-enabled drug candidates for central nervous system disorders. By leveraging generative AI across target validation, chemistry, and molecule optimization, the partnership aims to design next-generation therapies for neuroimmune conditions.
The impact of AI on drug discovery timelines is already measurable. Traditional early-stage drug discovery typically takes up to four years to identify a viable molecule. Using its advanced AI and automation platform, Insilico has consistently reached the preclinical candidate nomination stage in an average of just 12 to 18 months, synthesizing and testing a fraction of the molecules usually required.

Across the healthcare spectrum—from the emergency room to the genetics lab and the pharmaceutical pipeline—artificial intelligence is proving its capacity to handle the sheer volume and complexity of modern medical data. The technology is no longer a future concept; it is actively reshaping how diseases are diagnosed, how drugs are discovered, and how patient care is delivered.[1][4]
The consensus among medical researchers and technologists is not that artificial intelligence will replace human doctors. Instead, the emerging paradigm is one of profound augmentation. By serving as an always-on, highly accurate clinical collaborator, AI promises to reduce diagnostic errors, accelerate life-saving research, and ensure that fewer patients fall through the cracks of an increasingly complex healthcare system.[2][3]
How we got here
Dec 2025
Researchers develop AI models capable of diagnosing complex heart conditions from simple 10-second EKG strips.
May 2026
Science publishes a landmark study showing OpenAI's o1 model outperforming hundreds of physicians on clinical reasoning benchmarks.
May 2026
Mount Sinai introduces the Gene Set Foundation Model to map genetic interactions across thousands of biological contexts.
June 2026
Finland launches the FINe-Health Foundry to build a nationwide AI model predicting disease risk for its entire population.
June 2026
Insilico Medicine and SK Biopharmaceuticals announce a major partnership at BIO 2026 to use generative AI for central nervous system drug discovery.
Viewpoints in depth
Clinical Researchers
Argue that AI has definitively crossed the threshold of clinical reasoning and should be integrated as a standard second opinion.
Researchers who conducted the recent benchmark studies argue that the data is now unequivocal: advanced large language models possess a level of clinical reasoning that matches or exceeds human specialists. By consistently outperforming physicians on complex diagnostic vignettes and real-world emergency room scenarios, these systems have proven their potential utility. Proponents in this camp emphasize that integrating AI as an always-available second opinion could drastically reduce diagnostic errors, catch rare conditions that a busy clinician might overlook, and ultimately save lives.
Public Health Advocates
Emphasize that AI's greatest immediate value lies in "case finding" and population health.
Public health officials and epidemiologists view the AI breakthrough through a different lens. Rather than focusing on the technology's ability to solve rare medical mysteries, they highlight its capacity to scan vast databases of electronic health records to identify patients who have fallen out of care. By surfacing individuals with undiagnosed common conditions—such as hypertension or early-stage diabetes—AI can ensure that proven, existing treatments reach the people who need them most, effectively closing the gap between medical knowledge and actual care delivery.
Biotech Innovators
Focus on the upstream applications of foundation models in mapping biology and accelerating drug discovery.
For the biotechnology sector, the true revolution is happening at the cellular level. Innovators point to the development of Gene Set Foundation Models and generative AI platforms that are mapping genetic interactions and designing novel molecules in a fraction of the traditional time. By cutting the preclinical drug discovery phase from four years down to 12 to 18 months, these AI systems are fundamentally altering the economics of pharmaceutical development, making it feasible to pursue treatments for a wider array of diseases with unprecedented speed.
What we don't know
- How these text-based AI models will perform when directly integrating raw, multimodal clinical data like live audio auscultation and visual patient cues.
- The long-term legal and regulatory frameworks for liability when an AI system provides a diagnostic second opinion that contradicts a human physician.
- Whether the rapid deployment of AI in healthcare will exacerbate existing disparities if advanced tools are initially concentrated in well-funded academic medical centers.
Key terms
- Large Language Model (LLM)
- A type of artificial intelligence trained on vast amounts of text data, capable of understanding and generating human-like language and reasoning.
- Clinical Reasoning
- The cognitive process by which healthcare professionals gather patient information, synthesize it, and make diagnostic and treatment decisions.
- Foundation Model
- A large-scale AI model trained on a broad quantity of unlabeled data that can be adapted to a wide range of downstream tasks, such as predicting disease or mapping genes.
- Case Finding
- A public health strategy that involves actively searching for individuals with a specific disease or condition who are not currently receiving care.
- Preclinical Candidate (PCC)
- A newly discovered drug molecule that has shown enough promise in laboratory testing to advance to human clinical trials.
Frequently asked
Will AI replace human doctors?
No. Researchers emphasize that AI is designed to serve as a highly capable clinical second opinion, augmenting a physician's judgment rather than replacing the human elements of physical examination and patient empathy.
How did the AI perform in real emergency rooms?
In a blinded study of real emergency room cases, the AI model identified the correct diagnosis 72.4% of the time, outperforming two expert physicians who scored 61.8% and 52.6%.
What is a Gene Set Foundation Model?
It is an AI system developed by Mount Sinai that learns how genes group and function together across different biological contexts, acting like a map to uncover new insights into biology and disease.
How is AI changing drug discovery?
AI is drastically accelerating the timeline. Companies using generative AI can now identify viable preclinical drug candidates in 12 to 18 months, a process that traditionally took up to four years.
Sources
[1]News-MedicalClinical Researchers
AI model outperforms doctors in clinical reasoning tests
Read on News-Medical →[2]The BMJClinical Researchers
Artificial intelligence is better than humans at emergency triage diagnoses, a study has suggested
Read on The BMJ →[3]New York Academy of SciencesPublic Health Advocates
Healthcare's Real AI Breakthrough May Be Getting Proven Care to More Patients
Read on New York Academy of Sciences →[4]Mount SinaiBiotech Innovators
Scientists Create New AI Model to Reveal How Genes Function Together
Read on Mount Sinai →
More in ai
See all 6 stories →AI Workforce
AI Adoption Accelerates Job Losses in Tech and Finance to 28,000 Per Month
7 sources
AI Regulation
How 42 State Attorneys General Are Using Consumer Law to Regulate OpenAI
6 sources
Silicon Sovereignty
$1 Trillion AI Chip Selloff Follows Wave of Custom Silicon Shipments, Reshaping Compute Market
7 sources
Macroeconomics
Federal Reserve Raises US Growth Forecast, Citing Surging AI Infrastructure Investment
4 sources
Every angle. Every day.
Get ai stories with full source coverage and perspective breakdowns delivered to your inbox.








