Skip to main content
ExplainerDiagnostic AccuracyExplainer· 5 min read· in Science

The Four Metrics That Determine the Accuracy of Every Medical Test

Sensitivity and specificity measure how well a diagnostic test performs in a lab, but predictive values reveal the true probability that a patient actually has the disease.

By Harper Lane

Clinical Diagnosticians 40%Public Health Screeners 40%Test Manufacturers 20%
Clinical Diagnosticians
Clinicians argue that predictive values are the most critical metrics because they answer whether a specific patient actually has the disease.
Public Health Screeners
Public health officials prioritize high sensitivity in mass screening to ensure no infectious or severe cases are missed.
Test Manufacturers
Diagnostic companies focus on intrinsic sensitivity and specificity to prove their tests work reliably under controlled regulatory conditions.

Perspectives this story doesn't cover

  • Patients who have experienced the psychological trauma of a false positive diagnosis
  • Health insurance actuaries who model the financial cost of sequential testing

Key points

  • Diagnostic test accuracy is evaluated using sensitivity, specificity, positive predictive value (PPV), and negative predictive value (NPV).
  • Sensitivity and specificity are intrinsic to the test, measuring its ability to correctly identify sick and healthy individuals.
  • PPV and NPV are highly dependent on the prevalence of the disease in the tested population.
  • Mass screening for rare diseases often yields a high number of false positives, even with highly specific tests.
  • Clinicians use sequential testing—a sensitive test followed by a specific one—to balance the trade-offs between missing cases and overdiagnosis.
100%
Sensitivity of hypothetical perfect test
95%
Specificity of hypothetical perfect test
16.8%
PPV in a 1% prevalence population

Imagine a medical test that catches every single case of a disease—a perfect 100% detection rate—and correctly clears healthy people 95% of the time. If you test positive, you might assume the diagnosis is nearly certain. But if the disease affects only 1 in 100 people, that positive result actually means you have less than a 17% chance of being sick.[2]

This counterintuitive reality is governed by four foundational metrics of diagnostic accuracy: the true positive rate (sensitivity), the true negative rate (specificity), and their real-world counterparts, the positive and negative predictive values (PPV and NPV). Understanding how these numbers interact is the difference between a life-saving early diagnosis and a cascade of unnecessary medical interventions.[1]

At the core of all diagnostic testing is a simple two-by-two matrix known as a contingency table. Every test result falls into one of four buckets: true positives (sick people correctly identified), true negatives (healthy people correctly cleared), false positives (healthy people incorrectly flagged), and false negatives (sick people incorrectly cleared).[3][5]

The 2x2 contingency table forms the foundation of all diagnostic test accuracy metrics.

From this matrix, scientists derive sensitivity. Sensitivity measures the proportion of actual positives that are correctly identified. In a 2022 factsheet, the Johns Hopkins Center for Health Security explains, "A test's sensitivity is its ability to correctly identify those with the disease (the true positives) while minimizing the number of false negative results." A test with 99% sensitivity will find 99 out of 100 sick people, missing only one.[3][6]

Specificity, on the other hand, measures the proportion of actual negatives that are correctly identified. A test with 95% specificity will correctly clear 95 out of 100 healthy people, but it will falsely flag five of them as sick.[2][6]

Medical students are often taught the mnemonics "SnNout" and "SpPin" to remember how to apply these concepts. A highly Sensitive test, when Negative, rules OUT the disease. A highly Specific test, when Positive, rules IN the disease.

However, sensitivity and specificity share a critical limitation: they look backward from a known state of disease. They answer the question, "If a patient is sick, what is the chance the test will show it?" But in a real-world clinic, the doctor and patient do not know if the disease is present—that is precisely why they are running the test.[1][4]

The patient wants to know the opposite: "Given that my test is positive, what is the chance that I am actually sick?" This is the Positive Predictive Value (PPV).[2]

Conversely, the Negative Predictive Value (NPV) answers the mirror question: "Given that my test is negative, what is the chance that I am truly healthy?"[2]

Conversely, the Negative Predictive Value (NPV) answers the mirror question: "Given that my test is negative, what is the chance that I am truly healthy?"

While sensitivity and specificity are intrinsic properties of the test itself, PPV and NPV are highly dependent on the prevalence of the disease in the population being tested. This mathematical relationship, rooted in Bayes' Theorem, dictates that as a disease becomes rarer, the PPV plummets.[4][5]

To see why, consider a population of 10,000 people where a disease has a 1% prevalence. Exactly 100 people are sick, and 9,900 are healthy. If we apply our hypothetical test with 100% sensitivity and 95% specificity, it will correctly identify all 100 sick people.[2]

But what happens to the 9,900 healthy people? The 95% specificity means the test correctly clears 9,405 of them. However, it falsely flags 5% of them—which equals 495 false positives.[2]

The total number of positive results is 595 (100 true positives plus 495 false positives). Therefore, the PPV is 100 divided by 595, or just 16.8%. More than five out of six people who test positive do not actually have the disease.[2]

As a disease becomes more common in a population, the reliability of a positive test result increases dramatically.

This mathematical reality explains why mass screening programs for rare diseases are so controversial. "Sensitivity and specificity are inversely related, wherein one increases as the other decreases, but are generally considered stable for a given test, whereas positive and negative predictive values do inherently vary with pre-test probability," researchers noted in a 2021 review published in the Journal of Investigative Medicine.[2]

If the same test is used in a high-risk clinic where the prevalence of the disease is 50%, the math shifts dramatically. Out of 10,000 people, 5,000 are sick and 5,000 are healthy. The test finds all 5,000 sick people (100% sensitivity) and falsely flags 250 of the healthy people (5% of 5,000).[5]

Now, the total number of positive results is 5,250. The PPV is 5,000 divided by 5,250, or 95.2%. The exact same physical test, run on the exact same machine, is nearly six times more reliable simply because the patient walked through the door of a specialist clinic rather than a general screening center.[4][5]

Because sensitivity and specificity are inversely related, test manufacturers must choose where to set the threshold for a positive result. Lowering the threshold catches more sick people (increasing sensitivity) but also flags more healthy people (decreasing specificity).[1][5]

For severe, highly contagious diseases like COVID-19 or HIV, public health officials often prioritize sensitivity. A false negative means an infected person goes back into the community and spreads the virus. The cost of a false positive—a few days of unnecessary quarantine—is considered acceptable.[3]

Conversely, for diseases where the treatment is highly toxic or invasive, such as certain cancers, specificity becomes paramount. A false positive could lead to unnecessary chemotherapy or surgery, causing profound harm to a healthy person.[1][5]

To navigate this trade-off, modern medicine frequently relies on sequential testing. A patient is first given a highly sensitive, inexpensive screening test. If that result is positive, they are given a highly specific, often more expensive confirmatory test.

This two-step process leverages the strengths of both metrics. The sensitive test ensures few cases are missed, while the specific test weeds out the false positives before any drastic medical interventions are ordered.[1]

Ultimately, no diagnostic test provides absolute certainty. A test result is not a final answer; it is simply a mathematical update to the pre-test probability. Understanding the true positive rate, true negative rate, and predictive values empowers both clinicians and patients to interpret those updates accurately and make evidence-based decisions about what comes next.[4]

What we don’t know

  • How the widespread availability of at-home testing will impact public anxiety regarding false positives.
  • The optimal mathematical threshold for balancing sensitivity and specificity in emerging AI-driven diagnostic algorithms.
  • How to effectively communicate the counterintuitive concept of predictive values to patients receiving unexpected test results.

Sources

Source coverage

7 outlets

3 viewpoints surfaced

Clinical Diagnosticians 40%Public Health Screeners 40%Test Manufacturers 20%
  1. [1]Acta PaediatricaPublic Health Screeners

    Understanding diagnostic tests 1: sensitivity, specificity and predictive values

    Read on Acta Paediatrica →
  2. [2]J Investig MedClinical Diagnosticians

    Foundational Statistical Principles in Medical Research: Sensitivity, Specificity, Positive Predictive Value, and Negative Predictive Value

    Read on J Investig Med →
  3. [3]Johns Hopkins Center for Health SecurityPublic Health Screeners

    Factsheet: Understanding the Accuracy of Diagnostic and Serology Tests: Sensitivity and Specificity

    Read on Johns Hopkins Center for Health Security →
  4. [4]Acta PaediatricaPublic Health Screeners

    Understanding diagnostic tests 2: likelihood ratios, pre- and post-test probabilities and their use in clinical practice

    Read on Acta Paediatrica →
  5. [5]J Lab PhysiciansClinical Diagnosticians

    How to Analyze the Diagnostic Performance of a New Test? Explained with Illustrations

    Read on J Lab Physicians →
  6. [6]Wikipedia

    Sensitivity and specificity

    Read on Wikipedia →
  7. [7]Factlen Editorial Team

    Synthesis by Factlen editorial team

    Read on Factlen Editorial Team →

Comments

Stay informed

Every angle. Every day.

Get Science stories with full source coverage and perspective breakdowns delivered to your inbox.