Skip to main content
AI AuditingAnthropic· 4 min read· in Technology

Anthropic Embeds Independent METR Evaluators With Internal Access to Inspect Frontier AI Models

Anthropic has granted six researchers from the non-profit Model Evaluation and Threat Research group direct, employee-level access to its internal AI infrastructure. The arrangement bypasses standard API restrictions, allowing third-party auditors to test unreleased models for autonomous capabilities and cyber threats before safety filters are applied.

By Diego Navarro

Share this story

On October 15, 2026, Anthropic granted six researchers from the non-profit Model Evaluation and Threat Research (METR) direct, employee-level access to its internal AI systems. The arrangement bypasses the restricted programming interfaces that typically constrain outside auditors.[2][3]

The San Francisco-based company announced the integration as a structural shift in how frontier models undergo safety testing. Rather than probing a finished product from the outside, the embedded team will monitor the neural networks as they are being built.[3][4]

"We are giving independent evaluators the same internal tools our own researchers use to understand model behavior," Anthropic stated in its Thursday release.[3]

Bypassing the API barrier

Historically, third-party AI safety testing has operated through a glass wall. Auditors submit prompts through an application programming interface, waiting to see how the model responds after its safety filters have already been applied.[5][6]

That black-box approach prevents researchers from understanding how a model reaches its conclusions or whether it possesses latent capabilities that the filters merely mask. METR’s new access level removes that barrier entirely.[1][5]

Embedded evaluators bypass the API layer to inspect raw neural networks before safety filters are applied.

The six embedded evaluators can now inspect the raw, unfiltered neural networks before any safety guardrails are attached. They will operate across three distinct access tiers, scaling up to full visibility of the training infrastructure.[6]

The highest tier grants the non-profit team the ability to run custom code directly on Anthropic’s computing clusters. This allows them to test whether an unreleased model could autonomously replicate itself or execute complex cyberattacks.[2][9]

"This is a transition from external red-teaming to internal auditing," the Financial Times reported, noting the unprecedented nature of granting a third party "employee-like" privileges.[1]

The limits of embedded access

Despite the transparency framing, the arrangement remains fundamentally controlled by the host company. Anthropic dictates which six researchers receive the clearance and maintains ultimate authority over the hardware they use.[5][7]

The evaluators are bound by strict non-disclosure agreements regarding Anthropic’s proprietary training data and algorithmic architecture. They can report safety vulnerabilities, but they cannot publish the underlying trade secrets that make the models competitive.[5][8]

This tension highlights the ongoing debate over corporate AI governance. While embedding METR provides a deeper level of scrutiny than standard public releases, it still relies on a private company voluntarily opening its doors.[2][10]

The three tiers of internal access granted to METR researchers.

If the evaluators discover a critical threat, Anthropic has committed to pausing deployment until the issue is resolved. However, the exact threshold for what constitutes a deployment-halting danger remains loosely defined in the public announcement.[3][7]

Setting an industry baseline

The METR partnership arrives as regulators in the United States and Europe demand more rigorous oversight of artificial intelligence. By voluntarily embedding auditors, Anthropic is attempting to set a standard that its rivals may be forced to match.[1][8]

Competitors like OpenAI and Google DeepMind currently utilize external red-teaming, but they have not granted independent organizations unfettered internal access to their pre-release systems.[2]

The pressure is now on those competitors to explain why their safety testing remains external. If METR’s embedded team successfully identifies flaws that API-based testing missed, the employee-level access model could become a regulatory requirement.[1][10]

The first major test of this system will come during the development of Anthropic’s next major model generation, expected to require hundreds of millions of dollars in computing power.[3][9]

Illustration: The arrangement grants third-party auditors the same internal tools used by Anthropic's own engineers.

The embedded researchers will monitor that training run in real time, looking for sudden jumps in autonomous reasoning or deception capabilities. Their findings will dictate whether the model ever reaches the public.[4][6]

For now, the AI industry is watching to see how much friction this deep integration creates. The true measure of the program will not be the access granted today, but what happens when METR and Anthropic inevitably disagree on a model's safety.[2][7]

The integration also tests the operational capacity of non-profit safety organizations. METR, originally founded to assess existential risks from advanced systems, must now prove it can handle the logistical burden of continuous, deep-level auditing.[2][5]

Operating inside a frontier lab requires specialized engineering talent capable of navigating bespoke infrastructure. The six researchers will need to parse massive volumes of diagnostic data without slowing down Anthropic’s commercial development cycle.[6][8]

The true measure of this transparency initiative depends entirely on the independence of the evaluators. If they can maintain their critical distance while working inside the corporate firewall, the industry will have its first working blueprint for verifiable AI safety.[1][3]

Key points

  • Anthropic has granted six researchers from the non-profit METR direct, employee-level access to its internal AI systems.
  • The arrangement bypasses standard API restrictions, allowing evaluators to inspect raw neural networks before safety filters are applied.
  • Researchers will operate across three access tiers, up to running custom code directly on Anthropic's computing clusters.
  • The evaluators are bound by non-disclosure agreements to protect Anthropic's proprietary training data and trade secrets.

Unanswered questions

  • What specific threshold of danger would compel Anthropic to permanently halt a model's deployment rather than just delaying it.
  • Whether competitors like OpenAI and Google DeepMind will match this level of internal access for third-party evaluators.
  • How METR will balance its independence while working closely alongside Anthropic's engineering teams on a daily basis.

How we got here

  1. Mid-2025

    AI safety organizations increasingly criticize API-based red-teaming as insufficient for detecting latent model capabilities.

  2. Early 2026

    Regulators in the US and EU begin demanding more rigorous, independent oversight of frontier AI development.

  3. Oct 15, 2026

    Anthropic grants six METR researchers employee-level access to its internal computing clusters and unreleased models.

AI Safety Watchdogs 40%Frontier AI Developers 40%Open-Source Advocates 20%
AI Safety Watchdogs
Argue that true model evaluation requires unfiltered access to raw neural networks before corporate guardrails are applied.
Frontier AI Developers
Maintain that deep internal access must be carefully managed to protect proprietary training data and commercial trade secrets.
Open-Source Advocates
View embedded auditing as an improvement over API testing, but argue it still leaves safety verification in the hands of a select few under strict NDAs.

Perspectives this story doesn't cover

  • Government Regulators
  • Independent Cybersecurity Researchers

Sources

Source coverage

10 outlets

3 viewpoints surfaced

AI Safety Watchdogs 40%Frontier AI Developers 40%Open-Source Advocates 20%
  1. [1]Financial TimesFrontier AI Developers

    Anthropic grants non-profit METR 'employee-like' access to monitor AI risks

    Read on Financial Times →
  2. [2]Business InsiderAI Safety Watchdogs

    Anthropic just opened its doors to outside safety watchdogs. Here's how it will work.

    Read on Business Insider →
  3. [3]AnthropicFrontier AI Developers

    An update on independent evaluators

    Read on Anthropic →
  4. [4]AI WeeklyOpen-Source Advocates

    Anthropic Embeds Six METR Evaluators With Internal-Tools Access

    Read on AI Weekly →
  5. [5]OpenToolsAI Safety Watchdogs

    Anthropic gives six METR evaluators employee-like access — here are the limits

    Read on OpenTools →
  6. [6]ExplainXOpen-Source Advocates

    Anthropic Gives METR Employee-Like Access: Six Staff, Three Evaluator Tiers

    Read on ExplainX →
  7. [7]KonsulteerOpen-Source Advocates

    Anthropic Opens Internal AI Safety Processes to Independent Researchers

    Read on Konsulteer →
  8. [8]TradingViewFrontier AI Developers

    Anthropic grants AI evaluator METR employee-level access to its models

    Read on TradingView →
  9. [9]Crypto BriefingAI Safety Watchdogs

    Anthropic grants METR access to AI models for safety and transparency push

    Read on Crypto Briefing →
  10. [10]Investing.comFrontier AI Developers

    Anthropic grants AI evaluator METR employee-level access to its models

    Read on Investing.com →

Comments

Stay informed

Every angle. Every day.

Get Technology stories with full source coverage and perspective breakdowns, free every day.