Anthropic Embeds Independent METR Evaluators With Internal Access to Inspect Frontier AI Models
Anthropic has granted six researchers from the non-profit Model Evaluation and Threat Research group direct, employee-level access to its internal AI infrastructure. The arrangement bypasses standard API restrictions, allowing third-party auditors to test unreleased models for autonomous capabilities and cyber threats before safety filters are applied.
Share this story
On October 15, 2026, Anthropic granted six researchers from the non-profit Model Evaluation and Threat Research (METR) direct, employee-level access to its internal AI systems. The arrangement bypasses the restricted programming interfaces that typically constrain outside auditors.[2][3]
The San Francisco-based company announced the integration as a structural shift in how frontier models undergo safety testing. Rather than probing a finished product from the outside, the embedded team will monitor the neural networks as they are being built.[3][4]
"We are giving independent evaluators the same internal tools our own researchers use to understand model behavior," Anthropic stated in its Thursday release.[3]
Bypassing the API barrier
Historically, third-party AI safety testing has operated through a glass wall. Auditors submit prompts through an application programming interface, waiting to see how the model responds after its safety filters have already been applied.[5][6]
That black-box approach prevents researchers from understanding how a model reaches its conclusions or whether it possesses latent capabilities that the filters merely mask. METR’s new access level removes that barrier entirely.[1][5]
The six embedded evaluators can now inspect the raw, unfiltered neural networks before any safety guardrails are attached. They will operate across three distinct access tiers, scaling up to full visibility of the training infrastructure.[6]
The highest tier grants the non-profit team the ability to run custom code directly on Anthropic’s computing clusters. This allows them to test whether an unreleased model could autonomously replicate itself or execute complex cyberattacks.[2][9]
"This is a transition from external red-teaming to internal auditing," the Financial Times reported, noting the unprecedented nature of granting a third party "employee-like" privileges.[1]
The limits of embedded access
Despite the transparency framing, the arrangement remains fundamentally controlled by the host company. Anthropic dictates which six researchers receive the clearance and maintains ultimate authority over the hardware they use.[5][7]
The evaluators are bound by strict non-disclosure agreements regarding Anthropic’s proprietary training data and algorithmic architecture. They can report safety vulnerabilities, but they cannot publish the underlying trade secrets that make the models competitive.[5][8]
This tension highlights the ongoing debate over corporate AI governance. While embedding METR provides a deeper level of scrutiny than standard public releases, it still relies on a private company voluntarily opening its doors.[2][10]
If the evaluators discover a critical threat, Anthropic has committed to pausing deployment until the issue is resolved. However, the exact threshold for what constitutes a deployment-halting danger remains loosely defined in the public announcement.[3][7]
Setting an industry baseline
The METR partnership arrives as regulators in the United States and Europe demand more rigorous oversight of artificial intelligence. By voluntarily embedding auditors, Anthropic is attempting to set a standard that its rivals may be forced to match.[1][8]
Competitors like OpenAI and Google DeepMind currently utilize external red-teaming, but they have not granted independent organizations unfettered internal access to their pre-release systems.[2]
The pressure is now on those competitors to explain why their safety testing remains external. If METR’s embedded team successfully identifies flaws that API-based testing missed, the employee-level access model could become a regulatory requirement.[1][10]
The first major test of this system will come during the development of Anthropic’s next major model generation, expected to require hundreds of millions of dollars in computing power.[3][9]
The embedded researchers will monitor that training run in real time, looking for sudden jumps in autonomous reasoning or deception capabilities. Their findings will dictate whether the model ever reaches the public.[4][6]
For now, the AI industry is watching to see how much friction this deep integration creates. The true measure of the program will not be the access granted today, but what happens when METR and Anthropic inevitably disagree on a model's safety.[2][7]
The integration also tests the operational capacity of non-profit safety organizations. METR, originally founded to assess existential risks from advanced systems, must now prove it can handle the logistical burden of continuous, deep-level auditing.[2][5]
Key points
- Anthropic has granted six researchers from the non-profit METR direct, employee-level access to its internal AI systems.
- The arrangement bypasses standard API restrictions, allowing evaluators to inspect raw neural networks before safety filters are applied.
- Researchers will operate across three access tiers, up to running custom code directly on Anthropic's computing clusters.
- The evaluators are bound by non-disclosure agreements to protect Anthropic's proprietary training data and trade secrets.
Unanswered questions
- What specific threshold of danger would compel Anthropic to permanently halt a model's deployment rather than just delaying it.
- Whether competitors like OpenAI and Google DeepMind will match this level of internal access for third-party evaluators.
- How METR will balance its independence while working closely alongside Anthropic's engineering teams on a daily basis.
How we got here
Mid-2025
AI safety organizations increasingly criticize API-based red-teaming as insufficient for detecting latent model capabilities.
Early 2026
Regulators in the US and EU begin demanding more rigorous, independent oversight of frontier AI development.
Oct 15, 2026
Anthropic grants six METR researchers employee-level access to its internal computing clusters and unreleased models.
- AI Safety Watchdogs
- Argue that true model evaluation requires unfiltered access to raw neural networks before corporate guardrails are applied.
- Frontier AI Developers
- Maintain that deep internal access must be carefully managed to protect proprietary training data and commercial trade secrets.
- Open-Source Advocates
- View embedded auditing as an improvement over API testing, but argue it still leaves safety verification in the hands of a select few under strict NDAs.
Perspectives this story doesn't cover
- Government Regulators
- Independent Cybersecurity Researchers
Sources
[1]Financial TimesFrontier AI DevelopersAnthropic grants non-profit METR 'employee-like' access to monitor AI risks
Read on Financial Times →
[2]Business InsiderAI Safety WatchdogsAnthropic just opened its doors to outside safety watchdogs. Here's how it will work.
Read on Business Insider →
[3]AnthropicFrontier AI DevelopersAn update on independent evaluators
Read on Anthropic →
[4]AI WeeklyOpen-Source AdvocatesAnthropic Embeds Six METR Evaluators With Internal-Tools Access
Read on AI Weekly →
[5]OpenToolsAI Safety WatchdogsAnthropic gives six METR evaluators employee-like access — here are the limits
Read on OpenTools →
[6]ExplainXOpen-Source AdvocatesAnthropic Gives METR Employee-Like Access: Six Staff, Three Evaluator Tiers
Read on ExplainX →
[7]KonsulteerOpen-Source AdvocatesAnthropic Opens Internal AI Safety Processes to Independent Researchers
Read on Konsulteer →
[8]TradingViewFrontier AI DevelopersAnthropic grants AI evaluator METR employee-level access to its models
Read on TradingView →
[9]Crypto BriefingAI Safety WatchdogsAnthropic grants METR access to AI models for safety and transparency push
Read on Crypto Briefing →
[10]Investing.comFrontier AI DevelopersAnthropic grants AI evaluator METR employee-level access to its models
Read on Investing.com →
More in Technology
See all →AI Alignment
The Alignment Trade-off: Why AI Labs Are Replacing Human Feedback with AI Judges
7 sources
Transformer Architecture
Why Transformer Decoders Cannot Separate Commands From Untrusted Text
2 sources
AI Safety Policy
US Restores UK AI Security Institute Access to Pre-Release Frontier Models Following Freeze
4 sources
AI Regulation
The EU AI Act's Horizontal Risk Tiers Diverge Sharply From China's Vertical Content Controls
6 sources
Comments
Every angle. Every day.
Get Technology stories with full source coverage and perspective breakdowns, free every day.




