Frontier Lab Transparency: Anthropic Discloses Automation, Agent Oversight, And Safety Compute Metrics
AI research company Anthropic released a set of internal measurements intended to give the public, regulators, and third-party observers clearer visibility into how quickly frontier AI development is proceeding — including how much of the work of building new models is now being performed by AI itself.
The centerpiece of the release is the Anthropic R&D Automation Index, a prototype metric that catalogues every kind of AI research and development task at the company and rates each on an automation scale developed by Epoch AI. The scale runs from AL0, meaning no AI involvement, to AL5, meaning fully autonomous operation with no human in the loop. AL3 denotes tasks where AI collaborates under close human direction, while AL4 covers tasks AI completes end-to-end from a high-level prompt with human supervision.
As of August 2026, Claude is not operating fully autonomously in any measured area of AI R&D. However, AI leads approximately 26% of Anthropic’s R&D work, and more than 90% of tasks are at or above the level where AI collaborates with humans. Anthropic frames these figures as a way to track how close the industry is to recursive self-improvement — a scenario in which a model autonomously builds its own successor — and notes that the numbers would likely shift under any coordinated effort to slow frontier development.
The company pairs this with data on the oversight of AI agents. Roughly 30,000 agents were conducting research and engineering work on Anthropic’s most-used internal platform, and every one of their actions passes through real-time online monitors before execution, as well as offline monitors that review activity afterward. Over more than a billion agent decisions analyzed during August, about 0.002% — roughly one in 47,000 — were blocked. Offline monitors flag one to two transcripts per thousand, with around 100,000 flagged weekly and only about 50 escalated to human review.
Compute Allocation Emerges as a Verifiable Pacing Lever
The third measurement addresses compute, one of the most verifiable inputs to AI development and therefore a potential lever for any future industry-wide pacing regime. In a one-week snapshot of Anthropic’s total compute usage, approximately 6% of compute devoted to AI R&D went to safety work; within AI-driven R&D specifically, the figure was about 12%. The company describes these as deliberately conservative estimates, noting that compute is an imperfect proxy for safety investment since much safety research is design-intensive rather than compute-intensive.
Anthropic positions the release as complementary to its Responsible Scaling Policy risk reports and its Advanced AI Framework policy proposal, which outlines transparency obligations that governments could impose on labs. The company also announced plans to embed independent third-party evaluators from multiple organizations inside Anthropic, granting them access to internal systems and data comparable to what its own risk assessment teams receive.
Cross-lab comparison remains a challenge. Anthropic acknowledges there is no shared methodology for automation measurement, and that using its own models to evaluate its systems creates potential blind spots. It suggests third-party verification or evaluation by other developers’ models, with safeguards for competitively sensitive information, as a path toward standardized reporting that governments and the public could rely on.
Disclaimer
In line with the Trust Project guidelines, please note that the information provided on this page is not intended to be and should not be interpreted as legal, tax, investment, financial, or any other form of advice. It is important to only invest what you can afford to lose and to seek independent financial advice if you have any doubts. For further information, we suggest referring to the terms and conditions as well as the help and support pages provided by the issuer or advertiser. MetaversePost is committed to accurate, unbiased reporting, but market conditions are subject to change without notice.
About The Author
Alisa, a dedicated journalist at the MPost, specializes in crypto, AI, investments, and the expansive realm of Web3. With a keen eye for emerging trends and technologies, she delivers comprehensive coverage to inform and engage readers in the ever-evolving landscape of digital finance.
More articles
Alisa, a dedicated journalist at the MPost, specializes in crypto, AI, investments, and the expansive realm of Web3. With a keen eye for emerging trends and technologies, she delivers comprehensive coverage to inform and engage readers in the ever-evolving landscape of digital finance.
