Tuesday, 17 Nov 2026 Breaking: FMSCI National Rally Championship: Rajendra leads Petronas TVS Racing sweep at Hampi
BREAKING: Apple launches AI platform | Tesla earnings beat estimates | Nvidia stock surges | Bitcoin crosses major resistance
Business

Anthropic flags AI systems' 'self-improvement'; bats for greater transparency in development of models

Anthropic flags AI systems' 'self-improvement'; bats for greater transparency in development of models

California [US], September 18 (ANI): AI frontier lab Anthropic has pitched for greater transparency in the development of AI models. In a blog post the company said that AI systems are becoming exponentially more powerful and have begun to automate more of the process of building themselves, and as the world considers slowing the pace of frontier AI development, the public needs more information.
The post then lists out measurement tools on critical aspects of AI development. These include, the extent to which AI is building the next version of itself as opposed to being built by humans, ability to oversee and intervene in actions that AI agents take on Anthropic’s systems and resources that power the development of more capable models.
Anthropic further said that it had laid out a framework for rules on how a frontier lab could ensure the release of safe models and transparency. 
"In our policy proposal on advanced AI, the Advanced AI Framework (AAIF), we propose rules of the road for how any lab releases safe models, including transparency obligations that governments could require, such as risk reports. Together, these proposed measurements and policies are a starting point for monitoring the pace of AI development from outside the labs," the company said. 
Anthropic cautioned that models accelerating on their own could pose a challenge for humans to control such systems and thus metrics on 'self-improvement' of such models was required. 
"Frontier AI labs increasingly use AI to build future AI models. This process allows labs in democratic countries to develop more capable models more quickly and conduct more safety and testing on models before they are released to secure AI’s benefits while staying on the frontier. However, models accelerating their own development could make it more challenging for humans to understand or control these systems. It is therefore important to share these metrics to understand how close the world is to reaching recursive self-improvement (a model fully autonomously building its successor)," it said. 
After CEO Dario Amodei's call for slowing the pace of AI development down the company has batted for better measurement of that development. 
"As the world considers pacing the frontier, we should do everything possible to minimize the gap between what frontier labs know and what the public knows. This means better measuring the development of AI, reporting on it publicly, and giving society an opportunity to decide how to use this information. We hope to model that transparency by releasing these measurements, and we’ll continue to do so," the company said.
Earlier, speaking to CBS News Sunday Morning Amodei had cautioned that the exponential growth of AI was a warning sign that frontier labs need to slow down.
"I don't think I fully just appreciated what it would actually be like when the progress was as fast as it was...It doesn't mean we need to panic today. It doesn't mean we need to shut it all down," Amodei said.
Amodei further said that the technology needs safeguards that can keep up "with the pace at which the technology is happening." (ANI)

Tags

Related News

"India is the most interesting market": Italian industry leaders seek joint ventures and MRO expansion after talks with Piyush Goyal
Business
"India is the most interesting market": Italian industry leaders seek joint ventures and MRO expansion after talks with Piyush Goyal

<p>Rome [Italy], November 17 (ANI): Leading Italian companies across aviation maintenance, medical imaging, construction...

Jensen Huang signals willingness to return as Nvidia CEO: Report
Business
Jensen Huang signals willingness to return as Nvidia CEO: Report

<p>Santa Clara (California) [US], November 17 (ANI): Wall Street Journal on Tuesday reported that embattled former Nvidi...

China threatens countermeasures against US restrictions on advanced semiconductor access
Business
China threatens countermeasures against US restrictions on advanced semiconductor access

<p>Beijing [China], November 17 (ANI): China on Tuesday strongly opposed the United States' latest restrictions on remot...

"American people need answers": House Committee Chairmen welcome Jensen Huang's acceptance to testify
Business
"American people need answers": House Committee Chairmen welcome Jensen Huang's acceptance to testify

<p>Washington DC [US], November 17 (ANI): Chairmen Mast, Moolenaar, and Crawford released a statement after Jensen Huang...

Israel to launch 'Landing Pad' programme to help its companies find Indian partners: Ambassador Reuven Azar
Business
Israel to launch 'Landing Pad' programme to help its companies find Indian partners: Ambassador Reuven Azar

<p>Bengaluru (Karnataka) [India], November 17 (ANI): Israel will launch a new programme called 'Landing Pad' to help Isr...

Jensen Huang to appear before US House committees on December 1
Business
Jensen Huang to appear before US House committees on December 1

<p>Washington DC [US], November 17 (ANI): Former Nvidia CEO Jensen Huang will appear before the House Foreign Affairs, I...