Anthropic’s Dario Amodei responds: doesn’t oppose open-weight models, but fears Chinese AI

Anthropic founder and CEO Dario Amodei responded on Monday afternoon to murmuring within the business that his firm in some way helps efforts by the U.S. authorities to ban open-weight Chinese language fashions, or probably open-weight fashions typically.

“Anybody who has learn my previous writing ought to know that I don’t regard such bans as a helpful measure, however let me state it clearly in order that there isn’t any doubt: Anthropic has by no means advocated for a ban on open-weights fashions,” he wrote, emphasis his personal.

His response got here after Nvidia founder and CEO Jensen Huang took to X (his first publish on the platform) to share an open letter on Friday through which Nvidia and an extended listing of different AI corporations together with Hugging Face, Meta, Microsoft, Mistral, and Nvidia urged policymakers to not impose broad “untimely restrictions” on open-weight AI fashions.

Whereas that letter didn’t point out China particularly, the talk within the business has centered on allegations that Chinese language AI labs are rising in functionality typically by stealing mental property from their American counterparts. One methodology is distillation, the place an AI bombards one other mannequin with prompts to study the way it works.

Amodei stated within the weblog publish printed Monday that he views open-weight fashions as falling into a special bucket than the menace China poses. “Open-weights fashions that don’t have harmful capabilities are a public good: they don’t value something in addition to the compute wanted to run them, and so they present worth to companies, builders, and researchers.”

Amodei stated in his publish that he has longstanding fears about AI, however companies utilizing open-weight fashions, even ones from China, usually are not amongst them.

His worry is that “authoritarian governments” will construct fashions which can be extra highly effective than these within the U.S. to realize “everlasting army superiority” and/or use AI to repress their very own folks. He stated the Chinese language Communist Get together (CCP) isn’t the one authoritarian authorities he’s involved about, however it’s the “most succesful.”

Amodei additionally stated he fears AI will allow “organic assaults” not simply cybersecurity ones. And, in his view, open-weight fashions are extra harmful in these situations as a result of it’s tough to use guardrails to them or monitor their utilization. He additionally famous, citing a UK AI Safety Institute report, that when open-weights are launched they can’t be withdrawn

This runs counter to what open supply advocates argue: that entry to highly effective open fashions not managed by a single entity helps defenders defend themselves.

Amodei listed actions he believes would thwart China, together with limiting its entry to highly effective chips (which has been a longstanding U.S. coverage) and calling for a proper crackdown on distillation. The U.S. has threatened sanctions in opposition to China if it decided there was IP theft involving U.S. fashions.

Curiously, Amodei additionally stated he helps rising efforts, some led by the U.S., to create a mannequin security testing group, particularly if your entire world, together with China, agreed to undergo it.

“I feel this concept is definitely near a consensus: I’ve been heartened each that the Trump administration has moved on this path in current months, and by current business proposals that may apply such testing to probably the most succesful fashions no matter their nation of origin or whether or not they’re open or closed (whereas exempting much less succesful fashions, comparable to these from startups and academia, completely),” Amodei wrote.

“Be aware that to be efficient,” he added, “testing would must be international, which suggests even the CCP would must be on board. I feel this will really be attainable … restricted cooperation round stopping AI organic weapons could also be attainable as a result of it’s in China’s curiosity too.”