Elon Musk’s only AI expert witness at the OpenAI trial fears an AGI arms race

When will we take AI doomers critically?

That’s a key subtext of Elon Musk’s try and shut down OpenAI’s for-profit AI enterprise. His attorneys argue that the group was arrange as a charity centered on AI security, and misplaced its approach in pursuit of lucre. To show that, they cite previous emails and statements from the group’s founders in regards to the want for a public-spirited counterweight to Google DeepMind.

At this time, they known as the one skilled witness to talk on to AI know-how: Stuart Russell, a College of California, Berkeley pc science professor who has studied AI for many years. His job was to supply background on AI, and set up that this know-how is harmful sufficient to fret about.

Russell co-signed an open letter in March 2023 calling for a six-month pause in AI analysis. In an indication of the contradictions right here, Musk additionally signed the identical letter, at the same time as he was launching xAI, his personal for-profit AI lab.

Russell advised jurors and Choose Yvonne Gonzalez Rodgers that there have been a wide range of dangers related to the event of AI, starting from cybersecurity threats to issues with misalignment and the winner-take-all nature of creating Synthetic Normal Intelligence (AGI). In the end, he stated that there was a stress between the pursuit of AGI and security.

Russell’s bigger issues in regards to the existential threats of unconstrained AI didn’t get aired in open court docket after objections from OpenAI’s attorneys led the choose to restrict Russell’s testimony. However Russell has lengthy been a critic of the arms-race dynamic created by frontier labs across the globe competing to achieve AGI first, and known as for governments to control the sector extra tightly.

OpenAI’s attorneys spent their cross-examination establishing that Russell wasn’t straight evaluating the group’s company construction or its particular security insurance policies.

However this reporter (in addition to the choose and the jurors) can be weighing how a lot worth to placed on the connection between company greed and AI security issues. Just about each one of many OpenAI founders have strenuously warned in regards to the dangers of AI, whereas additionally emphasizing the advantages, making an attempt to construct AI as quick as attainable — and hatching plans for AI-focused for-profit enterprises they might management.

From the surface, a transparent situation right here is the rising realization inside OpenAI after its founding that the group merely wanted extra compute spend if it was to succeed. That cash might solely come from for-profit buyers. The founding crew’s worry of AGI within the palms of a single group pushed them to hunt the capital that in the end tore the crew aside, creating the arms race we all know in the present day—and bringing us to this lawsuit.

The identical dynamic is already taking part in out at a nationwide degree: Senator Bernie Sanders’ push for a legislation imposing a moratorium on knowledge middle building cites AI fears enunciated by Musk, Sam Altman, Geoffrey Hinton and others. Hoden Omar, who works on the commerce group the Middle for Knowledge Innovation, objected to Sanders citing their fears with out their hopes, telling Trendster that “it’s unclear why the general public ought to low cost all the things tech billionaires say besides when their phrases could be recruited to fill gaps in a precarious argument.”

Now, either side of the case are asking the court docket to do exactly that: take a part of Altman and Musk’s arguments critically, however low cost the components which are much less helpful for his or her authorized argument.

Correction: The article was up to date to appropriate identify of a Stuart Russell, College of California, Berkeley pc science professor.