OpenAI’s o3 model might be costlier to run than originally estimated

Must Read
bicycledays
bicycledayshttp://trendster.net
Please note: Most, if not all, of the articles published at this website were completed by Chat GPT (chat.openai.com) and/or copied and possibly remixed from other websites or Feedzy or WPeMatico or RSS Aggregrator or WP RSS Aggregrator. No copyright infringement is intended. If there are any copyright issues, please contact: bicycledays@yahoo.com.

When OpenAI unveiled its o3 β€œreasoning” AI mannequin in December, the corporate partnered with the creators of ARC-AGI, a benchmark designed to check extremely succesful AI, to showcase o3’s capabilities. Months later, the outcomes have been revised, they usually now look barely much less spectacular than they did initially.

Final week, the Arc Prize Basis, which maintains and administers ARC-AGI, up to date its approximate computing prices for o3. The group initially estimated that the best-performing configuration of o3 it examined, o3 excessive, value round $3,000 to unravel a single ARC-AGI drawback. Now the Arc Prize Basis thinks that the price is way greater β€” probably round $30,000 per job.

The revision is notable as a result of it illustrates simply how costly at present’s most refined AI fashions could find yourself being for sure duties, a minimum of early on. OpenAI has but to cost o3 β€” or launch it, even. However the Arc Prize Basis believes OpenAI’s o1-pro mannequin pricing is an inexpensive proxy.

For context, o1-pro is OpenAI’s costliest mannequin to this point.

β€œWe consider o1-pro is a better comparability of true o3 value … because of quantity of test-time compute used,” Mike Knoop, one of many co-founders of the Arc Prize Basis, advised Trendster. β€œHowever that is nonetheless a proxy, and we’ve saved o3 labeled as preview on our leaderboard to replicate the uncertainty till official pricing is introduced.”

A excessive value for o3 excessive wouldn’t be out of the query, given the quantity of computing assets the mannequin reportedly makes use of. Based on the Arc Prize Basis, o3 excessive used 172x extra computing than o3 low, the lowest-computing configuration of o3, to deal with ARC-AGI.

Furthermore, rumors have been flying for fairly a while about dear plans OpenAI is contemplating introducing for enterprise prospects. In early March, The Info reported that the corporate could also be planning to cost as much as $20,000 monthly for specialised AI β€œbrokers,” like a software program developer agent.

Some would possibly argue that even OpenAI’s priciest fashions will value properly below what a typical human contractor or staffer would command. However as AI researcher Toby Ord identified in a submit on X, the fashions might not be as environment friendly. For instance, o3 excessive wanted 1,024 makes an attempt at every job in ARC-AGI to realize its greatest rating.

Latest Articles

Nvidia’s 70+ projects at ICLR show how raw chip power is...

Some of the vital annual occasions within the subject of synthetic intelligence kicks off this week in Singapore: the...

More Articles Like This