Anthropics Call for A.I. Nonproliferation

ImageAndrew here.In 2023, Elon Musk signed an open letter, along with over 30,000 other signatories, seeking a pause on artificial intelligence.

Now, Anthropic is suggesting a similar break, arguing the risks could outweigh the rewards.All of this as it plans to go public.Also: The company behind the S&P 500 has declined to change its rules to quickly add SpaceX to its index after the I.P.O., unlike Nasdaq.

(A reminder: Nasdaq won the SpaceX listing on its exchange.) We go into all that below.ImageA global brake pedal for A.I.?Artificial intelligence giants like Anthropic and OpenAI are racing toward blockbuster I.P.O.s that could value them at more than $1 trillion each, on the promise of their rapidly advancing products.Yet Anthropic’s new suggestion that A.I.labs should weigh pausing work on their bleeding-edge technology — in the name of safety — raises questions about the risks of investing in these companies.

(That could have big repercussions if the federal government takes stakes in them, as the news outlet NOTUS reports.)From a blog post on Anthropic’s website on Thursday:We believe it would be good for the world to have the option to slow or temporarily pause frontier AI development to enable societal structures and alignment research to keep up with the advance of the technology.Jack Clark, an Anthropic founder, told BBC News, “Right now, it’s like the A.I.industry has a gas pedal, but it doesn’t have a brake pedal.”We are having trouble retrieving the article content.Please enable JavaScript in your browser settings.Thank you for your patience while we verify access.

If you are in Reader mode please exit and log into your Times account, or subscribe for all of The Times.Thank you for your patience while we verify access.Already a subscriber? Log in.Want all of The Times? Subscribe....