Anthropic researcher Jacob Coxon who quit AI role over fears of racing into extinction says people are begging for regulation

The Anthropic researcher who is leaving the company over fears the technology is gambling with human life told Fox News there is hope that we can avoid the chance it could destroy humankind within the next decade.Speaking exclusively Wednesday on “Special Report,” Jacob Coxon, 27, said regulation is key.He posted his resignation Tuesday on X, writing that companies are not acting responsibly and that the race toward self-improving superintelligence is “gambling with our lives.”Coxon, who said he spent the past three years doing pretraining research at OpenAI and Anthropic, noted that it’s not a completely hopeless scenario.He told Fox News chief political anchor Bret Baier the problem is “eminently solvable.” Evan Hubinger, alignment science lead at Anthropic, expressed his agreement with Coxon’s X post.“Jacob is correct here — we really do earnestly believe AI could kill all humans!” he wrote on X.“I personally think it is >10% within the next decade.

I believe Anthropic is trying its best, but we do not yet have a plan to solve alignment for superintelligence and are not clearly on track to.”“To be clear, as we say in our latest Risk Report, I think the risk from present models is low,” Hubinger added.“What I am worried about is superintelligence arising from recursive self-improvement, as we have said is happening faster than we thought.”Coxon said he agrees with Hubinger that right now, the threat is “minimal” of artificial intelligence’s actual takeover.“But recursive self-improvement — this AIs making themselves smarter — could happen as soon as next year,” he added.

“Some people even say six months.So this attitude is shared across the industry, where people essentially are aware that the work they are currently doing, if we don’t slow down, could lead to AI takeover by the end of the decade.”He believes there is “definitely” something the country can do to change the dynamic of the “grea...