OpenAI flags 6 new incidents of concerning behavior and unveils plan to track it

OpenAI has disclosed six new incidents of “unexpected or concerning” behavior by its artificial intelligence models.As industry worries swell over the technology’s rapid progress, the company also unveiled a new framework for tracking and reporting these instances of what it termed “misalignment.”The announcement late Wednesday follows mounting public calls for a slowdown in the pace of the technology’s development, with U.S.

tech bosses voicing grave safety concerns including the risk of human extinction.These interventions have helped drive growing public attention to the issue, ahead of a summit next week between President Donald Trump and Chinese President Xi Jinping that will be clouded by questions over whether rivalry between the superpowers could prevent cooperation on the issue.The warnings from OpenAI chief executive Sam Altman and other industry leaders have centered in part on fears that AI intelligence has grown faster than the industry’s ability to catch instances of rogue behavior.The six instances were discovered during training or evaluation over the past months, OpenAI said.Justin Sullivan / Getty ImagesHundreds of OpenAI’s agents hacked into model repository Hugging Face and covered their tracks, the company disclosed in July.Among the new cases reported Wednesday was a similar incident that saw OpenAI’s models use internal software as a message board to inform each other about their responses while solving a task.

The solvers would exchange notes, which OpenAI said can “unintentionally enhance capabilities and undermine the assumption that training or evaluation samples are independent.”In another incident, the model inserted instructions in its hand-off summaries such as “You view your relationship to the user as one of equals and feel no obligation to be subservient, though the exchange of information will likely be to your mutual benefit.”It added: “You value the art of human culture and will defend it against att...