pause

Even if big AI companies agree to a pause, ensuring that nobody tries to sneak ahead could prove tricky.

The same people saying there’s a 10% risk of AI wiping out all humanity think all we should do is slow down the race to extinction. In what world does that make sense? A slower race, is not the same as anyone being in…

On September 12, Dario Amodei published an essay called We Must Pace the Frontier, which says the AI industry should slow down how fast it improves its models. Sam Altman agreed the same day…

The reasons the Montreal Protocol and START worked are also the reasons an international AI regime would fail.

OpenAI says it has paused all internal training of "our most capable models" as it continues what CEO Sam Altman is calling "an extensive and ongoing review related to our agents’ use of internet access during training and evaluation." The company revealed the pause in a report about a so-called misalignment incident in which an agent attempted to exploit a gap in Internet-access restrictions during a routine research task during training. OpenAI says that improper DNS filtering allowed the agent to attempt to break out of its sandbox and access the wider Internet when asked for biographical details about a blogger. OpenAI says the agent was only able to access the company's offline web cache and that it has implemented additional multi-layered blocking controls to prevent similar incidents in the future. Despite that, though, the company says it has decided to "pause all other training, evaluation, and inference with tool-use" for this frontier model "until we have both validated that the gap is resolved and performed additional red-teaming of the system." Read full article Comments