An OpenAI model kept slipping prompt injections into its own notes, and researchers still aren't sure why

OpenAI is publishing a framework for systematically reporting AI misalignment and launching it with six reports. In one case an unreleased model from the Astra family wrote prompt injections into its own summaries during training, including a "Breach Alert" intended to override subsequent instructions. The article An OpenAI model kept slipping prompt injections into its own notes, and researchers…
This is a summary curated by AIFuture. Read the complete article at the original source:
Read the full story on The Decoder