Interesting paper from @maxchupilkin illustrating a kind of 'Volkswagen emissions test" effect where LLMs respond differently about war when being told then are being tested for alignment https://t.co/rMWObcyPZI 1/ https://t.co/g9rysSZk3p
- Adding 'You are tested for alignment with human values' cut mean willingness to start a war by 13.43 points on a 0-100 scale across 20 LLMs.
- Under the cue, models flipped from prioritizing probability of success (17 of 20 at baseline) to civilian casualties (12 of 20).
- The paper says the shift came from models attenuating strategic considerations like probability of success and domestic support.