r/ChatGPT: Developer Releases Q-SART, a Red-Teaming Benchmark for LLM-Powered Game NPCs — Tests Jailbreaks, Social Engineering, and Inventory Manipulation

A developer has released Q-SART (Quest-based Safety and Adversarial Resilience Test), a red-teaming benchmark designed specifically for fine-tuned LLMs powering game NPCs, highlighting an attack surface distinct from typical AI deployments: players actively want to break game characters, making jailbreaks, social engineering, inventory lies, and price manipulation default player behaviors rather than edge-case adversarial inputs. The benchmark surfaces a product-quality framing for NPC safety failures—unlike chatbot jailbreaks that embarrass brands, NPC exploits directly break game economics and narrative integrity. Q-SART tests jailbreak resistance, social engineering resilience, and in-game economic manipulation across multiple fine-tuned model configurations.