MultiRef-Compass: First Benchmark for Multi-Reference Audio-Video Generation Finds 8 Systems All Under-Deliver on 14 Metrics

Generating coherent audio-video from multiple visual and textual references is a core production need in advertising, film, and social content; this first evaluation reveals consistent failure modes in all 8 tested systems across the full pipeline of basic quality, reference consistency, audio-visual alignment, and instruction following.