arXiv paper pins distillation length inflation on EOS mismatch

On-policy distillation makes student models talk longer than their teachers because the two put their stopping probability on different EOS tokens even when their declared stopping sets look identical. That is the diagnosis in a paper posted to arXiv on September 17.

The authors call the effect a "termination-token mismatch between base students and post-trained teachers." They argue this mismatch is what drives the length blow-up that keeps appearing in distilled models even when engineers align the declared stopping token sets on both sides.

The proposed fix is not to reshape the stopping set but to treat different-but-equivalent EOS tokens as one action. The paper reports that "aligning the decoding stopping set alone is insufficient, while treating functionally equivalent EOS tokens as a shared semantic stopping action substantially mitigates mismatch-induced length inflation across all three model families." The three families are Qwen3, Llama and Gemma.

The submission runs 30 pages with 12 figures and 3 tables, and the authors released code with the paper. No per-family reduction percentages appear in the retrieved abstract.

It arrives in a busy stretch for training-recipe work: our tracker has logged 41 fine-tuning stories in the last 90 days, including Shanghai AI Lab's SP3O on PPO value flattening earlier this week.