paper web signal

Muon-RT Cuts LLM Self-Distillation Training Memory 42% by Reusing EMA Teacher as Momentum Buffer

Summary

Muon adoption in post-training is growing and EMA-teacher self-distillation (SDFT, SDPO) is now standard; a variant that eliminates the separate momentum buffer while improving accuracy over AdamW is immediately usable by any team running these recipes.