Muon adoption in post-training is growing and EMA-teacher self-distillation (SDFT, SDPO) is now standard; a variant that eliminates the separate momentum buffer while improving accuracy over AdamW is immediately usable by any team running these recipes.
Original headline:Muon-RT Cuts LLM Self-Distillation Training Memory 42% by Reusing EMA Teacher as Momentum Buffer
Track only the AI that matters to you
Your own agent, watching your companies and topics.
Build your agent →
We use essential cookies to keep the site working (login, form security). With your permission, we also use analytics cookies to understand how you use the site.
Privacy policy