Arxiv Paper Maps How Reasoning Fine-Tuning Reshapes LLMs

A new arxiv paper from Harrasse, Lan, Batra, Hashemi Chaleshtori and Bandi takes on a question that keeps coming back in the reasoning-model era, one that is easy to state and hard to answer: when you fine-tune a base model to be better at multi-step reasoning, what actually changes inside it? Is it token-level sharpening, or is the model reorganising how it structures inference over time?

Their answer, tested across four benchmarks and model scales from 1.5B to 32B parameters, points at the second one. They model Chain-of-Thought reasoning as a switching dynamical system, combining time-aware contrastive representation learning with discrete regime discovery to recover latent policies from activation trajectories. Reasoning-fine-tuned models, they report, show richer latent-policy organization than their base counterparts, with more differentiated transition structure and regimes that align with distinct reasoning stages.

The part that will matter to engineering teams more than to interpretability researchers is the causal follow-through. State-swap ablations reduce one-step predictive fit; transplanting reasoning dynamics into base models improves performance on challenging problems. And SDS-guided pruning of failure-prone reasoning prefixes outperformed self-consistency in 11 of 12 model-dataset settings, with gains up to 12.5 percentage points. Self-consistency is the standard trick of sampling many reasoning traces and majority-voting, and it is expensive; a pruning method that beats it on the same problems is a real inference-cost story, not just a diagnostic one.

The honest caveat is scope. The tested range tops out at 32B parameters, and the abstract does not name the four benchmarks or the specific model families, so how the method transfers to frontier-scale models or different fine-tuning recipes is not something you can read off the paper. What the reporting doesn't give you is a compute cost for running the SDS analysis itself, which matters if you are weighing it against simply paying for more sampled traces.

If the pruning result holds up on other people's models, the winners are teams paying per token for majority-vote sampling on reasoning workloads, and interpretability groups who now have a concrete handle on what reasoning fine-tuning is actually doing under the hood.