Fine-tuning

Latest: Unified Training Collapses Pretraining, SFT and RL Into One Maximum-Likelihood Algorithm · huggingface.co, Oct 30, 2026

Thème Mots-clés suivis : fine-tuning, fine tuning, lora, rlhf

16 AI Weekly issues and 87 live stories from the last 30 days mention Fine-tuning.

33 mentions au total 3/20 numéros récents -100% vs référence pic 1/numéro suivi depuis 2026-04-18

Tendance des mentions — 20 derniers numéros

Actus en direct (87)

Unified Training Collapses Pretraining, SFT and RL Into One Maximum-Likelihood Algorithm

huggingface.co · 2026-10-30 · Score : 22

'Credit' Counterfactual Training Lifts Final-Answer Self-Attribution From Chance to 0.85–0.90 Across Four Open Models

huggingface.co · 2026-10-27 · Score : 22

Shanghai AI Lab's S3AC Trains a Working Critic for Long-CoT RL, Scales From 1.5B to 397B With Prompt-Difficulty Sampling

arxiv.org · 2026-10-27 · Score : 20

Google and Ulm Push Self-Distillation to Topic Labels Alone, Report Cross-Domain Gains Without Curated Prompts

huggingface.co · 2026-10-26 · Score : 20

HKUST Traces 'Wait' in Reasoning Models to Training Data, Not RL — 13 of 14 SFT Runs Inherit It

huggingface.co · 2026-10-23 · Score : 23

TraceForge Synthesizes Family-Native Reasoning Traces, Beats Fable 5's Own Traces by 3.7–7.1 Points on Code

huggingface.co · 2026-10-22 · Score : 23

Columbia BrainLoRA Scales PEFT to 104B Multimodal Backbones, Tops Brain-Encoding Leaderboard With 5% of Prior Params

huggingface.co · 2026-10-19 · Score : 18

Tsinghua's TreeOPSD Lifts 30B Deep-Research Agent EM by 4.97 Points Over GRPO With Critic-Free Tree Credit Assignment

huggingface.co · 2026-10-19 · Score : 22

Copenhagen Shows MoE Experts Cleanly Localize Personalization Features That Dense LLMs Scatter Across Polysemantic Neurons

huggingface.co · 2026-10-16 · Score : 18

NUS and UIUC MRTPO Routes Each Verifiable Reward to Its Own Tokens via Jensen-Shannon Distance, Beats GDPO on SQL and Tool-Calling

huggingface.co · 2026-10-15 · Score : 18

Alibaba Cloud's Waypoint-OPD Gates RL Distillation Using Mid-Run Teacher Checkpoints, Tops Six Qwen3 Settings

arxiv.org · 2026-10-15 · Score : 17

Athanor Paper Says Four Claude Opus 5.5 Agents Autonomously Post-Trained a 4B Base to Match Qwen3-4B-Instruct in 104 Hours

huggingface.co · 2026-10-15 · Score : 23

Wisconsin-Madison's MaLoW Internalizes Streaming-Video History Into Evolving LoRA Weights, Hits 84.8% on StreamingBench

huggingface.co · 2026-10-16 · Score : 19

ByteDance Seed's Cortex Bakes Context Into LLM Weights, Keeps 99.8% Base Performance After 50 Edits

huggingface.co · 2026-10-14 · Score : 23

ActionOPD Distills Agent Decisions Instead of Tokens, Lifts Qwen3 Tool-Use Scores 3.3–6.9 Points OOD

huggingface.co · 2026-10-15 · Score : 20

Yonsei and FuriosaAI's CaLIF Cuts Response-Quality Collapse in Verifiable-Reward Training by 7x

huggingface.co · 2026-10-15 · Score : 22

OpenRubrics' ReVeR Lifts 4B Rubric RM Over 8B Pairwise Baselines Using Tool-Augmented Per-Criterion Judges

huggingface.co · 2026-10-14 · Score : 20

NTU's DeltaTTG Beats GRPO by 7 Points on Llama-3.1-8B With Shared Token-to-Go Progress Meter for Multi-Turn Agents

huggingface.co · 2026-10-14 · Score : 22

Nanjing-Fudan Paper Trains Reasoning Models on 0.22% of Full-Data SFT Via Uncertainty-Guided Contraction

huggingface.co · 2026-10-12 · Score : 22

LinkedIn's Δ-MOPD Distills From Teacher-Minus-Base Logit Shifts, Hits Math SoTA With 35% Fewer H100-Hours

huggingface.co · 2026-10-08 · Score : 19

EngramEdit Hits 97% Generalization on DeepSeek Engram Knowledge Edits via Jointly Allocated N-Gram Updates

huggingface.co · 2026-10-08 · Score : 25

SkillForge Co-Evolves LLM Agents and Skill Libraries via Trial-Active-Stable-Retired Lifecycle

huggingface.co · 2026-10-08 · Score : 22

TRACE Paper: Rollout-Guided FP4 QAT Matches BF16 Rollout for MoE RL, 5.4x Faster

huggingface.co · 2026-10-07 · Score : 22

Alibaba Paper Rethinks Cross-Tokenizer Distillation, Top-16 Reverse KL Beats Full-Vocab OPD

huggingface.co · 2026-10-07 · Score : 20

Hugging Face Paper APO Clusters Users by Preference Bottlenecks for 20-Shot LLM Personalization

huggingface.co · 2026-10-06 · Score : 19

Activation Alignment Paper Shrinks TabPFN-3 and TabFM Context With a Linear Aligner Trained in Minutes

huggingface.co · 2026-10-06 · Score : 21

OPPD Paper Trains Qwen2.5-Math-7B to Match 64-Candidate Power Sampling in a Single Decode, Adds 23 Points on MATH500

huggingface.co · 2026-10-06 · Score : 27

Paper Shows One-Token Prefills Match RL Reasoning Gains in Olmo and Qwen Base Models

huggingface.co · 2026-10-06 · Score : 27

Cambridge Paper Finds On-Policy Distillation's Advantage Depends on Objective and Hyperparameters, Not Rollouts

arxiv.org · 2026-10-02 · Score : 18

HF Paper Where-OPD Uses Synthetic Scenes to Self-Distill MLLMs, Transfers 3.23-Point Gain to Real Benchmarks

huggingface.co · 2026-10-02 · Score : 19

HF Paper 'Sharpening Tax' Shows RL Post-Training Hurts pass@K Coverage, Introduces Posterior-Tempered Sampling Fix

huggingface.co · 2026-10-01 · Score : 22

Qwen3.8-27B-pi Fine-Tune Restores Effort-Ordered Reasoning, Matches Base's High-Effort Pass Rate With 41% Fewer Tokens

huggingface.co · 2026-09-30 · Score : 24

Paper Finds DPO Beats Representation Steering for LLM Safety Except in Low-Data Regimes

arxiv.org · 2026-09-28 · Score : 17

LSPD Paper Reframes On-Policy Distillation as RL, Matches OPD on 25% of Rollouts

arxiv.org · 2026-09-28 · Score : 18

HF Paper: Domain-Normalized Multi-Teacher On-Policy Distillation Beats Single-Teacher Baselines

huggingface.co · 2026-09-29 · Score : 18

Firelex Ships Jeff, Jev-Compatible 0.8B Decision Models Trained at Home With ~30ms Inference

github.com · 2026-09-28 · Score : 16

Supersonic Labs Open-Weights Julia-1, a 144M-Param Decision Model Hitting 73.15% on Typed Decisions

huggingface.co · 2026-09-28 · Score : 19

Rufus-Air Ships Open Eight-Stage Post-Training Recipe for GLM-4.5-Air Using Public Data Only

huggingface.co · 2026-09-25 · Score : 19

AI Agents Help Six-Mathematician Team Crack Long-Open M23 Inverse Galois Problem

scientificamerican.com · 2026-09-22 · Score : 26

ACLArena Paper Diagnoses Non-Monotonic Forgetting in Multi-Stage Agent Post-Training

huggingface.co · 2026-09-22 · Score : 18

SAP's EDGEGEN Auto-Generates Tool-Calling Agent Edge Cases, Reports 30% Progress Gain Over Base Harness

huggingface.co · 2026-09-21 · Score : 17

Paper: 1% of Tokens Match Full On-Policy Distillation via New IER Gradient-Estimation Metric

arxiv.org · 2026-09-22 · Score : 22

onPanda Cuts On-Policy Alignment Annotation Time ~52% via Token-Level Correction Instead of Post-Editing

huggingface.co · 2026-09-21 · Score : 23

Harness-Zero Paper Distills Agent-Harness Behaviors Into Weights, Lifts Base LLMs From 23.3% to 44.3%

huggingface.co · 2026-09-21 · Score : 22

RRSI Paper Cures Agent-Harness Overfitting With Regularized Self-Improvement, Cuts Policy Tokens 30%

huggingface.co · 2026-09-22 · Score : 20

EOS Tokens Disagree: Paper Traces Length Inflation in On-Policy Distillation to Termination Mismatch

arxiv.org · 2026-09-18 · Score : 21

Shanghai AI Lab's SP3O Cures PPO 'Value Flattening' With Sparse Critic Supervision on Three States per Response

arxiv.org · 2026-09-17 · Score : 25

Cambridge's XConf Beats 10-Sample Self-Consistency on 23 of 24 AUROC by Recalling Past Reasoning Episodes

arxiv.org · 2026-09-17 · Score : 25

ImpossibleRubrics Benchmark Shows LLM-Generated Rubrics Get Gamed 8–26% as RL Reward Signals

huggingface.co · 2026-09-15 · Score : 17

Paper: On-Policy Reverse Distillation Lets Student LLMs Surpass Weak Teachers Faster Than Verifier-Only RL

arxiv.org · 2026-09-08 · Score : 19

IBM's DRACO Paper Redistributes Rubric Rewards Across Steps, Lifts AppWorld Agent Score 15.9 Points

arxiv.org · 2026-09-03 · Score : 21

'One Training Example' Paper Shows On-Policy Distillation Is Data-Overfed, Algorithm-Starved

huggingface.co · 2026-09-03 · Score : 21

Debias-SparseGPT Paper Adds Bias-Aware Pruning to LLM Compression, Retains Fairness at Sparse Weights

huggingface.co · 2026-09-03 · Score : 17

Cliff Paper: Zeroing In on the First Mistake in a Rollout Boosts RL-Trained LLMs 15% Over Distillation

huggingface.co · 2026-09-02 · Score : 23

Meta and Princeton Paper: Mid-Training KL Distillation Boosts Reasoning But Slows Factual Recall

arxiv.org · 2026-09-01 · Score : 18

DiagEvo Paper: Self-Evolution via Hierarchical Error Memory Beats R-Zero by 4.5 Points on Qwen3-8B Math

huggingface.co · 2026-09-02 · Score : 18

Paper: Split Qwen3-32B Into GRPO Experts, Merge via SLERP, Match Qwen3-235B on Enterprise Traffic

huggingface.co · 2026-09-02 · Score : 19

NoRA: Normalized LoRA Method Speeds Convergence and Cuts Catastrophic Forgetting at Zero Extra Cost

huggingface.co · 2026-09-01 · Score : 20

Trajectory Raises $40M Sequoia-Led Round at $300M for Continual-Learning Agents

theinformation.com · 2026-08-11 · Score : 21

ABSeeker Paper Turns Sparse Trajectory Outcomes Into Dense Step Rewards for Long-Horizon Search Agents

huggingface.co · 2026-08-05 · Score : 19

TurnSight Adds Turn-Level Hindsight Self-Distillation to Tool-Integrated Reasoning, Beats Trajectory-Level RL

huggingface.co · 2026-08-04 · Score : 17

Arxiv Paper Pins LLMs' Tabular Weakness on Dimensionality, Only Method Whose Accuracy Falls as Features Grow

arxiv.org · 2026-08-03 · Score : 18

BIGAI-PKU 'GradCuit' Adds Credit-Assigned Gradient Flow to Test-Time Latent Reasoning

huggingface.co · 2026-08-03 · Score : 20

DAPD Paper Blames 'Privilege Illusion' in On-Policy Distillation, Beats OPSD by 2+ Points Across Qwen3 Scales

huggingface.co · 2026-08-03 · Score : 20

CUHK-Lightspeed 'Skill-α' Uses Rollback Rewards to Learn Agent-Skill Edits, Beats SkillPro by 6.7 pts

huggingface.co · 2026-08-03 · Score : 15

β-OPSD Paper Generalizes On-Policy Self-Distillation Into a Tunable Family, Beats Vanilla OPSD on Math Reasoning

huggingface.co · 2026-07-31 · Score : 17

Tsinghua's Memory Decoder at Scale Pairs 410M Base With 6.9B External Memory, Matches Pythia-12B

huggingface.co · 2026-07-30 · Score : 22

Peking-Kling's Flux-OPD Uses Evolving Contexts as In-Training Supervision, Beats OPD Baselines on Open-Ended Tasks

huggingface.co · 2026-07-31 · Score : 20

CoRT Uses Counterfactual Replay to Add Token-Level Credit to Rubric-Based GRPO, Gains 4.4 Points on Average

huggingface.co · 2026-07-29 · Score : 15

Meta FAIR Ships DMC-Optim RL Framework, Lifts Qwen 2.5 7B Code-Optimization Pass Rate From 18% to 31%

arxiv.org · 2026-07-28 · Score : 21

Zhejiang and Alibaba's Relay-OPD Fixes On-Policy Distillation's Prefix Failure With Teacher Handoffs, Beats OPD 5.7% on Math

huggingface.co · 2026-07-29 · Score : 23

Paper Maps Multi-Turn Long-Horizon Planning Across Pre-Training, Post-Training and Multi-Teacher Distillation

huggingface.co · 2026-07-27 · Score : 17

MAPD Paper: Multi-Agent Protocol Distillation Beats SDAR by 3-5% Distilling Claude Opus 4.6, GPT-5.5, Gemini 3.1 Pro Into Qwen3

huggingface.co · 2026-07-27 · Score : 18

UT Austin's ISO Paper Frames RLVR as 'Inherit the Spectrum, Optimize the Frames,' Hits AdamW Accuracy in 2.7x Fewer Steps

huggingface.co · 2026-07-21 · Score : 23

Loopie MoE looped transformer claims IMO and IPhO gold-medal performance without tools

huggingface.co · 2026-07-19 · Score : 18

Muon optimizer lifts agentic RL success from 0.29 to 0.55 on ALFWorld, new arXiv paper finds

huggingface.co · 2026-07-20 · Score : 21

LoRA Speedrun Launches Public Wall-Clock Leaderboard for Fine-Tuning Techniques on Qwen2.5-1.5B and SmolLM2-1.7B

github.com · 2026-07-19 · Score : 17

Mind Lab Ships LongStraw — GRPO-Based Long-Context RL Training Reaches 4.46M Token Positions on 8 H20 GPUs

huggingface.co · 2026-07-16 · Score : 25

Tsinghua's SEED Frames Agentic RL as Self-Evolving On-Policy Distillation, Adds 14.9-45.9 Points on ALFWorld Over GRPO

huggingface.co · 2026-07-16 · Score : 19

Ring-Zero Scales Zero-RL to a Trillion Parameters, Shows Emergent Multi-Step Reasoning Without Handcrafted Signals

arxiv.org · 2026-07-16 · Score : 27

HF Paper 'Proxy Exploration and Reusable Guidance': Modular LLM Post-Training Paradigm Uses Proxy-Guided Update Signals, Separates Exploration From Policy Training for Cheaper Sample-Efficient RL Fine-Tuning

huggingface.co · 2026-07-13 · Score : 15

Tsinghua's SAO Paper: Single-Rollout Async Optimization Cracks GRPO's Stability Wall — Trained the Open GLM-5.2 750B-A40B, Beats Baselines on SWE-Bench Verified and BeyondAIME

huggingface.co · 2026-07-08 · Score : 18

BottleCap AI Releases ThinkingCap-Qwen3.6-27B — Reasoning Fine-Tune That Cuts Thinking Tokens 50% on Average (74% on GSM8K) While Preserving Accuracy and Safety

huggingface.co · 2026-07-06 · Score : 17

Waterloo Paper 'Program-as-Weights' Compiles Natural-Language Specs Into Compact Adapters — 0.6B Qwen3 Interpreter Matches Direct-Prompted Qwen3-32B at ~1/50th Inference Memory, Ships FuzzyBench 10M-Example Dataset

arxiv.org · 2026-07-03 · Score : 16

Paper 'Is One Layer Enough?' Shows Training a Single Transformer Layer Can Match Full-Parameter RL Training — Gains Concentrate in a Small Middle-Layer Subset

arxiv.org · 2026-07-01 · Score : 19

HF Paper 'TRIAGE': Role-Typed Credit Assignment Adds Semantic Role Axis to GRPO — Boosts ALFWorld Success 7.9% on Qwen2.5-7B, Cuts Rollout Length 10–15%

huggingface.co · 2026-06-30 · Score : 17

HF Paper 'QVal' — Cheaply Evaluating Dense Supervision Signals for Long-Horizon LLM Agents Gains Traction

huggingface.co · 2026-06-30 · Score : 16

Numéros de la newsletter (16)

#517 What Happens When AI Runs Out of Content to Steal?

2026-07-29 · 1 mentions

World Models: $610M Bets the World Is Not a Token

2026-06-21 · 1 mentions

AI Safety, Security & Ethics: train one trait, get alignment free

2026-06-21 · 3 mentions

AI Regulation: export-control law just became an AI kill switch

2026-06-21 · 3 mentions

Deep Learning: 4-bit pretraining just matched FP8 at scale

2026-05-26 · 1 mentions

AI Regulation: Trump killed his own AI oversight order at the door

2026-05-26 · 2 mentions

Frontier Research: LLMs reach Nature as the field bets against them

2026-05-26 · 1 mentions

AI Safety: the deepfake takedown clock starts ticking

2026-05-26 · 4 mentions

Frontier Research: reasoning is leaving the token stream

2026-05-21 · 6 mentions

AI Careers: 11,000 jobs cut in a day, one role is booming

2026-05-21 · 1 mentions

AI Safety: Washington floats an FDA for AI models

2026-05-21 · 3 mentions

Frontier research: the next architecture is not transformer-shaped

2026-04-25 · 1 mentions

ML this week: open weights closed the gap from underneath

2026-04-25 · 3 mentions

Deep Learning: Mamba-3 halves the state. SSMs win again.

2026-04-18 · 1 mentions

Generative AI: Anthropic just retook the frontier, quietly

2026-04-18 · 1 mentions

Machine Learning: The dataset just became the alignment lever

2026-04-18 · 1 mentions