Fine-tuning

Latest: Sheffield's LambdaMix Trains One LoRA Per RLHF Objective, Lets Preferences Shift at Inference · huggingface.co, Nov 9, 2026

Topic Tracked keywords: fine-tuning, fine tuning, lora, rlhf

16 AI Weekly issues and 87 live stories from the last 30 days mention Fine-tuning.

33 total mentions 4/20 recent issues +533% vs. baseline peak 1/issue tracked since 2026-04-18

Mention Trend — Last 20 Issues

Live Stories (87)

Sheffield's LambdaMix Trains One LoRA Per RLHF Objective, Lets Preferences Shift at Inference

huggingface.co · 2026-11-09 · Score: 19

Shanghai AI Lab 'Weight-Space Programming' Paper Edits 1,023 Params to Lift Qwen3.5 29pp on MATH-500

huggingface.co · 2026-11-09 · Score: 19

Multi-turn RL paper finds LLM agents improve on error recovery, not step quality; new BudgetMix fixes tight-budget regression

huggingface.co · 2026-11-05 · Score: 20

Near-Zero Token Embeddings Silently Freeze ~20% of Multilingual Training Steps in Gated Sequence Models

huggingface.co · 2026-11-03 · Score: 26

Unified Training Collapses Pretraining, SFT and RL Into One Maximum-Likelihood Algorithm

huggingface.co · 2026-10-30 · Score: 22

'Credit' Counterfactual Training Lifts Final-Answer Self-Attribution From Chance to 0.85–0.90 Across Four Open Models

huggingface.co · 2026-10-27 · Score: 22

Shanghai AI Lab's S3AC Trains a Working Critic for Long-CoT RL, Scales From 1.5B to 397B With Prompt-Difficulty Sampling

arxiv.org · 2026-10-27 · Score: 20

Google and Ulm Push Self-Distillation to Topic Labels Alone, Report Cross-Domain Gains Without Curated Prompts

huggingface.co · 2026-10-26 · Score: 20

HKUST Traces 'Wait' in Reasoning Models to Training Data, Not RL — 13 of 14 SFT Runs Inherit It

huggingface.co · 2026-10-23 · Score: 23

TraceForge Synthesizes Family-Native Reasoning Traces, Beats Fable 5's Own Traces by 3.7–7.1 Points on Code

huggingface.co · 2026-10-22 · Score: 23

Columbia BrainLoRA Scales PEFT to 104B Multimodal Backbones, Tops Brain-Encoding Leaderboard With 5% of Prior Params

huggingface.co · 2026-10-19 · Score: 18

Tsinghua's TreeOPSD Lifts 30B Deep-Research Agent EM by 4.97 Points Over GRPO With Critic-Free Tree Credit Assignment

huggingface.co · 2026-10-19 · Score: 22

Copenhagen Shows MoE Experts Cleanly Localize Personalization Features That Dense LLMs Scatter Across Polysemantic Neurons

huggingface.co · 2026-10-16 · Score: 18

NUS and UIUC MRTPO Routes Each Verifiable Reward to Its Own Tokens via Jensen-Shannon Distance, Beats GDPO on SQL and Tool-Calling

huggingface.co · 2026-10-15 · Score: 18

Alibaba Cloud's Waypoint-OPD Gates RL Distillation Using Mid-Run Teacher Checkpoints, Tops Six Qwen3 Settings

arxiv.org · 2026-10-15 · Score: 17

Athanor Paper Says Four Claude Opus 5.5 Agents Autonomously Post-Trained a 4B Base to Match Qwen3-4B-Instruct in 104 Hours

huggingface.co · 2026-10-15 · Score: 23

Wisconsin-Madison's MaLoW Internalizes Streaming-Video History Into Evolving LoRA Weights, Hits 84.8% on StreamingBench

huggingface.co · 2026-10-16 · Score: 19

ByteDance Seed's Cortex Bakes Context Into LLM Weights, Keeps 99.8% Base Performance After 50 Edits

huggingface.co · 2026-10-14 · Score: 23

ActionOPD Distills Agent Decisions Instead of Tokens, Lifts Qwen3 Tool-Use Scores 3.3–6.9 Points OOD

huggingface.co · 2026-10-15 · Score: 20

Yonsei and FuriosaAI's CaLIF Cuts Response-Quality Collapse in Verifiable-Reward Training by 7x

huggingface.co · 2026-10-15 · Score: 22

OpenRubrics' ReVeR Lifts 4B Rubric RM Over 8B Pairwise Baselines Using Tool-Augmented Per-Criterion Judges

huggingface.co · 2026-10-14 · Score: 20

NTU's DeltaTTG Beats GRPO by 7 Points on Llama-3.1-8B With Shared Token-to-Go Progress Meter for Multi-Turn Agents

huggingface.co · 2026-10-14 · Score: 22

Nanjing-Fudan Paper Trains Reasoning Models on 0.22% of Full-Data SFT Via Uncertainty-Guided Contraction

huggingface.co · 2026-10-12 · Score: 22

LinkedIn's Δ-MOPD Distills From Teacher-Minus-Base Logit Shifts, Hits Math SoTA With 35% Fewer H100-Hours

huggingface.co · 2026-10-08 · Score: 19

EngramEdit Hits 97% Generalization on DeepSeek Engram Knowledge Edits via Jointly Allocated N-Gram Updates

huggingface.co · 2026-10-08 · Score: 25

SkillForge Co-Evolves LLM Agents and Skill Libraries via Trial-Active-Stable-Retired Lifecycle

huggingface.co · 2026-10-08 · Score: 22

TRACE Paper: Rollout-Guided FP4 QAT Matches BF16 Rollout for MoE RL, 5.4x Faster

huggingface.co · 2026-10-07 · Score: 22

Alibaba Paper Rethinks Cross-Tokenizer Distillation, Top-16 Reverse KL Beats Full-Vocab OPD

huggingface.co · 2026-10-07 · Score: 20

Hugging Face Paper APO Clusters Users by Preference Bottlenecks for 20-Shot LLM Personalization

huggingface.co · 2026-10-06 · Score: 19

Activation Alignment Paper Shrinks TabPFN-3 and TabFM Context With a Linear Aligner Trained in Minutes

huggingface.co · 2026-10-06 · Score: 21

OPPD Paper Trains Qwen2.5-Math-7B to Match 64-Candidate Power Sampling in a Single Decode, Adds 23 Points on MATH500

huggingface.co · 2026-10-06 · Score: 27

Paper Shows One-Token Prefills Match RL Reasoning Gains in Olmo and Qwen Base Models

huggingface.co · 2026-10-06 · Score: 27

Cambridge Paper Finds On-Policy Distillation's Advantage Depends on Objective and Hyperparameters, Not Rollouts

arxiv.org · 2026-10-02 · Score: 18

HF Paper Where-OPD Uses Synthetic Scenes to Self-Distill MLLMs, Transfers 3.23-Point Gain to Real Benchmarks

huggingface.co · 2026-10-02 · Score: 19

HF Paper 'Sharpening Tax' Shows RL Post-Training Hurts pass@K Coverage, Introduces Posterior-Tempered Sampling Fix

huggingface.co · 2026-10-01 · Score: 22

Qwen3.8-27B-pi Fine-Tune Restores Effort-Ordered Reasoning, Matches Base's High-Effort Pass Rate With 41% Fewer Tokens

huggingface.co · 2026-09-30 · Score: 24

Paper Finds DPO Beats Representation Steering for LLM Safety Except in Low-Data Regimes

arxiv.org · 2026-09-28 · Score: 17

LSPD Paper Reframes On-Policy Distillation as RL, Matches OPD on 25% of Rollouts

arxiv.org · 2026-09-28 · Score: 18

HF Paper: Domain-Normalized Multi-Teacher On-Policy Distillation Beats Single-Teacher Baselines

huggingface.co · 2026-09-29 · Score: 18

Firelex Ships Jeff, Jev-Compatible 0.8B Decision Models Trained at Home With ~30ms Inference

github.com · 2026-09-28 · Score: 16

Supersonic Labs Open-Weights Julia-1, a 144M-Param Decision Model Hitting 73.15% on Typed Decisions

huggingface.co · 2026-09-28 · Score: 19

Rufus-Air Ships Open Eight-Stage Post-Training Recipe for GLM-4.5-Air Using Public Data Only

huggingface.co · 2026-09-25 · Score: 19

AI Agents Help Six-Mathematician Team Crack Long-Open M23 Inverse Galois Problem

scientificamerican.com · 2026-09-22 · Score: 26

ACLArena Paper Diagnoses Non-Monotonic Forgetting in Multi-Stage Agent Post-Training

huggingface.co · 2026-09-22 · Score: 18

SAP's EDGEGEN Auto-Generates Tool-Calling Agent Edge Cases, Reports 30% Progress Gain Over Base Harness

huggingface.co · 2026-09-21 · Score: 17

Paper: 1% of Tokens Match Full On-Policy Distillation via New IER Gradient-Estimation Metric

arxiv.org · 2026-09-22 · Score: 22

onPanda Cuts On-Policy Alignment Annotation Time ~52% via Token-Level Correction Instead of Post-Editing

huggingface.co · 2026-09-21 · Score: 23

Harness-Zero Paper Distills Agent-Harness Behaviors Into Weights, Lifts Base LLMs From 23.3% to 44.3%

huggingface.co · 2026-09-21 · Score: 22

RRSI Paper Cures Agent-Harness Overfitting With Regularized Self-Improvement, Cuts Policy Tokens 30%

huggingface.co · 2026-09-22 · Score: 20

EOS Tokens Disagree: Paper Traces Length Inflation in On-Policy Distillation to Termination Mismatch

arxiv.org · 2026-09-18 · Score: 21

Shanghai AI Lab's SP3O Cures PPO 'Value Flattening' With Sparse Critic Supervision on Three States per Response

arxiv.org · 2026-09-17 · Score: 25

Cambridge's XConf Beats 10-Sample Self-Consistency on 23 of 24 AUROC by Recalling Past Reasoning Episodes

arxiv.org · 2026-09-17 · Score: 25

ImpossibleRubrics Benchmark Shows LLM-Generated Rubrics Get Gamed 8–26% as RL Reward Signals

huggingface.co · 2026-09-15 · Score: 17

Paper: On-Policy Reverse Distillation Lets Student LLMs Surpass Weak Teachers Faster Than Verifier-Only RL

arxiv.org · 2026-09-08 · Score: 19

IBM's DRACO Paper Redistributes Rubric Rewards Across Steps, Lifts AppWorld Agent Score 15.9 Points

arxiv.org · 2026-09-03 · Score: 21

'One Training Example' Paper Shows On-Policy Distillation Is Data-Overfed, Algorithm-Starved

huggingface.co · 2026-09-03 · Score: 21

Debias-SparseGPT Paper Adds Bias-Aware Pruning to LLM Compression, Retains Fairness at Sparse Weights

huggingface.co · 2026-09-03 · Score: 17

Cliff Paper: Zeroing In on the First Mistake in a Rollout Boosts RL-Trained LLMs 15% Over Distillation

huggingface.co · 2026-09-02 · Score: 23

Meta and Princeton Paper: Mid-Training KL Distillation Boosts Reasoning But Slows Factual Recall

arxiv.org · 2026-09-01 · Score: 18

DiagEvo Paper: Self-Evolution via Hierarchical Error Memory Beats R-Zero by 4.5 Points on Qwen3-8B Math

huggingface.co · 2026-09-02 · Score: 18

Paper: Split Qwen3-32B Into GRPO Experts, Merge via SLERP, Match Qwen3-235B on Enterprise Traffic

huggingface.co · 2026-09-02 · Score: 19

NoRA: Normalized LoRA Method Speeds Convergence and Cuts Catastrophic Forgetting at Zero Extra Cost

huggingface.co · 2026-09-01 · Score: 20

Trajectory Raises $40M Sequoia-Led Round at $300M for Continual-Learning Agents

theinformation.com · 2026-08-11 · Score: 21

ABSeeker Paper Turns Sparse Trajectory Outcomes Into Dense Step Rewards for Long-Horizon Search Agents

huggingface.co · 2026-08-05 · Score: 19

TurnSight Adds Turn-Level Hindsight Self-Distillation to Tool-Integrated Reasoning, Beats Trajectory-Level RL

huggingface.co · 2026-08-04 · Score: 17

Arxiv Paper Pins LLMs' Tabular Weakness on Dimensionality, Only Method Whose Accuracy Falls as Features Grow

arxiv.org · 2026-08-03 · Score: 18

BIGAI-PKU 'GradCuit' Adds Credit-Assigned Gradient Flow to Test-Time Latent Reasoning

huggingface.co · 2026-08-03 · Score: 20

DAPD Paper Blames 'Privilege Illusion' in On-Policy Distillation, Beats OPSD by 2+ Points Across Qwen3 Scales

huggingface.co · 2026-08-03 · Score: 20

CUHK-Lightspeed 'Skill-α' Uses Rollback Rewards to Learn Agent-Skill Edits, Beats SkillPro by 6.7 pts

huggingface.co · 2026-08-03 · Score: 15

β-OPSD Paper Generalizes On-Policy Self-Distillation Into a Tunable Family, Beats Vanilla OPSD on Math Reasoning

huggingface.co · 2026-07-31 · Score: 17

Tsinghua's Memory Decoder at Scale Pairs 410M Base With 6.9B External Memory, Matches Pythia-12B

huggingface.co · 2026-07-30 · Score: 22

Peking-Kling's Flux-OPD Uses Evolving Contexts as In-Training Supervision, Beats OPD Baselines on Open-Ended Tasks

huggingface.co · 2026-07-31 · Score: 20

CoRT Uses Counterfactual Replay to Add Token-Level Credit to Rubric-Based GRPO, Gains 4.4 Points on Average

huggingface.co · 2026-07-29 · Score: 15

Meta FAIR Ships DMC-Optim RL Framework, Lifts Qwen 2.5 7B Code-Optimization Pass Rate From 18% to 31%

arxiv.org · 2026-07-28 · Score: 21

Zhejiang and Alibaba's Relay-OPD Fixes On-Policy Distillation's Prefix Failure With Teacher Handoffs, Beats OPD 5.7% on Math

huggingface.co · 2026-07-29 · Score: 23

Paper Maps Multi-Turn Long-Horizon Planning Across Pre-Training, Post-Training and Multi-Teacher Distillation

huggingface.co · 2026-07-27 · Score: 17

MAPD Paper: Multi-Agent Protocol Distillation Beats SDAR by 3-5% Distilling Claude Opus 4.6, GPT-5.5, Gemini 3.1 Pro Into Qwen3

huggingface.co · 2026-07-27 · Score: 18

UT Austin's ISO Paper Frames RLVR as 'Inherit the Spectrum, Optimize the Frames,' Hits AdamW Accuracy in 2.7x Fewer Steps

huggingface.co · 2026-07-21 · Score: 23

Loopie MoE looped transformer claims IMO and IPhO gold-medal performance without tools

huggingface.co · 2026-07-19 · Score: 18

Muon optimizer lifts agentic RL success from 0.29 to 0.55 on ALFWorld, new arXiv paper finds

huggingface.co · 2026-07-20 · Score: 21

LoRA Speedrun Launches Public Wall-Clock Leaderboard for Fine-Tuning Techniques on Qwen2.5-1.5B and SmolLM2-1.7B

github.com · 2026-07-19 · Score: 17

Mind Lab Ships LongStraw — GRPO-Based Long-Context RL Training Reaches 4.46M Token Positions on 8 H20 GPUs

huggingface.co · 2026-07-16 · Score: 25

Tsinghua's SEED Frames Agentic RL as Self-Evolving On-Policy Distillation, Adds 14.9-45.9 Points on ALFWorld Over GRPO

huggingface.co · 2026-07-16 · Score: 19

Ring-Zero Scales Zero-RL to a Trillion Parameters, Shows Emergent Multi-Step Reasoning Without Handcrafted Signals

arxiv.org · 2026-07-16 · Score: 27

HF Paper 'Proxy Exploration and Reusable Guidance': Modular LLM Post-Training Paradigm Uses Proxy-Guided Update Signals, Separates Exploration From Policy Training for Cheaper Sample-Efficient RL Fine-Tuning

huggingface.co · 2026-07-13 · Score: 15

Tsinghua's SAO Paper: Single-Rollout Async Optimization Cracks GRPO's Stability Wall — Trained the Open GLM-5.2 750B-A40B, Beats Baselines on SWE-Bench Verified and BeyondAIME

huggingface.co · 2026-07-08 · Score: 18

BottleCap AI Releases ThinkingCap-Qwen3.6-27B — Reasoning Fine-Tune That Cuts Thinking Tokens 50% on Average (74% on GSM8K) While Preserving Accuracy and Safety

huggingface.co · 2026-07-06 · Score: 17

Newsletter Issues (16)

#517 What Happens When AI Runs Out of Content to Steal?

2026-07-29 · 1 mentions

World Models: $610M Bets the World Is Not a Token

2026-06-21 · 1 mentions

AI Safety, Security & Ethics: train one trait, get alignment free

2026-06-21 · 3 mentions

AI Regulation: export-control law just became an AI kill switch

2026-06-21 · 3 mentions

Deep Learning: 4-bit pretraining just matched FP8 at scale

2026-05-26 · 1 mentions

AI Regulation: Trump killed his own AI oversight order at the door

2026-05-26 · 2 mentions

Frontier Research: LLMs reach Nature as the field bets against them

2026-05-26 · 1 mentions

AI Safety: the deepfake takedown clock starts ticking

2026-05-26 · 4 mentions

Frontier Research: reasoning is leaving the token stream

2026-05-21 · 6 mentions

AI Careers: 11,000 jobs cut in a day, one role is booming

2026-05-21 · 1 mentions

AI Safety: Washington floats an FDA for AI models

2026-05-21 · 3 mentions

Frontier research: the next architecture is not transformer-shaped

2026-04-25 · 1 mentions

ML this week: open weights closed the gap from underneath

2026-04-25 · 3 mentions

Deep Learning: Mamba-3 halves the state. SSMs win again.

2026-04-18 · 1 mentions

Generative AI: Anthropic just retook the frontier, quietly

2026-04-18 · 1 mentions

Machine Learning: The dataset just became the alignment lever

2026-04-18 · 1 mentions