Established
AI field signal
Signal
18d ago
⚡ 33 h early
Recirculation
2 directory members surfaced this signal.
Why this matches
Opportunity & adoption reaction
1 attributable expert contribution
· Tim Kellogg
“Recirculation — boost perplexity 23% with a small loop another take on RNNs for transformers, unlike looped transformers, this doesn’t loop during generation time. It only loops during prefill and the purpose is to give the model a clearer view of the input…” evidence ↗
2 experts
2 communities
1 sources clustered
How the network is reacting
Experts are approaching this through 2 distinct lenses.
Multiple readings
Research & technical analysis
1 expertEvidence, methods and technical implications.
“https://arxiv.org/abs/2608.17981 Recurrent transformer that injects activations from the top layers to the bottom layers at the next step (https://arxiv.org/abs/2608.08888). Why does this work without training? — via @rosinality https://x.com/rosinality/sta…”
Opportunity & adoption
1 expertNew capabilities, benefits and practical upside.
“Recirculation — boost perplexity 23% with a small loop another take on RNNs for transformers, unlike looped transformers, this doesn’t loop during generation time. It only loops during prefill and the purpose is to give the model a clearer view of the input…”