Recirculation

Shared on Bluesky by 2 AI experts

• L Leshem (Legend) Choshen @EMNLP @lchoshen.bsky.social: https://arxiv.org/abs/2608.17981 Recurrent transformer that injects activations from the top layers to the bottom layers at the next step (… →
• Tim Kellogg @timkellogg.me: Recirculation — boost perplexity 23% with a small loop another take on RNNs for transformers, unlike looped transformers, this doesn’t loop… →