last translation benchmark paper
3 experts across 3 network communities independently surfaced this.
3 experts
3 communities
1 sources clustered
“Machine translation is not solved and it will take a while for it to be done arxiv.org/abs/2609.04173”
“Vil\'em Zouhar, Niyati Bafna, Mukund Choudhary, Maike Z\"ufle, Sara Rajaee, Pinzhen Chen, Jannis Vamvas, Sara Papi, Ona de Gibert, Bhavitvya Malik, Eliya Habba, Orfeas Menis Mastromichalakis, Patr\'icia Schmidtov\'a, ... Last Translation Benchmark https://a…”
2 experts discussed this · 6 posts
Vilém Zouhar: Machine translation is not solved and it will take a while for it to be done arxiv.org/abs/2609.04173
Vilém Zouhar: We just released the Last Translation Benchmark paper. In a massive crowdsourcing effort we collected 3456 unique hard-to-translate examples that break state-of-the-art translation models, and whic…
Vilém Zouhar: Machine translation doesn't break on just figurative language as one would expect. In fact, for the next generation of models, we may need to invest heavily into multilingual (& cultural) reasoning.
Open the full discussion →
LLM story consistency analysis paper
2 directory members surfaced this signal.
2 experts
2 communities
1 sources clustered
“Thennal DK, Hans Ole Hatzel Do Large Language Models Always Tell The Same Stories? https://arxiv.org/abs/2606.17350”
2 directory members surfaced this signal.
2 experts
2 communities
1 sources clustered
“arXiv: https://arxiv.org/abs/2608.25832 alphaXiv: https://alphaxiv.org/abs/2608.25832 HF Paper: https://huggingface.co/papers/2608.25832 Code: https://github.com/TextArena/TextArena”
“Bobby Cheng, Adam Gaber, Zhengyuan Liu, Catherine Arnett, Omer Goldman, Cheston Tan, Leshem Choshen Skill Issue: Are Skills Language-Invariant in LLMs? https://arxiv.org/abs/2608.25832”
sequential distillation RLVR interplay paper
2 directory members surfaced this signal.
2 experts
1 community
1 sources clustered
“Boyan Li, Bingsen Chen, Chenghao Yang, Ping Nie, Chen Zhao, Xi Ye Sequential Beats Joint: On the Interplay between On-Policy Distillation and RLVR https://arxiv.org/abs/2609.04108”
“A study shows that the sequential method of on-policy distillation followed by RL with verifiable rewards outperforms existing training techniques for large language models, enhancing reasoning abilities and optimizing model performance. https://arxiv.org/a…”
VERDICT AI clinical trial matching paper
2 directory members surfaced this signal.
2 experts
1 community
1 sources clustered
“Zikai Zhou, Yufei Jin, Yilin Xu, Yu-Chiang Wang, Chieh-Ju Chao, Monica S. Lam Accountable AI with Grounded, Faithful, Consistent, Actionable Rationales: A Case Study in Clinical Trial Matching with VERDICT https://arxiv.org/abs/2609.03366”
“VERDICT changes clinical trial matching by ensuring accountability in AI, providing consistent rationales that clinicians prefer. Its formal method enhances transparency and reliability, marking a leap in trust for AI in healthcare. https://arxiv.org/abs/26…”
natural language neural functions compile paper
2 directory members surfaced this signal.
2 experts
1 community
1 sources clustered
“Yuntian Deng, Pengyu Nie, Stuart Shieber Compile by Training: Turning Natural-Language Specifications into Local Neural Functions https://arxiv.org/abs/2609.04199”
“The innovative method "compile by training" converts natural-language specifications into efficient neural functions, achieving 83.6% semantic accuracy on complex tasks without latency of large models. This advancement paves the way for scalable AI solution…”
training-free lossy speculative decoding paper
2 directory members surfaced this signal.
2 experts
1 community
1 sources clustered
“Oszk\'ar Urb\'an, Young D. Kwon, Stylianos I. Venieris, Cecilia Mascolo Margins, Not Windows: Training-Free Per-Step Lossy Speculative Decoding https://arxiv.org/abs/2609.02897”
“AdaptiveSpec improves LLM inference by optimizing speculative decoding through dynamic adjustments in token verification and draft tree structure, achieving up to 56% throughput gains over EAGLE-3 while preserving near lossless accuracy across multiple benc…”
hybrid RAG routing rewriting adapter paper
2 directory members surfaced this signal.
2 experts
1 community
1 sources clustered
“Yucan Guo, Miao Su, Saiping Guan, Long Bai, Zhongni Hou, Zixuan Li, Xiaolong Jin, Jiafeng Guo, Xueqi Cheng R$^{2}$Adapter: A Routing and Rewriting Adapter for Efficient Hybrid RAG https://arxiv.org/abs/2609.02894”
“Introducing R2ADAPTER: a model-agnostic plug-in that dynamically allocates queries in Retrieval-Augmented Generation systems. It cuts graph-based usage by up to 59% while preserving accuracy, providing a lightweight solution for multi-hop reasoning in LLMs.…”
random attention KV cache eviction paper
2 directory members surfaced this signal.
2 experts
1 community
1 sources clustered
“Heng Wang, Jielin Qiu, Wenting Zhao, Cheng Qian, Liangwei Yang, Jiawei Han, Heng Ji, Silvio Savarese, Shelby Heinecke, Huan Wang Random Attention: Rethinking KV Cache Eviction for Efficient Reasoning https://arxiv.org/abs/2609.03430”
“Salesforce AI Research's "Random Attention" improves KV cache eviction, enhancing reasoning model throughput by 32-43%, matching top methods without complex scoring. This innovation underscores the power of reasoning traces, boosting memory efficiency in LL…”
spurious CoT termination reasoning paper
2 directory members surfaced this signal.
2 experts
1 community
1 sources clustered
“Seunghee Koh, Sungjae Choi, Minchan Kwon, Sunghyun Baek, Junmo Kim </think> Doesn't Stop Reasoning: Analysis of Spurious CoT Termination https://arxiv.org/abs/2609.03633”
“A study reveals that injecting end-of-think tokens in reasoning can unintentionally extend reasoning into the answering phase, complicating responses. By enhancing attention to these tokens, researchers reduced redundant output and improved efficiency. http…”
cross-lingual parametric knowledge exploration paper
3 experts are actively discussing the implications.
2 experts
1 community
1 sources clustered
“Anecdotally, there’s evidence that it’s not always better to pivot to English @lchoshen.bsky.social arxiv.org/abs/2606.24579”
“Elisha Diskind, Itamar Trainin, Uri Shaham, Leshem Choshen, Idan Szpektor, Omri Abend Cross-Lingual Exploration for Parametric Knowledge https://arxiv.org/abs/2606.24579”
3 experts discussed this · 11 posts
Evangelos Kazakos: I guess obviously this is not a language property but more of what training data were used to train these models, no?
The Data Therapist in the Blue Sky : My guess is the former (language / embedding / representation similarity, assuming the differences between languages (if any) were controlled.
Evangelos Kazakos: How can you control the differences between the languages? Not really sure I understand what you mean. I was suggesting that the training data contain language X to English and language Y to Englis…
Open the full discussion →
WnW KV cache long-form speech LLMs
2 directory members surfaced this signal.
2 experts
1 community
1 sources clustered
“Yiming Yao, Chenyang Lyu, Xuanfan Ni, Longyue Wang, Weihua Luo, Yazheng Yang, Jinsong Su WnW: Waxing-and-Waning KV Cache for Long-Form Speech LLMs https://arxiv.org/abs/2608.22704”
“Researchers introduce WnW (Waxing-and-Waning KV cache), a new method that reduces memory usage for long-form speech LLMs, preserving near-full cache accuracy while managing 20% of audio tokens on GPU. This advancement enables efficient transcription of audi…”
Prefix sliding test-time scaling paper
2 directory members surfaced this signal.
2 experts
1 community
1 sources clustered
“Prefix Sliding for efficient test-time scaling "A vanilla full attention OOMs on long tasks & compaction loses important details -- prefix sliding is a simple & fast alternative that can outperform both" arxiv.org/abs/2608.26070”
“Niklas Muennighoff, Zhengyang Wang, Zeyi Chen, Weijia Shi, Binyuan Hui, John Yang, Dapeng Jiang, Mika Senghaas, Fares Obeid, Johannes Hagemann, Sami Jaghouar, Ludwig Schmidt, Percy Liang, Jason Wei, ... Prefix Sliding for efficient test-time scaling https:/…”
In-context machine translation reasoning paper
2 directory members surfaced this signal.
2 experts
1 community
1 sources clustered
“Maxime Bouthors, Josep Crego, Fran\c{c}ois Yvon Reasoning about In-Context Samples for Machine-Translation https://arxiv.org/abs/2608.27036”
“A new study shows that fragment-based reasoning in LLM machine translation greatly boosts translation quality by using retrieved exemplars, outperforming traditional methods. https://arxiv.org/abs/2608.27036”
SkillChain e-commerce AI skills paper
2 directory members surfaced this signal.
2 experts
1 community
1 sources clustered
“Yimin Hu, Mengtao Xu, Hao Guo, Yuheng Song, Xiaoyong Zhu, Bo Zheng SkillChain: Closing the Loop on Skill Evolution for Image-Based E-Commerce AI Assistants https://arxiv.org/abs/2606.12984”
“SkillChain automates skill evolution for image e-commerce AI assistants, enhancing response quality and user engagement with a three-stage lifecycle. Recent deployment shows gains in content accuracy and user retention, improving AI adaptation to user inten…”
STAR translation alignment paper
2 directory members surfaced this signal.
2 experts
1 community
1 sources clustered
“Yichen Dong, Hao Wang, Junhui Li, Linlong Xu, Longyue Wang, Weihua Luo STAR : Sentence Translation Alignment Rate for Document-to-Document Machine Translation https://arxiv.org/abs/2608.27161”
“StarPO introduces STAR, enhancing document-to-document translation with better structural fidelity, enabling compact models to surpass large systems like GPT-4o and improve token efficiency. https://arxiv.org/abs/2608.27161”
2 directory members surfaced this signal.
2 experts
1 community
1 sources clustered
“Aozhe Wang, Zhengxi Lu, Jianze Wang, Shangke Lv, Ying Liu, Weiming Lu, Jun Xiao, Yueting Zhuang, Hua Yang, Qianglong Chen, Yongliang Shen TTPO: Test-Time Policy Optimization https://arxiv.org/abs/2608.27448”
“Test-Time Policy Optimization (TTPO) boosts reasoning in language models without ground-truth labels, achieving over 25% accuracy on benchmarks. Using majority-vote pseudo-labels, TTPO refines training with asymmetric penalties and token-level selection. ht…”
Established
AI field signal
Signal
9d ago
⚡ 12 h early
2 directory members surfaced this signal.
2 experts
1 community
1 sources clustered
“Zebei Zhao, Zhihao Shi, Minqi Shi AutoVerifier: Residual-Guided Non-Parametric Optimization for Reference-Based Answer Verification https://arxiv.org/abs/2608.25637”
“AUTOVERIFIER employs a residual-guided non-parametric optimization to learn biases, boosting accuracy in answer verification. It enhances performance by transforming recurring errors into auditable logic, reaching 93.05% macro accuracy across benchmarks. ht…”