Mandana Samiei, Eunice Yiu, Anthony GX-Chen, Dongyan Lin, Jocelyn Shen, Blake A. Richards, Alison Gopnik, Doina Precup Human Adults and LLMs as Scientists: Who Benefits from Active Exploration? https://arxiv.org/abs/2606.06464
Human Adults and LLMs as Scientists: Who Benefits from Active Exploration? arxiv.org
AI Weekly's analysis
→
Read full analysis →
Fitsum Reda, John Kamalu, Roger Waleffe, Mostofa Patwary, Mohammad Shoeybi, Bryan Catanzaro Nemotron-TwoTower: Diffusion Language Modeling with Pretrained Autoregressive Context https://arxiv.org/abs/2606.26493
Nemotron-TwoTower: Diffusion Language Modeling with Pretrained Autoregressive Context arxiv.org
AI Weekly's analysis
→
- NVIDIA's Nemotron-TwoTower splits an LM into a frozen autoregressive context tower and a trainable diffusion denoiser with bidirectional block attention.
- The system is built on Nemotron-3-Nano-30B-A3B, a 30B hybrid Mamba-Transformer MoE backbone, and trained on roughly 2.1 trillion tokens.
- The authors report retaining 98.7% of the autoregressive baseline's quality while delivering 2.42x higher wall-clock generation throughput.
Read full analysis →
Sangyun Lee, Sean McLeish, Tom Goldstein, Giulia Fanti Language Models Need Sleep https://arxiv.org/abs/2605.26099
[2605.26099] Do Language Models Need Sleep? Offline Recurrence for Improved Online Inference arxiv.org
Qihan Wang, Nicholas Tomlin, Michael Hu, Brian Dillon, Tal Linzen Simulating Human Memory with Language Models https://arxiv.org/abs/2605.25680
[2605.25680] Simulating Human Memory with Language Models arxiv.org
Joseph Marvin Imperial, Junhong Liang, Belal Shoer, Abdullah Barayan, Rodrigo Wilkens, Omar Mussa, Dawn Knight, Eug\'enio Ribeiro, Ekaterina Kochmar, ... ComplexityMT: Benchmarking the Interaction Between Text Complexity and Machine Translation https://arxiv.org/abs/2606.05421
ComplexityMT: Benchmarking the Interaction Between Text Complexity and Machine Translation arxiv.org
AI Weekly's analysis
→
- ComplexityMT benchmarks machine translation across Arabic, Dutch, English, French, Hindi and Russian using CEFR as the measure of text complexity.
- Higher CEFR levels make texts more difficult to translate, and MT systems shift the CEFR level of the target versus the source for most languages.
- The study evaluates three open-weight models, one closed model and one commercial machine translation system on two CEFR-grounded tasks.
Read full analysis →
Zhiyun Zhang, Liwen Sun, Xiang Qian, Chenyan Xiong FaithMed: Training LLMs For Faithful Evidence-Based Medical Reasoning https://arxiv.org/abs/2607.01440
FaithMed: Training LLMs For Faithful Evidence-Based Medical Reasoning arxiv.org
AI Weekly's analysis
→
- FaithMed uses clinician-designed rubrics refined automatically to supervise how LLMs appraise evidence during medical reasoning.
- Across seven medical benchmarks, the paper reports +9% over agentic-search baselines and +5.8% over outcome-only RL.
- Evidence-based medicine rubric scores rose 15.5% against agentic-search Qwen3 baselines, per the abstract.
Read full analysis →
Gianmarco Spinaci, Lukas Klic, Giovanni Colavizza EduArt: An educational-level benchmark for evaluating art history knowledge in large language models https://arxiv.org/abs/2607.02007
EduArt: An educational-level benchmark for evaluating art history knowledge in large language models arxiv.org
AI Weekly's analysis
→
- EduArt tests LLMs with 871 human-authored art history questions drawn from Italian secondary-school and US AP exams.
- The benchmark spans two languages and seven question formats and evaluates twelve models from six provider families.
- Models near 94% on multiple-choice fell to 23.9% on open completion and 6.2% on error identification.
Read full analysis →
A. Seza Do\u{g}ru\"oz, Xixian Liao, Verena Blaschke, Jakob Prange, Senyu Li, David Ifeoluwa Adelani Challenges and Recommendations for LLMs-as-a-Judge in Multilingual Settings and Low-Resource Languages https://arxiv.org/abs/2607.02235
Challenges and Recommendations for LLMs-as-a-Judge in Multilingual Settings and Low-Resource Languages arxiv.org
AI Weekly's analysis
→
- A new arxiv paper surveyed 650 ACL Anthology papers on LLM-as-a-Judge and found only 33 focused on low-resource or multilingual settings.
- The authors warn that LLMs have limited proficiency in low-resource languages and that adequate human validation is often absent from these evaluations.
- The audit flags inconsistent evaluation outcomes across studies and widespread reliance on a single judge model per study.
Read full analysis →
