Seems like a good time to share our new preprint about model openness! (with @catherinearnett.bsky.social @tylerachang.bsky.social Pamela D. Rivière, Samuel M. Taylor @camrobjones.bsky.social @seantrott.bsky.social @rplevy.bsky.social Ben Bergen, and Micah Altman): arxiv.org/a…
How Open Must Language Models be to Enable Reliable Scientific Inference? arxiv.org
AI Weekly's analysis
→
- Closed model performance can vary by up to 60% across undocumented version updates, making past benchmark results irreproducible.
- The paper defines open-weight models as providing complete weights, tokenizer, full architecture, and sufficient code to run independently.
- Authors recommend researchers justify model selection and systematically document threats to inference when using LLMs in research.
Read full analysis →
View on Bluesky ·
♥ 19
↻ 3
↩ 1
·
2 from the directory shared this ·
150d ago
See the full paper here: arxiv.org/abs/2609.16967
Target-Language Generation in Multilingual Models: Activation Steering and Optimal Control arxiv.org
Looking forward to #SNL2026! I’ll be presenting the work published in our recent JML paper about language model scaling and the N400. Find me (or email/message) if you want to chat about predictive coding and NLP in the study of human language comprehension! Paper link: doi.or…
Redirecting doi.org
AI Weekly's analysis
→
Read full analysis →