Who's Who of AI

Catherine Arnett

365 trust researcher @catherinearnett.bsky.social · 4,030 followers
NLP Researcher at EleutherAI, PhD UC San Diego Linguistics. Interested in multilingual NLP, tokenizers, open science. đź“ŤBoston. She/her. https://catherinearnett.github.io/
What they're sharing

Articles & links

↻ Catherine Arnett reposted
James Michaelov @jamichaelov.bsky.social

Seems like a good time to share our new preprint about model openness! (with @catherinearnett.bsky.social @tylerachang.bsky.social Pamela D. Rivière, Samuel M. Taylor @camrobjones.bsky.social @seantrott.bsky.social @rplevy.bsky.social Ben Bergen, and Micah Altman): arxiv.org/a…

How Open Must Language Models be to Enable Reliable Scientific Inference? arxiv.org
AI Weekly's analysis →
  • Closed model performance can vary by up to 60% across undocumented version updates, making past benchmark results irreproducible.
  • The paper defines open-weight models as providing complete weights, tokenizer, full architecture, and sufficient code to run independently.
  • Authors recommend researchers justify model selection and systematically document threats to inference when using LLMs in research.
Read full analysis →
 View on Bluesky →
Their network

In Catherine Arnett's orbit

Center = Catherine Arnett. Left = members they follow (green edges). Right = members who follow them (blue edges). Top = mutual follows (orange edges, slightly larger). Drag any node to reposition; click to open that profile.