Ted Underwood

Machine learning and literary history

Uses machine learning to study literary imagination, and vice-versa. Likely to share news about AI & computational social science / Sozialwissenschaft / 社会科学 Information Sciences and English, UIUC. Distant Horizons (Chicago, 2019). tedunderwood.com

Articles & links

For fans of Talkie-1930 and all the methodological questions raised by historical models, here's a new entrant into the field, TypewriterLM, trained up to 1913. Corpus, instruction-tuning datasets, and event dataset are released. arxiv.org/abs/2606.02991

Pretraining Language Models on Historical Text arxiv.org
View on Bluesky · ♥ 113 ↻ 20 ↩ 6 · 3 from the directory shared this · 8d ago
Ted Underwood reposted
Gus @gusthema.bsky.social

Gemma 4 12B is live! 🚀 An encoder-free multimodal model (text/img/audio) for local 16GB laptops. Elite reasoning nearing 26B MoE in half the size, fast, and open (Apache 2.0). This is the main reason I was not posting much!! Glad it is launched!! blog.google/innovation-a...

Introducing Gemma 4 12B: a unified, encoder-free multimodal model blog.google
AI Weekly's analysis
  • The 35M-parameter vision embedder replaces 27 vision transformer layers, keeping the full model inside 16GB with complete image and audio understanding.
  • Audio projects from raw 16 kHz waveforms in 40ms frames directly to the LLM backbone, bypassing any separate ASR encoder used in competing designs.
  • Single-pass LoRA fine-tuning updates vision, audio, and text weights simultaneously, eliminating the engineering overhead of co-tuning frozen encoders.
Read full analysis →
View on Bluesky →
Ted Underwood reposted
Jessica Hullman @jessicahullman.bsky.social

Thoughts on metascientific consequences of AI-generated slides & ideas diluting the impression that speakers are commited to what they present. Science runs on personal attachment more than we admit. If it were a cake mix, how wouldn we add back an egg? statmodeling.stat.colum…

statmodeling.stat.columbia.edu View on Bluesky →

Recent commentary

So, naive question about these campuses that pay OpenAI $13mil/yr. Why don’t they pour that money into a cluster running the strongest available open-weight model, with API and interactive options. And if the answer is “overhead,” why aren’t we collaborating?

View on Bluesky · ♥ 497 ↻ 72 ↩ 58 · 6d ago

If the Feds’ move against Fable was an isolated thing, you might say “paranoid US regime.” But putting it together with Anthropic’s own efforts to nerf the model on ML research—and the long history of chip controls—it really feels like we’re entering an era where knowledge is behind lock & key. +

View on Bluesky · ♥ 143 ↻ 20 ↩ 10 · 5d ago

Anthropic survey of social scientists tending to support my anecdotal impression: friends who see potential value in AI mostly use it for coding (or use it dialogically), and are wary-to-disapproving about asking it to draft documents or significant sections of them. +

View on Bluesky · ♥ 79 ↻ 14 ↩ 8 · 19d ago

Every academic I know who uses or studies AI is also deeply worried about the technology’s effect on universities. Concern is universal. What separates people is how they think we should respond: whether by pumping the brakes, backing up, or trying to steer through the hazard. +

View on Bluesky · ♥ 82 ↻ 8 ↩ 5 · 1d ago

It is really necessary to publish drafts about AI instantly. If you let them sit for two months after getting readers' reports, they become historical documents and you have to revise them from scratch.

View on Bluesky · ♥ 67 ↻ 3 ↩ 2 · 18d ago

People who see value in AI are explaining popular anxiety by saying "SV did a bad sales job." Possible. More plausible, for me, is @michellegoldberg.bsky.social: anxiety is highest in the US b/c low trust in leaders generally. But also, come on—why would we ever expect AI not to provoke anxiety?

View on Bluesky · ♥ 59 ↻ 5 ↩ 4 · 29d ago

I was just checking on the meaning of this German phrase, but AI overviews thought I was saying "see ya!" and responded in kind. I actually like this kind of diffuse, free-floating personification ...

View on Bluesky · ♥ 43 ↻ 3 ↩ 6 · 20d ago

The Pope teaming up with Anthropic is how I define “ecumenical.”

View on Bluesky · ♥ 47 ↻ 3 ↩ 1 · 26d ago

Me: According to @srhm.ca, LLMs love telling stories about lighthouse-keepers, clockmakers, and librarians. @ecourtem.bsky.social, without pausing for even one second: Sure. Doesn't everyone? Those are all places where the finite world encounters the infinite. Me: ....

View on Bluesky · ♥ 31 ↻ 4 ↩ 5 · 7d ago

Academics are willing to make reasonable adjustments. So you see a lot of requests like "Okay. I don't want to be closed-minded. Show me how I can adjust my teaching to reflect AI, without—of course!—turning the class into a class *about* AI." And I wish I had answers.

View on Bluesky · ♥ 35 ↻ 2 ↩ 5 · 30d ago

In Ted Underwood's orbit

Center = Ted Underwood. Left = members they follow (green edges). Right = members who follow them (blue edges). Top = mutual follows (orange edges, slightly larger). Drag any node to reposition; click to open that profile.