↻
Maria Antoniak reposted
@sfeuerriegel.bsky.social
📣 New paper @nathumbehav.nature.com: A reporting checklist for large language models in behavioural science www.nature.com/articles/s41...
A reporting checklist for large language models in behavioural science - Nature Human Behaviour nature.com
View on Bluesky →
not wrong! bambamramfan.github.io/ai-compass/
The AI Compass bambamramfan.github.io
View on Bluesky ·
♥ 15
↻ 2
↩ 4
·
15 from the directory shared this ·
8d ago
↻
Maria Antoniak reposted
↻
Maria Antoniak reposted
Juan Diego Rodriguez
@juand-r.bsky.social
2) Characterizing Narrative Content in Web-scale LLM Pretraining Data, by @teagrjohnson.bsky.social, @elliottash.bsky.social, @andrewpiper.bsky.social, @mariaa.bsky.social arxiv.org/abs/2606.19468 Why: annotation and analysis of narrative features across the pretraining data (…
Characterizing Narrative Content in Web-scale LLM Pretraining Data arxiv.org
AI Weekly's analysis
→
- A new arXiv preprint introduces NarraBERT, a RoBERTa-based classifier, and applies it to 3 million passages from the 3-trillion-token Dolma corpus.
- The framework operationalizes three narrative elements, agency, setting, and events, across 11 interpretable dimensions, trained on 400 annotated passages.
- The authors report narrative qualities are unequally distributed across pretraining sources and topics in ways current curation practices do not measure.
Read full analysis →
View on Bluesky →
What are people really doing with chatbots? 👀 Turns out that a lot of them are writing/reading various kinds of fiction, and in particular, they're generating a ton of erotica! What does this mean for the future of reading? Paper: arxiv.org/abs/2606.22748 Web Explorer: ai-fict…
AI Fiction in the Wild arxiv.org
View on Bluesky ·
♥ 62
↻ 10
↩ 3
·
2 from the directory shared this ·
14d ago
↻
Maria Antoniak reposted
↻
Maria Antoniak reposted
↻
Maria Antoniak reposted
↻
Maria Antoniak reposted
Andrew Gordon Wilson
@andrewgwils.bsky.social
How much does a language model forget when finetuned on new tasks? We show both model size and optimization matter and forgetting can be nearly eliminated with self-generated replay! arxiv.org/abs/2605.26097 w/Martin Marek, Dongkyu Cho, Shikai Qiu, Rumi Chunara, and Pavel Izma…
[2605.26097] Forgetting in Language Models: Capacity, Optimization, and Self-Generated Replay arxiv.org
View on Bluesky →
↻
Maria Antoniak reposted
↻
Maria Antoniak reposted
↻
Maria Antoniak reposted