β»
Maria Antoniak reposted
@sfeuerriegel.bsky.social
π£ New paper @nathumbehav.nature.com: A reporting checklist for large language models in behavioural science www.nature.com/articles/s41...
A reporting checklist for large language models in behavioural science - Nature Human Behaviour nature.com
View on Bluesky β
not wrong! bambamramfan.github.io/ai-compass/
The AI Compass bambamramfan.github.io
View on Bluesky Β·
β₯ 15
β» 2
β© 4
Β·
15 from the directory shared this Β·
8d ago
β»
Maria Antoniak reposted
β»
Maria Antoniak reposted
Juan Diego Rodriguez
@juand-r.bsky.social
2) Characterizing Narrative Content in Web-scale LLM Pretraining Data, by @teagrjohnson.bsky.social, @elliottash.bsky.social, @andrewpiper.bsky.social, @mariaa.bsky.social arxiv.org/abs/2606.19468 Why: annotation and analysis of narrative features across the pretraining data (β¦
Characterizing Narrative Content in Web-scale LLM Pretraining Data arxiv.org
AI Weekly's analysis
β
- A new arXiv preprint introduces NarraBERT, a RoBERTa-based classifier, and applies it to 3 million passages from the 3-trillion-token Dolma corpus.
- The framework operationalizes three narrative elements, agency, setting, and events, across 11 interpretable dimensions, trained on 400 annotated passages.
- The authors report narrative qualities are unequally distributed across pretraining sources and topics in ways current curation practices do not measure.
Read full analysis β
View on Bluesky β
What are people really doing with chatbots? π Turns out that a lot of them are writing/reading various kinds of fiction, and in particular, they're generating a ton of erotica! What does this mean for the future of reading? Paper: arxiv.org/abs/2606.22748 Web Explorer: ai-fictβ¦
AI Fiction in the Wild arxiv.org
View on Bluesky Β·
β₯ 62
β» 10
β© 3
Β·
2 from the directory shared this Β·
14d ago
β»
Maria Antoniak reposted
β»
Maria Antoniak reposted
β»
Maria Antoniak reposted
β»
Maria Antoniak reposted
Andrew Gordon Wilson
@andrewgwils.bsky.social
How much does a language model forget when finetuned on new tasks? We show both model size and optimization matter and forgetting can be nearly eliminated with self-generated replay! arxiv.org/abs/2605.26097 w/Martin Marek, Dongkyu Cho, Shikai Qiu, Rumi Chunara, and Pavel Izmaβ¦
[2605.26097] Forgetting in Language Models: Capacity, Optimization, and Self-Generated Replay arxiv.org
View on Bluesky β
β»
Maria Antoniak reposted
β»
Maria Antoniak reposted
β»
Maria Antoniak reposted