↻
Micah G. Allen reposted
@cstrauch.bsky.social
How much of a risk are LLM-generated bots for online behavioral experiments? We present results of an entirely natural language prompt-generated agent, capable of absolving any of the 26 experiments we tested it on. Most tasks are passed with data that can pass as human osf.io…
OSF osf.io
View on Bluesky →
↻
Micah G. Allen reposted
@smfleming.bsky.social
Hi yes we have a new page on our lab wiki on this here: metacoglab.github.io/lab_wiki/ai_...
AI usage metacoglab.github.io
View on Bluesky →
This is still very much WIP but we have this “lab book” for in depth guidance on how to use agentic coding (e.g. Claude code) in the lab, largely adopted from @russpoldrack.org’s book chapter, a few other sources, and our own experience. I’m working on a new lab manual. www.th…
Agents in the Lab the-ecg.org
↻
Micah G. Allen reposted
@kiante.bsky.social
We have been documenting agents' capabilities to take on these sorts of tasks across a wide range of cognitive paradigms. The current state is even better than some of these initial benchmarks suggest as well (under review at NeurIPS this year). cog-arena.vercel.app
CogArena — AI Agent Cognitive Benchmark cog-arena.vercel.app
View on Bluesky →
as many as 34% self report doing this in one study... journals.sagepub.com/doi/pdf/10.1... 9% detected here journals.sagepub.com/doi/10.1177/... it is a real problem to be sure. we were shocked that Sol could do our task as easily and convincingly as it did.
journals.sagepub.com
as many as 34% self report doing this in one study... journals.sagepub.com/doi/pdf/10.1... 9% detected here journals.sagepub.com/doi/10.1177/... it is a real problem to be sure. we were shocked that Sol could do our task as easily and convincingly as it did.
journals.sagepub.com
ok, the first is not comforting at all, that reads like cope from a company whose entire existence may be in jeapordy. the second at least seems to indicate that you just manually reject such participatns. researcher-help.prolific.com/en/articles/... researcher-help.prolific.c…
How do I prevent AI-generated responses in my study? | Prolific Research researcher-help.prolific.com