The Who's Who of AI

What the AI community is actually reading and debating — the articles its researchers, builders, ethicists and critics are sharing, and the discussions they're having, ranked by standing inside the field.

What the directory is reading

What they're debating

Casey Fiesler on why LLMs don't really cite their sources
5 members · 29 posts ·5d ago
Casey Fiesler · Luke Stark · Eileen Clancy 🧿 · Prof. Catherine Flick · Thomas Dietterich · D. Hicks
Casey Fiesler: Particularly in the context of (appropriate) crackdowns on LLM-generated papers (e.g., on arXiv) and more and more tales of fabricated citations, two reminders: (1) LLMs do not …
Casey Fiesler: A common comment on my videos about LLM "hallucinations" is that this isn't as much of a problem because LLMs "cite their sources" now. This is a category error. Citing a source…
Casey Fiesler: So when you get LLM output with links or citations to scholarly work: those citations aren't there because the model consulted them and they actually represent the source of the…
Casey Fiesler: Therefore, the possible failure mode here isn't just fabricated citations - a model can include a real paper in a real journal by a real author, but be *completely* wrong about …
Open the thread →
8 members · 45 posts ·17d ago
M.J. Crockett · Eryk Salvaggio · Emily M. Bender · SE Gyges · Alondra Nelson · Singularity's Bounty e/cc · Maxim Raginsky · Larry Hunter · Jack Stilgoe
M.J. Crockett: Joseph Weizenbaum's 1976 book, Computer Power and Human Reason, has long been out of print - used copies sell for hundreds of dollars. It's wild that this is not more widely ava…
M.J. Crockett: Weizenbaum was an MIT computer scientist who built one of the first chatbots, ELIZA. He wrote the book out of a growing sense of horror as he saw how “extremely short exposures …
M.J. Crockett: Another version of the program, called DOCTOR, simulated psychotherapy: “A number of practicing psychiatrists seriously believed the DOCTOR computer program could grow into a ne…
M.J. Crockett: He cites a psychiatrist who writes: “The human therapist, involved in the design and operation of this system, would not be replaced, but would become a much more efficient man …
Open the thread →
7 members · 9 posts ·9d ago
ICML Conference · Naomi Saphra · Christian Wolf · David Picard · Djamé 🟥 · Claas Voelcker · Eugene Vinitsky · Maria Antoniak
ICML Conference: This year, ICML maintains a presence on Twitter/X, Bsky, and LinkedIn. The other two have much higher engagement than Bsky. We would consider using Facebook as well, but we are …
ICML Conference: Note that policies on social media use may differ from year to year, and are at the discretion of the organizing committee. Another organizer for another conference in another y…
ICML Conference: We appreciate the love ❤️ But limited engagement and few followers on Bsky makes some (not us!) question whether it's worth it Be sure to follow (and share with your ML friends!…
Naomi Saphra: We appreciate the love ❤️ But limited engagement and few followers on Bsky makes some (not us!) question whether it's worth it Be sure to follow (and share with your ML friends!…
Open the thread →
7 members · 12 posts ·15d ago
Naomi Saphra · Isaiah Bishop · Ted Underwood · Joanna Bryson · Claas Voelcker · Mark J. Nelson · David Marx
Naomi Saphra: Are students embarrassed by AI cheating? Like, there has always been rare but unstigmatized dishonesty (memorizing a frat’s archive of finals questions) and common but stigmatiz…
Naomi Saphra: I don’t know exactly what dictates cheating stigma. Ease of observation? Is there something about effort, or the margin of work required to do it honestly? Regardless, AI cheati…
Isaiah Bishop: Absolutely not
Naomi Saphra: :(
Open the thread →
7 members · 11 posts ·16d ago
Christian Wolf · David Picard · Alexander Hoyle · Jacob Eisenstein · Thomas Dietterich · Eric Brachmann · Kabir Kumar, aiplans.org
Christian Wolf: The impact of Claude: it - has become very cheap to produce submissions (quality?) - remains very expensive to evaluate them by humans. Possible solutions are limited (I don't a…
David Picard: Limit the number of sub. You start the year with 2 tokens, if you want more tokens, then you review 2x per token.
Alexander Hoyle: Per some back-of-the-envelope math, I think this doesn't pan out. Even if we capped submissions at max one per author (which no one is suggesting), we'd still have at least ~10k…
Jacob Eisenstein: i agree about the dynamic, but the trend in submissions was in place well before claude
Open the thread →
5 members · 11 posts ·1d ago
Stella Biderman · Mark Riedl · Rich Harang · David Marx · Eugene Vinitsky
Stella Biderman: If you believe their story, OpenAI accidentally committed cyber warfare against Hugging Face while doing what they thought was an internal test of a model without internet acces…
Stella Biderman: If EleutherAI did this, I would be in jail. If DeepSeek did this, the government would consider it an act of cyber warfare. To be clear, this is the appropriate response. But th…
Stella Biderman: I don’t care what you think about AGI, open vs closed models, or AI technologies in general. If you don’t think that this is unacceptable you don’t care about the future.
Mark Riedl: If Anthropic did this they would have been punished again. Calvin Ball regulations are exhausting
Open the thread →
6 members · 10 posts ·14d ago
Maria Antoniak · Marzena Karpinska · Arseny Khakhalin · Christian Wolf · Thomas Dietterich · Marco Z
Maria Antoniak: hot take: don’t even use it for polishing your reviews. as an AC and SAC, the last thing i care about is your grammar, spelling, or formatting. i get the presentation issues wit…
Marzena Karpinska: funniest part is that the one i saw looked like bullet points copy-pasted from whichever-ai-tool. there was no space precisely where the bullet points changed but the person sai…
Marzena Karpinska: hot take: don’t even use it for polishing your reviews. as an AC and SAC, the last thing i care about is your grammar, spelling, or formatting. i get the presentation issues wit…
Arseny Khakhalin: Language is fixed so easily though ("please fix only typos, prepositions, grammar, and near-misses for idiomatic expressions. Don't make any substantial changes"). Or smth like …
Open the thread →
4 members · 45 posts ·2d ago
Pwnallthethings · Matthew Sheffield · Ted Underwood · SE Gyges
Pwnallthethings: This is going to be a big deal, but easy to get the wrong end of the stick on it. So I think it's worth breaking down what actually happened, why, and what it actually means, ba…
Pwnallthethings: Upfront tl;dr: a model at OAI hacked out of a constrained environment inside OAI and hacked a *different* company autonomously, without authorization from any human in order to …
Pwnallthethings: First, the task was being done by a combination of models performing an "eval". Evals are used to benchmark the basic capabilities of models. Broadly speaking, they are a test t…
Pwnallthethings: Evals cover lots of different topics, because an AI might be good at one task in one domain, but not good in another. One domain they are often now graded in is "how good are th…
Open the thread →
4 members · 20 posts ·8d ago
rev. howard arson · Eugene Vinitsky · Mary Branscombe · Colin
rev. howard arson: working on this in 2019, the reason we delayed releasing any LLMs to the public was specifically because "if we fuck this up or handle it irresponsibly, we will ruin first the w…
rev. howard arson: 2022, almost instantaneously, coinciding with Sergey Brin having gone completely fucking insane during the pandemic and then returning to involvement at Alphabet. (he spent almo…
Eugene Vinitsky: Coming from self driving...
Eugene Vinitsky: This is basically the example I give whenever I'm asked to talk about AI safety. I thought things would get regulated or controlled but actual outcomes depended entirely on whet…
Open the thread →
5 members · 7 posts ·13d ago
Gautam Kamath · Naomi Saphra · Martin Trapp · Marco · Eugene Vinitsky
Gautam Kamath: That account's bio says "parody." It got me too for a second. It would be more believable if he weren't 91 years old. I hope dude is enjoying his retirement.
Naomi Saphra: Anthropic just hired Gilbert Strang???
Martin Trapp: What a strange world we live in nowadays.
Marco: it fooled me also haha
Open the thread →
5 members · 10 posts ·5d ago
Ted Underwood · Eryk Salvaggio · Eugene Vinitsky · Arseny Khakhalin · Erin Kissane
Ted Underwood: The Science article brouhaha is doing a great job of clarifying the boundary between "critiquing new developments while remaining engaged with them" and "retreating to a commune…
Ted Underwood: American analogy, I guess; Europeans can substitute ... Lebensreform? followers of Tolstoy eating only brown bread?
Eryk Salvaggio: Genuinely no offense taken but I want you to know that I am in Rochester NY eating a sprouted spelt flour biscuit as I read this
Eugene Vinitsky: Brown bread is incredible and should not be besmirched. I hope the Eastern European community never finds out about this post
Open the thread →
5 members · 12 posts ·16d ago
Marzena Karpinska · David Mimno · David Jurgens · Alexander Hoyle · Carlos Gómez-Rodríguez
Marzena Karpinska: Only 17% of May #ARR authors are qualified for reviewing, and almost 40% of papers have no qualified people?!?!
David Mimno: is anyone there suggesting not allowing submissions with no qualified reviewers? Elitist and gate-keepy yes, but is there a better option?
Marzena Karpinska: Yes, that's precisely what was suggested.
David Jurgens: I crunched some numbers for the Jan26 cycle and many of these papers do have senior author (e.g., 62% have a prof co-author), but these folks are often from related non-ACL fiel…
Open the thread →