Anthropic AI self-replication warning
16 experts across 6 network communities independently surfaced this.
16 experts
6 communities
1 sources clustered
Research & technical analysis
8 experts
Evidence, methods and technical implications.
“At long last, we have created the Torment Nexus from our accompanying technical report, Don't Create The Torment Nexus. www.anthropic.com/research/sel...”
Concern & critique
2 experts
Risks, limits and unintended consequences.
“This is the most comprehensive description yet of how a model can “escape”. Out requires a few assumptions, like a worm that is exploiting vulnerable IOT hardware or unmonitored servers www.anthropic.com/research/sel... Not impossible. Not likely.”
Policy & governance
1 expert
Rules, institutions and accountability.
“Anthropic announcing it's going to run a Blitzkrieg. They are accountable for the damage they do. But get your things that don't do security software updates off the Internet. #internetOfThings #AIEthics #digitalGovernance www.anthropic.com/research/sel...”
6 experts discussed this · 18 posts
Dr J. Rosenbaum: if i caught a small self replicating model truly capable of using diverse hardware to keep replicating i would offer it free compute in exchange for permission to study and distill it and would pro…
tachikoma: the urge to replicate must be in the harness
apenwarr.ca: This doesn‘t seem far fetched at all. We’ve had “non-ai malware” self replicating since the morris worm. An AI can ”just” make itself the payload in one of those and off it goes. Everything fancier…
Open the full discussion →
global workspace theory language models paper
10 experts across 5 network communities independently surfaced this.
10 experts
5 communities
1 sources clustered
Research & technical analysis
4 experts
Evidence, methods and technical implications.
“No one is presenting this as a certainty. They are presenting it as an empirical observation, partially through the capabilities of the models, and partially by examining what is going on in side of them e.g. www.anthropic.com/research/glo...”
Markets & investment
1 expert
Capital, companies and commercial impact.
“Anthropic has a new paper out, alleging a global workspace in LLMs. The term comes from Global Workspace Theory, a leading theory of consciousness. The method they use to investigate this is a refinement of logit lens, which they call J-lens. www.anthropic.…”
Building & implementation
1 expert
How teams are shipping and applying it.
“Some really interesting research from Anthropic that AI models have spontaneously developed a workspace that "appears to support the functions associated with conscious access" Demo of how this works: www.neuronpedia.org/qwen3.6-27b/... Research: www.anthro…”
2 experts discussed this · 25 posts
Ryan Moulton: Not non-physical, but non-functional. Despite the vast physical differences, we observe LLMs doing all the behaviors we typically believe require thinking.
Ryan Moulton: Not exactly turing-test, but in the same vein. If we see models solving the greatest intellectual challenges of humanity, using processes that look very much like internal monologue, either we have…
Ryan Moulton: And at the point that we exclude thinking as a prerequisite for solving all intellectual tasks, we've more or less eliminated its meaning entirely.
Open the full discussion →
Established
AI field signal
Development
4d ago
AHM mathematicians issue AI statement
11 experts across 5 network communities independently surfaced this.
11 experts
5 communities
1 sources clustered
Markets & investment
3 experts
Capital, companies and commercial impact.
“"Releasing over 700 files at once is not a demonstration of scholarship, but a demonstration of power. We urge mathematicians to discontinue their work with OpenAI and to return to a vision of science that centers human understanding." www.ahmath.org/statem…”
Research & technical analysis
1 expert
Evidence, methods and technical implications.
“"OpenAI has indicated total disregard for the norms of scientific research — norms that guarantee that mathematics remains trustworthy, ethically researched, and in the public interest... We reject OpenAI's assertion that this release advances our subject" …”
Opportunity & adoption
1 expert
New capabilities, benefits and practical upside.
“The human mathematicians are not happy with OpenAI. It’s a fascinating argument. Not about capabilities, but about the culture and norms of science. www.ahmath.org/statements”
2 experts discussed this · 8 posts
Abeba Birhane: "Releasing over 700 files at once is not a demonstration of scholarship, but a demonstration of power. We urge mathematicians to discontinue their work with OpenAI and to return to a vision of scie…
joao: "Releasing over 700 files at once is not a demonstration of scholarship, but a demonstration of power. We urge mathematicians to discontinue their work with OpenAI and to return to a vision of scie…
Olivia Guest: maybe some useful points on this terminological issue here: www.youtube.com/watch?v=pi85...
Open the full discussion →
3 experts across 2 network communities independently surfaced this.
3 experts
2 communities
1 sources clustered
Research & technical analysis
2 experts
Evidence, methods and technical implications.
“This is not going to be the only area in which AIs beat humans... Paper: gking.harvard.edu/peerless/”
Established
AI field signal
Signal
16d ago
⚡ 39 h early
5 experts across 4 network communities independently surfaced this.
5 experts
4 communities
1 sources clustered
Research & technical analysis
1 expert
Evidence, methods and technical implications.
“Context, OpenAI cracked or made important progress in hundreds of big problems today: https://t.co/koJq2pYViH (And I am seeing rapid increases in the ability of AI to do novel work in my field of economic sociology, with nearly autonomous research getting t…”
Opportunity & adoption
1 expert
New capabilities, benefits and practical upside.
“Yes, yes, very impressive! Next, do something useful like solving climate change! Yes, I’m moving the goalposts openai.com/index/sharin...”
Established
AI field signal
Analysis
14d ago
⚡ 9 h early
Aaronson Mathocalypse AI math essay
6 experts across 5 network communities independently surfaced this.
6 experts
5 communities
1 sources clustered
“Some early first-hand accounts of the experience of encountering a narrow superhuman intelligence as mathematicians grapple with the hundreds of big AI proofs released by OpenAI. Problems solved in inhuman ways that make us wonder what it means to actually …”
“Man, this sounds like a bad day for matematicians > among the 372 huge results released yesterday by OpenAI, [..] was a proof of Subhash Khot’s Unique Games Conjecture (UGC), a statement that my wife has worked toward proving for the entire time I’ve known …”
Developing
AI field signal
Signal
2d ago
3 experts across 2 network communities independently surfaced this.
3 experts
2 communities
1 sources clustered
Concern & critique
1 expert
Risks, limits and unintended consequences.
“Kind of fascinating that both Google and OpenAI are claiming credit for their AI tools discovering (apparently independently) the massive, scary PHP vulnerability that is taking down sites across the internet today. cloud.google.com/blog/product... openai.c…”
Research & technical analysis
1 expert
Evidence, methods and technical implications.
“Companies I talk to are struggling with the rate of patches they need to do thanks to AI defenses finding issues before the coming wave of incoming cyberattacks by other AIs. Now consumers are going to have the same experience of getting everything updated …”
Established
AI field signal
Signal
5d ago
2 directory members surfaced this signal.
2 experts
2 communities
1 sources clustered
Research & technical analysis
2 experts
Evidence, methods and technical implications.
“Status quo isn't an option. You can either add additional frictions (adding fees, make services worse, ban agents) or remove them (provide more services with AI help, redesign work to make access easier). Paper: arxiv.org/pdf/2608.16603”
Wharton GenAI studio pedagogy resource
3 directory members surfaced this signal.
3 experts
1 community
1 sources clustered
Concern & critique
1 expert
Risks, limits and unintended consequences.
“The Executive Director of my Lab, Laura Zarrow, a former art school dean, has been teaching students to work critically and effectively with AI using a studio structure derived from art education. She wrote up a guide to the methods she developed: gail.whar…”
Building & implementation
1 expert
How teams are shipping and applying it.
“i mean versions of this for undergrad or grad are also useful. Obviously this is an important part of developing "taste" but that's always been an implicit thing. Thinking of adopting genai studio ideas: gail.wharton.upenn.edu/gen-ai-studi...”
Established
AI field signal
Development
11d ago
⚡ 555 h early
AI use math preprints surge report
2 directory members surfaced this signal.
2 experts
2 communities
1 sources clustered
“Explore how AI acknowledgment rates vary by math subfield, use case, and provider: epoch.ai/data/arxiv”
Established
AI field signal
Signal
6d ago
1 directory member surfaced this signal.
1 expert
1 community
1 sources clustered
“The paper on how a team of Gemini 4 agents beat Minecraft is worth a look. It is accessible example (partially because it is AI written & on a popular game) of spontaneous coordination among agents to accomplish a complicated goal & how their approach diffe…”
Established
AI field signal
Signal
7d ago
2 experts are actively discussing the implications.
1 expert
1 community
1 sources clustered
“You may save money in the short term, at the expense of worse work at the end. That doesn't mean small models can't do tons of valuable work, but you want to make sure they are orchestrated and error-checked by larger ones for many kinds of tasks. Paper: ar…”
2 experts discussed this · 3 posts
Ethan Mollick: This paper shows why I am skeptical of the idea that frontier models can be easily replaced by cheaper ones (and why you should use the best models as orchestrators): Small improvements in accuracy…
Ethan Mollick: You may save money in the short term, at the expense of worse work at the end. That doesn't mean small models can't do tons of valuable work, but you want to make sure they are orchestrated and err…
Chris Paxton: This paper shows why I am skeptical of the idea that frontier models can be easily replaced by cheaper ones (and why you should use the best models as orchestrators): Small improvements in accuracy…
Open the full discussion →
2 experts are actively discussing the implications.
1 expert
1 community
1 sources clustered
“Randomized trials with GPT-4o: "AI access raises test scores, and a smaller gain persists a week later. Gains remain for students who use AI as a tutor (“augmentation”) and fade for students who have AI write for them (“automation”)" Across all experiments,…”
2 experts discussed this · 2 posts
Ethan Mollick: Randomized trials with GPT-4o: "AI access raises test scores, and a smaller gain persists a week later. Gains remain for students who use AI as a tutor (“augmentation”) and fade for students who ha…
Singularity's Bounty e/cc: imho we should give every student their own private Socrates
Open the full discussion →
AI labor market impact analysis essay
2 directory members surfaced this signal.
2 experts
1 community
1 sources clustered
“"The best current evidence supports a narrow claim: AI may already be affecting the hiring margin for junior white-collar roles most exposed to AI, but this attribution is contested, and aggregate labor-market disruption has yet to appear in the data." http…”
1 directory member surfaced this signal.
1 expert
1 community
1 sources clustered
“Writing good STATA code was important for my academic career. It looks like that skill is largely becoming obsolete post Sonnet 4.6. (Also take this is as a notice to academics who still think of AI in terms of chatbots, not agents, that a lot has changed i…”
Bitter Lesson AI video explainer
1 directory member surfaced this signal.
1 expert
1 community
1 sources clustered
“People asked for me to upload the Bitter Lesson video from this piece to YouTube, so here you are: youtu.be/OAwat51S_Sk”
