AI benchmarking science methodology essay
3 experts across 3 network communities independently surfaced this.
Why this matches
Research & technical analysis reaction
1 attributable expert contribution
· Frank Pasquale
““Benchmarks, he writes, are “the mistake that made machine learning.” Notably, he argues, instead of creating a replicability crisis, they drove legitimate progress anyway — “mostly by sheer luck,” in his view” www.quantamagazine.org/he-wants-ai-...”
evidence ↗
3 experts
3 communities
1 sources clustered
““Benchmarks, he writes, are “the mistake that made machine learning.” Notably, he argues, instead of creating a replicability crisis, they drove legitimate progress anyway — “mostly by sheer luck,” in his view” www.quantamagazine.org/he-wants-ai-...”
“The dark, dark art of my #FlanBenchmark... www.quantamagazine.org/he-wants-ai-...”
Established
AI field signal
Analysis
6d ago
AI spectacle world takeover essay
3 experts across 2 network communities independently surfaced this.
Why this matches
Research & technical analysis reaction
1 attributable expert contribution
· Frank Pasquale
“The math dump’s main “purpose is to produce an effect of propaganda and stupefaction, relying on scientific illiteracy and on its uncritical amplification by the media echo chamber. To produce its propaganda effect, it erases…hundreds of researchers…” europ…”
evidence ↗
3 experts
2 communities
1 sources clustered
“The math dump’s main “purpose is to produce an effect of propaganda and stupefaction, relying on scientific illiteracy and on its uncritical amplification by the media echo chamber. To produce its propaganda effect, it erases…hundreds of researchers…” europ…”
2 directory members surfaced this signal.
Why this matches
Research & technical analysis reaction
1 attributable expert contribution
· Frank Pasquale
“When one researcher has an agent email others for help, it may not be too annoying. But there are obvious problems with scale here, and I don't think the AI firms have thought them through. www.science.org/content/arti... At a bare minimum, the agent needs …”
evidence ↗
2 experts
1 community
1 sources clustered
“When one researcher has an agent email others for help, it may not be too annoying. But there are obvious problems with scale here, and I don't think the AI firms have thought them through. www.science.org/content/arti... At a bare minimum, the agent needs …”
“After years of prompting AI chatbots, the AI agents are now prompting us… https://t.co/FDjH9fphjf https://t.co/BGMk9Ut87Q”
AI upending systems research paper
1 directory member surfaced this signal.
Why this matches
Research & technical analysis reaction
1 attributable expert contribution
· Frank Pasquale
““AI is starting to transform the research process by automating the discovery of new solutions. Given a task, the typical AI-driven approach is (i) to generate a set of diverse solutions, and then (ii) to verify these solutions and select one that solves th…”
evidence ↗
1 expert
1 community
1 sources clustered
““AI is starting to transform the research process by automating the discovery of new solutions. Given a task, the typical AI-driven approach is (i) to generate a set of diverse solutions, and then (ii) to verify these solutions and select one that solves th…”
