SemiAnalysis

Why they matter

Tracked through public AI activity and peer connections inside the directory.

AI signals
8
past 30d
Sources
4
distinct domains
Discussions
0
past 30d
Latest signal
11d ago
View every signal from SemiAnalysis →

Articles & links

Or OpenAI's blog https://t.co/rnSrr68wy0 And attend today's Jalapeño Hot Chips session with Richard, Ravi, and Chris from OpenAI too. (7/7)

openai.com
View on Bluesky · ♥ 0 ↻ 0 ↩ 0 · 7 from the directory shared this · 11d ago

AgentX - InferenceXv3: Does CUDA Moat Hold up in Agentic Inferencing? $3 Million USD dataset open sourced, 1 Mil+ Context Length, Multiturn, Sub Agents 95%+ KVCache HitRate, GB300 NVL72, MI355, B200 https://t.co/PgtKNYXdFr

AgentX - InferenceXv3: Does CUDA Moat Hold up in Agentic Inferencing? newsletter.semianalysis.com
AI Weekly's analysis
  • SemiAnalysis's AgentX 1.0, built on 393 anonymized Claude Code traces at 1M+ context, cost more than $3M and used ~2MW across 1000+ chips.
  • On Qwen3.5 SGLang the report puts Nvidia at 'over 20x better performance' at 90 tok/s/user; B300 FP4 shows '12x better performance per dollar' vs H100.
  • AMD's ATOM stack shows strong single-GPU kernels but almost no production adoption — only one Alibaba ad unit runs it live, the authors say.
Read full analysis →
View on Bluesky · ♥ 0 ↻ 0 ↩ 0 · 2 from the directory shared this · 13d ago

TokenBudgeting: Our Conversations with Enterprises on Token Spend Was Widespread TokenMaxxing Ever Really Here? https://t.co/tgNssBBGVk

TokenBudgeting: Our Conversations with Enterprises on Token Spend newsletter.semianalysis.com
AI Weekly's analysis
  • Meta employees consumed over 60 trillion tokens in a 30-day window in early 2026, with one individual alone accounting for about 280 billion.
  • Monthly per-employee caps now range from $250 at an aerospace and defense manufacturer to $2,000 at Workday and Stripe, with no cross-industry consensus.
  • Ramp data cited by SemiAnalysis shows 99th percentile customers spend about $90,000 per employee per year while the median customer spends $136.
Read full analysis →
View on Bluesky · ♥ 0 ↻ 0 ↩ 0 · 2 from the directory shared this · 67d ago

https://t.co/kmFqrIAzF2 (2/2)

AgentX Methodology and Datasets | InferenceX inferencex.semianalysis.com
AI Weekly's analysis
  • AgentX v1.0 turns 393 opt-in Claude Code sessions into a replay benchmark, with a median 142k input tokens and 444 output tokens per request.
  • To share traces safely, inputs are reduced to session-scoped chained hashes in 64-token blocks that preserve matching prefixes but not content.
  • SemiAnalysis says the benchmark's biggest first-months output was 50+ upstream pull requests from partners including vLLM, SGLang and TensorRT-LLM.
Read full analysis →
View on Bluesky · ♥ 0 ↻ 0 ↩ 0 · 12d ago

Cerebras's Next Generation CS-4: Fast Just Got Faster Double the Performance, Double the Power, Double the Fun https://t.co/qUgaBrNOYA

Cerebras's Next Generation CS-4: Fast Just Got Faster newsletter.semianalysis.com
AI Weekly's analysis
  • Cerebras CS-4 delivers more than 4,400 tokens per second per user on GPT-OSS-120B, up to 30 times a GPU inference baseline.
  • Each rack pairs three WSE-3 Turbo wafers for 750 PFLOPS, 129.6 PB/s of memory bandwidth, and two-microsecond wafer-to-wafer latency.
  • AMD Instinct and AWS Trainium handle prompt processing while CS-4 acts as the decode accelerator; first shipments begin this quarter.
Read full analysis →
View on Bluesky · ♥ 0 ↻ 0 ↩ 0 · 18d ago

We discuss the potential TPU beneficiaries in our Core Research Exclusive Note, "TPU Long and Prosper: Don't Cry Because Gemini's Over, Smile Because TPU Happened." (3/3) https://t.co/Onejdf8iMG

SemiAnalysis Core Research semianalysis.com
AI Weekly's analysis
  • SemiAnalysis projects more than $100 million in 2026 revenue, up from roughly $20 million a year earlier, according to The Information.
  • Core Research is one of four institutional products, aimed at hedge funds, long-only asset managers, venture investors and corporate strategy teams.
  • The Substack newsletter reaches 200,000-plus subscribers but is sold separately from the institutional models and Core Research.
Read full analysis →
View on Bluesky · ♥ 0 ↻ 0 ↩ 0 · 18d ago

To learn more about ICI networking topology, please refer to our networking model (8/8) https://t.co/kqt0IiSiFi

AI Networking Model semianalysis.com
AI Weekly's analysis
  • SemiAnalysis is offering device-level tracking of AI cluster networking across five fabric layers, with data running 2023 to 2026.
  • Coverage spans 80+ hyperscaler configuration panels for Microsoft, Google, Meta, Amazon, Oracle, X.AI and neoclouds, tied to specific accelerator SKUs.
  • 25+ suppliers are tracked, including Nvidia, Arista, Broadcom, Cisco, Coherent and Lumentum, across 200G to 1.6T transceiver speeds.
Read full analysis →
View on Bluesky · ♥ 0 ↻ 0 ↩ 0 · 19d ago

To learn more, check out our Datacenter Model, which covers BitDeer, and our AI TCO Model, which covers the economics of NeoClouds. 6/6🧵 https://t.co/wACjpkQLM8 https://t.co/EeBYF4i2ve

AI Cloud TCO Model semianalysis.com
AI Weekly's analysis
  • SemiAnalysis's AI Cloud TCO Model covers Nvidia, AMD, Intel, and custom accelerators across cost of ownership per hour, inference cost per million tokens, and training cost per FLOP.
  • The $/hr calculation is built from upfront server capex, system power consumption, colocation and electricity costs, and cost of capital, wrapped in a three-statement financial model.
  • Detailed install base projections run through 2028 and vendor unit shipment estimates through 2034, aimed at operators, procurement teams, and equity and debt investors.
Read full analysis →
View on Bluesky · ♥ 0 ↻ 0 ↩ 0 · 32d ago

Meta Compute: Everyone Wants To Be A Cloud Zuck Takes Plan B? SpaceX 2.0, Bedrock 2.0, MSL Isn't Giving Up, Scaling RecSys by 10x... ClusterMAX ranking coming soon? https://t.co/RKHoW1Du89

Meta Compute: Everyone Wants To Be A Neocloud newsletter.semianalysis.com
AI Weekly's analysis
  • Meta has contracted over 5GW of capacity across cloud and colocation, per SemiAnalysis, after nearly 10GW of deals since early 2024.
  • Meta is reportedly in final talks with Anthropic to host private Claude instances, akin to Bedrock or Vertex from rival hyperscalers.
  • SemiAnalysis pegs Meta's strategy as four-track: frontier training, 10x-plus ads recsys, Claude hosting, and SpaceX-style external rentals.
Read full analysis →
View on Bluesky · ♥ 0 ↻ 0 ↩ 0 · 65d ago

Are you SemiAnalysis? Show it.

Add the Who’s Who of AI badge to your site or bio. It links back to this profile.

Listed in AI Weekly's Who's Who of AI

Markdown: [![Listed in AI Weekly's Who's Who of AI](https://aiweekly.co/modules/custom/aiweekly_whoswho/images/whoswho-badge.svg)](https://aiweekly.co/whos-who/person/semianalysis)