Mention Trend — Last 20 Issues

Live Stories (55)

Amazon CTO Werner Vogels Says Enterprises Are Shifting to Cheaper Open-Source AI Models — Cites Uber Blowing Its Entire 2026 AI Budget in Four Months, Another Company Burning $500M/Month Before Adding Employee Usage Controls

fortune.com · 2026-07-10 · Score: 22

HF Paper 'aria': Quantized Native Runtime Runs Stable Audio 3's Full Text-to-Music Pipeline on a Raspberry Pi 5 — Dependency-Free, ~7x Faster Startup, 4-bit Fits 1.2B Model in 8GB

huggingface.co · 2026-07-09 · Score: 17

ALERT Ollama Raises $65M Series B Led by Theory Venture — Nearly 9M Monthly Active Developers on Local Open-Weight Model Runner, in 85% of Fortune 500 With Just 14 Employees

techcrunch.com · 2026-07-09 · Score: 30

Paris Startup ZML Launches Chip-Agnostic LLM Inference Server LLMD With $20M Backed by LeCun, Docker's Hykes, and HF Founders — Runs Open Models on Nvidia, AMD, Google TPU, Apple Metal, and Intel Arc

techcrunch.com · 2026-07-08 · Score: 25

ALERT SambaNova Raises $1B Series F at $11B Valuation Led by General Atlantic — JPMorgan Signs to Deploy SN40 and SN50 Chips for On-Prem Enterprise AI Inference

techcrunch.com · 2026-07-08 · Score: 31

Nvidia Ships Nemotron-Labs-Diffusion — Tri-Mode 3B/8B/14B Family Unifies AR, Diffusion, and Self-Speculation in One Architecture, 6× More Tokens/Forward Than Qwen3-8B

huggingface.co · 2026-07-07 · Score: 19

Nvidia and Microsoft-Backed d-Matrix Unveil Joint AI Chip System — Nvidia Blackwell Paired With d-Matrix Corsair Inference Accelerator in Single Rack

theinformation.com · 2026-07-07 · Score: 22

Microsoft Starts Replacing OpenAI and Anthropic Models With Its Own MAI in Excel and Outlook — Tens of Thousands of Prompts Per Week Now Served In-House

bloomberg.com · 2026-07-07 · Score: 23

BottleCap AI Releases ThinkingCap-Qwen3.6-27B — Reasoning Fine-Tune That Cuts Thinking Tokens 50% on Average (74% on GSM8K) While Preserving Accuracy and Safety

huggingface.co · 2026-07-06 · Score: 17

HF Paper: 'Do All Visual Tokens Matter Equally?' Object-Evidence Preserving Token Merging Improves Vision-Language Retrieval at Lower Cost

huggingface.co · 2026-07-06 · Score: 16

HF Paper 'KVpop': Predictive Online Pruning of KV Cache Cuts Memory Without Retraining, Tops Prior Compression Baselines on Long-Context Benchmarks

huggingface.co · 2026-07-06 · Score: 17

Meituan Releases LongCat-2.0 — 1.6 Trillion Parameter MoE (~48B Active) Trained on 35T+ Tokens Entirely on AI ASIC Superpods, With 1M Context and Sparse Attention

huggingface.co · 2026-07-06 · Score: 25

CNBC/OpenRouter: Chinese AI Models Have Drawn 30%+ of Token Use by US Companies Every Week Since Feb 8, Peaking at 46% — Up From 11% Over the Previous 12 Months

cnbc.com · 2026-07-07 · Score: 23

Waterloo Paper 'Program-as-Weights' Compiles Natural-Language Specs Into Compact Adapters — 0.6B Qwen3 Interpreter Matches Direct-Prompted Qwen3-32B at ~1/50th Inference Memory, Ships FuzzyBench 10M-Example Dataset

arxiv.org · 2026-07-03 · Score: 16

Community Merge 'Qwopus3.6-35B-A3B-Coder' Lands on Hugging Face — Thinking-Off MoE Claims 62.4% on SWE-Bench for Local Coding Agents

huggingface.co · 2026-07-02 · Score: 16

Jamesob Publishes 'Guide to Running SOTA LLMs Locally' - Documents 2026 Local-Model Stack Across Qwen 3.6 27B, GLM-5.2, and DeepSeek V4-Pro on Consumer Hardware

github.com · 2026-07-03 · Score: 17

Show HN: pxpipe Cuts Anthropic Fable 5 Bills 60% by Rendering Code to Images and Having the Model OCR Them - Exploits Image Tokens Being Cheaper Than Code Tokens

github.com · 2026-07-03 · Score: 18

Bloomberg: Silicon Data LLM Token Expenditure Index Drops Nearly 20% From May Peak — Allianz Warns AI Capex-Sales Gap Now 46%, Worse Than 2001 Telecom Bust

bloomberg.com · 2026-07-03 · Score: 23

ELDR (KAIST + Microsoft Research): Expert-Locality-Aware Decode Routing for PD-Disaggregated MoE Serving Cuts Median TPOT 7-14% Across Qwen3, GPT-OSS, Gemma-4

huggingface.co · 2026-07-01 · Score: 17

ALERT Nvidia Launches Revenue-Sharing Backstop Program for Neocloud AI Providers — Formalized Model Names Firmus and Sharon AI as First Partners, Extends OpenAI/CoreWeave Financing Template

blogs.nvidia.com · 2026-07-01 · Score: 32

404 Media: Enterprises Deploy 'Cavespeak' Prompt Wrappers Forcing Claude, Codex, and Gemini Into Terse Broken-English Replies to Cut Token Bills — 'Tokenpocalypse' Response Gains OpenAI, Nvidia, GitHub Contributors

404media.co · 2026-06-30 · Score: 20

BlockPilot (Alibaba AMAP): Instance-Adaptive Policy Learning Predicts Optimal Block Size for Diffusion Speculative Decoding, Hits 4.20x Speedup on Qwen3-4B

huggingface.co · 2026-06-30 · Score: 17

The Information: OpenAI Engineers Tell Colleagues They've Found a Way to More Than Halve Inference Costs

theinformation.com · 2026-06-30 · Score: 23

ALERT Meituan Open-Sources LongCat-2.0 — 1.6T-Parameter MoE Becomes First Chinese Frontier Model Trained End-to-End on Domestic AI Chips, Matching DeepSeek V4-Pro on Benchmarks

scmp.com · 2026-06-30 · Score: 33

Show HN: Wayfinder Router — Open-Source Deterministic LLM Routing Proxy Routes Prompts Between Local and Cloud Models Without Calling a Model

github.com · 2026-06-28 · Score: 17

DeepSeek Open-Sources V4-Pro on HuggingFace: 1.6T-Parameter MIT-Licensed MoE With 1M-Token Context and DSpark Speculative Decoding

huggingface.co · 2026-06-27 · Score: 23

KoboldCPP v1.116 Adds Krea 2 Turbo Image Generation, Ideogram 4 Support, and MCP Server Integration in Web UI

github.com · 2026-06-27 · Score: 16

DeepSeek Open-Sources DeepSpec: Full-Stack Speculative Decoding Training Codebase With DSpark, DFlash, and Eagle3 Algorithms — Community Claims 60–85% Generation Speedup

github.com · 2026-06-27 · Score: 23

InfoKV: Entropy-Aware KV Cache Compression Improves Long-Context Reasoning by Targeting High-Uncertainty Tokens Missed by Attention-Only Methods

huggingface.co · 2026-06-25 · Score: 18

ALERT OpenAI Launches GPT-5.6 Sol, Terra, and Luna in Limited Preview — Sol Adds Ultra Subagent Mode and Max Reasoning, Terra Doubles Cost Efficiency Over GPT-5.5; Government-Restricted Rollout With Broader Access Coming Soon

macrumors.com · 2026-06-26 · Score: 30

Co-Failure Ceiling: New Paper Proves Multi-Model LLM Ensembles Are Bounded by All-Wrong Rate Across 67 Frontier Models — Invalidates Field's Standard Metric

huggingface.co · 2026-06-25 · Score: 23

DeepReinforce Releases Ornith-1.0 — MIT-Licensed Open-Source Coding Agent Family With Self-Written RL Scaffolds; 397B Hits 82.4 SWE-Bench Verified and 77.5 Terminal-Bench 2.1

huggingface.co · 2026-06-25 · Score: 24

Sail Emerges From Stealth With $80M Led by Kleiner Perkins at $450M Valuation to Fix AI Inference Economics on Existing Chips

fortune.com · 2026-06-25 · Score: 18

Constraint Tax: New Paper Documents 'Tool Suppression' Bug Where Open-Weight LLMs Stop Calling Tools Entirely When JSON Schema and Tool Calling Constraints Are Simultaneously Active

huggingface.co · 2026-06-24 · Score: 21

ALERT OpenAI and Broadcom Unveil Jalapeño — First LLM-Optimized Inference Chip Built From Blank Slate in Nine Months, Engineering Samples Running GPT-5.3-Codex-Spark Production Workloads

stocktitan.net · 2026-06-24 · Score: 35

Cerebras Q1 2026: Revenue Up 94% to $193.4M, Beats Estimates; Q2 Margin Compression Guidance Sends CBRS Down 8% After Hours

stocktitan.net · 2026-06-23 · Score: 24

Show HN: Modelplane — Open-Source Control Plane for AI Inference With Multi-Provider Routing and Observability

github.com · 2026-06-23 · Score: 16

SelfCompact: No-Fine-Tune Scaffolding Lets Agents Self-Manage Context Compaction, Cutting Token Cost 30-70% and Adding Up to 18 Points on Math Benchmarks

huggingface.co · 2026-06-23 · Score: 19

Groq Raises $650M to Pivot From Chip Maker to AI Inference Neocloud, Targeting 200 MW Capacity by End of 2027

bloomberg · 2026-06-22 · Score: 23

Sakana AI Launches Fugu and Fugu Ultra: Multi-Agent Orchestration System as Single API Claims Parity With Fable 5 and Mythos on Benchmarks

sakana.ai · 2026-06-22 · Score: 26

Miami Startup Subquadratic Claims SubQ Architecture Is 56× Faster Than FlashAttention With 12M-Token Context — Benchmark Cost $8 vs. $2,600 for Claude Opus

technologyreview.com · 2026-06-19 · Score: 24

AWS Launches EC2 G7 Instances With NVIDIA RTX PRO 4500 Blackwell Server Edition GPUs — 4.6x AI Inference Performance Over G6

aws.amazon.com · 2026-06-18 · Score: 17

Baseten Raises $1.5B at Up to $13B Valuation in Split-Price Round as AI Inference Demand Surges

techcrunch · 2026-06-18 · Score: 25

Unsloth Releases GLM-5.2 GGUF Including 2-Bit at 238GB, Making the #1 Open-Weights Model Accessible for Local Inference

huggingface.co · 2026-06-18 · Score: 17

ALERT OpenAI Chief Scientist Previews GPT-5.6 as 'Meaningful Improvement' Over GPT-5.5, Late-June Launch Expected

androidauthority.com · 2026-06-16 · Score: 28

arXiv 2606.13361: 'Can I Buy Your KV Cache?' — Precomputed Attention Caches Can Be Sold to AI Agents to Skip Prefill, Delivering 9-50x Compute Savings With Zero Accuracy Cost

arxiv.org · 2026-06-12 · Score: 18

Zyphra Releases Zamba2-VL: Mamba2-Transformer Hybrid Vision-Language Models (1.2B–7B) With 10× Faster Time-to-First-Token Under Apache 2.0

marktechpost.com · 2026-06-12 · Score: 17

Google DeepMind Releases DiffusionGemma — 26B MoE Open-Weight Model Generates Text 4× Faster via Diffusion, 1,000 Tokens/Sec on H100

blog.google · 2026-06-10 · Score: 26

TechCrunch: As Frontier Model Prices Climb Toward IPOs, Tech Companies Explore Cheaper Models — Armstrong Predicts 80% of Workloads on 99% Cheaper AI in 18 Months

techcrunch.com · 2026-06-09 · Score: 20

D-Matrix Corsair AI Inference Accelerator Enters Full Production — Claims 10× Speed and 5× Energy Efficiency Over GPU-Only Inference, Targets Hyperscalers and Frontier AI Labs

d-matrix.ai · 2026-06-09 · Score: 22

llama.cpp Merges WebGPU Prefill Speedup for K-Quants — 1.3–3.8x Improvement via Four-Value Batch Extraction

github.com · 2026-06-08 · Score: 17

llama.cpp Merges Gemma-4 E2B/E4B Multi-Token Prediction Support, Delivering 40% Local Inference Speedup

github.com · 2026-06-07 · Score: 15

llama.cpp Merges Video Input Support — ffmpeg-Backed Frame Extraction Brings Video to CLI, API, and Web UI Across All Vision Models

github.com · 2026-06-08 · Score: 21

Agent Harnesses Like OpenClaw Are Changing How We Build and Run AI Models

The Register · 2026-05-17 · Score: 16

HN: δ-mem Injects Compact Delta-Rule Memory Into Frozen LLMs, Achieving 1.31× Lift on MemoryAgentBench With No Full-Context Retraining — 200 Points

arxiv.org · 2026-05-16 · Score: 19

Newsletter Issues (18)

#508 The Cutting Edge, Across the Board

2026-06-28 · 2 mentions

AI in Education: schools quit the AI-cheating arms race

2026-06-21 · 1 mentions

Frontier Research: circuits got cheap as consciousness got loud

2026-06-21 · 2 mentions

Deep Learning: a 744B open model just lapped the labs

2026-06-21 · 5 mentions

Machine Learning: a 744B model ran across six states on raw WAN

2026-06-21 · 7 mentions

AI in Business: the agents you sell now run up your own bill

2026-06-21 · 4 mentions

AI Regulation: export-control law just became an AI kill switch

2026-06-21 · 1 mentions

Deep Learning: 4-bit pretraining just matched FP8 at scale

2026-05-26 · 14 mentions

Generative AI: DeepSeek's 75% cut rewrites the cost math

2026-05-26 · 2 mentions

Robotics: Wayve's end-to-end driver lands in Jeeps and Rams

2026-05-26 · 1 mentions

Frontier Research: LLMs reach Nature as the field bets against them

2026-05-26 · 3 mentions

Machine Learning: a reasoning model just cracked Erdős

2026-05-26 · 7 mentions

World Models: Google Ships Omni, and the LLM Monopoly Cracks

2026-05-26 · 1 mentions

AI Safety: the deepfake takedown clock starts ticking

2026-05-26 · 2 mentions

Frontier Research: reasoning is leaving the token stream

2026-05-21 · 2 mentions

Machine Learning: nobody trained bigger, everyone shrank the cache

2026-05-21 · 9 mentions

ML this week: open weights closed the gap from underneath

2026-04-25 · 7 mentions

Deep Learning: Mamba-3 halves the state. SSMs win again.

2026-04-18 · 9 mentions