Inference News — AI Trends, Updates & Tracker

Mention Trend — Last 20 Issues

Live Stories (34)

HN: Interfaze — New Hybrid DNN-Transformer Architecture Claims to Beat Gemini Flash and Claude Sonnet on OCR and Data Extraction Benchmarks — 117 Points, 31 Comments

news.ycombinator.com · 2026-05-11 · Score: 21

HN: 'Running Local Models on an M4 With 24GB Memory' — 176 Points as Developer Documents Full Qwen 3.5-9B Setup on Apple Silicon

jola.dev · 2026-05-10 · Score: 16

NVIDIA Releases Star Elastic: Single Training Checkpoint Containing 30B, 23B, and 12B Reasoning Models via Zero-Shot Slicing at 360x Lower Training Cost

marktechpost.com · 2026-05-09 · Score: 18

OpenRouter Analysis: GPT-5.5 API Costs Double GPT-5.4 — Real-World Developer Spend Up 49–92% Despite Token Efficiency Claims

openrouter.ai · 2026-05-08 · Score: 20

ALERT Bleeding Llama: Critical Ollama CVE-2026-7482 Exposes 300,000 AI Servers to Unauthenticated Memory Leak

csoonline.com · 2026-05-07 · Score: 28

Mojo v1.0.0b1: Modular's AI Systems Language Ships First 1.0 Beta With Native Apple Metal, AMD MI250X, and NVIDIA B300 GPU Targets

mojolang.org · 2026-05-07 · Score: 25

Google Gemini 3.1 Flash-Lite Reaches General Availability, Deprecating Preview Model on May 11

Google Cloud Blog · 2026-05-07 · Score: 25

Show HN: antirez Releases ds4 — Native Apple Metal Inference Engine for DeepSeek V4 Flash, Enabling Local 1M-Token Runs on 128GB MacBooks

github.com · 2026-05-07 · Score: 26

Zyphra Releases ZAYA1-8B: 8B MoE With 760M Active Params Claims to Match DeepSeek-R1 on Math, Trained Entirely on AMD Hardware Under Apache 2.0

prnewswire.com · 2026-05-06 · Score: 22

RadixArk Launches With $100M Seed Led by Accel to Commercialize SGLang, the Open-Source Inference Engine Serving Trillions of Tokens Daily

theaiinsider.tech · 2026-05-06 · Score: 21

DeepSeek Extends V4 Pro 75% API Discount Through May 31, Adds 1M-Token Context Integration for Claude Code and OpenCode

deepseek.com · 2026-05-07 · Score: 20

ALERT Subquadratic Exits Stealth With $29M Seed and SubQ, Claiming First Sub-Quadratic Frontier LLM With 12M-Token Context at Fraction of Transformer Cost

siliconangle.com · 2026-05-05 · Score: 29

HN: Computer Use Is 45x More Expensive Than Structured APIs — Reflex Benchmark Finds Vision Agents Burn 495K Tokens Where APIs Use 12K

reflex.dev · 2026-05-05 · Score: 25

Google Releases Multi-Token Prediction Drafters for Gemma 4, Delivering Up to 3x Inference Speedup Under Apache 2.0

blog.google · 2026-05-05 · Score: 26

Pinecone Launches Nexus Knowledge Engine and KnowQL Declarative Query Language for AI Agents

pinecone.io · 2026-05-04 · Score: 22

Panthalassa Raises $140M Series B Led by Peter Thiel to Deploy Wave-Powered AI Data Centers in the Pacific Ocean

geekwire.com · 2026-05-04 · Score: 21

Google's Unreleased Gemini 3.2 Flash Appears in LM Arena Testing Ahead of I/O 2026

geeky-gadgets.com · 2026-05-03 · Score: 23

Cerebras IPO Roadshow Opens Monday With $115–$125 Share Price Range; $10B+ in Early Indications Signals Strong Demand for Nvidia Rival

finance.yahoo.com · 2026-05-04 · Score: 19

Inference Is Giving AI Chip Startups a 2nd Chance to Shine

theregister.com · 2026-05-03 · Score: 20

Qwen 3.6-Plus debuts exclusively on Fireworks AI in landmark closed-model partnership

x.com · 2026-05-02 · Score: 18

Nebius acquires 20-person inference optimization startup Eigen AI for $643M to strengthen Token Factory platform

siliconangle.com · 2026-05-01 · Score: 27

Featherless.ai raises $20M Series A co-led by AMD Ventures and Airbus Ventures for open-source AI inference

technode.global · 2026-05-01 · Score: 17

Perplexity launches Sonar 2 in-house LLM optimized for web-grounded search

perplexity.ai · 2026-04-28 · Score: 15

DeepSeek slashes V4-Pro API prices by 75%, intensifying Chinese AI price war

Bloomberg · 2026-04-27 · Score: 27

HN: Interactive TurboQuant walkthrough of Google's ICLR 2026 KV cache compression hits front page

arkaung.github.io · 2026-04-27 · Score: 17

HN: 'How LLMs Work' interactive visual guide based on Karpathy's lecture hits front page (236 pts)

Hacker News · 2026-04-24 · Score: 16

Unpatched Ollama vulnerability (CVE-2026-5757) leaks server memory via malicious model uploads; CERT unable to reach vendor

Cyber Security News · 2026-04-24 · Score: 25

LMDeploy SSRF vulnerability (CVE-2026-33626) exploited within 13 hours of disclosure, targeting AI inference nodes

Sysdig · 2026-04-24 · Score: 23

ALERT Google unveils 8th-gen TPUs: TPU 8t for training, TPU 8i for inference

blog.google · 2026-04-22 · Score: 30

NVIDIA and Google Cloud expand AI supercomputing partnership with Vera Rubin

NVIDIA Blog · 2026-04-22 · Score: 27

ALERT Google splits TPU into two chips at Cloud Next, launches TPU 8t and TPU 8i

TechCrunch · 2026-04-22 · Score: 32

General Compute launches ASIC-first inference cloud built for AI agents

OpenPR · 2026-04-18 · Score: 15

European AI chip startup Euclyd seeks €100M to challenge Nvidia on inference efficiency

cnbc.com · 2026-04-17 · Score: 21

Cloudflare launches AI Platform: an inference layer designed for agents

blog.cloudflare.com · 2026-04-17 · Score: 25

Newsletter Issues (13)

#491 100 years from now : The Last Election

2026-05-10 · 1 mentions

Generative AI: open-weights merged the specialists into one

2026-05-05 · 9 mentions

AI Regulation: the August cliff just got steeper

2026-05-05 · 2 mentions

AI Applications: agents just hit the warehouse floor

2026-05-05 · 1 mentions

AI in Healthcare: AI diagnostics just took the ER test

2026-05-05 · 1 mentions

Robotics: Big Tech just bought its way into physical AGI

2026-05-05 · 1 mentions

Frontier Research: the data wall is no longer a private secret

2026-05-05 · 6 mentions

Machine Learning: this week, smarter beat bigger

2026-05-05 · 1 mentions

#488 OpenAI lost three things in five days

2026-04-30 · 4 mentions

ML this week: open weights closed the gap from underneath

2026-04-25 · 7 mentions

Deep Learning: Mamba-3 halves the state. SSMs win again.

2026-04-18 · 9 mentions

#387 Issue #387: 10 Best AI PDF Summarizers

2024-05-30 · 1 mentions

#399 Issue #399: [Webinar] Cut storage and processing costs for vector embeddings

2024-08-20 · 2 mentions