Inference

Latest: Cloudflare Launches Clef-Omni Multimodal, Cuts Clef-Flash Pricing 58% to $0.038/M · blog.cloudflare.com, Oct 9, 2026

Tema Palabras clave monitoreadas: inference, latency, throughput, serving

22 AI Weekly issues and 68 live stories from the last 30 days mention Inference.

83 menciones en total 4/20 números recientes -100% vs referencia pico 2/número monitoreado desde 2026-04-18

Tendencia de menciones: últimos 20 números

Noticias en vivo (68)

Cloudflare Launches Clef-Omni Multimodal, Cuts Clef-Flash Pricing 58% to $0.038/M

blog.cloudflare.com · 2026-10-09 · Puntuación: 27

Tsinghua's TokenRouter Serving System Delivers 2-64x Decode Speedup for Token-Level LLM Routing

huggingface.co · 2026-10-08 · Puntuación: 23

ALERTA Unpatched LMCache CVSS 9.8 RCE Flaw Hits vLLM Inference Stacks via Pickle Deserialization

thehackernews.com · 2026-10-07 · Puntuación: 35

Autotrust Releases GEV-26B-Decide NVFP4, Quantizes 26B MoE Decision Model to 17 GiB With 85ms Clicks

huggingface.co · 2026-10-07 · Puntuación: 20

GRACE Latent-Compressed Video Diffusion Runs 11.1x Faster at 480x832 With No VBench Quality Drop

huggingface.co · 2026-10-07 · Puntuación: 21

ALERTA Anthropic Ships Claude Haiku 5.5 at 75% Lower Cost, Pairs With Sonnet Cache Cut and Max API Credits

anthropic.com · 2026-10-07 · Puntuación: 34

TRACE Paper: Rollout-Guided FP4 QAT Matches BF16 Rollout for MoE RL, 5.4x Faster

huggingface.co · 2026-10-07 · Puntuación: 22

OpenAI Opens Decisions API Public Beta on GPT-6 Luna, Prices Input at $0.10 per Million Tokens

community.openai.com · 2026-10-06 · Puntuación: 27

GitHub openTPU Ships AI-Designed FPGA Inference Accelerator Running Qwen3 and LFM2.5 on a Kintex-7

github.com · 2026-10-05 · Puntuación: 20

Antseed Launches P2P AI Inference Marketplace, Claims Up to 97% Below API Prices, Backed by Spark Capital

siliconangle.com · 2026-10-06 · Puntuación: 22

HF Paper 'What Matters for Latent Reasoning' Introduces FLaRe, Hits 97% CoT Accuracy at 4x Speedup

huggingface.co · 2026-10-06 · Puntuación: 19

Looped Models Done Right II Shrinks KV Cache 3x, Trains Distilled Student Prefill 1.79x Faster

huggingface.co · 2026-10-06 · Puntuación: 23

llama.cpp v0.6.0 Lands MTP Speculative Decoding for Qwen4Exp and First-Party GLM-5.3-Flash, Clef and Ling 3.0 VL Support

github.com · 2026-10-05 · Puntuación: 22

r/LocalLLaMA Project OntoPrune Ships Neuro-Symbolic Context Pruning for Local LLMs, 83% Fewer Tokens and 6.7x TTFT on CPU

github.com · 2026-10-05 · Puntuación: 16

Open-Source Strata Engine Runs 125B Qwen3.8-Flash-Next on a Single 12GB Consumer GPU at 60-95 Tokens/Sec

github.com · 2026-10-04 · Puntuación: 21

HF Paper LoopCD Halves Looped-Transformer Loops Training-Free, Lifts Ouro-2.6B AIME Score From 61.88% to 73.33%

huggingface.co · 2026-10-01 · Puntuación: 21

HF Paper AgSpec Reports 4.76x Speedup for Coding Agents via Multi-Corpus Retrieval-Based Speculative Decoding

arxiv.org · 2026-10-01 · Puntuación: 20

Cloudflare Open-Sources Clef Decision Models and Launches RL Fine-Tuning Service on Edge GPUs

blog.cloudflare.com · 2026-10-01 · Puntuación: 26

Volantis Raises $88M Series A to Pack 220 Memory Chips Around a GPU With VCSEL Photonic Links

prnewswire.com · 2026-10-01 · Puntuación: 25

Magnitude (YC S25) Launches Self-Compiling Inference Engine, Claims 92% Faster Metal Decode Than llama.cpp

github.com · 2026-09-30 · Puntuación: 20

GMI Cloud Closes $668M Equity-and-Debt Package With Nvidia and Taiwan's CTBC to Expand Nvidia-Only GPU Buildout

theinformation.com · 2026-09-30 · Puntuación: 26

llama.cpp Merges Support for Zhipu's 320B Hybrid GLM-5.3-Flash With MoE, MLA, DSA and Vision

github.com · 2026-09-30 · Puntuación: 21

Artificial Analysis Ships AA-AgentPerf-Local, Benchmarking Local Agentic AI on Laptops and Workstations

artificialanalysis.ai · 2026-09-29 · Puntuación: 22

Efficient Computer raises $97M Series B at $650M valuation for dataflow AI chips

reuters.com · 2026-09-29 · Puntuación: 21

NVIDIA KDA Agent Rewrites Moonshot's Kimi Delta Attention Kernel, Hits 2.96x Speedup on B300

github.com · 2026-09-28 · Puntuación: 20

Show HN: ESP32-S3 Cluster Runs a 0.4B BitNet 1.58-Bit LLM Across Seven Microcontrollers

github.com · 2026-09-28 · Puntuación: 18

Firelex Ships Jeff, Jev-Compatible 0.8B Decision Models Trained at Home With ~30ms Inference

github.com · 2026-09-28 · Puntuación: 16

FT: Open Models Hit 56% of Vercel Tokens and 40% of AT&T AI Workloads, Earnings-Call Mentions Up 6x

ft.com · 2026-09-27 · Puntuación: 23

ALERTA NaiveAI Open-Weights 309B MoE Naive-N0.5-Flash With No Full-Attention Layers, Trained by AI-Assisted Researchers

huggingface.co · 2026-09-27 · Puntuación: 29

DeepSeek Publishes DSec Paper on arXiv Detailing Elastic Compute for Model Serving

arxiv.org · 2026-09-26 · Puntuación: 22

Modal in Talks at ~$15B, Baseten at ~$26B as AI Inference Startups Race to Multiply Valuations

bloomberg.com · 2026-09-23 · Puntuación: 23

Flash-dLLM Paper Reports 5.1x and 11.0x Speedups Over Elastic-Cache for Diffusion LLMs on GSM8K and HumanEval

arxiv.org · 2026-09-22 · Puntuación: 19

AMD Ships Zebra-HyLo: 14 Open-Source Hybrid Checkpoints With 92-98% KV-Cache Reduction

rocm.blogs.amd.com · 2026-09-22 · Puntuación: 25

Tom's Hardware: M5 Ultra Mac Studio Runs Local Models Faster Than Nvidia DGX Spark

tomshardware.com · 2026-09-21 · Puntuación: 18

TypeSafe's Jev Hits 13% of Vercel Paid Teams in 24 Hours, 2x GPT-5.6 Family and 6x Fable 5.1

forbes.com · 2026-09-19 · Puntuación: 22

ALERTA StepFun Ships Step 5 Preview API, a 600B MoE at $1/$2.70 That Scores 44 on Intelligence Index

artificialanalysis.ai · 2026-09-20 · Puntuación: 28

ALERTA PrismML Ships Ternary Bonsai 2 27B: 5.9GB Model Retains 98.2% of Qwen3.8 27B Under Apache 2.0

marktechpost.com · 2026-09-18 · Puntuación: 30

AutoArk's Edge0 streams a 35B MoE from SSD at 20 tok/s on a 24GB Mac mini via one-token-ahead prerouter

huggingface.co · 2026-09-17 · Puntuación: 22

Z.ai says GLM-5.3 built the inference stack that now serves it on 100,000+ Chinese chips

z.ai · 2026-09-17 · Puntuación: 23

IEEE Spectrum: 2026 Is the Inference Hardware Turning Point as GPUs Sit Idle 50-80% of the Decode Phase

spectrum.ieee.org · 2026-09-15 · Puntuación: 19

Paper: Orthrus 'Lossless' Speculative Decoding Only Matches Reference 45% of the Time at BF16

huggingface.co · 2026-09-14 · Puntuación: 23

SemiAnalysis: Datacenter Inference Beats On-Device by 46% Cost/PFLOP for Robots, But Network Wall Blocks Move

semianalysis.com · 2026-09-14 · Puntuación: 26

Netherlands' Euclyd Raises €200M+ Series A, Taps Ex-ASML CEO Wennink to Chair Nvidia Inference Rival

cnbc.com · 2026-09-14 · Puntuación: 23

ALERTA SemiAnalysis Benchmarks Vera Rubin NVL72 at 7x Blackwell's Tokens per MW on DeepSeek V4 Pro 1.6T

semianalysis.com · 2026-09-14 · Puntuación: 31

XPeng AI Ships X-AuT: Progressive Audio-Encoder Compression Cuts Speech LLM Layers Without Accuracy Loss

huggingface.co · 2026-09-10 · Puntuación: 18

Survey Paper Maps Inference-Efficiency Mechanisms Across 125 Video and Audiovisual LLMs

huggingface.co · 2026-09-10 · Puntuación: 17

CoVeR Paper: Geometry-Only Token Pruning Retains 93.5% of Multi-View 3D VLM Accuracy at 8% of Tokens

huggingface.co · 2026-09-09 · Puntuación: 18

ALERTA OpenBMB Ships MiniCPM5-2B, a 2.5B Apache-2.0 On-Device Model Averaging 53.9 Across 34 Benchmarks

marktechpost.com · 2026-09-07 · Puntuación: 28

OpenVDN Drops VDN-MiniMax-H3, Hybrid-Attention Video Model Renders 14.4s at 768p in 11 Seconds

huggingface.co · 2026-09-06 · Puntuación: 24

AMD Debuts Threadripper Halo Station at IFA, Runs Trillion-Parameter Models Locally on 576GB HBM3e

theregister.com · 2026-09-04 · Puntuación: 25

Gimlet Labs Raises $300M at $3B Led by Andreessen Horowitz, With Arm and Microsoft's M12 Joining

bloomberg.com · 2026-09-04 · Puntuación: 23

Random Attention Paper: Uniform Random KV-Cache Eviction Matches Best Scorers, Runs 32-43% Faster in vLLM

arxiv.org · 2026-09-04 · Puntuación: 20

Minima Paper Fully Quantizes Qwen3.8-27B to NVFP4 W4A4 Including Gated DeltaNet, Matches BF16

huggingface.co · 2026-09-03 · Puntuación: 26

Nvidia Launches PAIR, a Free Tool That Distributes Local AI Inference Across Home GPUs

blogs.nvidia.com · 2026-09-03 · Puntuación: 27

Equinix, Nvidia and Together AI Launch Inference Exchange for Enterprise Open-Model Serving

cnbc.com · 2026-09-02 · Puntuación: 23

Anthropic-Google Paper: 'Declarative Attention' Lets LLMs Skip 31–52% of Cache Reads at Minimal Accuracy Loss

huggingface.co · 2026-09-02 · Puntuación: 25

Paper: Split Qwen3-32B Into GRPO Experts, Merge via SLERP, Match Qwen3-235B on Enterprise Traffic

huggingface.co · 2026-09-02 · Puntuación: 19

Slotstream Runs 125B Qwen3.8 Flash Next on a 48GB Mac at 12 tok/s Via SSD-Streamed Experts

github.com · 2026-09-01 · Puntuación: 22

The Information: Apple's Enterprise-AI Gap Left It Scrambling to Meet Mac Mini and Mac Studio Cluster Demand

macrumors.com · 2026-08-31 · Puntuación: 19

ALERTA Perplexity Ships Hybrid Compute for Mac, Auto-Routes Sensitive Prompts to Local Qwen 3.6 and Gemma E4B

engadget.com · 2026-09-01 · Puntuación: 28

Koboldcpp v1.120 Ships DirectIO Model Loading Plus Full Qwen 3.8-Flash-Next and Ling-3.0-Flash Support

github.com · 2026-08-29 · Puntuación: 18

vLLM v0.28.0 Ships Decode Context Parallel, Bigger Batches and Model Runner V2 Maturation

github.com · 2026-08-29 · Puntuación: 20

ALERTA Tencent Open-Sources Hy4-Preview, a 770B MoE With 49B Active and 1M Context Under Apache 2.0

technode.com · 2026-08-28 · Puntuación: 31

ALERTA OpenAI Details Jalapeño, Its First Broadcom-Built Inference ASIC That Beats Nvidia Rubin on Perf-per-Watt

newsletter.semianalysis.com · 2026-08-25 · Puntuación: 34

Apple Preps New Mac mini With M5 and M6 Chips as On-Device AI Demand Strains Supply

9to5mac.com · 2026-08-24 · Puntuación: 18

OpenAI Reinstates 5-Hour Codex and ChatGPT Work Limits for Plus Subscribers, Cites Compute Load

9to5mac.com · 2026-08-24 · Puntuación: 17

Agent Harnesses Like OpenClaw Are Changing How We Build and Run AI Models

The Register · 2026-05-17 · Puntuación: 16

HN: δ-mem Injects Compact Delta-Rule Memory Into Frozen LLMs, Achieving 1.31× Lift on MemoryAgentBench With No Full-Context Retraining — 200 Points

arxiv.org · 2026-05-16 · Puntuación: 19

Números de la newsletter (22)

#535 AI got too expensive, so companies are moving to cheaper models

2026-10-06 · 1 menciones

#527 Schools are choosing opposite futures for AI

2026-08-30 · 1 menciones

#521 The frontier just split into three markets

2026-08-12 · 1 menciones

#520 What a week: AI became everybody's decision

2026-08-09 · 1 menciones

#508 The Cutting Edge, Across the Board

2026-06-28 · 2 menciones

AI in Education: schools quit the AI-cheating arms race

2026-06-21 · 1 menciones

Frontier Research: circuits got cheap as consciousness got loud

2026-06-21 · 2 menciones

Deep Learning: a 744B open model just lapped the labs

2026-06-21 · 5 menciones

Machine Learning: a 744B model ran across six states on raw WAN

2026-06-21 · 7 menciones

AI in Business: the agents you sell now run up your own bill

2026-06-21 · 4 menciones

AI Regulation: export-control law just became an AI kill switch

2026-06-21 · 1 menciones

Deep Learning: 4-bit pretraining just matched FP8 at scale

2026-05-26 · 14 menciones

Generative AI: DeepSeek's 75% cut rewrites the cost math

2026-05-26 · 2 menciones

Robotics: Wayve's end-to-end driver lands in Jeeps and Rams

2026-05-26 · 1 menciones

Frontier Research: LLMs reach Nature as the field bets against them

2026-05-26 · 3 menciones

Machine Learning: a reasoning model just cracked Erdős

2026-05-26 · 7 menciones

World Models: Google Ships Omni, and the LLM Monopoly Cracks

2026-05-26 · 1 menciones

AI Safety: the deepfake takedown clock starts ticking

2026-05-26 · 2 menciones

Frontier Research: reasoning is leaving the token stream

2026-05-21 · 2 menciones

Machine Learning: nobody trained bigger, everyone shrank the cache

2026-05-21 · 9 menciones

ML this week: open weights closed the gap from underneath

2026-04-25 · 7 menciones

Deep Learning: Mamba-3 halves the state. SSMs win again.

2026-04-18 · 9 menciones