Edge AI News — AI Trends, Updates & Tracker

r/LocalLLaMA: AMD Strix Halo Crosses 100 t/s on Qwen3 30B-A3B in llama.cpp — First Triple-Digit Result Documented on Consumer APU at 30B Scale

reddit.com · 2026-06-03 · Score: 15

Microsoft Unveils Project Solara at Build 2026 — Android-Based OS for Agent-First Smart Badges and Desk Companions, Piloting at Best Buy, CVS, Levi's, and Target

thenextweb.com · 2026-06-02 · Score: 27

r/LocalLLaMA: Intel Arc Pro B70 Achieves 62–64 Tokens/Second on Qwen 3.6-35B in llama.cpp — Engineering Guide Maps the Gap That Remains vs. CUDA

lemongravy.me · 2026-06-02 · Score: 16

r/LocalLLaMA: AdelicLLama-3.1-8B Claims 99.7% KV Cache Compression at 100K Tokens — 13 GB Shrinks to 33 MB, Methodology Unverified

reddit.com · 2026-06-02 · Score: 19

Nvidia JetPack 7.2 Ships for Edge AI: One-Command NemoClaw Deployment, MIG on Jetson Thor, 241 TOPS on Orin

developer.nvidia.com · 2026-06-01 · Score: 20

r/LocalLLaMA: AMD ROCm Now Runs Sanely Inside WSL2 for llama.cpp — Community Posts Working Build Instructions, Known Bugs Remain

github.com · 2026-06-02 · Score: 18

r/LocalLLaMA: Qwen3.6-35B on MacBook M4 Pro Scores 37.8% on Terminal-Bench 2.0, Rivalling Claude Code + Sonnet 4.5 on Local Hardware

reddit.com · 2026-06-01 · Score: 16

r/LocalLLaMA: EXAONE 4.5 — LG's 33B Open-Weight Vision-Language Model — Added to llama.cpp Mainline via PR #21733

github.com · 2026-06-01 · Score: 15

Microsoft Surface Laptop Ultra with NVIDIA RTX Spark Announced at Computex — 1 Petaflop AI Compute, 128GB Unified Memory, Runs 120B-Parameter Models Locally

windowscentral.com · 2026-06-01 · Score: 22

AMD Ryzen AI Max PRO 400 Debuts at Computex — First x86 Chip for 300B-Parameter Local LLMs, 192GB Unified Memory, Ships Q3 2026

amd.com · 2026-05-31 · Score: 23

r/LocalLLaMA: Developer Ports NVIDIA Parakeet Speech-to-Text to Pure C++/ggml — No Python, No PyTorch, Runs on CUDA, HIP, Metal, and Vulkan

reddit.com · 2026-05-31 · Score: 19

r/LocalLLaMA: PewDiePie Releases Open-Source Local LLM Harness and WebUI, Bringing Self-Hosted AI to Mainstream Audience

reddit.com · 2026-05-31 · Score: 15

r/LocalLLaMA: CS Student Ships mlx-Chronos — First Neutral Community Benchmark Leaderboard Comparing Four Apple Silicon MLX Inference Engines Across 520 Scored Questions

reddit.com · 2026-05-31 · Score: 16

r/LocalLLaMA: OpenAI Job Posting for On-Device Transformer Inference Lead Signals Pivot to Local AI

openai.com · 2026-05-31 · Score: 21

r/LocalLLaMA: Cost Analysis of My $6.4K Local LLM Server

reddit.com · 2026-05-30 · Score: 15

Qualcomm Announces Snapdragon C Platform for Sub-$300 Windows AI Laptops at Computex — First NPU-Equipped Budget ARM Chip

tomshardware.com · 2026-05-29 · Score: 20

r/LocalLLaMA: Developer Builds First 'Train LLM From Scratch on 8GB VRAM, No Cloud' Project Overnight and Benchmarks Which Optimization Tricks Actually Work

r/LocalLLaMA · 2026-05-29 · Score: 18

Apple Reportedly Trying to Distill Google's Multi-Trillion-Parameter Gemini AI to Run On-Device on iPhone

arstechnica.com · 2026-05-28 · Score: 23

Liquid AI Releases LFM2.5-8B-A1B on HuggingFace — New 8B MoE Entry Extends the LFM2.5 On-Device Family

huggingface.co · 2026-05-28 · Score: 17

r/LocalLLaMA: Developer Ships Desktop App That Converts Local LLM Corrections Into LoRA Training Data for On-Device Fine-Tuning

reddit.com · 2026-05-27 · Score: 17

r/MachineLearning: Developer Trains 7 MB Open-Source Self-Driving AI That Runs on a Phone and Adapts to New Environments From Visual and Sensor Input

reddit.com · 2026-05-27 · Score: 18

OpenBMB Releases MiniCPM5-1B: 0.5 GB On-Device Model Tops 1B Category on Artificial Analysis Index, Ships With MCP and 128K Context

decrypt.co · 2026-05-26 · Score: 22

r/LocalLLaMA: Cactus Hybrid Router — 65k-Param Model Lets Gemma4-2B Match Gemini-3.1-Flash-Lite by Routing Only 15–55% of Queries to Cloud

reddit.com · 2026-05-26 · Score: 15

PrismML Releases Apache 2.0 Binary and Ternary Bonsai Image 4B — First Published Diffusion Transformers That Run Fully In-Browser at Under 3GB

reddit.com · 2026-05-26 · Score: 15

r/ArtificialInteligence: Princeton Team Open-Sources Conifer — Funded Local Inference Runtime for Apple Silicon Built in Rust

reddit.com · 2026-05-26 · Score: 15

r/LocalLLaMA: New Local Model Reaches Near-Frontier on PII Removal at 9ms CPU Inference

screenpipe.github.io · 2026-05-26 · Score: 16

r/LocalLLaMA: Cider SDK Adds W8A8 Activation Quantization to Apple MLX — 11% Prefill Speedup on M5 Pro, First Activation-Quant Layer for MLX

reddit.com · 2026-05-25 · Score: 16

r/LocalLLaMA: Developer Builds Custom C++ Inference Engine for MiniCPM-V 4.6 on Orange Pi AIPro (Ascend 310B NPU, ~$150) — Full VLM Without GPU or Cloud

reddit.com · 2026-05-25 · Score: 18

r/LocalLLaMA: Pushing Qwen3.6 MoE Expert Layers to CPU Doubles Decode Speed on 12 GB VRAM — Counterintuitive Finding Sparks Community Explanation

reddit.com · 2026-05-25 · Score: 16

SPAN Wants to Turn Homes Into Mini AI Data Centers, Attaching Inference Hardware to Residential Electrical Panels

scientificamerican.com · 2026-05-25 · Score: 22

r/LocalLLaMA: Developer Publishes Guide to Access Chrome's Quietly Installed Gemma4 (Gemini Nano) Directly on PC Without GPU or Dev Tools

reddit.com · 2026-05-23 · Score: 16

r/LocalLLaMA: Needle 26M Specialist Beats Qwen3-0.6B at CPU Function Calling — 4.4× Faster, Higher Accuracy Across 50 Queries and 5 Difficulty Tiers

reddit.com · 2026-05-23 · Score: 19

r/LocalLLaMA: Gemma4 26B-A4B Apex Quant Hits 38 tok/s at 90K Context on RX 9060 XT 16GB — Zero Quality Degradation Reported

reddit.com · 2026-05-23 · Score: 16

r/LocalLLaMA: club-rdna16 Opens Community 16GB AMD/Radeon Local LLM Benchmark Repository — Practical Counterpart to club-5060ti for RDNA Hardware

reddit.com · 2026-05-23 · Score: 15

r/LocalLLaMA: Qwen3.6-27B Q4_K_M Achieves 40 tok/s on Single RTX 5060 Ti 16GB Using Pure Quantization — Full Dense Model Fits in VRAM

reddit.com · 2026-05-23 · Score: 17

TechCrunch Hands-On: Google's Android XR Display Glasses Prototype Overlays Gemini HUD With Navigation, Translation, and Live Widgets — No Ship Date Yet

techcrunch.com · 2026-05-22 · Score: 22

r/LocalLLaMA: ByteShape Qwen3.6-35B-A3B Quant Runs 30% Faster Than Unsloth IQ on 6GB VRAM Laptop — ShapeLearn Per-Tensor Format Selection Fits Full MoE at Reduced Memory

reddit.com · 2026-05-22 · Score: 16

r/LocalLLaMA: Developer Explores Salvaged AMD BC-250 (PS5 APU) Boards at $50–150 for Local LLM Inference — 35B MoE at 37.5 tok/s on 16GB GDDR6, Vulkan-Only Stack

reddit.com · 2026-05-21 · Score: 17

Apple Unveils Apple Intelligence-Powered Accessibility Features — VoiceOver Image Explorer, Interactive Live Recognition, and On-Device Subtitle Generation

apple.com · 2026-05-19 · Score: 15

r/LocalLLaMA: Google AI Edge Gallery v1.0.13 & v1.0.14 Ship Gemma 4 Multi-Token Prediction, Pixel TPU Support, Experimental MCP, and Persistent Chat History

GitHub · 2026-05-19 · Score: 17

EnCharge AI Launches EN100: Industry's First Analog In-Memory AI Accelerator Claiming 20× Better Performance-Per-Watt for On-Device Inference

datacenterdynamics.com · 2026-05-18 · Score: 18

r/LocalLLaMA: MLX Engine Comparison on M5 Max 64GB — oMLX Tops All Backends for Qwen 3.6 35B-A3B, MTPLX Tested on 27B

reddit.com · 2026-05-18 · Score: 15

AMD Confirms June Launch for Ryzen AI Halo Mini PC — 128GB Unified Memory, Full ROCm Stack, Targets Nvidia DGX Spark for Local AI Developers

startupfortune.com · 2026-05-18 · Score: 21

r/LocalLLaMA: First Working Gemma 4 31B-A4B NVFP4 + vLLM 0.21 MTP on Single RTX 5060 Ti 16GB — Community Opens Benchmarking on New-Gen Consumer Card

reddit.com · 2026-05-17 · Score: 17

r/LocalLLaMA: ik_llama Runs Qwen3.6-27B and 35B Models on RTX 2060 6GB VRAM via Aggressive Quantization and CPU Offload

reddit.com · 2026-05-17 · Score: 15

HN: 'Apple Silicon Costs More Than OpenRouter' — Developer Analysis Finds Local M5 Inference Runs ~3× Pricier and ~2× Slower Than Cloud API; 253 Points

williamangel.net · 2026-05-17 · Score: 18

Oppo Open-Sources X-OmniClaw: On-Device Android AI Agent That Uses Camera, Screen, and Voice Without Leaving the Phone

the-decoder.com · 2026-05-17 · Score: 20

r/LocalLLaMA: ROCm 7.13 Nightly Confirmed Working on AMD Strix Halo (gfx1151) With llama.cpp Multi-Token Prediction — First Full Local Stack Validated

Reddit r/LocalLLaMA · 2026-05-17 · Score: 16

r/LocalLLaMA: Developer Publishes 55-Run Benchmark Pitting AMD Strix Halo Against RTX 3090 and RTX 5070 Across Five Backends

reddit.com · 2026-05-17 · Score: 16

NASA Tests HPSC Space Processor 500x Faster Than Current Radiation-Hardened Chips, Enabling Real-Time AI Autonomy for Deep Space Missions

jpl.nasa.gov · 2026-05-15 · Score: 19

Osaurus Launches Open-Source Mac LLM Server Letting Developers Switch Between Local and Cloud AI Models While Keeping Files On-Device

techcrunch.com · 2026-05-15 · Score: 16

Meta Rolls Out Neural Handwriting to All Ray-Ban Display Users, Opens SDK to Third-Party Developers

The Verge · 2026-05-15 · Score: 23

Counterpoint Research: 80% of Premium Smartphones Will Carry Agentic AI by 2027, One in Three of All Handsets

theregister.com · 2026-05-14 · Score: 19

Ollama Pre-Release v0.30.0 Drops Custom GGML Build, Switches to llama.cpp Directly

github.com · 2026-05-14 · Score: 23

TextGen (text-generation-webui) Relaunches as Native Cross-Platform Desktop App, Open-Source Alternative to LM Studio

reddit.com · 2026-05-13 · Score: 17

MiniCPM-V 4.6: 1.3B Multimodal Model Runs Fully On-Device on Smartphones, Challenges Much Larger Rivals

firethering.com · 2026-05-13 · Score: 22

Show HN: Needle — 26M-Parameter Model Distilled From Gemini Tool-Call Data Runs On-Device at 6,000 tok/s, MIT-Licensed, Targeting Phones and Watches

news.ycombinator.com · 2026-05-12 · Score: 21

Alibaba Updates Qwen AI Glasses S1 With Proactive AI Suggestions and Spatial 3D Floating Interface

the-gadgeteer.com · 2026-05-12 · Score: 15

Google Unveils 'Googlebook' — Gemini-Native Laptop Category With Magic Pointer, Glowbar Hardware, and OEM Lineup From Acer, Asus, Dell, HP, and Lenovo Arriving Fall 2026

axios.com · 2026-05-12 · Score: 20

HN: 'Training an LLM in Swift, Part 1: Taking Matrix Mult From GFlop/s to TFlop/s' — 242 Points, 12 Comments as Developer Builds Native Apple Metal LLM Training Pipeline Without CUDA

news.ycombinator.com · 2026-05-11 · Score: 15

Google The Android Show: I/O Edition 2026 Formally Unveils Android 17 With Agentic Gemini Features, Aluminium OS Replacing ChromeOS as Android-Based Desktop Platform, and Android XR Smart Glasses With Warby Parker and Gentle Monster

android.com · 2026-05-12 · Score: 26

HN: 'How Fast Does Claude, Acting as a User Space IP Stack, Respond to Pings?' — 149 Points, 54 Comments as Developer Demonstrates Claude Parsing Raw IP Packets and Constructing Valid ICMP Replies

dunkels.com · 2026-05-11 · Score: 16

HN: 'Running Local Models on an M4 With 24GB Memory' — 176 Points as Developer Documents Full Qwen 3.5-9B Setup on Apple Silicon

jola.dev · 2026-05-10 · Score: 16

HN: 'Local AI Needs to Be the Norm' — 297 Points, 165 Comments as Developer Essay Argues On-Device Models Should Replace Server-Side Defaults

unix.foo · 2026-05-10 · Score: 15

Qualcomm CEO Cristiano Amon Confirms Company Is Powering AI Hardware for 'Pretty Much All' Major Players — OpenAI, Meta, and Others — on Top-Secret Wearable Devices

fortune.com · 2026-05-09 · Score: 22

Tether AI Launches QVAC MedPsy: 1.7B On-Device Medical Model Outperforms MedGemma 27B on Clinical Benchmarks

decrypt.co · 2026-05-08 · Score: 19

HN: Google Chrome Silently Installs 4 GB Gemini Nano AI Model on Every Device Without Consent — Re-Downloads If Deleted (151 pts, 167 comments)

news.ycombinator.com · 2026-05-05 · Score: 26

Show HN: Apple's SHARP 3D view-synthesis model now runs in the browser via ONNX Runtime Web — 143 pts

news.ycombinator.com · 2026-05-03 · Score: 16

HN: IBM releases Granite 4.1 family — 3B/8B/30B dense models with 512K context under Apache 2.0

research.ibm.com · 2026-05-03 · Score: 18

Google accidentally publishes and pulls COSMO, an experimental on-device Gemini Nano AI assistant app for Android

9to5google.com · 2026-05-01 · Score: 26

NVIDIA launches Nemotron 3 Nano Omni: 30B-A3B open multimodal model unifying vision, audio, and language

NVIDIA Blog · 2026-04-28 · Score: 27

CNBC: In China, startups are actually shipping consumer AI hardware

cnbc.com · 2026-04-27 · Score: 17

HN: Chrome's Prompt API for built-in Gemini Nano AI trends on front page

Hacker News · 2026-04-27 · Score: 15

HN: Qwen3.6-35B-A3B on a laptop outdraws Claude Opus 4.7 — Simon Willison

simonwillison.net · 2026-04-17 · Score: 20

Edge AI

Mention Trend — Last 20 Issues

Live Stories (74)

Newsletter Issues (3)