Multimodal

Latest: Reka Ships Edge 2603, a 7B Multimodal VLM Needing Only 331 Tokens Per 1024x1024 Image · huggingface.co, Oct 9, 2026

Tema Palavras-chave monitoradas: multimodal, vision language, omni

14 AI Weekly issues and 89 live stories from the last 30 days mention Multimodal.

35 menções no total 2/20 edições recentes -100% vs referência pico 1/edição monitorado desde 2026-04-18

Tendência de menções: últimas 20 edições

Notícias ao vivo (89)

Reka Ships Edge 2603, a 7B Multimodal VLM Needing Only 331 Tokens Per 1024x1024 Image

huggingface.co · 2026-10-09 · Pontuação: 23

Cloudflare Launches Clef-Omni Multimodal, Cuts Clef-Flash Pricing 58% to $0.038/M

blog.cloudflare.com · 2026-10-09 · Pontuação: 27

OneSearch-VL 8B Beats Qwen3-VL-8B by 20 Points on Multi-Image Research, 27 Points on Video DR

huggingface.co · 2026-10-09 · Pontuação: 23

KAIST's ME-World Jointly Denoises Multi-Agent Egocentric Video for Fine-Grained Embodied Interaction

huggingface.co · 2026-10-08 · Pontuação: 22

Zhejiang's SpaceCast-Bench Finds Top VLM Scores 58% on Predictive Spatial Reasoning vs 87% Human Baseline

huggingface.co · 2026-10-08 · Pontuação: 20

ALERTA Perplexity Open-Sources pplx-embed-v2-late, 0.6B and 9B Multimodal Late-Interaction Embedders

perplexity.ai · 2026-10-07 · Pontuação: 30

UCLA OpenSLA Unifies 79 Sensor Modalities, 60 Action Groups and 116K Patients With Language Bridge

huggingface.co · 2026-10-07 · Pontuação: 16

ALERTA OpenAI Rolls GPT-6 to All ChatGPT Tiers With Intelligent UI That Renders Charts, Buttons and Forms in Replies

techcrunch.com · 2026-10-07 · Pontuação: 33

Google Launches EmbeddingGemma 2, a 740M Multimodal Embedder Under Apache 2.0 With 9.92-Point MTEB Code Gain

blog.google · 2026-10-06 · Pontuação: 26

HF Paper HLA-WM Uses Hybrid Linear Attention to Stabilize Long-Horizon Video World Models

huggingface.co · 2026-10-05 · Pontuação: 18

OmniConfess Paper Scores Token-Level 'Confessions' to Catch Omni-Modal LLM Hallucinations on 3,540-Example Benchmark

huggingface.co · 2026-10-06 · Pontuação: 16

ACG-Bench Paper Debuts AE-VLA Dual-Arm Policy, Lifts Simulation Success to 21.53% From 2.94%

huggingface.co · 2026-10-06 · Pontuação: 17

HF Paper Where-OPD Uses Synthetic Scenes to Self-Distill MLLMs, Transfers 3.23-Point Gain to Real Benchmarks

huggingface.co · 2026-10-02 · Pontuação: 19

HF Paper Omni-Embed-Mini Hits 49.57 nDCG at 0.9B Params by Freezing Text, Rivals Gemini Embedding 2 at 2.3B

arxiv.org · 2026-10-01 · Pontuação: 19

NeurIPS Paper Shows VideoLLMs Lose Temporal Signal Mid-Network, Proposes Inference-Time Activation Injection Fix

arxiv.org · 2026-10-01 · Pontuação: 17

HF Paper OneStreamer Trains Streaming Video Model on 1M-Record Dataset, Tops Eight Benchmarks at 4B

arxiv.org · 2026-10-01 · Pontuação: 17

Stability AI's 4Director Lets Video World Models Take Rigid 3D Scene Control

huggingface.co · 2026-10-01 · Pontuação: 19

Bilibili Open-Sources Index-Translate Covering 150 Languages, Tops Out at 35B MoE Under Apache 2.0

huggingface.co · 2026-09-30 · Pontuação: 27

HF Paper: APM-Bench Benchmarks Cross-Session Persistent Memory for Egocentric Streaming Video Assistants

huggingface.co · 2026-09-30 · Pontuação: 18

InfiniHand Paper Streams World-Space Hand Motion From Egocentric Video at 11 FPS

arxiv.org · 2026-09-28 · Pontuação: 17

Paper: Encoder-Free Multimodal Models Predicted to Catch Encoder-Based at ~10^22 FLOPs

arxiv.org · 2026-09-28 · Pontuação: 19

Stanford's HomeBody Wires GPT-6 Astra Directly to a Unitree G1, Skips the VLA Layer

stanford.edu · 2026-09-26 · Pontuação: 26

Nvidia/Bar-Ilan Paper Adds KL Regularizer That Cuts Audio-Video Desynchronization From 0.804 to 0.752 in Joint Diffusion

huggingface.co · 2026-09-24 · Pontuação: 17

RoboFollow Benchmark Shows Top VLA Policies Ace L0 but Fail Instruction Following at L1–L3

huggingface.co · 2026-09-22 · Pontuação: 24

Qwen Team Releases OmniVChat: Native Audio-Video Dialogue Task, Bench and RL Recipe in One Drop

huggingface.co · 2026-09-21 · Pontuação: 19

ALERTA Alibaba Ships Qwen3.8-Omni-Flash, a 1M-Context Omnimodal Model With 26%+ Average Gain Over 3.5-Omni-Plus

technode.com · 2026-09-18 · Pontuação: 29

ActionPiece VLA Tokenizer Prioritizes Physical Rank Consistency, Hits 94.8% LIBERO With Qwen3-VL-4B

arxiv.org · 2026-09-17 · Pontuação: 24

Snap Unveils $2,195 Standalone Specs AR Glasses and Free Specs Intelligence AI Assistant

theverge.com · 2026-09-16 · Pontuação: 23

CMU's ModAR Ships First World-Action Model That Autoregressively Denoises Depth, Point Tracks and DINO Features

huggingface.co · 2026-09-15 · Pontuação: 20

LynnReal-Omni Paper Unifies Video Generation With 32B Multimodal DiT, Ships 27B Flash at 377ms per 540p Clip

arxiv.org · 2026-09-14 · Pontuação: 18

'Omni-Streaming Thinking' Paper Benchmarks Streaming Video Reasoning Against GPT-6 Astra and Sol

huggingface.co · 2026-09-15 · Pontuação: 17

PhysBrain 1.5 Paper Extends Vision-Language Models Into Physical Foundation Models

huggingface.co · 2026-09-15 · Pontuação: 18

Agnes-AI Ships Open-Weight 33B Multimodal Agnes-3.0-Flash With 262K Context Under Apache 2.0

huggingface.co · 2026-09-11 · Pontuação: 22

SenseNova-U1.5: 8B Native Unified MoT Beats Nano-Banana-Pro on Vision Reasoning

huggingface.co · 2026-09-10 · Pontuação: 20

Show-Harness Paper: Off-the-Shelf VLMs Can Control Robots Zero-Shot via a Semantic Action Interface

arxiv.org · 2026-09-09 · Pontuação: 18

CoVeR Paper: Geometry-Only Token Pruning Retains 93.5% of Multi-View 3D VLM Accuracy at 8% of Tokens

huggingface.co · 2026-09-09 · Pontuação: 18

TANGO Ships First Whole-Body 29-DoF VLA for Humanoid Navigation, Deployed Zero-Shot on Unitree G1

huggingface.co · 2026-09-09 · Pontuação: 22

Tencent Ships Gander, an Open Omni-Interaction Agent With 100% Turn-Taking Accuracy on Full-Duplex Bench

huggingface.co · 2026-09-09 · Pontuação: 21

OpenAI Ships ChatGPT Images 2.5 With Sketch Input, Cuts Latency 50% Over Images 2.0

openai.com · 2026-09-08 · Pontuação: 23

Select, Compress, Reinvest Paper: Controlled Study of Visual-Token Allocation in Long-Video MLLMs Beats Uniform Budgeting

huggingface.co · 2026-09-04 · Pontuação: 16

LatentStream Paper Replaces Retrieval With Progressive Latent Memory for Streaming Video Understanding

huggingface.co · 2026-09-03 · Pontuação: 18

WorldReward Paper Unifies Action-Consistency and Visual-Quality Reward for Camera-Conditioned World Models

huggingface.co · 2026-09-04 · Pontuação: 18

Hugging Face Paper: Puffin-World Unified 3D Multimodal Model Cuts Gravity Error to 1.32°

huggingface.co · 2026-09-04 · Pontuação: 22

DroneCATS Benchmark Finds 2B MLLMs Fly Better Than Frontier Models But Fail to Terminate Episodes

huggingface.co · 2026-09-02 · Pontuação: 18

ALERTA Fei-Fei Li's World Labs Unveils Atlas, a Multimodal World Model Generating 1-Minute 1440p Video

worldlabs.ai · 2026-09-01 · Pontuação: 32

LightNav-0 Paper: Compact VLM Hits SOTA on 10 Navigation Sim Benchmarks With Dual-Channel Pointing

arxiv.org · 2026-08-31 · Pontuação: 22

ALERTA Runway Unveils Solaris, Its First 'Interface World Model' That Generates UIs Frame-by-Frame in Real Time

runway.com · 2026-08-31 · Pontuação: 29

DreamX-Creator Paper Pitches Native Audio-Video Generation at 2K Resolution

huggingface.co · 2026-09-01 · Pontuação: 18

NavMCP Scaffolds VLM + Navigation Foundation Model, Gets 78.3% Success on Unitree Go2

huggingface.co · 2026-09-01 · Pontuação: 16

ByteDance Seed Ships Lucida, a Parse-Generate-Place VLM Pipeline for Real-to-Sim Scenes

huggingface.co · 2026-09-01 · Pontuação: 17

ALERTA DeepSeek Drops V4-Flash-Vision-Exp, a 305B MIT-Licensed Multimodal Agent Model

huggingface.co · 2026-08-31 · Pontuação: 31

Alibaba Launches Wan3.0 Video Model, Generates 30-Second Clips From PDFs, Slides and Spreadsheets

reuters.com · 2026-08-24 · Pontuação: 22

ALERTA DeepSeek Launches V4-Flash-Vision-Exp on API, Beats Anthropic Opus 4.8 on Two Multimodal Benchmarks

siliconangle.com · 2026-08-21 · Pontuação: 33

Apple's Camera-Equipped AirPods Confirmed in macOS Tahoe 26.7 Release Candidate Demo

macrumors.com · 2026-08-17 · Pontuação: 22

ALERTA Alibaba Ships Qwen 3.8 27B With Vision, 262K Native Context and Apache 2.0 Weights

huggingface.co · 2026-08-14 · Pontuação: 32

Zhejiang and Yale's Sci-VBench Finds Video Generators Cluster on Realism but Split on Scientific Correctness

huggingface.co · 2026-08-10 · Pontuação: 15

CoCoEvolve Paper: Cross-Representation Agreement Between Chart, Table and Code Yields Label-Free Training Signal

huggingface.co · 2026-08-05 · Pontuação: 18

BridgeVLA++ Paper Adds Spatio-Temporal Memory to 3D VLA, Hits 90.5% RLBench and 96% RMBench With 10 Demos

huggingface.co · 2026-08-05 · Pontuação: 21

Alibaba's OmniPack Cuts Qwen2.5-Omni-7B FLOPs to 16.7% Without Retraining, Keeps 98% of Baseline Score

huggingface.co · 2026-08-04 · Pontuação: 19

Video-DeepResearch 35B-A3B Beats Claude 4.5 Sonnet by 5 Points on New VideoDR-Bench

huggingface.co · 2026-08-04 · Pontuação: 21

PKU-Huawei DeepVoyager-VL Puts Vision Inside the Retrieval Loop for Long-Horizon Multimodal Search

huggingface.co · 2026-08-03 · Pontuação: 20

CASIA-Led WorldExam Benchmark Finds No Video World Model Handles Camera, Action and Language Control Well

huggingface.co · 2026-08-04 · Pontuação: 18

CASIA-Alibaba-Yale Ship UEmbed, a Decoder-Only Model That Emits Sparse and Dense Multimodal Embeddings

huggingface.co · 2026-08-03 · Pontuação: 18

USTC-Metastone's MPIE-Bench Exposes Anatomy Failures in Multi-Person Image Editing, VLM Judges Miss 30% Gap

huggingface.co · 2026-07-30 · Pontuação: 16

HKUST-Tsinghua LedgerMind Enforces Structured Evidence Ledgers, Cuts Multimodal Agent Fabrication 11-26pt

huggingface.co · 2026-07-31 · Pontuação: 20

Meta and NTU's HumanCLAW Benchmark Finds Top VLMs Solve Only 16.8% of Embodied 'Find-Navigate-Sit' Tasks

huggingface.co · 2026-07-29 · Pontuação: 22

EPFL and Apple's Modus Extends BAGEL-7B Into a Decoder-Only Any-to-Any Model Spanning 15 Modalities

huggingface.co · 2026-07-28 · Pontuação: 26

Adobe Research and JHU Ship Wonder, a Camera-Controllable Video World Model Running 16 FPS Over Minute-Long Rollouts

huggingface.co · 2026-07-29 · Pontuação: 20

ByteDance Ships DecoupleMix, a Convex-Optimization Framework for VLM Pretraining Data Recipes

huggingface.co · 2026-07-27 · Pontuação: 15

Evidence Attribution Paper Shows VLMs Cite Wrong Regions Because of Coordinate Interfaces, Not Capability

huggingface.co · 2026-07-28 · Pontuação: 20

'Show, Don't Tell' Benchmark Puts Image Generators Against VLMs on Spatial Reasoning; GPT Image 2 Solves 37% of Items GPT-5.4 Misses

huggingface.co · 2026-07-24 · Pontuação: 17

HDR Paper: Hierarchical Denoising Delivers 76% Reasoning Gains and 54x Speedup Over Bidirectional Diffusion

huggingface.co · 2026-07-17 · Pontuação: 20

NJU + Shanghai AI Lab Release VIABench — 761-Video, 46.9-Hour Egocentric Benchmark for Blind-Assistance MLLMs

huggingface.co · 2026-07-17 · Pontuação: 19

VideoChat3 Released as Fully Open 4B Video MLLM With 16x Visual-Token Compression, 70.1 on Video-MME

huggingface.co · 2026-07-16 · Pontuação: 20

OvisOCR2 Technical Report and Open-Weights Model Release — ATH-MaaS Publishes Multilingual OCR Foundation Model on Hugging Face at 42 Paper Upvotes and 134 Model Likes, Positioning It as Open Alternative to Commercial OCR APIs for Document AI Pipelines

huggingface.co · 2026-07-15 · Pontuação: 16

Boogu-Image-0.1 Open-Source Unified Multimodal Model Released — Apache 2.0 in Four Variants (Base, Turbo, Edit, Edit-Turbo) Trained on 208.62M Images for ~$400K, Claims Parity With Nano-Banana-Pro and GPT-Image-2 on Bilingual Chinese-English Text Rendering

huggingface.co · 2026-07-16 · Pontuação: 16

Xiaomi Robotics Publishes 'U0' — 38B Multimodal Autoregressive World Foundation Model Unifies Text-to-Image, Scene Generation, Embodied Transfer and Manipulation, Lifts π₀.₅ OOD Success From 36.9% to 63.2%

huggingface.co · 2026-07-13 · Pontuação: 17

HF Paper 'LightMem-Ego' From ZJU Ships Streaming Multimodal Memory for Everyday Life — Hierarchical Current/Short/Long-Term Layers Route Egocentric Video and Audio Queries on Phones and AI Glasses

huggingface.co · 2026-07-13 · Pontuação: 18

EPFL 'NEvo' Paper Hits HN: Neural-Guided Evolutionary Video Synthesis Generates AI Videos That Drive Higher Brain-Region Activation Than Handcrafted Localizer Clips

arxiv.org · 2026-07-09 · Pontuação: 16

SenseTime Releases SenseNova-Vision Paper — Reframes All of Computer Vision as Unified Multimodal Generation, One Model Matches Task-Specialized SOTA Across Detection, OCR, Segmentation, 3D Geometry

huggingface.co · 2026-07-07 · Pontuação: 17

HF Paper 'Nemotron-Labs-Audex-30B-A3B' — Unified Audio-Text LLM Trained on 157B Audio + 320B Text Tokens Hits SOTA on Audio/Speech Tasks Without Regressing on Text

huggingface.co · 2026-07-06 · Pontuação: 19

HF Paper: 'Do All Visual Tokens Matter Equally?' Object-Evidence Preserving Token Merging Improves Vision-Language Retrieval at Lower Cost

huggingface.co · 2026-07-06 · Pontuação: 16

PixWorld Paper: Pixel-Space Diffusion Unifies 3D Scene Generation and Reconstruction in a Single 1.04B Model — SOTA on WorldScore With 91.08 Camera Control and 91.39 3D Consistency

huggingface.co · 2026-07-07 · Pontuação: 18

InternVLA-A1.5 Paper: Native-VLM Robot Policy Preserves Pretrained Semantics via Latent Foresight, Tops All Six Simulation Benchmarks

arxiv.org · 2026-07-07 · Pontuação: 17

Alibaba Wan Team Releases Wan-Streamer v0.2 — Native Full-Duplex Audio-Video Agent Jumps to 640×368 at 25 FPS With Same ~200ms Model-Side Latency via Ulysses Context-Parallel 'Performer' Group

huggingface.co · 2026-07-07 · Pontuação: 20

HN Front Page: 'Claude-Real-Video' Open-Source Shim Lets Any Text-Only LLM Watch a Video Frame-by-Frame — 133 Points, 41 Comments

github.com · 2026-07-02 · Pontuação: 18

AMVL (SJTU + Ant Group): Asymmetric Mutual Variational Learning Lets MLLMs Reason in Continuous Latent Space, Gains +32 on BLINK Jigsaw and Beats Vision-R1 and DeepEyes

huggingface.co · 2026-07-01 · Pontuação: 17

Twelve Labs Raises $100M Series B Co-Led by NEA and Naver — Nvidia-Backed Video AI Startup Signs AWS Distribution Deal

bloomberg.com · 2026-07-01 · Pontuação: 19

HF Paper 'DataEvolver' (CSU + HKUST): Self-Evolving Multi-Agent Pipeline for Text-Rich Image Generation Data Recycles Rejected Samples, Boosts OCR-F1 by 85% on TextScenesHQ Over Static Crawl-Filter-Freeze Baselines

huggingface.co · 2026-06-30 · Pontuação: 17

Edições da newsletter (14)

#528 What are companies building with AI? An Applied AI Deep Dive

2026-09-01 · 1 menções

Frontier Research: circuits got cheap as consciousness got loud

2026-06-21 · 2 menções

Generative AI: DeepSeek's 75% cut rewrites the cost math

2026-05-26 · 3 menções

AI Regulation: Trump killed his own AI oversight order at the door

2026-05-26 · 3 menções

AI in Marketing: Gemini eats the ad stack, agents take the keys

2026-05-26 · 1 menções

Machine Learning: a reasoning model just cracked Erdős

2026-05-26 · 4 menções

World Models: Google Ships Omni, and the LLM Monopoly Cracks

2026-05-26 · 6 menções

AI Safety: the deepfake takedown clock starts ticking

2026-05-26 · 3 menções

Machine Learning: nobody trained bigger, everyone shrank the cache

2026-05-21 · 3 menções

World Models: Google's Genie now simulates real streets, not just dreams

2026-05-21 · 4 menções

AI Safety: Washington floats an FDA for AI models

2026-05-21 · 1 menções

Frontier research: the next architecture is not transformer-shaped

2026-04-25 · 1 menções

Gen AI: $40B compute check, open-weight reset, software bloodbath

2026-04-25 · 1 menções

AI Healthcare: Why pharma data is the real moat

2026-04-18 · 2 menções