CoVeR Retains 93.5% of 3D VLM Accuracy Using 8% of Tokens
TL;DR
- CoVeR prunes multi-view 3D VLM inputs to about 8% of visual tokens while retaining 93.5% of the full-token accuracy across three benchmarks.
- At a 9% token budget the paper reports 13.3x fewer LLM TFLOPs, 10.7x smaller KV cache, 2.9x inference speedup, and a 1.1% relative accuracy drop.
- The selector is training-free and deterministic, using only token coordinates, with a single setting (a=0.4) transferring unchanged across four VLMs.
CoVeR uses only about 8% of visual tokens and keeps 93.5% of a multi-view 3D VLM's full-token performance, according to a paper posted on Hugging Face. The pruner is training-free and deterministic, and picks tokens from their coordinates alone with no learned signals.
The abstract frames the setup as a coverage problem. Rendering a 3D scene as many views produces "thousands of redundant visual tokens whose cost grows with every view." Existing pruners fall into two families. Learned-importance methods, the authors write, "keep near-duplicate tokens from a few prominent regions and leave most of the scene unrepresented." Voxelization methods, meanwhile, "cannot enforce an exact token budget and saturate as multi-view observations overlap in 3D."
CoVeR runs in two stages. An adaptive voxel grid keeps one representative token per occupied voxel; farthest-point sampling then expands the selection until an exact per-scene budget is filled. The paper evaluates on ScanQA, SQA3D and OpenEQA using LLaVA-OneVision-7B, Video-3D LLM, Qwen2.5-VL-7B and Qwen3-VL-8B, with a single coverage weight a=0.4 kept fixed across all four models. On the same setup it reports beating prior state of the art "by 3.9 percentage points" on average.
At a 9% token budget the authors report 13.3x fewer LLM TFLOPs, 10.7x smaller KV cache, 2.9x inference speedup, and a 1.1% relative accuracy drop. It slots into a busy run of inference efficiency work we have been tracking, our 93rd inference piece in the last 90 days. The abstract publishes no per-model latency comparisons against the base runs, and the Hugging Face page shows no author affiliations.
Originally reported by huggingface.co
Read the original article →Original headline: CoVeR Paper: Geometry-Only Token Pruning Retains 93.5% of Multi-View 3D VLM Accuracy at 8% of Tokens