SpatialBlock: 15K synthetic puzzles train VLMs on 3D reasoning
TL;DR
- SpatialBlock-15k is a synthetic set of 15,000 block-stacking problems built to teach LVLMs 3D-to-2D projection, viewpoint transformation, and structural combination without hand-labelled geometry.
- A Qwen3-VL-4B model fine-tuned on the data scored 95.7% on the in-domain SB-Bench and 51.3% out-of-domain on MindCube in the paper's tests.
- The dataset uses controlled color modulation as visual cues to encourage anchor-based reasoning in visually complex conditions, per the abstract.
A Qwen3-VL-4B model fine-tuned on 15,000 synthetic block-stacking puzzles scored 95.7% on its in-domain benchmark and 51.3% on the out-of-domain MindCube test, according to a new arXiv paper from Soohyun Ryu, Sohee Kim, and Eunho Yang.
The dataset, SpatialBlock-15k, covers "3D-to-2D projection, viewpoint transformation, and structural combination," per the abstract, and every example is procedurally generated, sidestepping the dense human-labelled geometry that most spatial-reasoning datasets rely on. The authors describe their bet as "learning foundational spatial skills through structured block-manipulation tasks," an approach the abstract says is "inspired by human cognitive development."
On out-of-domain benchmarks, the 7B variant reached 50.9% on SPBench, 29.7% on MMSI-Bench, and 55.5% on MMMU. Human evaluators average 95% accuracy on the in-domain SB-Bench tasks, the paper reports. The authors argue that LVLMs trained on this data "significantly outperform baselines and generalize to real-world spatial tasks, despite the dataset's synthetic and compact nature."
The abstract publishes no head-to-head against closed-source frontier models, and the load-bearing claim is how far a compact block-stacking curriculum actually transfers to messy 3D scenes rather than benchmarks tilted toward geometric primitives. Code and data, the authors say, are on the repository linked from the paper.
Originally reported by paper
Read the original article →Original headline: SpatialBlock: 15K Synthetic Stacking Problems Give 4B VLM Best Open-Source Spatial Reasoning Score