Georgia Tech's RCWM Turns Single Images Into Recursive Scene Code
TL;DR
- Georgia Tech researchers Zhiqi Li, Yuxuan Liao, and Bo Zhu propose RCWM, reconstructing 3D scenes as executable code from a single reference image.
- The method pairs a Recursive Scene Program with a global-local-global solver that revisits parent nodes after refining child components.
- On five whole-scene references and five local crops, RCWM reports PSNR of 18.7-19.3 and LPIPS as low as 0.075.
Georgia Tech researchers Zhiqi Li, Yuxuan Liao, and Bo Zhu introduce Recursive Code World Models (RCWM), a framework that reconstructs 3D worlds as executable code from a single reference image, in a 21-page paper posted to arXiv on September 10.
The method pairs a Recursive Scene Program with a solver that follows the same loop at every depth: "establish the whole, recursively reconstruct unresolved parts, and revisit the whole to refine their composition." A vision-language coding agent compares rendered scenes against the reference image to guide edits, and the solver revisits parent nodes when local refinements would otherwise break spatial relations.
On five whole-scene references and five local crops, RCWM reports PSNR scores of 18.7 on a "medieval-village" scene and 19.3 on "japan-island," with LPIPS as low as 0.075 on "park-lake." Ablations find that "deeper recursive solves can improve both local detail and whole-scene fidelity." The abstract concedes that representing worlds as programs "does not determine how to construct a complex world"; recursion is the paper's proposed answer to that gap.
The comparison in the paper is against prior code-based image-to-scene methods; it does not benchmark against neural reconstruction baselines. It arrives in a busy week for world-model work on our tracker, alongside Westlake AGI Lab's 'World in World'.
Originally reported by huggingface.co
Read the original article →Original headline: Recursive Code World Models Paper Turns Single Images Into Executable Recursive 3D Scene Programs