SpatialBlock: Enhancing Spatial Intelligence in LVLMs via Synthetic Block-Stacking Problem
Abstract
Large vision-language models trained on synthetic block-manipulation tasks improve 3D spatial reasoning and generalize to real-world visual tasks.
Large Vision-Language Models (LVLMs) have achieved strong performance on diverse visual tasks, yet their ability to reconstruct and reason about the 3D structure of the scene depicted in 2D images -- referred to as spatial intelligence -- remains limited. Existing approaches attempt to address this gap by using real-scene spatial question answering datasets that require dense geometric annotations. However, constructing such labels is costly, time-consuming, and often noisy due to reliance on external perception modules. In this work, we propose a novel paradigm inspired by human cognitive development: learning foundational spatial skills through structured block-manipulation tasks. We introduce SpatialBlock-15k, a synthetic dataset of 15,000 block-stacking problems covering 3D-to-2D projection, viewpoint transformation, and structural combination. The dataset further incorporates controlled color modulation as visual cues to encourage anchor-based reasoning in visually complex conditions. Experiments demonstrate that LVLMs trained on our dataset through either direct answering or reasoning-based prediction significantly outperform baselines and generalize to real-world spatial tasks, despite the dataset's synthetic and compact nature. Code and data are available at https://github.com/rsoohyun/SpatialBlock.
Community
Large vision-language models describe what a scene contains well, yet still struggle to reconstruct the 3D structure behind a 2D image and reason about it — spatial intelligence. SpatialBlock takes the route human spatial cognition develops along — block play. We train LVLMs on SpatialBlock-15k, a fully synthetic, scalable set of 15,000 block-stacking problems spanning 3D-to-2D projection, viewpoint transformation and structural combination, extended with controlled color cues so that models learn to anchor their reasoning on task-relevant blocks. Two training strategies are released: a direct model that predicts the answer immediately, and a reason model that thinks before answering. Despite training only on synthetic data at a small scale, both transfer to real-scene spatial benchmarks.
This is an automated message from the Librarian Bot. I found the following papers similar to this paper.
The following papers were recommended by the Semantic Scholar API
- MV-STRIDE: Enabling MLLMs to Master Multi-View Spatial Reasoning via Hierarchical Capability Modeling (2026)
- SpatioLM: Towards General Physical Spatial Intelligence in Vision-Language Models (2026)
- SCOUT: Unlocking Enhanced Spatial Reasoning via Structured Chain-of-Thought and Multi-Objective Process Reward (2026)
- Unfold The World: Factorize 4D Properties in Reinforcing Spatial Reasoning (2026)
- Chain of Spatial Thoughts: Modality-Agnostic Spatial Grounding for Vision Language Models (2026)
- GeoAnchor: Collaborative Reasoning via Latent Decomposition for 3D Spatial Understanding (2026)
- SD-MAR: Multi-image Analytical Reasoning via Synthetic Data and Reinforcement Learning (2026)
Please give a thumbs up to this comment if you found it helpful!
If you want recommendations for any Paper on Hugging Face checkout this Space
You can directly ask Librarian Bot for paper recommendations by tagging it in a comment: @librarian-bot recommend
Get this paper in your agent:
hf papers read 2609.07064 Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash