Papers
arxiv:2610.22276

MJev-Spatial: System One Spatial Intelligence via Native Attention Matching

Published on Oct 15
ยท Submitted by
Luozheng Qin
on Oct 16
ยท mindlab-research Mind Lab
Authors:
,
,
,
,
,
,
,
,
,
,
,

Abstract

MJev-Spatial is a fast multimodal decision model that unifies spatial reasoning tasks into a single-pass classification framework, improving speed and accuracy over autoregressive vision-language models.

Spatial intelligence lets an agent perceive and act in the physical world, and many of its judgments must be made at interaction rates: which spatial relation holds, how far an object is, or where to place it. Vision-language models (VLMs) produce these answers by free-form text generation, paying for autoregressive decoding and answer parsing even though the output space is compact: one of a few options, a scalar, or a 2D point. In light of this, we introduce MJev-Spatial, a System 1 multimodal decision model that tackles all three types of spatial understanding tasks within a unified classification framework. Specifically, MJev-Spatial treats each candidate as a class and scores it using the backbone's pretrained query and key projections, without adding parameters. The candidates are the given options for choice tasks, or value bins and image regions refined through coarse-to-fine classification for numerical and point prediction, respectively. At inference, each classification decision takes a single forward pass and generates no answer tokens. To train on heterogeneous spatial data efficiently, we supervise all coarse-to-fine stages jointly with teacher forcing in one forward pass, and combine this with length-aware global batching and cross-GPU load balancing, raising training throughput by 30.8% over the original batching strategy. Built on Qwen3.5-4B and trained on 12.3M question-answer pairs converted from existing spatial datasets, MJev-Spatial achieves the highest overall score (65.64%) among eight tested models, ranks first on seven of twelve benchmarks, and outperforms its unmodified autoregressive base model on all twelve, while running 2.5 times faster than the fastest autoregressive baseline and 5.6 times faster than the base model.

Community

๐Ÿš€ We devloped MJev-Spatial, a System 1 multimodal decision model tailored for spatial intelligence!

๐Ÿง  MJev-Spatial unify spatial question answering, numerical estimation, and image pointing through direct candidate classification. The model reuses pretrained attention Q/K projections for scoring, with coarse-to-fine refinement for values and locations. Each decision takes one forward pass and generates zero answer tokens.

โšก Built on Qwen3.5-4B, MJev-Spatial achieves 65.64% mean score across 12 benchmarks, leads on 7/12, and runs 5.6ร— faster than its autoregressive base model.

๐ŸŒ Project page: https://fr0zencrane.github.io/mjev-spatial-project/
๐Ÿ’ป Code: https://github.com/Fr0zenCrane/MJev-Spatial
๐Ÿค— Model checkpoint: https://huggingface.co/Fr0zencr4nE/MJev-Spatial-Qwen-3.5-4B

Feedback and discussions are welcome! ๐Ÿ™Œ

Sign up or log in to comment

Get this paper in your agent:

hf papers read 2610.22276
Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash

Models citing this paper 1

Datasets citing this paper 0

No dataset linking this paper

Cite arxiv.org/abs/2610.22276 in a dataset README.md to link it from this page.

Spaces citing this paper 0

No Space linking this paper

Cite arxiv.org/abs/2610.22276 in a Space README.md to link it from this page.

Collections including this paper 0

No Collection including this paper

Add this paper to a collection to link it from this page.