How to use from the
Use from the
Transformers library
# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("image-text-to-text", model="jankin123/3DThinker-Mindcube")
messages = [
    {
        "role": "user",
        "content": [
            {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"},
            {"type": "text", "text": "What animal is on the candy?"}
        ]
    },
]
pipe(text=messages)
# Load model directly
from transformers import AutoProcessor, AutoModelForImageTextToText

processor = AutoProcessor.from_pretrained("jankin123/3DThinker-Mindcube")
model = AutoModelForImageTextToText.from_pretrained("jankin123/3DThinker-Mindcube")
messages = [
    {
        "role": "user",
        "content": [
            {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"},
            {"type": "text", "text": "What animal is on the candy?"}
        ]
    },
]
inputs = processor.apply_chat_template(
	messages,
	add_generation_prompt=True,
	tokenize=True,
	return_dict=True,
	return_tensors="pt",
).to(model.device)

outputs = model.generate(**inputs, max_new_tokens=40)
print(processor.decode(outputs[0][inputs["input_ids"].shape[-1]:]))
Quick Links

3DThinker-Mindcube

This repository contains the stage 1 model checkpoint for 3DThinker, as presented in the paper Think with 3D: Geometric Imagination Grounded Spatial Reasoning from Limited Views.

3DThinker is a framework that enables Vision-Language Models (VLMs) to exploit geometric information within images for 3D spatial reasoning, simulating human-like spatial imagination without requiring explicit 3D prior inputs or labeled 3D training data.

Introduction

  • The model was trained on Mindcube_Train and tested on MindCube-Tiny.
  • This model corresponds to stage 1 training (supervised alignment of 3D latents) of Qwen2.5-3B-VL.
  • Note that Tab. 2 in the paper is trained on a different training data configuration.

Bibtex

If you find 3DThinker helpful for your work, please cite:

@article{chen2025think,
  title={Think with 3D: Geometric Imagination Grounded Spatial Reasoning from Limited Views},
  author={Chen, Zhangquan and Zhang, Manyuan and Yu, Xinlei and Luo, Xufang and Sun, Mingze and Pan, Zihao and Feng, Yan and Pei, Peng and Cai, Xunliang and Huang, Ruqi},
  journal={arXiv preprint arXiv:2510.18632},
  year={2025}
}
Downloads last month
30
Safetensors
Model size
4B params
Tensor type
BF16
·
F32
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for jankin123/3DThinker-Mindcube

Finetuned
(752)
this model

Paper for jankin123/3DThinker-Mindcube