Hugging Face's logo

Diankun
/
Spatial-MLLM-subset-sft

Video-Text-to-Text
Transformers
Safetensors
qwen2_5_vl
text-generation
text-generation-inference
Model card Files
xet
 Community
1
How to use from the
Use from the
Transformers library
# pip install -U transformers accelerate
# Load model directly
from transformers import AutoProcessor, AutoModelForSeq2SeqLM

processor = AutoProcessor.from_pretrained("Diankun/Spatial-MLLM-subset-sft")
model = AutoModelForSeq2SeqLM.from_pretrained("Diankun/Spatial-MLLM-subset-sft", device_map="auto")
Quick Links

This repository contains the model described in Spatial-MLLM: Boosting MLLM Capabilities in Visual-based Spatial Intelligence.

Project page: https://diankun-wu.github.io/Spatial-MLLM/

Code: https://github.com/diankun-wu/Spatial-MLLM

Downloads last month
71
Safetensors
Model size
5B params
Tensor type
BF16
·
Inference Providers NEW
Video-Text-to-Text
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for Diankun/Spatial-MLLM-subset-sft

Base model

Qwen/Qwen2.5-VL-3B-Instruct
Finetuned
(894)
this model

Collection including Diankun/Spatial-MLLM-subset-sft

Paper for Diankun/Spatial-MLLM-subset-sft