Hugging Face's logo

wcccp
/
PanoWorld

Image-Text-to-Text
Transformers
Safetensors
English
qwen3_5
vision-language-model
multimodal
panoramic-understanding
360-degree
equirectangular-panorama
spatial-reasoning
panoworld
conversational
Model card Files
xet
 Community
PanoWorld
File size: 3,019 Bytes
d41f4f8
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
---
license: cc-by-nc-4.0
language:
  - en
library_name: transformers
pipeline_tag: image-text-to-text
tags:
  - vision-language-model
  - multimodal
  - panoramic-understanding
  - 360-degree
  - equirectangular-panorama
  - spatial-reasoning
  - panoworld
base_model:
  - Qwen/Qwen3.5-9B
datasets:
  - wcccp/Pano_dataset
---


# PanoWorld-Hstar

PanoWorld-Hstar is a vision-language model based on **Qwen3.5-9B**, developed for 360-degree panoramic understanding and spatial reasoning.

The model is part of the **PanoWorld** project, which focuses on ERP-native panoramic perception, global spatial topology understanding, and human-centric visual search in 360° scenes.

* Project: https://github.com/wcpcp/PanoWorld
* Model: https://huggingface.co/wcccp/PanoWorld
* Dataset: https://huggingface.co/datasets/wcccp/Pano_dataset

## Model Description

PanoWorld-Hstar is fine-tuned for vision-language understanding in equirectangular panorama images. It is designed to improve model capability on panoramic scene captioning, spatial relation reasoning, direction understanding, and 360° visual question answering.

## Intended Use

This model is intended for research on:

* 360° panoramic image understanding
* panoramic visual question answering
* spatial and directional reasoning
* human-centric visual search in panoramic scenes
* embodied AI and panoramic scene perception

## Usage

```python
import torch
from transformers import AutoProcessor, Qwen3_5ForConditionalGeneration

model_id = "wcccp/PanoWorld-Hstar"

processor = AutoProcessor.from_pretrained(model_id, trust_remote_code=True)
model = Qwen3_5ForConditionalGeneration.from_pretrained(
    model_id,
    torch_dtype=torch.bfloat16,
    device_map="auto",
    trust_remote_code=True,
)

messages = [
    {
        "role": "user",
        "content": [
            {"type": "image", "image": "example_panorama.jpg"},
            {"type": "text", "text": "Describe this 360-degree panoramic scene."},
        ],
    }
]

inputs = processor.apply_chat_template(
    messages,
    tokenize=True,
    add_generation_prompt=True,
    return_dict=True,
    return_tensors="pt",
).to(model.device)

generated_ids = model.generate(
    **inputs,
    max_new_tokens=512,
)

generated_ids_trimmed = [
    output_ids[len(input_ids):]
    for input_ids, output_ids in zip(inputs.input_ids, generated_ids)
]

response = processor.batch_decode(
    generated_ids_trimmed,
    skip_special_tokens=True,
    clean_up_tokenization_spaces=False,
)[0]

print(response)
```

Please use a recent version of `transformers` that supports Qwen3.5.


## Citation

```bibtex
@misc{wang2026panoworld,
      title={PanoWorld: Towards Spatial Supersensing in 360$^\circ$ Panorama World}, 
      author={Changpeng Wang and Xin Lin and Junhan Liu and Yuheng Liu and Zhen Wang and Donglian Qi and Yunfeng Yan and Xi Chen},
      year={2026},
      eprint={2605.13169},
      archivePrefix={arXiv},
      primaryClass={cs.CV},
      url={https://arxiv.org/abs/2605.13169}, 
}
```