YOUSIKI commited on
Commit
daab846
·
verified ·
1 Parent(s): 1b2e2c0

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +109 -4
README.md CHANGED
@@ -1,6 +1,6 @@
1
  ---
2
  tags:
3
- - text-to-image
4
  - lora
5
  - diffusers
6
  - template:diffusion-lora
@@ -26,13 +26,118 @@ base_model: Wan-AI/Wan2.1-T2V-1.3B
26
  instance_prompt: null
27
  license: apache-2.0
28
  ---
 
 
 
 
 
 
 
 
 
 
29
  # PanoWan
30
 
31
- <Gallery />
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
32
 
 
33
 
 
34
 
35
- ## Download model
36
 
 
37
 
38
- [Download](/YOUSIKI/PanoWan/tree/main) them in the Files & versions tab.
 
 
 
 
 
 
 
 
1
  ---
2
  tags:
3
+ - text-to-video
4
  - lora
5
  - diffusers
6
  - template:diffusion-lora
 
26
  instance_prompt: null
27
  license: apache-2.0
28
  ---
29
+ <a align="center">
30
+ <video src='https://github.com/user-attachments/assets/238d45f9-9335-42be-9b03-27ed6880ce29'></video>
31
+ </a>
32
+
33
+ <p align="center">
34
+ <a href='https://panowan.variantconst.com'><img src='https://img.shields.io/badge/Project-Page-Green'></a> &nbsp;
35
+ <a href='https://arxiv.org/abs/2505.22016'><img src='https://img.shields.io/badge/arXiv-2505.22016-b31b1b.svg'></a> &nbsp;
36
+ <a href='https://huggingface.co/datasets/yousiki/PanoWan'><img src='https://img.shields.io/badge/Dataset-PanoWan-yellow'></a>
37
+ </p>
38
+
39
  # PanoWan
40
 
41
+ Official repository for "PanoWan: Lifting Diffusion Video Generation Models to 360° with Latitude/Longitude-aware Mechanisms"
42
+
43
+ ## Text-to-360° Video Generation
44
+
45
+ Generate panoramic videos from text prompts:
46
+
47
+ <table>
48
+ <tr>
49
+ <td align="center" valign="top">
50
+ <video src="https://github.com/user-attachments/assets/6453d67b-60ad-42be-9a72-013f1449341a" width="200"></video>
51
+ </td>
52
+ <td align="center" valign="top">
53
+ <video src="https://github.com/user-attachments/assets/a494213c-ca3f-4ff1-93d2-a36df8ad8790" width="200"></video>
54
+ </td>
55
+ <td align="center" valign="top">
56
+ <video src="https://github.com/user-attachments/assets/4614969f-9973-421a-9fc0-4f4222e2b84b" width="200"></video>
57
+ </td>
58
+ <td align="center" valign="top">
59
+ <video src="https://github.com/user-attachments/assets/746e5c19-18ef-4fab-b25b-68521f0dcea9" width="200"></video>
60
+ </td>
61
+ </tr>
62
+ <tr>
63
+ <td align="center" valign="top">
64
+ <video src="https://github.com/user-attachments/assets/92b0c1d9-5005-4cf4-adf2-5042e7bf0abf" width="200"></video>
65
+ </td>
66
+ <td align="center" valign="top">
67
+ <video src="https://github.com/user-attachments/assets/7c040660-4a9e-408f-9490-79fb5f349297" width="200"></video>
68
+ </td>
69
+ <td align="center" valign="top">
70
+ <video src="https://github.com/user-attachments/assets/add58417-e00c-4fae-af6f-2cbfb0b8019b" width="200"></video>
71
+ </td>
72
+ <td align="center" valign="top">
73
+ <video src="https://github.com/user-attachments/assets/96c64c3d-a3f3-4832-94e2-c3c1c6a3edf0" width="200"></video>
74
+ </td>
75
+ </tr>
76
+ </table>
77
+
78
+ ## Zero-Shot Applications
79
+
80
+ ### Long Video Generation
81
+
82
+ Generate extended panoramic videos using temporal windowing and seamless blending:
83
+
84
+ https://github.com/user-attachments/assets/1e404ed9-0165-4a67-89e3-9f9ac9ecd052
85
+
86
+ ### Super Resolution
87
+
88
+ Enhance low-resolution panoramic videos to 2x resolution:
89
+
90
+ <div align="center">
91
+ <table>
92
+ <tr>
93
+ <td width="50%">
94
+ <video src="https://github.com/user-attachments/assets/ccb31e1f-133b-4fbb-86e2-084cf2edce28" width="100%"></video>
95
+ <p align="center">Low Resolution</p>
96
+ </td>
97
+ <td width="50%">
98
+ <video src="https://github.com/user-attachments/assets/d06ad051-9d25-4589-89aa-f15b85894119" width="100%"></video>
99
+ <p align="center">High Resolution</p>
100
+ </td>
101
+ </tr>
102
+ </table>
103
+ </div>
104
+
105
+ ### Semantic Editing
106
+
107
+ Edit panoramic videos with text-guided modifications:
108
+
109
+ <div align="center">
110
+ <table>
111
+ <tr>
112
+ <td width="50%">
113
+ <video src="https://github.com/user-attachments/assets/951cd6ff-60df-4480-a728-9a3d38568117" width="100%"></video>
114
+ <p align="center">Original</p>
115
+ </td>
116
+ <td width="50%">
117
+ <video src="https://github.com/user-attachments/assets/c0e12443-a479-40eb-aa67-d4874b745fde" width="100%"></video>
118
+ <p align="center">Edited</p>
119
+ </td>
120
+ </tr>
121
+ </table>
122
+ </div>
123
+
124
+ ### Video Outpainting
125
+
126
+ Transform conventional videos to panoramic format:
127
 
128
+ https://github.com/user-attachments/assets/92dca130-d5c0-423e-a285-9f6402b8db9d
129
 
130
+ ## Dataset
131
 
132
+ The metadata for our dataset is released at [HuggingFace](https://huggingface.co/datasets/yousiki/PanoWan).
133
 
134
+ ## Citation
135
 
136
+ ```bibtex
137
+ @article{xia2025panowan,
138
+ title={PanoWan: Lifting Diffusion Video Generation Models to 360° with Latitude/Longitude-aware Mechanisms},
139
+ author={Xia, Yifei and Weng, Shuchen and Yang, Siqi and Liu, Jingqi and Zhu, Chengxuan and Teng, Minggui and Jia, Zijian and Jiang, Han and Shi, Boxin},
140
+ journal={arXiv preprint arXiv:2505.22016},
141
+ year={2025}
142
+ }
143
+ ```