findcard12138 commited on
Commit
0b0293a
·
verified ·
1 Parent(s): 043d7f2

Upload folder using huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +0 -4
README.md CHANGED
@@ -60,7 +60,6 @@ This model is designed as a high-performance offline engine for multimodal tasks
60
  **MOSS-VL-Instruct-0408** adopts a decoupled multimodal design, utilizing a cross-attention mechanism to bridge high-resolution visual encoding with advanced language reasoning.
61
  <p align="center">
62
  <img src="assets/structure.png" alt="MOSS-VL Architecture" width="90%"/>
63
- <em>Figure 1: MOSS-VL Core Architecture.</em>
64
  </p>
65
 
66
 
@@ -69,7 +68,6 @@ This model is designed as a high-performance offline engine for multimodal tasks
69
  At the model-family level, MOSS-VL uses timestamp-aware multimodal prompting for video understanding. This design gives sampled frames explicit temporal anchors, which helps the model reason about order, duration, and event localization more robustly.
70
  <p align="center">
71
  <img src="assets/timestamp_input.svg" alt="Timestamped Sequence Input Illustration" width="90%"/>
72
- <em>Figure 2: Illustration of the timestamped sequence input pipeline.</em>
73
  </p>
74
 
75
  ## Multimodal RoPE
@@ -77,7 +75,6 @@ At the model-family level, MOSS-VL uses timestamp-aware multimodal prompting for
77
  MOSS-VL uses multimodal rotary position encoding to align text tokens and visual features in a shared spatial-temporal coordinate system. At a high level, this improves video-text grounding and helps preserve temporal structure during multimodal reasoning.
78
  <p align="center">
79
  <img src="assets/3d-rope.png" alt="MOSS-VL mRoPE Architecture Illustration" width="80%"/>
80
- <em>Figure 3: 3D-RoPE spatial-temporal alignment.</em>
81
  </p>
82
 
83
 
@@ -86,7 +83,6 @@ MOSS-VL uses multimodal rotary position encoding to align text tokens and visual
86
  We evaluate **MOSS-VL-Instruct-0408** across several key multimodal benchmarks, focusing on both video and image understanding.
87
  <p align="center">
88
  <img src="assets/MOSS-VL-Benchmark.png" alt="MOSS-VL Benchmark Results" width="100%"/>
89
- <em>Figure 4: Performance comparison on mainstream multimodal benchmarks.</em>
90
  </p>
91
 
92
 
 
60
  **MOSS-VL-Instruct-0408** adopts a decoupled multimodal design, utilizing a cross-attention mechanism to bridge high-resolution visual encoding with advanced language reasoning.
61
  <p align="center">
62
  <img src="assets/structure.png" alt="MOSS-VL Architecture" width="90%"/>
 
63
  </p>
64
 
65
 
 
68
  At the model-family level, MOSS-VL uses timestamp-aware multimodal prompting for video understanding. This design gives sampled frames explicit temporal anchors, which helps the model reason about order, duration, and event localization more robustly.
69
  <p align="center">
70
  <img src="assets/timestamp_input.svg" alt="Timestamped Sequence Input Illustration" width="90%"/>
 
71
  </p>
72
 
73
  ## Multimodal RoPE
 
75
  MOSS-VL uses multimodal rotary position encoding to align text tokens and visual features in a shared spatial-temporal coordinate system. At a high level, this improves video-text grounding and helps preserve temporal structure during multimodal reasoning.
76
  <p align="center">
77
  <img src="assets/3d-rope.png" alt="MOSS-VL mRoPE Architecture Illustration" width="80%"/>
 
78
  </p>
79
 
80
 
 
83
  We evaluate **MOSS-VL-Instruct-0408** across several key multimodal benchmarks, focusing on both video and image understanding.
84
  <p align="center">
85
  <img src="assets/MOSS-VL-Benchmark.png" alt="MOSS-VL Benchmark Results" width="100%"/>
 
86
  </p>
87
 
88