Update README.md

README.md

@@ -15,34 +15,88 @@ pipeline_tag: image-text-to-text
 We introduce Skywork-R1V, a multimodal reasoning model that extends the R1-series text models to visual modalities through a near-lossless transfer method. Using a lightweight visual projector, Skywork-R1V enables seamless multimodal adaptation without requiring retraining of either the base language model or vision encoder. To enhance visual-text alignment, we developed a hybrid optimization strategy combining Iterative Supervised Fine-Tuning (SFT) with Group Relative Policy Optimization (GRPO), significantly improving cross-modal integration. Additionally, we created an adaptive-length Chain-of-Thought distillation approach for generating reasoning data, which dynamically optimizes reasoning chain lengths to improve inference efficiency and prevent overthinking. The model achieves good performance on key multimodal reasoning benchmarks, scoring 69 on MMMU and 67.5 on MathVista, comparable to leading closed-source models like Gemini 2.0 and Kimi-k1.5. It also maintains strong textual reasoning capabilities, achieving impressive scores of 72.0 on AIME and 94.0 on MATH500. 
 
 
-## 2. Model Summary
-
-****Architecture:**** 
-Skywork-R1V employs a modular architecture that efficiently combines vision and language capabilities:
-- Vision Encoder: Uses Vision Transformer (ViT) as the visual backbone to process image inputs.
-- Visual Projector: A lightweight MLP (multilayer perceptron) adapter that serves as the bridge between the vision and language components.
-- Language Model: Utilizes R1-distilled-Qwen-32B as the reasoning-capable language model backbone.
-
-The model follows a connection pattern of Vision Encoder → MLP Adapter → Language Model, where the MLP adapter aligns the output space of the vision encoder with the input space of the language model. This design allows for efficient transfer of reasoning capabilities from text to multimodal domains without requiring extensive retraining of either the vision encoder or language model.
-
-****Key Designs**** 
-- **Advanced Multimodal Reasoning**  
-  Excels in complex reasoning across textual and visual modalities.
-- **Iterative Training Strategies**  
-  Employs iterative supervision and grpo to refine model alignment and performance.
-- **Adaptive length Chain-of-Thought**  
-  Dynamically adjusts reasoning length to enhance inference efficiency and accuracy.
-- **Scalable Performance**  
-  Benchmarked to rival proprietary models across mathematics, coding, and multimodal tasks.
+## 2. Feature
+- **Visual Chain-of-Thought**: Enables multi-step logical reasoning on visual inputs, breaking down complex image-based problems into manageable steps.
+- **Mathematical & Scientific Analysis**: Capable of solving visual math problems and interpreting scientific/medical imagery with high precision.
+- **Cross-Modal Understanding**: Seamlessly integrates text and images for richer, context-aware comprehension.
 
-## 3. Evaluation
 
+## 3. Evaluation
+<br>
+<br>
 <div align="center">
-  <img src="eval.jpeg" width="800" height="600" alt="skywork_r1v_eval" />
+  <b>Comparison with Larger-Scale Open-Source and Closed-Source Models</b>
 </div>
 
+<table align="center">
+  <thead>
+    <tr>
+      <th></th>
+      <th align="center"><strong>Benchmark</strong></th>
+      <th align="center"><strong>LLM</strong></th>
+      <th align="center" colspan="4"><strong>VLM</strong></th>
+    </tr>
+    <tr>
+      <th></th>
+      <th></th>
+      <th align="center"><strong>QwQ-32B-Preview</strong></th>
+      <th align="center"><strong>InternVL-2.5-38B</strong></th>
+      <th align="center"><strong>VILA 1.5-40B</strong></th>
+      <th align="center"><strong>InternVL2-40B</strong></th>
+      <th align="center"><strong>Skywork-R1V-38B</strong></th>
+    </tr>
+  </thead>
+  <tbody>
+    <tr>
+      <td rowspan="3">Reasoning</td>
+      <td>MATH-500</td>
+      <td align="center">90.6</td>
+      <td align="center">-</td>
+      <td align="center">-</td>
+      <td align="center">-</td>
+      <td align="center"><strong>94.0</strong></td>
+    </tr>
+    <tr>
+      <td>AIME 2024</td>
+      <td align="center">50.0</td>
+      <td align="center">-</td>
+      <td align="center">-</td>
+      <td align="center">-</td>
+      <td align="center"><strong>72.0</strong></td>
+    </tr>
+    <tr>
+      <td>GPQA</td>
+      <td align="center">54.5</td>
+      <td align="center">-</td>
+      <td align="center">-</td>
+      <td align="center">-</td>
+      <td align="center"><strong>61.6</strong></td>
+    </tr>
+    <tr>
+      <td rowspan="3">Vision</td>
+      <td>MathVista(mini)</td>
+      <td align="center">-</td>
+      <td align="center">71.9</td>
+      <td align="center">49.5</td>
+      <td align="center">63.7</td>
+      <td align="center">67.5</td>
+    </tr>
+    <tr>
+      <td>MMMU(Val)</td>
+      <td align="center">-</td>
+      <td align="center">63.9</td>
+      <td align="center">55.1</td>
+      <td align="center">55.2</td>
+      <td align="center"><strong>69.0</strong></td>
+    </tr>
+  </tbody>
+</table>
+
+
+<br>
+<br>
 <div align="center">
-  <b>Evaluation results of LLMs and VLMs</b>
+  <b>Evaluation results of state-of-the-art LLMs and VLMs</b>
 </div>
 <table>
   <thead>
@@ -175,73 +229,9 @@ The model follows a connection pattern of Vision Encoder → MLP Adapter → Lan
 </table>
 
 <div align="center">
-  <b>Comparison with Larger-Scale Open-Source and Closed-Source Models</b>
+  <img src="eval.jpeg" width="80%" alt="skywork_r1v_eval" />
 </div>
 
-<table align="center">
-  <thead>
-    <tr>
-      <th></th>
-      <th align="center"><strong>Benchmark</strong></th>
-      <th align="center"><strong>LLM</strong></th>
-      <th align="center" colspan="4"><strong>VLM</strong></th>
-    </tr>
-    <tr>
-      <th></th>
-      <th></th>
-      <th align="center"><strong>QwQ-32B-Preview</strong></th>
-      <th align="center"><strong>InternVL-2.5-38B</strong></th>
-      <th align="center"><strong>VILA 1.5-40B</strong></th>
-      <th align="center"><strong>InternVL2-40B</strong></th>
-      <th align="center"><strong>Skywork-R1V-38B</strong></th>
-    </tr>
-  </thead>
-  <tbody>
-    <tr>
-      <td rowspan="3">Reasoning</td>
-      <td>MATH-500</td>
-      <td align="center">90.6</td>
-      <td align="center">-</td>
-      <td align="center">-</td>
-      <td align="center">-</td>
-      <td align="center"><strong>94.0</strong></td>
-    </tr>
-    <tr>
-      <td>AIME 2024</td>
-      <td align="center">50.0</td>
-      <td align="center">-</td>
-      <td align="center">-</td>
-      <td align="center">-</td>
-      <td align="center"><strong>72.0</strong></td>
-    </tr>
-    <tr>
-      <td>GPQA</td>
-      <td align="center">54.5</td>
-      <td align="center">-</td>
-      <td align="center">-</td>
-      <td align="center">-</td>
-      <td align="center"><strong>61.6</strong></td>
-    </tr>
-    <tr>
-      <td rowspan="3">Vision</td>
-      <td>MathVista(mini)</td>
-      <td align="center">-</td>
-      <td align="center">71.9</td>
-      <td align="center">49.5</td>
-      <td align="center">63.7</td>
-      <td align="center">67.5</td>
-    </tr>
-    <tr>
-      <td>MMMU(Val)</td>
-      <td align="center">-</td>
-      <td align="center">63.9</td>
-      <td align="center">55.1</td>
-      <td align="center">55.2</td>
-      <td align="center"><strong>69.0</strong></td>
-    </tr>
-  </tbody>
-</table>
-
 
 ## 4. Skywork-R1V Family