Enhance OpenVLThinker-7B model card: Add paper info, abstract, and descriptive tags

README.md

@@ -1,11 +1,25 @@
 ---
 base_model:
 - Qwen/Qwen2.5-VL-7B-Instruct
-license: apache-2.0
 library_name: transformers
+license: apache-2.0
 pipeline_tag: image-text-to-text
+tags:
+- reasoning
+- multimodal
+- vlm
+- math
+- visual-question-answering
 ---
 
+# OpenVLThinker: Complex Vision-Language Reasoning via Iterative SFT-RL Cycles
+
+This model was presented in the paper [OpenVLThinker: Complex Vision-Language Reasoning via Iterative SFT-RL Cycles](https://huggingface.co/papers/2503.17352).
+
+## Abstract
+
+We introduce OpenVLThinker, one of the first open-source large vision-language models (LVLMs) to exhibit sophisticated chain-of-thought reasoning, achieving notable performance gains on challenging visual reasoning tasks. While text-based reasoning models (e.g., Deepseek R1) show promising results in text-only tasks, distilling their reasoning into LVLMs via supervised fine-tuning (SFT) often results in performance degradation due to imprecise visual grounding. Conversely, purely reinforcement learning (RL)-based methods face a large search space, hindering the emergence of reflective behaviors in smaller models (e.g., 7B LVLMs). Surprisingly, alternating between SFT and RL ultimately results in significant performance improvements after a few iterations. Our analysis reveals that the base model rarely exhibits reasoning behaviors initially, but SFT effectively surfaces these latent actions and narrows the RL search space, accelerating the development of reasoning capabilities. Each subsequent RL stage further refines the model's reasoning skills, producing higher-quality SFT data for continued self-improvement. OpenVLThinker-7B consistently advances performance across six benchmarks demanding mathematical and general reasoning, notably improving MathVista by 3.8%, EMMA by 2.4%, and HallusionBench by 1.6%. Beyond demonstrating the synergy between SFT and RL for complex reasoning tasks, our findings provide early evidence towards achieving R1-style reasoning in multimodal contexts. The code, model and data are held at this https URL .
+
 ## Overview
 OpenVLThinker-7B is a vision-language reasoning model designed to handle multimodal tasks. It is especially tuned for visual mathematical problem-solving.
 
@@ -85,14 +99,14 @@ print(generated_text)
 ```
 
 ### Citation
-```text
+```bibtex
 @misc{deng2025openvlthinker,
-      title={OpenVLThinker: An Early Exploration to Complex Vision-Language Reasoning via Iterative Self-Improvement}, 
+      title={OpenVLThinker: Complex Vision-Language Reasoning via Iterative SFT-RL Cycles},
       author={Yihe Deng and Hritik Bansal and Fan Yin and Nanyun Peng and Wei Wang and Kai-Wei Chang},
       year={2025},
       eprint={2503.17352},
       archivePrefix={arXiv},
       primaryClass={cs.CV},
-      url={https://arxiv.org/abs/2503.17352}, 
+      url={https://huggingface.co/papers/2503.17352},
 }
 ```