Improve model card and metadata

#1
by nielsr HF Staff - opened
Files changed (1) hide show
  1. README.md +20 -7
README.md CHANGED
@@ -1,40 +1,53 @@
1
  ---
2
  license: bsd-3-clause
3
  pipeline_tag: video-text-to-text
 
 
4
  ---
5
 
6
  # VideoMind-2B-FT-QVHighlights
7
 
8
  <div style="display: flex; gap: 5px;">
 
9
  <a href="https://arxiv.org/abs/2503.13444" target="_blank"><img src="https://img.shields.io/badge/arXiv-2503.13444-red"></a>
10
  <a href="https://videomind.github.io/" target="_blank"><img src="https://img.shields.io/badge/Project-Page-brightgreen"></a>
 
11
  <a href="https://github.com/yeliudev/VideoMind/blob/main/README.md" target="_blank"><img src="https://img.shields.io/badge/License-BSD--3--Clause-purple"></a>
12
- <a href="https://github.com/yeliudev/VideoMind" target="_blank"><img src="https://img.shields.io/github/stars/yeliudev/VideoMind"></a>
13
  </div>
14
 
15
- VideoMind is a multi-modal agent framework that enhances video reasoning by emulating *human-like* processes, such as *breaking down tasks*, *localizing and verifying moments*, and *synthesizing answers*.
 
 
16
 
17
  ## πŸ”– Model Details
18
 
19
  ### Model Description
20
 
21
- - **Model type:** Multi-modal Large Language Model
 
 
22
  - **Language(s):** English
23
  - **License:** BSD-3-Clause
24
 
25
- ### More Details
 
 
 
 
 
 
26
 
27
- Please refer to our [GitHub Repository](https://github.com/yeliudev/VideoMind) for more details about this model.
28
 
29
  ## πŸ“– Citation
30
 
31
  Please kindly cite our paper if you find this project helpful.
32
 
33
- ```
34
  @inproceedings{liu2026videomind,
35
  title={VideoMind: A Chain-of-LoRA Agent for Temporal-Grounded Video Reasoning},
36
  author={Liu, Ye and Lin, Kevin Qinghong and Chen, Chang Wen and Shou, Mike Zheng},
37
  booktitle={International Conference on Learning Representations (ICLR)},
38
  year={2026}
39
  }
40
- ```
 
1
  ---
2
  license: bsd-3-clause
3
  pipeline_tag: video-text-to-text
4
+ library_name: transformers
5
+ base_model: Qwen/Qwen2-VL-2B-Instruct
6
  ---
7
 
8
  # VideoMind-2B-FT-QVHighlights
9
 
10
  <div style="display: flex; gap: 5px;">
11
+ <a href="https://huggingface.co/papers/2503.13444" target="_blank"><img src="https://img.shields.io/badge/Paper-HF--Papers-yellow"></a>
12
  <a href="https://arxiv.org/abs/2503.13444" target="_blank"><img src="https://img.shields.io/badge/arXiv-2503.13444-red"></a>
13
  <a href="https://videomind.github.io/" target="_blank"><img src="https://img.shields.io/badge/Project-Page-brightgreen"></a>
14
+ <a href="https://github.com/yeliudev/VideoMind" target="_blank"><img src="https://img.shields.io/badge/GitHub-Code-blue"></a>
15
  <a href="https://github.com/yeliudev/VideoMind/blob/main/README.md" target="_blank"><img src="https://img.shields.io/badge/License-BSD--3--Clause-purple"></a>
 
16
  </div>
17
 
18
+ **VideoMind** is a multi-modal agent framework that enhances video reasoning by emulating *human-like* processes, such as *breaking down tasks*, *localizing and verifying moments*, and *synthesizing answers*.
19
+
20
+ This repository contains the fine-tuned LoRA adapter (specifically the **Grounder** role for temporal event localization) for the 2B version of the framework, trained on the **QVHighlights** dataset. It is based on the paper [VideoMind: A Chain-of-LoRA Agent for Temporal-Grounded Video Reasoning](https://huggingface.co/papers/2503.13444).
21
 
22
  ## πŸ”– Model Details
23
 
24
  ### Model Description
25
 
26
+ - **Model type:** Multi-modal Large Language Model (LoRA Adapter)
27
+ - **Base Model:** [Qwen/Qwen2-VL-2B-Instruct](https://huggingface.co/Qwen/Qwen2-VL-2B-Instruct)
28
+ - **Role:** Grounder (Temporal Event Localization)
29
  - **Language(s):** English
30
  - **License:** BSD-3-Clause
31
 
32
+ ### Framework Overview
33
+
34
+ VideoMind identifies four essential capabilities for grounded video reasoning:
35
+ 1. **Planner:** Coordinates roles.
36
+ 2. **Grounder:** Temporal event localization.
37
+ 3. **Verifier:** Assesses event candidates.
38
+ 4. **Answerer:** Question answering.
39
 
40
+ This specific checkpoint is the Grounder specialized for the QVHighlights task using the Chain-of-LoRA mechanism.
41
 
42
  ## πŸ“– Citation
43
 
44
  Please kindly cite our paper if you find this project helpful.
45
 
46
+ ```bibtex
47
  @inproceedings{liu2026videomind,
48
  title={VideoMind: A Chain-of-LoRA Agent for Temporal-Grounded Video Reasoning},
49
  author={Liu, Ye and Lin, Kevin Qinghong and Chen, Chang Wen and Shou, Mike Zheng},
50
  booktitle={International Conference on Learning Representations (ICLR)},
51
  year={2026}
52
  }
53
+ ```