teetone commited on
Commit
4dec8af
·
verified ·
1 Parent(s): 7550f9f

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +49 -1
README.md CHANGED
@@ -6,4 +6,52 @@ language:
6
  - en
7
  base_model:
8
  - Qwen/Qwen3-VL-4B-Instruct
9
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
6
  - en
7
  base_model:
8
  - Qwen/Qwen3-VL-4B-Instruct
9
+ ---
10
+
11
+ # RoboReward 4B
12
+
13
+ **Paper:** [https://arxiv.org/abs/2601.00675](https://arxiv.org/abs/2601.00675)
14
+
15
+ RoboReward provides **general-purpose vision-language reward model for robotics**, trained on the [RoboReward dataset](https://huggingface.co/datasets/teetone/RoboReward) with **Qwen-3 VL** to predict **discrete end-of-episode progress rewards** from real-robot rollout videos.
16
+
17
+
18
+ ## Usage
19
+
20
+ ### Purpose
21
+
22
+ Given a **task instruction** and a **rollout video**, the model predicts an end-of-episode progress score:
23
+ - **1:** No success
24
+ - **2:** Minimal progress
25
+ - **3:** Partial completion
26
+ - **4:** Near completion
27
+ - **5:** Perfect completion
28
+
29
+ ### Inference
30
+
31
+ Follow the [original Qwen 3-VL instructions with video input](https://huggingface.co/Qwen/Qwen3-VL-4B-Instruct) and use a text prompt like this:
32
+
33
+ ```text
34
+ Given the task, assign a discrete progress score reward (1,2,3,4,5) for the robot in the video in the format: ANSWER: <score>
35
+ Rubric for end-of-episode progress (judge only the final state without time limits):
36
+ 1 - No Success: Final state shows no goal-relevant change for the command.
37
+ 2 - Minimal Progress: Final state shows a small but insufficient change toward the goal.
38
+ 3 - Partial Completion: The final state shows good progress toward the goal but violates more than one requirement or a major requirement.
39
+ 4 - Near Completion: Final state is correct in region and intent but misses a single minor requirement.
40
+ 5 - Perfect Completion: Final state satisfies all requirements.
41
+
42
+ Task: <INSERT TASK HERE>
43
+ ```
44
+
45
+ ## Citation
46
+
47
+ ```bibtex
48
+ @misc{lee2026roborewardgeneralpurposevisionlanguagereward,
49
+ title={RoboReward: General-Purpose Vision-Language Reward Models for Robotics},
50
+ author={Tony Lee and Andrew Wagenmaker and Karl Pertsch and Percy Liang and Sergey Levine and Chelsea Finn},
51
+ year={2026},
52
+ eprint={2601.00675},
53
+ archivePrefix={arXiv},
54
+ primaryClass={cs.RO},
55
+ url={https://arxiv.org/abs/2601.00675},
56
+ }
57
+ ```