array
/

Qwen2.5-VL-SAT

text-generation-inference

Model card Files Files and versions

array commited on about 1 month ago

Commit

b5bb67c

·

verified ·

1 Parent(s): 141028c

Update README.md

Files changed (1) hide show

README.md +2 -2

README.md CHANGED Viewed

@@ -36,8 +36,8 @@ Please see the paper for details on training and evaluation datasets and metrics
 | Model              | MV    | RelDep | SpRel | Jig   | IQT   | BLINK Avg | BLINK Reas | SAT-R | VSI Avg | VSI Reas | ERQA | Avg (All) |
 |--------------------|-------|--------|-------|-------|-------|-----------|------------|-------|---------|----------|------|-----------|
-| a. Qwen2.5-VL (7B) | 39.00 | 61.29  | 92.38 | 58.66 | 25.33 | 55.33     | 41.00      | 59.00 | 23.96   | 22.96    | 38.91 | 44.30     |
-| b. + DirAns FT    | 57.14 | 87.09  | 74.12 | 58.66 | 30.00 | 61.40     | 48.60      | 71.66 | 32.40   | 30.65    | 38.00 | 50.87     |

 | Model              | MV    | RelDep | SpRel | Jig   | IQT   | BLINK Avg | BLINK Reas | SAT-R | VSI Avg | VSI Reas | ERQA | Avg (All) |
 |--------------------|-------|--------|-------|-------|-------|-----------|------------|-------|---------|----------|------|-----------|
+| Qwen2.5-VL (7B) | 39.00 | 61.29  | 92.38 | 58.66 | 25.33 | 55.33     | 41.00      | 59.00 | 23.96   | 22.96    | 38.91 | 44.30     |
+| + SAT    | 57.14 | 87.09  | 74.12 | 58.66 | 30.00 | 61.40     | 48.60      | 71.66 | 32.40   | 30.65    | 38.00 | 50.87     |