CCCCyx commited on
Commit
e64e1f6
·
verified ·
1 Parent(s): 99b290c

Add files using upload-large-folder tool

Browse files
.gitattributes CHANGED
@@ -39,3 +39,5 @@ assets/architecture.png filter=lfs diff=lfs merge=lfs -text
39
  assets/logo.png filter=lfs diff=lfs merge=lfs -text
40
  assets/mossvl_quantization_benchmark_comparison_zh_4k.png filter=lfs diff=lfs merge=lfs -text
41
  assets/mossvl_quantization_benchmark_comparison_en_4k.png filter=lfs diff=lfs merge=lfs -text
 
 
 
39
  assets/logo.png filter=lfs diff=lfs merge=lfs -text
40
  assets/mossvl_quantization_benchmark_comparison_zh_4k.png filter=lfs diff=lfs merge=lfs -text
41
  assets/mossvl_quantization_benchmark_comparison_en_4k.png filter=lfs diff=lfs merge=lfs -text
42
+ assets/mossvl_quantization_benchmark_comparison_final_v3_en_4k.png filter=lfs diff=lfs merge=lfs -text
43
+ assets/mossvl_quantization_benchmark_comparison_final_v3_zh_4k.png filter=lfs diff=lfs merge=lfs -text
README.md CHANGED
@@ -54,14 +54,15 @@ inference. This checkpoint is not an SGLang release.
54
  directly and do not pass a second quantization configuration or replace its
55
  generation config with the BF16 source file.
56
 
57
- ## Base model benchmark
58
 
59
- The following figure reports the streaming benchmark results of the original
60
- MOSS-VL-Realtime release. It provides base-model context; it is not presented
61
- as a separate quality evaluation of this FP8 checkpoint.
 
62
 
63
  <p align="center">
64
- <img src="assets/benchmark-streaming.png" alt="MOSS-VL-Realtime benchmark" width="100%"/>
65
  </p>
66
 
67
  ## Hardware requirements
 
54
  directly and do not pass a second quantization configuration or replace its
55
  generation config with the BF16 source file.
56
 
57
+ ## Quantization benchmark
58
 
59
+ The final evaluation compares the original BF16 model with all four release
60
+ profiles on their corresponding benchmark suites. For this streaming FP8
61
+ checkpoint, the scores are 70.66 on OVOBench Avg, 62.93 on StreamingBench Avg,
62
+ and 65.50 on OmniMMI PA, compared with 70.86, 62.42, and 66.00 for BF16.
63
 
64
  <p align="center">
65
+ <img src="assets/mossvl_quantization_benchmark_comparison_final_v3_en_4k.png" alt="MOSS-VL quantization benchmark comparison" width="100%"/>
66
  </p>
67
 
68
  ## Hardware requirements
README_zh.md CHANGED
@@ -52,13 +52,14 @@ tags:
52
  `generation_config.json` 会自动启用 HQQ KV8。请直接加载 checkpoint,
53
  不要再次传入量化配置,也不要用 BF16 原模型的 generation config 覆盖它。
54
 
55
- ## 基础模型 Benchmark
56
 
57
- 下图是原始 MOSS-VL-Realtime 的流式 benchmark,用于说明基础模型能力;
58
- 它不作为该 FP8 checkpoint 的独立精度测评结果。
 
59
 
60
  <p align="center">
61
- <img src="assets/benchmark-streaming.png" alt="MOSS-VL-Realtime benchmark" width="100%"/>
62
  </p>
63
 
64
  ## 硬件要求
 
52
  `generation_config.json` 会自动启用 HQQ KV8。请直接加载 checkpoint,
53
  不要再次传入量化配置,也不要用 BF16 原模型的 generation config 覆盖它。
54
 
55
+ ## 量化 Benchmark
56
 
57
+ 最终测评在各自对应的 benchmark 上对比原始 BF16 模型与四个量化发布配置。
58
+ 流式 FP8 checkpoint 的 OVOBench Avg、StreamingBench Avg 和 OmniMMI PA
59
+ 分别为 70.66、62.93 和 65.50;对应 BF16 分数为 70.86、62.42 和 66.00。
60
 
61
  <p align="center">
62
+ <img src="assets/mossvl_quantization_benchmark_comparison_final_v3_zh_4k.png" alt="MOSS-VL 量化配置 benchmark 对比" width="100%"/>
63
  </p>
64
 
65
  ## 硬件要求
assets/mossvl_quantization_benchmark_comparison_final_v3_en_4k.png ADDED

Git LFS Details

  • SHA256: d516d803e3cdb2bbae4348035f7249012597c5f92b82139a0e5d0735e3585875
  • Pointer size: 132 Bytes
  • Size of remote file: 1.71 MB
assets/mossvl_quantization_benchmark_comparison_final_v3_zh_4k.png ADDED

Git LFS Details

  • SHA256: 6ea3e7a3bfabdadbfed70b83d07f7dd084d44e366ba5123a776d3e557ddeb6e8
  • Pointer size: 132 Bytes
  • Size of remote file: 1.63 MB