Update README.md
Browse files
README.md
CHANGED
|
@@ -13,9 +13,9 @@ base_model:
|
|
| 13 |
<h1 style="margin: 0; border-bottom: none;">Step-3.5-Flash</h1>
|
| 14 |
</div>
|
| 15 |
|
| 16 |
-
[](https://huggingface.co/stepfun-ai/
|
| 17 |
[](https://huggingface.co/stepfun-ai/step3p5_preview/tree/main)
|
| 18 |
-
[](https://huggingface.co/stepfun-ai/
|
| 19 |
[]()
|
| 20 |
|
| 21 |
</div>
|
|
@@ -51,7 +51,7 @@ Performance of Step 3.5 Flash measured across **Reasoning**, **Coding**, and **A
|
|
| 51 |
| Est. decoding cost (@ 128K context, Hopper GPU**) | **1.0x** (100 tok/s, MTP-3, EP8) | 6.0x (33 tok/s, MTP-1, EP32) | 18.9x (33 tok/s, no MTP, EP32) | 18.9x (100 tok/s, MTP-3, EP8) | 3.9x (100 tok/s, MTP-3, EP8) | 1.2x (100 tok/s, MTP-3, EP8) |
|
| 52 |
| **Agency** | | | | | | |
|
| 53 |
| τ²-Bench | **88.2** | 80.3 | 74.3* / — | 87.4 | 80.2* | 80.3 |
|
| 54 |
-
| BrowseComp |
|
| 55 |
| BrowseComp (w/ Context Manager) | 69.0 | 67.6 | 60.2 / **74.9** | 67.5 | 62.0 | 58.3 |
|
| 56 |
| BrowseComp-ZH | **66.9** | 65.0 | 62.3 / 62.3* | 66.6 | 47.8* | 51.2* |
|
| 57 |
| BrowseComp-ZH (w/ Context Manager) | **73.7** | — | — / — | — | — | — |
|
|
|
|
| 13 |
<h1 style="margin: 0; border-bottom: none;">Step-3.5-Flash</h1>
|
| 14 |
</div>
|
| 15 |
|
| 16 |
+
[](https://huggingface.co/stepfun-ai/Step-3.5-Flash)
|
| 17 |
[](https://huggingface.co/stepfun-ai/step3p5_preview/tree/main)
|
| 18 |
+
[](https://huggingface.co/stepfun-ai/Step-3.5-Flash)
|
| 19 |
[]()
|
| 20 |
|
| 21 |
</div>
|
|
|
|
| 51 |
| Est. decoding cost (@ 128K context, Hopper GPU**) | **1.0x** (100 tok/s, MTP-3, EP8) | 6.0x (33 tok/s, MTP-1, EP32) | 18.9x (33 tok/s, no MTP, EP32) | 18.9x (100 tok/s, MTP-3, EP8) | 3.9x (100 tok/s, MTP-3, EP8) | 1.2x (100 tok/s, MTP-3, EP8) |
|
| 52 |
| **Agency** | | | | | | |
|
| 53 |
| τ²-Bench | **88.2** | 80.3 | 74.3* / — | 87.4 | 80.2* | 80.3 |
|
| 54 |
+
| BrowseComp | 51.6 | 51.4 | 41.5* / **60.6** | 52.0 | 47.4 | 45.4 |
|
| 55 |
| BrowseComp (w/ Context Manager) | 69.0 | 67.6 | 60.2 / **74.9** | 67.5 | 62.0 | 58.3 |
|
| 56 |
| BrowseComp-ZH | **66.9** | 65.0 | 62.3 / 62.3* | 66.6 | 47.8* | 51.2* |
|
| 57 |
| BrowseComp-ZH (w/ Context Manager) | **73.7** | — | — / — | — | — | — |
|