TheStageAI
/

Elastic-DeepSeek-R1-Distill-Llama-8B

psynote123 commited on Apr 24, 2025

Commit

4a283c7

verified ·

1 Parent(s): 3709146

Upload README.md with huggingface_hub

Files changed (1) hide show

README.md CHANGED Viewed

@@ -152,7 +152,7 @@ __100 input/300 output; tok/s:__
 | GPU/Model | S   | M | L | XL | Original | W8A8, int8 |
 |-----------|-----|---|---|----|----------|------------|
-| H100 | 195 | 189 | 161 | 132 | 58 | -1 | - |
 | L40S | -1 | -1 | -1 | -1 | -1 | -1 | - |

 | GPU/Model | S   | M | L | XL | Original | W8A8, int8 |
 |-----------|-----|---|---|----|----------|------------|
+| H100 | 194 | 191 | 161 | 131 | 58 | 198 | - |
 | L40S | -1 | -1 | -1 | -1 | -1 | -1 | - |