TheStageAI
/

Elastic-Llama-3.1-8B-Instruct

Text Generation

Model card Files Files and versions

psynote123 commited on Apr 25, 2025

Commit

e9f7e51

·

verified ·

1 Parent(s): acf0220

Update README.md

Files changed (1) hide show

README.md +2 -2

README.md CHANGED Viewed

@@ -30,7 +30,7 @@ __Goals of elastic models:__
 > It's important to note that specific quality degradation can vary from model to model. For instance, with an S model, you can have 0.5% degradation as well.
-![image/png](https://cdn-uploads.huggingface.co/production/uploads/67991798ae62bd1f17cc22ed/QLfmHh17Pvr_iwYYiwRk7.png)
 -----
@@ -155,7 +155,7 @@ __100 input/300 output; tok/s:__
 | GPU/Model | S   | M | L | XL | Original | W8A8, int8 |
 |-----------|-----|---|---|----|----------|------------|
-| H100      | 188 | 174 | 159 | 131  | 58       | 191          |
 | L40s      | 73  | 64 | 57 | 45  | 40    | 77         |

 > It's important to note that specific quality degradation can vary from model to model. For instance, with an S model, you can have 0.5% degradation as well.
+![image/png](https://cdn-uploads.huggingface.co/production/uploads/6799fc8e150f5a4014b030ca/pKc4jGGKTrp7ecawPbZq-.png)
 -----
 | GPU/Model | S   | M | L | XL | Original | W8A8, int8 |
 |-----------|-----|---|---|----|----------|------------|
+| H100      | 189 | 175 | 159 | 132  | 60       | 191          |
 | L40s      | 73  | 64 | 57 | 45  | 40    | 77         |