Update README.md
Browse files
README.md
CHANGED
|
@@ -32,8 +32,6 @@ pipeline_tag: text-generation
|
|
| 32 |
| **Type** | **INTELLECT-3** | **INTELLECT-3-AWQ-8bit** |
|
| 33 |
|:---------------:|:----------------:|:----------------:|
|
| 34 |
| **Memory Size** | 199.0 GB | 107.7 GB |
|
| 35 |
-
| **KV Cache per Token** | 61.3 kB | 30.7 kB |
|
| 36 |
-
| **KV Cache per Context** | 7.7 GB | 3.8 GB |
|
| 37 |
|
| 38 |
## Inference
|
| 39 |
|
|
|
|
| 32 |
| **Type** | **INTELLECT-3** | **INTELLECT-3-AWQ-8bit** |
|
| 33 |
|:---------------:|:----------------:|:----------------:|
|
| 34 |
| **Memory Size** | 199.0 GB | 107.7 GB |
|
|
|
|
|
|
|
| 35 |
|
| 36 |
## Inference
|
| 37 |
|