Update README.md
Browse files
README.md
CHANGED
|
@@ -35,7 +35,7 @@ Packaged in the **`compressed-tensors`** `pack-quantized` format so it loads dir
|
|
| 35 |
Marlin INT4 MoE + Linear kernels. Fast tensor-core prefill.
|
| 36 |
- **Long context via YaRN.** With YaRN RoPE scaling the context extends from the native
|
| 37 |
**262,144** up to **1,048,576 (1M)** tokens (configurable). Dense needle-in-a-haystack
|
| 38 |
-
retrieval is **verified past native (
|
| 39 |
|
| 40 |
## Verified results (single B300, this checkpoint)
|
| 41 |
|
|
|
|
| 35 |
Marlin INT4 MoE + Linear kernels. Fast tensor-core prefill.
|
| 36 |
- **Long context via YaRN.** With YaRN RoPE scaling the context extends from the native
|
| 37 |
**262,144** up to **1,048,576 (1M)** tokens (configurable). Dense needle-in-a-haystack
|
| 38 |
+
retrieval is **verified past native (1M, PASS)** on a single GPU; see *Long context* below.
|
| 39 |
|
| 40 |
## Verified results (single B300, this checkpoint)
|
| 41 |
|