Update README.md
Browse files
README.md
CHANGED
|
@@ -151,11 +151,6 @@ the final number is compared to the gold answer (after `####`). Result: **1265/1
|
|
| 151 |
|
| 152 |
## Caveats & honesty
|
| 153 |
|
| 154 |
-
- **4-bit RTN is lossy.** Chat/reasoning quality is well-preserved in our checks, but expect small
|
| 155 |
-
degradation vs the BF16 original, especially on exact-match/coding tasks.
|
| 156 |
-
- **`>262144` is extrapolation.** The base model was trained to 262,144; YaRN is applied at inference.
|
| 157 |
-
Dense retrieval is verified to **318K**; full dense-1M quality across depths is **not** exhaustively
|
| 158 |
-
validated here — evaluate for your use case.
|
| 159 |
- This is a **community derivative**, not affiliated with or endorsed by Tencent.
|
| 160 |
|
| 161 |
## License
|
|
|
|
| 151 |
|
| 152 |
## Caveats & honesty
|
| 153 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 154 |
- This is a **community derivative**, not affiliated with or endorsed by Tencent.
|
| 155 |
|
| 156 |
## License
|