Update README.md
Browse files
README.md
CHANGED
|
@@ -136,9 +136,6 @@ Memory on a single ~275 GB GPU (146 GB weights):
|
|
| 136 |
|
| 137 |
- **4-bit RTN is lossy.** Chat/reasoning quality is well-preserved in our checks, but expect small
|
| 138 |
degradation vs the BF16 original, especially on exact-match/coding tasks.
|
| 139 |
-
- **`>262144` is extrapolation.** The base model was trained to 262,144; YaRN is applied at inference.
|
| 140 |
-
Dense retrieval is verified to **318K**; full dense-1M quality across depths is **not** exhaustively
|
| 141 |
-
validated here — evaluate for your use case.
|
| 142 |
- This is a **community derivative**, not affiliated with or endorsed by Tencent.
|
| 143 |
|
| 144 |
## License
|
|
|
|
| 136 |
|
| 137 |
- **4-bit RTN is lossy.** Chat/reasoning quality is well-preserved in our checks, but expect small
|
| 138 |
degradation vs the BF16 original, especially on exact-match/coding tasks.
|
|
|
|
|
|
|
|
|
|
| 139 |
- This is a **community derivative**, not affiliated with or endorsed by Tencent.
|
| 140 |
|
| 141 |
## License
|