Update README.md
Browse files
README.md
CHANGED
|
@@ -4,7 +4,7 @@ This repo contains two variants of the model. The only intended difference is th
|
|
| 4 |
|
| 5 |
## Variants
|
| 6 |
|
| 7 |
-
Models trained with 1B tokens on FW-edu
|
| 8 |
|
| 9 |
- run-1089676
|
| 10 |
- Partial RoPE on the indexer: no (standard/full RoPE disabled for the “partial” behavior)
|
|
|
|
| 4 |
|
| 5 |
## Variants
|
| 6 |
|
| 7 |
+
Models continually trained with 1B tokens on FW-edu
|
| 8 |
|
| 9 |
- run-1089676
|
| 10 |
- Partial RoPE on the indexer: no (standard/full RoPE disabled for the “partial” behavior)
|