jbduran commited on
Commit
9b7cebb
·
verified ·
1 Parent(s): 3d2a742

Correct parameter count to 2.82B (value embeddings were uncounted)

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -70,7 +70,7 @@ Its `sft/` directory holds six fine-tuning variants. The one shipped as
70
  `pre1930-curriculum-c3-robust-v2`; the others — `karpathy-modern-sft-v1`,
71
  `nanochat-default-datamatch-v1`, `c3-robust`, and two `c3-robust-v3` configs — are kept here.
72
 
73
- `clean1930s-d24-r12-ctx4096-sssl-fulltok-v1` is the d24 / 730M run; its tokenizer is the one every
74
  midtrain mixture was built against.
75
 
76
  > **Note.** Each `config.json` records repo and dataset names as they were at training time
 
70
  `pre1930-curriculum-c3-robust-v2`; the others — `karpathy-modern-sft-v1`,
71
  `nanochat-default-datamatch-v1`, `c3-robust`, and two `c3-robust-v3` configs — are kept here.
72
 
73
+ `clean1930s-d24-r12-ctx4096-sssl-fulltok-v1` is the d24 / 1.38B run; its tokenizer is the one every
74
  midtrain mixture was built against.
75
 
76
  > **Note.** Each `config.json` records repo and dataset names as they were at training time