rsafier commited on
Commit
0fa7c83
·
verified ·
1 Parent(s): 76de9b6

Upload folder using huggingface_hub

Browse files
Files changed (3) hide show
  1. README.md +2 -2
  2. config.json +2 -2
  3. model.safetensors +1 -1
README.md CHANGED
@@ -23,8 +23,8 @@ A GPT-style language model trained from scratch in Rust on Project Gutenberg.
23
  | Embedding dim | 128 |
24
  | Context window | 256 tokens |
25
  | Vocab size | 1500 (BPE) |
26
- | Training iters | 9725 |
27
- | Best val loss | 3.7275 |
28
 
29
  ## Training
30
 
 
23
  | Embedding dim | 128 |
24
  | Context window | 256 tokens |
25
  | Vocab size | 1500 (BPE) |
26
+ | Training iters | 10800 |
27
+ | Best val loss | 3.7141 |
28
 
29
  ## Training
30
 
config.json CHANGED
@@ -14,6 +14,6 @@
14
  "block_size": 256,
15
  "bos_token_id": 0,
16
  "eos_token_id": 1,
17
- "trained_iters": 9725,
18
- "best_val_loss": 3.7275052070617676
19
  }
 
14
  "block_size": 256,
15
  "bos_token_id": 0,
16
  "eos_token_id": 1,
17
+ "trained_iters": 10800,
18
+ "best_val_loss": 3.714090585708618
19
  }
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:460aaa2ad8b04f23d76464f53ba3c5d5726c9798579226664cb3bb8c4a5a0f2a
3
  size 11111200
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a6378af62e79a51b00e3a6a0fc932f3189264af4ba779b898f02e1505ce32d60
3
  size 11111200