rsafier commited on
Commit
76de9b6
·
verified ·
1 Parent(s): 84e7ad7

Upload folder using huggingface_hub

Browse files
Files changed (3) hide show
  1. README.md +2 -2
  2. config.json +2 -2
  3. model.safetensors +1 -1
README.md CHANGED
@@ -23,8 +23,8 @@ A GPT-style language model trained from scratch in Rust on Project Gutenberg.
23
  | Embedding dim | 128 |
24
  | Context window | 256 tokens |
25
  | Vocab size | 1500 (BPE) |
26
- | Training iters | 9000 |
27
- | Best val loss | 3.8270 |
28
 
29
  ## Training
30
 
 
23
  | Embedding dim | 128 |
24
  | Context window | 256 tokens |
25
  | Vocab size | 1500 (BPE) |
26
+ | Training iters | 9725 |
27
+ | Best val loss | 3.7275 |
28
 
29
  ## Training
30
 
config.json CHANGED
@@ -14,6 +14,6 @@
14
  "block_size": 256,
15
  "bos_token_id": 0,
16
  "eos_token_id": 1,
17
- "trained_iters": 9000,
18
- "best_val_loss": 3.8269858360290527
19
  }
 
14
  "block_size": 256,
15
  "bos_token_id": 0,
16
  "eos_token_id": 1,
17
+ "trained_iters": 9725,
18
+ "best_val_loss": 3.7275052070617676
19
  }
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:452e3c8134a643e7190ccb47b2ed356931cc8a4d134d25c22c7058e9a303255c
3
  size 11111200
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:460aaa2ad8b04f23d76464f53ba3c5d5726c9798579226664cb3bb8c4a5a0f2a
3
  size 11111200