Hugging Face's logo

andrew-healey
/
context-compression

Model card Files
xet
Community
andrew-healey commited on
Commit
42e8d08
·
verified ·
1 Parent(s): fa1fb26

Upload folder using huggingface_hub

Browse files
Files changed (3) hide show
  1. attention_kindselective_n_heads4_seed1345/log2.txt +2 -0
  2. attention_kindselective_n_heads4_seed1345/model_08749.pt +1 -1
  3. attention_kindselective_n_heads4_seed1345/optimizer_08749.pt +1 -1
attention_kindselective_n_heads4_seed1345/log2.txt CHANGED
@@ -529,3 +529,5 @@ max_steps: 8750
529
  8700 val loss 5.5038
530
  8700 val perplexity 245.6131
531
  8700 train 5.561337 (lr=5.0041e-06) (hash(x)=153446789)
 
 
 
529
  8700 val loss 5.5038
530
  8700 val perplexity 245.6131
531
  8700 train 5.561337 (lr=5.0041e-06) (hash(x)=153446789)
532
+ 8749 val loss 5.5027
533
+ 8749 val perplexity 245.3448
attention_kindselective_n_heads4_seed1345/model_08749.pt CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:4116fa61c7f1cdf137ea00df9bdd7b917474dd43ad1ed65e218ac759467c44e8
3
  size 92843394
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ad48bc05e89fdde27cf1897a292eb8f37db9dfe2b48d5dc9b6e69452203c1d02
3
  size 92843394
attention_kindselective_n_heads4_seed1345/optimizer_08749.pt CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:5f79873e3c061c0420e145d23845da2a9f7a57bbb91c03038039c018ea71fc52
3
  size 179406214
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1c9592c69aae29e0ee9a228aad3c8ef52bd00de257552edbd6e192b400ceb3f9
3
  size 179406214