Hugging Face's logo

andrew-healey
/
context-compression

Model card Files
xet
 Community
andrew-healey commited on
Commit
7003504
·
verified ·
1 Parent(s): 5ec4a81

Upload folder using huggingface_hub

Browse files
Files changed (3) hide show
  1. attention_kindselective_n_heads4_seed1345/log2.txt +2 -0
  2. attention_kindselective_n_heads4_seed1345/model_17499.pt +1 -1
  3. attention_kindselective_n_heads4_seed1345/optimizer_17499.pt +1 -1
attention_kindselective_n_heads4_seed1345/log2.txt CHANGED
@@ -1052,3 +1052,5 @@ max_steps: 17500
1052
  17400 val loss 5.6163
1053
  17400 val perplexity 274.8719
1054
  17400 train 5.445556 (lr=4.0030e-06) (hash(x)=140939390)
 
 
 
1052
  17400 val loss 5.6163
1053
  17400 val perplexity 274.8719
1054
  17400 train 5.445556 (lr=4.0030e-06) (hash(x)=140939390)
1055
+ 17499 val loss 5.6147
1056
+ 17499 val perplexity 274.4340
attention_kindselective_n_heads4_seed1345/model_17499.pt CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:77def304d5a4d5766a399670015f1443356b783f1e414d80d29ce3f454a56667
3
  size 92843394
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:408db4bda9a7bb82ed13ed8dd4f26ddfa7333f0c9752fac1d8a842fa0b3772fb
3
  size 92843394
attention_kindselective_n_heads4_seed1345/optimizer_17499.pt CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:cedb87afb700e6e774bf19f4eaa8abb5e27bc745f8f3d39a40ab734951ef407e
3
  size 179406214
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c58ac33f1c0e3f3f4ff40a688fe8407bbe2efc9650319691a3d46c77c875a738
3
  size 179406214