Hugging Face's logo

andrew-healey
/
context-compression

Model card Files
xet
 Community
andrew-healey commited on
Commit
5ec4a81
·
verified ·
1 Parent(s): 36e5272

Upload folder using huggingface_hub

Browse files
Files changed (3) hide show
  1. attention_kindselective_n_heads4_seed1338/log2.txt +2 -0
  2. attention_kindselective_n_heads4_seed1338/model_17499.pt +1 -1
  3. attention_kindselective_n_heads4_seed1338/optimizer_17499.pt +1 -1
attention_kindselective_n_heads4_seed1338/log2.txt CHANGED
@@ -1052,3 +1052,5 @@ max_steps: 17500
1052
  17400 val loss 5.5252
1053
  17400 val perplexity 250.9298
1054
  17400 train 5.501467 (lr=3.7528e-06) (hash(x)=148400702)
 
 
 
1052
  17400 val loss 5.5252
1053
  17400 val perplexity 250.9298
1054
  17400 train 5.501467 (lr=3.7528e-06) (hash(x)=148400702)
1055
+ 17499 val loss 5.5247
1056
+ 17499 val perplexity 250.8136
attention_kindselective_n_heads4_seed1338/model_17499.pt CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:278408312592a175d7ef97e31580042adc4983160ade6d84eefec00db3f627b6
3
  size 92843394
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ae41fe20169570eb68f05123278fe3a4205d7710ff9433b0f0ae2f14401d95e0
3
  size 92843394
attention_kindselective_n_heads4_seed1338/optimizer_17499.pt CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:98acd634505624795929b0bce783d7c16bc675ab95a8831af11c40182685208e
3
  size 179406214
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2e7ee69dd34ecb720c0a38bb9599743d2e127dfe453b5069762da4e221a9eb5e
3
  size 179406214