Hugging Face's logo

andrew-healey
/
context-compression

Model card Files
xet
Community
andrew-healey commited on
Commit
09b1b0b
·
verified ·
1 Parent(s): fbc30dd

Upload folder using huggingface_hub

Browse files
Files changed (5) hide show
  1. attention_kindselective_n_heads2_seed1340/log2.txt +3 -0
  2. attention_kindselective_n_heads2_seed1340/model_47500.pt +1 -1
  3. attention_kindselective_n_heads2_seed1340/model_49999.pt +1 -1
  4. attention_kindselective_n_heads2_seed1340/optimizer_47500.pt +1 -1
  5. attention_kindselective_n_heads2_seed1340/optimizer_49999.pt +1 -1
attention_kindselective_n_heads2_seed1340/log2.txt CHANGED
@@ -4467,3 +4467,6 @@ max_steps: 50000
4467
  48700 val loss 5.7060
4468
  48700 val perplexity 300.6585
4469
  48700 train 5.399137 (lr=5.0756e-06) (hash(x)=42508579)
 
 
 
 
4467
  48700 val loss 5.7060
4468
  48700 val perplexity 300.6585
4469
  48700 train 5.399137 (lr=5.0756e-06) (hash(x)=42508579)
4470
+ 48800 val loss 5.7038
4471
+ 48800 val perplexity 299.9909
4472
+ 48800 train 5.903813 (lr=5.0644e-06) (hash(x)=52737449)
attention_kindselective_n_heads2_seed1340/model_47500.pt CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:671e09d821aad0b05acfd58c4cb5943479619d40c185ec2b6e6081321e58589a
3
  size 38587970
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:de1f486b8f86fbb809a6be851b62256ae2af83ec6383a2e5f050d8d71504677f
3
  size 38587970
attention_kindselective_n_heads2_seed1340/model_49999.pt CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:2ade59c1a7b1f27604ba9d522da69929f07674b7e48af67cb6f07699745ecf35
3
  size 38587970
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:dbd80fee9798682a524b5487d864974cbc76da9780aa61e296e05285ce11f70f
3
  size 38587970
attention_kindselective_n_heads2_seed1340/optimizer_47500.pt CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:a33cd629f7b0ddcb5fe3a20bc9eeb53fd933901026e245136c3cc30eeeb0cf06
3
  size 70895430
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:dd632047c46b7432e10e1052300352f996e3e65e1acccb5af2c630a76e88b14d
3
  size 70895430
attention_kindselective_n_heads2_seed1340/optimizer_49999.pt CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:c0b2e4ee681ee034716693975b2f3696f223c079ff54afce878108a7d45599c2
3
  size 70895430
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bc48b024994b9aedeca20a51f2af1a6c837fc3a470a1ea344a85396e0c6c3c81
3
  size 70895430