Hugging Face's logo

Fsoft-AIC
/
backup_checkpoints_libmoe

Image-Text-to-Text
TensorBoard
Safetensors
English
Model card Files
xet
Metrics Community
6187
DavidNguyen commited on
Commit
5140234
·
verified ·
1 Parent(s): c8675a4

Upload folder using huggingface_hub (#271)

Browse files

- f7b8cf0fa5881c15ca085d20e48d8a2e91be4a98cf44c19314b7b9f73aa7367b (4c8fded4569e4da0ddaf5f6e47e71387e53d09dd)
- ed31723a38a8fcd1db48da417833e047a0a24a1ec89fc47edac8fefaf30251c9 (4f2e6fa8949da67becd86d7aaf7e2919ea0ba2f3)
- 23b1dd577474d45e362c6f6d8a489fd101e2831b330b3901b3815b838603eb56 (0f4defff76bfc7444f337a8a4f82c04e0d46d66a)
- 18f6f9a060d26bbc5615a2329089a79e8b5458b533d8765d396668e7d41c0a38 (12019ac68d5bd2fa9c0c2e32ecf69635607206e3)
- eadf0ad2827dbb96572248221a0813b0bf67479cbb9005ce9093a88585a3a378 (9c6dda43571e093bed2f2d7542fa0a8f52fc1abd)
- 01d7c18884eeb1cf49c92526f8546ae97cb13c19249ee2276a8d6a5e1ec1a9c0 (0b7c5030510555ec0e32e3444a847cbdd25d9847)
- d095afabafbed536977bc7eca8a09d56bba8143367d53fc501e89b763a9aa914 (9deef5e7ce0340938462eedd2d64051ca85770bb)
- 2f6f643c7f4c54cf9b1771bd402e58416d2f36662001cd3d33b761f8f0ff4e32 (38c02ef04b0795c9c51e7fb52cf4ed8f10c271e9)
- 36203936f8178859d410725877e9c90e808de0df9256327e980894e52928871a (7805d2ae7a9593b824267d2d3ed2fe77318cd0f5)
- f8a7e44dbe97d9d509e04289e6315034a95717c882112fa0340a7b3e4d8862c1 (b27756d2af245e93cca4183b542400afc91fc617)
- cb4a25dea0a3fdbbe5c84afa42f60ad603c741d6ef96477db29a2fcdf003a70f (0b55cb11be3429d8d08878f9b333baa2963d60d6)
- 8dde72ef1d39e003421484e55c976a3fd9fce38e650765aebef8b159869c2872 (2cf71c1ee313d89ae09fea3bbfe24ddde08b2380)
- ce0827663a812ce906dc1fd1f4382bea4cfcf677232eda19a70343695ac1ecd5 (8176d3c70d183e3d2ae6054f26952db727514719)
- 8de63bea1bb51a11427577aa1993fc0bc076768dde3cc4a48eab9839bd6a9a18 (b1401cd02c3027d1e9384cb93937701fa7aee4f9)
- fe96619c1963f0bcce10c6ccbdb9868c0e322ff07ece03d9b01fb0f8289fcdfe (e904dab39dde6c7074359deb1db9e90cf50ca472)
- 1fba3de578b9994db9b09d0551d14ce58559637509060832434c1ffb2c2039b0 (38ecff22a1f56340b440180c829d36038c97e7db)
- 0ed8fb14056e8e07c8f17392b01c2270a7ffa582f650da77560cf8f36e2352a3 (e1f6ed1dfb64b1a2c1c1f54681149b29b8715cae)
- ca103f9580f89c1de54abd59bc7a7ba59c908ac595f7c29736388f685ffa6ca1 (1a92ab46c3520450f9f23962534b12ed7599c38e)
- ce4f57fb2f22342acb2770bcaa4bda912b3bd51d0f853f4450052cefce134cb6 (34695e2601d00e3394b9aed9f45b9c83a2208d57)
- 8b73d37833caaad95f06b75c816e562267f348f65ac0269067ecb5b36121483e (49da14c82c02b20d763ab675a2bcc192f3ece865)

Files changed (20) hide show
  1. Pretrain_language_model/save_final/slimpajama_moe_no_attmoe_660M_standardlb_deepseek_sigmoidonly_v2/checkpoint/model-100000.pth +3 -0
  2. Pretrain_language_model/save_final/slimpajama_moe_no_attmoe_660M_standardlb_deepseek_sigmoidonly_v2/checkpoint/model-120000.pth +3 -0
  3. Pretrain_language_model/save_final/slimpajama_moe_no_attmoe_660M_standardlb_deepseek_sigmoidonly_v2/checkpoint/model-140000.pth +3 -0
  4. Pretrain_language_model/save_final/slimpajama_moe_no_attmoe_660M_standardlb_deepseek_sigmoidonly_v2/checkpoint/model-160000.pth +3 -0
  5. Pretrain_language_model/save_final/slimpajama_moe_no_attmoe_660M_standardlb_deepseek_sigmoidonly_v2/checkpoint/model-180000.pth +3 -0
  6. Pretrain_language_model/save_final/slimpajama_moe_no_attmoe_660M_standardlb_deepseek_sigmoidonly_v2/checkpoint/model-20000.pth +3 -0
  7. Pretrain_language_model/save_final/slimpajama_moe_no_attmoe_660M_standardlb_deepseek_sigmoidonly_v2/checkpoint/model-200000.pth +3 -0
  8. Pretrain_language_model/save_final/slimpajama_moe_no_attmoe_660M_standardlb_deepseek_sigmoidonly_v2/checkpoint/model-220000.pth +3 -0
  9. Pretrain_language_model/save_final/slimpajama_moe_no_attmoe_660M_standardlb_deepseek_sigmoidonly_v2/checkpoint/model-240000.pth +3 -0
  10. Pretrain_language_model/save_final/slimpajama_moe_no_attmoe_660M_standardlb_deepseek_sigmoidonly_v2/checkpoint/model-260000.pth +3 -0
  11. Pretrain_language_model/save_final/slimpajama_moe_no_attmoe_660M_standardlb_deepseek_sigmoidonly_v2/checkpoint/model-280000.pth +3 -0
  12. Pretrain_language_model/save_final/slimpajama_moe_no_attmoe_660M_standardlb_deepseek_sigmoidonly_v2/checkpoint/model-300000.pth +3 -0
  13. Pretrain_language_model/save_final/slimpajama_moe_no_attmoe_660M_standardlb_deepseek_sigmoidonly_v2/checkpoint/model-320000.pth +3 -0
  14. Pretrain_language_model/save_final/slimpajama_moe_no_attmoe_660M_standardlb_deepseek_sigmoidonly_v2/checkpoint/model-340000.pth +3 -0
  15. Pretrain_language_model/save_final/slimpajama_moe_no_attmoe_660M_standardlb_deepseek_sigmoidonly_v2/checkpoint/model-360000.pth +3 -0
  16. Pretrain_language_model/save_final/slimpajama_moe_no_attmoe_660M_standardlb_deepseek_sigmoidonly_v2/checkpoint/model-380000.pth +3 -0
  17. Pretrain_language_model/save_final/slimpajama_moe_no_attmoe_660M_standardlb_deepseek_sigmoidonly_v2/checkpoint/model-40000.pth +3 -0
  18. Pretrain_language_model/save_final/slimpajama_moe_no_attmoe_660M_standardlb_deepseek_sigmoidonly_v2/checkpoint/model-400000.pth +3 -0
  19. Pretrain_language_model/save_final/slimpajama_moe_no_attmoe_660M_standardlb_deepseek_sigmoidonly_v2/checkpoint/model-60000.pth +3 -0
  20. Pretrain_language_model/save_final/slimpajama_moe_no_attmoe_660M_standardlb_deepseek_sigmoidonly_v2/checkpoint/model-80000.pth +3 -0
Pretrain_language_model/save_final/slimpajama_moe_no_attmoe_660M_standardlb_deepseek_sigmoidonly_v2/checkpoint/model-100000.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:16a95f41d17724716f016acf69cd7f609baeaecad285d68ed152ca01de64ccb9
3
+ size 8140483620
Pretrain_language_model/save_final/slimpajama_moe_no_attmoe_660M_standardlb_deepseek_sigmoidonly_v2/checkpoint/model-120000.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9dff30dbb337163b98242e72d8254bef40ad481e4b61351ea23014efce006b18
3
+ size 8140483620
Pretrain_language_model/save_final/slimpajama_moe_no_attmoe_660M_standardlb_deepseek_sigmoidonly_v2/checkpoint/model-140000.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cb7e0ed218a280d6fd2090beb9a0fe6da718674bc817f45551eb51839c140f1b
3
+ size 8140483620
Pretrain_language_model/save_final/slimpajama_moe_no_attmoe_660M_standardlb_deepseek_sigmoidonly_v2/checkpoint/model-160000.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:26c8589a2a14572f95f2a577ed90f5ad5c0affcbfe3eb7c3f173b66f45108923
3
+ size 8140483620
Pretrain_language_model/save_final/slimpajama_moe_no_attmoe_660M_standardlb_deepseek_sigmoidonly_v2/checkpoint/model-180000.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b51ed0f450bf291459972f135d6d40eaccf1ce81428dfd274069377dd87225fd
3
+ size 8140483620
Pretrain_language_model/save_final/slimpajama_moe_no_attmoe_660M_standardlb_deepseek_sigmoidonly_v2/checkpoint/model-20000.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2f4f73fd84654b5d8acbea670c9ea1ea04f179d4f3b3696ee5d97157531cff93
3
+ size 8140483620
Pretrain_language_model/save_final/slimpajama_moe_no_attmoe_660M_standardlb_deepseek_sigmoidonly_v2/checkpoint/model-200000.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d14067107c384ad289a959b927228c1c2286d5e808bd097661ae6f3ed6b2f99c
3
+ size 8140483620
Pretrain_language_model/save_final/slimpajama_moe_no_attmoe_660M_standardlb_deepseek_sigmoidonly_v2/checkpoint/model-220000.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:158b8e1b34ae5207399edff97036112da88dc05e1cb4fe08c155926de6cdd031
3
+ size 8140483620
Pretrain_language_model/save_final/slimpajama_moe_no_attmoe_660M_standardlb_deepseek_sigmoidonly_v2/checkpoint/model-240000.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9a8f3fae86e0e5b42f01f2b6d4d68481061e6b2a33bf0a86d1af0ea10e27a41d
3
+ size 8140483620
Pretrain_language_model/save_final/slimpajama_moe_no_attmoe_660M_standardlb_deepseek_sigmoidonly_v2/checkpoint/model-260000.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:af1a3891493c8b108edf9e32a4ccc8887adcb959917a7a064faca17a228451e4
3
+ size 8140483620
Pretrain_language_model/save_final/slimpajama_moe_no_attmoe_660M_standardlb_deepseek_sigmoidonly_v2/checkpoint/model-280000.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a2199d301d5f866055d0cb3ef07276bd99db1fdcf8ab9288b5fb42f8889fa889
3
+ size 8140483620
Pretrain_language_model/save_final/slimpajama_moe_no_attmoe_660M_standardlb_deepseek_sigmoidonly_v2/checkpoint/model-300000.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0bc0eedb5e0aca9bd80e70cb09c0823fda8829aada3fbcf9fe0f4cdcd2a1253d
3
+ size 8140483620
Pretrain_language_model/save_final/slimpajama_moe_no_attmoe_660M_standardlb_deepseek_sigmoidonly_v2/checkpoint/model-320000.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:759522c022e6ed5cccc3b8e88e20d94e8c3c26917872c7f4e054e1c7a22b33dc
3
+ size 8140483620
Pretrain_language_model/save_final/slimpajama_moe_no_attmoe_660M_standardlb_deepseek_sigmoidonly_v2/checkpoint/model-340000.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3e29e3e26f9b9b9dd1b2d8a415b9796ed5522662d059f2cef4c209bd37b847b9
3
+ size 8140483620
Pretrain_language_model/save_final/slimpajama_moe_no_attmoe_660M_standardlb_deepseek_sigmoidonly_v2/checkpoint/model-360000.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3cc0e7c67f6b91da2fa58c19699da1befffc0a3e9f22a3972589e9fa5fb9e583
3
+ size 8140483620
Pretrain_language_model/save_final/slimpajama_moe_no_attmoe_660M_standardlb_deepseek_sigmoidonly_v2/checkpoint/model-380000.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b56c81eed9b7c8ab2fd68238f7a0cd7aa2fc2115ff811f7718f199121b465be8
3
+ size 8140483620
Pretrain_language_model/save_final/slimpajama_moe_no_attmoe_660M_standardlb_deepseek_sigmoidonly_v2/checkpoint/model-40000.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:84d2016c109626b2af0fa338649b7c54cc751b51064ffb5d83e41c93dd934b9c
3
+ size 8140483620
Pretrain_language_model/save_final/slimpajama_moe_no_attmoe_660M_standardlb_deepseek_sigmoidonly_v2/checkpoint/model-400000.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3d4ac3770a0964bb9e6fb8f75761fe40038b421da3db8517c2d015f523985d63
3
+ size 8140483620
Pretrain_language_model/save_final/slimpajama_moe_no_attmoe_660M_standardlb_deepseek_sigmoidonly_v2/checkpoint/model-60000.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:91b5dcaab5e7785c28ddbde62bb123ce88b883bcf58ccab5ac4a8f83e9aa1c6d
3
+ size 8140483620
Pretrain_language_model/save_final/slimpajama_moe_no_attmoe_660M_standardlb_deepseek_sigmoidonly_v2/checkpoint/model-80000.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6c4299a6c97cbbb42d99fe395774aade63d17b5629a5ac5a0fe1e8824f5512af
3
+ size 8140483620