Hugging Face's logo

Shameless111
/
mixtral-8x7b-quip-2bit

mixtral
Model card Files
xet
 Community
Shameless111 commited on
Commit
cfd7a1a
·
verified ·
1 Parent(s): 7cfb01c

Upload quantized Mixtral-8x7B model (QuIP# 2-bit)

Browse files
This view is limited to 50 files because it contains too many changes.   See raw diff
Files changed (50) hide show
  1. 0_expert0_w1.pt +3 -0
  2. 0_expert0_w2.pt +3 -0
  3. 0_expert0_w3.pt +3 -0
  4. 0_expert1_w1.pt +3 -0
  5. 0_expert1_w2.pt +3 -0
  6. 0_expert1_w3.pt +3 -0
  7. 0_expert2_w1.pt +3 -0
  8. 0_expert2_w2.pt +3 -0
  9. 0_expert2_w3.pt +3 -0
  10. 0_expert3_w1.pt +3 -0
  11. 0_expert3_w2.pt +3 -0
  12. 0_expert3_w3.pt +3 -0
  13. 0_expert4_w1.pt +3 -0
  14. 0_expert4_w2.pt +3 -0
  15. 0_expert4_w3.pt +3 -0
  16. 0_expert5_w1.pt +3 -0
  17. 0_expert5_w2.pt +3 -0
  18. 0_expert5_w3.pt +3 -0
  19. 0_expert6_w1.pt +3 -0
  20. 0_expert6_w2.pt +3 -0
  21. 0_expert6_w3.pt +3 -0
  22. 0_expert7_w1.pt +3 -0
  23. 0_expert7_w2.pt +3 -0
  24. 0_expert7_w3.pt +3 -0
  25. 0_gate.pt +3 -0
  26. 0_k.pt +3 -0
  27. 0_layernorm.pt +3 -0
  28. 0_o.pt +3 -0
  29. 0_q.pt +3 -0
  30. 0_v.pt +3 -0
  31. 10_expert0_w1.pt +3 -0
  32. 10_expert0_w2.pt +3 -0
  33. 10_expert0_w3.pt +3 -0
  34. 10_expert1_w1.pt +3 -0
  35. 10_expert1_w2.pt +3 -0
  36. 10_expert1_w3.pt +3 -0
  37. 10_expert2_w1.pt +3 -0
  38. 10_expert2_w2.pt +3 -0
  39. 10_expert2_w3.pt +3 -0
  40. 10_expert3_w1.pt +3 -0
  41. 10_expert3_w2.pt +3 -0
  42. 10_expert3_w3.pt +3 -0
  43. 10_expert4_w1.pt +3 -0
  44. 10_expert4_w2.pt +3 -0
  45. 10_expert4_w3.pt +3 -0
  46. 10_expert5_w1.pt +3 -0
  47. 10_expert5_w2.pt +3 -0
  48. 10_expert5_w3.pt +3 -0
  49. 10_expert6_w1.pt +3 -0
  50. 10_expert6_w2.pt +3 -0
0_expert0_w1.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:73b870eb202770bd40e900663d13fa2006417c11d3eed64591ec64baf838a464
3
+ size 14718775
0_expert0_w2.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3983cccaee8e81b669fad59d82ba64e39148c47cb38907973ccb30b992b9bdaa
3
+ size 14718775
0_expert0_w3.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a5811ab3b863b56c5c1fe630f40a03b718ecb0ac53d39ac5cd6ab53a7f951525
3
+ size 14718775
0_expert1_w1.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3c9dd95de3c00d14043a160c8c3eb5f1b71632e25ddfa0e00beca398cb31809c
3
+ size 14718775
0_expert1_w2.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ccf49b3522e46ba47d1b13d14877cdccfcbac1d5e1f249bfafca9956641a15a6
3
+ size 14718775
0_expert1_w3.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8e700ec8550dd4edbc3005c93f6ce4b2e0426ef8a8139f236978a4356b405b80
3
+ size 14718775
0_expert2_w1.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:86c8782d8917476e89bafe2f5461c5c96046d697fb007e31d0fdd85d3e54284d
3
+ size 14718775
0_expert2_w2.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b49ba2a52c4646fe2209bb5c2d30e95f8c72aa375a10387cfd4f4ccddb5208b4
3
+ size 14718775
0_expert2_w3.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2b326ade042696e7d5eda5b54c2217d14e19f3a9bbb896ecec834424e3e6e871
3
+ size 14718775
0_expert3_w1.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:14dbbb23aeae49d479b5d2612e7fb84eb2c55e877d18140d688197e0d6f0ff6a
3
+ size 14718775
0_expert3_w2.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ab006cb02e65418e86c2d88c056d7e8391b06ca615fb79d1c7e90c6eab94c5b4
3
+ size 14718775
0_expert3_w3.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9ea17b03fd726b84cee807f2b1203456e9df3934e24c712f56bbb03e55bb3b2e
3
+ size 14718775
0_expert4_w1.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0ee4278b1b5297b72155adc70b166d9e925071ca7d38e4d647057885bdfbeeed
3
+ size 14718775
0_expert4_w2.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d460eba75444784bf1ad5fb7c55d95018d8418657dd84b127e9e85c0a085051f
3
+ size 14718775
0_expert4_w3.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:33623c4226dc2fe7f6264674b1a6ef12bbf388366adbbc2e829ba71f2f2b0913
3
+ size 14718775
0_expert5_w1.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c1609f92798073984b7d10713184471f90db8ac4104c98df6657810cfb063f64
3
+ size 14718775
0_expert5_w2.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9004b1800e77675be8d54937fdd96ab41145a77b7615e53ab4d4f5bef6bc7eb9
3
+ size 14718775
0_expert5_w3.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:de48b9b8326f4cbac183fa585be924c1296b168b77ad9d8e4703e35b414daad4
3
+ size 14718775
0_expert6_w1.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1b9e396a4ff3317f3aa9773dd87e762ccfd3b23a0ef6ce9f8afc3800c8a92971
3
+ size 14718775
0_expert6_w2.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f9e4aa150e7a517167683675bdb155862037727cea4f675f08abc9fb665a12cc
3
+ size 14718775
0_expert6_w3.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c954eb3bdd790d88e17edad8ae55938aec5c8ad47c26a34f7119b7c9860c0046
3
+ size 14718775
0_expert7_w1.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f464d701bbe65ba0afe72481cbc2b1eb980a425d8ee7a29692f55158a8de16b6
3
+ size 14718775
0_expert7_w2.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6a83cb681ab929cb6b24c4b953ed918a9482ecbedff661cd191a0d49cb26ee04
3
+ size 14718775
0_expert7_w3.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0e4d709da09160d9a5ff4e893a3a9a6b998c42460070fc477d5f41be452ddd76
3
+ size 14718775
0_gate.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7aa42d6c912399340d8c2a303911dc3373f6ed9775a0c61e623eb5b29fbe5c1d
3
+ size 66711
0_k.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:93849daba3b39642872b0e2ef7cebd2e29e67367c424c87b57dbfe6ee62ba639
3
+ size 1060408
0_layernorm.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d245cd2b96f0c5b94742c7305f2811627f7c1794ed3ad4b2a4ac434b31321938
3
+ size 17968
0_o.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:969ada6e81084896a8c76afa41035af8c5f8efe14b5b5382c8cda8db54ab4ee2
3
+ size 4212280
0_q.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6493ec1f0d275f583de1547ee28000eb7c92209e16e6872ddeaf07600bdd6798
3
+ size 4212280
0_v.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0f5fb3df1064db9307a193b8ad9291d24945ef873711fa4020fb8c6c772f3817
3
+ size 1060408
10_expert0_w1.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bfa8f39aed02470ff9df0db61190db895314fe9ecf5859f1fc72837ef600b93e
3
+ size 14718782
10_expert0_w2.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5e8bbdc80c5ab221daa568cde39a779ccf869a929575ee5c51980e5bd2ea1503
3
+ size 14718782
10_expert0_w3.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b36ac097fd4ac8a02d9d140f4b0245ffc21fb246493d8dd23c88e8405ea98675
3
+ size 14718782
10_expert1_w1.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cd7faaeea681c2ff101122686019bba3879eb6949d13064173b3ff969c4738fe
3
+ size 14718782
10_expert1_w2.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:287a1a89c300c87a36be3b01e75e9ab64ee747669a3a2cb7dba85cd58f21388d
3
+ size 14718782
10_expert1_w3.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:de61e9c2a350de8e31e822b26fe2e52ab5a64bff6fa541d643215ce65feaf5b8
3
+ size 14718782
10_expert2_w1.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3bd1d5b3780876180c012fd019b53b5d10111792967e6207b2e86cac361adbf3
3
+ size 14718782
10_expert2_w2.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:73bbe734e892ce2e666c770e435e76235c348febcca908ac96340499b58bdd1c
3
+ size 14718782
10_expert2_w3.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e85c738aac80d6b33fc37932d93ddf0f3053e62a0239ed0a388ccd8ad64b7405
3
+ size 14718782
10_expert3_w1.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:da0f22536d8ed1708af1968e493f8bb78f4984221deac7c7584e8361754f11d6
3
+ size 14718782
10_expert3_w2.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:271d4dbf4b904572b9775f78cbcf9df31db9b90e3ba583dc484e8a8e2f8ac8c0
3
+ size 14718782
10_expert3_w3.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:26a120d58e5ed4a076022a2017717456c6d67841683456965ac3be34c209cd8b
3
+ size 14718782
10_expert4_w1.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ccd85bf0e6c6690ce59493cc8cdff5665716c9d81af3e6ffa8157cbca3c12b08
3
+ size 14718782
10_expert4_w2.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:75949bc8bf174595bcceae614d3256e14f403cc11789a2ea252ae1f8d97cb981
3
+ size 14718782
10_expert4_w3.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b8f13a6b142f5b23cd19ab86dfcd498f572aa5aaf1666c697f0d5c1fdea9966e
3
+ size 14718782
10_expert5_w1.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:441e68e03380b1e138d4e2e82df343aa56dfd9939bf595e476a12c98d6212f4d
3
+ size 14718782
10_expert5_w2.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a74f69d572be0a5a57a82cd6168a9eaa3d4b0b3282c3fe7530468f29e5bf5342
3
+ size 14718782
10_expert5_w3.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4ae8fcc64967a2375147fe683786efba06db84c05864061530acad407cb3d80e
3
+ size 14718782
10_expert6_w1.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8c0c0537421bdf7d62de337f252a5bd35d12ed48c1f186290b800acfd6bed5a4
3
+ size 14718782
10_expert6_w2.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7131f7431596a880eaa58c669cb0263d158656a6489e1e611871074e76c860d4
3
+ size 14718782