Hugging Face's logo

mratsim
/
MiniMax-M2.5-BF16-INT4-AWQ

Text Generation
Safetensors
llm-compressor
minimax_m2
fp8
awq
conversational
vllm
code
devops
software engineering
engineer
developer
architect
stem
agent
custom_code
compressed-tensors
Model card Files
xet
 Community
9
mratsim commited on
Commit
5bc26c9
·
verified ·
1 Parent(s): 8a2d415

Upload folder using huggingface_hub

Browse files
Files changed (28) hide show
  1. README.md +1 -1
  2. model-00001-of-00027.safetensors +1 -1
  3. model-00002-of-00027.safetensors +1 -1
  4. model-00003-of-00027.safetensors +1 -1
  5. model-00004-of-00027.safetensors +1 -1
  6. model-00005-of-00027.safetensors +1 -1
  7. model-00006-of-00027.safetensors +1 -1
  8. model-00007-of-00027.safetensors +1 -1
  9. model-00008-of-00027.safetensors +1 -1
  10. model-00009-of-00027.safetensors +1 -1
  11. model-00010-of-00027.safetensors +1 -1
  12. model-00011-of-00027.safetensors +1 -1
  13. model-00012-of-00027.safetensors +1 -1
  14. model-00013-of-00027.safetensors +1 -1
  15. model-00014-of-00027.safetensors +1 -1
  16. model-00015-of-00027.safetensors +1 -1
  17. model-00016-of-00027.safetensors +1 -1
  18. model-00017-of-00027.safetensors +1 -1
  19. model-00018-of-00027.safetensors +1 -1
  20. model-00019-of-00027.safetensors +1 -1
  21. model-00020-of-00027.safetensors +1 -1
  22. model-00021-of-00027.safetensors +1 -1
  23. model-00022-of-00027.safetensors +1 -1
  24. model-00023-of-00027.safetensors +1 -1
  25. model-00024-of-00027.safetensors +1 -1
  26. model-00025-of-00027.safetensors +1 -1
  27. model-00026-of-00027.safetensors +1 -1
  28. model-00027-of-00027.safetensors +1 -1
README.md CHANGED
@@ -84,7 +84,7 @@ This strives to be the highest quality quant that can run on 192GiB VRAM
84
  It features:
85
  - That model has ensured that all experts are calibrated, not doing so is extremely detrimental, PR: https://github.com/vllm-project/llm-compressor/pull/2171
86
  <details>
87
- <summary>**[Click me!]** Visual showcase of why ensuring quantization of all MoE experts is important</summary>
88
 
89
  - Source: https://avtc.github.io/aquarium-side-by-side/
90
  - Context: https://github.com/ModelCloud/GPTQModel/pull/2235
 
84
  It features:
85
  - That model has ensured that all experts are calibrated, not doing so is extremely detrimental, PR: https://github.com/vllm-project/llm-compressor/pull/2171
86
  <details>
87
+ <summary>Visual showcase of why ensuring quantization of all MoE experts is important</summary>
88
 
89
  - Source: https://avtc.github.io/aquarium-side-by-side/
90
  - Context: https://github.com/ModelCloud/GPTQModel/pull/2235
model-00001-of-00027.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:95524311fc93851ffce47af2630eb9598a9e024b3bddcbf46d5ab9a17b7bf873
3
  size 5000235232
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d0a6751ab999f04da986ef83ab0e426100f48607b3dd488dcffd5b4ae666f412
3
  size 5000235232
model-00002-of-00027.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:6beebffb25c660b9d8b4bb183723b7c330b0dd5aff3fe89009408c2960ae9635
3
  size 4999565832
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d9d1cfbf4bed7146980fb1c43c15856e5fa7926085ee8120d65c7e7c20820b26
3
  size 4999565832
model-00003-of-00027.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:a55de3dbd0acab01cd1804745d72ad3f93123f0e10ed4f59c6a02e6bee0315ab
3
  size 5000140792
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c5fc4feb2e909a19ec73958cd229c588ea98cf64a99948a6e9eb7f995af52fe6
3
  size 5000140792
model-00004-of-00027.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:e93169d67e0cc2227a25f4147e02b431a31d93ef808e4384e3c3f9400ab54fd7
3
  size 5000141504
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2e253d0caaa5a377bd96b9beeb6a8a011e4b65baedefdd184ce52f7a464ccff5
3
  size 5000141504
model-00005-of-00027.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:0f72bd58fbff54aa1b1b67427903eb5949ec687cea6fb6306cd70a86aed91a6c
3
  size 4999568344
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5546eab734b3ed0e0b53c290ef734fbeb17ad889af4cd4aaf5155f6e03c53627
3
  size 4999568344
model-00006-of-00027.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:da12b8403da6e11535cc75921487fc1de058e416046e111cf630d28876cd94ee
3
  size 5000146376
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:17e93d07b3e156ed64bfcecd9ce630b07d3eeba359276dede616036a9696becd
3
  size 5000146376
model-00007-of-00027.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:3156b64dc1e13f50c52d78190a0b8b81d471319d3be63c35e3785eb1ee5d70b0
3
  size 5000146968
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:153ff03432d199202ddeaebac19cc42a4295806bed790bad0d77c706775e5269
3
  size 5000146968
model-00008-of-00027.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:de9ad1f91de7a8a44638903ac154af2a8481e8176ffacbd0d2d304835800e8d3
3
  size 4999570984
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:64849464f1eed5fca4b1b4943440ca9c669135312e8e7b2185440bd148409623
3
  size 4999570984
model-00009-of-00027.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:329bef633ae99da9fdd416848cbd908df96f3e877c417b071f1ea01bdc074fa2
3
  size 5000146488
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5c4f447c2e04718d48103027dc44f1ae37e07b110cf2ed36a4c8de20b0fd8701
3
  size 5000146488
model-00010-of-00027.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:2b74f6dfc477358d1bfc377d6c349637c026fe446c8d891a2e947c72d36b5a76
3
  size 5000146968
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:05aacc49c81a276b791fa94130b8ae2dea9a3920a935e5f7141d3e707f59734c
3
  size 5000146968
model-00011-of-00027.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:34748576ef636be2ad0799ef7f569b11efce0f901d01e35bf8a6ca091c8e3a50
3
  size 4999570864
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3e46210a8fd5c52c65be3ee148b6913a37e40529391378efc21ec111da3ac2a7
3
  size 4999570864
model-00012-of-00027.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:fb53471d3cde285103fc111fd1f8d960af380a1e86b73131be8f9902305acc93
3
  size 5000146600
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9dd99b09f9fadd846cf5c2207183fa7ef57ac6236cf26905bfd43839027146b9
3
  size 5000146600
model-00013-of-00027.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:f469f8919864afc5971abc1d8684201a7d9f17624cf5a4ad28af02b430732655
3
  size 5000146968
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5339b9cf92dd208aa0c2e043f6e22848e41a142677b5656f81c594ccf55fd649
3
  size 5000146968
model-00014-of-00027.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:1b929a61c21a918acbb0d3d0a736e0891d96b8f6d5033a973ec350367ff903a6
3
  size 4999570752
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1c791f69d55af4e13e6ce34ee18343c9bc10f84b41bec69e523c29d6d3f5b7a8
3
  size 4999570752
model-00015-of-00027.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:0fbf0c943dbc94017283c5ada78c93ecc35ce16f2b03f2e39d8f8cf20922c2e8
3
  size 5000146712
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:25b98836640923c1066e10b960e00309bdba7f1ed055c7562731c0945c9a6312
3
  size 5000146712
model-00016-of-00027.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:4d5405d433e3384c6b5ec48a0a3edf2f026b9e2a08bbc316b93f8fd5eff4b4f1
3
  size 4981577024
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:988f142621279810a7ab13540ec0b2375b71f747f7e3eca0008fd294965b163a
3
  size 4981577024
model-00017-of-00027.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:23146ddfa08b0c5f286d6930fcf40cdcdb84c5317d36c23cb21d283f35f27ba4
3
  size 4999558272
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f83ee8dc528b34b7eb63539d4ef1fc8a41a98fc6495ea3b7fa9399b4af4a07b1
3
  size 4999558272
model-00018-of-00027.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:886f5566544cde156077bdefc2e52fa5ccbae821164a10adc8ce7175a2d2a12e
3
  size 5000146808
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fe7f48b199ac99bb23ae30c0ca5118c8ab7ad8d97d6b996a75a997986a22e539
3
  size 5000146808
model-00019-of-00027.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:aafb97c6f2b93957dc98bd96f2e205eade7a73c87426cdf674446f32773084ac
3
  size 4999571464
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a9b993539dc742003c6b8c58ad89a732483ac14089e421a53450c7b1b056b6e9
3
  size 4999571464
model-00020-of-00027.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:ecb65cfc080e99ad07c11fac0373d0a63e004b1820a1e9dabe53201446c6fabf
3
  size 5000146048
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:045ff7b1fe80685658d4dbc6f98ddbd60885ab3b50b5c94e4eaf4c41b600228e
3
  size 5000146048
model-00021-of-00027.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:61874086a5bd6396d67646d4d47b1fefa9c259f40b6f2b4ed813e3de620f96b1
3
  size 5000146920
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c04d7f2d19fdd629129d9a6471cc9d55fe54a013af9ef229df59dd246e4e40a7
3
  size 5000146920
model-00022-of-00027.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:4d6798c66f4c6f01eaf85b6dcc88386916eccbd94d1f678868996901fd41c4a9
3
  size 4999571272
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6c89f588e1b8d3f1b65c8f8d8741a0a8ee01e2ca7b517f7ccf942e6ea8a6ed5e
3
  size 4999571272
model-00023-of-00027.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:58dce464d259d94956e7d193327f3f29f54321bc558b0a14fca3f15d567f8f53
3
  size 5000146192
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d23e45081a8429dd9288a9dcf9bf91ebd737aa78ae6d33f266129ae30d95c161
3
  size 5000146192
model-00024-of-00027.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:5f552a6812b62aee7ee2df17026178c1ee7cf296c7ab51632e3539cfc7a65ce4
3
  size 5000146968
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d3ef379a492f2d5f1220e5a0dbc6d03a37fdb2830e30390d55da3a96e9579f40
3
  size 5000146968
model-00025-of-00027.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:cb78cf8996819546b8fad11100f10589762e63d80ca41af62283b84a34b59d82
3
  size 4999571160
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:feba15a145576f115ac32329190c5afbee228e9315ba25af013a25658a0c36df
3
  size 4999571160
model-00026-of-00027.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:47aa6469bd5d5d25ebe08aed696e786952784e81f3459442d02f712326b7599f
3
  size 5000146312
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:be95040721d1e8814b68783d233fa4b88a9a9b77fa2eab8dc0add4123a23b125
3
  size 5000146312
model-00027-of-00027.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:6e9a17a9f8af58ac8eee4f0b88959824e1406a01f4061e8bd4fd336eb7c73831
3
  size 4440722160
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fc8949f4f310b16ccfaa56e5d3269fe43036bf23f7ed1b648fd74b3550d37e29
3
  size 4440722160