Hugging Face's logo

tensorblock
/
Mistral-7B-Instruct-v0.2-GGUF

Transformers
GGUF
English
unsloth
mistral
mistral-7b
mistral-instruct
instruct
bnb
TensorBlock
GGUF
conversational
Model card Files
xet
 Community
morriszms commited on
Commit
4dfd65f
·
verified ·
1 Parent(s): 33ab485

Keep Q2_K/Q3_K_M gguf only

Browse files
Files changed (20) hide show
  1. Mistral-7B-Instruct-v0.2-Q3_K_L.gguf +0 -3
  2. Mistral-7B-Instruct-v0.2-Q3_K_S.gguf +0 -3
  3. Mistral-7B-Instruct-v0.2-Q4_0.gguf +0 -3
  4. Mistral-7B-Instruct-v0.2-Q4_K_M.gguf +0 -3
  5. Mistral-7B-Instruct-v0.2-Q4_K_S.gguf +0 -3
  6. Mistral-7B-Instruct-v0.2-Q5_0.gguf +0 -3
  7. Mistral-7B-Instruct-v0.2-Q5_K_M.gguf +0 -3
  8. Mistral-7B-Instruct-v0.2-Q5_K_S.gguf +0 -3
  9. Mistral-7B-Instruct-v0.2-Q6_K.gguf +0 -3
  10. Mistral-7B-Instruct-v0.2-Q8_0.gguf +0 -3
  11. mistral-7b-instruct-v0.2-Q3_K_L.gguf +0 -3
  12. mistral-7b-instruct-v0.2-Q3_K_S.gguf +0 -3
  13. mistral-7b-instruct-v0.2-Q4_0.gguf +0 -3
  14. mistral-7b-instruct-v0.2-Q4_K_M.gguf +0 -3
  15. mistral-7b-instruct-v0.2-Q4_K_S.gguf +0 -3
  16. mistral-7b-instruct-v0.2-Q5_0.gguf +0 -3
  17. mistral-7b-instruct-v0.2-Q5_K_M.gguf +0 -3
  18. mistral-7b-instruct-v0.2-Q5_K_S.gguf +0 -3
  19. mistral-7b-instruct-v0.2-Q6_K.gguf +0 -3
  20. mistral-7b-instruct-v0.2-Q8_0.gguf +0 -3
Mistral-7B-Instruct-v0.2-Q3_K_L.gguf DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:59f1e5884be35ec4f76cbae1b6642ff0028fc8e26b850a46e246fc2e3c7326de
3
- size 3822025344
 
 
 
 
Mistral-7B-Instruct-v0.2-Q3_K_S.gguf DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:a1a5a9f135c6c58620cacafb051438f5ad6f79535a4696a2c8d6b968dcb1a690
3
- size 3164568192
 
 
 
 
Mistral-7B-Instruct-v0.2-Q4_0.gguf DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:bc936fe040836b01b4c80248813cf616cb3b9123fab48029f8f902e41db1db7e
3
- size 4108917376
 
 
 
 
Mistral-7B-Instruct-v0.2-Q4_K_M.gguf DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:74e11169ac724aacc8fdc3aea00335e25b952150c37a0ab78235f19c0bda8d02
3
- size 4368439936
 
 
 
 
Mistral-7B-Instruct-v0.2-Q4_K_S.gguf DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:8750dae03e2d7e5fc5380aafabed3f21fa3cd93051a8218a57f2c80905620039
3
- size 4140374656
 
 
 
 
Mistral-7B-Instruct-v0.2-Q5_0.gguf DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:16ae3b06d280d4cd72d66d23887ec7c01ce7fc8607b0a1b773873ea77295db12
3
- size 4997716608
 
 
 
 
Mistral-7B-Instruct-v0.2-Q5_K_M.gguf DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:7fb5db1bf7dcf72a9e18539fffdaf93cac032279f9d096e1bb5c71417cf054cb
3
- size 5131410048
 
 
 
 
Mistral-7B-Instruct-v0.2-Q5_K_S.gguf DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:099ab4b21bd5ad9d69aac5b5cfe7ee18516fdf6d03c401be77ffe0cb3b09cc37
3
- size 4997716608
 
 
 
 
Mistral-7B-Instruct-v0.2-Q6_K.gguf DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:82343e4350fd3f6545e5efaa0b60ccc397aa61369c8af5083ac5d3382f9c2413
3
- size 5942065792
 
 
 
 
Mistral-7B-Instruct-v0.2-Q8_0.gguf DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:7d6e2d0b6615960b0bdc0d9cff73508633d1553c91fbdb4d572449078e281310
3
- size 7695858304
 
 
 
 
mistral-7b-instruct-v0.2-Q3_K_L.gguf DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:73c37852ee472679da2ad1b9d2f03e0151e893b6cd8a03a59538fa2289c74344
3
- size 3822026272
 
 
 
 
mistral-7b-instruct-v0.2-Q3_K_S.gguf DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:6e2907129c94b1710843558b679aa1c3d41b6141d0d61229da5d859b68b78a9f
3
- size 3164569120
 
 
 
 
mistral-7b-instruct-v0.2-Q4_0.gguf DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:72cfdb68ce047e529c0185c34296eaf0bc9fa01dd5d4cb940f72c07312e72ba1
3
- size 4108918304
 
 
 
 
mistral-7b-instruct-v0.2-Q4_K_M.gguf DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:2c73c39b5331624adeba3f0858be26cdccd9537db57ff47790ce1339f765cf32
3
- size 4368440864
 
 
 
 
mistral-7b-instruct-v0.2-Q4_K_S.gguf DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:0d477ba6773b91fc50efb4ec136e46756456b3a6786074d087dcd243f5c41026
3
- size 4140375584
 
 
 
 
mistral-7b-instruct-v0.2-Q5_0.gguf DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:e7eded237e484ebc01d7461649a8f54a606a1285199f43756dc5246157a1d876
3
- size 4997717536
 
 
 
 
mistral-7b-instruct-v0.2-Q5_K_M.gguf DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:0c513827bd4df877ead0a43e5de95203607a6eb6e0581fb75948e9d60d03c57a
3
- size 5131410976
 
 
 
 
mistral-7b-instruct-v0.2-Q5_K_S.gguf DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:4af7eb7e1139900406a904fd40e7fe01b4cda24fdc226bb6bda7e785a0af847e
3
- size 4997717536
 
 
 
 
mistral-7b-instruct-v0.2-Q6_K.gguf DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:0832362790468171a612f41411c9edd79ccfb23f09c15a91c4f696fc915f8ce6
3
- size 5942066720
 
 
 
 
mistral-7b-instruct-v0.2-Q8_0.gguf DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:9efe9f9fa381eb94b075587601e96769ae89d68dbe5db3973ade2361082f2140
3
- size 7695859232