Hugging Face's logo

l3utterfly
/
WizardLM-2-7B-gguf

GGUF
Model card Files
xet
Community
l3utterfly commited on
Commit
ad10d63
·
1 Parent(s): 5395ac5

Add quantised GGUF files

Browse files
Files changed (9) hide show
  1. .gitattributes +1 -0
  2. WizardLM-2-7B-Q2_K.gguf +3 -0
  3. WizardLM-2-7B-Q4_0_4_4.gguf +3 -0
  4. WizardLM-2-7B-Q4_0_4_8.gguf +3 -0
  5. WizardLM-2-7B-Q4_0_8_8.gguf +3 -0
  6. WizardLM-2-7B-Q4_K_M.gguf +3 -0
  7. WizardLM-2-7B-Q6_K.gguf +3 -0
  8. WizardLM-2-7B-Q8_0.gguf +3 -0
  9. WizardLM-2-7B-f16.gguf +3 -0
.gitattributes CHANGED
@@ -33,3 +33,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ *.gguf filter=lfs diff=lfs merge=lfs -text
WizardLM-2-7B-Q2_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c2ffcd9340fc9c196ebebf8cafd98ed22b0d37fe11f7aca777ed45ee5569c450
3
+ size 2719242080
WizardLM-2-7B-Q4_0_4_4.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:07f682895f29430d2b630efe6c033eef0f234a0cf69a3e60a2e631384e64f855
3
+ size 4108916576
WizardLM-2-7B-Q4_0_4_8.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e2536839b5a45c0613399489df82e75244bd49a11322b502a9e491020afdb2b2
3
+ size 4108916576
WizardLM-2-7B-Q4_0_8_8.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1a924ddbd77227bcea9f2c2362a81b35992c818238e450ffea0d9061cbb6c66f
3
+ size 4108916576
WizardLM-2-7B-Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:63b16e5e95a277e6b8f025f7d7590119c240284632735838f940d59ad3c84860
3
+ size 4368439136
WizardLM-2-7B-Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2e8ef1fd8b943b690a545002d01bdf1a69d6054e6f2ba55bf136db5970cc2112
3
+ size 5942064992
WizardLM-2-7B-Q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7e9e0e813e467bb09722287d722b2617af0b9267788951fa7aa77b7a52e221d1
3
+ size 7695857504
WizardLM-2-7B-f16.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:985e7453cfaef0f0aa7d86a3edeb5892ba07ed597bfb64efdf3bcb071c391b15
3
+ size 14484731744