Hugging Face's logo

DevQuasar
/
PowerInfer.SmallThinker-21BA3B-Instruct-GGUF

Text Generation
GGUF
conversational
Model card Files
xet
 Community
csabakecskemeti commited on
Commit
9091127
·
verified ·
1 Parent(s): 93a4290

Upload PowerInfer.SmallThinker-21BA3B-Instruct.Q5_K_M.gguf with huggingface_hub

Browse files
Files changed (2) hide show
  1. .gitattributes +1 -0
  2. PowerInfer.SmallThinker-21BA3B-Instruct.Q5_K_M.gguf +3 -0
.gitattributes CHANGED
@@ -37,3 +37,4 @@ PowerInfer.SmallThinker-21BA3B-Instruct.f16-00001-of-00002.gguf filter=lfs diff=
37
  PowerInfer.SmallThinker-21BA3B-Instruct.f16-00002-of-00002.gguf filter=lfs diff=lfs merge=lfs -text
38
  PowerInfer.SmallThinker-21BA3B-Instruct.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
39
  PowerInfer.SmallThinker-21BA3B-Instruct.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
 
 
37
  PowerInfer.SmallThinker-21BA3B-Instruct.f16-00002-of-00002.gguf filter=lfs diff=lfs merge=lfs -text
38
  PowerInfer.SmallThinker-21BA3B-Instruct.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
39
  PowerInfer.SmallThinker-21BA3B-Instruct.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
40
+ PowerInfer.SmallThinker-21BA3B-Instruct.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
PowerInfer.SmallThinker-21BA3B-Instruct.Q5_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:81e60981dc3694655c0956839bf681cd88cf528fd2ef0009238171ab6a8fa5eb
3
+ size 15311526880