DevQuasar
/

PowerInfer.SmallThinker-3B-Preview-GGUF

Text Generation

Model card Files Files and versions

PowerInfer.SmallThinker-3B-Preview-GGUF

14.1 GB

Ctrl+K

Ctrl+K

1 contributor

History: 8 commits

csabakecskemeti's picture

csabakecskemeti

Upload PowerInfer.SmallThinker-3B-Preview.Q8_0.gguf with huggingface_hub

fce6b95 verified over 1 year ago

.gitattributes

2.01 kB
Upload PowerInfer.SmallThinker-3B-Preview.Q8_0.gguf with huggingface_hub over 1 year ago
PowerInfer.SmallThinker-3B-Preview.Q2_K.gguf

1.38 GB
xet

Upload PowerInfer.SmallThinker-3B-Preview.Q2_K.gguf with huggingface_hub over 1 year ago
PowerInfer.SmallThinker-3B-Preview.Q3_K_M.gguf

1.72 GB
xet

Upload PowerInfer.SmallThinker-3B-Preview.Q3_K_M.gguf with huggingface_hub over 1 year ago
PowerInfer.SmallThinker-3B-Preview.Q4_K_M.gguf

2.1 GB
xet

Upload PowerInfer.SmallThinker-3B-Preview.Q4_K_M.gguf with huggingface_hub over 1 year ago
PowerInfer.SmallThinker-3B-Preview.Q5_K_M.gguf

2.44 GB
xet

Upload PowerInfer.SmallThinker-3B-Preview.Q5_K_M.gguf with huggingface_hub over 1 year ago
PowerInfer.SmallThinker-3B-Preview.Q6_K.gguf

2.79 GB
xet

Upload PowerInfer.SmallThinker-3B-Preview.Q6_K.gguf with huggingface_hub over 1 year ago
PowerInfer.SmallThinker-3B-Preview.Q8_0.gguf

3.62 GB
xet

Upload PowerInfer.SmallThinker-3B-Preview.Q8_0.gguf with huggingface_hub over 1 year ago
README.md

330 Bytes
Upload README.md with huggingface_hub over 1 year ago