Upload HuggingFaceTB_SmolLM3-3B-Q4_0.gguf
Browse filesBartowski's q4 with template from: https://huggingface.co/ggml-org/SmolLM3-3B-GGUF.
HF staff manually updated the template at ggml-org after release; there's an extra [:] on some arrays on the original template. That used to work, but, now llama.cpp is refusing to inference SmolLM3 with an error about a vector at row X column Y. I believe using this file will fix that.
HuggingFaceTB_SmolLM3-3B-Q4_0.gguf
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:022ab56b7071bedf7cf741068cd65cab289ed1ad5cfc56b55f9cabb634297928
|
| 3 |
+
size 1811455744
|