Upload folder using huggingface_hub

README.md

@@ -1,20 +1,9 @@
 ---
-license: apache-2.0
-base_model: unsloth/SmolLM-135M
+library_name: transformers
 tags:
-- alignment-handbook
-- trl
-- unsloth
 - TensorBlock
 - GGUF
-datasets:
-- Magpie-Align/Magpie-Pro-300K-Filtered
-- bigcode/self-oss-instruct-sc2-exec-filter-50k
-- teknium/OpenHermes-2.5
-- HuggingFaceTB/everyday-conversations-llama3.1-2k
-library_name: transformers
-language:
-- en
+base_model: khairi/SmolLM-135M
 ---
 
 <div style="width: auto; margin-left: auto; margin-right: auto">
@@ -28,11 +17,11 @@ language:
     </div>
 </div>
 
-## unsloth/SmolLM-135M - GGUF
+## khairi/SmolLM-135M - GGUF
 
-This repo contains GGUF format model files for [unsloth/SmolLM-135M](https://huggingface.co/unsloth/SmolLM-135M).
+This repo contains GGUF format model files for [khairi/SmolLM-135M](https://huggingface.co/khairi/SmolLM-135M).
 
-The files were quantized using machines provided by [TensorBlock](https://tensorblock.co/), and they are compatible with llama.cpp as of [commit b4011](https://github.com/ggerganov/llama.cpp/commit/a6744e43e80f4be6398fc7733a01642c846dce1d).
+The files were quantized using machines provided by [TensorBlock](https://tensorblock.co/), and they are compatible with llama.cpp as of [commit b4882](https://github.com/ggml-org/llama.cpp/commit/be7c3034108473beda214fd1d7c98fd6a7a3bdf5).
 
 <div style="text-align: left; margin: 20px 0;">
     <a href="https://tensorblock.co/waitlist/client" style="display: inline-block; padding: 10px 20px; background-color: #007bff; color: white; text-decoration: none; border-radius: 5px; font-weight: bold;">
@@ -43,7 +32,11 @@ The files were quantized using machines provided by [TensorBlock](https://tensor
 ## Prompt template
 
 ```
-
+<|im_start|>system
+{system_prompt}<|im_end|>
+<|im_start|>user
+{prompt}<|im_end|>
+<|im_start|>assistant
 ```
 
 ## Model file specification

SmolLM-135M-Q2_K.gguf

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:237ed03dbd95e9fe299249476ae6359505e68f2080007456b21d65b615a0a967
-size 88201888
+oid sha256:99cce9f2e86e2d98fee6b3d9a734d2bd9491260faa0cf544b772ffa84794175c
+size 88202400

SmolLM-135M-Q3_K_L.gguf

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:66c93ee27b51c733003573c4da28f5e55502ef78ef9ff2be1f9aa84807e7bf0f
-size 97533088
+oid sha256:59732338c361d2c319d271a4e280e52f693eff1aa61fd2adc2cb85b69fb3d194
+size 97533600

SmolLM-135M-Q3_K_M.gguf

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:bfc25321346d2928df8f0ec7f397e779dcda18016034e33ed508deeff0f01f32
-size 93510304
+oid sha256:4e6af5bbdf5b29b06cd52eb9be9920e560dcea01db8a6c6b250d7d00767b4bc7
+size 93510816

SmolLM-135M-Q3_K_S.gguf

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:c57644b10895850aa81ebd328ed4f8d3163211091145b7ca42bf784cabf11694
-size 88201888
+oid sha256:a33b97acf5e8ac3007c8b7aac1a931bd7736a111315ce7c279e9b46451e3dfa7
+size 88202400

SmolLM-135M-Q4_0.gguf

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:ab7ddc4f1b5a4895997f14763d73e0cf73f6872c13b984b76bae6e579debcdc9
-size 91727008
+oid sha256:2de7858e21ce6e4ef46be1427f72f16348e83b4175d8cc2eeacedb69a18ac5e2
+size 91727520

SmolLM-135M-Q4_K_M.gguf

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:5c0b8584b7f77c0969d07cd6830ad795ccae114c6c95323433c441685d5db72b
-size 105454240
+oid sha256:faa547bb3c804d964661afbf4765232f3c5abb9844444c3cde435f50f2e68b79
+size 105454752

SmolLM-135M-Q4_K_S.gguf

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:886f815f3691dafbb61037fa043867e077c9ea1b0918ad85068ced3164aa4a33
-size 102039712
+oid sha256:324b43b21c1829596c178eceb56a25108dd86190775ded6f9558469b33015b96
+size 102040224

SmolLM-135M-Q5_0.gguf

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:d72cdd4d974368d1911781e89fe3ea85ec93eabd7f8f7af4765a434b3564c389
-size 104998048
+oid sha256:5ac0b348dc99bb21a1b040ff4e06ca31f7cc68d1096e6f42b60b6fb5cbbbd828
+size 104998560

SmolLM-135M-Q5_K_M.gguf

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:10e62cdea213247aed62966dfc6c1ff931044ca3a94bba416fd2a2a6fe839b9a
-size 112103584
+oid sha256:b9d0a75699163d70893a552a92ff8e3e41b208e6cdf7fc91b3a02fe33517fe85
+size 112104096

SmolLM-135M-Q5_K_S.gguf

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:e6ea7b7a9af27510234192a840d949931222948b17ffbc446c3013ea7198fa84
-size 109974688
+oid sha256:112db0c0fff49aa2546bf26b3e1bca5ef4f16cd048afdefe86e150580c6c88bf
+size 109975200

SmolLM-135M-Q6_K.gguf

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:ae1921b63175478b82a61b9e2f309f1ab8be7489ec9fa02cc7243a189cf2a5dc
-size 138383008
+oid sha256:3465a6a3591381357725877a26e2e680ecec9124d5b067e973c0b517e64c14bf
+size 138383520

SmolLM-135M-Q8_0.gguf

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:affd9eb0a32ccd3fa09b2dec5d386fc2a5a98751fad8867e9f628d60a1a89729
-size 144811168
+oid sha256:6be60d2febc061fbbe3fcae3e44bf6b7a1a8b5fc4e07b9450362b58fe15e20df
+size 144811680