Upload folder using huggingface_hub

.gitattributes

@@ -33,3 +33,15 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 *.zip filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
+stablelm-2-1_6b-chat-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
+stablelm-2-1_6b-chat-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
+stablelm-2-1_6b-chat-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+stablelm-2-1_6b-chat-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+stablelm-2-1_6b-chat-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
+stablelm-2-1_6b-chat-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+stablelm-2-1_6b-chat-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+stablelm-2-1_6b-chat-Q5_0.gguf filter=lfs diff=lfs merge=lfs -text
+stablelm-2-1_6b-chat-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+stablelm-2-1_6b-chat-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+stablelm-2-1_6b-chat-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
+stablelm-2-1_6b-chat-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text

README.md

@@ -0,0 +1,93 @@
+---
+datasets:
+- HuggingFaceH4/ultrachat_200k
+- allenai/ultrafeedback_binarized_cleaned
+- meta-math/MetaMathQA
+- WizardLM/WizardLM_evol_instruct_V2_196k
+- openchat/openchat_sharegpt4_dataset
+- LDJnr/Capybara
+- Intel/orca_dpo_pairs
+- hkust-nlp/deita-10k-v0
+- teknium/OpenHermes-2.5
+language:
+- en
+tags:
+- causal-lm
+- TensorBlock
+- GGUF
+extra_gated_fields:
+  Name: text
+  Email: text
+  Country: text
+  Organization or Affiliation: text
+  I ALLOW Stability AI to email me about new model releases: checkbox
+license: other
+base_model: stabilityai/stablelm-2-1_6b-chat
+---
+
+<div style="width: auto; margin-left: auto; margin-right: auto">
+<img src="https://i.imgur.com/jC7kdl8.jpeg" alt="TensorBlock" style="width: 100%; min-width: 400px; display: block; margin: auto;">
+</div>
+<div style="display: flex; justify-content: space-between; width: 100%;">
+    <div style="display: flex; flex-direction: column; align-items: flex-start;">
+        <p style="margin-top: 0.5em; margin-bottom: 0em;">
+            Feedback and support: TensorBlock's  <a href="https://x.com/tensorblock_aoi">Twitter/X</a>, <a href="https://t.me/TensorBlock">Telegram Group</a> and <a href="https://x.com/tensorblock_aoi">Discord server</a>
+        </p>
+    </div>
+</div>
+
+## stabilityai/stablelm-2-1_6b-chat - GGUF
+
+This repo contains GGUF format model files for [stabilityai/stablelm-2-1_6b-chat](https://huggingface.co/stabilityai/stablelm-2-1_6b-chat).
+
+The files were quantized using machines provided by [TensorBlock](https://tensorblock.co/), and they are compatible with llama.cpp as of [commit b4011](https://github.com/ggerganov/llama.cpp/commit/a6744e43e80f4be6398fc7733a01642c846dce1d).
+
+## Prompt template
+
+```
+<|im_start|>system
+{system_prompt}<|im_end|>
+<|im_start|>user
+{prompt}<|im_end|>
+<|im_start|>assistant
+```
+
+## Model file specification
+
+| Filename | Quant type | File Size | Description |
+| -------- | ---------- | --------- | ----------- |
+| [stablelm-2-1_6b-chat-Q2_K.gguf](https://huggingface.co/tensorblock/stablelm-2-1_6b-chat-GGUF/tree/main/stablelm-2-1_6b-chat-Q2_K.gguf) | Q2_K | 0.646 GB | smallest, significant quality loss - not recommended for most purposes |
+| [stablelm-2-1_6b-chat-Q3_K_S.gguf](https://huggingface.co/tensorblock/stablelm-2-1_6b-chat-GGUF/tree/main/stablelm-2-1_6b-chat-Q3_K_S.gguf) | Q3_K_S | 0.737 GB | very small, high quality loss |
+| [stablelm-2-1_6b-chat-Q3_K_M.gguf](https://huggingface.co/tensorblock/stablelm-2-1_6b-chat-GGUF/tree/main/stablelm-2-1_6b-chat-Q3_K_M.gguf) | Q3_K_M | 0.799 GB | very small, high quality loss |
+| [stablelm-2-1_6b-chat-Q3_K_L.gguf](https://huggingface.co/tensorblock/stablelm-2-1_6b-chat-GGUF/tree/main/stablelm-2-1_6b-chat-Q3_K_L.gguf) | Q3_K_L | 0.852 GB | small, substantial quality loss |
+| [stablelm-2-1_6b-chat-Q4_0.gguf](https://huggingface.co/tensorblock/stablelm-2-1_6b-chat-GGUF/tree/main/stablelm-2-1_6b-chat-Q4_0.gguf) | Q4_0 | 0.915 GB | legacy; small, very high quality loss - prefer using Q3_K_M |
+| [stablelm-2-1_6b-chat-Q4_K_S.gguf](https://huggingface.co/tensorblock/stablelm-2-1_6b-chat-GGUF/tree/main/stablelm-2-1_6b-chat-Q4_K_S.gguf) | Q4_K_S | 0.921 GB | small, greater quality loss |
+| [stablelm-2-1_6b-chat-Q4_K_M.gguf](https://huggingface.co/tensorblock/stablelm-2-1_6b-chat-GGUF/tree/main/stablelm-2-1_6b-chat-Q4_K_M.gguf) | Q4_K_M | 0.961 GB | medium, balanced quality - recommended |
+| [stablelm-2-1_6b-chat-Q5_0.gguf](https://huggingface.co/tensorblock/stablelm-2-1_6b-chat-GGUF/tree/main/stablelm-2-1_6b-chat-Q5_0.gguf) | Q5_0 | 1.083 GB | legacy; medium, balanced quality - prefer using Q4_K_M |
+| [stablelm-2-1_6b-chat-Q5_K_S.gguf](https://huggingface.co/tensorblock/stablelm-2-1_6b-chat-GGUF/tree/main/stablelm-2-1_6b-chat-Q5_K_S.gguf) | Q5_K_S | 1.083 GB | large, low quality loss - recommended |
+| [stablelm-2-1_6b-chat-Q5_K_M.gguf](https://huggingface.co/tensorblock/stablelm-2-1_6b-chat-GGUF/tree/main/stablelm-2-1_6b-chat-Q5_K_M.gguf) | Q5_K_M | 1.106 GB | large, very low quality loss - recommended |
+| [stablelm-2-1_6b-chat-Q6_K.gguf](https://huggingface.co/tensorblock/stablelm-2-1_6b-chat-GGUF/tree/main/stablelm-2-1_6b-chat-Q6_K.gguf) | Q6_K | 1.261 GB | very large, extremely low quality loss |
+| [stablelm-2-1_6b-chat-Q8_0.gguf](https://huggingface.co/tensorblock/stablelm-2-1_6b-chat-GGUF/tree/main/stablelm-2-1_6b-chat-Q8_0.gguf) | Q8_0 | 1.632 GB | very large, extremely low quality loss - not recommended |
+
+
+## Downloading instruction
+
+### Command line
+
+Firstly, install Huggingface Client
+
+```shell
+pip install -U "huggingface_hub[cli]"
+```
+
+Then, downoad the individual model file the a local directory
+
+```shell
+huggingface-cli download tensorblock/stablelm-2-1_6b-chat-GGUF --include "stablelm-2-1_6b-chat-Q2_K.gguf" --local-dir MY_LOCAL_DIR
+```
+
+If you wanna download multiple model files with a pattern (e.g., `*Q4_K*gguf`), you can try:
+
+```shell
+huggingface-cli download tensorblock/stablelm-2-1_6b-chat-GGUF --local-dir MY_LOCAL_DIR --local-dir-use-symlinks False --include='*Q4_K*gguf'
+```

stablelm-2-1_6b-chat-Q2_K.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:523c7e95194f7cd100f3a30d4779461aa3e2ba59befc4539fe188e50d877ead6
+size 694162432

stablelm-2-1_6b-chat-Q3_K_L.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:1aca43749f7641e9f23eb015a980a318bda7244cbdd6843d1212ececa114a2fb
+size 914985984

stablelm-2-1_6b-chat-Q3_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:225aa15e622e27d3bc9049e58c51df87bba646c9fcca40a11b448afa79c08105
+size 857707520

stablelm-2-1_6b-chat-Q3_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:80ad4fb174db4828dc37fd56b6236254f47aacc8ffb63673b3d3e33dfee64eca
+size 791712768

stablelm-2-1_6b-chat-Q4_0.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:afd06b9eb83044d3cb70ae107a832a6a1139670230234b49f9d939ea0139c78d
+size 982782976

stablelm-2-1_6b-chat-Q4_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:cb1825d01b45b089b79c07ae218b73de08079674c8ae7429ba3b41acf9f6b6df
+size 1031443456

stablelm-2-1_6b-chat-Q4_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:af706440220ba9f3e4297040b76769d52a715f6549260fd89a4f2a3d4ef5e95e
+size 989205504

stablelm-2-1_6b-chat-Q5_0.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e3a354308319f412ad9a1e60382a162268a51b8e4ea3d9c72466aae073ea6b49
+size 1162613760

stablelm-2-1_6b-chat-Q5_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:48a1ef57c5aa209f9769017f3789176d9505e20cf711834cc448bf0c7068e4e6
+size 1187681280

stablelm-2-1_6b-chat-Q5_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:7908ccdf10fe55c1310acb3cb4133c75cdd36f3a59f56d4df946e580077682b2
+size 1162613760

stablelm-2-1_6b-chat-Q6_K.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:32270cd71e77fd242b4aae177627867a6a7d76c7478eb0c3647caec68e6704e3
+size 1353683968

stablelm-2-1_6b-chat-Q8_0.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:086a1e0659c9b72697cf2311b2b39598ee06108fa11c5ac19d28240b9301c123
+size 1751880704