Upload folder using huggingface_hub

.gitattributes

@@ -33,3 +33,15 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 *.zip filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
+ft-240209-sft-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
+ft-240209-sft-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
+ft-240209-sft-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+ft-240209-sft-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+ft-240209-sft-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
+ft-240209-sft-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+ft-240209-sft-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+ft-240209-sft-Q5_0.gguf filter=lfs diff=lfs merge=lfs -text
+ft-240209-sft-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+ft-240209-sft-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+ft-240209-sft-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
+ft-240209-sft-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text

README.md

@@ -0,0 +1,79 @@
+---
+license: cc-by-nc-4.0
+language:
+- ko
+library_name: transformers
+base_model: msy127/ft-240209-sft
+tags:
+- TensorBlock
+- GGUF
+---
+
+<div style="width: auto; margin-left: auto; margin-right: auto">
+<img src="https://i.imgur.com/jC7kdl8.jpeg" alt="TensorBlock" style="width: 100%; min-width: 400px; display: block; margin: auto;">
+</div>
+<div style="display: flex; justify-content: space-between; width: 100%;">
+    <div style="display: flex; flex-direction: column; align-items: flex-start;">
+        <p style="margin-top: 0.5em; margin-bottom: 0em;">
+            Feedback and support: TensorBlock's  <a href="https://x.com/tensorblock_aoi">Twitter/X</a>, <a href="https://t.me/TensorBlock">Telegram Group</a> and <a href="https://x.com/tensorblock_aoi">Discord server</a>
+        </p>
+    </div>
+</div>
+
+## msy127/ft-240209-sft - GGUF
+
+This repo contains GGUF format model files for [msy127/ft-240209-sft](https://huggingface.co/msy127/ft-240209-sft).
+
+The files were quantized using machines provided by [TensorBlock](https://tensorblock.co/), and they are compatible with llama.cpp as of [commit b4011](https://github.com/ggerganov/llama.cpp/commit/a6744e43e80f4be6398fc7733a01642c846dce1d).
+
+<div style="text-align: left; margin: 20px 0;">
+    <a href="https://tensorblock.co/waitlist/client" style="display: inline-block; padding: 10px 20px; background-color: #007bff; color: white; text-decoration: none; border-radius: 5px; font-weight: bold;">
+        Run them on the TensorBlock client using your local machine ↗
+    </a>
+</div>
+
+## Prompt template
+
+```
+
+```
+
+## Model file specification
+
+| Filename | Quant type | File Size | Description |
+| -------- | ---------- | --------- | ----------- |
+| [ft-240209-sft-Q2_K.gguf](https://huggingface.co/tensorblock/ft-240209-sft-GGUF/blob/main/ft-240209-sft-Q2_K.gguf) | Q2_K | 3.799 GB | smallest, significant quality loss - not recommended for most purposes |
+| [ft-240209-sft-Q3_K_S.gguf](https://huggingface.co/tensorblock/ft-240209-sft-GGUF/blob/main/ft-240209-sft-Q3_K_S.gguf) | Q3_K_S | 4.421 GB | very small, high quality loss |
+| [ft-240209-sft-Q3_K_M.gguf](https://huggingface.co/tensorblock/ft-240209-sft-GGUF/blob/main/ft-240209-sft-Q3_K_M.gguf) | Q3_K_M | 4.916 GB | very small, high quality loss |
+| [ft-240209-sft-Q3_K_L.gguf](https://huggingface.co/tensorblock/ft-240209-sft-GGUF/blob/main/ft-240209-sft-Q3_K_L.gguf) | Q3_K_L | 5.339 GB | small, substantial quality loss |
+| [ft-240209-sft-Q4_0.gguf](https://huggingface.co/tensorblock/ft-240209-sft-GGUF/blob/main/ft-240209-sft-Q4_0.gguf) | Q4_0 | 5.740 GB | legacy; small, very high quality loss - prefer using Q3_K_M |
+| [ft-240209-sft-Q4_K_S.gguf](https://huggingface.co/tensorblock/ft-240209-sft-GGUF/blob/main/ft-240209-sft-Q4_K_S.gguf) | Q4_K_S | 5.783 GB | small, greater quality loss |
+| [ft-240209-sft-Q4_K_M.gguf](https://huggingface.co/tensorblock/ft-240209-sft-GGUF/blob/main/ft-240209-sft-Q4_K_M.gguf) | Q4_K_M | 6.103 GB | medium, balanced quality - recommended |
+| [ft-240209-sft-Q5_0.gguf](https://huggingface.co/tensorblock/ft-240209-sft-GGUF/blob/main/ft-240209-sft-Q5_0.gguf) | Q5_0 | 6.982 GB | legacy; medium, balanced quality - prefer using Q4_K_M |
+| [ft-240209-sft-Q5_K_S.gguf](https://huggingface.co/tensorblock/ft-240209-sft-GGUF/blob/main/ft-240209-sft-Q5_K_S.gguf) | Q5_K_S | 6.982 GB | large, low quality loss - recommended |
+| [ft-240209-sft-Q5_K_M.gguf](https://huggingface.co/tensorblock/ft-240209-sft-GGUF/blob/main/ft-240209-sft-Q5_K_M.gguf) | Q5_K_M | 7.169 GB | large, very low quality loss - recommended |
+| [ft-240209-sft-Q6_K.gguf](https://huggingface.co/tensorblock/ft-240209-sft-GGUF/blob/main/ft-240209-sft-Q6_K.gguf) | Q6_K | 8.301 GB | very large, extremely low quality loss |
+| [ft-240209-sft-Q8_0.gguf](https://huggingface.co/tensorblock/ft-240209-sft-GGUF/blob/main/ft-240209-sft-Q8_0.gguf) | Q8_0 | 10.751 GB | very large, extremely low quality loss - not recommended |
+
+
+## Downloading instruction
+
+### Command line
+
+Firstly, install Huggingface Client
+
+```shell
+pip install -U "huggingface_hub[cli]"
+```
+
+Then, downoad the individual model file the a local directory
+
+```shell
+huggingface-cli download tensorblock/ft-240209-sft-GGUF --include "ft-240209-sft-Q2_K.gguf" --local-dir MY_LOCAL_DIR
+```
+
+If you wanna download multiple model files with a pattern (e.g., `*Q4_K*gguf`), you can try:
+
+```shell
+huggingface-cli download tensorblock/ft-240209-sft-GGUF --local-dir MY_LOCAL_DIR --local-dir-use-symlinks False --include='*Q4_K*gguf'
+```

ft-240209-sft-Q2_K.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c90dd53810bce25da2bfa2af8827900d94bf9f82636d92b0ac7eddebb9ffffa7
+size 4078892448

ft-240209-sft-Q3_K_L.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c99a9de5f0654c4517889b5157ef844dd595697445ed08125780a9f58db5a161
+size 5733066144

ft-240209-sft-Q3_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c18120217ae4fb650b6f2c573a542b9adcebca78a5a07780b9c33047fbe7f55c
+size 5277984160

ft-240209-sft-Q3_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ef84ef2cbf537ee04d74568ad2797da1f0882c8f6df0fa006ee46a9ae4d1d378
+size 4746880416

ft-240209-sft-Q4_0.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:7d13b015c940338351834d349e14b6af41e5fa6df8c5dc6fd40fdb8b9d543298
+size 6163404192

ft-240209-sft-Q4_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:dcda49c16683b5b6bb4d1ea557d7f3c24649eb10fd8b2d29ddabf156bfdc8471
+size 6552688032

ft-240209-sft-Q4_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f26a2de11f053f98bc66717f4308f54c6da1e81d4524cf04de63995eb5eb2e5b
+size 6209541536

ft-240209-sft-Q5_0.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:896b0a856441c35a5177ad8bb77b863bb2e80ab45b4645e2b804973995ee8e65
+size 7496603040

ft-240209-sft-Q5_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:3da017627a25711bd5a78e3c859b569d7ed8a43df0417d88ac1d748b969062ac
+size 7697143200

ft-240209-sft-Q5_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b317fc88f58472c01ad6c122e778dbe33d726c6d9a8eeb998ae42aa6020be30a
+size 7496603040

ft-240209-sft-Q6_K.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ebbe96c898c26a4f29179272bde5163a5a5e5743eca75735f68d74d153e2da08
+size 8913126816

ft-240209-sft-Q8_0.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c191b648c7754adf62d996957a2476f17c311f820f9952a21198ca10a5de4b80
+size 11543815584