Upload folder using huggingface_hub

.gitattributes

@@ -33,3 +33,15 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 *.zip filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
+KwaiCoder-23B-A4B-v1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
+KwaiCoder-23B-A4B-v1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
+KwaiCoder-23B-A4B-v1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+KwaiCoder-23B-A4B-v1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+KwaiCoder-23B-A4B-v1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
+KwaiCoder-23B-A4B-v1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+KwaiCoder-23B-A4B-v1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+KwaiCoder-23B-A4B-v1-Q5_0.gguf filter=lfs diff=lfs merge=lfs -text
+KwaiCoder-23B-A4B-v1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+KwaiCoder-23B-A4B-v1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+KwaiCoder-23B-A4B-v1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
+KwaiCoder-23B-A4B-v1-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text

KwaiCoder-23B-A4B-v1-Q2_K.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:0866da131097595db3255fabbedcb5267d544750ef727866d61e42f9613cd98b
+size 9474809216

KwaiCoder-23B-A4B-v1-Q3_K_L.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:682a61f9084474d92ff619c5325d3d3f1f7732d0272e1e4aed2a26fc1dddfe83
+size 12547394944

KwaiCoder-23B-A4B-v1-Q3_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:61326e4be9b5937f70c4f0d82528e0dcd8ae29f89609c44c07dc2b1d92d9c84c
+size 12039359872

KwaiCoder-23B-A4B-v1-Q3_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:7fa0a5952d8200100efda35c92e87dde0df63dd7545ebac611b78ea58cd9586c
+size 11021716864

KwaiCoder-23B-A4B-v1-Q4_0.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:cc48e5b844ffc0a58288c4a503f48890cf6ad59005a7ced1ab1e2c77d8287bd1
+size 13133725056

KwaiCoder-23B-A4B-v1-Q4_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f40a6516f5a376567e3f23459f2b368897f759b9a60f52f4fe4bae6ab8d70fdf
+size 15431417216

KwaiCoder-23B-A4B-v1-Q4_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e9f621330dc7a9f0bbe1bdd906e6efef64dbaa86f06d84a2f2c4485e26f0ec16
+size 14088977792

KwaiCoder-23B-A4B-v1-Q5_0.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:04a69dcffc031d5b4be8a512810d89c10f319cf111d7ce4805b40a1186c9bfb3
+size 16023272832

KwaiCoder-23B-A4B-v1-Q5_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:22e3febd244ed64620cb40ca66adb80b8c676493036148afdeb9bbfced58e7a2
+size 17623661952

KwaiCoder-23B-A4B-v1-Q5_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f0aed052334f330369baa34e22993aa34784caf7117bae307b7aeb7c9412f127
+size 16474160512

KwaiCoder-23B-A4B-v1-Q6_K.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:fefe3b609ce851f2f0f71355ee33ee59bdaa70db63d28901b0e09b25b4cab090
+size 20840607104

KwaiCoder-23B-A4B-v1-Q8_0.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:856e96ec9e3d6f29100850db9f4d4c9cc6aa3a833e26931de2691908d2def15e
+size 24723787136

README.md

@@ -0,0 +1,80 @@
+---
+language:
+- multilingual
+tags:
+- code-generation
+- transformers
+- TensorBlock
+- GGUF
+license: mit
+base_model: Kwaipilot/KwaiCoder-23B-A4B-v1
+---
+
+<div style="width: auto; margin-left: auto; margin-right: auto">
+<img src="https://i.imgur.com/jC7kdl8.jpeg" alt="TensorBlock" style="width: 100%; min-width: 400px; display: block; margin: auto;">
+</div>
+<div style="display: flex; justify-content: space-between; width: 100%;">
+    <div style="display: flex; flex-direction: column; align-items: flex-start;">
+        <p style="margin-top: 0.5em; margin-bottom: 0em;">
+            Feedback and support: TensorBlock's  <a href="https://x.com/tensorblock_aoi">Twitter/X</a>, <a href="https://t.me/TensorBlock">Telegram Group</a> and <a href="https://x.com/tensorblock_aoi">Discord server</a>
+        </p>
+    </div>
+</div>
+
+## Kwaipilot/KwaiCoder-23B-A4B-v1 - GGUF
+
+This repo contains GGUF format model files for [Kwaipilot/KwaiCoder-23B-A4B-v1](https://huggingface.co/Kwaipilot/KwaiCoder-23B-A4B-v1).
+
+The files were quantized using machines provided by [TensorBlock](https://tensorblock.co/), and they are compatible with llama.cpp as of [commit b4823](https://github.com/ggml-org/llama.cpp/commit/5bbe6a9fe9a8796a9389c85accec89dbc4d91e39).
+
+<div style="text-align: left; margin: 20px 0;">
+    <a href="https://tensorblock.co/waitlist/client" style="display: inline-block; padding: 10px 20px; background-color: #007bff; color: white; text-decoration: none; border-radius: 5px; font-weight: bold;">
+        Run them on the TensorBlock client using your local machine ↗
+    </a>
+</div>
+
+## Prompt template
+
+```
+Unable to determine prompt format automatically. Please check the original model repository for the correct prompt format.
+```
+
+## Model file specification
+
+| Filename | Quant type | File Size | Description |
+| -------- | ---------- | --------- | ----------- |
+| [KwaiCoder-23B-A4B-v1-Q2_K.gguf](https://huggingface.co/tensorblock/KwaiCoder-23B-A4B-v1-GGUF/blob/main/KwaiCoder-23B-A4B-v1-Q2_K.gguf) | Q2_K | 9.475 GB | smallest, significant quality loss - not recommended for most purposes |
+| [KwaiCoder-23B-A4B-v1-Q3_K_S.gguf](https://huggingface.co/tensorblock/KwaiCoder-23B-A4B-v1-GGUF/blob/main/KwaiCoder-23B-A4B-v1-Q3_K_S.gguf) | Q3_K_S | 11.022 GB | very small, high quality loss |
+| [KwaiCoder-23B-A4B-v1-Q3_K_M.gguf](https://huggingface.co/tensorblock/KwaiCoder-23B-A4B-v1-GGUF/blob/main/KwaiCoder-23B-A4B-v1-Q3_K_M.gguf) | Q3_K_M | 12.039 GB | very small, high quality loss |
+| [KwaiCoder-23B-A4B-v1-Q3_K_L.gguf](https://huggingface.co/tensorblock/KwaiCoder-23B-A4B-v1-GGUF/blob/main/KwaiCoder-23B-A4B-v1-Q3_K_L.gguf) | Q3_K_L | 12.547 GB | small, substantial quality loss |
+| [KwaiCoder-23B-A4B-v1-Q4_0.gguf](https://huggingface.co/tensorblock/KwaiCoder-23B-A4B-v1-GGUF/blob/main/KwaiCoder-23B-A4B-v1-Q4_0.gguf) | Q4_0 | 13.134 GB | legacy; small, very high quality loss - prefer using Q3_K_M |
+| [KwaiCoder-23B-A4B-v1-Q4_K_S.gguf](https://huggingface.co/tensorblock/KwaiCoder-23B-A4B-v1-GGUF/blob/main/KwaiCoder-23B-A4B-v1-Q4_K_S.gguf) | Q4_K_S | 14.089 GB | small, greater quality loss |
+| [KwaiCoder-23B-A4B-v1-Q4_K_M.gguf](https://huggingface.co/tensorblock/KwaiCoder-23B-A4B-v1-GGUF/blob/main/KwaiCoder-23B-A4B-v1-Q4_K_M.gguf) | Q4_K_M | 15.431 GB | medium, balanced quality - recommended |
+| [KwaiCoder-23B-A4B-v1-Q5_0.gguf](https://huggingface.co/tensorblock/KwaiCoder-23B-A4B-v1-GGUF/blob/main/KwaiCoder-23B-A4B-v1-Q5_0.gguf) | Q5_0 | 16.023 GB | legacy; medium, balanced quality - prefer using Q4_K_M |
+| [KwaiCoder-23B-A4B-v1-Q5_K_S.gguf](https://huggingface.co/tensorblock/KwaiCoder-23B-A4B-v1-GGUF/blob/main/KwaiCoder-23B-A4B-v1-Q5_K_S.gguf) | Q5_K_S | 16.474 GB | large, low quality loss - recommended |
+| [KwaiCoder-23B-A4B-v1-Q5_K_M.gguf](https://huggingface.co/tensorblock/KwaiCoder-23B-A4B-v1-GGUF/blob/main/KwaiCoder-23B-A4B-v1-Q5_K_M.gguf) | Q5_K_M | 17.624 GB | large, very low quality loss - recommended |
+| [KwaiCoder-23B-A4B-v1-Q6_K.gguf](https://huggingface.co/tensorblock/KwaiCoder-23B-A4B-v1-GGUF/blob/main/KwaiCoder-23B-A4B-v1-Q6_K.gguf) | Q6_K | 20.841 GB | very large, extremely low quality loss |
+| [KwaiCoder-23B-A4B-v1-Q8_0.gguf](https://huggingface.co/tensorblock/KwaiCoder-23B-A4B-v1-GGUF/blob/main/KwaiCoder-23B-A4B-v1-Q8_0.gguf) | Q8_0 | 24.724 GB | very large, extremely low quality loss - not recommended |
+
+
+## Downloading instruction
+
+### Command line
+
+Firstly, install Huggingface Client
+
+```shell
+pip install -U "huggingface_hub[cli]"
+```
+
+Then, downoad the individual model file the a local directory
+
+```shell
+huggingface-cli download tensorblock/KwaiCoder-23B-A4B-v1-GGUF --include "KwaiCoder-23B-A4B-v1-Q2_K.gguf" --local-dir MY_LOCAL_DIR
+```
+
+If you wanna download multiple model files with a pattern (e.g., `*Q4_K*gguf`), you can try:
+
+```shell
+huggingface-cli download tensorblock/KwaiCoder-23B-A4B-v1-GGUF --local-dir MY_LOCAL_DIR --local-dir-use-symlinks False --include='*Q4_K*gguf'
+```