Upload folder using huggingface_hub

.gitattributes

@@ -33,3 +33,15 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 *.zip filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
+SeaLLM-7B-v2.5-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
+SeaLLM-7B-v2.5-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
+SeaLLM-7B-v2.5-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+SeaLLM-7B-v2.5-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+SeaLLM-7B-v2.5-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
+SeaLLM-7B-v2.5-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+SeaLLM-7B-v2.5-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+SeaLLM-7B-v2.5-Q5_0.gguf filter=lfs diff=lfs merge=lfs -text
+SeaLLM-7B-v2.5-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+SeaLLM-7B-v2.5-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+SeaLLM-7B-v2.5-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
+SeaLLM-7B-v2.5-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text

README.md

@@ -0,0 +1,89 @@
+---
+license: other
+license_name: seallms
+license_link: https://huggingface.co/SeaLLMs/SeaLLM-13B-Chat/blob/main/LICENSE
+language:
+- en
+- zh
+- vi
+- id
+- th
+- ms
+- km
+- lo
+- my
+- tl
+tags:
+- multilingual
+- sea
+- TensorBlock
+- GGUF
+base_model: SeaLLMs/SeaLLM-7B-v2.5
+---
+
+<div style="width: auto; margin-left: auto; margin-right: auto">
+<img src="https://i.imgur.com/jC7kdl8.jpeg" alt="TensorBlock" style="width: 100%; min-width: 400px; display: block; margin: auto;">
+</div>
+<div style="display: flex; justify-content: space-between; width: 100%;">
+    <div style="display: flex; flex-direction: column; align-items: flex-start;">
+        <p style="margin-top: 0.5em; margin-bottom: 0em;">
+            Feedback and support: TensorBlock's  <a href="https://x.com/tensorblock_aoi">Twitter/X</a>, <a href="https://t.me/TensorBlock">Telegram Group</a> and <a href="https://x.com/tensorblock_aoi">Discord server</a>
+        </p>
+    </div>
+</div>
+
+## SeaLLMs/SeaLLM-7B-v2.5 - GGUF
+
+This repo contains GGUF format model files for [SeaLLMs/SeaLLM-7B-v2.5](https://huggingface.co/SeaLLMs/SeaLLM-7B-v2.5).
+
+The files were quantized using machines provided by [TensorBlock](https://tensorblock.co/), and they are compatible with llama.cpp as of [commit b4011](https://github.com/ggerganov/llama.cpp/commit/a6744e43e80f4be6398fc7733a01642c846dce1d).
+
+## Prompt template
+
+```
+<bos><|im_start|>system
+{system_prompt}<eos>
+<|im_start|>user
+{prompt}<eos>
+<|im_start|>assistant
+```
+
+## Model file specification
+
+| Filename | Quant type | File Size | Description |
+| -------- | ---------- | --------- | ----------- |
+| [SeaLLM-7B-v2.5-Q2_K.gguf](https://huggingface.co/tensorblock/SeaLLM-7B-v2.5-GGUF/tree/main/SeaLLM-7B-v2.5-Q2_K.gguf) | Q2_K | 3.242 GB | smallest, significant quality loss - not recommended for most purposes |
+| [SeaLLM-7B-v2.5-Q3_K_S.gguf](https://huggingface.co/tensorblock/SeaLLM-7B-v2.5-GGUF/tree/main/SeaLLM-7B-v2.5-Q3_K_S.gguf) | Q3_K_S | 3.709 GB | very small, high quality loss |
+| [SeaLLM-7B-v2.5-Q3_K_M.gguf](https://huggingface.co/tensorblock/SeaLLM-7B-v2.5-GGUF/tree/main/SeaLLM-7B-v2.5-Q3_K_M.gguf) | Q3_K_M | 4.069 GB | very small, high quality loss |
+| [SeaLLM-7B-v2.5-Q3_K_L.gguf](https://huggingface.co/tensorblock/SeaLLM-7B-v2.5-GGUF/tree/main/SeaLLM-7B-v2.5-Q3_K_L.gguf) | Q3_K_L | 4.386 GB | small, substantial quality loss |
+| [SeaLLM-7B-v2.5-Q4_0.gguf](https://huggingface.co/tensorblock/SeaLLM-7B-v2.5-GGUF/tree/main/SeaLLM-7B-v2.5-Q4_0.gguf) | Q4_0 | 4.668 GB | legacy; small, very high quality loss - prefer using Q3_K_M |
+| [SeaLLM-7B-v2.5-Q4_K_S.gguf](https://huggingface.co/tensorblock/SeaLLM-7B-v2.5-GGUF/tree/main/SeaLLM-7B-v2.5-Q4_K_S.gguf) | Q4_K_S | 4.700 GB | small, greater quality loss |
+| [SeaLLM-7B-v2.5-Q4_K_M.gguf](https://huggingface.co/tensorblock/SeaLLM-7B-v2.5-GGUF/tree/main/SeaLLM-7B-v2.5-Q4_K_M.gguf) | Q4_K_M | 4.964 GB | medium, balanced quality - recommended |
+| [SeaLLM-7B-v2.5-Q5_0.gguf](https://huggingface.co/tensorblock/SeaLLM-7B-v2.5-GGUF/tree/main/SeaLLM-7B-v2.5-Q5_0.gguf) | Q5_0 | 5.570 GB | legacy; medium, balanced quality - prefer using Q4_K_M |
+| [SeaLLM-7B-v2.5-Q5_K_S.gguf](https://huggingface.co/tensorblock/SeaLLM-7B-v2.5-GGUF/tree/main/SeaLLM-7B-v2.5-Q5_K_S.gguf) | Q5_K_S | 5.570 GB | large, low quality loss - recommended |
+| [SeaLLM-7B-v2.5-Q5_K_M.gguf](https://huggingface.co/tensorblock/SeaLLM-7B-v2.5-GGUF/tree/main/SeaLLM-7B-v2.5-Q5_K_M.gguf) | Q5_K_M | 5.723 GB | large, very low quality loss - recommended |
+| [SeaLLM-7B-v2.5-Q6_K.gguf](https://huggingface.co/tensorblock/SeaLLM-7B-v2.5-GGUF/tree/main/SeaLLM-7B-v2.5-Q6_K.gguf) | Q6_K | 6.529 GB | very large, extremely low quality loss |
+| [SeaLLM-7B-v2.5-Q8_0.gguf](https://huggingface.co/tensorblock/SeaLLM-7B-v2.5-GGUF/tree/main/SeaLLM-7B-v2.5-Q8_0.gguf) | Q8_0 | 8.454 GB | very large, extremely low quality loss - not recommended |
+
+
+## Downloading instruction
+
+### Command line
+
+Firstly, install Huggingface Client
+
+```shell
+pip install -U "huggingface_hub[cli]"
+```
+
+Then, downoad the individual model file the a local directory
+
+```shell
+huggingface-cli download tensorblock/SeaLLM-7B-v2.5-GGUF --include "SeaLLM-7B-v2.5-Q2_K.gguf" --local-dir MY_LOCAL_DIR
+```
+
+If you wanna download multiple model files with a pattern (e.g., `*Q4_K*gguf`), you can try:
+
+```shell
+huggingface-cli download tensorblock/SeaLLM-7B-v2.5-GGUF --local-dir MY_LOCAL_DIR --local-dir-use-symlinks False --include='*Q4_K*gguf'
+```

SeaLLM-7B-v2.5-Q2_K.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e83bed0c07ff212db709dbb294ff70146b3f3c1bf76d343150639e44c14913a5
+size 3481447808

SeaLLM-7B-v2.5-Q3_K_L.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:01cc1a5ad6c9a99452ab1d303323af52163e99a8ac85a906132dfa0a79f43eb3
+size 4709068160

SeaLLM-7B-v2.5-Q3_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:10b1c1e31412dca7cad11538781cb6e84a6823191abe45391da3b065bb9ff44d
+size 4369329536

SeaLLM-7B-v2.5-Q3_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:70f1e64857f9fb5d3c583a046779db1d35c7d9efa37aae4c3a849f17e04651d9
+size 3982404992

SeaLLM-7B-v2.5-Q4_0.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:10cf79d2440c40fbaad081f469457ece8edd37a0a71a8014b6b3d1170fab98a3
+size 5011844480

SeaLLM-7B-v2.5-Q4_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:1dca2fafa8db76aa2a9e47c153aa2f3266fef1184ebb981f4b6bcfb98da3160a
+size 5329759616

SeaLLM-7B-v2.5-Q4_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d0d4e3548a41e629d8740ab4fd715fe9ca25afc136a037c5f99c21e5a5376540
+size 5046447488

SeaLLM-7B-v2.5-Q5_0.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:3db2e73232347cdc2dbeb9f07d74385e1cfad2f65393199996c694737f0a5656
+size 5980728704

SeaLLM-7B-v2.5-Q5_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:a95f79b7cb4d4560bd77bf8946d090aeea498ee1490d79c99cccb525a5c36b87
+size 6144503168

SeaLLM-7B-v2.5-Q5_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b1d66fb32f958bd8fa491634bfe09131baa289768ccc9308ab674fa8a8728526
+size 5980728704

SeaLLM-7B-v2.5-Q6_K.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:fba11ae2c1959f4f6f0a78a7e7fa3988700253a476c9dd65226bd4ff696d0ff2
+size 7010168192

SeaLLM-7B-v2.5-Q8_0.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f82a9da1caf917073eae3e8a7cd3dc76e539229d3b4b79651c9c4b9fd9996c32
+size 9077845376