Upload folder using huggingface_hub
Browse files- Qwen2.5-Math-1.5B-Q2_K.gguf +2 -2
- Qwen2.5-Math-1.5B-Q3_K_L.gguf +2 -2
- Qwen2.5-Math-1.5B-Q3_K_M.gguf +2 -2
- Qwen2.5-Math-1.5B-Q3_K_S.gguf +2 -2
- Qwen2.5-Math-1.5B-Q4_0.gguf +2 -2
- Qwen2.5-Math-1.5B-Q4_K_M.gguf +2 -2
- Qwen2.5-Math-1.5B-Q4_K_S.gguf +2 -2
- Qwen2.5-Math-1.5B-Q5_0.gguf +2 -2
- Qwen2.5-Math-1.5B-Q5_K_M.gguf +2 -2
- Qwen2.5-Math-1.5B-Q5_K_S.gguf +2 -2
- Qwen2.5-Math-1.5B-Q6_K.gguf +2 -2
- Qwen2.5-Math-1.5B-Q8_0.gguf +2 -2
- README.md +18 -24
Qwen2.5-Math-1.5B-Q2_K.gguf
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:03a368066a991a966daf21543d44c5ba69889445fd4b06216d079bdf2a022269
|
| 3 |
+
size 676302240
|
Qwen2.5-Math-1.5B-Q3_K_L.gguf
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:290ceb2985d2bb127b6e929004a05f1527b23d6116435ad3a2f1e96ad028e859
|
| 3 |
+
size 880160160
|
Qwen2.5-Math-1.5B-Q3_K_M.gguf
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:4833ee30201fbc035ce11ca5690c8d830ddc85b92abb67ae29160e353fcbcc3f
|
| 3 |
+
size 824176032
|
Qwen2.5-Math-1.5B-Q3_K_S.gguf
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:e6f807807a6bce0148c519751f6c86bd97f3da76cd7f6fe9f87275bf94da21ce
|
| 3 |
+
size 760941984
|
Qwen2.5-Math-1.5B-Q4_0.gguf
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:71feda328360da5de155ff9981840d5744e0d09e2724d173561805d58b747538
|
| 3 |
+
size 934952352
|
Qwen2.5-Math-1.5B-Q4_K_M.gguf
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:20960373234a261d5c46bff4385f5b4f8b498868f3ce28d9aba951593861bace
|
| 3 |
+
size 986045856
|
Qwen2.5-Math-1.5B-Q4_K_S.gguf
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:6dffc2e1f64a90af8c583e1aac10e19f2db9251f9143bbea7a2fdbd65389d0c3
|
| 3 |
+
size 940309920
|
Qwen2.5-Math-1.5B-Q5_0.gguf
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:90f81da5c0196e91d57f8210a5ee5a47fd630124f1f7777435faca281c1cb0b7
|
| 3 |
+
size 1098726816
|
Qwen2.5-Math-1.5B-Q5_K_M.gguf
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:035631838c6aea2af60860254fb8388700f8b3bc9a5f14e175a459ad188e1a8a
|
| 3 |
+
size 1125047712
|
Qwen2.5-Math-1.5B-Q5_K_S.gguf
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:a045c50fa1b63f1ac52731a1ce50aa502f3d8552d1a7d3da81f42f10aeb7f650
|
| 3 |
+
size 1098726816
|
Qwen2.5-Math-1.5B-Q6_K.gguf
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:0fee714690fe47de84303ccc0c3495e2d8b44fd55c1cab0d4283fe9f6be7d9e9
|
| 3 |
+
size 1272737184
|
Qwen2.5-Math-1.5B-Q8_0.gguf
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:42f7ec19e34b47f74cb9f5e62a6bf71dedaf6afa1c8b5a6a825314ffeccf6e5b
|
| 3 |
+
size 1646570400
|
README.md
CHANGED
|
@@ -1,12 +1,12 @@
|
|
| 1 |
---
|
| 2 |
-
base_model:
|
| 3 |
language:
|
| 4 |
- en
|
| 5 |
-
pipeline_tag: text-generation
|
| 6 |
library_name: transformers
|
| 7 |
license: apache-2.0
|
| 8 |
-
license_link: https://huggingface.co/Qwen/Qwen2.5-Math-1.5B/blob/main/LICENSE
|
| 9 |
tags:
|
|
|
|
|
|
|
| 10 |
- TensorBlock
|
| 11 |
- GGUF
|
| 12 |
---
|
|
@@ -22,13 +22,12 @@ tags:
|
|
| 22 |
</div>
|
| 23 |
</div>
|
| 24 |
|
| 25 |
-
##
|
| 26 |
|
| 27 |
-
This repo contains GGUF format model files for [
|
| 28 |
|
| 29 |
The files were quantized using machines provided by [TensorBlock](https://tensorblock.co/), and they are compatible with llama.cpp as of [commit b4011](https://github.com/ggerganov/llama.cpp/commit/a6744e43e80f4be6398fc7733a01642c846dce1d).
|
| 30 |
|
| 31 |
-
|
| 32 |
<div style="text-align: left; margin: 20px 0;">
|
| 33 |
<a href="https://tensorblock.co/waitlist/client" style="display: inline-block; padding: 10px 20px; background-color: #007bff; color: white; text-decoration: none; border-radius: 5px; font-weight: bold;">
|
| 34 |
Run them on the TensorBlock client using your local machine ↗
|
|
@@ -37,31 +36,26 @@ The files were quantized using machines provided by [TensorBlock](https://tensor
|
|
| 37 |
|
| 38 |
## Prompt template
|
| 39 |
|
| 40 |
-
|
| 41 |
```
|
| 42 |
-
|
| 43 |
-
{system_prompt}<|im_end|>
|
| 44 |
-
<|im_start|>user
|
| 45 |
-
{prompt}<|im_end|>
|
| 46 |
-
<|im_start|>assistant
|
| 47 |
```
|
| 48 |
|
| 49 |
## Model file specification
|
| 50 |
|
| 51 |
| Filename | Quant type | File Size | Description |
|
| 52 |
| -------- | ---------- | --------- | ----------- |
|
| 53 |
-
| [Qwen2.5-Math-1.5B-Q2_K.gguf](https://huggingface.co/tensorblock/Qwen2.5-Math-1.5B-GGUF/blob/main/Qwen2.5-Math-1.5B-Q2_K.gguf) | Q2_K | 0.
|
| 54 |
-
| [Qwen2.5-Math-1.5B-Q3_K_S.gguf](https://huggingface.co/tensorblock/Qwen2.5-Math-1.5B-GGUF/blob/main/Qwen2.5-Math-1.5B-Q3_K_S.gguf) | Q3_K_S | 0.
|
| 55 |
-
| [Qwen2.5-Math-1.5B-Q3_K_M.gguf](https://huggingface.co/tensorblock/Qwen2.5-Math-1.5B-GGUF/blob/main/Qwen2.5-Math-1.5B-Q3_K_M.gguf) | Q3_K_M | 0.
|
| 56 |
-
| [Qwen2.5-Math-1.5B-Q3_K_L.gguf](https://huggingface.co/tensorblock/Qwen2.5-Math-1.5B-GGUF/blob/main/Qwen2.5-Math-1.5B-Q3_K_L.gguf) | Q3_K_L | 0.
|
| 57 |
-
| [Qwen2.5-Math-1.5B-Q4_0.gguf](https://huggingface.co/tensorblock/Qwen2.5-Math-1.5B-GGUF/blob/main/Qwen2.5-Math-1.5B-Q4_0.gguf) | Q4_0 | 0.
|
| 58 |
-
| [Qwen2.5-Math-1.5B-Q4_K_S.gguf](https://huggingface.co/tensorblock/Qwen2.5-Math-1.5B-GGUF/blob/main/Qwen2.5-Math-1.5B-Q4_K_S.gguf) | Q4_K_S | 0.
|
| 59 |
-
| [Qwen2.5-Math-1.5B-Q4_K_M.gguf](https://huggingface.co/tensorblock/Qwen2.5-Math-1.5B-GGUF/blob/main/Qwen2.5-Math-1.5B-Q4_K_M.gguf) | Q4_K_M | 0.
|
| 60 |
-
| [Qwen2.5-Math-1.5B-Q5_0.gguf](https://huggingface.co/tensorblock/Qwen2.5-Math-1.5B-GGUF/blob/main/Qwen2.5-Math-1.5B-Q5_0.gguf) | Q5_0 | 1.
|
| 61 |
-
| [Qwen2.5-Math-1.5B-Q5_K_S.gguf](https://huggingface.co/tensorblock/Qwen2.5-Math-1.5B-GGUF/blob/main/Qwen2.5-Math-1.5B-Q5_K_S.gguf) | Q5_K_S | 1.
|
| 62 |
-
| [Qwen2.5-Math-1.5B-Q5_K_M.gguf](https://huggingface.co/tensorblock/Qwen2.5-Math-1.5B-GGUF/blob/main/Qwen2.5-Math-1.5B-Q5_K_M.gguf) | Q5_K_M | 1.
|
| 63 |
-
| [Qwen2.5-Math-1.5B-Q6_K.gguf](https://huggingface.co/tensorblock/Qwen2.5-Math-1.5B-GGUF/blob/main/Qwen2.5-Math-1.5B-Q6_K.gguf) | Q6_K | 1.
|
| 64 |
-
| [Qwen2.5-Math-1.5B-Q8_0.gguf](https://huggingface.co/tensorblock/Qwen2.5-Math-1.5B-GGUF/blob/main/Qwen2.5-Math-1.5B-Q8_0.gguf) | Q8_0 | 1.
|
| 65 |
|
| 66 |
|
| 67 |
## Downloading instruction
|
|
|
|
| 1 |
---
|
| 2 |
+
base_model: unsloth/Qwen2.5-Math-1.5B
|
| 3 |
language:
|
| 4 |
- en
|
|
|
|
| 5 |
library_name: transformers
|
| 6 |
license: apache-2.0
|
|
|
|
| 7 |
tags:
|
| 8 |
+
- unsloth
|
| 9 |
+
- transformers
|
| 10 |
- TensorBlock
|
| 11 |
- GGUF
|
| 12 |
---
|
|
|
|
| 22 |
</div>
|
| 23 |
</div>
|
| 24 |
|
| 25 |
+
## unsloth/Qwen2.5-Math-1.5B - GGUF
|
| 26 |
|
| 27 |
+
This repo contains GGUF format model files for [unsloth/Qwen2.5-Math-1.5B](https://huggingface.co/unsloth/Qwen2.5-Math-1.5B).
|
| 28 |
|
| 29 |
The files were quantized using machines provided by [TensorBlock](https://tensorblock.co/), and they are compatible with llama.cpp as of [commit b4011](https://github.com/ggerganov/llama.cpp/commit/a6744e43e80f4be6398fc7733a01642c846dce1d).
|
| 30 |
|
|
|
|
| 31 |
<div style="text-align: left; margin: 20px 0;">
|
| 32 |
<a href="https://tensorblock.co/waitlist/client" style="display: inline-block; padding: 10px 20px; background-color: #007bff; color: white; text-decoration: none; border-radius: 5px; font-weight: bold;">
|
| 33 |
Run them on the TensorBlock client using your local machine ↗
|
|
|
|
| 36 |
|
| 37 |
## Prompt template
|
| 38 |
|
|
|
|
| 39 |
```
|
| 40 |
+
|
|
|
|
|
|
|
|
|
|
|
|
|
| 41 |
```
|
| 42 |
|
| 43 |
## Model file specification
|
| 44 |
|
| 45 |
| Filename | Quant type | File Size | Description |
|
| 46 |
| -------- | ---------- | --------- | ----------- |
|
| 47 |
+
| [Qwen2.5-Math-1.5B-Q2_K.gguf](https://huggingface.co/tensorblock/Qwen2.5-Math-1.5B-GGUF/blob/main/Qwen2.5-Math-1.5B-Q2_K.gguf) | Q2_K | 0.676 GB | smallest, significant quality loss - not recommended for most purposes |
|
| 48 |
+
| [Qwen2.5-Math-1.5B-Q3_K_S.gguf](https://huggingface.co/tensorblock/Qwen2.5-Math-1.5B-GGUF/blob/main/Qwen2.5-Math-1.5B-Q3_K_S.gguf) | Q3_K_S | 0.761 GB | very small, high quality loss |
|
| 49 |
+
| [Qwen2.5-Math-1.5B-Q3_K_M.gguf](https://huggingface.co/tensorblock/Qwen2.5-Math-1.5B-GGUF/blob/main/Qwen2.5-Math-1.5B-Q3_K_M.gguf) | Q3_K_M | 0.824 GB | very small, high quality loss |
|
| 50 |
+
| [Qwen2.5-Math-1.5B-Q3_K_L.gguf](https://huggingface.co/tensorblock/Qwen2.5-Math-1.5B-GGUF/blob/main/Qwen2.5-Math-1.5B-Q3_K_L.gguf) | Q3_K_L | 0.880 GB | small, substantial quality loss |
|
| 51 |
+
| [Qwen2.5-Math-1.5B-Q4_0.gguf](https://huggingface.co/tensorblock/Qwen2.5-Math-1.5B-GGUF/blob/main/Qwen2.5-Math-1.5B-Q4_0.gguf) | Q4_0 | 0.935 GB | legacy; small, very high quality loss - prefer using Q3_K_M |
|
| 52 |
+
| [Qwen2.5-Math-1.5B-Q4_K_S.gguf](https://huggingface.co/tensorblock/Qwen2.5-Math-1.5B-GGUF/blob/main/Qwen2.5-Math-1.5B-Q4_K_S.gguf) | Q4_K_S | 0.940 GB | small, greater quality loss |
|
| 53 |
+
| [Qwen2.5-Math-1.5B-Q4_K_M.gguf](https://huggingface.co/tensorblock/Qwen2.5-Math-1.5B-GGUF/blob/main/Qwen2.5-Math-1.5B-Q4_K_M.gguf) | Q4_K_M | 0.986 GB | medium, balanced quality - recommended |
|
| 54 |
+
| [Qwen2.5-Math-1.5B-Q5_0.gguf](https://huggingface.co/tensorblock/Qwen2.5-Math-1.5B-GGUF/blob/main/Qwen2.5-Math-1.5B-Q5_0.gguf) | Q5_0 | 1.099 GB | legacy; medium, balanced quality - prefer using Q4_K_M |
|
| 55 |
+
| [Qwen2.5-Math-1.5B-Q5_K_S.gguf](https://huggingface.co/tensorblock/Qwen2.5-Math-1.5B-GGUF/blob/main/Qwen2.5-Math-1.5B-Q5_K_S.gguf) | Q5_K_S | 1.099 GB | large, low quality loss - recommended |
|
| 56 |
+
| [Qwen2.5-Math-1.5B-Q5_K_M.gguf](https://huggingface.co/tensorblock/Qwen2.5-Math-1.5B-GGUF/blob/main/Qwen2.5-Math-1.5B-Q5_K_M.gguf) | Q5_K_M | 1.125 GB | large, very low quality loss - recommended |
|
| 57 |
+
| [Qwen2.5-Math-1.5B-Q6_K.gguf](https://huggingface.co/tensorblock/Qwen2.5-Math-1.5B-GGUF/blob/main/Qwen2.5-Math-1.5B-Q6_K.gguf) | Q6_K | 1.273 GB | very large, extremely low quality loss |
|
| 58 |
+
| [Qwen2.5-Math-1.5B-Q8_0.gguf](https://huggingface.co/tensorblock/Qwen2.5-Math-1.5B-GGUF/blob/main/Qwen2.5-Math-1.5B-Q8_0.gguf) | Q8_0 | 1.647 GB | very large, extremely low quality loss - not recommended |
|
| 59 |
|
| 60 |
|
| 61 |
## Downloading instruction
|