Upload folder using huggingface_hub
Browse files- Qwen2.5-Math-1.5B-Instruct-Q2_K.gguf +2 -2
- Qwen2.5-Math-1.5B-Instruct-Q3_K_L.gguf +2 -2
- Qwen2.5-Math-1.5B-Instruct-Q3_K_M.gguf +2 -2
- Qwen2.5-Math-1.5B-Instruct-Q3_K_S.gguf +2 -2
- Qwen2.5-Math-1.5B-Instruct-Q4_0.gguf +2 -2
- Qwen2.5-Math-1.5B-Instruct-Q4_K_M.gguf +2 -2
- Qwen2.5-Math-1.5B-Instruct-Q4_K_S.gguf +2 -2
- Qwen2.5-Math-1.5B-Instruct-Q5_0.gguf +2 -2
- Qwen2.5-Math-1.5B-Instruct-Q5_K_M.gguf +2 -2
- Qwen2.5-Math-1.5B-Instruct-Q5_K_S.gguf +2 -2
- Qwen2.5-Math-1.5B-Instruct-Q6_K.gguf +2 -2
- Qwen2.5-Math-1.5B-Instruct-Q8_0.gguf +2 -2
- README.md +19 -22
Qwen2.5-Math-1.5B-Instruct-Q2_K.gguf
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:be7afa51587500100c999f0b018e616b9b652c73be9ee23922c82b7e961d004d
|
| 3 |
+
size 676304864
|
Qwen2.5-Math-1.5B-Instruct-Q3_K_L.gguf
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:870496888f35c532e3b88408fba2df3383de4d386b516b0c080ed81230a94282
|
| 3 |
+
size 880162784
|
Qwen2.5-Math-1.5B-Instruct-Q3_K_M.gguf
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:4409492a01a8393a791cce8190e2baec892ec0f17f7542bcc79b1ef2e8737507
|
| 3 |
+
size 824178656
|
Qwen2.5-Math-1.5B-Instruct-Q3_K_S.gguf
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:5a6c976deed80919a047a37a8a031b6fa69b3488c93672c751a7051068bd4fc9
|
| 3 |
+
size 760944608
|
Qwen2.5-Math-1.5B-Instruct-Q4_0.gguf
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:4a6a9bfb025f770c0c259bf15689cd125c9b2fe9e216f6689c45616bae0e3d39
|
| 3 |
+
size 934954976
|
Qwen2.5-Math-1.5B-Instruct-Q4_K_M.gguf
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:035772b9d36910ef8389f6fc44f151ad8c24f8a153ab815df005a3420e90cec1
|
| 3 |
+
size 986048480
|
Qwen2.5-Math-1.5B-Instruct-Q4_K_S.gguf
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:1cac5fc6caf371c3489a30404a1c6fe3a6eba3d558756361c61c299d84a9e1f0
|
| 3 |
+
size 940312544
|
Qwen2.5-Math-1.5B-Instruct-Q5_0.gguf
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:c9b42c4ae2bf15b4d328ab562bafc803c3132d85eb683beb46e125a0bf513680
|
| 3 |
+
size 1098729440
|
Qwen2.5-Math-1.5B-Instruct-Q5_K_M.gguf
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:b8d6c05e0fa848564485776b02656ffe36a447bfd2d0c4a3a194e1912202fb55
|
| 3 |
+
size 1125050336
|
Qwen2.5-Math-1.5B-Instruct-Q5_K_S.gguf
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:dd64d4544295bec5453dd72f1b160f6e4912136c9b0a7c6d1b391b1e3d8f7af2
|
| 3 |
+
size 1098729440
|
Qwen2.5-Math-1.5B-Instruct-Q6_K.gguf
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:84c026f3eee86a143306524919e310d9d75d085b649f7929fbedadfec6d34a97
|
| 3 |
+
size 1272739808
|
Qwen2.5-Math-1.5B-Instruct-Q8_0.gguf
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:bec8d4ed6cb0a2931046075cecddd1bdff92a96df8797aadf3193a09e03bc300
|
| 3 |
+
size 1646573024
|
README.md
CHANGED
|
@@ -1,15 +1,14 @@
|
|
| 1 |
---
|
| 2 |
-
base_model:
|
| 3 |
language:
|
| 4 |
- en
|
| 5 |
-
|
|
|
|
| 6 |
tags:
|
| 7 |
-
-
|
|
|
|
| 8 |
- TensorBlock
|
| 9 |
- GGUF
|
| 10 |
-
library_name: transformers
|
| 11 |
-
license: apache-2.0
|
| 12 |
-
license_link: https://huggingface.co/Qwen/Qwen2.5-Math-1.5B-Instruct/blob/main/LICENSE
|
| 13 |
---
|
| 14 |
|
| 15 |
<div style="width: auto; margin-left: auto; margin-right: auto">
|
|
@@ -23,13 +22,12 @@ license_link: https://huggingface.co/Qwen/Qwen2.5-Math-1.5B-Instruct/blob/main/L
|
|
| 23 |
</div>
|
| 24 |
</div>
|
| 25 |
|
| 26 |
-
##
|
| 27 |
|
| 28 |
-
This repo contains GGUF format model files for [
|
| 29 |
|
| 30 |
The files were quantized using machines provided by [TensorBlock](https://tensorblock.co/), and they are compatible with llama.cpp as of [commit b4011](https://github.com/ggerganov/llama.cpp/commit/a6744e43e80f4be6398fc7733a01642c846dce1d).
|
| 31 |
|
| 32 |
-
|
| 33 |
<div style="text-align: left; margin: 20px 0;">
|
| 34 |
<a href="https://tensorblock.co/waitlist/client" style="display: inline-block; padding: 10px 20px; background-color: #007bff; color: white; text-decoration: none; border-radius: 5px; font-weight: bold;">
|
| 35 |
Run them on the TensorBlock client using your local machine ↗
|
|
@@ -38,7 +36,6 @@ The files were quantized using machines provided by [TensorBlock](https://tensor
|
|
| 38 |
|
| 39 |
## Prompt template
|
| 40 |
|
| 41 |
-
|
| 42 |
```
|
| 43 |
<|im_start|>system
|
| 44 |
{system_prompt}<|im_end|>
|
|
@@ -51,18 +48,18 @@ The files were quantized using machines provided by [TensorBlock](https://tensor
|
|
| 51 |
|
| 52 |
| Filename | Quant type | File Size | Description |
|
| 53 |
| -------- | ---------- | --------- | ----------- |
|
| 54 |
-
| [Qwen2.5-Math-1.5B-Instruct-Q2_K.gguf](https://huggingface.co/tensorblock/Qwen2.5-Math-1.5B-Instruct-GGUF/blob/main/Qwen2.5-Math-1.5B-Instruct-Q2_K.gguf) | Q2_K | 0.
|
| 55 |
-
| [Qwen2.5-Math-1.5B-Instruct-Q3_K_S.gguf](https://huggingface.co/tensorblock/Qwen2.5-Math-1.5B-Instruct-GGUF/blob/main/Qwen2.5-Math-1.5B-Instruct-Q3_K_S.gguf) | Q3_K_S | 0.
|
| 56 |
-
| [Qwen2.5-Math-1.5B-Instruct-Q3_K_M.gguf](https://huggingface.co/tensorblock/Qwen2.5-Math-1.5B-Instruct-GGUF/blob/main/Qwen2.5-Math-1.5B-Instruct-Q3_K_M.gguf) | Q3_K_M | 0.
|
| 57 |
-
| [Qwen2.5-Math-1.5B-Instruct-Q3_K_L.gguf](https://huggingface.co/tensorblock/Qwen2.5-Math-1.5B-Instruct-GGUF/blob/main/Qwen2.5-Math-1.5B-Instruct-Q3_K_L.gguf) | Q3_K_L | 0.
|
| 58 |
-
| [Qwen2.5-Math-1.5B-Instruct-Q4_0.gguf](https://huggingface.co/tensorblock/Qwen2.5-Math-1.5B-Instruct-GGUF/blob/main/Qwen2.5-Math-1.5B-Instruct-Q4_0.gguf) | Q4_0 | 0.
|
| 59 |
-
| [Qwen2.5-Math-1.5B-Instruct-Q4_K_S.gguf](https://huggingface.co/tensorblock/Qwen2.5-Math-1.5B-Instruct-GGUF/blob/main/Qwen2.5-Math-1.5B-Instruct-Q4_K_S.gguf) | Q4_K_S | 0.
|
| 60 |
-
| [Qwen2.5-Math-1.5B-Instruct-Q4_K_M.gguf](https://huggingface.co/tensorblock/Qwen2.5-Math-1.5B-Instruct-GGUF/blob/main/Qwen2.5-Math-1.5B-Instruct-Q4_K_M.gguf) | Q4_K_M | 0.
|
| 61 |
-
| [Qwen2.5-Math-1.5B-Instruct-Q5_0.gguf](https://huggingface.co/tensorblock/Qwen2.5-Math-1.5B-Instruct-GGUF/blob/main/Qwen2.5-Math-1.5B-Instruct-Q5_0.gguf) | Q5_0 | 1.
|
| 62 |
-
| [Qwen2.5-Math-1.5B-Instruct-Q5_K_S.gguf](https://huggingface.co/tensorblock/Qwen2.5-Math-1.5B-Instruct-GGUF/blob/main/Qwen2.5-Math-1.5B-Instruct-Q5_K_S.gguf) | Q5_K_S | 1.
|
| 63 |
-
| [Qwen2.5-Math-1.5B-Instruct-Q5_K_M.gguf](https://huggingface.co/tensorblock/Qwen2.5-Math-1.5B-Instruct-GGUF/blob/main/Qwen2.5-Math-1.5B-Instruct-Q5_K_M.gguf) | Q5_K_M | 1.
|
| 64 |
-
| [Qwen2.5-Math-1.5B-Instruct-Q6_K.gguf](https://huggingface.co/tensorblock/Qwen2.5-Math-1.5B-Instruct-GGUF/blob/main/Qwen2.5-Math-1.5B-Instruct-Q6_K.gguf) | Q6_K | 1.
|
| 65 |
-
| [Qwen2.5-Math-1.5B-Instruct-Q8_0.gguf](https://huggingface.co/tensorblock/Qwen2.5-Math-1.5B-Instruct-GGUF/blob/main/Qwen2.5-Math-1.5B-Instruct-Q8_0.gguf) | Q8_0 | 1.
|
| 66 |
|
| 67 |
|
| 68 |
## Downloading instruction
|
|
|
|
| 1 |
---
|
| 2 |
+
base_model: unsloth/Qwen2.5-Math-1.5B-Instruct
|
| 3 |
language:
|
| 4 |
- en
|
| 5 |
+
library_name: transformers
|
| 6 |
+
license: apache-2.0
|
| 7 |
tags:
|
| 8 |
+
- unsloth
|
| 9 |
+
- transformers
|
| 10 |
- TensorBlock
|
| 11 |
- GGUF
|
|
|
|
|
|
|
|
|
|
| 12 |
---
|
| 13 |
|
| 14 |
<div style="width: auto; margin-left: auto; margin-right: auto">
|
|
|
|
| 22 |
</div>
|
| 23 |
</div>
|
| 24 |
|
| 25 |
+
## unsloth/Qwen2.5-Math-1.5B-Instruct - GGUF
|
| 26 |
|
| 27 |
+
This repo contains GGUF format model files for [unsloth/Qwen2.5-Math-1.5B-Instruct](https://huggingface.co/unsloth/Qwen2.5-Math-1.5B-Instruct).
|
| 28 |
|
| 29 |
The files were quantized using machines provided by [TensorBlock](https://tensorblock.co/), and they are compatible with llama.cpp as of [commit b4011](https://github.com/ggerganov/llama.cpp/commit/a6744e43e80f4be6398fc7733a01642c846dce1d).
|
| 30 |
|
|
|
|
| 31 |
<div style="text-align: left; margin: 20px 0;">
|
| 32 |
<a href="https://tensorblock.co/waitlist/client" style="display: inline-block; padding: 10px 20px; background-color: #007bff; color: white; text-decoration: none; border-radius: 5px; font-weight: bold;">
|
| 33 |
Run them on the TensorBlock client using your local machine ↗
|
|
|
|
| 36 |
|
| 37 |
## Prompt template
|
| 38 |
|
|
|
|
| 39 |
```
|
| 40 |
<|im_start|>system
|
| 41 |
{system_prompt}<|im_end|>
|
|
|
|
| 48 |
|
| 49 |
| Filename | Quant type | File Size | Description |
|
| 50 |
| -------- | ---------- | --------- | ----------- |
|
| 51 |
+
| [Qwen2.5-Math-1.5B-Instruct-Q2_K.gguf](https://huggingface.co/tensorblock/Qwen2.5-Math-1.5B-Instruct-GGUF/blob/main/Qwen2.5-Math-1.5B-Instruct-Q2_K.gguf) | Q2_K | 0.676 GB | smallest, significant quality loss - not recommended for most purposes |
|
| 52 |
+
| [Qwen2.5-Math-1.5B-Instruct-Q3_K_S.gguf](https://huggingface.co/tensorblock/Qwen2.5-Math-1.5B-Instruct-GGUF/blob/main/Qwen2.5-Math-1.5B-Instruct-Q3_K_S.gguf) | Q3_K_S | 0.761 GB | very small, high quality loss |
|
| 53 |
+
| [Qwen2.5-Math-1.5B-Instruct-Q3_K_M.gguf](https://huggingface.co/tensorblock/Qwen2.5-Math-1.5B-Instruct-GGUF/blob/main/Qwen2.5-Math-1.5B-Instruct-Q3_K_M.gguf) | Q3_K_M | 0.824 GB | very small, high quality loss |
|
| 54 |
+
| [Qwen2.5-Math-1.5B-Instruct-Q3_K_L.gguf](https://huggingface.co/tensorblock/Qwen2.5-Math-1.5B-Instruct-GGUF/blob/main/Qwen2.5-Math-1.5B-Instruct-Q3_K_L.gguf) | Q3_K_L | 0.880 GB | small, substantial quality loss |
|
| 55 |
+
| [Qwen2.5-Math-1.5B-Instruct-Q4_0.gguf](https://huggingface.co/tensorblock/Qwen2.5-Math-1.5B-Instruct-GGUF/blob/main/Qwen2.5-Math-1.5B-Instruct-Q4_0.gguf) | Q4_0 | 0.935 GB | legacy; small, very high quality loss - prefer using Q3_K_M |
|
| 56 |
+
| [Qwen2.5-Math-1.5B-Instruct-Q4_K_S.gguf](https://huggingface.co/tensorblock/Qwen2.5-Math-1.5B-Instruct-GGUF/blob/main/Qwen2.5-Math-1.5B-Instruct-Q4_K_S.gguf) | Q4_K_S | 0.940 GB | small, greater quality loss |
|
| 57 |
+
| [Qwen2.5-Math-1.5B-Instruct-Q4_K_M.gguf](https://huggingface.co/tensorblock/Qwen2.5-Math-1.5B-Instruct-GGUF/blob/main/Qwen2.5-Math-1.5B-Instruct-Q4_K_M.gguf) | Q4_K_M | 0.986 GB | medium, balanced quality - recommended |
|
| 58 |
+
| [Qwen2.5-Math-1.5B-Instruct-Q5_0.gguf](https://huggingface.co/tensorblock/Qwen2.5-Math-1.5B-Instruct-GGUF/blob/main/Qwen2.5-Math-1.5B-Instruct-Q5_0.gguf) | Q5_0 | 1.099 GB | legacy; medium, balanced quality - prefer using Q4_K_M |
|
| 59 |
+
| [Qwen2.5-Math-1.5B-Instruct-Q5_K_S.gguf](https://huggingface.co/tensorblock/Qwen2.5-Math-1.5B-Instruct-GGUF/blob/main/Qwen2.5-Math-1.5B-Instruct-Q5_K_S.gguf) | Q5_K_S | 1.099 GB | large, low quality loss - recommended |
|
| 60 |
+
| [Qwen2.5-Math-1.5B-Instruct-Q5_K_M.gguf](https://huggingface.co/tensorblock/Qwen2.5-Math-1.5B-Instruct-GGUF/blob/main/Qwen2.5-Math-1.5B-Instruct-Q5_K_M.gguf) | Q5_K_M | 1.125 GB | large, very low quality loss - recommended |
|
| 61 |
+
| [Qwen2.5-Math-1.5B-Instruct-Q6_K.gguf](https://huggingface.co/tensorblock/Qwen2.5-Math-1.5B-Instruct-GGUF/blob/main/Qwen2.5-Math-1.5B-Instruct-Q6_K.gguf) | Q6_K | 1.273 GB | very large, extremely low quality loss |
|
| 62 |
+
| [Qwen2.5-Math-1.5B-Instruct-Q8_0.gguf](https://huggingface.co/tensorblock/Qwen2.5-Math-1.5B-Instruct-GGUF/blob/main/Qwen2.5-Math-1.5B-Instruct-Q8_0.gguf) | Q8_0 | 1.647 GB | very large, extremely low quality loss - not recommended |
|
| 63 |
|
| 64 |
|
| 65 |
## Downloading instruction
|