Hugging Face's logo

tensorblock
/
Qwen2.5-Math-7B-GGUF

Transformers
GGUF
English
unsloth
TensorBlock
GGUF
Model card Files
xet
Community
morriszms commited on
Commit
b0d796e
·
verified ·
1 Parent(s): cf0ae78

Upload folder using huggingface_hub

Browse files
Files changed (13) hide show
  1. Qwen2.5-Math-7B-Q2_K.gguf +2 -2
  2. Qwen2.5-Math-7B-Q3_K_L.gguf +2 -2
  3. Qwen2.5-Math-7B-Q3_K_M.gguf +2 -2
  4. Qwen2.5-Math-7B-Q3_K_S.gguf +2 -2
  5. Qwen2.5-Math-7B-Q4_0.gguf +2 -2
  6. Qwen2.5-Math-7B-Q4_K_M.gguf +2 -2
  7. Qwen2.5-Math-7B-Q4_K_S.gguf +2 -2
  8. Qwen2.5-Math-7B-Q5_0.gguf +2 -2
  9. Qwen2.5-Math-7B-Q5_K_M.gguf +2 -2
  10. Qwen2.5-Math-7B-Q5_K_S.gguf +2 -2
  11. Qwen2.5-Math-7B-Q6_K.gguf +2 -2
  12. Qwen2.5-Math-7B-Q8_0.gguf +2 -2
  13. README.md +19 -25
Qwen2.5-Math-7B-Q2_K.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:a945ba6a3597791ccdda55c60cd0d32b4658d4939eda7be048940541bee37a1d
3
- size 3015940480
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0f15455c820b273562415f7bb064f268aec2dc6494cc5e5e571e182ea36ee898
3
+ size 3015937856
Qwen2.5-Math-7B-Q3_K_L.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:4c9da34bae0a1d23b6d69fb38aefbda0d87b7bfbfb1c317613e5c094868dd2b3
3
- size 4088459648
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1992f29d8330664326e1917990810502434e9fc5c4292a270a5771bae6522dde
3
+ size 4088457024
Qwen2.5-Math-7B-Q3_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:033607937d6abf8e3aa54af99ec9af54f58fd11152c31b81cf2b1054741fbb79
3
- size 3808391552
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:547c105bc0a1083cd6758bcc8166e10e3226c4192c783d805efb69e4e0488e2f
3
+ size 3808388928
Qwen2.5-Math-7B-Q3_K_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:328129e9edccb36ad3086c3a813b09ebf88dd2430ba72b3e0825e9ad971e7b69
3
- size 3492368768
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7d7f1525e6957097869e8da0f5cbb7ae320afc8c2d0e8d33eedbd257730a2d63
3
+ size 3492366144
Qwen2.5-Math-7B-Q4_0.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:74c201bf42404bdc4554ca967da2bf6c2e4bd5c017bbb9389b427c43ee610868
3
- size 4431391104
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1cbe56304375c70d81721b60cd6b3dbd30de2fd9c64e643ebcddb7cf47f5472b
3
+ size 4431388480
Qwen2.5-Math-7B-Q4_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:1ca2e96b18fb58225123abc30bc5812d45dcd7a696690c248cfd92f3e214ff1d
3
- size 4683073920
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ce2124a5c41ebad405be44acb89002f9b3d4b03e40e36646729cd56a629a0161
3
+ size 4683071296
Qwen2.5-Math-7B-Q4_K_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:fcaa459c21046c64bb452687117fe47179eac616440ddcca3bf5d9509d912b3c
3
- size 4457769344
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:07755ffe6fc8ec07c33f80f71f160a021f99a6e1478ceaa34561607de0339b52
3
+ size 4457766720
Qwen2.5-Math-7B-Q5_0.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:f93f7879311ea034414fb87053edbd6507f34afa3c4ac9a9309812937cbe5b23
3
- size 5315176832
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:528ee49323dd5f11cb098a865135348fb91f18b5325f750d8c349ab5d87cfd85
3
+ size 5315174208
Qwen2.5-Math-7B-Q5_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:ca6d82364245a8147e5ed4cbbd8b0c6cd55cc3edcc5d94a8b7a07470224b1388
3
- size 5444831616
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:58e6c275ca7ca3e7be1bb152cb92bda53c051bc6129faf55f91e1d50828c1558
3
+ size 5444828992
Qwen2.5-Math-7B-Q5_K_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:fd66b373a1b7533147ccdeba3ceb1fed9b283065345a12d861eedb11fee3b4d5
3
- size 5315176832
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4ebed1ac0a09133c8b8e102e9c41f87957c0f2698c54e17599513230c67faebc
3
+ size 5315174208
Qwen2.5-Math-7B-Q6_K.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:dfa1e38dfad90d591437aada03acc49ead73ad90cf1392a17b7d8e011f190598
3
- size 6254199168
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:27fade42d46bc1ea677007af88b38d0570dd91607411b9e53332fd1cc076d700
3
+ size 6254196544
Qwen2.5-Math-7B-Q8_0.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:2e7901dd82684ed5255c5cd7f9ba321191fc43330210f738b95e1d3ea4c5890e
3
- size 8098525568
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bd680cef5288e18ba469d22e749ad387734315fa60a8ebabba8b8e98c7aa7782
3
+ size 8098522944
README.md CHANGED
@@ -1,12 +1,12 @@
1
  ---
2
- base_model: Qwen/Qwen2.5-Math-7B
3
  language:
4
  - en
5
- pipeline_tag: text-generation
6
  library_name: transformers
7
  license: apache-2.0
8
- license_link: https://huggingface.co/Qwen/Qwen2.5-Math-7B/blob/main/LICENSE
9
  tags:
 
 
10
  - TensorBlock
11
  - GGUF
12
  ---
@@ -22,12 +22,11 @@ tags:
22
  </div>
23
  </div>
24
 
25
- ## Qwen/Qwen2.5-Math-7B - GGUF
26
 
27
- This repo contains GGUF format model files for [Qwen/Qwen2.5-Math-7B](https://huggingface.co/Qwen/Qwen2.5-Math-7B).
28
-
29
- The files were quantized using machines provided by [TensorBlock](https://tensorblock.co/), and they are compatible with llama.cpp as of [commit b4011](https://github.com/ggerganov/llama.cpp/commit/a6744e43e80f4be6398fc7733a01642c846dce1d).
30
 
 
31
 
32
  <div style="text-align: left; margin: 20px 0;">
33
  <a href="https://tensorblock.co/waitlist/client" style="display: inline-block; padding: 10px 20px; background-color: #007bff; color: white; text-decoration: none; border-radius: 5px; font-weight: bold;">
@@ -37,31 +36,26 @@ The files were quantized using machines provided by [TensorBlock](https://tensor
37
 
38
  ## Prompt template
39
 
40
-
41
  ```
42
- <|im_start|>system
43
- {system_prompt}<|im_end|>
44
- <|im_start|>user
45
- {prompt}<|im_end|>
46
- <|im_start|>assistant
47
  ```
48
 
49
  ## Model file specification
50
 
51
  | Filename | Quant type | File Size | Description |
52
  | -------- | ---------- | --------- | ----------- |
53
- | [Qwen2.5-Math-7B-Q2_K.gguf](https://huggingface.co/tensorblock/Qwen2.5-Math-7B-GGUF/blob/main/Qwen2.5-Math-7B-Q2_K.gguf) | Q2_K | 2.809 GB | smallest, significant quality loss - not recommended for most purposes |
54
- | [Qwen2.5-Math-7B-Q3_K_S.gguf](https://huggingface.co/tensorblock/Qwen2.5-Math-7B-GGUF/blob/main/Qwen2.5-Math-7B-Q3_K_S.gguf) | Q3_K_S | 3.253 GB | very small, high quality loss |
55
- | [Qwen2.5-Math-7B-Q3_K_M.gguf](https://huggingface.co/tensorblock/Qwen2.5-Math-7B-GGUF/blob/main/Qwen2.5-Math-7B-Q3_K_M.gguf) | Q3_K_M | 3.547 GB | very small, high quality loss |
56
- | [Qwen2.5-Math-7B-Q3_K_L.gguf](https://huggingface.co/tensorblock/Qwen2.5-Math-7B-GGUF/blob/main/Qwen2.5-Math-7B-Q3_K_L.gguf) | Q3_K_L | 3.808 GB | small, substantial quality loss |
57
- | [Qwen2.5-Math-7B-Q4_0.gguf](https://huggingface.co/tensorblock/Qwen2.5-Math-7B-GGUF/blob/main/Qwen2.5-Math-7B-Q4_0.gguf) | Q4_0 | 4.127 GB | legacy; small, very high quality loss - prefer using Q3_K_M |
58
- | [Qwen2.5-Math-7B-Q4_K_S.gguf](https://huggingface.co/tensorblock/Qwen2.5-Math-7B-GGUF/blob/main/Qwen2.5-Math-7B-Q4_K_S.gguf) | Q4_K_S | 4.152 GB | small, greater quality loss |
59
- | [Qwen2.5-Math-7B-Q4_K_M.gguf](https://huggingface.co/tensorblock/Qwen2.5-Math-7B-GGUF/blob/main/Qwen2.5-Math-7B-Q4_K_M.gguf) | Q4_K_M | 4.361 GB | medium, balanced quality - recommended |
60
- | [Qwen2.5-Math-7B-Q5_0.gguf](https://huggingface.co/tensorblock/Qwen2.5-Math-7B-GGUF/blob/main/Qwen2.5-Math-7B-Q5_0.gguf) | Q5_0 | 4.950 GB | legacy; medium, balanced quality - prefer using Q4_K_M |
61
- | [Qwen2.5-Math-7B-Q5_K_S.gguf](https://huggingface.co/tensorblock/Qwen2.5-Math-7B-GGUF/blob/main/Qwen2.5-Math-7B-Q5_K_S.gguf) | Q5_K_S | 4.950 GB | large, low quality loss - recommended |
62
- | [Qwen2.5-Math-7B-Q5_K_M.gguf](https://huggingface.co/tensorblock/Qwen2.5-Math-7B-GGUF/blob/main/Qwen2.5-Math-7B-Q5_K_M.gguf) | Q5_K_M | 5.071 GB | large, very low quality loss - recommended |
63
- | [Qwen2.5-Math-7B-Q6_K.gguf](https://huggingface.co/tensorblock/Qwen2.5-Math-7B-GGUF/blob/main/Qwen2.5-Math-7B-Q6_K.gguf) | Q6_K | 5.825 GB | very large, extremely low quality loss |
64
- | [Qwen2.5-Math-7B-Q8_0.gguf](https://huggingface.co/tensorblock/Qwen2.5-Math-7B-GGUF/blob/main/Qwen2.5-Math-7B-Q8_0.gguf) | Q8_0 | 7.542 GB | very large, extremely low quality loss - not recommended |
65
 
66
 
67
  ## Downloading instruction
 
1
  ---
2
+ base_model: unsloth/Qwen2.5-Math-7B
3
  language:
4
  - en
 
5
  library_name: transformers
6
  license: apache-2.0
 
7
  tags:
8
+ - unsloth
9
+ - transformers
10
  - TensorBlock
11
  - GGUF
12
  ---
 
22
  </div>
23
  </div>
24
 
25
+ ## unsloth/Qwen2.5-Math-7B - GGUF
26
 
27
+ This repo contains GGUF format model files for [unsloth/Qwen2.5-Math-7B](https://huggingface.co/unsloth/Qwen2.5-Math-7B).
 
 
28
 
29
+ The files were quantized using machines provided by [TensorBlock](https://tensorblock.co/), and they are compatible with llama.cpp as of [commit b4242](https://github.com/ggerganov/llama.cpp/commit/a6744e43e80f4be6398fc7733a01642c846dce1d).
30
 
31
  <div style="text-align: left; margin: 20px 0;">
32
  <a href="https://tensorblock.co/waitlist/client" style="display: inline-block; padding: 10px 20px; background-color: #007bff; color: white; text-decoration: none; border-radius: 5px; font-weight: bold;">
 
36
 
37
  ## Prompt template
38
 
 
39
  ```
40
+
 
 
 
 
41
  ```
42
 
43
  ## Model file specification
44
 
45
  | Filename | Quant type | File Size | Description |
46
  | -------- | ---------- | --------- | ----------- |
47
+ | [Qwen2.5-Math-7B-Q2_K.gguf](https://huggingface.co/tensorblock/Qwen2.5-Math-7B-GGUF/blob/main/Qwen2.5-Math-7B-Q2_K.gguf) | Q2_K | 3.016 GB | smallest, significant quality loss - not recommended for most purposes |
48
+ | [Qwen2.5-Math-7B-Q3_K_S.gguf](https://huggingface.co/tensorblock/Qwen2.5-Math-7B-GGUF/blob/main/Qwen2.5-Math-7B-Q3_K_S.gguf) | Q3_K_S | 3.492 GB | very small, high quality loss |
49
+ | [Qwen2.5-Math-7B-Q3_K_M.gguf](https://huggingface.co/tensorblock/Qwen2.5-Math-7B-GGUF/blob/main/Qwen2.5-Math-7B-Q3_K_M.gguf) | Q3_K_M | 3.808 GB | very small, high quality loss |
50
+ | [Qwen2.5-Math-7B-Q3_K_L.gguf](https://huggingface.co/tensorblock/Qwen2.5-Math-7B-GGUF/blob/main/Qwen2.5-Math-7B-Q3_K_L.gguf) | Q3_K_L | 4.088 GB | small, substantial quality loss |
51
+ | [Qwen2.5-Math-7B-Q4_0.gguf](https://huggingface.co/tensorblock/Qwen2.5-Math-7B-GGUF/blob/main/Qwen2.5-Math-7B-Q4_0.gguf) | Q4_0 | 4.431 GB | legacy; small, very high quality loss - prefer using Q3_K_M |
52
+ | [Qwen2.5-Math-7B-Q4_K_S.gguf](https://huggingface.co/tensorblock/Qwen2.5-Math-7B-GGUF/blob/main/Qwen2.5-Math-7B-Q4_K_S.gguf) | Q4_K_S | 4.458 GB | small, greater quality loss |
53
+ | [Qwen2.5-Math-7B-Q4_K_M.gguf](https://huggingface.co/tensorblock/Qwen2.5-Math-7B-GGUF/blob/main/Qwen2.5-Math-7B-Q4_K_M.gguf) | Q4_K_M | 4.683 GB | medium, balanced quality - recommended |
54
+ | [Qwen2.5-Math-7B-Q5_0.gguf](https://huggingface.co/tensorblock/Qwen2.5-Math-7B-GGUF/blob/main/Qwen2.5-Math-7B-Q5_0.gguf) | Q5_0 | 5.315 GB | legacy; medium, balanced quality - prefer using Q4_K_M |
55
+ | [Qwen2.5-Math-7B-Q5_K_S.gguf](https://huggingface.co/tensorblock/Qwen2.5-Math-7B-GGUF/blob/main/Qwen2.5-Math-7B-Q5_K_S.gguf) | Q5_K_S | 5.315 GB | large, low quality loss - recommended |
56
+ | [Qwen2.5-Math-7B-Q5_K_M.gguf](https://huggingface.co/tensorblock/Qwen2.5-Math-7B-GGUF/blob/main/Qwen2.5-Math-7B-Q5_K_M.gguf) | Q5_K_M | 5.445 GB | large, very low quality loss - recommended |
57
+ | [Qwen2.5-Math-7B-Q6_K.gguf](https://huggingface.co/tensorblock/Qwen2.5-Math-7B-GGUF/blob/main/Qwen2.5-Math-7B-Q6_K.gguf) | Q6_K | 6.254 GB | very large, extremely low quality loss |
58
+ | [Qwen2.5-Math-7B-Q8_0.gguf](https://huggingface.co/tensorblock/Qwen2.5-Math-7B-GGUF/blob/main/Qwen2.5-Math-7B-Q8_0.gguf) | Q8_0 | 8.099 GB | very large, extremely low quality loss - not recommended |
59
 
60
 
61
  ## Downloading instruction