morriszms commited on
Commit
07de4ce
·
verified ·
1 Parent(s): 8bc6082

Upload folder using huggingface_hub

Browse files
Qwen2.5-Math-1.5B-Q2_K.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:07a148a13eba770ae7cde8bce8252dd17a34a4729d9b6d736f55a2f07c45f309
3
- size 676304832
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:03a368066a991a966daf21543d44c5ba69889445fd4b06216d079bdf2a022269
3
+ size 676302240
Qwen2.5-Math-1.5B-Q3_K_L.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:66d1c752c6d12d521067e214d08b461d71b633e17be5c74859cdcb3e5c39d6f7
3
- size 880162752
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:290ceb2985d2bb127b6e929004a05f1527b23d6116435ad3a2f1e96ad028e859
3
+ size 880160160
Qwen2.5-Math-1.5B-Q3_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:221ddd64cd0fc8ddb535a56a76f9cc26b9daea8adffefa7a85bca98186bafd4f
3
- size 824178624
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4833ee30201fbc035ce11ca5690c8d830ddc85b92abb67ae29160e353fcbcc3f
3
+ size 824176032
Qwen2.5-Math-1.5B-Q3_K_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:6385b820114e410f6f3960b8e10a8039699e9571d35a0360e1a7135e145e7444
3
- size 760944576
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e6f807807a6bce0148c519751f6c86bd97f3da76cd7f6fe9f87275bf94da21ce
3
+ size 760941984
Qwen2.5-Math-1.5B-Q4_0.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:a1d86547384ebe08afe5b9632aaff2829f85f79fde6aeee174ef6a9538229646
3
- size 934954944
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:71feda328360da5de155ff9981840d5744e0d09e2724d173561805d58b747538
3
+ size 934952352
Qwen2.5-Math-1.5B-Q4_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:a7b641a24ee0c80df2b85c949ef0adb4540b9fa082fa5ae274b7870390cc045a
3
- size 986048448
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:20960373234a261d5c46bff4385f5b4f8b498868f3ce28d9aba951593861bace
3
+ size 986045856
Qwen2.5-Math-1.5B-Q4_K_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:0b926a37ad97b5a1d7f9b59406fbd67a7d54cb4567618986a4aa10a2063f32bd
3
- size 940312512
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6dffc2e1f64a90af8c583e1aac10e19f2db9251f9143bbea7a2fdbd65389d0c3
3
+ size 940309920
Qwen2.5-Math-1.5B-Q5_0.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:5a11a29c397845638bfc503c08cd13594b6c0d3adeff4095c6beecd43a9f1bb2
3
- size 1098729408
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:90f81da5c0196e91d57f8210a5ee5a47fd630124f1f7777435faca281c1cb0b7
3
+ size 1098726816
Qwen2.5-Math-1.5B-Q5_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:0660fa0e9f616ac8a816033905965d4afe5b6e327e7145e84d15c71029bebc9f
3
- size 1125050304
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:035631838c6aea2af60860254fb8388700f8b3bc9a5f14e175a459ad188e1a8a
3
+ size 1125047712
Qwen2.5-Math-1.5B-Q5_K_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:03217a94e69b03bcb8e218e7cebb95f79ebc3a3c59693b82a9f2d3abdb8e20a4
3
- size 1098729408
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a045c50fa1b63f1ac52731a1ce50aa502f3d8552d1a7d3da81f42f10aeb7f650
3
+ size 1098726816
Qwen2.5-Math-1.5B-Q6_K.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:9e092689c8ec384bd385837716a73b2066ee9b9c1f2accddf7870e42cf2efd71
3
- size 1272739776
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0fee714690fe47de84303ccc0c3495e2d8b44fd55c1cab0d4283fe9f6be7d9e9
3
+ size 1272737184
Qwen2.5-Math-1.5B-Q8_0.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:7062a63101a3c7ca6b6d738c0e001dacdb1fd67ad4401f255b41725c59bf2dbb
3
- size 1646572992
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:42f7ec19e34b47f74cb9f5e62a6bf71dedaf6afa1c8b5a6a825314ffeccf6e5b
3
+ size 1646570400
README.md CHANGED
@@ -1,12 +1,12 @@
1
  ---
2
- base_model: Qwen/Qwen2.5-Math-1.5B
3
  language:
4
  - en
5
- pipeline_tag: text-generation
6
  library_name: transformers
7
  license: apache-2.0
8
- license_link: https://huggingface.co/Qwen/Qwen2.5-Math-1.5B/blob/main/LICENSE
9
  tags:
 
 
10
  - TensorBlock
11
  - GGUF
12
  ---
@@ -22,13 +22,12 @@ tags:
22
  </div>
23
  </div>
24
 
25
- ## Qwen/Qwen2.5-Math-1.5B - GGUF
26
 
27
- This repo contains GGUF format model files for [Qwen/Qwen2.5-Math-1.5B](https://huggingface.co/Qwen/Qwen2.5-Math-1.5B).
28
 
29
  The files were quantized using machines provided by [TensorBlock](https://tensorblock.co/), and they are compatible with llama.cpp as of [commit b4011](https://github.com/ggerganov/llama.cpp/commit/a6744e43e80f4be6398fc7733a01642c846dce1d).
30
 
31
-
32
  <div style="text-align: left; margin: 20px 0;">
33
  <a href="https://tensorblock.co/waitlist/client" style="display: inline-block; padding: 10px 20px; background-color: #007bff; color: white; text-decoration: none; border-radius: 5px; font-weight: bold;">
34
  Run them on the TensorBlock client using your local machine ↗
@@ -37,31 +36,26 @@ The files were quantized using machines provided by [TensorBlock](https://tensor
37
 
38
  ## Prompt template
39
 
40
-
41
  ```
42
- <|im_start|>system
43
- {system_prompt}<|im_end|>
44
- <|im_start|>user
45
- {prompt}<|im_end|>
46
- <|im_start|>assistant
47
  ```
48
 
49
  ## Model file specification
50
 
51
  | Filename | Quant type | File Size | Description |
52
  | -------- | ---------- | --------- | ----------- |
53
- | [Qwen2.5-Math-1.5B-Q2_K.gguf](https://huggingface.co/tensorblock/Qwen2.5-Math-1.5B-GGUF/blob/main/Qwen2.5-Math-1.5B-Q2_K.gguf) | Q2_K | 0.630 GB | smallest, significant quality loss - not recommended for most purposes |
54
- | [Qwen2.5-Math-1.5B-Q3_K_S.gguf](https://huggingface.co/tensorblock/Qwen2.5-Math-1.5B-GGUF/blob/main/Qwen2.5-Math-1.5B-Q3_K_S.gguf) | Q3_K_S | 0.709 GB | very small, high quality loss |
55
- | [Qwen2.5-Math-1.5B-Q3_K_M.gguf](https://huggingface.co/tensorblock/Qwen2.5-Math-1.5B-GGUF/blob/main/Qwen2.5-Math-1.5B-Q3_K_M.gguf) | Q3_K_M | 0.768 GB | very small, high quality loss |
56
- | [Qwen2.5-Math-1.5B-Q3_K_L.gguf](https://huggingface.co/tensorblock/Qwen2.5-Math-1.5B-GGUF/blob/main/Qwen2.5-Math-1.5B-Q3_K_L.gguf) | Q3_K_L | 0.820 GB | small, substantial quality loss |
57
- | [Qwen2.5-Math-1.5B-Q4_0.gguf](https://huggingface.co/tensorblock/Qwen2.5-Math-1.5B-GGUF/blob/main/Qwen2.5-Math-1.5B-Q4_0.gguf) | Q4_0 | 0.871 GB | legacy; small, very high quality loss - prefer using Q3_K_M |
58
- | [Qwen2.5-Math-1.5B-Q4_K_S.gguf](https://huggingface.co/tensorblock/Qwen2.5-Math-1.5B-GGUF/blob/main/Qwen2.5-Math-1.5B-Q4_K_S.gguf) | Q4_K_S | 0.876 GB | small, greater quality loss |
59
- | [Qwen2.5-Math-1.5B-Q4_K_M.gguf](https://huggingface.co/tensorblock/Qwen2.5-Math-1.5B-GGUF/blob/main/Qwen2.5-Math-1.5B-Q4_K_M.gguf) | Q4_K_M | 0.918 GB | medium, balanced quality - recommended |
60
- | [Qwen2.5-Math-1.5B-Q5_0.gguf](https://huggingface.co/tensorblock/Qwen2.5-Math-1.5B-GGUF/blob/main/Qwen2.5-Math-1.5B-Q5_0.gguf) | Q5_0 | 1.023 GB | legacy; medium, balanced quality - prefer using Q4_K_M |
61
- | [Qwen2.5-Math-1.5B-Q5_K_S.gguf](https://huggingface.co/tensorblock/Qwen2.5-Math-1.5B-GGUF/blob/main/Qwen2.5-Math-1.5B-Q5_K_S.gguf) | Q5_K_S | 1.023 GB | large, low quality loss - recommended |
62
- | [Qwen2.5-Math-1.5B-Q5_K_M.gguf](https://huggingface.co/tensorblock/Qwen2.5-Math-1.5B-GGUF/blob/main/Qwen2.5-Math-1.5B-Q5_K_M.gguf) | Q5_K_M | 1.048 GB | large, very low quality loss - recommended |
63
- | [Qwen2.5-Math-1.5B-Q6_K.gguf](https://huggingface.co/tensorblock/Qwen2.5-Math-1.5B-GGUF/blob/main/Qwen2.5-Math-1.5B-Q6_K.gguf) | Q6_K | 1.185 GB | very large, extremely low quality loss |
64
- | [Qwen2.5-Math-1.5B-Q8_0.gguf](https://huggingface.co/tensorblock/Qwen2.5-Math-1.5B-GGUF/blob/main/Qwen2.5-Math-1.5B-Q8_0.gguf) | Q8_0 | 1.533 GB | very large, extremely low quality loss - not recommended |
65
 
66
 
67
  ## Downloading instruction
 
1
  ---
2
+ base_model: unsloth/Qwen2.5-Math-1.5B
3
  language:
4
  - en
 
5
  library_name: transformers
6
  license: apache-2.0
 
7
  tags:
8
+ - unsloth
9
+ - transformers
10
  - TensorBlock
11
  - GGUF
12
  ---
 
22
  </div>
23
  </div>
24
 
25
+ ## unsloth/Qwen2.5-Math-1.5B - GGUF
26
 
27
+ This repo contains GGUF format model files for [unsloth/Qwen2.5-Math-1.5B](https://huggingface.co/unsloth/Qwen2.5-Math-1.5B).
28
 
29
  The files were quantized using machines provided by [TensorBlock](https://tensorblock.co/), and they are compatible with llama.cpp as of [commit b4011](https://github.com/ggerganov/llama.cpp/commit/a6744e43e80f4be6398fc7733a01642c846dce1d).
30
 
 
31
  <div style="text-align: left; margin: 20px 0;">
32
  <a href="https://tensorblock.co/waitlist/client" style="display: inline-block; padding: 10px 20px; background-color: #007bff; color: white; text-decoration: none; border-radius: 5px; font-weight: bold;">
33
  Run them on the TensorBlock client using your local machine ↗
 
36
 
37
  ## Prompt template
38
 
 
39
  ```
40
+
 
 
 
 
41
  ```
42
 
43
  ## Model file specification
44
 
45
  | Filename | Quant type | File Size | Description |
46
  | -------- | ---------- | --------- | ----------- |
47
+ | [Qwen2.5-Math-1.5B-Q2_K.gguf](https://huggingface.co/tensorblock/Qwen2.5-Math-1.5B-GGUF/blob/main/Qwen2.5-Math-1.5B-Q2_K.gguf) | Q2_K | 0.676 GB | smallest, significant quality loss - not recommended for most purposes |
48
+ | [Qwen2.5-Math-1.5B-Q3_K_S.gguf](https://huggingface.co/tensorblock/Qwen2.5-Math-1.5B-GGUF/blob/main/Qwen2.5-Math-1.5B-Q3_K_S.gguf) | Q3_K_S | 0.761 GB | very small, high quality loss |
49
+ | [Qwen2.5-Math-1.5B-Q3_K_M.gguf](https://huggingface.co/tensorblock/Qwen2.5-Math-1.5B-GGUF/blob/main/Qwen2.5-Math-1.5B-Q3_K_M.gguf) | Q3_K_M | 0.824 GB | very small, high quality loss |
50
+ | [Qwen2.5-Math-1.5B-Q3_K_L.gguf](https://huggingface.co/tensorblock/Qwen2.5-Math-1.5B-GGUF/blob/main/Qwen2.5-Math-1.5B-Q3_K_L.gguf) | Q3_K_L | 0.880 GB | small, substantial quality loss |
51
+ | [Qwen2.5-Math-1.5B-Q4_0.gguf](https://huggingface.co/tensorblock/Qwen2.5-Math-1.5B-GGUF/blob/main/Qwen2.5-Math-1.5B-Q4_0.gguf) | Q4_0 | 0.935 GB | legacy; small, very high quality loss - prefer using Q3_K_M |
52
+ | [Qwen2.5-Math-1.5B-Q4_K_S.gguf](https://huggingface.co/tensorblock/Qwen2.5-Math-1.5B-GGUF/blob/main/Qwen2.5-Math-1.5B-Q4_K_S.gguf) | Q4_K_S | 0.940 GB | small, greater quality loss |
53
+ | [Qwen2.5-Math-1.5B-Q4_K_M.gguf](https://huggingface.co/tensorblock/Qwen2.5-Math-1.5B-GGUF/blob/main/Qwen2.5-Math-1.5B-Q4_K_M.gguf) | Q4_K_M | 0.986 GB | medium, balanced quality - recommended |
54
+ | [Qwen2.5-Math-1.5B-Q5_0.gguf](https://huggingface.co/tensorblock/Qwen2.5-Math-1.5B-GGUF/blob/main/Qwen2.5-Math-1.5B-Q5_0.gguf) | Q5_0 | 1.099 GB | legacy; medium, balanced quality - prefer using Q4_K_M |
55
+ | [Qwen2.5-Math-1.5B-Q5_K_S.gguf](https://huggingface.co/tensorblock/Qwen2.5-Math-1.5B-GGUF/blob/main/Qwen2.5-Math-1.5B-Q5_K_S.gguf) | Q5_K_S | 1.099 GB | large, low quality loss - recommended |
56
+ | [Qwen2.5-Math-1.5B-Q5_K_M.gguf](https://huggingface.co/tensorblock/Qwen2.5-Math-1.5B-GGUF/blob/main/Qwen2.5-Math-1.5B-Q5_K_M.gguf) | Q5_K_M | 1.125 GB | large, very low quality loss - recommended |
57
+ | [Qwen2.5-Math-1.5B-Q6_K.gguf](https://huggingface.co/tensorblock/Qwen2.5-Math-1.5B-GGUF/blob/main/Qwen2.5-Math-1.5B-Q6_K.gguf) | Q6_K | 1.273 GB | very large, extremely low quality loss |
58
+ | [Qwen2.5-Math-1.5B-Q8_0.gguf](https://huggingface.co/tensorblock/Qwen2.5-Math-1.5B-GGUF/blob/main/Qwen2.5-Math-1.5B-Q8_0.gguf) | Q8_0 | 1.647 GB | very large, extremely low quality loss - not recommended |
59
 
60
 
61
  ## Downloading instruction