Hugging Face's logo

tensorblock
/
Qwen2.5-Coder-3B-GGUF

Transformers
GGUF
English
unsloth
code
qwen
qwen-coder
codeqwen
TensorBlock
GGUF
Model card Files
xet
 Community
morriszms commited on
Commit
d11bdf1
·
verified ·
1 Parent(s): f6362ea

Upload folder using huggingface_hub

Browse files
Files changed (13) hide show
  1. Qwen2.5-Coder-3B-Q2_K.gguf +2 -2
  2. Qwen2.5-Coder-3B-Q3_K_L.gguf +2 -2
  3. Qwen2.5-Coder-3B-Q3_K_M.gguf +2 -2
  4. Qwen2.5-Coder-3B-Q3_K_S.gguf +2 -2
  5. Qwen2.5-Coder-3B-Q4_0.gguf +2 -2
  6. Qwen2.5-Coder-3B-Q4_K_M.gguf +2 -2
  7. Qwen2.5-Coder-3B-Q4_K_S.gguf +2 -2
  8. Qwen2.5-Coder-3B-Q5_0.gguf +2 -2
  9. Qwen2.5-Coder-3B-Q5_K_M.gguf +2 -2
  10. Qwen2.5-Coder-3B-Q5_K_S.gguf +2 -2
  11. Qwen2.5-Coder-3B-Q6_K.gguf +2 -2
  12. Qwen2.5-Coder-3B-Q8_0.gguf +2 -2
  13. README.md +8 -13
Qwen2.5-Coder-3B-Q2_K.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:2af21150f688c4a2579da215797c5705524c639de8e05837b1a3a2021fdc7435
3
- size 1274755936
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:98a76b4e6b81bba0893f29c6892b876b77d0c71b6ca7f5906335c233f05248c2
3
+ size 1274753376
Qwen2.5-Coder-3B-Q3_K_L.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:754da7357b3410392325d71e7ef9f61f216edae254bd9c2fd221e92a22037f0c
3
- size 1707391840
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b4766c78a58de3f43de08da4d660a0a49345142f68f91e8b6053c4bc8fae553c
3
+ size 1707389280
Qwen2.5-Coder-3B-Q3_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:fe0728bd682b3244d2afebcd1d0da26bc63819a309d2418769bc59048f474d5b
3
- size 1590475616
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:716a630eff3e9a9e830c3fae91d77ca23d7d93e140375b434690f31dd7719e46
3
+ size 1590473056
Qwen2.5-Coder-3B-Q3_K_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:3a2ce48d026c77dc74fec566d8976966ec5a092710bced6a496fbe1d22d489c8
3
- size 1454357344
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6ebc3fc4eaaf6e880b9e95d0f21adc8161c116a0d9735264f654a4c00fe476c9
3
+ size 1454354784
Qwen2.5-Coder-3B-Q4_0.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:df308b6c26c696aa34a3da8a868fa72594b63937b60bf9c9f50a2db2403bf9cb
3
- size 1822849888
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:499401079f4fa1f3d9a9c61c0d1c2caf4135727f0b1e531ddf99bda20acefb1f
3
+ size 1822847328
Qwen2.5-Coder-3B-Q4_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:433d2d9314aed9ec99b62c2f138a79cba33673e85d5ecc36358efbb499977341
3
- size 1929902944
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e6dd1021bc0a48df4aa8195d4ab1b66afbf4e2cf449ac293c7978d5100ff23d2
3
+ size 1929900384
Qwen2.5-Coder-3B-Q4_K_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:a3ec9355c591642365ba59b5adb6d5e812b3fc2c96c6f53e83c67eea1fec232c
3
- size 1834384224
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0f3dd93dd39a872067e22786f5c9bdffd51fa510d262b6e7af7a62c07de9978e
3
+ size 1834381664
Qwen2.5-Coder-3B-Q5_0.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:2467ea1e621769f4234527b3ba8ecdbd34f2a9141fe8981f5bfe49662472d102
3
- size 2169666400
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:416a384452aa8e77b61656ef558ef6c372e0fd6f233836023ca97ebb412abf69
3
+ size 2169663840
Qwen2.5-Coder-3B-Q5_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:866ef7447348825750bf101652d6d112219fee8fbb206ea9874c9e97d8e6d8ec
3
- size 2224814944
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f0b6e8140d0c19938609d9f982bc0a73eb4d3f5c95249d1ff994cfe2d5fbee79
3
+ size 2224812384
Qwen2.5-Coder-3B-Q5_K_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:452f3e9d6bb1346e723c4fc7173017f658c66172ea77da8dd722936b021080ca
3
- size 2169666400
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f223457c4c9fb9895885daf4bced41ec291d38b5a3524806e0b3b8178b08ca29
3
+ size 2169663840
Qwen2.5-Coder-3B-Q6_K.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:60a1df0d9a87c7210d5c7171faff1ba5ad912fdab2a4d8104db2d95f234f53ad
3
- size 2538158944
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ef2fc4f1a1cc87dc677b779548393a31a7466a3d2f68e662418fdd07967ce462
3
+ size 2538156384
Qwen2.5-Coder-3B-Q8_0.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:9622fc8e5103999005f2291db8f488ce1ea22f748502072d7537de1e5d7cc6f7
3
- size 3285476192
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7d5575d87090985d0f2a0d08631311533a07258a0f6bdc19a20cc90d5a4e3442
3
+ size 3285473632
README.md CHANGED
@@ -1,13 +1,12 @@
1
  ---
2
- license: other
3
- license_name: qwen-research
4
- license_link: https://huggingface.co/Qwen/Qwen2.5-Coder-3B/blob/main/LICENSE
5
  language:
6
  - en
7
- base_model: Qwen/Qwen2.5-Coder-3B
8
- pipeline_tag: text-generation
9
  library_name: transformers
 
10
  tags:
 
 
11
  - code
12
  - qwen
13
  - qwen-coder
@@ -27,11 +26,11 @@ tags:
27
  </div>
28
  </div>
29
 
30
- ## Qwen/Qwen2.5-Coder-3B - GGUF
31
 
32
- This repo contains GGUF format model files for [Qwen/Qwen2.5-Coder-3B](https://huggingface.co/Qwen/Qwen2.5-Coder-3B).
33
 
34
- The files were quantized using machines provided by [TensorBlock](https://tensorblock.co/), and they are compatible with llama.cpp as of [commit b4011](https://github.com/ggerganov/llama.cpp/commit/a6744e43e80f4be6398fc7733a01642c846dce1d).
35
 
36
  <div style="text-align: left; margin: 20px 0;">
37
  <a href="https://tensorblock.co/waitlist/client" style="display: inline-block; padding: 10px 20px; background-color: #007bff; color: white; text-decoration: none; border-radius: 5px; font-weight: bold;">
@@ -42,11 +41,7 @@ The files were quantized using machines provided by [TensorBlock](https://tensor
42
  ## Prompt template
43
 
44
  ```
45
- <|im_start|>system
46
- {system_prompt}<|im_end|>
47
- <|im_start|>user
48
- {prompt}<|im_end|>
49
- <|im_start|>assistant
50
  ```
51
 
52
  ## Model file specification
 
1
  ---
2
+ base_model: unsloth/Qwen2.5-Coder-3B
 
 
3
  language:
4
  - en
 
 
5
  library_name: transformers
6
+ license: apache-2.0
7
  tags:
8
+ - unsloth
9
+ - transformers
10
  - code
11
  - qwen
12
  - qwen-coder
 
26
  </div>
27
  </div>
28
 
29
+ ## unsloth/Qwen2.5-Coder-3B - GGUF
30
 
31
+ This repo contains GGUF format model files for [unsloth/Qwen2.5-Coder-3B](https://huggingface.co/unsloth/Qwen2.5-Coder-3B).
32
 
33
+ The files were quantized using machines provided by [TensorBlock](https://tensorblock.co/), and they are compatible with llama.cpp as of [commit b4242](https://github.com/ggerganov/llama.cpp/commit/a6744e43e80f4be6398fc7733a01642c846dce1d).
34
 
35
  <div style="text-align: left; margin: 20px 0;">
36
  <a href="https://tensorblock.co/waitlist/client" style="display: inline-block; padding: 10px 20px; background-color: #007bff; color: white; text-decoration: none; border-radius: 5px; font-weight: bold;">
 
41
  ## Prompt template
42
 
43
  ```
44
+
 
 
 
 
45
  ```
46
 
47
  ## Model file specification