Hugging Face's logo

tensorblock
/
Qwen2.5-Coder-7B-Instruct-GGUF

Text Generation
Transformers
GGUF
English
code
codeqwen
chat
qwen
qwen-coder
TensorBlock
GGUF
conversational
Model card Files
xet
Community
morriszms commited on
Commit
a318ccf
·
verified ·
1 Parent(s): f6636a2

Upload folder using huggingface_hub

Browse files
Files changed (13) hide show
  1. Qwen2.5-Coder-7B-Instruct-Q2_K.gguf +2 -2
  2. Qwen2.5-Coder-7B-Instruct-Q3_K_L.gguf +2 -2
  3. Qwen2.5-Coder-7B-Instruct-Q3_K_M.gguf +2 -2
  4. Qwen2.5-Coder-7B-Instruct-Q3_K_S.gguf +2 -2
  5. Qwen2.5-Coder-7B-Instruct-Q4_0.gguf +2 -2
  6. Qwen2.5-Coder-7B-Instruct-Q4_K_M.gguf +2 -2
  7. Qwen2.5-Coder-7B-Instruct-Q4_K_S.gguf +2 -2
  8. Qwen2.5-Coder-7B-Instruct-Q5_0.gguf +2 -2
  9. Qwen2.5-Coder-7B-Instruct-Q5_K_M.gguf +2 -2
  10. Qwen2.5-Coder-7B-Instruct-Q5_K_S.gguf +2 -2
  11. Qwen2.5-Coder-7B-Instruct-Q6_K.gguf +2 -2
  12. Qwen2.5-Coder-7B-Instruct-Q8_0.gguf +2 -2
  13. README.md +9 -8
Qwen2.5-Coder-7B-Instruct-Q2_K.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:a9f74e5ac979c8357c9b7d8c5f47123106fd5075bce09f191ebefecb6db8a429
3
- size 3015940544
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f1eb61e3fd9688da3de9b8f1b90fc700e1b1a95cd8fc8a1db4d8d0e7c70d46d2
3
+ size 3015940608
Qwen2.5-Coder-7B-Instruct-Q3_K_L.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:2d83efa527ac7a93304a88d3bb79178f5e34633acc850b3274fc3a395638d90f
3
- size 4088459712
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:487b83769ff9dab444326dd2abbec31a9a4b205177dd1ab527391bade06cc260
3
+ size 4088459776
Qwen2.5-Coder-7B-Instruct-Q3_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:7367f7cf4ee175f268fabd6950c49fd40f29734301ff986d1b0a622d3021a8ce
3
- size 3808391616
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bdd5eecfa0e5629a866772f34b727ba38fa5e6f967d8e30c166bcfdf06c9e5d5
3
+ size 3808391680
Qwen2.5-Coder-7B-Instruct-Q3_K_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:c41b60811e9b4ee627ac61e62244cd34aef27a924d026bdca22d103c12324ad8
3
- size 3492368832
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6d6996d7e87d9ef95e145b3f84e36a537b2aa8f5f563942a6a547da2cf84dda4
3
+ size 3492368896
Qwen2.5-Coder-7B-Instruct-Q4_0.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:f95ec68eb083890df0559d8a2740cf275d5f8f37f4019b71a8a97940d0b6f7ba
3
- size 4431391168
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ed2b7c55aa7f6e3f1280bc332edd235f1a7df8904bffe02f6da0ea542afca738
3
+ size 4431391232
Qwen2.5-Coder-7B-Instruct-Q4_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:383aacfb57e88cb8d0b9f80e3cf76e59fda281023aba656bef01ed318798c692
3
- size 4683073984
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fd3e718923742192a3a79c7ef2ea22e6d4a6d268883e70e4a3cffc7c76d472b1
3
+ size 4683074048
Qwen2.5-Coder-7B-Instruct-Q4_K_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:c9d09a4ac693df883bae4e943e4897c47503bb6059cd3bd07af35e6dd9c84909
3
- size 4457769408
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9e8b57be1f3ef538cfa987dce1edc31cdc3caf016b20e3781868e506f78d05f8
3
+ size 4457769472
Qwen2.5-Coder-7B-Instruct-Q5_0.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:51624cc7a808bdef5dcc1913406285945fac0e0ca56bdec555b24306611d80b4
3
- size 5315176896
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:965a9027d1e8bf360773a510bee94b491db69ae5d0f8e5736427c02ef6f728bd
3
+ size 5315176960
Qwen2.5-Coder-7B-Instruct-Q5_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:99cbb3925870746886eef3bb001b98357ba1f9b9c92008b4fdf6844ab98320d6
3
- size 5444831680
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fe0348b8971dfac2b58ae129fcc09718eba69bb015f7884952dc19dc8d7c124a
3
+ size 5444831744
Qwen2.5-Coder-7B-Instruct-Q5_K_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:cefa50b1ef7345d95404cedd2be14686543ee4665adf81c31f4626fa3f587c65
3
- size 5315176896
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a6580066b0d3be8f6a6323174b9b21dfe8e9b2fce2859fdf79c792febdc0e9b9
3
+ size 5315176960
Qwen2.5-Coder-7B-Instruct-Q6_K.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:c2d12d650c1b3eccd9c6e8a566d216bac59f3e3eefc9b4652b8c2a084d4c7db8
3
- size 6254199232
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0db92f3be11b912c1f060b1631b96e6a3b65f657b76ac36122a684dfc55a4561
3
+ size 6254199296
Qwen2.5-Coder-7B-Instruct-Q8_0.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:7741e85e820562de9e6503b8d97579a5dbfbcfdd388ffd3862244caea52e3263
3
- size 8098525632
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:05715ce0f66ad3a634f5f8222e0dcd69bf84c6d7ae50560c9711c4510c4d61a1
3
+ size 8098525696
README.md CHANGED
@@ -1,16 +1,17 @@
1
  ---
2
- base_model: unsloth/Qwen2.5-Coder-7B-Instruct
 
3
  language:
4
  - en
 
 
5
  library_name: transformers
6
- license: apache-2.0
7
  tags:
8
- - unsloth
9
- - transformers
10
  - code
 
 
11
  - qwen
12
  - qwen-coder
13
- - codeqwen
14
  - TensorBlock
15
  - GGUF
16
  ---
@@ -26,11 +27,11 @@ tags:
26
  </div>
27
  </div>
28
 
29
- ## unsloth/Qwen2.5-Coder-7B-Instruct - GGUF
30
 
31
- This repo contains GGUF format model files for [unsloth/Qwen2.5-Coder-7B-Instruct](https://huggingface.co/unsloth/Qwen2.5-Coder-7B-Instruct).
32
 
33
- The files were quantized using machines provided by [TensorBlock](https://tensorblock.co/), and they are compatible with llama.cpp as of [commit b4011](https://github.com/ggerganov/llama.cpp/commit/a6744e43e80f4be6398fc7733a01642c846dce1d).
34
 
35
  <div style="text-align: left; margin: 20px 0;">
36
  <a href="https://tensorblock.co/waitlist/client" style="display: inline-block; padding: 10px 20px; background-color: #007bff; color: white; text-decoration: none; border-radius: 5px; font-weight: bold;">
 
1
  ---
2
+ license: apache-2.0
3
+ license_link: https://huggingface.co/Qwen/Qwen2.5-Coder-7B-Instruct/blob/main/LICENSE
4
  language:
5
  - en
6
+ base_model: Qwen/Qwen2.5-Coder-7B-Instruct
7
+ pipeline_tag: text-generation
8
  library_name: transformers
 
9
  tags:
 
 
10
  - code
11
+ - codeqwen
12
+ - chat
13
  - qwen
14
  - qwen-coder
 
15
  - TensorBlock
16
  - GGUF
17
  ---
 
27
  </div>
28
  </div>
29
 
30
+ ## Qwen/Qwen2.5-Coder-7B-Instruct - GGUF
31
 
32
+ This repo contains GGUF format model files for [Qwen/Qwen2.5-Coder-7B-Instruct](https://huggingface.co/Qwen/Qwen2.5-Coder-7B-Instruct).
33
 
34
+ The files were quantized using machines provided by [TensorBlock](https://tensorblock.co/), and they are compatible with llama.cpp as of [commit ec7f3ac](https://github.com/ggerganov/llama.cpp/commit/ec7f3ac9ab33e46b136eb5ab6a76c4d81f57c7f1).
35
 
36
  <div style="text-align: left; margin: 20px 0;">
37
  <a href="https://tensorblock.co/waitlist/client" style="display: inline-block; padding: 10px 20px; background-color: #007bff; color: white; text-decoration: none; border-radius: 5px; font-weight: bold;">