morriszms commited on
Commit
5b6cf3b
·
verified ·
1 Parent(s): 853c1b1

Upload folder using huggingface_hub

Browse files
Qwen2.5-7B-Q2_K.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:b299f1e255836a005354a515056a2165069e26d2f507135a6ec0eb47632ae2d5
3
- size 3015940128
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6e68c2fecd7f87bb6f474f4d6c2b55dc66fcd91a06663311ca08606ced60831f
3
+ size 3015937856
Qwen2.5-7B-Q3_K_L.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:5fcd3a6bbc4c1ee5417c6d07e328a59e10fff2fc0b6ac37d350f2457f8dc4678
3
- size 4088459296
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:60de61f2424a7a4ecb89a6b3145790a87b5ce162845431c00f3ced3ca1505ab9
3
+ size 4088457024
Qwen2.5-7B-Q3_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:b36d5d1e388e90cf9eea71e64b4b45fa53fdabb150752c04e1240812370eff01
3
- size 3808391200
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2c6211634b395128e60de98f36026898bb78ed640c94037e47e82474e98c1bc6
3
+ size 3808388928
Qwen2.5-7B-Q3_K_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:0279be732def84bdcb9e5c688422ce8ac1831a69f910f644cc47efd104ab4f29
3
- size 3492368416
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5f87007b03f1a9b3f214980af4b4e9c7e15bf7b2d08def69825231ef859a8ae8
3
+ size 3492366144
Qwen2.5-7B-Q4_0.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:dc6f8f4a46138765383c2515f4a02d9c97564cb658c3d9eae0b582bb301e4b66
3
- size 4431390752
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4f1a472d958f3bf90372d2eab2b302b2b07afb323476d1396afb194444f31c82
3
+ size 4431388480
Qwen2.5-7B-Q4_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:456373ad5d036841b3b68004dd49dbb411fd4ec0efb35b71b9b2bc5e03b80a45
3
- size 4683073568
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5c36df1428c6a3eb183b6be463dbded89055a6eb04883504c88368b384d1ef8d
3
+ size 4683071296
Qwen2.5-7B-Q4_K_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:cde35bfc35ce0919de160df4024bfefeeec57f33119073c4f8891eac3cb0ce46
3
- size 4457768992
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:579acbc071c178903c87a3fbaaca5f81ff6acb7ae373b0ced12334d21ef336c1
3
+ size 4457766720
Qwen2.5-7B-Q5_0.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:0b1f4c40b79e83ed4523b45791ec665b50e61c9866f24ce5d7027e022a726ea0
3
- size 5315176480
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:af3fd19a44bf41b3d957be35053febac23d6268639fa60440adf895a644c541c
3
+ size 5315174208
Qwen2.5-7B-Q5_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:25696e18675a395784cf892824a87ad9cc9d8e1d79a8f449b6591b6387a12368
3
- size 5444831264
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a2a84e7f5e6c56d069043ef18e0bb07a51cb08fd2e8d04652ef01edd0d2cb19b
3
+ size 5444828992
Qwen2.5-7B-Q5_K_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:7019e7f36249ec0bea60ceedbb20703d897b2e8ebb3ae85ee2fa8dce85bd7b9a
3
- size 5315176480
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:34830607b45d7acb0d5156ab06851895de49d9def343e0708c9702c3bbc63e89
3
+ size 5315174208
Qwen2.5-7B-Q6_K.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:e56697a9fa8c8bd4435286460210e2d8bde08f85f39c1244f6e1791e1025343b
3
- size 6254198816
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:970291cec8135ef6edfe4356ad51076c427484ff0865958c007a8e5e8d8f1480
3
+ size 6254196544
Qwen2.5-7B-Q8_0.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:08aaddaa8e067a78a8cfd73da5f56b756489c64f255efd45f182802d5d890b65
3
- size 8098525216
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:12dd5385f92929bcf893b62990e14bbd2955e67d100f0f14b44557922725c8e8
3
+ size 8098522944
README.md CHANGED
@@ -1,14 +1,14 @@
1
  ---
2
- license: apache-2.0
3
- license_link: https://huggingface.co/Qwen/Qwen2.5-7B/blob/main/LICENSE
4
  language:
5
  - en
6
- pipeline_tag: text-generation
7
  library_name: transformers
 
8
  tags:
 
 
9
  - TensorBlock
10
  - GGUF
11
- base_model: Qwen/Qwen2.5-7B
12
  ---
13
 
14
  <div style="width: auto; margin-left: auto; margin-right: auto">
@@ -22,13 +22,12 @@ base_model: Qwen/Qwen2.5-7B
22
  </div>
23
  </div>
24
 
25
- ## Qwen/Qwen2.5-7B - GGUF
26
 
27
- This repo contains GGUF format model files for [Qwen/Qwen2.5-7B](https://huggingface.co/Qwen/Qwen2.5-7B).
28
 
29
  The files were quantized using machines provided by [TensorBlock](https://tensorblock.co/), and they are compatible with llama.cpp as of [commit b4011](https://github.com/ggerganov/llama.cpp/commit/a6744e43e80f4be6398fc7733a01642c846dce1d).
30
 
31
-
32
  <div style="text-align: left; margin: 20px 0;">
33
  <a href="https://tensorblock.co/waitlist/client" style="display: inline-block; padding: 10px 20px; background-color: #007bff; color: white; text-decoration: none; border-radius: 5px; font-weight: bold;">
34
  Run them on the TensorBlock client using your local machine ↗
@@ -37,13 +36,8 @@ The files were quantized using machines provided by [TensorBlock](https://tensor
37
 
38
  ## Prompt template
39
 
40
-
41
  ```
42
- <|im_start|>system
43
- {system_prompt}<|im_end|>
44
- <|im_start|>user
45
- {prompt}<|im_end|>
46
- <|im_start|>assistant
47
  ```
48
 
49
  ## Model file specification
 
1
  ---
2
+ base_model: unsloth/Qwen2.5-7B
 
3
  language:
4
  - en
 
5
  library_name: transformers
6
+ license: apache-2.0
7
  tags:
8
+ - unsloth
9
+ - transformers
10
  - TensorBlock
11
  - GGUF
 
12
  ---
13
 
14
  <div style="width: auto; margin-left: auto; margin-right: auto">
 
22
  </div>
23
  </div>
24
 
25
+ ## unsloth/Qwen2.5-7B - GGUF
26
 
27
+ This repo contains GGUF format model files for [unsloth/Qwen2.5-7B](https://huggingface.co/unsloth/Qwen2.5-7B).
28
 
29
  The files were quantized using machines provided by [TensorBlock](https://tensorblock.co/), and they are compatible with llama.cpp as of [commit b4011](https://github.com/ggerganov/llama.cpp/commit/a6744e43e80f4be6398fc7733a01642c846dce1d).
30
 
 
31
  <div style="text-align: left; margin: 20px 0;">
32
  <a href="https://tensorblock.co/waitlist/client" style="display: inline-block; padding: 10px 20px; background-color: #007bff; color: white; text-decoration: none; border-radius: 5px; font-weight: bold;">
33
  Run them on the TensorBlock client using your local machine ↗
 
36
 
37
  ## Prompt template
38
 
 
39
  ```
40
+
 
 
 
 
41
  ```
42
 
43
  ## Model file specification