Jackrong commited on
Commit
d9c1d4e
·
verified ·
1 Parent(s): 208078f

Add README

Browse files
Files changed (1) hide show
  1. README.md +30 -0
README.md ADDED
@@ -0,0 +1,30 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ tags:
3
+ - gguf
4
+ - llama.cpp
5
+ - unsloth
6
+ - vision-language-model
7
+ ---
8
+
9
+ # Qwen3.5-9B-Python-Coder-GGUF : GGUF
10
+
11
+ This model was finetuned and converted to GGUF format using [Unsloth](https://github.com/unslothai/unsloth).
12
+
13
+ **Example usage**:
14
+ - For text only LLMs: `llama-cli -hf Jackrong/Qwen3.5-9B-Python-Coder-GGUF --jinja`
15
+ - For multimodal models: `llama-mtmd-cli -hf Jackrong/Qwen3.5-9B-Python-Coder-GGUF --jinja`
16
+
17
+ ## Available Model files:
18
+ - `Qwen3.5-9B.Q8_0.gguf`
19
+ - `Qwen3.5-9B.Q6_K.gguf`
20
+ - `Qwen3.5-9B.Q5_K_M.gguf`
21
+ - `Qwen3.5-9B.Q5_K_S.gguf`
22
+ - `Qwen3.5-9B.Q4_K_M.gguf`
23
+ - `Qwen3.5-9B.Q4_K_S.gguf`
24
+ - `Qwen3.5-9B.Q3_K_L.gguf`
25
+ - `Qwen3.5-9B.Q3_K_M.gguf`
26
+ - `Qwen3.5-9B.Q3_K_S.gguf`
27
+ - `Qwen3.5-9B.Q2_K.gguf`
28
+ - `Qwen3.5-9B.BF16-mmproj.gguf`
29
+ This was trained 2x faster with [Unsloth](https://github.com/unslothai/unsloth)
30
+ [<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>](https://github.com/unslothai/unsloth)