Hugging Face's logo

nassimjp
/
ipashtoCoder-9B-GGUF

GGUF
llama-cpp
qwen3.5
omnicoder
tesslate
code
agent
conversational
Model card Files
xet
 Community
nassimjp smirki commited on
Commit
00a7863
·
0 Parent(s):

Duplicate from Tesslate/OmniCoder-9B-GGUF

Browse files

Co-authored-by: Manav Majumdar <smirki@users.noreply.huggingface.co>

Files changed (15) hide show
  1. .gitattributes +48 -0
  2. README.md +67 -0
  3. omnicoder-9b-bf16.gguf +3 -0
  4. omnicoder-9b-q2_k.gguf +3 -0
  5. omnicoder-9b-q3_k_l.gguf +3 -0
  6. omnicoder-9b-q3_k_m.gguf +3 -0
  7. omnicoder-9b-q3_k_s.gguf +3 -0
  8. omnicoder-9b-q4_0.gguf +3 -0
  9. omnicoder-9b-q4_k_m.gguf +3 -0
  10. omnicoder-9b-q4_k_s.gguf +3 -0
  11. omnicoder-9b-q5_0.gguf +3 -0
  12. omnicoder-9b-q5_k_m.gguf +3 -0
  13. omnicoder-9b-q5_k_s.gguf +3 -0
  14. omnicoder-9b-q6_k.gguf +3 -0
  15. omnicoder-9b-q8_0.gguf +3 -0
.gitattributes ADDED
@@ -0,0 +1,48 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ *.7z filter=lfs diff=lfs merge=lfs -text
2
+ *.arrow filter=lfs diff=lfs merge=lfs -text
3
+ *.bin filter=lfs diff=lfs merge=lfs -text
4
+ *.bz2 filter=lfs diff=lfs merge=lfs -text
5
+ *.ckpt filter=lfs diff=lfs merge=lfs -text
6
+ *.ftz filter=lfs diff=lfs merge=lfs -text
7
+ *.gz filter=lfs diff=lfs merge=lfs -text
8
+ *.h5 filter=lfs diff=lfs merge=lfs -text
9
+ *.joblib filter=lfs diff=lfs merge=lfs -text
10
+ *.lfs.* filter=lfs diff=lfs merge=lfs -text
11
+ *.mlmodel filter=lfs diff=lfs merge=lfs -text
12
+ *.model filter=lfs diff=lfs merge=lfs -text
13
+ *.msgpack filter=lfs diff=lfs merge=lfs -text
14
+ *.npy filter=lfs diff=lfs merge=lfs -text
15
+ *.npz filter=lfs diff=lfs merge=lfs -text
16
+ *.onnx filter=lfs diff=lfs merge=lfs -text
17
+ *.ot filter=lfs diff=lfs merge=lfs -text
18
+ *.parquet filter=lfs diff=lfs merge=lfs -text
19
+ *.pb filter=lfs diff=lfs merge=lfs -text
20
+ *.pickle filter=lfs diff=lfs merge=lfs -text
21
+ *.pkl filter=lfs diff=lfs merge=lfs -text
22
+ *.pt filter=lfs diff=lfs merge=lfs -text
23
+ *.pth filter=lfs diff=lfs merge=lfs -text
24
+ *.rar filter=lfs diff=lfs merge=lfs -text
25
+ *.safetensors filter=lfs diff=lfs merge=lfs -text
26
+ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
27
+ *.tar.* filter=lfs diff=lfs merge=lfs -text
28
+ *.tar filter=lfs diff=lfs merge=lfs -text
29
+ *.tflite filter=lfs diff=lfs merge=lfs -text
30
+ *.tgz filter=lfs diff=lfs merge=lfs -text
31
+ *.wasm filter=lfs diff=lfs merge=lfs -text
32
+ *.xz filter=lfs diff=lfs merge=lfs -text
33
+ *.zip filter=lfs diff=lfs merge=lfs -text
34
+ *.zst filter=lfs diff=lfs merge=lfs -text
35
+ *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ omnicoder-9b-bf16.gguf filter=lfs diff=lfs merge=lfs -text
37
+ omnicoder-9b-q2_k.gguf filter=lfs diff=lfs merge=lfs -text
38
+ omnicoder-9b-q3_k_l.gguf filter=lfs diff=lfs merge=lfs -text
39
+ omnicoder-9b-q3_k_m.gguf filter=lfs diff=lfs merge=lfs -text
40
+ omnicoder-9b-q3_k_s.gguf filter=lfs diff=lfs merge=lfs -text
41
+ omnicoder-9b-q4_0.gguf filter=lfs diff=lfs merge=lfs -text
42
+ omnicoder-9b-q4_k_m.gguf filter=lfs diff=lfs merge=lfs -text
43
+ omnicoder-9b-q4_k_s.gguf filter=lfs diff=lfs merge=lfs -text
44
+ omnicoder-9b-q5_0.gguf filter=lfs diff=lfs merge=lfs -text
45
+ omnicoder-9b-q5_k_m.gguf filter=lfs diff=lfs merge=lfs -text
46
+ omnicoder-9b-q5_k_s.gguf filter=lfs diff=lfs merge=lfs -text
47
+ omnicoder-9b-q6_k.gguf filter=lfs diff=lfs merge=lfs -text
48
+ omnicoder-9b-q8_0.gguf filter=lfs diff=lfs merge=lfs -text
README.md ADDED
@@ -0,0 +1,67 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: Tesslate/OmniCoder-9B
3
+ tags:
4
+ - llama-cpp
5
+ - gguf
6
+ - qwen3.5
7
+ - omnicoder
8
+ - tesslate
9
+ - code
10
+ - agent
11
+ license: apache-2.0
12
+ ---
13
+
14
+ <div align="center">
15
+
16
+ <img src="https://huggingface.co/Tesslate/OmniCoder-9B/resolve/main/omnicoder-banner.png" alt="OmniCoder" width="720">
17
+
18
+ # OmniCoder-9B-GGUF
19
+
20
+ ### GGUF quantizations of [OmniCoder-9B](https://huggingface.co/Tesslate/OmniCoder-9B)
21
+
22
+ [![License](https://img.shields.io/badge/License-Apache_2.0-blue.svg)](https://opensource.org/licenses/Apache-2.0)
23
+ [![Full Weights](https://img.shields.io/badge/Full_Weights-OmniCoder--9B-purple)](https://huggingface.co/Tesslate/OmniCoder-9B)
24
+
25
+ </div>
26
+
27
+ ---
28
+
29
+ ## Available Quantizations
30
+
31
+ | Quantization | Size | Use Case |
32
+ |:---|---:|:---|
33
+ | `Q2_K` | ~3.8 GB | Extreme compression, lowest quality |
34
+ | `Q3_K_S` | ~4.3 GB | Small footprint |
35
+ | `Q3_K_M` | ~4.6 GB | Small footprint, balanced |
36
+ | `Q3_K_L` | ~4.9 GB | Small footprint, higher quality |
37
+ | `Q4_0` | ~5.3 GB | Good balance |
38
+ | `Q4_K_S` | ~5.4 GB | Good balance |
39
+ | **`Q4_K_M`** | **~5.7 GB** | **Recommended for most users** |
40
+ | `Q5_0` | ~6.3 GB | High quality |
41
+ | `Q5_K_S` | ~6.3 GB | High quality |
42
+ | `Q5_K_M` | ~6.5 GB | High quality, balanced |
43
+ | `Q6_K` | ~7.4 GB | Near-lossless |
44
+ | `Q8_0` | ~9.5 GB | Highest quality quantization |
45
+ | `BF16` | ~17.9 GB | Full precision |
46
+
47
+ ## Usage
48
+
49
+ ```bash
50
+ # Install llama.cpp
51
+ brew install llama.cpp # macOS
52
+ # or build from source: https://github.com/ggml-org/llama.cpp
53
+
54
+ # Interactive chat
55
+ llama-cli --hf-repo Tesslate/OmniCoder-9B-GGUF --hf-file omnicoder-9b-q4_k_m.gguf -p "Your prompt" -c 8192
56
+
57
+ # Server mode (OpenAI-compatible API)
58
+ llama-server --hf-repo Tesslate/OmniCoder-9B-GGUF --hf-file omnicoder-9b-q4_k_m.gguf -c 8192
59
+ ```
60
+
61
+ ---
62
+
63
+ <div align="center">
64
+
65
+ **Built by [Tesslate](https://tesslate.com)** | See full model card: [OmniCoder-9B](https://huggingface.co/Tesslate/OmniCoder-9B)
66
+
67
+ </div>
omnicoder-9b-bf16.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:dacb3eed8305f23d78e69b60b74b0939c5eb0bbe88bc2665d557c922b06e4625
3
+ size 17920696640
omnicoder-9b-q2_k.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0bccd8ea7be89f89174b4b80f4ad37e104702c4c042fb6bd784ce5c1634f84ad
3
+ size 3827261760
omnicoder-9b-q3_k_l.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:15a7dee2c5438ff924e5bc11012d82c6fbc26ba5f81e8d907e1cf4ee1ae2ba4e
3
+ size 4925514048
omnicoder-9b-q3_k_m.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:881c47477a2193fdc665e13a859f7b541162ce323f798abb5c6fb94c49954051
3
+ size 4623524160
omnicoder-9b-q3_k_s.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fb18a1322303cc8b8e0f23ef645aed296d806ed7a2625280ee98f4d82cbc47e3
3
+ size 4259406144
omnicoder-9b-q4_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fe8f964b68f7714b41dbdf555fabc3e335fc2535f0feb18ca5b2b0665e845e0e
3
+ size 5313356096
omnicoder-9b-q4_k_m.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:550e8f7253c8e07997fbce2570d37259b69b0d21faf77e5ed518d4ee4c73d8b3
3
+ size 5737242944
omnicoder-9b-q4_k_s.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:64c779c67a890e740eda9376fc0fc9ff1f8383c5cfdb51eb33b7f203cb36434c
3
+ size 5351629120
omnicoder-9b-q5_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d5e3c1168480f1cfde462c0751f6d1d1e0ce93b107667995eae5d88c660d1ece
3
+ size 6305308992
omnicoder-9b-q5_k_m.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ba33ee59845dcd854164a1fcef758be3543c39fc3365937fbf2a7c8ce064ba64
3
+ size 6523674944
omnicoder-9b-q5_k_s.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:08b046616c8dcb746128403203fdde6c93e139227c4081ad6c44765245e62da6
3
+ size 6305308992
omnicoder-9b-q6_k.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f0798688edbb25de4fe0dc7e682b2b257bf8580511eff620de71d12db1284d05
3
+ size 7359258944
omnicoder-9b-q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3bb360f0d5bf788503dcd751e704760173298a35b26602dfb939474d87745732
3
+ size 9527501120