lainlives commited on
Commit
3c23308
·
verified ·
1 Parent(s): 5beeb99

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +64 -0
README.md ADDED
@@ -0,0 +1,64 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ library_name: transformers
3
+ base_model: Tesslate/OmniCoder-9B
4
+ tags:
5
+ - qwen3.5
6
+ - code
7
+ - agent
8
+ - sft
9
+ - omnicoder
10
+ - tesslate
11
+ - llama-cpp
12
+ - gguf-my-repo
13
+ license: apache-2.0
14
+ language:
15
+ - en
16
+ pipeline_tag: text-generation
17
+ model-index:
18
+ - name: OmniCoder-9B
19
+ results:
20
+ - task:
21
+ type: text-generation
22
+ dataset:
23
+ name: AIME 2025
24
+ type: custom
25
+ metrics:
26
+ - type: accuracy
27
+ value: 90.0
28
+ name: pass@5
29
+ - type: accuracy
30
+ value: 83.8
31
+ name: pass@1
32
+ - type: accuracy
33
+ value: 86.4
34
+ name: pass@3
35
+ - type: accuracy
36
+ value: 28.1
37
+ name: Pass Rate
38
+ ---
39
+
40
+ # lainlives/QCoder
41
+ This model contains GGUF format model files for [`Tesslate/OmniCoder-9B`](https://huggingface.co/Tesslate/OmniCoder-9B).
42
+
43
+ ### Available Quants
44
+ The following files were generated and uploaded to this repo:
45
+ `Q4_0`, `Q4_K_S`, `Q4_K_M`, `Q5_0`, `Q5_K_S`, `Q5_K_M`, `Q6_K`, `Q8_0`, `f16`, `bf16`
46
+
47
+ ### Use with llama.cpp
48
+
49
+ CLI:
50
+ ```bash
51
+ llama-cli --hf-repo lainlives/QCoder --hf-file OmniCoder-9B-Q4_K_M.gguf -p "The meaning to life and the universe is"
52
+ ```
53
+
54
+ Server:
55
+ ```bash
56
+ llama-server --hf-repo lainlives/QCoder --hf-file OmniCoder-9B-Q4_K_M.gguf -c 2048
57
+ ```
58
+
59
+ ### Or ollama
60
+
61
+ CLI:
62
+ ```bash
63
+ ollama run https://hf.co/lainlives/QCoder:Q4_K_M
64
+ ```