pehlicd commited on
Commit
01c0667
·
verified ·
1 Parent(s): a6333cb

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +43 -3
README.md CHANGED
@@ -1,3 +1,43 @@
1
- ---
2
- license: apache-2.0
3
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ base_model: Qwen/Qwen2.5-Coder-7B-Instruct
4
+ tags:
5
+ - kubernetes
6
+ - crd
7
+ - code-generation
8
+ - gguf
9
+ - quantised
10
+ ---
11
+
12
+ # CRD Wizard - Kubernetes CRD Generator (GGUF)
13
+
14
+ This is a fine-tuned version of **Qwen2.5-Coder-7B-Instruct**, optimized for generating Kubernetes **Custom Resource Definitions (CRDs)** and their corresponding valid YAML manifests.
15
+
16
+ It was trained to understand CRD Schemas (`openAPIV3Schema`) and produce production-ready YAML examples.
17
+
18
+ ## Model Details
19
+ - **Base Model**: Qwen/Qwen2.5-Coder-7B-Instruct
20
+ - **Format**: GGUF (Q4_K_M Quantization)
21
+ - **Size**: ~4.7 GB
22
+ - **Context Window**: Optimized for **8192** tokens (8k).
23
+
24
+ ## Usage with Ollama
25
+
26
+ 1. Download the `crd-wizard.gguf` and `Modelfile`.
27
+ 2. Import into Ollama:
28
+ ```bash
29
+ ollama create crd-wizard -f Modelfile
30
+ ```
31
+ 3. Run:
32
+ ```bash
33
+ ollama run crd-wizard "Create a PostgresDB resource for the database.my.org/v1 API"
34
+ ```
35
+
36
+ ## IMPORTANT: Context Window
37
+ This model is optimized for an **8k context window**.
38
+ If you use the default 32k window of Qwen, it significantly increases memory usage (RAM) and can cause extreme slowness on consumer hardware (e.g., Apple Silicon M1/M2).
39
+
40
+ The included `Modelfile` enforces this limit:
41
+ ```dockerfile
42
+ PARAMETER num_ctx 8192
43
+ ```