README.md

metadata

license: apache-2.0
base_model: Qwen/Qwen2.5-Coder-7B-Instruct
tags:
  - kubernetes
  - crd
  - code-generation
  - gguf
  - quantised

CRD Wizard - Kubernetes CRD Generator (GGUF)

This is a fine-tuned version of Qwen2.5-Coder-7B-Instruct, optimized for generating Kubernetes Custom Resource Definitions (CRDs) and their corresponding valid YAML manifests.

It was trained to understand CRD Schemas (openAPIV3Schema) and produce production-ready YAML examples.

Model Details

• Base Model: Qwen/Qwen2.5-Coder-7B-Instruct
• Format: GGUF (Q4_K_M Quantization)
• Size: ~4.7 GB
• Context Window: Optimized for 8192 tokens (8k).

Usage with Ollama

1. Download the crd-wizard.gguf and Modelfile.
2. Import into Ollama:

   ollama create crd-wizard -f Modelfile
   

3. Run:

   ollama run crd-wizard "Create a PostgresDB resource for the database.my.org/v1 API"
   

IMPORTANT: Context Window

This model is optimized for an 8k context window. If you use the default 32k window of Qwen, it significantly increases memory usage (RAM) and can cause extreme slowness on consumer hardware (e.g., Apple Silicon M1/M2).

The included Modelfile enforces this limit:

PARAMETER num_ctx 8192