Add model card

README.md

@@ -0,0 +1,36 @@
+---
+license: apache-2.0
+tags:
+  - gguf
+  - code
+  - llama-cpp
+base_model: rovdetection/code-1b-chat-v2
+---
+
+# code-1b-chat-v2 GGUF
+
+GGUF quantization of [rovdetection/code-1b-chat-v2](https://huggingface.co/rovdetection/code-1b-chat-v2).
+
+## Available files
+
+| File | Quant | Size | Use case |
+|------|-------|------|----------|
+| `code-1b-chat-v2-Q4_K_M.gguf` | Q4_K_M | ~700 MB | Recommended — best quality/speed |
+
+## Usage with llama-cpp-python
+
+```python
+from llama_cpp import Llama
+
+llm = Llama.from_pretrained(
+    repo_id="rovdetection/code-1b-chat-v2-gguf",
+    filename="code-1b-chat-v2-Q4_K_M.gguf",
+    n_ctx=2048,
+)
+
+SYSTEM = "Below is an instruction that describes a coding task. Write a response that appropriately completes the request."
+prompt = f"{SYSTEM}\n\n### Instruction:\nWrite a fibonacci function.\n\n### Response:\n"
+
+out = llm(prompt, max_tokens=200, temperature=0.7, stop=["### Instruction:"])
+print(out["choices"][0]["text"])
+```