---
base_model: Colby/starcoder-7b-agent-0.2-merged
tags:
- gguf
- starcoder
- agentic-coding
- tool-use
- sft
---

# starcoder-7b-agent-0.3-gguf

GGUF conversion of [Colby/starcoder-7b-agent-0.3](https://huggingface.co/Colby/starcoder-7b-agent-0.3).

Chat format: StarCoderChat with <think> reasoning traces and <tool_call>/<tool_response> agentic turns.

## Quantizations

| File | Format | Size |
|------|--------|------|
| starcoder-7b-agent-0.3-f16.gguf | FP16 | ~14 GB |
| starcoder-7b-agent-0.3-q8_0.gguf | Q8_0 | ~7 GB |
| starcoder-7b-agent-0.3-q5_k_m.gguf | Q5_K_M | ~5 GB |
| starcoder-7b-agent-0.3-q4_k_m.gguf | Q4_K_M | ~4 GB |