---
tags:
- gguf
- unsloth
- qwen2.5
base_model: unsloth/Qwen2.5-0.5B-bnb-4bit
---

# verity-2.1-beta-instruct

GGUF export of a QLoRA fine-tune of Qwen2.5-0.5B Base, quantized with **Q4_K_M**.

Built with [Unsloth](https://github.com/unslothai/unsloth).

## Usage
Load `verity-2.1-beta-instruct.Q4_K_M.gguf` in [Ollama](https://ollama.com), [LM Studio](https://lmstudio.ai), or any llama.cpp-based tool.