Qwen2.5 Coder 7B Instruct – Q4_KM (Consolidated)

Source: Qwen/Qwen2.5-Coder-7B-Instruct-GGUF

This repo bundles the Q4_KM GGUF variant along with necessary configuration and tokenizer files. No weight merging. Compatible with llama.cpp ecosystem.

Downloads last month
44
GGUF
Model size
8B params
Architecture
qwen2
Hardware compatibility
Log In to view the estimation

4-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. πŸ™‹ Ask for provider support