Qwen2.5 Coder 7B Instruct – Q4_KM (Consolidated)

Source: Qwen/Qwen2.5-Coder-7B-Instruct-GGUF

This repo bundles only the single consolidated 'qwen2.5-coder-7b-instruct-q4_k_m.gguf' GGUF variant. No weight merging. Compatible with llama.cpp ecosystem.

Downloads last month
31
GGUF
Model size
8B params
Architecture
qwen2
Hardware compatibility
Log In to view the estimation

4-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. πŸ™‹ Ask for provider support