Levelfive's picture
Add Q4_KM only consolidated GGUF with YAML metadata
29704d9 verified
metadata
tags:
  - qwen
  - qwen2_5
  - gguf
  - text-generation
  - quantization
model_name: Qwen2.5 Coder 7B Instruct - Q4_KM (Consolidated)

Qwen2.5 Coder 7B Instruct – Q4_KM (Consolidated)

Source: Qwen/Qwen2.5-Coder-7B-Instruct-GGUF

This repo bundles only the single consolidated 'qwen2.5-coder-7b-instruct-q4_k_m.gguf' GGUF variant. No weight merging. Compatible with llama.cpp ecosystem.