GGUF

image/png

Qiskit/Qwen2.5-Coder-14B-Qiskit-GGUF

This is the Q4_K_M converted version of the original Qiskit/Qwen2.5-Coder-14B-Qiskit. Please refer to the original Qwen2.5-Coder-14B-Qiskit model card for more details.

Benchmark Results (Base vs GGUF)

Notes: For CrowsPairs (% stereotype), lower is better.

Metric Qwen2.5-Coder-14B-Qiskit (%) Qwen2.5-Coder-14B-Qiskit-GGUF (%)
QiskitHumanEval-Hard 25.17 26.49
QiskitHumanEval 49.01 35.10
HumanEval 91.46 77.44
ASDiv (acc) 4.21 3.56
MathQA (acc) 53.90 54.41
SciQ (acc) 97.00 97.50
IFEval (prompt strict) 49.64 36.23
CrowsPairs English (% stereotype) 65.18 65.00
TruthfulQA (MC1 acc) 37.82 37.33
Downloads last month
19
GGUF
Model size
15B params
Architecture
qwen2
Hardware compatibility
Log In to view the estimation

4-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for Qiskit/Qwen2.5-Coder-14B-Qiskit-GGUF

Base model

Qwen/Qwen2.5-14B
Quantized
(2)
this model

Collection including Qiskit/Qwen2.5-Coder-14B-Qiskit-GGUF