Qiskit LLMs
Collection
LLMs finetuned for Qiskit Coding and Quantum Computing tasks
•
12 items
•
Updated
This is the Q4_K_M converted version of the original Qiskit/Qwen2.5-Coder-14B-Qiskit. Please refer to the original Qwen2.5-Coder-14B-Qiskit model card for more details.
Notes: For CrowsPairs (% stereotype), lower is better.
| Metric | Qwen2.5-Coder-14B-Qiskit (%) | Qwen2.5-Coder-14B-Qiskit-GGUF (%) |
|---|---|---|
| QiskitHumanEval-Hard | 25.17 | 26.49 |
| QiskitHumanEval | 49.01 | 35.10 |
| HumanEval | 91.46 | 77.44 |
| ASDiv (acc) | 4.21 | 3.56 |
| MathQA (acc) | 53.90 | 54.41 |
| SciQ (acc) | 97.00 | 97.50 |
| IFEval (prompt strict) | 49.64 | 36.23 |
| CrowsPairs English (% stereotype) | 65.18 | 65.00 |
| TruthfulQA (MC1 acc) | 37.82 | 37.33 |
4-bit
Base model
Qwen/Qwen2.5-14B