---
license: mit
base_model:
- Qwen/Qwen2.5-3B-Instruct
pipeline_tag: text-generation
tags:
- onnx
- onnxruntime-genai
- oga
---

My Tests (Tesla P4)
- CUDA int4: TBD
- CUDA int4_plh: TBD
- CUDA fp16: TBD
- CUDA fp16_plh: TBD