| license: mit | |
| base_model: | |
| - Qwen/Qwen2.5-3B-Instruct | |
| pipeline_tag: text-generation | |
| tags: | |
| - onnx | |
| - onnxruntime-genai | |
| - oga | |
| My Tests (Tesla P4) | |
| - CUDA int4: TBD | |
| - CUDA int4_plh: TBD | |
| - CUDA fp16: TBD | |
| - CUDA fp16_plh: TBD | |
| license: mit | |
| base_model: | |
| - Qwen/Qwen2.5-3B-Instruct | |
| pipeline_tag: text-generation | |
| tags: | |
| - onnx | |
| - onnxruntime-genai | |
| - oga | |
| My Tests (Tesla P4) | |
| - CUDA int4: TBD | |
| - CUDA int4_plh: TBD | |
| - CUDA fp16: TBD | |
| - CUDA fp16_plh: TBD | |