amd/Mixtral-8x7B-Instruct-v0.1-w4a16-llmcompressor
Text Generation • 47B • Updated • 423
AMD EPYC-compatible Models
-
-
amd/Qwen3.6-35B-A3B-w8a8-llmcompressor
Text Generation • 35B • Updated • 495 • 1 -
amd/gemma-4-26B-A4B-it-w8a8-llmcompressor
Text Generation • 26B • Updated • 735 -
amd/Llama-3.1-8B-Instruct-w4a16-llmcompressor
Text Generation • 8B • Updated • 374 -
amd/Llama-3.3-70B-Instruct-w4a16-llmcompressor-asym
Text Generation • 11B • Updated • 63 • 1 -
amd/Qwen3-VL-8B-Instruct-w4a16-llmcompressor
Image-Text-to-Text • 9B • Updated • 282 -
amd/Qwen3-VL-8B-Instruct-w8a8-llmcompressor
Image-Text-to-Text • 9B • Updated • 533 -
amd/gemma-4-12B-it-w8a8-llmcompressor
Text Generation • 12B • Updated • 286 -
amd/Phi-4-reasoning-plus-w8a8-llmcompressor
Text Generation • 15B • Updated • 122 -
amd/Mistral-7B-Instruct-v0.3-w4a16-llmcompressor-asym
Text Generation • 7B • Updated • 66 -
amd/gpt-oss-20b-BF16-w8a8-llmcompressor
Text Generation • 21B • Updated • 511 -
amd/granite-4.0-h-tiny-w4a16-llmcompressor
Text Generation • 7B • Updated • 86 -
amd/granite-4.0-h-tiny-w8a8-llmcompressor
Text Generation • 7B • Updated • 349 -
amd/Qwen3.6-35B-A3B-w4a16-llmcompressor
Text Generation • 35B • Updated • 1.31k -
amd/Instella-MoE-16B-A3B-SFT-w4a16-llmcompressor
Text Generation • 15B • Updated • 253 • 2 -
amd/gpt-oss-20b-BF16-w4a16-llmcompressor
Text Generation • 21B • Updated • 435 • 1 -
amd/granite-4.0-h-small-w4a16-llmcompressor
Text Generation • 32B • Updated • 224 -
amd/Instella-MoE-16B-A3B-SFT-w8a8-llmcompressor
Text Generation • 16B • Updated • 642 -
amd/Muse-Glimmer-30B-w8a8-llmcompressor
Text Generation • 30B • Updated • 484 -
amd/gemma-4-26B-A4B-it-w4a16-llmcompressor
Text Generation • 26B • Updated • 2.23k -
amd/gemma-4-12B-it-w4a16-llmcompressor
Text Generation • 12B • Updated • 1.4k • 2 -
amd/granite-4.0-h-small-w8a8-llmcompressor
Text Generation • 32B • Updated • 185 -
amd/Phi-4-mini-instruct-w4a16-llmcompressor
Text Generation • 4B • Updated • 573 • 1 -
amd/Qwen3.8-27B-w8a8-llmcompressor
Text Generation • 27B • Updated • 642 -
amd/Phi-4-reasoning-plus-w4a16-llmcompressor
Text Generation • 15B • Updated • 738 -
amd/Mixtral-8x7B-Instruct-v0.1-w8a8-llmcompressor-v0.10.0.2
Text Generation • 47B • Updated • 531