Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

43

Base only

Active filters: zendnn

amd/Qwen3.6-35B-A3B-w8a8-llmcompressor-v0.12.0

Text Generation • 35B • Updated 3 days ago • 1.35k • 1

amd/Llama-3.1-8B-Instruct-da8w8-torchao-v0.16.0

Text Generation • Updated Apr 30 • 20 • 1

amd/Qwen2.5-VL-7B-Instruct-da8w8-torchao-v0.16.0

Image-Text-to-Text • Updated May 4 • 10

amd/Phi-4-da8w8-torchao-v0.16.0

Text Generation • Updated May 4 • 106

amd/Qwen3-14B-Instruct-da8w8-torchao-v0.16.0

Text Generation • Updated May 4 • 16

amd/gpt-oss-20b-BF16-da8w8-torchao-v0.17.0

Text Generation • 21B • Updated Jun 17 • 12

amd/granite-4.0-h-tiny-da8w8-torchao-v0.17.0

Text Generation • 7B • Updated Jun 17 • 9

amd/InternVL3-8B-da8w8-torchao-v0.17.0

Image-Text-to-Text • Updated May 27 • 10

amd/Mistral-7B-v0.1-da8w8-torchao-v0.17.0

Text Generation • 7B • Updated Jun 17 • 7

amd/Qwen3-30B-A3B-da8w8-torchao-v0.17.0

Text Generation • 31B • Updated May 27 • 8

amd/Qwen3-VL-8B-Instruct-da8w8-torchao-v0.17.0

Image-Text-to-Text • 9B • Updated May 27 • 11

amd/Qwen2.5-VL-7B-Instruct-da8w8-torchao-v0.17.0

Image-Text-to-Text • Updated May 27 • 16

amd/gpt-oss-20b-BF16-w8a8-llmcompressor-v0.10.0.2

Text Generation • 21B • Updated Jun 3 • 1.92k

amd/Llama-3.1-8B-Instruct-da8w8-torchao-v0.17.0

Text Generation • 8B • Updated Jun 17 • 169

amd/Llama-3.1-8B-Instruct-w4a16-tao-symchannel-torchao-v0.17.0

Text Generation • 8B • Updated May 27 • 8

amd/Phi-4-reasoning-plus-w4a16-tao-symchannel-torchao-v0.17.0

Text Generation • 15B • Updated May 27 • 8

amd/Llama-3.1-8B-Instruct-w4a16-tao-symgroup-torchao-v0.17.0

Text Generation • 8B • Updated May 27 • 237

amd/Llama-3.1-8B-Instruct-w4a16-asym-torchao-v0.17.0

Text Generation • 5B • Updated May 27 • 540

amd/gpt-oss-20b-BF16-w4a16-asym-torchao-v0.17.0

Text Generation • 21B • Updated May 27 • 5

amd/Llama-3.3-70B-Instruct-w4a16-asym-torchao-v0.17.0

Text Generation • 38B • Updated May 27 • 7

amd/Qwen3.5-9B-w4a16-asym-torchao-v0.17.0

Text Generation • 6B • Updated May 27 • 339

amd/Phi-4-reasoning-plus-w4a16-asym-torchao-v0.17.0

Text Generation • 8B • Updated May 27 • 140

amd/Mistral-7B-v0.1-w4a16-asym-torchao-v0.17.0

Text Generation • 4B • Updated May 27 • 3

amd/Qwen3.5-9B-w4a16-tao-symgroup-torchao-v0.17.0

Text Generation • 10B • Updated May 27 • 202

amd/Qwen3-VL-8B-Instruct-w4a16-asym-torchao-v0.17.0

Image-Text-to-Text • 5B • Updated May 27 • 98

amd/Qwen2.5-VL-7B-Instruct-w4a16-asym-torchao-v0.17.0

Image-Text-to-Text • Updated May 27 • 7

amd/Qwen3.5-9B-da8w8-torchao-v0.17.0

Text Generation • 9B • Updated Jun 30 • 251

amd/Llama-3.3-70B-Instruct-da8w8-torchao-v0.17.0

Text Generation • 71B • Updated Jun 30 • 13

amd/Phi-4-reasoning-plus-da8w8-torchao-v0.17.0

Text Generation • 15B • Updated Jun 30 • 100

amd/Phi-4-reasoning-plus-w4a16-tao-symgroup-torchao-v0.17.0

Text Generation • 15B • Updated May 27 • 121