Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

52

Base only

Active filters: npu_16K

amd/CodeLlama-7b-Instruct-hf_rai_1.7.1_npu_16K

Text Generation • Updated Mar 31 • 18

amd/DeepSeek-R1-Distill-Llama-8B_rai_1.7.1_npu_16K

Text Generation • Updated Mar 31 • 18

amd/DeepSeek-R1-Distill-Qwen-1.5B_rai_1.7.1_npu_16K

Text Generation • Updated Mar 31 • 13

amd/DeepSeek-R1-Distill-Qwen-7B_rai_1.7.1_npu_16K

Text Generation • Updated Mar 31 • 15

amd/Llama-3.1-8B_rai_1.7.1_npu_16K

Text Generation • Updated Mar 31 • 7

amd/Llama-3.2-1B-Instruct_rai_1.7.1_npu_16K

Text Generation • Updated Mar 31 • 10

amd/Llama-3.2-1B_rai_1.7.1_npu_16K

Text Generation • Updated Mar 31 • 10

amd/Llama-3.2-3B-Instruct_rai_1.7.1_npu_16K

Text Generation • Updated Mar 31 • 11

amd/Llama-3.2-3B_rai_1.7.1_npu_16K

Text Generation • Updated Mar 31 • 17

amd/Meta-Llama-3.1-8B-Instruct_rai_1.7.1_npu_16K

Text Generation • Updated Mar 31 • 13

amd/Mistral-7B-Instruct-v0.1_rai_1.7.1_npu_16K

Text Generation • Updated Mar 31 • 9

amd/Mistral-7B-Instruct-v0.2_rai_1.7.1_npu_16K

Text Generation • Updated Mar 31 • 9

amd/Mistral-7B-Instruct-v0.3_rai_1.7.1_npu_16K

Text Generation • Updated Mar 31 • 13

amd/Mistral-7B-v0.3_rai_1.7.1_npu_16K

Text Generation • Updated Mar 31 • 9

amd/Phi-3-mini-128k-instruct_rai_1.7.1_npu_16K

Text Generation • Updated Mar 31 • 15

amd/Phi-3.5-mini-instruct_rai_1.7.1_npu_16K

Text Generation • Updated Mar 31 • 13

amd/Phi-4-mini-instruct_rai_1.7.1_npu_16K

Text Generation • Updated Mar 31 • 13

amd/Phi-4-mini-reasoning_rai_1.7.1_npu_16K

Text Generation • Updated Mar 31 • 10

amd/Qwen-2.5_1.5B_Instruct_rai_1.7.1_npu_16K

Text Generation • Updated Mar 31 • 10

amd/Qwen2-1.5B_rai_1.7.1_npu_16K

Text Generation • Updated Mar 31 • 8

amd/Qwen2-7B_rai_1.7.1_npu_16K

Text Generation • Updated Mar 31 • 10

amd/Qwen2.5-0.5B-Instruct_rai_1.7.1_npu_16K

Text Generation • Updated Mar 31 • 9

amd/Qwen2.5-7B-Instruct_rai_1.7.1_npu_16K

Text Generation • Updated Mar 31 • 8

amd/Qwen2.5-Coder-0.5B-Instruct_rai_1.7.1_npu_16K

Text Generation • Updated Mar 31 • 12

amd/Qwen2.5-Coder-1.5B-Instruct_rai_1.7.1_npu_16K

Text Generation • Updated Mar 31 • 8

amd/Qwen2.5-Coder-7B-Instruct_rai_1.7.1_npu_16K

Text Generation • Updated Mar 31 • 41 • 1

amd/Qwen2.5_3B_Instruct_rai_1.7.1_npu_16K

Text Generation • Updated Mar 31 • 14

amd/Gemma-3-4b_rai_1.8.0_npu_16K

Text Generation • Updated Jul 22 • 36 • 1

amd/Llama-3.1-8B_rai_1.8.0_npu_16K

Text Generation • Updated Jul 22 • 12

amd/Llama-3.2-1B-Instruct_rai_1.8.0_npu_16K

Text Generation • Updated Jul 22 • 14