Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

11,594

Base only

Active filters: quantized

adamrb/mpt-30b-chat-w8a8-gptq

30B • Updated Jul 15, 2025 • 4

ramblingpolymath/qwen3-30B-A3B-w8a8

Text Generation • 31B • Updated Aug 2, 2025 • 10

ramblingpolymath/Qwen3-0.6B-W8A8

Text Generation • 0.8B • Updated Aug 3, 2025 • 32

tachyphylaxis/DeepSeek-R1-0528-FP4

Text Generation • 397B • Updated Jul 18, 2025 • 6

SandLogicTechnologies/MedGemma-4B-IT-GGUF

4B • Updated Jul 29, 2025 • 155 • 4

PJEDeveloper/Mistral_Nemo_Instruct_2407-F16.gguf-Q4_K_M

12B • Updated Jul 23, 2025 • 2

sdurgi/bert_emotion_response_classifier_quantized

Text Classification • Updated Jul 19, 2025 • 10

Hariprasath28/orpheus-3b-4bit-AWQ

Text Generation • 3B • Updated Jul 19, 2025 • 1.1k

mirekphd/whisper-large-v3-onnx-fp16

Automatic Speech Recognition • Updated Jul 19, 2025 • 1

mirekphd/whisper-large-v3-onnx-w8a16-dynamic

Automatic Speech Recognition • Updated Jul 19, 2025 • 1

mirekphd/whisper-large-v3-onnx-w4a16-dynamic

Automatic Speech Recognition • Updated Jul 19, 2025 • 1

steampunque/Qwen2.5-VL-32B-Instruct-MP-GGUF

33B • Updated Feb 18 • 7

theprint/Zeth-Gemma3-4B-GGUF

Text Generation • 5B • Updated Aug 16, 2025 • 36

HackNetAyush/smollm2-135M-instruct-gguf-q8

Text Generation • 0.1B • Updated Jul 20, 2025 • 114 • 3

ericrisco/medical-gemma-3n-4b-gguf

7B • Updated Jul 28, 2025 • 15

nvidia/DeepSeek-R1-0528-NVFP4-v2

Text Generation • 394B • Updated Sep 2, 2025 • 680k • 23

steampunque/GLM-Z1-9B-0414-MP-GGUF

9B • Updated Feb 18 • 37 • 2

nvidia/DeepSeek-R1-NVFP4-v2

Text Generation • 394B • Updated Jul 22, 2025 • 1.94k • 8

YongdongWang/llama-3.2-1b-lora-qlora-dart-llm-gguf

Text Generation • 1B • Updated Jul 22, 2025 • 10

YongdongWang/llama-3.1-8b-lora-qlora-dart-llm-gguf

Text Generation • 8B • Updated Jul 23, 2025 • 6

YongdongWang/llama-3.2-3b-lora-qlora-dart-llm-gguf

Text Generation • 3B • Updated Jul 22, 2025 • 13

sugiv/cardvaultplus-500m-gguf

Image-to-Text • 0.4B • Updated Jul 22, 2025 • 28 • 2

PJEDeveloper/mistralai_Mistral-7B-Instruct-v0.3-F16.gguf-Q5_K_M

7B • Updated Jul 23, 2025 • 34

nufikq/tinyllama-php-finetuned-test1

Updated Jul 23, 2025

SaidzodaEng/Ameena_Qwen3-8B_e3_Quantised_gguf

8B • Updated Jul 23, 2025

Bastion-AI/SmolLM3-3B-GGUF

3B • Updated Jul 23, 2025 • 115 • 1

NVFP4/Qwen3-235B-A22B-Instruct-2507-FP4

Text Generation • 118B • Updated Jul 23, 2025 • 105 • 4

NVFP4/Qwen3-Coder-480B-A35B-Instruct-FP4

Text Generation • 241B • Updated Jul 23, 2025 • 29 • 3

nvidia/Qwen3-235B-A22B-Eagle3

Text Generation • 0.3B • Updated Jan 26 • 737 • 13

PJEDeveloper/mistralai_Mistral-7B-Instruct-v0.2-Q5_K_M

7B • Updated Jul 23, 2025 • 2