Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

15,889

Base only

Active filters: quantized

LeonSaia/minerva

7B • Updated Jun 9, 2025 • 4

duydq12/Qwen2.5-Coder-7B-Instruct-FP8-dynamic

Text Generation • 8B • Updated Jun 9, 2025 • 6

duydq12/Qwen2.5-7B-Instruct-1M-FP8-dynamic

Text Generation • 8B • Updated Jun 9, 2025 • 4 • 1

duydq12/Qwen2.5-14B-Instruct-1M-FP8-dynamic

Text Generation • 15B • Updated Jun 9, 2025 • 3

duydq12/Qwen2.5-Coder-14B-Instruct-FP8-dynamic

Text Generation • 15B • Updated Jun 9, 2025 • 4

duydq12/QwQ-32B-FP8-dynamic

Text Generation • 33B • Updated Jun 9, 2025 • 7

duydq12/Qwen2.5-Coder-32B-Instruct-FP8-dynamic

Text Generation • 33B • Updated Jun 9, 2025 • 874

duydq12/GLM-4-32B-0414-FP8-dynamic

Text Generation • 33B • Updated Jun 9, 2025 • 59

duydq12/GLM-Z1-32B-0414-FP8-dynamic

Text Generation • 33B • Updated Jun 9, 2025 • 14

duydq12/nomic-embed-code-FP8-dynamic

Text Generation • 8B • Updated Jun 9, 2025 • 4 • 1

duydq12/Qwen2.5-Coder-1.5B-Instruct-FP8-dynamic

Text Generation • 2B • Updated Jun 9, 2025 • 16

duydq12/Qwen2.5-Coder-3B-Instruct-FP8-dynamic

Text Generation • 3B • Updated Jun 9, 2025 • 6

nikodoz/qwen2.5-7b-instruct-int4

Text Generation • 8B • Updated Jun 10, 2025 • 7 • 1

LibraxisAI/c4ai-command-a-03-2025-q5-mlx

Text Generation • Updated May 12

ReallyFloppyPenguin/Holo1-3B-GGUF

3B • Updated Jun 10, 2025 • 25 • 2

Hariprasath28/orpheus-3b-8bit-gptq

Text Generation • Updated Jun 10, 2025 • 27 • 1

QuantStack/Wan2.1_I2V_14B_FusionX-GGUF

Image-to-Video • 16B • Updated Jun 11, 2025 • 5.26k • 87

QuantStack/Phantom_Wan_14B_FusionX-GGUF

Image-to-Video • 14B • Updated Jun 12, 2025 • 2.87k • 36

RedHatAI/Llama-4-Maverick-17B-128E-Instruct-quantized.w4a16

Image-Text-to-Text • 405B • Updated Jun 12, 2025 • 226 • 1

LibraxisAI/Qwen3-235B-A22B-MLX-Q5

Text Generation • 235B • Updated May 11 • 21

sausheong/lexsg

Text Generation • 8B • Updated Jun 12, 2025 • 20

botirk/tiny-prompt-task-complexity-classifier

Text Classification • Updated Jun 12, 2025 • 49 • 3

Argonaut790/PA-stage2-Qwen7B-147-GGUF

8B • Updated Jun 12, 2025 • 1

komixenon/Llama-Sahabat-AI-v2-70B-IT-GGUF

Text Generation • 71B • Updated Jun 14, 2025 • 23

ReallyFloppyPenguin/sarvam-m-GGUF

24B • Updated Jun 14, 2025 • 41 • 1

cello78/sambanova-llama2-100-gguf-q8

Text Generation • 7B • Updated Jun 14, 2025 • 6

althayr/Gemma-3-Gaia-PT-BR-4b-it-GGUF

Text Generation • 4B • Updated Jun 14, 2025 • 12 • 1

althayr/Gemma-3-Gaia-PT-BR-4b-it-Q8_0-GGUF

Text Generation • 4B • Updated Jun 14, 2025 • 12

ReallyFloppyPenguin/DeepSeek-R1-0528-Qwen3-8B-GGUF

8B • Updated Jul 5, 2025 • 84

ReallyFloppyPenguin/MiniCPM4-8B-GGUF

8B • Updated Jun 14, 2025 • 37