Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

11,598

Base only

Active filters: quantized

humbleakh/chain-of-zoom-8bit-complete-pipeline

Image-to-Image • Updated Jun 8, 2025 • 2

LeonSaia/minerva

7B • Updated Jun 9, 2025 • 4

duydq12/Qwen2.5-Coder-7B-Instruct-FP8-dynamic

Text Generation • 8B • Updated Jun 9, 2025 • 16

duydq12/Qwen2.5-7B-Instruct-1M-FP8-dynamic

Text Generation • 8B • Updated Jun 9, 2025 • 4 • 1

duydq12/Qwen2.5-14B-Instruct-1M-FP8-dynamic

Text Generation • 15B • Updated Jun 9, 2025 • 2

duydq12/Qwen2.5-Coder-14B-Instruct-FP8-dynamic

Text Generation • 15B • Updated Jun 9, 2025 • 2

duydq12/QwQ-32B-FP8-dynamic

Text Generation • 33B • Updated Jun 9, 2025 • 3

duydq12/Qwen2.5-Coder-32B-Instruct-FP8-dynamic

Text Generation • 33B • Updated Jun 9, 2025 • 24

duydq12/GLM-4-32B-0414-FP8-dynamic

Text Generation • 33B • Updated Jun 9, 2025 • 7

duydq12/GLM-Z1-32B-0414-FP8-dynamic

Text Generation • 33B • Updated Jun 9, 2025 • 1

duydq12/nomic-embed-code-FP8-dynamic

Text Generation • 8B • Updated Jun 9, 2025 • 9 • 1

duydq12/Qwen2.5-Coder-1.5B-Instruct-FP8-dynamic

Text Generation • 2B • Updated Jun 9, 2025 • 8

duydq12/Qwen2.5-Coder-3B-Instruct-FP8-dynamic

Text Generation • 3B • Updated Jun 9, 2025 • 13

nikodoz/qwen2.5-7b-instruct-int4

Text Generation • 8B • Updated Jun 10, 2025 • 6 • 1

LibraxisAI/c4ai-command-a-03-2025-q5-mlx

Text Generation • Updated May 12

ReallyFloppyPenguin/Holo1-3B-GGUF

3B • Updated Jun 10, 2025 • 46 • 2

Hariprasath28/orpheus-3b-8bit-gptq

Text Generation • Updated Jun 10, 2025 • 19 • 1

QuantStack/Wan2.1_I2V_14B_FusionX-GGUF

Image-to-Video • 16B • Updated Jun 11, 2025 • 1.96k • 87

QuantStack/Phantom_Wan_14B_FusionX-GGUF

Image-to-Video • 14B • Updated Jun 12, 2025 • 371 • 36

RedHatAI/Llama-4-Maverick-17B-128E-Instruct-quantized.w4a16

Image-Text-to-Text • 405B • Updated Jun 12, 2025 • 6.35k • 1

LibraxisAI/Qwen3-235B-A22B-MLX-Q5

Text Generation • 235B • Updated May 11 • 72

sausheong/lexsg

Text Generation • 8B • Updated Jun 12, 2025 • 10

botirk/tiny-prompt-task-complexity-classifier

Text Classification • Updated Jun 12, 2025 • 37 • 3

Argonaut790/PA-stage2-Qwen7B-147-GGUF

8B • Updated Jun 12, 2025 • 4

komixenon/Llama-Sahabat-AI-v2-70B-IT-GGUF

Text Generation • 71B • Updated Jun 14, 2025 • 18

ReallyFloppyPenguin/sarvam-m-GGUF

24B • Updated Jun 14, 2025 • 14 • 1

cello78/sambanova-llama2-100-gguf-q8

Text Generation • 7B • Updated Jun 14, 2025 • 10

althayr/Gemma-3-Gaia-PT-BR-4b-it-GGUF

Text Generation • 4B • Updated Jun 14, 2025 • 6 • 1

althayr/Gemma-3-Gaia-PT-BR-4b-it-Q8_0-GGUF

Text Generation • 4B • Updated Jun 14, 2025 • 8

ReallyFloppyPenguin/DeepSeek-R1-0528-Qwen3-8B-GGUF

8B • Updated Jul 5, 2025 • 65