Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,530

Base only

Active filters: quantization

AvoCahDoe/llava-v1.6-mistral-7b-rlmpq-aggressive

AvoCahDoe/qwen2-vl-7b-rlmpq-balanced

Achta/gemma-4-E4B-it-distilled-awq

Image-Text-to-Text • 9B • Updated Jun 21 • 17

bilal-akhtar-ut/gemma-4-E4B-it-resilient-qat-q4

Image-Text-to-Text • 7B • Updated Jun 15

Crusadersk/quantsafe-refusal-modernbert

Text Classification • 0.1B • Updated Jun 13 • 11

xv0y5ncu/gemma-4-26B-A4B-it-GLQ-3bpw

Image-Text-to-Text • 7B • Updated 10 days ago • 243

xv0y5ncu/gemma-4-26B-A4B-it-GLQ-5bpw

Image-Text-to-Text • 11B • Updated 10 days ago • 14

xv0y5ncu/gemma-4-26B-A4B-it-GLQ-6bpw

Image-Text-to-Text • 11B • Updated 10 days ago • 17

Defnotirf/gemma-4-E4B-hybrid-GGUF

Image-to-Text • 8B • Updated Jun 14

aquaman164/Nex-N2-Pro-AutoBit-3.2bpw

Text Generation • Updated Jun 17 • 80

FilledVaccum/gemma-4-31B-awq-manual

javawock7618/comfy-ltx-2.x-workflows

Image-to-Video • Updated 4 days ago • 2

hansaka01/qwen2.5-7b-naive-1bit-ptq

Text Generation • Updated Jun 14

DJLougen/Qwen3.6-35B-A3B-REAP-90pct-GGUF

Text Generation • 6B • Updated Jun 14 • 750 • 17

tg-techie-agents/Q1D-4B-Blk0-V1

Text Generation • 4B • Updated Jun 14 • 21

anhnlq/Qwen3-30B-A3B-Q4_K_M-GGUF

Text Generation • 31B • Updated Jun 15 • 15

Abiray/SCAIL-2-GGUF

Image-to-Video • 16B • Updated Jun 14 • 8.99k • 11

tg-techie-agents/Q1D-8B-Blk0-V1

Text Generation • 8B • Updated Jun 19 • 14

MehulChourasia/sarvam-30b-compressed

32B • Updated Jun 16

Yingyaeliae/Ministral-3-14B-Nymphaea-RP-heretic

14B • Updated Jun 15 • 567

pearsonkyle/Qwopus3.6-27B-Coder-imatrix-MTP-GGUF

Text Generation • 27B • Updated Jun 25 • 625 • 6

Pranay2412/sarvam-30b-W4A16-Autoround

Text Generation • 7B • Updated Jun 15

tg-techie-agents/Q1D-4B-Blk0-V2

Text Generation • 4B • Updated Jun 19 • 7

ltl1605/voxtral-fp8-round2

Automatic Speech Recognition • Updated Jun 15

KikoCis/vq-llm-compression

Shankara-A-S/sarvam-30b-godspeed

Text Generation • 6B • Updated Jun 15 • 42

leonsarmiento/MechaEpstein-8000-6bit-mlx

8B • Updated 24 days ago • 33

ForeverBlue/Qwen3-VL-2B-GRACE-W4G128-AWQ

Image-Text-to-Text • 0.9B • Updated about 6 hours ago • 8 • 1

Shankara-A-S/sarvam-30b-distillation-method

SC117/Nex-N2-mini-template-fix-APEX-GGUF

Image-Text-to-Text • 35B • Updated Jun 26 • 252 • 1