Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,438

Base only

Active filters: quantization

AMR5210/qwen3-0.6b-qat-q2k

Text Generation • 0.6B • Updated 6 days ago • 59

vxltxrllc/Qwen3-32B-BA-IQ4_NL

33B • Updated 12 days ago • 183

willfalco/GLM-5.2-EXL3-TR3-3.36bpw

Text Generation • 175B • Updated 8 days ago • 234 • 1

infosave/Qwen3.6-35B-A3B-Escha-W2cmf

Text Generation • Updated 5 days ago • 2

Pier-Jean/Qwen3-4B-LLVQ-2bit

Updated 5 days ago

agiws/NeuralQuant

Updated 3 days ago

brokenjade/Confucius4-TTS-mlx-mix

Text-to-Speech • Updated 11 days ago • 13

KaedeTai/Qwen3.6-35B-A3B-Escha-W2-Codebook-Ref

Updated 11 days ago • 1

mmahdi-sz/FeyNobg-ONNX

Image Segmentation • Updated 11 days ago

momoe5445/gemma2-handy-lora

Text Generation • 3B • Updated 10 days ago • 22

hazardscarn10/indic-parler-tts-awq-int4

Text-to-Speech • Updated 10 days ago • 19

xv0y5ncu/gemma-4-31B-it-GLQ-trellis-3inst-4bpw

Image-Text-to-Text • 9B • Updated 7 days ago • 13

xv0y5ncu/gemma-4-E4B-it-GLQ-trellis-3inst-4bpw

Any-to-Any • 3B • Updated 7 days ago • 46

xv0y5ncu/gemma-4-E2B-it-GLQ-trellis-3inst-4bpw

Any-to-Any • 2B • Updated 7 days ago • 17

xv0y5ncu/gemma-4-12B-it-GLQ-trellis-3inst-4bpw

Any-to-Any • 4B • Updated 7 days ago • 13

willfalco/GLM-5.2-EXL3-TR3-3.40bpw

Text Generation • 176B • Updated 8 days ago • 106

dkhokhlov/whisper-tiny-hqq-4bit

Automatic Speech Recognition • 35.3M • Updated 2 days ago • 97

hazardscarn10/indic-conformer-600m-int8

Automatic Speech Recognition • Updated 9 days ago

dkhokhlov/whisper-base-hqq-4bit

Automatic Speech Recognition • 65.9M • Updated 2 days ago • 81

migtissera/x-jpeg

2.2M • Updated 8 days ago • 14

dkhokhlov/whisper-small-hqq-4bit

Automatic Speech Recognition • 0.2B • Updated 2 days ago • 79

GoedelMachines/dg-w4-kernels

Updated 6 days ago

malaiwah/DeepSeek-V2-Lite-Chat-SIQ-K4K3

4B • Updated 8 days ago • 216

Sayujaya14/Qwen3-1.7B-GGUF

Text Generation • 2B • Updated 8 days ago • 126

malvavisc0/Qwable-9B-Claude-Fable-5-GPTQ-Int4

Image-Text-to-Text • 9B • Updated 3 days ago • 36

eodus/Qwen3.6-35B-A3B-DBF-SIGN1

83B • Updated 8 days ago • 31

Pilcothink/Qwen3.5-9B-MixedInt4-AutoRound

Image-Text-to-Text • 4B • Updated 7 days ago • 23

rudrakshrakeshzodage/distil-whisper-large-v3-pytorch-q4

Automatic Speech Recognition • 0.8B • Updated 7 days ago • 17

rudrakshrakeshzodage/distil-whisper-large-v3-ct2-int8

Automatic Speech Recognition • Updated 7 days ago • 15

marcsun13/gguf-kernels

Updated 5 days ago