Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,617

Base only

Active filters: quantization

HarimxChoi/WarpQuant-Qwen3.8-27B-R16E4H4

Image-Text-to-Text • 28B • Updated 6 days ago • 20

caiovicentino1/Qwen3.8-27B-GPTQ-gs64-FOEM

Text Generation • 27B • Updated 6 days ago • 115

PollardWeights/Qwen2.5-1.5B-Instruct-Pollard

Text Generation • 2B • Updated 6 days ago • 314

mickyba/Qwen3.8-27B-3bit-mlx

Image-Text-to-Text • 4B • Updated 6 days ago • 486

HarimxChoi/WarpQuant-Qwen3.8-27B-R16E4H4-Text

Text Generation • 27B • Updated 6 days ago • 227

Myric/abliteration-token-efficiency-study

27B • Updated 6 days ago • 53

CobrIX/CobrIX-1.0-Coder-Flash-33B-A13B-GGUF

Text Generation • 33B • Updated 2 days ago • 386

HarimxChoi/WarpQuant-Qwen3.5-4B-R16E4V4

Image-Text-to-Text • 5B • Updated 6 days ago • 16

HarimxChoi/WarpQuant-Qwen3.5-4B-R16E4-Text

Text Generation • 4B • Updated 6 days ago • 140

HarimxChoi/WarpQuant-Llama-3-8B-R16E4H4

Text Generation • 8B • Updated 6 days ago • 132

superniker/qwen3.8-27b-g8l4i

Text Generation • Updated 6 days ago • 191

Ank0X0/needle2

Text Generation • Updated 6 days ago • 16

Frosty40/h3-spark

Updated 5 days ago

PeetPedro/quantal-classroom-1.6

Text Generation • Updated about 23 hours ago • 173

calneymgp/Qwen3.8-27B-NVFP4-lmhead4-recipe

Updated 5 days ago

Goodoldjam/DiffusionGemma-26B-E38-Abliterated-NVFP4

Image-Text-to-Text • 14B • Updated about 1 hour ago • 245

eaddario/IQ2_NL-IQ3_NL-Test-Models

Text Generation • 9B • Updated 3 days ago • 2.82k

Brunobkr/OFFFELLIA_Q2_K_huihui-ai_MTP-hybrid-Qwen3.8-27B-abliterated.gguf

Text Generation • 27B • Updated 5 days ago • 548

VikramPal/Qwen3-Omni-30B-A3B-Thinker-SLURP-DynQuant-3bit

Audio-Text-to-Text • 3B • Updated 5 days ago • 29

eemin/GLM-5.2-MXFP8-NVFP4-NF3-Hybrid

318B • Updated 5 days ago • 12

Brunobkr/OFFFELLIA_f16_huihui-ai_MTP-Qwen3.8-27B-abliterated.gguf

Text Generation • 27B • Updated 5 days ago • 213

tianxia2/CQ3-Qwen3-4B-K8-Channel-FP8-AWq

4B • Updated 5 days ago • 17

mlasli/Qwen3.8-27B-Heretic-Abliterated-MLX-6bit

Text Generation • 6B • Updated 5 days ago • 688

ikantkode/Qwen3.5-4B-AWQ-vd

5B • Updated 3 days ago • 37

michalakis99/turboquant-evo2-int4

Updated 5 days ago

dlab-cmu/sf-grids

Updated 4 days ago

lite-infer/krea-2-turbo-nunchaku-lite-nvfp4_r32-bnb4-text-encoder

Text-to-Image • 7B • Updated 4 days ago • 16

lite-infer/krea-2-turbo-nunchaku-lite-int4_r32-bnb4-text-encoder

Text-to-Image • 7B • Updated 4 days ago • 32

lightware-dev/parakeet-tdt-0.6b-v3

Automatic Speech Recognition • Updated 4 days ago • 187

KikoCis/Qwen3.8-27B-GGUF

Text Generation • 27B • Updated 3 days ago • 412