Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

3,197

Base only

Active filters: quantization

enesor0/pulsar-acoustic

Audio Classification • Updated Aug 22 • 43

enesor0/pulsar-radar

Updated Aug 22 • 20

liuwangaaaa/SPARK

Object Detection • Updated Aug 23

itamiArika/htdemucs-int8-memory

Audio-to-Audio • Updated Aug 23

eemin/Qwen3.8-27B-NVFP4-lmhead4-recipe

sleepyeldrazi/Ornith-1.5-REAP-20B-A3B-GGUF

19B • Updated Aug 24 • 1.85k • 3

kwanhee/Qwen3-30B-A3B-P48NVFP4-W4A4-GS32-GW2

31B • Updated Aug 23 • 23

KaedeTai/mlx-mtp-graft

oxfrug/chronos-2-int8-torchao

Time Series Forecasting • 0.1B • Updated Aug 23 • 16

KaedeTai/Qwen3.x-27B-mlx-mtp-graft

Oxidez/DeepSeek-V4-Flash-0731-UD-IQ3_IQ2-XS

Text Generation • 284B • Updated Aug 23 • 40

neopolita/Qwen3.6-19B-A3B-Niwaki-v2-2bit-mlx

Text Generation • 1.58k • Updated Aug 23 • 66

neopolita/Qwen3.6-19B-A3B-Niwaki-v2-4bit-mlx

Text Generation • 1.58k • Updated Aug 23 • 75

Ttimms/KAT-Coder-V2.5-Dev-REAP-50-NVFP4A16-GPTQ

Text Generation • 19B • Updated 23 days ago • 110

biMEMO/Ornith-1.5-35B-A3B-int4-AutoRound-MTP

6B • Updated Aug 24 • 5.96k • 5

agiws/Qwen3.8-27B-NQ-SVD-IQ2

Updated 1 day ago

slevinw/Muse-Glimmer-30B-Heretic-Uncensored-GGUF

Image-Text-to-Text • 28B • Updated Aug 24 • 1.22k

vcruz305/Muse-Glimmer-30B-Hermes-Agentic-NVFP4

Image-Text-to-Text • 19B • Updated Aug 24 • 229

MESHIVEAI/Qwen-3.8-27B-Q4_K_M-Imatrix

Text Generation • 27B • Updated 4 days ago • 116

casperhansen/Qwen3.6-35B-A3B-MXFP4xMXFP8

36B • Updated about 1 month ago • 123

mesiu650/GR00T-N1.6-LIBERO-llm-w4a4-flatquant-tf32

Updated Aug 24 • 4

LayerNorm/Qwen3-ASR-0.6B-hf-hqq-int4

Automatic Speech Recognition • 0.5B • Updated Aug 24 • 10

Kindadodgy/qwen38-256k-on-16gb

Text Generation • 27B • Updated Aug 24 • 569 • 1

matbee/LFM2.5-350M-Instruct-ONNX-Vulkan

Text Generation • Updated Aug 24

gbuzhf/ICE-quantization

Updated Aug 25 • 5

arashakb/FastWAM_UR3

Robotics • Updated Aug 25

peasantsmith/gpt-oss-120b-PS-IQ4_NL.gguf

Text Generation • 117B • Updated about 1 month ago • 282 • 2

xedro98/quantization-as-a-transfer-constraint

Updated Aug 25 • 1

altaidevorg/turkish-bge-m3-model2vec-turboquant-4bit

Feature Extraction • Updated Aug 25 • 10

altaidevorg/turkish-bge-m3-model2vec-turboquant-2bit

Feature Extraction • Updated Aug 25 • 55 • 1