Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

3,397

Base only

Active filters: quantization

lite-infer/z-image-turbo-nunchaku-lite-nvfp4_r32-bnb4-text-encoder

Text-to-Image • 4B • Updated Jul 12 • 39

sakamakismile/Huihui-ThinkingCap-Qwen3.6-27B-abliterated-NVFP4

Image-Text-to-Text • 17B • Updated Jul 12 • 374 • 38

SC117/Ornith-1.0-35B-Heretic-MTP

Text Generation • Updated 5 days ago • 433 • 3

adrahmana/NanoFable-1M-fp16

Text Generation • 1.38M • Updated Jul 13 • 35

adrahmana/NanoFable-6M-fp16

Text Generation • 5.87M • Updated Jul 13 • 20

adrahmana/NanoFable-16M-fp16

Text Generation • 15.7M • Updated Jul 13 • 19

developerabu/IndicF5-MNN

Text-to-Speech • Updated Jul 13

protoLabsAI/LTX-2.3-22B-distilled-NVFP4

Text-to-Video • Updated Jul 13 • 3

mradermacher/Ornith-1.0-35B-Heretic-MTP-GGUF

36B • Updated Jul 13 • 755 • 3

mradermacher/Ornith-1.0-35B-Heretic-MTP-i1-GGUF

36B • Updated Jul 14 • 998 • 2

Majipa/Qwen3-0.6B-GGUF-Quantized

Text Generation • 0.8B • Updated Jul 13 • 433 • 2

gvij/parakeet-tdt-0.6b-v3-onnx-static-qdq-pc

Automatic Speech Recognition • Updated Jul 15 • 28 • 2

mastersubhajit/sarvam-30b-AWQ-GPTQ-Hybrid

6B • Updated Jul 18 • 24

adrahmana/NanoFable-1M-ternary

Text Generation • 1.38M • Updated Jul 13 • 22

adrahmana/NanoFable-6M-ternary

Text Generation • 5.87M • Updated Jul 13 • 17

adrahmana/NanoFable-16M-ternary

Text Generation • 15.7M • Updated Jul 13 • 21

adrahmana/NanoFable-28M-ternary

Text Generation • 27.8M • Updated Jul 13 • 55 • 1

adrahmana/NanoFable-28M-fp16

Text Generation • 27.8M • Updated Jul 13 • 18

milo01/INT4-Convrot-Comfy-Models

Updated Jul 13 • 2

arathishree/gpt-oss-20b-NVFP4

21B • Updated Jul 14 • 19

Ares-Realm-Studios/LingBot-30B-3B_GGUF_ComfyUI

Text-to-Video • 30B • Updated Jul 14 • 164 • 1

mastersubhajit/sarvam-30b-AWQ-4bit

7B • Updated Aug 7 • 2.14k • 1

alonsopg/wmt26-layeraware-native-mlp-q4

Text Generation • Updated Jul 14 • 13

fieldsmodelorg/FM-Pochi-32B-ProofPilot

Litwein/Qwen3.6-35B-A3B-Claude-4.7-Opus-oQ4e-DWQ-MC-MTP-Vision-MLX

Image-Text-to-Text • 36B • Updated Jul 15 • 299 • 3

Litwein/Qwen3.6-35B-A3B-Claude-4.7-Opus-oQ4e-DWQ-MC-MTP-MLX

Text Generation • 36B • Updated Jul 15 • 116 • 1

Albertchen96/FlowDIS-int8-convrot

Image Segmentation • Updated Jul 14 • 1

mirai-community/granite-3.3-2b-instruct-int4-gram

1B • Updated Aug 6 • 6

zacaj/Ornith-1.0-35B-unsloth_UD-IQ3_XXS-MTP-gguf

Text Generation • 36B • Updated Jul 15 • 65 • 2

realrebelai/Wan_Dancer_GGUFs

17B • Updated Jul 17 • 3.39k • 16