Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,441

Base only

Active filters: quantization

thisisaditichouhan/Phi-2-4bit-Quantized-Model

Text Generation • Updated Jul 12 • 3 • 1

lite-infer/z-image-turbo-nunchaku-lite-int4_r32-bnb4-text-encoder

Text-to-Image • 3B • Updated Jul 12 • 42

lite-infer/z-image-turbo-nunchaku-lite-nvfp4_r32-bnb4-text-encoder

Text-to-Image • 4B • Updated Jul 12 • 24

SC117/Ornith-1.0-35B-Heretic-MTP

Text Generation • 665k • Updated Jul 12 • 1.32k • 2

adrahmana/NanoFable-1M-fp16

Text Generation • 1.38M • Updated about 1 month ago • 232

adrahmana/NanoFable-6M-fp16

Text Generation • 5.87M • Updated about 1 month ago • 246

adrahmana/NanoFable-16M-fp16

Text Generation • 15.7M • Updated about 1 month ago • 232

developerabu/IndicF5-MNN

Text-to-Speech • Updated about 1 month ago

protoLabsAI/LTX-2.3-22B-distilled-NVFP4

Text-to-Video • Updated about 1 month ago • 3

mradermacher/Ornith-1.0-35B-Heretic-MTP-GGUF

36B • Updated about 1 month ago • 2.53k • 2

mradermacher/Ornith-1.0-35B-Heretic-MTP-i1-GGUF

36B • Updated 30 days ago • 3.04k • 2

Majipa/Qwen3-0.6B-GGUF-Quantized

Text Generation • 0.8B • Updated about 1 month ago • 1.41k • 2

gvij/parakeet-tdt-0.6b-v3-onnx-static-qdq-pc

Automatic Speech Recognition • Updated 29 days ago • 58 • 2

mastersubhajit/sarvam-30b-AWQ-GPTQ-Hybrid

6B • Updated 26 days ago • 1

adrahmana/NanoFable-1M-ternary

Text Generation • 1.38M • Updated about 1 month ago • 182

adrahmana/NanoFable-6M-ternary

Text Generation • 5.87M • Updated about 1 month ago • 183

adrahmana/NanoFable-16M-ternary

Text Generation • 15.7M • Updated about 1 month ago • 203

adrahmana/NanoFable-28M-ternary

Text Generation • 27.8M • Updated about 1 month ago • 209

adrahmana/NanoFable-28M-fp16

Text Generation • 27.8M • Updated about 1 month ago • 261

milo01/INT4-Convrot-Comfy-Models

Updated about 1 month ago • 1

arathishree/gpt-oss-20b-NVFP4

21B • Updated 29 days ago • 43

Ares-Realm-Studios/LingBot-30B-3B_GGUF_ComfyUI

Text-to-Video • 30B • Updated 30 days ago • 257 • 1

mastersubhajit/sarvam-30b-AWQ-4bit

7B • Updated 6 days ago • 1.71k

alonsopg/wmt26-layeraware-native-mlp-q4

Text Generation • Updated 29 days ago • 162

fieldsmodelorg/Olmo-3.1-32B-Think-OPD-ProofPilot

Updated 3 days ago

Litwein/Qwen3.6-35B-A3B-Claude-4.7-Opus-oQ4e-DWQ-MC-MTP-Vision-MLX

Image-Text-to-Text • 6B • Updated 29 days ago • 450 • 1

Litwein/Qwen3.6-35B-A3B-Claude-4.7-Opus-oQ4e-DWQ-MC-MTP-MLX

Text Generation • 6B • Updated 29 days ago • 619 • 1

Albertchen96/FlowDIS-int8-convrot

Image Segmentation • Updated 29 days ago

mirai-community/granite-3.3-2b-instruct-int4-gram

1B • Updated 6 days ago • 5

zacaj/Ornith-1.0-35B-unsloth_UD-IQ3_XXS-MTP-gguf

Text Generation • 36B • Updated 29 days ago • 970 • 1