Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,433

Base only

Active filters: quantization

0bserverx/Muse-Glimmer-30B-Heretic-Uncensored-GGUF

Image-Text-to-Text • 28B • Updated about 8 hours ago • 2

legraphista/DeepSeek-V2-Lite-IMat-GGUF

Text Generation • 16B • Updated May 26, 2024 • 1.84k • 4

legraphista/Hermes-2-Theta-Llama-3-8B-IMat-GGUF

Text Generation • 8B • Updated May 26, 2024 • 1.82k • 1

legraphista/internlm2-math-plus-1_8b-IMat-GGUF

Text Generation • 2B • Updated May 27, 2024 • 1.51k • 3

legraphista/internlm2-math-plus-mixtral8x22b-IMat-GGUF

Text Generation • 141B • Updated May 28, 2024 • 1.4k • 1

legraphista/NuminaMath-7B-TIR-IMat-GGUF

Text Generation • 7B • Updated Jul 11, 2024 • 286 • 2

legraphista/xLAM-8x7b-r-IMat-GGUF

Text Generation • 47B • Updated Aug 31, 2024 • 1.37k • 2

legraphista/xLAM-8x22b-r-IMat-GGUF

Text Generation • 141B • Updated Sep 1, 2024 • 2.08k • 1

legraphista/Yi-Coder-9B-Chat-IMat-GGUF

Text Generation • 9B • Updated Sep 5, 2024 • 648 • 2

Em-80/Qwen3-coder-REAP-25B-A3B-Rust-GGUF

Text Generation • 25B • Updated Jul 11 • 2.68k • 17

3ndetz/LTX2-Rapid-Merges-GGUF

Image-Text-to-Video • 19B • Updated Feb 3 • 424 • 25

JEILDLWLRMA/Qwen3-VL-8B-Instruct-NVFP4

Image-to-Text • 6B • Updated Feb 2 • 213k • 3

ApacheOne/Qwen2.5-VL-7B-Instruct-abliterated-nvfp4

Updated Feb 24 • 50 • 6

InsecureErasure/Wan2.1-I2V-14B-480P-StepDistill-CfgDistill-Lightx2v-NVFP4

Image-to-Video • Updated Jun 7 • 356 • 2

dangvansam/chandra-ocr-2-FP8-dynamic

Image-Text-to-Text • 5B • Updated May 26 • 13.1k • 1

Motif-Technologies/Motif-Video-2B-GGUF

Text-to-Video • 2B • Updated May 15 • 1k • 26

mack-williams/Light-Forcing

Updated Jun 9 • 2

webhie/Qwen3.6-27B-int4-AutoRound-Code

Image-Text-to-Text • 6B • Updated May 12 • 17.5k • 19

tturing/Qwen3-Omni-30B-A3B-Thinking-FP8

Any-to-Any • 32B • Updated May 22 • 283 • 2

dangvansam/chandra-ocr-2-NVFP4A16

Image-Text-to-Text • 3B • Updated May 26 • 1.4k • 2

Reza2kn/Cosmos3-Nano-MLX-8bit

Text-to-Image • Updated Jun 2 • 4

coolthor/gemma-4-12B-it-NVFP4A16

Any-to-Any • 7B • Updated Jun 5 • 2.44k • 1

coolthor/gemma-4-12B-it-FP8-dynamic

Any-to-Any • 12B • Updated 22 days ago • 12.1k • 2

Reza2kn/Higgs-Audio-v3-TTS-4bit-MLX

Text-to-Speech • Updated Jun 4 • 251 • 5

pjsmith/Qwen3.6-35B-A3B-2.6763bpw.gguf

35B • Updated Jun 7 • 8.67k • 5

tonera/vitoom-nunchaku

Updated Jun 30 • 8

molbal/krea2-gguf

Text-to-Image • 13B • Updated 16 days ago • 11.3k • 17

xero0000/Gordon-35B-A3B-mixed-q2k-imat

Text Generation • 35B • Updated 4 days ago • 256 • 2

Winnougan/Wan2.2-INT8-Convrot

Updated Jul 1 • 32

realrebelai/Boogu-Image-Edit-Turbo_GGUFs

10B • Updated Jul 1 • 5.41k • 5