Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

15,955

Base only

Active filters: quantized

avlp12/Krea-2-Turbo-Alis-MLX-8bit

Text-to-Image • Updated Jul 14 • 242 • 13

s-batman/Ornith-1.0-35B-NVFP4-MTP-GGUF

Text Generation • 36B • Updated Jun 29 • 7.86k • 39

AtomicChat/Ornith-9B-MLX-5bit

Text Generation • 9B • Updated Jul 22 • 155 • 1

s-batman/Ornith-1.0-9B-NVFP4-MTP-GGUF

Text Generation • 9B • Updated Jun 29 • 1.86k • 9

aday777/gemma-4-31B-it-abliterated-NVFP4

Text Generation • 31B • Updated 6 days ago • 1.73k • 1

Alittlehammmer/Qwen3.6-35B-A3B-DFlash-GGUF-llama.cpp

Text Generation • 0.4B • Updated Jun 29 • 69.9k • 9

InternScience/Agents-A1-FP8

Text Generation • 35B • Updated Jul 15 • 2.25k • 23

InternScience/Agents-A1-Q4_K_M-GGUF

Text Generation • 35B • Updated Jul 15 • 10.4k • 146

InternScience/Agents-A1-Q8_0-GGUF

Text Generation • 35B • Updated Jul 15 • 1.36k • 37

Jundot/Qwen3.6-35B-A3B-oQ4e-mtp

6B • Updated Jul 9 • 3.4k • 19

sylvanian/anima-int8

Text-to-Image • Updated Jul 14 • 3

mudler/Qwen-AgentWorld-35B-A3B-APEX-GGUF

35B • Updated 16 days ago • 5.94k • 13

supermind/int8_convrot_models

Updated Jul 25 • 20

Audio8/Audio8-ASR-0.1B-onnx-runtime

Automatic Speech Recognition • Updated Jul 15 • 156 • 14

AtomicChat/Qwen3.5-27B-DFlash-GGUF

Text Generation • 2B • Updated Jul 22 • 107 • 3

RemySkye/NVIDIA-Nemotron-Labs-3-Puzzle-75B-A9B-GGUF

78B • Updated Jul 14 • 2.68k • 10

alphaZimuth/Hy-MT2-30B-A3B-APEX-GGUF

Translation • 30B • Updated Jul 27 • 12.6k • 12

InternScience/Agents-A1-4B-Q8_0-GGUF

Text Generation • 4B • Updated Jul 14 • 188k • 46

mlx-community/MiniCPM5-1B-Claude-Opus-Fable5-V2-Thinking-OptiQ-4bit

Text Generation • 0.2B • Updated Jul 14 • 1.64k • 6

basecompute/Qwen3.5-2B

Text Generation • Updated Jul 27 • 17 • 1

smarttasks/bge-m3-GGUF

Feature Extraction • 0.6B • Updated Jul 14 • 491 • 1

wraps/FLUX.2-klein-9B-KV-INT8-ConvRot-ComfyUI

Updated Jul 15 • 6

ScottzillaSystems/RavenX-CyberAgent-Qwen3.6-35B-A3B-Opus-4.7-OpenMythos-Pentester-BugHunter-RATH-GGUF

Text Generation • 36B • Updated Jul 16 • 221 • 2

yashwork-byte/indic-conformer-600m-int8-onnx

Updated Jul 18 • 134 • 3

qvac/VisionPsy-Nano-460M-Flash-GGUFs

Image-Text-to-Text • 0.4B • Updated Jul 29 • 2.43k • 8

AutomatosX/AX-Gemma-4-12B-IT-MLX-QAT-OptiQ-4bit-Assistant-MTP

Image-Text-to-Text • 12B • Updated Jul 23 • 700 • 3

barozp/Qwen3.6-29B-REAP-Opus-Reasoning-Distill-MTP-GGUF

Text Generation • 29B • Updated Jul 22 • 2.39k • 9

Myric/Laguna-S-2.1-APEX-GGUF

Text Generation • 118B • Updated 7 days ago • 4.86k • 21

NullSense/Nanbeige4.2-3B-FP8-Dynamic

Text Generation • 4B • Updated Jul 24 • 308 • 2

litert-community/whisper-large-v3-turbo

Automatic Speech Recognition • Updated Jul 23 • 132 • 3