Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,013,702

Base only

Active filters: endpoints_compatible

LH-Tech-AI/Apex-1.6-Instruct-350M

Text Generation • 0.4B • Updated Mar 31 • 41 • 7

rodrigomt/s2-pro-gguf

Text-to-Speech • 5B • Updated Mar 21 • 7.43k • 62

darkc0de/XortronCriminalComputingConfig-i1-GGUF

24B • Updated Mar 17 • 925 • 7

prithivMLmods/chandra-ocr-2-GGUF

Image-Text-to-Text • 5B • Updated May 15 • 10.3k • 35

bartowski/nvidia_Nemotron-Cascade-2-30B-A3B-GGUF

Text Generation • 32B • Updated Mar 22 • 8.48k • 45

janhq/Jan-v3.5-4B-gguf

Text Generation • 4B • Updated Mar 24 • 317k • 31

DavidAU/Qwen3.5-9B-Claude-4.6-Opus-Deckard-V4.2-Uncensored-Heretic-Thinking-GGUF

Image-Text-to-Text • 9B • Updated Mar 24 • 7.77k • 17

mradermacher/Qwen3.5-9B-Claude-4.6-Opus-Deckard-V4.2-Uncensored-Heretic-Thinking-i1-GGUF

9B • Updated Mar 24 • 35.6k • 10

timteh673/Mistral-Small-4-119B-Uncensored-GGUF

Text Generation • 119B • Updated Mar 31 • 877 • 5

prism-ml/Bonsai-4B-gguf

Text Generation • 4B • Updated Apr 18 • 18.1k • 54

nDimensional/Qwen3.5-9B-Uncensored-Safetensors

Image-Text-to-Text • 9B • Updated Apr 2 • 1.12k • • 7

agentscope-ai/QwenPaw-Flash-2B-Q4_K_M

2B • Updated Apr 9 • 265 • 4

llmfan46/Qwen3.5-9B-ultra-uncensored-heretic-GGUF

Image-Text-to-Text • 9B • Updated 23 days ago • 17.7k • 50

Jackrong/Qwopus3.5-9B-v3-GGUF

Image-Text-to-Text • 9B • Updated about 1 month ago • 17.2k • 375

ggml-org/gemma-4-E4B-it-GGUF

Any-to-Any • 8B • Updated 9 days ago • 38.3k • 74

mradermacher/Total04-DeepSeek-R1-Distill-Llama-70B-heretic-i1-GGUF

71B • Updated Apr 3 • 21.4k • 3

bartowski/google_gemma-4-E4B-it-GGUF

Image-Text-to-Text • 8B • Updated 8 days ago • 35.6k • 73

p-e-w/gemma-4-E2B-it-heretic-ara

Any-to-Any • 5B • Updated Apr 2 • 372 • 86

TrevorJS/gemma-4-E4B-it-uncensored-GGUF

Text Generation • 8B • Updated Apr 5 • 9.26k • 92

LiquidAI/LFM2.5-VL-450M-GGUF

Image-Text-to-Text • 0.4B • Updated 25 days ago • 9.34k • 59

mudler/GLM-4.7-Flash-APEX-GGUF

30B • Updated Apr 27 • 2.85k • 15

mudler/gemma-4-26B-A4B-it-heretic-APEX-GGUF

25B • Updated Apr 27 • 13.8k • 50

llmfan46/gemma-4-E4B-it-ultra-uncensored-heretic

Any-to-Any • 8B • Updated May 4 • 3.2k • 32

RedHatAI/gemma-4-26B-A4B-it-FP8-dynamic

Image-Text-to-Text • 27B • Updated 18 days ago • 1.2M • 37

McGill-NLP/A3-Qwen3.5-9B

Image-Text-to-Text • 9B • Updated Apr 16 • 263 • 8

llmfan46/gemma-4-26B-A4B-it-ultra-uncensored-heretic

Image-Text-to-Text • 26B • Updated May 5 • 1.99k • 40

mradermacher/gemma-4-31B-it-The-DECKARD-HERETIC-UNCENSORED-Thinking-GGUF

31B • Updated Apr 8 • 10.5k • 7

DavidAU/gemma-4-E4B-it-The-DECKARD-V2-Strong-HERETIC-UNCENSORED-Thinking

Any-to-Any • 8B • Updated Apr 14 • 20 • 7

infly/Infinity-Parser2-Pro

Image-Text-to-Text • 35B • Updated 15 days ago • 13.5k • 87

LiquidAI/LFM2.5-VL-450M

Image-Text-to-Text • 0.4B • Updated Apr 8 • 79.5k • 208