Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

3,776

Base only

Active filters: instruct

Outlier-Ai/Qwen3-8B-MLX-4bit

Text Generation • 1B • Updated May 26 • 37

Outlier-Ai/Qwen3-4B-MLX-4bit

Text Generation • 0.6B • Updated May 26 • 21

Outlier-Ai/gpt-oss-20b-MLX-4bit

Text Generation • 21B • Updated May 5 • 33

Outlier-Ai/SmolLM3-3B-MLX-4bit

Text Generation • 0.5B • Updated May 26 • 7

Outlier-Ai/gemma-3-27b-it-MLX-4bit

Text Generation • 27B • Updated May 26 • 31

Outlier-Ai/gemma-3-4b-it-MLX-4bit

Text Generation • 0.6B • Updated May 26 • 31 • 1

mradermacher/Qwen3.6-35B-A3B-Esper3.1-i1-GGUF

35B • Updated Apr 20 • 464 • 2

Mal1cc/Llama3.3-8B-Instruct-Thinking-Heretic-Uncensored-Claude-4.5-Opus-High-Reasoning-i1-GGUF

8B • Updated Apr 20 • 354 • 1

mradermacher/GRaPE-2.1-Flash-GGUF

9B • Updated Apr 21 • 180

mradermacher/GRaPE-2.1-Flash-i1-GGUF

9B • Updated Apr 21 • 975

AyoubChLin/LFM2.5-1.2B-hermes-agent

Text Generation • 1B • Updated Apr 21 • 72 • 2

sseymens/Stiles-Seymens-Qwen2.5-7B-Generalist-Q4KM-GGUF

Text Generation • 8B • Updated 30 days ago • 388

cpral/Hermes-4-405B-exl3-5bpw

Text Generation • 129B • Updated Apr 22 • 7

mradermacher/DFlash-Qwen3.5-27B-Uncensored-GGUF

Text Generation • 27B • Updated Jun 24 • 498

ValiantLabs/Qwen3.6-27B-Esper3.1

Image-Text-to-Text • 28B • Updated Apr 23 • 12 • 9

Jackrong/Qwopus3.6-27B-v1-preview

Image-Text-to-Text • 28B • Updated Apr 23 • 71 • 48

Jackrong/Qwopus3.6-27B-v1-preview-GGUF

Image-Text-to-Text • 27B • Updated Jul 9 • 203k • 125

mradermacher/Qwen3.6-27B-Esper3.1-GGUF

27B • Updated Apr 23 • 222 • 2

skriptdiddie/Pentest_AI-IQ3_XXS-GGUF

7B • Updated Apr 23 • 4 • 1

Abiray/Qwopus3.6-27B-v1-preview-GGUF

Image-Text-to-Text • 27B • Updated Apr 23 • 106 • 7

mradermacher/gemma-4-31B-it-Guardpoint-GGUF

31B • Updated Apr 23 • 199

crazyi/Qwopus3.6-27B-v1-preview-mlx-8bit

Text Generation • 27B • Updated Apr 28 • 20

mradermacher/gemma-4-31B-it-Guardpoint-i1-GGUF

31B • Updated Apr 23 • 558 • 1

mradermacher/Qwen3.6-27B-Esper3.1-i1-GGUF

27B • Updated Apr 23 • 1.07k • 5

KyleHessling1/Qwopus3.6-27B-v1-preview-MLX-4bit

Text Generation • 27B • Updated Apr 23 • 19 • 1

AEON-7/Qwen3.6-27B-AEON-Ultimate-Uncensored-BF16

Text Generation • 27B • Updated Jul 15 • 6.61k • • 147

SL-AI/GRaPE-2-Nano

Image-Text-to-Text • 0.9B • Updated Apr 24 • 28 • 6

bharat3645/Llama3-OpenBioLLM-70B

Updated Apr 24 • 2

cpral/Hermes-4-405B-exl3-2bpw

Text Generation • 53B • Updated Apr 24 • 18

SL-AI/GRaPE-2-Nano_GGUF

Image-Text-to-Text • Updated Apr 24 • 2