Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

433

Base only

Active filters: lm-studio

eewer/small-agent-20260303-mlx-8bit

Text Generation • 1B • Updated Mar 4 • 8

rudycaz/qwen35-27b-phish-finetuned-gguf

Text Generation • 27B • Updated Mar 4 • 29

Featherlabs/Aethon-4b-GGUF

Text Generation • 4B • Updated Mar 8 • 167

dineth554/legion-coder-8m

Text Generation • 56.8M • Updated Mar 8 • 30

dineth554/legion-coder-8m-10k

Text Generation • 56.8M • Updated Mar 8 • 15

wakari/Qwen3.5-27B-heretic-GGUF

27B • Updated Mar 12 • 25

Swicked86/phi4-mm-gguf

Visual Question Answering • 4B • Updated Mar 20 • 611 • 3

vanch007/Huihui-Qwen3.5-35B-A3B-Claude-4.6-Opus-abliterated-mlx-bf16

Image-Text-to-Text • 35B • Updated Mar 18 • 33 • 1

vanch007/Huihui-Qwen3.5-35B-A3B-Claude-4.6-Opus-abliterated-mlx-8bit

Image-Text-to-Text • 10B • Updated Mar 18 • 31

vanch007/Huihui-Qwen3.5-35B-A3B-Claude-4.6-Opus-abliterated-mlx-4bit

Image-Text-to-Text • 6B • Updated Mar 18 • 35 • 2

hasnainayaz/qehwa-pashto-llm-gguf

Text Generation • Updated Mar 17 • 1

EMD123/tiny-aya-kosher-3.3B-GGUF

3B • Updated Mar 17 • 139 • 1

continuum-ai/qwen2.5-0.5b-general-forged

Text Generation • 0.5B • Updated Apr 11 • 26

continuum-ai/qwen2.5-1.5b-general-forged

Text Generation • 2B • Updated Apr 11 • 30

continuum-ai/qwen2.5-3b-general-forged

Text Generation • 3B • Updated Apr 11 • 17

continuum-ai/qwen3.5-4b-code-forged

Text Generation • 4B • Updated Apr 11 • 128 • 1

continuum-ai/qwen3.5-27b-code-forged

Text Generation • 27B • Updated Apr 11 • 44

FaisalFehad/Nemotron-3-Super-120B-A12B-MLX-6bit

Text Generation • 121B • Updated Mar 31 • 91 • 2

continuum-ai/qwen3.5-27b-code-forged-mlx-4bit

Text Generation • 14B • Updated Apr 11 • 205

continuum-ai/qwen3.5-4b-code-forged-defragged

Text Generation • 4B • Updated Apr 11 • 40

continuum-ai/qwen3.5-27b-code-forged-defragged

Text Generation • 26B • Updated Apr 11 • 46

continuum-ai/qwen3.5-4b-code-forged-GGUF

Text Generation • 4B • Updated Apr 11 • 557 • 6

WithinUsAI/IBM-Grok4-Ultra.Fast.Coder-1B-GGUF

Text Generation • 2B • Updated Mar 30 • 1.42k • 8

WithinUsAI/Llama3.2-Octo.Thinker.iNano-1B-GGUF

Text Generation • 1B • Updated Mar 30 • 41 • 1

jamezoon/qwen3-5-9b-medmcqa-gguf

Text Generation • 9B • Updated Mar 30 • 6

RyanGichuru254/Psych_Qwen_32B-GGUF

33B • Updated Mar 30 • 15

jamezoon/qwen3-14b-medmcqa-gguf

Text Generation • 15B • Updated Mar 30 • 5 • 1

tianrui6641/omnicoder_local9b_blackwell_coregen_hdlfix_v2_hf_r64_epoch1-gguf

Image-Text-to-Text • 9B • Updated Mar 31 • 87

mlx-community/Nemotron-3-Super-120B-A12B-MLX-6bit

Text Generation • 121B • Updated Mar 31 • 619 • 4

mlx-community/context-1-MLX-6bit

Text Generation • 21B • Updated Mar 31 • 19