Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,591

Base only

Active filters: coding

WaveCut/Nanbeige4.2-3B-heretic-MLX-DWQ-4bit

Text Generation • 4B • Updated Jul 23 • 151 • 1

nightmedia/Qwen3.6-27B-AllYourBase-qx64-hi-mlx

Image-Text-to-Text • 27B • Updated Jul 23 • 39 • 1

Aronstk15/Qwythos-9B-v2-PerfectSplit-GGUF

9B • Updated Jul 23 • 32

yangzex/KAT-Coder-V2.5-Dev-Q5_K_M-GGUF

Text Generation • 35B • Updated Jul 23 • 35

jaromer/Gemma4-31B-QAT-Uncensored-HauhauCS-Balanced-MTP

Image-Text-to-Text • 31B • Updated Jul 23 • 683 • 2

jaromer/Gemma4-26B-A4B-QAT-Uncensored-HauhauCS-Balanced-MTP

Image-Text-to-Text • 25B • Updated Jul 23 • 419

owao/KAT-Coder-V2.5-Dev-Q6_K-GGUF

Text Generation • 35B • Updated Jul 23 • 81 • 2

owao/KAT-Coder-V2.5-Dev-Q5_K_M-GGUF

Text Generation • 35B • Updated Jul 23 • 63 • 1

owao/KAT-Coder-V2.5-Dev-Q4_K_M-GGUF

Text Generation • 35B • Updated Jul 23 • 283 • 2

eugene-kamenev/KAT-Coder-V2.5-Dev-Q4_K_M-GGUF

Text Generation • 35B • Updated Jul 23 • 30

suryatmodulus/KAT-Coder-V2.5-Dev

Text Generation • 35B • Updated Jul 23 • 13

leonsarmiento/grug-35b-v2-6bit-XL-mlx

Image-Text-to-Text • 35B • Updated Aug 4 • 43 • 1

Petrouil/FrankenCPM-4x1B-A2B

Text Generation • 3B • Updated Jul 23 • 30 • 2

dealignai/Laguna-S-2.1-CRACK-GGUF

Text Generation • 118B • Updated Jul 24 • 176 • 17

RemySkye/KAT-Coder-V2.5-Dev-GGUF

Text Generation • 35B • Updated Jul 24 • 7.26k

mradermacher/KAT-Coder-V2.5-Dev-GGUF

35B • Updated Jul 24 • 1.49k • 2

Abiray/KAT-Coder-V2.5-Dev-Imatrix-GGUF

Text Generation • 35B • Updated Jul 24 • 925 • 7

deadbydawn101/gemma-4-E4B-Agentic-Sol-Fable-Reasoning-GeminiCLI-mlx-4bit

Text Generation • 8B • Updated Jul 24 • 714 • 4

mradermacher/KAT-Coder-V2.5-Dev-i1-GGUF

35B • Updated Jul 24 • 2.93k • 12

deadbydawn101/gemma-4-E4B-Agentic-Sol-Fable-Reasoning-GeminiCLI-GGUF

Text Generation • 8B • Updated Jul 24 • 2.22k • 8

vijinvinod/gemma-4-12B-agentic-fable5-composer2.5-v2-3.5x-tau2-GGUF

Text Generation • 12B • Updated Jul 24 • 402

Smilyai-labs/CodVa-1-Small

Text Generation • Updated Jul 29 • 88 • 1

Irfanuruchi/Qwen3-4B-Computer-Science-Models

Text Generation • Updated Jul 25 • 1

dealignai/Laguna-XS-2.1-CRACK-GGUF

Text Generation • 33B • Updated Jul 24 • 274 • 4

ilyakam/Geer-Ornith-1.0-35B-A3B-6bit-MLX

Image-Text-to-Text • 35B • Updated Aug 2 • 65

Trilogix1/Hugston-Macaron-V1-Tall

35B • Updated Jul 26 • 179 • 7

Neura-Tech-AI/Neuron-4B-Instruct

Text Generation • 4B • Updated Jul 27 • 202 • 1

velora-intelligence/velora-ai-v1

Text Generation • Updated Jul 25 • 1

Irfanuruchi/Qwen3-4B-Computer-Science-OpenVINO-INT4

Text Generation • Updated Jul 25 • 10

leonsarmiento/Salience-1.5-Pro-6bit-XL-mlx

Image-Text-to-Text • 35B • Updated Aug 4 • 13