Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,345

Base only

Active filters: tool-calling

danelcsb/localagent-ultra-tiny-1m

Text Generation • 977k • Updated Jun 4 • 4

danelcsb/localagent-tiny-30m-byte

Text Generation • 28.3M • Updated Jun 12 • 17

slevinw/Qwen3.5-9B-NSC-ACE-SABER-GGUF

9B • Updated Jun 4 • 47

slevinw/Qwen3.6-35B-A3B-NSC-ACE-SABER-GGUF

Image-Text-to-Text • 35B • Updated Jun 4 • 104

slevinw/Ornstein3.6-27B-MTP-NSC-ACE-SABER-GGUF

Image-Text-to-Text • 0.5B • Updated Jun 4 • 42

slevinw/Harmonic-Hermes-9B-GGUF

9B • Updated Jun 5 • 63

edan23/Gemma-4-12B-it-AEON-Abliterated-K4-BF16

Text Generation • 12B • Updated Jun 5 • 8

AEON-7/Gemma-4-12B-it-AEON-Abliterated-MLXFP4

Image-Text-to-Text • 4B • Updated Jun 21 • 671 • 3

AEON-7/Gemma-4-12B-it-AEON-Abliterated-MLX-8bit

Image-Text-to-Text • 4B • Updated Jun 21 • 1.3k • 4

phattrandeveloper/functiongemma-270m-function-calling

0.3B • Updated Jun 6 • 34

Basher17/Domyn-Small-v1.0-mlx-fp16

Text Generation • 10B • Updated Jun 5 • 4

sabeshbesh/angry-todo-caller-0.5b

Text Generation • 77.2M • Updated Jun 7 • 23

mradermacher/MiniCPM5-1B-heretic-som-GGUF

Text Generation • 1B • Updated Jun 5 • 249

mradermacher/MiniCPM5-1B-heretic-som-i1-GGUF

Text Generation • 1B • Updated Jun 5 • 794

mradermacher/Gemma-4-12B-it-AEON-Abliterated-K4-BF16-GGUF

Text Generation • 12B • Updated Jun 23 • 714 • 1

AEON-7/Gemma-4-12B-it-AEON-Abliterated-K4-NVFP4

Text Generation • 8B • Updated 29 days ago • 450 • 1

mradermacher/Gemma-4-12B-it-AEON-Abliterated-K4-BF16-i1-GGUF

Text Generation • 12B • Updated Jul 3 • 792 • 3

phattrandeveloper/functiongemma-270m-function-calling-v1

0.3B • Updated Jun 6 • 3

phattrandeveloper/functiongemma-270m-function-calling-v2

0.3B • Updated Jun 6 • 5

AEON-7/Gemma-4-12B-it-AEON-Abliterated-K4-FP8

Text Generation • 12B • Updated 29 days ago • 2.38k • 9

Mungert/MiniCPM5-1B-GGUF

Text Generation • 1B • Updated Jun 6 • 401

Ck-TnT/RavenX-CyberAgent-Qwen3.6-35B-A3B-Opus-4.7-OpenMythos-Pentester-BugHunter-RATH-mlx-mlx-4Bit

Text Generation • 35B • Updated Jun 6 • 383 • 1

AEON-7/Gemma-4-12B-it-AEON-Abliterated-K4-NVFP4-FP8

Text Generation • 8B • Updated 29 days ago • 3.01k

ArithaAI/aritha-ai-mini

Updated Jun 6 • 1

phattrandeveloper/gemma-4-bank-function-calling

5B • Updated Jun 7 • 7

lschaffer/qwen2.5-3b-weathersensorsmcp-ollama

Text Generation • 3B • Updated Jun 7 • 6

lschaffer/qwen3-4b-weathersensorsmcp-ollama

4B • Updated Jun 7 • 97

REDSOULTM/baxy-gemma4-E2B-GGUF

Text Generation • 5B • Updated Jun 7 • 11

lschaffer/ministral-3b-weathersensorsmcp-ollama

4B • Updated Jun 7 • 258

mjpsm/qwen-bash-experiment-model-lora

Text Generation • Updated Jun 7