Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

3,040

Base only

Active filters: on-device

prism-ml/Ternary-Bonsai-2-27B-gguf

Text Generation • 27B • Updated 1 day ago • 3.34M • 2.17k

Cactus-Compute/needle3

Text Generation • Updated 8 days ago • 85.4k • 248

prism-ml/Ternary-Bonsai-2-27B-mlx-2bit

Text Generation • 27B • Updated 5 days ago • 59.3k • 387

huihui-ai/Huihui-Qwen3.8-27B-abliterated-GGUF

Image-Text-to-Text • 27B • Updated 6 days ago • 2.2M • 919

openbmb/MiniCPM5-2B

Text Generation • 3B • Updated 15 days ago • 767k • 1.69k

openbmb/MiniCPM5-2B-GGUF

Text Generation • 3B • Updated 15 days ago • 231k • 330

dealignai/Bonsai-2-27B-Ternary-CRACK-GGUF

Text Generation • 27B • Updated 9 days ago • 63.2k • 150

prism-ml/Ternary-Bonsai-27B-gguf

Text Generation • 27B • Updated 27 days ago • 639k • • 1.4k

dealignai/Bonsai-2-27B-1bit-CRACK-GGUF

Text Generation • 27B • Updated 9 days ago • 32.7k • 82

prism-ml/Bonsai-27B-gguf

Text Generation • 27B • Updated Jul 17 • 434k • 876

ganmoor-ai-labs/finanalyzer-indian-bank-statements

Text Generation • 2B • Updated 8 days ago • 543 • 12

prism-ml/Bonsai-27B-mlx-1bit

Text Generation • 2B • Updated Jul 14 • 1.1M • 258

FINAL-Bench/POCKET-Zimage-CPU

Text-to-Image • 6B • Updated 2 days ago • 76 • 40

chaoliangUNSW/Jev-Style-0.8B-Decision-v3-GGUF

Text Classification • 0.8B • Updated 1 day ago • 944 • 8

FINAL-Bench/POCKET-Qwen3.8-Flash-Next-GGUF

Text Generation • 177B • Updated 2 days ago • 164 • 51

openbmb/MiniCPM5-1B

Text Generation • 1B • Updated Aug 17 • 536k • 1.15k

Cactus-Compute/needle2

Text Generation • Updated 24 days ago • 24k • 328

Abiray/MiniCPM5-2B-heretic-abliterated-GGUF

Text Generation • 3B • Updated 19 days ago • 23.9k • 33

prism-ml/Ternary-Bonsai-8B-gguf

Text Generation • 8B • Updated Jun 10 • 371k • 161

prism-ml/Ternary-Bonsai-27B-mlx-2bit

Text Generation • 27B • Updated Jul 14 • 1.09M • 200

oddadmix/Kokoro-7M-Distill

Text-to-Speech • Updated 11 days ago • 597 • 31

Supertone/supertonic-3

Text-to-Speech • Updated May 18 • 28.5k • 971

desert-ant-labs/redact

Token Classification • Updated 4 days ago • 7.28k • 24

desert-ant-labs/voz

Automatic Speech Recognition • Updated 3 days ago • 227 • 42

openbmb/MiniCPM5-2B-MLX

Text Generation • 3B • Updated 15 days ago • 194k • 51

bartowski/MiniCPM5-2B-GGUF

Text Generation • 3B • Updated 17 days ago • 21.6k • 34

ginigen-ai/Edge-4B-TELL

Any-to-Any • 7B • Updated 8 days ago • 1.43k • 35

chaoliangUNSW/Jev-Style-0.8B-Decision-v3

Text Classification • 0.8B • Updated 1 day ago • 188 • 4

prism-ml/Bonsai-8B-gguf

Text Generation • 8B • Updated Apr 18 • 118k • 787

PeppX/gemma-4-e2b-uncensored-litertlm

Updated Jul 17 • 2.97k • 26