Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

25,406

Base only

Active filters: llama-cpp

prism-ml/Ternary-Bonsai-2-27B-gguf

Text Generation • 27B • Updated about 5 hours ago • 2.99M • 2.04k

dealignai/Bonsai-2-27B-Ternary-CRACK-GGUF

Text Generation • 27B • Updated 7 days ago • 52.7k • 142

huihui-ai/Huihui-Qwen3.8-27B-abliterated-GGUF

Image-Text-to-Text • 27B • Updated 3 days ago • 2.23M • 885

prism-ml/Ternary-Bonsai-27B-gguf

Text Generation • 27B • Updated 24 days ago • 653k • • 1.4k

dealignai/Bonsai-2-27B-1bit-CRACK-GGUF

Text Generation • 27B • Updated 7 days ago • 27.3k • 79

Hikari07jp/Ternary-Bonsai-2-27B-Abliterated-GGUF

Text Generation • 27B • Updated 7 days ago • 12.7k • 46

RavichandranJ/Dolphin3-Cyber-8B-GGUF

Text Generation • 8B • Updated Jun 8 • 46.3k • 217

pottokao/Qwen-Image-2.1-PE-T2I-Heretic-GGUF

9B • Updated about 17 hours ago • 11.7k • 22

prism-ml/Ternary-Bonsai-2-27B-gguf-dev

Text Generation • 27B • Updated 7 days ago • 6.03k • 31

prism-ml/Bonsai-27B-gguf

Text Generation • 27B • Updated Jul 17 • 446k • 874

TokenRhythm/NeoHorse-1-4B-GGUF

Text Generation • 4B • Updated 15 days ago • 31.5k • 40

pottokao/Qwen-Image-2.1-PE-I2I-Heretic-GGUF

9B • Updated about 21 hours ago • 11.9k • 15

decent-jawfish/bonsai-2-27b-mtp

Text Generation • 27B • Updated 7 days ago • 3.95k • 14

Hikari07jp/Ternary-Bonsai-27B-Abliterated-LowDeg-GGUF

Text Generation • 27B • Updated Jul 22 • 11.9k • 43

jica98/qwen3.5-4B-super-coder

Text Generation • 4B • Updated Jun 27 • 36.9k • 106

dealignai/Xing4.0-29B-A4B-CRACK-GGUF

Text Generation • 31B • Updated 4 days ago • 2.9k • 11

TokenRhythm/NeoHorse-1-9B-GGUF

Text Generation • 9B • Updated 16 days ago • 26.3k • 32

deadbydawn101/RavenX-CyberAgent-Qwen3.6-35B-A3B-Opus-4.7-OpenMythos-Pentester-BugHunter-RATH-GGUF

Text Generation • 36B • Updated Jun 13 • 34.7k • 166

Blackfrost-AI/TERNARY-BONSAI-2-27B-DERISKED-GGUF

Image-Text-to-Text • 27B • Updated 6 days ago • 2.94k • 10

prithivMLmods/Qwen-Image-2.1-PE-I2I-GGUF

Image-Text-to-Text • 9B • Updated 4 days ago • 26.7k • 9

Jab1718/qwen3.8-flash-coder-26gb-gguf

Text Generation • 43B • Updated 14 days ago • 8.79k • 24

prism-ml/Ternary-Bonsai-8B-gguf

Text Generation • 8B • Updated Jun 10 • 384k • 159

AlicanKiraz0/Cybersecurity-BaronLLM_Offensive_Security_LLM_Q6_K_GGUF

Text Generation • 8B • Updated Jun 4, 2025 • 2.17k • 362

sillykiwi/Qwen3-4B-Cybersecurity-Heretic-16bit-Q4_K_M-GGUF

Text Generation • 4B • Updated Apr 3 • 2k • 21

SC117/Spark-X2.5-4B-abliterated-FIT-GGUF

Text Generation • 4B • Updated 19 days ago • 33k • 23

cygnal/Qwen3.8-Flash-Next-Heretic2-IQ4XS-NGQ4-GGUF

Image-Text-to-Text • 177B • Updated 5 days ago • 1.26k • 4

prithivMLmods/LensVLM-9B-GGUF

Image-Text-to-Text • 9B • Updated 2 days ago • 289 • 4

prism-ml/Bonsai-8B-gguf

Text Generation • 8B • Updated Apr 18 • 122k • 785

barozp/Qwen3.6-28B-REAP20-A3B-GGUF

Text Generation • 28B • Updated Apr 19 • 6.14k • 81

Abiray/Qwen3.8-27B-Q4_K_M-GGUF

Image-Text-to-Text • 27B • Updated Aug 14 • 15.4k • 25