Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

24,090

Base only

Active filters: llama-cpp

jinaai/jina-embeddings-v5-text-small-retrieval-GGUF

Sentence Similarity • 0.6B • Updated Feb 25 • 2.39k • 8

Aimin12/Qwen3-4B-Thinking-2507-Distill-Claude-Opus-4.6-Reasoning-Abliterated-Q4_K_M-GGUF

Text Generation • 4B • Updated Feb 20 • 256 • 2

ClinicDx1/ClinicDx

Text Generation • 4B • Updated Mar 16 • 46 • 1

forkjoin-ai/qwen2-audio-7b-instruct-gguf

Text-to-Audio • 8B • Updated 17 days ago • 1.48k • 2

jc-builds/Qwen3.5-9B-VLM-Q4_K_M-GGUF

Image-Text-to-Text • 9B • Updated Mar 18 • 6.49k • 10

FINAL-Bench/Darwin-35B-A3B-Opus-Q8-GGUF

Text Generation • 35B • Updated May 15 • 394 • 21

barozp/gemma-4-21b-a4b-it-REAP-GGUF

Text Generation • 21B • Updated Apr 6 • 980 • 14

continuum-ai/qwen3-coder-30b-a3b-compacted-19b-256k

Text Generation • 20B • Updated Apr 11 • 844 • 1

ermiaazarkhalili/Qwen3.5-0.8B-SFT-Claude-Opus-Reasoning-GGUF

Text Generation • 0.8B • Updated Apr 18 • 67 • 1

uid0/gemma-4-E4B-it-OBLITERATED-Q4_K_M-GGUF

Text Generation • 7B • Updated Apr 15 • 237 • 1

Centara/gemma-4-E4B-it-OBLITERATED-Q3_K_L-GGUF

Text Generation • 7B • Updated Apr 15 • 149 • 1

prism-ml/Ternary-Bonsai-1.7B-gguf

Text Generation • 2B • Updated 16 days ago • 2.98k • 24

prism-ml/Ternary-Bonsai-4B-gguf

Text Generation • 4B • Updated 16 days ago • 2.82k • 18

Youssofal/Kimi-K2.6-Abliterated-Heretic-GGUF

Text Generation • Updated Apr 21 • 20

wyrmiyu/Qwen-3.5-Opus-GLM-27B-Q5_K_M-GGUF

Image-Text-to-Text • 27B • Updated Apr 23 • 41 • 1

rico03/Qwen3.6-27B-Claude-Opus-Reasoning-Distilled-GGUF

Text Generation • 27B • Updated Apr 23 • 15.8k • 48

brunopio/Qwen3.5-14B-A3B-Claude-4.6-Opus-Reasoning-Distilled-reap-Q4_K_M-GGUF

Text Generation • 14B • Updated May 26 • 10.4k • 11

Abiray/Qwen3.6-27B-AEON-Ultimate-Uncensored-GGUF

Text Generation • 27B • Updated Apr 27 • 6.8k • 16

DAXZEIT/Qwen3.6-27B-Claude-Opus-Reasoning-Distilled-UD-Q5_K_XL-gguf

Text Generation • 27B • Updated May 20 • 467 • 1

darkc0de/gemma-4-31B-it-heretic-FP8-Dynamic-Q4_K_M-GGUF

Image-Text-to-Text • 31B • Updated May 2 • 127 • 1

Alex89912/Qwen3.6-27B-FP8-Q4_K_M-GGUF

Image-Text-to-Text • Updated May 2 • 240 • 1

DAXZEIT/Qwen3.6-27B-Claude-Opus-Reasoning-Distilled-UD-Q4_K_XL-gguf

Text Generation • 27B • Updated May 20 • 721 • 5

prithivMLmods/Q3.6-27B-GLM-5.1-DA-GGUF

Image-Text-to-Text • 27B • Updated 25 days ago • 4.32k • 3

BernTheCreator/Gemma-4-E4B-it-OBLITERATED-Q4_0-GGUF

Text Generation • 8B • Updated May 18 • 204 • 1

AtomicChat/Qwen3.6-27B-UDT-MTP-GGUF

27B • Updated May 13 • 2.09k • 10

zerokid/Llama-3.2-3B-ascii-cats-guide-lora-F32-GGUF

24.3M • Updated May 17 • 42 • 1

persadian/DeepSeek-V4-Flash-IQ1_S-XL

Text Generation • 229B • Updated about 1 month ago • 552 • 3

nopesadly/higgs-audio-v3-8b-stt-v2-Q4_K_M-GGUF

Automatic Speech Recognition • 8B • Updated 29 days ago • 479 • 3

gaston-parravicini/LFM2.5-8B-A1B-Uncensored-Gaston-GGUF

Text Generation • 8B • Updated 27 days ago • 9.7k • 15

sneedjak/Adelic-Gemma-4-12B-GGUF

Text Generation • 12B • Updated 19 days ago • 23.3k • 5