Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

5,411

Base only

Active filters: llama.cpp

AbdelilahYounsi/Qwen2.5-0.5B-Instruct-summarization-GGUF

0.5B • Updated Dec 24, 2025 • 12

RinKana/Gemma3-4b-Deconstruct-V2-103-GGUF

4B • Updated Dec 24, 2025 • 24

spikymoth/G3-Heresy-MPOA-G-W99-D0.1099-R01-GGUF

Text Generation • 27B • Updated Dec 31, 2025 • 28

spikymoth/G3-Heresy-MPOA-G-W99-D0.0690-R02-GGUF

Text Generation • 27B • Updated Dec 31, 2025 • 241 • 3

spikymoth/G3-Heresy-MPOA-G-W99-D0.0394-R03-GGUF

Text Generation • 27B • Updated Dec 31, 2025 • 16

spikymoth/G3-Heresy-MPOA-G-W99-D0.1099-R01-i1-GGUF

Text Generation • 27B • Updated Dec 31, 2025 • 13

spikymoth/G3-Heresy-MPOA-G-W99-D0.0690-R02-i1-GGUF

Text Generation • 27B • Updated Dec 31, 2025 • 55 • 1

spikymoth/G3-Heresy-MPOA-G-W99-D0.0394-R03-i1-GGUF

Text Generation • 27B • Updated Dec 31, 2025 • 37

RinKana/DeepSeek-R1-Distill-Qwen-1.5B-bnb-4bit-Deconstruct-V2-GGUF

2B • Updated Dec 25, 2025 • 125

mizuxx/finetuned_model

21B • Updated Dec 25, 2025 • 5

spikymoth/G3-Heresy-MPOA-G-W99-D0.0199-R08-i1-GGUF

Text Generation • 27B • Updated Dec 31, 2025 • 13

prithivMLmods/DeepCaption-VLA-7B-AIO-GGUF

Image-Text-to-Text • 8B • Updated Dec 25, 2025 • 197 • 1

prithivMLmods/DeepCaption-VLA-V2.0-7B-AIO-GGUF

Image-Text-to-Text • 8B • Updated Dec 25, 2025 • 576 • 2

A5CENSION-SRT/mental-health-deepseek-v1-GGUF

8B • Updated Dec 25, 2025 • 20

RinKana/Qwen2.5-3B-Deconstruct-V2.3-GGUF

3B • Updated Dec 25, 2025 • 6

WarlordHermes/Magidonia-24B-v4.3-creative-ORPO-v3-GGUF

24B • Updated Dec 28, 2025 • 17

ermiaazarkhalili/Qwen2.5-0.5B-SFT-UltraChat-GGUF

0.5B • Updated Apr 18 • 50

Ashraya/gemma-270m-legal-gguf

0.3B • Updated Dec 25, 2025 • 1

prithivMLmods/LFM2-2.6B-Exp-GGUF

Text Generation • 3B • Updated Dec 25, 2025 • 168 • 5

icebird50817/gsm8k-llama31-8b-unsloth-lora

8B • Updated Dec 25, 2025 • 12

LiquidAI/LFM2-2.6B-Exp-GGUF

Text Generation • 3B • Updated Mar 30 • 2.66k • 64

alwaysfurther/deepfabric-blender-mcp-gguf

4B • Updated Dec 25, 2025 • 531 • 3

pavanc21/EMET-Mistral-2.0-GGUF

7B • Updated Dec 26, 2025 • 3

kalai4390/FunctionGemma_Q8_270M_finetuned_GGUF_MobileActionsdataset

0.3B • Updated Dec 25, 2025 • 10

johkamb/task-decomposer-270m

Text Generation • 0.3B • Updated Dec 25, 2025 • 1

ermiaazarkhalili/Qwen2.5-1.5B-SFT-UltraChat-GGUF

2B • Updated Apr 18 • 23

kalai4390/Gemma3N_4B_finetuned_Q8GGUF_conversation

7B • Updated Dec 25, 2025 • 13

Capibara-LLM/gemma-2-9b-it-Jopara-GGUF

9B • Updated Dec 26, 2025 • 14

ermiaazarkhalili/Qwen3-0.6B-SFT-UltraChat-GGUF

0.6B • Updated Apr 18 • 14

nullzero-live/gem3COMPILAR

4B • Updated Dec 26, 2025 • 8