Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

5,397

Base only

Active filters: llama.cpp

thiagoteams/gemma-3-4b-it-vn-lora

Text Generation • 4B • Updated Dec 18, 2025 • 3

prithivMLmods/Qwen3-VL-8B-Instruct-abliterated-v2-GGUF

Image-Text-to-Text • 8B • Updated Dec 15, 2025 • 7.7k • 25

prithivMLmods/Qwen3-VL-8B-Thinking-abliterated-v1-GGUF

Image-Text-to-Text • 8B • Updated Dec 15, 2025 • 456 • 1

TeichAI/Qwen3-8B-GPT-5.2-High-Reasoning-Distill-GGUF

8B • Updated Dec 21, 2025 • 773 • 4

AIMS2025/DeepSignal

Text Generation • 4B • Updated Apr 17 • 158 • 1

naveedashfaq/llama-3-8b-pruned-30-percent-taylor

6B • Updated Dec 16, 2025 • 15 • 1

ss-lab/IBM-granite-4.0-micro-GGUF

Text Generation • 3B • Updated Jan 11 • 18 • 1

ArslanRobo/llama-3.1-8b-instruct-smoothquant-Pruned30Tailor-fp16

Text Generation • 6B • Updated Dec 16, 2025 • 1

beratdgan/Qwen3-14B-Interview-Coach-v2

15B • Updated Dec 16, 2025 • 5

saisatwikkuppili/unslot-llama-3.2_1B_merged-gguf

1B • Updated Dec 16, 2025 • 7

saisatwikkuppili/unslot-llama-3.2_1B_merged-quantised

1B • Updated Dec 16, 2025 • 21

GTKING/ZFusionAI_Hacker

2B • Updated Jan 15 • 220 • 1

aotal/curso-ai-crew-llama3-8b-gguf

8B • Updated Dec 16, 2025 • 5

aotal/curso-ai-crew-Qwen2.5-7B-gguf

8B • Updated Dec 16, 2025 • 6

Christoferson/qwen2.5-500M-grpo-after-sft-both-basic-3000-3e-5-20251216-153659-GGUF

0.5B • Updated Dec 16, 2025 • 70

anezatra/gpt-oss-20b-eliza-v1-orpo-GGUF

21B • Updated Dec 25, 2025 • 34

moxin-org/Nemotron-3-Nano-30B-A3B-GGUF

Text Generation • 32B • Updated Dec 17, 2025 • 22 • 3

Harsha901/Qwen3_4B_GRPO_GGUF

Text Generation • 4B • Updated Dec 23, 2025 • 37

SMOK33Y3/gary-nemotron-8b-v2-gguf

8B • Updated Dec 17, 2025 • 15

atul0341/my-qwen-finetuned1_16

0.5B • Updated Dec 17, 2025 • 7

Christoferson/gemma3-270m-grpo-after-sft-sysmprompt-both-3000-1e-6-cosine-20251216-152129-GGUF

0.3B • Updated Dec 17, 2025 • 48

robiophantom/model

8B • Updated Dec 17, 2025

goldenall/phi4-imdb-sentiment

15B • Updated Dec 17, 2025 • 4

aotal/curso-ai-crew-llama3-8b-2-gguf

8B • Updated Dec 17, 2025 • 24

Sr-Carlos/model_SFT_gemma_3n_E2B_it-4B

4B • Updated Dec 17, 2025 • 53

ss-lab/Google-gemma-3-1b-it-GGUF

Text Generation • 1.0B • Updated Jan 11 • 56

NgVietAnh41/Qwen3-4b-it-test-VietMedQA-gguf

4B • Updated Dec 17, 2025 • 11

eigenben/llama-3-8b-bnb-4bit-alpaca-finetuned-gguf

8B • Updated Dec 17, 2025 • 4

TeichAI/Nemotron-Cascade-8B-Thinking-Claude-4.5-Opus-High-Reasoning-Distill-GGUF

8B • Updated Dec 17, 2025 • 401 • 8

ajvikram/Qwen2.5-Coder-3B-Network-Eng-GGUF

3B • Updated Dec 17, 2025 • 57