Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

24,097

Base only

Active filters: llama-cpp

schuellerf/TinyLlama-1.1B-Chat-v1.0-german-Q4_K_M-GGUF

Updated Jun 27, 2024 • 9 • 1

BafS/gemma-2-2b-it-Q4_K_M-GGUF

Text Generation • 3B • Updated Jul 31, 2024 • 993 • 5

SteelTalon/nephra_v1.0-Q4_K_M-GGUF

8B • Updated Aug 23, 2024 • 22 • 2

ClaudioItaly/Qwen2.5-Coder-7B-Instruct-Q5_K_M-GGUF

Text Generation • 8B • Updated Sep 19, 2024 • 674 • 1

TouchNight/Qwen2.5-14B_Uncencored-Q4_K_M-GGUF

Text Generation • 15B • Updated Sep 19, 2024 • 629 • 4

v8karlo/Qwen2.5-0.5B-Instruct-Q8_0-GGUF

Text Generation • 0.5B • Updated Oct 2, 2024 • 108 • 1

itlwas/Vikhr-Gemma-2B-instruct-Q4_K_M-GGUF

3B • Updated Dec 18, 2024 • 222 • 3

paultimothymooney/Qwen2.5-Coder-0.5B-Instruct-Q8_0-GGUF

Text Generation • 0.5B • Updated Jan 15, 2025 • 124 • 1

roleplaiapp/Qwen2.5-Coder-14B-Instruct-Uncensored-Q4_K_M-GGUF

Text Generation • 15B • Updated Jan 31, 2025 • 2.45k • 5

ggml-org/gte-small-Q8_0-GGUF

Sentence Similarity • 33.2M • Updated Feb 6, 2025 • 49 • 3

asuglia/Qwen2-VL-2B-Instruct-Q4_K_M-GGUF

Image-Text-to-Text • 2B • Updated Mar 10, 2025 • 404 • 3

jeiku/Gemma-3-4B-it-RP-Test-Q4_0-GGUF

4B • Updated Mar 15, 2025 • 19 • 1

mshojaei77/gemma-3-4b-persian-v0-abliterated-Q8_0-GGUF

4B • Updated Mar 19, 2025 • 54 • 2

sudomoniker/all-MiniLM-L6-v2-Q8_0-GGUF

Sentence Similarity • 22.6M • Updated Mar 24, 2025 • 1.49k • 2

Tesslate/UIGEN-T2-7B-Q8_0-GGUF

Text Generation • 8B • Updated May 6, 2025 • 28 • 136

enacimie/Qwen3-1.7B-Q4_K_M-GGUF

Text Generation • 2B • Updated Dec 30, 2025 • 692 • 2

jmarxsen/medgemma-27b-text-it-Q4_K_M-GGUF

Text Generation • 27B • Updated Jun 13, 2025 • 13 • 1

ggml-org/Qwen3-Coder-30B-A3B-Instruct-Q8_0-GGUF

Text Generation • 31B • Updated Aug 20, 2025 • 1.24k • 12

AlicanKiraz0/BaronLLM-v2-OffensiveSecurityLLM-Q8

15B • Updated Aug 21, 2025 • 318 • 29

jinaai/jina-reranker-v3-GGUF

Text Ranking • 0.6B • Updated Oct 4, 2025 • 3.82k • 20

ethanolivertroy/HackIDLE-NIST-Coder-v1.1-GGUF

8B • Updated Apr 23 • 176 • 7

yanolja/YanoljaNEXT-Rosetta-27B-2511-GGUF

Translation • 28B • Updated Nov 2, 2025 • 479 • 6

Felladrin/gguf-MXFP4-gpt-oss-20b-Derestricted

Text Generation • 21B • Updated Dec 5, 2025 • 163 • 16

enacimie/Qwen3-0.6B-Q4_K_M-GGUF

Text Generation • 0.8B • Updated Dec 23, 2025 • 361 • 2

ruv/ruvltra-claude-code

Text Generation • 0.5B • Updated Mar 28 • 9.1k • 184

squ11z1/gpt-oss-nano

Text Generation • 9B • Updated 25 days ago • 4.33k • 23

mradermacher/gpt-oss-nano-GGUF

9B • Updated Jan 30 • 186 • 1

lainlives/Qwen3-Coder-30B-A3B-Instruct_Pruned_REAP-15B-A3B-SafeTensors-Q4_K_M-GGUF

16B • Updated Jan 31 • 300 • 3

jinaai/jina-embeddings-v5-text-small-retrieval

Sentence Similarity • 0.6B • Updated Apr 15 • 134k • 25

LegoKeeper/Qwen3-4b-Moe-Q4_K_M-GGUF

4B • Updated Feb 8 • 42 • 1