Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

21,848

Full-text search

Active filters: llama-cpp

NikolayKozloff/Phi-4-reasoning-plus-Q5_K_S-GGUF

Text Generation • 15B • Updated May 1, 2025 • 7 • 2

huihui-ai/BaronLLM_Offensive_Security-abliterated-GGUF

Text Generation • 8B • Updated Jun 11, 2025 • 543 • 34

AliCat2/Mistral-Small-3.2-24B-Instruct-2506-Text-Only-Q5_K_M-GGUF

24B • Updated Jun 30, 2025 • 19 • 2

Trendyol/Qwen3-14B-BaronLLM-v2-Q8

15B • Updated Aug 20, 2025 • 64 • 6

ggml-org/Qwen3-4B-Thinking-2507-Q8_0-GGUF

Text Generation • 4B • Updated Sep 22, 2025 • 344 • 2

ggml-org/Qwen3-Reranker-0.6B-Q8_0-GGUF

Text Ranking • 0.6B • Updated Oct 3, 2025 • 30k • 7

jinaai/jina-reranker-v3-GGUF

Text Ranking • 0.6B • Updated Oct 4, 2025 • 1.35k • 13

Ygz-08123/Qwen3-7B-Instruct-Q4_K_M-GGUF

8B • Updated Oct 13, 2025 • 1.36k • 1

dougeeai/llama-cpp-python-wheels

Updated Nov 9, 2025 • 7

echos-keeper/Qwen3-30B-A3B-Thinking-2507-Claude-4.5-Sonnet-High-Reasoning-Distill-Q5_K_M-GGUF

Text Generation • 31B • Updated Nov 17, 2025 • 115 • 2

PleIAs/Baguettotron-GGUF

0.3B • Updated Nov 19, 2025 • 1.46k • 10

Ex0bit/Elbaz-Olmo-3-7B-Instruct-abliterated

Text Generation • 7B • Updated Nov 30, 2025 • 412 • 3

ldostadi/Huihui-Ministral-3-3B-Reasoning-2512-abliterated-Q4_K_M-GGUF

3B • Updated Dec 6, 2025 • 34 • 1

matrixportalx/gemma-2-9b-it-abliterated-Q4_0-GGUF

9B • Updated Dec 25, 2025 • 49 • 1

tp7030/Qwen3-Coder-30B-A3B-Instruct-FP8-Q6_K-GGUF

Text Generation • 31B • Updated Dec 26, 2025 • 241 • 6

matrixportalx/Huihui-gemma-3n-E4B-it-abliterated-Q6_K-GGUF

Image-Text-to-Text • 7B • Updated Dec 27, 2025 • 16 • 1

Schwi07/Huihui-Qwen3-VL-8B-Instruct-abliterated-Q6_K-GGUF

Image-Text-to-Text • 8B • Updated Jan 2 • 168 • 1

AlicanKiraz0/Mihenk-LLM-14B-Turkish-Financial-Model-mlx-8Bit

15B • Updated Jan 16 • 14 • 9

squ11z1/gpt-oss-nano

Text Generation • 9B • Updated 16 days ago • 8.34k • 20

ijohn07/Qwen3-Coder-30B-A3B-Instruct-FP8-Q4_K_M-GGUF

Text Generation • 31B • Updated Feb 3 • 1.49k • 3

jinaai/jina-embeddings-v5-text-small-clustering

Feature Extraction • 0.6B • Updated 12 days ago • 13.9k • 5

jinaai/jina-embeddings-v5-text-small-classification

Text Classification • 0.6B • Updated 12 days ago • 15.1k • 3

jinaai/jina-embeddings-v5-text-nano-retrieval

Sentence Similarity • 0.2B • Updated 15 days ago • 26.5k • 8

jinaai/jina-embeddings-v5-text-nano-classification

Text Classification • 0.2B • Updated 15 days ago • 16.9k • 6

Xlnk/ruvltra-claude-code

Text Generation • 0.5B • Updated Feb 10 • 187 • 8

Edge-Quant/Nanbeige4.1-3B-Q4_K_M-GGUF

Text Generation • 4B • Updated Feb 11 • 11.4k • 37

NeshVerse/Uncensored_Nanbeige-4.1-3B-Q8_0-GGUF

4B • Updated 27 days ago • 223 • 2

jinaai/jina-embeddings-v5-text-small-retrieval-GGUF

Sentence Similarity • 0.6B • Updated 18 days ago • 6.86k • 5

jinaai/jina-embeddings-v5-text-small-text-matching-GGUF

Sentence Similarity • 0.6B • Updated 18 days ago • 6.43k • 2

jinaai/jina-embeddings-v5-text-small-classification-GGUF

Text Classification • 0.6B • Updated 18 days ago • 5.96k • 1