Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

5,308

Base only

Active filters: llama.cpp

Jianqiao1/Qwen3.6-27B-MTP-MoQ-GGUF

27B • Updated about 15 hours ago • 2

BirdieByte1024/doctor-dental-implant-LoRA-Qwen2.5-7B-Instruct-FullModel

8B • Updated Apr 12, 2025 • 13 • 1

LiquidAI/LFM2-350M-GGUF

Text Generation • 0.4B • Updated Mar 30 • 4.86k • 58

LiquidAI/LFM2-700M-GGUF

Text Generation • 0.7B • Updated Mar 30 • 3.82k • 50

LiquidAI/LFM2-8B-A1B-GGUF

Text Generation • 8B • Updated Mar 30 • 4.68k • 109

pramodlohra/Qween3_4B_thinking_finetune

4B • Updated Oct 21, 2025 • 33.9k • 3

prithivMLmods/chandra-OCR-GGUF

Image-Text-to-Text • 8B • Updated Nov 14, 2025 • 621 • 13

meetara-lab/meetara-qwen3-4b-instruct-gguf

4B • Updated Mar 7 • 28 • 1

infil00p/granite-docling-258M-GGUF

Image-Text-to-Text • 0.2B • Updated Dec 5, 2025 • 212 • 1

GTKING/ZFusionAI_Hacker

2B • Updated Jan 15 • 240 • 1

danielhanchen/functiongemma-gguf

0.3B • Updated Dec 23, 2025 • 42 • 1

LiquidAI/LFM2.5-1.2B-Base-GGUF

Text Generation • 1B • Updated Jan 5 • 562 • 19

TeichAI/Qwen3-4B-Thinking-2507-MiniMax-M2.1-Distill-GGUF

4B • Updated Jan 7 • 1.1k • 7

LiquidAI/LFM2-ColBERT-350M-GGUF

Sentence Similarity • 0.4B • Updated Jan 5 • 5.91k • 15

LiquidAI/LFM2.5-Audio-1.5B-GGUF

1B • Updated Mar 30 • 23.4k • 104

coder3101/Ministral-3-8B-Reasoning-2512-heretic-GGUF

8B • Updated Jan 18 • 336 • 4

jsonMartin/voyage-4-nano-gguf

Sentence Similarity • 0.3B • Updated Feb 2 • 180 • 4

mixer3d/step-3.5-flash-imatrix-gguf

Text Generation • 197B • Updated Feb 9 • 16 • 2

jinaai/jina-embeddings-v5-text-nano-retrieval

Sentence Similarity • 0.2B • Updated Apr 15 • 78.6k • 13

jinaai/jina-embeddings-v5-text-nano-text-matching

Sentence Similarity • 0.2B • Updated Apr 15 • 6.18k • 7

jinaai/jina-embeddings-v5-text-small-text-matching-GGUF

Sentence Similarity • 0.6B • Updated Feb 25 • 1.64k • 3

adambarbato/PaddleOCR-VL-For-Manga-GGUF

Image-Text-to-Text • 0.5B • Updated Feb 25 • 109 • 2

Yusiko/qwen3.5-prompter

Text Generation • 4B • Updated Mar 21 • 142 • 3

LiquidAI/LFM2.5-350M-GGUF

Text Generation • 0.4B • Updated Apr 8 • 11.3k • 67

TeichAI/Qwen3.5-4B-Claude-Opus-Reasoning-Distill-GGUF

4B • Updated Apr 1 • 631 • 19

prithivMLmods/Qwen3.5-9B-abliterated-v2-MAX

Image-Text-to-Text • 9B • Updated 8 days ago • 2.71k • 7

prism-ml/Bonsai-1.7B-gguf

Text Generation • 2B • Updated Apr 18 • 9.79k • 74

SuperPauly/harrier-oss-v1-0.6b-gguf

Feature Extraction • 0.6B • Updated Apr 1 • 720 • 4

lilyanatia/Bonsai-1.7B-requantized

2B • Updated Apr 27 • 151 • 6

lilyanatia/Bonsai-4B-requantized

4B • Updated Apr 27 • 115 • 4