Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

21,848

Full-text search

Active filters: llama-cpp

TitleOS/Qwen3-VL-Embedding-2B-GGUF

Feature Extraction • 0.4B • Updated 23 days ago • 287 • 1

LocoreMind/LocoOperator-4B-GGUF

4B • Updated 18 days ago • 3.39k • 11

InquiringMinds-AI/LongCat-Flash-Lite-GGUF

Text Generation • 69B • Updated 11 days ago • 1.23k • 5

cs2764/Huihui-Qwen3.5-35B-A3B-abliterated-Q8_0-GGUF

Image-Text-to-Text • 35B • Updated 15 days ago • 4.7k • 2

chenly124/Qwen3.5-4B-PaperWitch-heresy-Q8_0-GGUF

Text Generation • 4B • Updated 12 days ago • 764 • 2

OpenMOSS-Team/MOSS-TTS-GGUF

Text-to-Speech • Updated 7 days ago • 1.5k • 6

CorryL/piccolo_gorgone

9B • Updated 4 days ago • 1.37k • 1

EganAI/qwen3.5-9b-terminal-merge

Text Generation • 9B • Updated 7 days ago • 3.38k • 14

jamesburton/Phi-4-reasoning-vision-15B-GGUF

Text Generation • 15B • Updated 8 days ago • 27.2k • 3

miloK1/Qwen3-Embedding-4B-Q8_0-GGUF

Feature Extraction • 4B • Updated 7 days ago • 61 • 1

ghost-actual/Qwen3.5-27B-Claude-Opus-4.6-Distilled-heretic-GGUF

Text Generation • 27B • Updated 7 days ago • 868 • 3

lainlives/Qwen3.5-9B-Claude-4.6-HighIQ-INSTRUCT-HERETIC-UNCENSORED-GGUF

Image-Text-to-Text • 9B • Updated 7 days ago • 1.05k • 1

yusufbaykaloglu/qwen3.5-4b-turkish-sft-gguf

Text Generation • 4B • Updated 5 days ago • 405 • 1

VijayShinde1996/vrs-sft-Qwen2_5-7B-it

Text Generation • 8B • Updated 4 days ago • 37 • 1

welyjesch/hiligaynon_llama_3.1_finetuned_8b_gguf

8B • Updated 3 days ago • 804 • 1

shivamjha98/Agnes-8B

Text Generation • 8B • Updated 1 day ago • 195 • 1

Abhiray/LocoTrainer-4B-GGUF

Text Generation • 4B • Updated 1 day ago • 55 • 1

Jongsim/Qwen3.5-35B-A3B-heretic-Opus-4.6-Distilled-GGUF

Text Generation • Updated about 8 hours ago • 1

Lucy-in-the-Sky/NSFW-3B-Q4_K_M-GGUF

Text Generation • 3B • Updated Feb 19, 2025 • 338 • 2

Recouper/Qwen3-The-Xiaolong-Josiefied-Omega-Directive-22B-uncensored-abliterated-Q4_K_M-GGUF

Text Generation • 22B • Updated Jun 10, 2025 • 97 • 1

sahan77/Mistral_7B-Open_Hermes-NSFWV1-Q4_K_M-GGUF

7B • Updated 2 days ago • 92 • 1

RicardoEstep/RPBizkit-v6-12B-GGUF

12B • Updated 1 day ago • 83 • 1

arkii/chatglm2-6b-ggml

Updated Jul 26, 2023 • 6

BUT-FIT/csmpt7b

Text Generation • 7B • Updated May 21, 2025 • 290 • 17

pcuenq/TinyLlama-1.1B-Chat-v1.0-Q4_K_M-GGUF

1B • Updated Mar 29, 2024 • 22

reach-vb/phi-2-Q2_K-GGUF

Text Generation • 3B • Updated Mar 27, 2024 • 7

reach-vb/TinyLlama-1.1B-Chat-v1.0-Q2_K-GGUF

1B • Updated Jun 19, 2024 • 89

reach-vb/TinyLlama-1.1B-Chat-v1.0-Q8_0-GGUF

1B • Updated Mar 27, 2024 • 1

osanseviero/TinyLlama-1.1B-Chat-v1.0-Q4_K_M-GGUF

1B • Updated Mar 27, 2024 • 21

LeroyDyer/Language_VisionModel_GGUF

Image-Text-to-Text • 7B • Updated Aug 26, 2024 • 29 • 2