Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

5,313

Base only

Active filters: llama.cpp

rafw007/qwen36-a3b-claude-coder-llama.cpp-GGUF

Text Generation • 36B • Updated 1 day ago • 2.27k • 1

Chaouqi1/nextyou-qwen-training-gguf-v6

3B • Updated 1 day ago • 185 • 1

superbonyx/gemma-4-26B-A4B-it-qat-assistant-MTP-Q8_0.gguf

Text Generation • 0.4B • Updated 1 day ago • 180 • 1

Janvitos/gemma-4-31B-it-qat-assistant-MTP-Q8_0-GGUF

0.5B • Updated about 21 hours ago • 117 • 1

Vegss/CHADROCK3.6-35B-UNCENSORED-MTP-STRIX-LEAN

Text Generation • 36B • Updated about 20 hours ago • 6 • 1

LLM-OS-Models/LFM2.5-8B-A1B-Terminal-ToolBench-Full-SFT-1Epoch-GGUF

Text Generation • 8B • Updated about 8 hours ago • 1

yuxinlu1/Mellum2-12B-A2.5B-Claude-4.6-4.8-Opus-Thinking-GGUF

Text Generation • 12B • Updated about 1 hour ago • 1

junwatu/Mellum2-12B-A2.5B-Instruct-GGUF

Text Generation • 12B • Updated 7 days ago • 498 • 2

Mozzipa/ko_vicuna_7b_ggml_q4

Updated Apr 20, 2023 • 4

ManthanKulakarni/JQL_LLaMa_GGML

Text Generation • Updated Jun 26, 2023 • 2

mys/ggml_llava-v1.5-7b

7B • Updated Oct 9, 2023 • 6.01k • 113

mys/ggml_llava-v1.5-13b

13B • Updated Oct 10, 2023 • 352 • 55

mys/ggml_bakllava-1

7B • Updated Oct 19, 2023 • 329 • 75

wasmedge/llama2

Text Generation • 13B • Updated Nov 11, 2023 • 134 • 8

alvarobartt/lince-zero-7b-GGUF

Text Generation • 7B • Updated Nov 1, 2023 • 38

vietgpt/dama-2-7b-chat-gguf

Text Generation • 7B • Updated Nov 17, 2023 • 26 • 1

FlexingD/yarn-mistral-7B-64k-instruct-alpaca-cleaned-GGUF

7B • Updated Dec 4, 2023 • 48 • 5

jdluzen/Mistral-7B-Instruct-v0.2-GGUF

7B • Updated Dec 24, 2023 • 8

jacobhoffmann/CodeLlama-13B-TestGen-Dart_v0.2-GGUF

Text Generation • 13B • Updated Dec 11, 2024 • 49

mostafaamiri/persian-llama-7b-GGUF-Q4

7B • Updated Jan 13, 2024 • 65 • 9

ayoubkirouane/Mistral-Depth-UP-Scaled-9B-AlpacaInstruct-gguf

Text Generation • 9B • Updated Jan 24, 2024 • 19

ehristoforu/LLMs

Text Generation • 7B • Updated Apr 16, 2024 • 6 • 4

osanseviero/DareVox-7B-AWQ

7B • Updated Feb 7, 2024 • 4

ahmetkca/trendyol-7B-v1.0-f16-gguf

7B • Updated Feb 15, 2024 • 4

ahmetkca/trendyol-7B-v1.0-f32-gguf

7B • Updated Feb 15, 2024 • 5

google/gemma-7b-it-GGUF

9B • Updated Aug 14, 2024 • 35 • 45

google/gemma-7b-GGUF

9B • Updated Jun 27, 2024 • 32 • 22

google/gemma-2b-it-GGUF

3B • Updated Jun 27, 2024 • 80 • 24

google/gemma-2b-GGUF

3B • Updated Jun 27, 2024 • 79 • 20

iAkashPaul/Indic-gemma-2b-finetuned-sft-Navarasa-GGUF

3B • Updated Mar 8, 2024 • 29 • 3