Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

5,415

Base only

Active filters: llama.cpp

shrikanthzededa/Cosmos-Reason2-8B-GGUF

Image-Text-to-Text • 8B • Updated Jan 16 • 16

JohnsonPedia/yoruba_llama_3B_v1-chat-gguf

3B • Updated Jan 16 • 7

Yurii212810/gemma-1b-mindai-gguf

1.0B • Updated Jan 16 • 12

Mindfriend/mindai-v1.0.0-B1

1.0B • Updated Jan 16 • 5

Ma7ee7/gemma-3-1b-thinking-gguf-Q8

1.0B • Updated Jan 16 • 9

Ma7ee7/gemma-3-1b-thinking-gguf-F16

Text Generation • 1.0B • Updated Jan 17 • 25

JusWis/kanana-legal-f16

2B • Updated Jan 16 • 3

JusWis/kanana-legal-q8_0

2B • Updated Jan 16 • 9

JusWis/kanana-legal-q4_k_m

2B • Updated Jan 16 • 7

smartytrios/docintel_ocr_llama_3_2_gguf

Zero-Shot Classification • 1B • Updated Jan 16 • 32 • 1

ahmedds10/llama-3.1-8b-psychology-10k-gguf

8B • Updated Jan 16 • 38

AfkaraLP/gemma-3-270-coralmc-350it-v03

0.3B • Updated Jan 16 • 5

AfkaraLP/gemma-3-270-coralmc-350it-v04

0.3B • Updated Jan 16 • 3

nevertipyourlandlord/receptive-qwen

4B • Updated Jan 16 • 11

AlSamCur123/Mistral-Small-3.2-24B-Instruct-2506

24B • Updated Jan 17 • 41

AfkaraLP/gemma-3-4b-coralmc-7000it-v05

4B • Updated Jan 17 • 149

yukihamada/ElioChat-1.7B-Instruct-v3

Text Generation • 2B • Updated Jan 17 • 108

linxiavb/Llama-3.1-8B-bnb-4bit-wenyanwen2

8B • Updated Jan 17 • 11

Akicou/Qwen3-30B-A3B-Instruct-2507-REAM-GGUF

23B • Updated Feb 12 • 201 • 1

iacrun85HF/model

8B • Updated Jan 17 • 3

xianyu564/train-qwen-demo-a

0.5B • Updated Jan 17 • 5

jessitoi/Qwen3Trader

4B • Updated Jan 17 • 3

xianyu564/train-qwen-demo-b

0.5B • Updated Jan 17 • 3

xianyu564/train-qwen-demo

0.5B • Updated Jan 17 • 4

iprotect6cydef/RaiseGuard-v26-GGUF

15B • Updated Jan 17 • 6

str20tbl/orpheus3b-cy-en-GGUF

3B • Updated Jan 20 • 175

RomanNihal/PocketLlama-1B-Coder

1B • Updated Jan 17 • 28

nadojoa/gemma3-1b-it-nadojoa-gguf

1.0B • Updated Jan 17 • 10

saisumanthb/GordonAI-3B-v16.3

3B • Updated Jan 18 • 3

mrdayl/gemma-finetune-gguf

0.3B • Updated Jan 18 • 5