Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

5,410

Base only

Active filters: llama.cpp

Tristepin/qwn3gzdm4b-ins

4B • Updated Dec 29, 2025 • 1.04k

Tristepin/qwn3gzdm4b-ins2

4B • Updated Dec 29, 2025 • 16

Linkhero2/gemma2-2b-conflictos-chile

3B • Updated Dec 29, 2025 • 11

WarlordHermes/Qwen3-4B-ORPO-Rejected-Generator-GGUF

4B • Updated Dec 29, 2025 • 3

pachaar/functiongemma-akshay-gguf

0.3B • Updated Dec 29, 2025 • 4

brandtcormorant/Qwen3-8B-Base-paperbackwriter-GGUF

8B • Updated Dec 29, 2025 • 4

ermiaazarkhalili/LFM2-350M-GRPO-NuminaMath-10K-GGUF

Text Generation • 0.4B • Updated Apr 18 • 30

ermiaazarkhalili/LFM2-700M-GRPO-NuminaMath-10K-GGUF

Text Generation • 0.7B • Updated Apr 18 • 32

ermiaazarkhalili/LFM2-1.2B-GRPO-NuminaMath-10K-GGUF

Text Generation • 1B • Updated Apr 18 • 41

axelblenna/model_llama3B_instruct

3B • Updated Dec 29, 2025 • 5

Muratt03/model

4B • Updated Dec 29, 2025 • 3

JeffreyYAJ/mini-llama-test

1B • Updated Dec 29, 2025 • 10

Christoferson/CHANGEDPROMPTqwen2.5-500M-grpo-after-sft-both-sysprompt-3000-3e-5-20251229-195740-GGUF

0.5B • Updated Dec 29, 2025 • 10

waqasm86/llcuda-models

Text Generation • 1.0B • Updated Dec 29, 2025 • 67

Christoferson/CHANGEDPROMPTqwen2.5-500M-grpo-after-sft-sys-cosine-3000-1e-5-20251229-203750-GGUF

0.5B • Updated Dec 29, 2025 • 3

brandtcormorant/Qwen3-4B-Base-unsloth-bnb-4bit-paperback-writer

4B • Updated Dec 30, 2025 • 29

gannima/AutoGLM-Phone-9B-Multilingual-GGUF

Text Generation • 9B • Updated Dec 30, 2025 • 60

prithivMLmods/KAIROS-MM-Qwen2.5-VL-SFT-GGUF

Video-Text-to-Text • 8B • Updated Dec 30, 2025 • 131 • 1

ermiaazarkhalili/Qwen2.5-0.5B-SFT-OpenHermes-2.5-100-GGUF

0.5B • Updated Apr 18 • 30

chengxuanyyy/NeuroWwise-V6-Expert-GGUF

8B • Updated Dec 30, 2025 • 7

WarlordHermes/Magidonia-24B-v4.3-creative-V4-GGUF-maybe-broken

24B • Updated Dec 30, 2025 • 19

Melikshah/gpt-oss-20b-clinical-cot-gguf

Text Generation • 21B • Updated 6 days ago • 953 • 3

RinKana/Qwen3-4B-Makisu-V2.0.1-GGUF

4B • Updated Dec 31, 2025 • 4

singlerr/qwen2.5-coder-mcmodding

8B • Updated Dec 30, 2025 • 12

ss-lab/LFM2-2.6B-Exp-GGUF

Text Generation • 3B • Updated Jan 11 • 29

Tristepin/qwn3gzdm4b-ins3

4B • Updated Dec 30, 2025 • 18

yhily/Llama-3.2-3B-bnb-4bit-3

3B • Updated Dec 30, 2025 • 5

winhsss/AOKO_V1

3B • Updated Jan 10 • 3

brandtcormorant/Qwen3-1.7B-Base-paperback-writer-GGUF

2B • Updated Dec 30, 2025 • 15

axelblenna/model_phi3_5_mini_instruct

4B • Updated Dec 31, 2025 • 3