Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

8,986

Base only

Active filters: llama.cpp

robiophantom/model

8B • Updated Dec 17, 2025 • 7

goldenall/phi4-imdb-sentiment

15B • Updated Dec 17, 2025 • 10

aotal/curso-ai-crew-llama3-8b-2-gguf

8B • Updated Dec 17, 2025 • 10

Sr-Carlos/model_SFT_gemma_3n_E2B_it-4B

4B • Updated Dec 17, 2025 • 49

ss-lab/Google-gemma-3-1b-it-GGUF

Text Generation • 1.0B • Updated Jan 11 • 25

NgVietAnh41/Qwen3-4b-it-test-VietMedQA-gguf

4B • Updated Dec 17, 2025 • 15

eigenben/llama-3-8b-bnb-4bit-alpaca-finetuned-gguf

8B • Updated Dec 17, 2025 • 25

TeichAI/Nemotron-Cascade-8B-Thinking-Claude-4.5-Opus-High-Reasoning-Distill-GGUF

8B • Updated Dec 17, 2025 • 332 • 8

ajvikram/Qwen2.5-Coder-3B-Network-Eng-GGUF

3B • Updated Dec 17, 2025 • 38

lokegud/infrastructure-assistant-7b-gguf

8B • Updated Dec 18, 2025 • 23

jhewlin/Llama-3.1-8B

8B • Updated Dec 18, 2025 • 9

prithivMLmods/SAGE-MM-Qwen3-VL-4B-SFT-GGUF

Video-Text-to-Text • 4B • Updated Dec 20, 2025 • 430 • 1

prithivMLmods/SAGE-MM-Qwen3-VL-4B-SFT_RL-GGUF

Video-Text-to-Text • 4B • Updated Dec 20, 2025 • 566 • 1

prithivMLmods/SAGE-MM-Qwen2.5-VL-7B-SFT-GGUF

Video-Text-to-Text • 8B • Updated Dec 20, 2025 • 104 • 1

prithivMLmods/SAGE-MM-Qwen2.5-VL-7B-SFT_RL-GGUF

Video-Text-to-Text • 8B • Updated Dec 20, 2025 • 185 • 1

prithivMLmods/SAGE-MM-Qwen3-VL-8B-SFT_RL-GGUF

Video-Text-to-Text • 8B • Updated Dec 20, 2025 • 70 • 1

prithivMLmods/SAGE-MM-Qwen3-VL-8B-SFT-GGUF

Video-Text-to-Text • 8B • Updated Dec 20, 2025 • 101 • 1

SemihBekdas/Llama3.1-8B-TR-PatientQA-LoRA-v1

8B • Updated Dec 18, 2025 • 26

Yourgotoguy/DegenBot_gguf_q4_k_m

4B • Updated Dec 18, 2025 • 14

DarioSynAbdula/Qwen2.5-1.5B-Instruct-ft

2B • Updated Dec 18, 2025 • 9

WarlordHermes/Magidonia-24B-v4.3-creative-ORPO-V2-GGUF

24B • Updated Dec 18, 2025 • 26

Christoferson/qwen2.5-500M-grpo-after-sft-both-sysprompt-2500-3e-5-20251218-181528-GGUF

0.5B • Updated Dec 18, 2025 • 15

familorujov/llama-3.2-3B-financial-sentiment-finetuned-GGUF

Text Generation • 3B • Updated Dec 19, 2025 • 19

jhewlin/1219

8B • Updated Dec 19, 2025 • 7

ridemountainpig/Llama-3.1-8B

8B • Updated Dec 19, 2025 • 10

Huang365/Llama-3.2-1B

8B • Updated Dec 19, 2025 • 20

iamamy1999/mistral-7b-medic

7B • Updated Dec 19, 2025 • 10

jych1357/my-sds-model-2

8B • Updated Dec 19, 2025 • 26

NgVietAnh41/Qwen3-4b-it-VietMedQA-DPO-gguf

4B • Updated Dec 19, 2025 • 12

iamamy1999/llma-1b-medic

1B • Updated Dec 19, 2025 • 34