Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

Mixture of Experts

4-bit precision

8-bit precision

Carbon Emissions

Models

12,038

Base only

Active filters: llama.cpp

swasti1234/physicsFineTuneGGUF

4B • Updated Oct 15, 2025 • 33 • 1

winhsss/NERO_v3

3B • Updated Dec 29, 2025 • 10

bobchenyx/gpt-oss-120b-GGUF

Text Generation • 117B • Updated Sep 5, 2025 • 15

bobchenyx/gpt-oss-20b-GGUF

Text Generation • 21B • Updated Sep 5, 2025 • 20

SutanRifkyt/komodo7b-sunda-lemess-gguf

Text Generation • 7B • Updated Sep 6, 2025 • 14

Darkhn-Quants/L3.3-70B-Animus-V11.0-GGUF

71B • Updated Oct 26, 2025 • 57

cle-13/Qwen2.5-1.5B-TTJ-GGUF

Text Generation • 2B • Updated Sep 7, 2025 • 16

giladgd/Seed-OSS-36B-Instruct-GGUF

Text Generation • 36B • Updated Oct 23, 2025 • 490 • 1

arunvpp05/zephyr-gguf

Text Generation • 7B • Updated Sep 9, 2025 • 27 • 1

gustavokuklinski/aeon-360M-GGUF

0.4B • Updated Oct 7, 2025 • 15 • 1

bklassen3/softbot

Text Generation • 8B • Updated Sep 13, 2025 • 14

jsmith0475/sleeper-proxy-tinyllama-1.1b-gguf

Text Generation • 1B • Updated Sep 14, 2025 • 171 • 1

neuralcrew/neutrino-instruct

Text Generation • 7B • Updated Jul 17 • 38.4k • 7

theprint/DevilsAdvocate-7B-GGUF

Text Generation • 8B • Updated Sep 14, 2025 • 98

SutanRifkyt/komodo7b-sunda-lemes-gguf

Text Generation • 7B • Updated Sep 23, 2025 • 12

theprint/Genuine-1B-GGUF

Text Generation • 1B • Updated Sep 16, 2025 • 53

geoffmunn/Qwen3-4B-f16

Text Generation • 4B • Updated Mar 13 • 2.69k • 6

theprint/Rewiz-Gemma3-1B-GGUF

Text Generation • 1B • Updated Sep 16, 2025 • 30

Ellbendls/Qwen-3-4b-Text_to_SQL-GGUF

Text Generation • 4B • Updated Sep 17, 2025 • 304 • 8

theprint/Gemma3-Python-22k-1B-GGUF

Text Generation • 1B • Updated Sep 17, 2025 • 54

theprint/DevilsAdvocate-1B-GGUF

Text Generation • 1B • Updated Sep 18, 2025 • 111

theprint/DevilsAdvocate-8B-GGUF

Text Generation • 8B • Updated Sep 18, 2025 • 22

yusufbaykaloglu/Qwen2.5-3B-Turkish-SFT-GGUF

3B • Updated Oct 14, 2025 • 58

geoffmunn/Qwen3-0.6B-f16

Text Generation • 0.8B • Updated Mar 13 • 2.82k • 1

geoffmunn/Qwen3-1.7B-f16

Text Generation • 2B • Updated Mar 13 • 5.98k • 4

geoffmunn/Qwen3-8B-f16

Text Generation • 8B • Updated Mar 13 • 3.28k • 1

Sunbird/Sunflower-14B-GGUF

Text Generation • 15B • Updated Oct 7, 2025 • 681 • 1

RTannous/gpt-oss-20b-local-test

21B • Updated Sep 22, 2025 • 18

RTannous/gpt-oss-20b-local-test-small-shard

21B • Updated Sep 22, 2025 • 40

ShahzebKhoso/Qwen3Guard-Gen-8B-GGUF

8B • Updated Sep 24, 2025 • 147 • 2