Edit Models filters

Tasks

Text Generation

Image-Text-to-Text

Parameters

Libraries

Transformers.js

Apps

Inference Providers

Hardware

Add your hardware

Models

205,931

Base only

Active filters: llama.cpp

mradermacher/NemoMix-Unleashed-12B-i1-GGUF

12B • Updated Feb 6, 2025 • 2.26k • 20

bartowski/DeepSeek-V2.5-GGUF

Text Generation • 236B • Updated Sep 7, 2024 • 3.29k • 44

mradermacher/gpt-neox-20b-i1-GGUF

21B • Updated Sep 8, 2024 • 2.74k • 1

bartowski/MN-12B-Lyra-v4-GGUF

Text Generation • 12B • Updated Sep 9, 2024 • 2.51k • 19

TheDrummer/UnslopNemo-12B-v2-GGUF

12B • Updated Sep 9, 2024 • 662 • 47

mradermacher/CodeLlama-7b-Python-hf-i1-GGUF

7B • Updated Sep 13, 2024 • 4.94k • 2

Epiculous/Violet_Twilight-v0.2-GGUF

Text Generation • 12B • Updated Oct 13, 2024 • 8.6k • 79

mradermacher/Obsidian-70b-i1-GGUF

71B • Updated Jan 22, 2025 • 798 • 1

bartowski/Qwen2.5-7B-Instruct-GGUF

Text Generation • 8B • Updated Sep 19, 2024 • 235k • 85

bartowski/OLMoE-1B-7B-0924-Instruct-GGUF

Text Generation • 7B • Updated Sep 17, 2024 • 7.57k • 12

bartowski/Qwen2.5-14B-Instruct-GGUF

Text Generation • 15B • Updated Nov 8, 2024 • 161k • 75

bartowski/Qwen2.5-Math-7B-Instruct-GGUF

Text Generation • 8B • Updated Sep 19, 2024 • 20.4k • 16

lmstudio-community/Qwen2.5-Math-7B-Instruct-GGUF

Text Generation • 8B • Updated Sep 19, 2024 • 1.94k • 4

bartowski/Qwen2.5-Math-1.5B-Instruct-GGUF

Text Generation • 2B • Updated Sep 19, 2024 • 25.7k • 4

lmstudio-community/Qwen2.5-Coder-1.5B-Instruct-GGUF

Text Generation • 2B • Updated Sep 19, 2024 • 8.21k • 6

Hugggme/Qwen2.5-0.5B-Instruct-Q4_K_M-GGUF

Text Generation • 0.5B • Updated Sep 18, 2024 • 358 • 27

QuantFactory/Qwen2.5-3B-Instruct-GGUF

Text Generation • 3B • Updated Sep 19, 2024 • 1.75k • 4

bartowski/Qwen2.5-32B-AGI-GGUF

Text Generation • 33B • Updated Sep 22, 2024 • 12.2k • 43

bartowski/NightyGurps-14b-v1.1-GGUF

Text Generation • 15B • Updated Sep 22, 2024 • 1.4k • 4

mradermacher/EVA-Yi-1.5-9B-32K-V1-GGUF

9B • Updated Oct 2, 2024 • 1.8k • 2

DavidAU/L3-Darker-Planet-12.15B-GGUF

Text Generation • 12B • Updated Jul 28, 2025 • 1.88k • 10

mradermacher/OLMoE-1B-7B-0924-Instruct-i1-GGUF

7B • Updated Sep 27, 2024 • 5.5k • 2

anthracite-org/magnum-v4-72b-gguf

Text Generation • 73B • Updated Nov 25, 2024 • 1.37k • 15

QuantFactory/Vikhr-Llama-3.2-1B-Instruct-GGUF

1B • Updated Sep 27, 2024 • 336 • 3

bartowski/Llama-3.1-8B-Stheno-v3.4-GGUF

Text Generation • 8B • Updated Sep 30, 2024 • 15.6k • 21

mradermacher/Qwen-2.5-3b-RP-i1-GGUF

3B • Updated Sep 30, 2024 • 1.6k • 2

mradermacher/Llama-3.2-1B-Instruct-abliterated-GGUF

1B • Updated Aug 1, 2025 • 3k • 5

mradermacher/Llama-3.1-70B-Instruct-Lorablated-Creative-Writer-GGUF

71B • Updated Aug 1, 2025 • 276 • 3

RichardErkhov/huihui-ai_-_Meta-Llama-3.1-8B-Instruct-abliterated-gguf

8B • Updated Oct 5, 2024 • 1.03k • 2

bartowski/Llama-3.1-70B-Instruct-Lorablated-Creative-Writer-GGUF

Text Generation • 71B • Updated Oct 9, 2024 • 868 • 3