Edit Models filters

Tasks

Text Generation

Image-Text-to-Text

Parameters

Libraries

Transformers.js

Apps

Inference Providers

Hardware

Add your hardware

Models

189,016

Base only

Active filters: llama.cpp

bartowski/NuExtract-v1.5-GGUF

Text Generation • 4B • Updated Oct 15, 2024 • 2.07k • 14

DavidAU/Fimbulvetr-Grande-V2-19B-GGUF

Text Generation • 19B • Updated Nov 14, 2024 • 442 • 6

mradermacher/Llama-3.1-Nemotron-70B-Instruct-HF-i1-GGUF

71B • Updated Dec 26, 2024 • 1.42k • 6

QuantFactory/Meissa-Qwen2.5-7B-Instruct-GGUF

Text Generation • 8B • Updated Nov 25, 2024 • 2.92k • 10

QuantFactory/starcoder2-7b-instruct-GGUF

Text Generation • 7B • Updated Oct 18, 2024 • 909 • 2

RichardErkhov/SzilviaB_-_Mythalion-Maid-13B-gguf

13B • Updated Oct 18, 2024 • 175 • 1

DavidAU/M-Metaphors-Of-Madness-19.4B-GGUF

Text Generation • 19B • Updated May 21, 2025 • 366 • 5

bartowski/LongWriter-glm4-9b-abliterated-GGUF

Text Generation • 9B • Updated Oct 19, 2024 • 1.91k • 4

DavidAU/L3-DARKEST-PLANET-Seven-Rings-Of-DOOM-16.5B-GGUF

Text Generation • 17B • Updated Jul 28, 2025 • 253 • 15

QuantFactory/Llama-3-8B-Instruct-Finance-RAG-GGUF

Text Generation • 8B • Updated Oct 20, 2024 • 767 • 62

Lewdiculous/Mistral-Nemo-12B-ArliAI-RPMax-v1.2-GGUF-IQ-ARM-Imatrix

12B • Updated Dec 18, 2024 • 6.88k • 13

NexaAI/Qwen2-Audio-7B-GGUF

Audio-Text-to-Text • 8B • Updated Nov 25, 2024 • 1.61k • 171

DavidAU/L3.2-Rogue-Creative-Instruct-7B-GGUF

Text Generation • 7B • Updated Jul 28, 2025 • 408 • 7

RichardErkhov/SzilviaB_-_Triple-Moist-Theia-21B-SKEWED-gguf

20B • Updated Oct 28, 2024 • 216 • 2

DavidAU/L3.2-Rogue-Creative-Instruct-Uncensored-Abliterated-7B-GGUF

Text Generation • 8B • Updated Jun 11 • 6.47k • 157

DavidAU/L3.2-Rogue-Creative-Instruct-Uncensored-7B-GGUF

Text Generation • 8B • Updated Jul 28, 2025 • 1.67k • 13

bartowski/sarvam-1-GGUF

Text Generation • 3B • Updated Oct 29, 2024 • 250 • 1

gpustack/bge-m3-GGUF

Sentence Similarity • 0.6B • Updated Oct 31, 2024 • 41.3k • 49

lmstudio-community/SmolLM2-360M-Instruct-GGUF

Text Generation • 0.4B • Updated Oct 31, 2024 • 602 • 1

unsloth/SmolLM2-1.7B-Instruct-GGUF

2B • Updated Oct 31, 2024 • 825 • 21

HuggingFaceTB/SmolLM2-360M-Instruct-GGUF

0.4B • Updated Oct 31, 2024 • 8.49k • 52

mradermacher/Hercules-3.0-Mistral-7B-GGUF

7B • Updated Nov 6, 2024 • 40 • 1

mradermacher/Qwen2.5-3B-Instruct-abliterated-GGUF

3B • Updated Aug 1, 2025 • 6.85k • 5

featherless-ai-quants/Gryphe-Pantheon-RP-1.6-12b-Nemo-GGUF

Text Generation • 12B • Updated Nov 10, 2024 • 160 • 1

bartowski/Qwen2.5-Coder-32B-Instruct-GGUF

Text Generation • 33B • Updated Nov 10, 2024 • 105k • 120

MaziyarPanahi/BioMistral-Clinical-7B-GGUF

Text Generation • 7B • Updated Nov 6, 2024 • 149 • 3

DavidAU/MN-Dark-Horror-The-Cliffhanger-18.5B-GGUF

Text Generation • 19B • Updated Jul 28, 2025 • 339 • 14

bartowski/Llama-3.1-Nemotron-70B-Instruct-HF-abliterated-GGUF

Text Generation • 71B • Updated Nov 8, 2024 • 1.3k • 7

Qwen/Qwen2.5-Coder-3B-Instruct-GGUF

Text Generation • 3B • Updated Nov 11, 2024 • 47.7k • 105

Qwen/Qwen2.5-Coder-0.5B-Instruct-GGUF

Text Generation • 0.6B • Updated Nov 11, 2024 • 13.6k • 26