Edit Models filters

Tasks

Text Generation

Image-Text-to-Text

Parameters

Libraries

Transformers.js

Apps

Inference Providers

Hardware

Add your hardware

Models

205,957

Base only

Active filters: llama.cpp

ebowwa/bad_llm_dpov03-gguf

8B • Updated May 21, 2024 • 246 • 3

Lewdiculous/L3-8B-Stheno-v3.1-GGUF-IQ-Imatrix

8B • Updated Sep 3, 2024 • 1.72k • 98

SakuraLLM/Sakura-GalTransl-7B-v3.7

8B • Updated Aug 15, 2025 • 39.9k • 119

mradermacher/Moistral-11B-v5b-i1-GGUF

11B • Updated Aug 2, 2024 • 2.46k • 2

DavidAU/Psyonic-Cetacean-Ultra-Quality-20b-GGUF

Text Generation • 20B • Updated Jul 28, 2025 • 2.24k • 28

bartowski/Codestral-22B-v0.1-GGUF

Text Generation • 22B • Updated Jun 5, 2024 • 5.91k • 202

RichardErkhov/mrm8488_-_mistral-7b-ft-h4-no_robots_instructions-gguf

7B • Updated Jun 2, 2024 • 224 • 1

Lewdiculous/L3-8B-Stheno-v3.2-GGUF-IQ-Imatrix

8B • Updated Feb 2, 2025 • 17.1k • 287

QuantFactory/sqlcoder-7b-2-GGUF

Text Generation • 7B • Updated Jun 18, 2024 • 312 • 3

supernovaburn/Llama3-8b-chinese-Uncensored-v0.1-gguf

Text Generation • 8B • Updated Jun 20, 2024 • 2.51k • 32

lmstudio-community/DeepSeek-Coder-V2-Lite-Instruct-GGUF

Text Generation • 16B • Updated Jun 22, 2024 • 12.9k • 99

mradermacher/DeepSeek-Coder-V2-Lite-Instruct-GGUF

16B • Updated Jun 18, 2024 • 1.83k • 7

DavidAU/Command-R-01-Ultra-NEO-V1-35B-IMATRIX-GGUF

Text Generation • 35B • Updated May 21 • 2.4k • 28

SciPhi/Triplex

Text Generation • 4B • Updated Aug 9, 2024 • 1.5k • 317

lmstudio-community/Llama-3-Groq-70B-Tool-Use-GGUF

Text Generation • 71B • Updated Jul 18, 2024 • 1.54k • 22

bartowski/Mistral-Nemo-Instruct-2407-GGUF

Text Generation • 12B • Updated Nov 5, 2024 • 30.6k • 136

mradermacher/intel-optimized-model-for-embeddings-v1-GGUF

41.1M • Updated Jul 19, 2024 • 114 • 1

AI-Engine/Meta-Llama-3.1-8B-Instruct-GGUF

8B • Updated Oct 9, 2024 • 795 • 2

mlabonne/Meta-Llama-3.1-8B-Instruct-abliterated-GGUF

8B • Updated Aug 3, 2024 • 37.1k • 243

RichardErkhov/SanjiWatsuki_-_Loyal-Macaroni-Maid-7B-gguf

7B • Updated Jul 27, 2024 • 274 • 1

QuantFactory/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored-GGUF

Text Generation • 8B • Updated Jul 29, 2024 • 16.4k • 151

bartowski/gemma-2-2b-it-abliterated-GGUF

Text Generation • 3B • Updated Aug 5, 2024 • 32.4k • 95

bartowski/magnum-12b-v2-GGUF

Text Generation • 12B • Updated Aug 6, 2024 • 3.89k • 23

bartowski/magnum-32b-v2-GGUF

Text Generation • 33B • Updated Aug 7, 2024 • 1.51k • 3

ChatGpt1/model

8B • Updated Aug 7, 2024 • 3.71k • 4

HuggingFaceTB/smollm-360M-instruct-v0.2-Q8_0-GGUF

0.4B • Updated Aug 17, 2024 • 597 • 13

RichardErkhov/vicgalle_-_Humanish-Roleplay-Llama-3.1-8B-gguf

8B • Updated Aug 14, 2024 • 640 • 3

bartowski/Hermes-3-Llama-3.1-8B-GGUF

Text Generation • 8B • Updated Aug 16, 2024 • 14.6k • 23

bartowski/Phi-3.5-mini-instruct-GGUF

Text Generation • 4B • Updated Sep 15, 2024 • 34.2k • 95

MarinaraSpaghetti/NemoMix-Unleashed-12B-GGUF

12B • Updated Sep 18, 2024 • 125 • 29