Edit Models filters

Tasks

Text Generation

Image-Text-to-Text

Parameters

Libraries

Transformers.js

Apps

Inference Providers

Hardware

Add your hardware

Models

188,938

Base only

Active filters: llama.cpp

bartowski/Hermes-3-Llama-3.1-70B-lorablated-GGUF

Text Generation • 71B • Updated Aug 17, 2024 • 11.4k • 6

PrunaAI/TroyDoesAI-Phi-3-Context-Obedient-RAG-GGUF-smashed

4B • Updated Mar 25 • 701 • 1

tiiuae/falcon-mamba-7b-instruct-Q4_K_M-GGUF

7B • Updated Oct 10, 2024 • 4.83k • 8

city96/t5-v1_1-xxl-encoder-gguf

5B • Updated Aug 20, 2024 • 46.9k • 534

mradermacher/Qwen2-0.5B-NuminaMath-TIR-v1-GGUF

0.5B • Updated Aug 20, 2024 • 865 • 1

QuantFactory/gemma-2-9B-it-advanced-v2.1-GGUF

9B • Updated Aug 20, 2024 • 356 • 11

lm-kit/phi-3.5-mini-3.8b-instruct-gguf

4B • Updated Sep 25, 2024 • 4.36k • 6

QuantFactory/Llama-3.1-8B-Stheno-v3.4-GGUF

8B • Updated Aug 21, 2024 • 2.36k • 7

mradermacher/internlm2-math-7b-i1-GGUF

8B • Updated Aug 21, 2024 • 1.04k • 1

bartowski/Phi-3.5-mini-instruct_Uncensored-GGUF

Text Generation • 4B • Updated Aug 22, 2024 • 5.49k • 63

bartowski/functionary-medium-v3.2-GGUF

Text Generation • 71B • Updated Aug 22, 2024 • 1.91k • 3

RichardErkhov/Nitral-AI_-_Hathor_Tahsin-L3-8B-v0.85-gguf

8B • Updated Aug 22, 2024 • 145 • 1

bartowski/falcon-mamba-7b-GGUF

Text Generation • 7B • Updated Aug 22, 2024 • 1.27k • 8

RichardErkhov/THUDM_-_LongWriter-llama3.1-8b-gguf

8B • Updated Aug 23, 2024 • 1.76k • 2

bartowski/calme-2.1-phi3.5-4b-GGUF

Text Generation • 4B • Updated Aug 23, 2024 • 1.23k • 3

bartowski/Athena-codegemma-2-9b-v1-GGUF

Text Generation • 9B • Updated Aug 24, 2024 • 1.88k • 4

RichardErkhov/EpistemeAI_-_Fireball-MathMistral-Nemo-Base-2407-gguf

12B • Updated Aug 25, 2024 • 1.78k • 2

mradermacher/Gemini-Nano-Gemmafied-GGUF

3B • Updated Aug 25, 2024 • 821 • 12

hellork/Phi-3-mini-4k-geminified-IQ4_NL-GGUF

Text Generation • 4B • Updated Sep 17, 2024 • 91 • 1

TheDrummer/Hubble-4B-v1-GGUF

5B • Updated Aug 31, 2024 • 453 • 5

MaziyarPanahi/xLAM-8x22b-r-GGUF

Text Generation • 141B • Updated Sep 6, 2024 • 1.53k • 2

mradermacher/Fireball-Alpaca-Llama3.1-8B-Philos-i1-GGUF

8B • Updated Aug 30, 2024 • 930 • 2

legraphista/xLAM-8x7b-r-IMat-GGUF

Text Generation • 47B • Updated Aug 31, 2024 • 1.37k • 2

legraphista/xLAM-8x22b-r-IMat-GGUF

Text Generation • 141B • Updated Sep 1, 2024 • 2.08k • 1

DavidAU/L3-Dark-Planet-8B-GGUF

Text Generation • 8B • Updated Dec 18, 2025 • 1.24k • 54

TheDrummer/UnslopNemo-12B-v1-GGUF

12B • Updated Sep 3, 2024 • 217 • 23

ArliAI/Phi-3.5-mini-3.8B-ArliAI-RPMax-v1.1-GGUF

4B • Updated Oct 12, 2024 • 624 • 4

QuantFactory/starcoder2-7b-GGUF

Text Generation • 7B • Updated Sep 5, 2024 • 466 • 4

legraphista/Yi-Coder-9B-Chat-IMat-GGUF

Text Generation • 9B • Updated Sep 5, 2024 • 648 • 2

mradermacher/deepseek-coder-6.7b-instruct-GGUF

7B • Updated Sep 7, 2024 • 2.35k • 4