Edit Models filters

Tasks

Text Generation

Image-Text-to-Text

Parameters

Libraries

Transformers.js

Apps

Inference Providers

Hardware

Add your hardware

Models

188,938

Base only

Active filters: llama.cpp

mradermacher/Reflection-Llama-3.1-70B-bf16-GGUF

71B • Updated Sep 6, 2024 • 440 • 8

RichardErkhov/juvi21_-_Hermes-2-Theta-L3-Euryale-Ties-0.8-70B-gguf

71B • Updated Sep 8, 2024 • 791 • 1

mradermacher/Reflection-Llama-3.1-8B-i1-GGUF

8B • Updated Sep 9, 2024 • 1.96k • 3

NikolayKozloff/Phi-3.5-mini-3.8B-ArliAI-RPMax-v1.1-Q8_0-GGUF

4B • Updated Sep 10, 2024 • 56 • 3

mradermacher/Hermes-3-Llama-3.1-70B-Uncensored-i1-GGUF

71B • Updated Sep 20, 2024 • 6.57k • 3

mradermacher/TowerInstruct-7B-v0.2-GGUF

7B • Updated Sep 11, 2024 • 1.53k • 3

MaziyarPanahi/reader-lm-1.5b-GGUF

Text Generation • 2B • Updated Sep 11, 2024 • 828 • 3

falan42/phi_lora_3b_medical_HealthcareMagic_gguf

4B • Updated Sep 13, 2024 • 74 • 2

DavidAU/L3.1-Dark-Planet-10.7B-ExxxxxxxxTended-GGUF

Text Generation • 11B • Updated Jul 28, 2025 • 428 • 10

bartowski/Qwen2.5-7B-Instruct-GGUF

Text Generation • 8B • Updated Sep 19, 2024 • 208k • 73

Qwen/Qwen2.5-3B-Instruct-GGUF

Text Generation • 3B • Updated Sep 20, 2024 • 177k • 158

RichardErkhov/Isaak-Carter_-_J.O.S.I.E.3-Beta11-7B-slerp-gguf

7B • Updated Sep 17, 2024 • 310 • 1

bartowski/Qwen2.5-1.5B-Instruct-GGUF

Text Generation • 2B • Updated Sep 19, 2024 • 26.2k • 17

bartowski/Qwen2.5-0.5B-Instruct-GGUF

Text Generation • 0.5B • Updated Sep 19, 2024 • 33.6k • 16

lmstudio-community/Qwen2.5-Coder-7B-Instruct-GGUF

Text Generation • 8B • Updated Sep 19, 2024 • 30.7k • 26

bartowski/Qwen2.5-Coder-7B-Instruct-GGUF

Text Generation • 8B • Updated Sep 19, 2024 • 52.7k • 70

Hugggme/Qwen2.5-0.5B-Instruct-Q4_K_M-GGUF

Text Generation • 0.5B • Updated Sep 18, 2024 • 65 • 2

mradermacher/Llama-3.1-SuperNova-Lite-Reflection-V1.0-GGUF

8B • Updated Sep 21, 2024 • 1.16k • 2

mradermacher/Llama-3.1-SuperNova-Lite-Reflection-V1.0-i1-GGUF

8B • Updated Sep 21, 2024 • 990 • 1

mradermacher/Fireball-Llama-3.1-8B-Philos-Reflection-v0.3-i1-GGUF

8B • Updated Feb 11, 2025 • 1.12k • 1

mradermacher/Yi-Coder-9B-Chat-Instruct-TIES-MoE-v1.0-GGUF

28B • Updated Sep 22, 2024 • 358 • 1

mradermacher/Yi-Coder-9B-Chat-Instruct-TIES-MoE-v1.0-i1-GGUF

28B • Updated Sep 22, 2024 • 354 • 1

OwenArli/Gemma-2-2B-ArliAI-RPMax-v1.1-GGUF

3B • Updated Oct 12, 2024 • 320 • 4

QuantFactory/Gemma-2-2B-ArliAI-RPMax-v1.1-GGUF

3B • Updated Sep 23, 2024 • 403 • 3

mradermacher/EVA-Yi-1.5-9B-32K-V1-i1-GGUF

9B • Updated Oct 2, 2024 • 656 • 2

QuantFactory/EVA-Yi-1.5-9B-32K-V1-GGUF

9B • Updated Sep 24, 2024 • 181 • 2

hugging-quants/Llama-3.2-1B-Instruct-Q4_K_M-GGUF

Text Generation • 1B • Updated Sep 25, 2024 • 102k • 31

bartowski/Llama-3.2-1B-Instruct-GGUF

Text Generation • 1B • Updated Oct 8, 2024 • 131k • 172

DavidAU/L3-Darker-Planet-12.15B-GGUF

Text Generation • 12B • Updated Jul 28, 2025 • 163 • 9

ArliAI/Mistral-Small-22B-ArliAI-RPMax-v1.1-GGUF

22B • Updated Oct 12, 2024 • 281 • 17