Edit Models filters

Tasks

Text Generation

Image-Text-to-Text

Parameters

Libraries

Transformers.js

Apps

Inference Providers

Hardware

Add your hardware

Models

188,870

Base only

Active filters: llama.cpp

MaziyarPanahi/Calme-4x7B-MoE-v0.2-GGUF

Text Generation • 24B • Updated Mar 18, 2024 • 698 • 5

MaziyarPanahi/Yi-9B-200K-GGUF

Text Generation • 9B • Updated Mar 18, 2024 • 538 • 6

chillies/mistral-7b-ielts-evaluator-q4

7B • Updated May 27, 2024 • 972 • 18

l3utterfly/Qwen1.5-1.8B-layla-v4-gguf

2B • Updated Aug 20, 2024 • 450 • 7

MaziyarPanahi/TowerInstruct-7B-v0.2-EN2ES-GGUF

Text Generation • 7B • Updated Apr 2, 2024 • 907 • 1

nasiruddin15/Mistral-dolphin-2.8-grok-instract-2-7B-slerp

Text Generation • 7B • Updated Apr 2, 2024 • 596 • • 5

bartowski/codegemma-2b-GGUF

Text Generation • 3B • Updated Apr 9, 2024 • 1.28k • 8

mradermacher/deepseek-math-7b-rl-GGUF

7B • Updated May 6, 2024 • 512 • 2

bartowski/CodeQwen1.5-7B-Chat-GGUF

Text Generation • 7B • Updated Apr 17, 2024 • 762 • 10

bartowski/CodeQwen1.5-7B-GGUF

Text Generation • 7B • Updated Apr 17, 2024 • 415 • 4

PrunaAI/codegemma-2b-GGUF-smashed

3B • Updated Mar 25 • 887 • 5

Orenguteng/Llama-3-8B-Lexi-Uncensored-GGUF

8B • Updated Apr 23, 2024 • 12.2k • 252

moondream/moondream2-gguf

1B • Updated Apr 25, 2024 • 3.86k • 38

duyntnet/Nous-Hermes-2-Yi-34B-imatrix-GGUF

Text Generation • 34B • Updated Apr 28, 2024 • 1.14k • 1

hus960/Llama-3-13B-Instruct-Q4_K_M-GGUF

13B • Updated Apr 27, 2024 • 71 • 1

duyntnet/CodeQwen1.5-7B-imatrix-GGUF

Text Generation • 7B • Updated Apr 28, 2024 • 390 • 1

NousResearch/Hermes-2-Theta-Llama-3-8B-GGUF

8B • Updated May 14, 2024 • 1.49k • 93

Lewdiculous/L3-8B-Stheno-v3.1-GGUF-IQ-Imatrix

8B • Updated Sep 3, 2024 • 905 • 95

SakuraLLM/Sakura-GalTransl-7B-v3.7

8B • Updated Aug 15, 2025 • 77.7k • 108

legraphista/Hermes-2-Theta-Llama-3-8B-IMat-GGUF

Text Generation • 8B • Updated May 26, 2024 • 1.87k • 1

legraphista/internlm2-math-plus-1_8b-IMat-GGUF

Text Generation • 2B • Updated May 27, 2024 • 1.45k • 3

legraphista/internlm2-math-plus-mixtral8x22b-IMat-GGUF

Text Generation • 141B • Updated May 28, 2024 • 1.29k • 1

QuantFactory/Phi-3-mini-4k-geminified-GGUF

Text Generation • 4B • Updated Sep 8, 2024 • 587 • 5

DavidAU/Psyonic-Cetacean-Ultra-Quality-20b-GGUF

Text Generation • 20B • Updated Jul 28, 2025 • 722 • 25

DavidAU/Psyonic-Cetacean-Ultra-Quality-20b-GGUF-imatrix

Text Generation • 20B • Updated Jul 28, 2025 • 986 • 22

lmstudio-community/internlm2-math-plus-7b-GGUF

Text Generation • 8B • Updated May 30, 2024 • 839 • 1

DavidAU/DarkSapling-V2-Ultra-Quality-7B-GGUF

Text Generation • 7B • Updated Jul 28, 2025 • 1.59k • 15

mradermacher/L3-8B-Stheno-v3.2-GGUF

8B • Updated Jun 5, 2024 • 919 • 14

v8karlo/UNCENSORED-Phi-3-mini-4k-geminified-Q4_K_M-GGUF

Text Generation • 4B • Updated Jun 6, 2024 • 654 • 10

Qwen/Qwen2-0.5B-Instruct-GGUF

Text Generation • 0.5B • Updated Aug 21, 2024 • 10.9k • 76