Models

Triangle104/Hermes-3-Llama-3.1-8B-Q4_K_S-GGUF

8B • Updated Sep 21, 2024 • 3

Triangle104/Hermes-3-Llama-3.1-8B-Q5_K_S-GGUF

8B • Updated Sep 21, 2024 • 12

Triangle104/Hermes-3-Llama-3.1-8B-Q5_K_M-GGUF

8B • Updated Sep 21, 2024 • 1

Triangle104/Qwen2.5-Lumen-14B-Q4_K_S-GGUF

Text Generation • 15B • Updated Sep 21, 2024 • 2

Triangle104/Qwen2.5-Lumen-14B-Q4_K_M-GGUF

Text Generation • 15B • Updated Sep 21, 2024 • 3 • 1

WSDW/Qwen2.5-7B-Instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Sep 21, 2024 • 296 • 1

Felladrin/gguf-Q5_K_M-Qwen2.5-0.5B-Instruct

Text Generation • 0.5B • Updated Apr 28, 2025 • 31

Triangle104/Qwen2.5-Lumen-14B-Q5_K_S-GGUF

Text Generation • 15B • Updated Sep 21, 2024 • 33

Triangle104/Qwen2.5-Lumen-14B-Q5_K_M-GGUF

Text Generation • 15B • Updated Sep 21, 2024 • 3

Triangle104/Qwen2.5-Lumen-14B-Q6_K-GGUF

Text Generation • 15B • Updated Sep 21, 2024 • 1

Triangle104/Qwen2.5-Lumen-14B-Q8_0-GGUF

Text Generation • 15B • Updated Sep 21, 2024 • 8

QuantFactory/Qwen2.5-Lumen-14B-GGUF

Text Generation • 15B • Updated Sep 21, 2024 • 141 • 3

mlx-community/Josiefied-Qwen2.5-1.5B-Instruct-abliterated-v1-4bit

Text Generation • 0.2B • Updated Sep 24, 2024 • 12 • 1

mlx-community/Josiefied-Qwen2.5-1.5B-Instruct-abliterated-v1-8bit

Text Generation • 0.4B • Updated Sep 24, 2024 • 4

mlx-community/Josiefied-Qwen2.5-1.5B-Instruct-abliterated-v1-2bit

Text Generation • 0.1B • Updated Sep 24, 2024 • 24

mlx-community/Josiefied-Qwen2.5-1.5B-Instruct-abliterated-v1-f16

Text Generation • 2B • Updated Sep 24, 2024 • 15 •

mradermacher/Qwen2.5-Lumen-14B-GGUF

15B • Updated Sep 22, 2024 • 82 • 5

mradermacher/Josiefied-Qwen2.5-7B-Instruct-abliterated-v2-GGUF

8B • Updated Jun 3, 2025 • 135 • 2

Alex01837178373/Qwen2.5-0.5B-Instruct-GGUF

Text Generation • 0.5B • Updated Sep 21, 2024 • 24

Delta-Vector/Tor-8B

8B • Updated Dec 31, 2024 • 6 • 4

QuantFactory/Qwen2.5-14B-Gutenberg-1e-Delta-GGUF

15B • Updated Sep 22, 2024 • 738 • 2

mradermacher/Qwen2.5-Math-72B-Instruct-i1-GGUF

73B • Updated Sep 22, 2024 • 168

Delta-Vector/Darkens-8B

8B • Updated Dec 31, 2024 • 13 • 6

mradermacher/Qwen2.5-Lumen-14B-i1-GGUF

15B • Updated Sep 22, 2024 • 256 • 8

mradermacher/Josiefied-Qwen2.5-7B-Instruct-abliterated-v2-i1-GGUF

8B • Updated Jun 3, 2025 • 673 • 1

DeusImperator/Qwen2.5-32B-Instruct_exl2_4.7bpw_rpcal_mk2

Text Generation • Updated Apr 28, 2025 • 2

RagnarokChan/Qwen2.5-3B-Instruct-Q4_K_M-GGUF

Text Generation • 3B • Updated Sep 22, 2024 • 3

RagnarokChan/Qwen2.5-3B-Instruct-Q4_0-GGUF

Text Generation • 3B • Updated Sep 22, 2024 • 6

Triangle104/Qwen2.5-1.5B-Instruct-Q4_K_S-GGUF

Text Generation • 2B • Updated Apr 28, 2025 • 78

Triangle104/Qwen2.5-1.5B-Instruct-Q4_K_M-GGUF

Text Generation • 2B • Updated Apr 28, 2025 • 273 • 2