Models

45,214

Full-text search

Active filters: 4-bit

openbmb/MiniCPM-2B-sft-int4

Text Generation • 3B • Updated Sep 7, 2024 • 81 • 24

openbmb/MiniCPM-2B-dpo-int4

Text Generation • 3B • Updated Sep 7, 2024 • 68 • 5

alokabhishek/Mistral-7B-Instruct-v0.2-bnb-4bit

Text Generation • 7B • Updated Apr 2, 2024 • 18 • 2

CohereLabs/c4ai-command-r-v01-4bit

Text Generation • 35B • Updated Apr 16, 2025 • 14.3k • 178

CohereLabs/c4ai-command-r-plus-4bit

Text Generation • 105B • Updated Apr 16, 2025 • 3.87k • 259

MaziyarPanahi/Llama-3-8B-Instruct-32k-v0.1-GGUF

Text Generation • 8B • Updated Jun 28, 2024 • 142k • 59

unsloth/Phi-3-mini-4k-instruct-bnb-4bit

Text Generation • 4B • Updated Sep 3, 2024 • 32.3k • 44

Qwen/Qwen2-VL-2B-Instruct-AWQ

Image-Text-to-Text • 2B • Updated Sep 21, 2024 • 32.9k • 25

Qwen/Qwen2.5-14B-Instruct-AWQ

Text Generation • 15B • Updated Oct 9, 2024 • 1.66M • 36

Qwen/Qwen2.5-32B-Instruct-AWQ

Text Generation • 33B • Updated Oct 9, 2024 • 1.08M • 100

Qwen/Qwen2.5-72B-Instruct-AWQ

Text Generation • 73B • Updated Oct 9, 2024 • 1.72M • 78

mlx-community/Qwen2.5-72B-Instruct-4bit

Text Generation • 11B • Updated Sep 18, 2024 • 1.19k • 6

unsloth/Qwen2.5-7B-Instruct-bnb-4bit

Text Generation • 8B • Updated Apr 28, 2025 • 273k • 23

unsloth/Llama-3.2-3B-Instruct-bnb-4bit

Text Generation • 3B • Updated Jun 2, 2025 • 65.1k • 36

MaziyarPanahi/Llama-3.2-3B-Instruct-uncensored-GGUF

Text Generation • 4B • Updated Oct 20, 2024 • 780 • 4

Svngoku/c4ai-command-r7b-12-2024-4bit

Text Generation • 8B • Updated Dec 15, 2024 • 289 • 1

unsloth/DeepSeek-R1-Distill-Qwen-7B-unsloth-bnb-4bit

Text Generation • 8B • Updated Feb 14, 2025 • 23.4k • 25

mlx-community/DeepSeek-R1-Distill-Qwen-32B-4bit

Text Generation • 5B • Updated Feb 26, 2025 • 5.97k • 47

unsloth/Llama-3.2-3B-unsloth-bnb-4bit

Text Generation • 3B • Updated Jun 2, 2025 • 3.65k • 4

Felprot75/Llama-3.1-8B-Lexi-Uncensored-V2-mlx_4bit

Text Generation • 1B • Updated Jan 29, 2025 • 1.16k • 3

roleplaiapp/Qwen2.5-Coder-14B-Instruct-Uncensored-Q4_K_M-GGUF

Text Generation • 15B • Updated Jan 31, 2025 • 2.54k • 3

Qwen/Qwen2.5-VL-72B-Instruct-AWQ

Image-Text-to-Text • 74B • Updated Mar 7, 2025 • 116k • 72

Qwen/Qwen2.5-VL-7B-Instruct-AWQ

Image-Text-to-Text • 8B • Updated Apr 6, 2025 • 829k • 104

unsloth/Qwen2.5-VL-32B-Instruct-bnb-4bit

Image-Text-to-Text • Updated May 12, 2025 • 101 • 4

unsloth/orpheus-3b-0.1-ft-unsloth-bnb-4bit

Text-to-Speech • 3B • Updated Mar 24, 2025 • 1.77k • 17

Qwen/Qwen2.5-VL-32B-Instruct-AWQ

Image-Text-to-Text • 33B • Updated Apr 6, 2025 • 156k • 62

sleepdeprived3/Reformed-Christian-Bible-Expert-v2.1-12B_EXL2_4bpw_H8

Text Generation • Updated Apr 20, 2025 • 6 • 1

unsloth/Qwen3-8B-bnb-4bit

Updated May 13, 2025 • 29.9k • 10

lmstudio-community/Qwen3-14B-MLX-4bit

Text Generation • 2B • Updated Apr 28, 2025 • 51.3k • 6

Qwen/Qwen3-32B-AWQ

Text Generation • 33B • Updated May 21, 2025 • 861k • 133