hellork/Qwen2-7B-Instruct-IQ4_NL-GGUF
Text Generation • 8B • Updated • 6
Under 10b iq4_nl gguf
Under 10B GGUFs Non-linear Quantized to try on 4GiB VRAM. Leaderboard https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard
-
-
SixOpen/Nous-Capybara-7B-V1.9-IQ4_NL-GGUF
7B • Updated • 28 -
SixOpen/Phi-3-mini-4k-instruct-IQ4_NL-imat.gguf
Text Generation • 4B • Updated • 20 -
n3shelter/Peach-9B-8k-Roleplay-IQ4_XS-GGUF
Text Generation • 9B • Updated • 30 • 1 -
aifeifei798/llama3-8B-DarkIdol-2.0-Uncensored-IQ4_NL-GGUF
8B • Updated • 16 • 2 -
Trisert/Meta-Llama-3.1-8B-Instruct-IQ4_NL-GGUF
Text Generation • 8B • Updated • 4 • 1 -
Jianping746/Llama3.1-8B-Chinese-Chat-IQ4_XS-GGUF
Text Generation • 8B • Updated • 3 -
DarqueDante/Llama-3.1-8B-Stheno-v3.4-IQ4_XS-GGUF
8B • Updated • 80 -
herrkobold/SauerkrautLM-1.5b-IQ4_XS-GGUF
2B • Updated • 5 -
GrimsenClory/Meta-Llama-3.1-8B-Instruct-IQ4_XS-GGUF
Text Generation • 8B • Updated • 7 -
Niansuh/Llama-3-Groq-8B-Tool-Use-IQ4_NL-GGUF
Updated • 9 -
Cran-May/openbuddy-llama3.1-8b-v22.3-131k-IQ4_XS-GGUF
Text Generation • 8B • Updated • 10 -
matrixportalx/Meta-Llama-3.1-8B-Instruct-IQ4_NL-GGUF
Text Generation • 8B • Updated • 23 -
askmyteapot/Meta-Llama-3-70B-Instruct-abliterated-v3.5-IQ4_XS
71B • Updated • 24 -
Amensia/Qwen2-1.5B-Instruct-IQ4_NL-GGUF
Text Generation • 2B • Updated • 3 -
float-trip/drama-llama-3-iq4_xs
8B • Updated • 3 -
NikolayKozloff/Dorna-Llama3-8B-Instruct-IQ4_XS-GGUF
8B • Updated • 9 • 1 -
Cran-May/Gemma-2-9B-Chinese-Chat-IQ4_XS-GGUF
Text Generation • 9B • Updated • 8 -
SixOpen/Meta-Llama-3-8B-Instruct-IQ4_NL-GGUF
Text Generation • 8B • Updated • 11 -
NikolayKozloff/Dorna-Llama3-8B-Instruct-IQ4_NL-GGUF
8B • Updated • 1 • 1 -
gate369/Phi-3-mini-128k-instruct-IQ4_XS-GGUF
Text Generation • 4B • Updated • 9 -
Alex01837178373/gemma-2-9b-it-abliterated-IQ4_NL-GGUF
9B • Updated • 63 -
lucasdozie/gemma-2-2b-it-IQ4_NL-GGUF
Text Generation • 3B • Updated • 5 -
hanchungshin/Meta-Llama-3.1-8B-Instruct-IQ4_NL-GGUF
Text Generation • 8B • Updated • 1 -
ElMater06/Mistral-7B-Instruct-v0.3-IQ4_NL-GGUF
7B • Updated • 2 • 1 -
NikolayKozloff/L3-8B-Lunaris-v1-IQ4_NL-GGUF
8B • Updated • 1 • 2 -
NikolayKozloff/Llama-3-Instruct-Neurona-8b-v2-IQ4_NL-GGUF
Text Generation • 8B • Updated • 23 • 1 -
NikolayKozloff/llama3-turbcat-instruct-8b-IQ4_NL-GGUF
8B • Updated • 1 • 1 -
NikolayKozloff/tabula-8b-IQ4_NL-GGUF
8B • Updated • 1 -
qnixsynapse/Meta-Llama-3-8B-Instruct-IQ4_XS-GGUF
Text Generation • 8B • Updated • 3 -
qnixsynapse/gemma-2-9b-it-IQ4_XS-GGUF
Text Generation • 9B • Updated • 26 -
Joseph717171/Llama-3.1-SuperNova-Lite-8.0B-OQ8_0-F32.EF32.IQ4_K-Q8_0-GGUF
8B • Updated • 692 • 2 -
DarwinAnim8or/mergekit-model_stock-ffibbcs-IQ4_NL-GGUF
3B • Updated • 1 • 1 -
bunnycore/Llama-3.1-8B-OmniMatrix-IQ4_NL-GGUF
Updated • 1 • 1 -
bunnycore/HyperLlama-3.1-8B-IQ4_NL-GGUF
8B • Updated • 1 • 1 -
DarwinAnim8or/mergekit-model_stock-ffibbcs-IQ4_XS-GGUF
3B • Updated • 5 • 1 -
sehiro/EvoLLM-JP-A-v1-7B-IQ4_XS-GGUF
7B • Updated • 1 • 1 -
Joseph717171/Gemma-2-2b-it-OQ8_0-F32.EF32.IQ4_K_M-8_0-GGUF
3B • Updated • 32 • 1 -
utterlygreat/omost-dolphin-2.9-llama3-8b-IQ4_XS-GGUF
8B • Updated • 2 -
bunnycore/Crazy-Qwen2-7b-IQ4_NL-GGUF
8B • Updated • 5 -
mradermacher/FinMatcha-3B-Instruct-i1-GGUF
3B • Updated • 3.36k -
tiiuae/Falcon3-7B-Instruct
Text Generation • 7B • Updated • 20.3k • 78 -
amgdev9/CodeLlama-7b-hf-Q4_K_M-GGUF
Text Generation • 7B • Updated • 12 -
unsloth/gemma-3n-E4B-it-GGUF
Image-Text-to-Text • 7B • Updated • 29.6k • 200 -
ggml-org/SmolLM3-3B-GGUF
3B • Updated • 5.47k • 55