Q4_0_4_4-GGUF GGUF dedicated for ARM NEON devices flyfishstudio/yarn-llama-2-7b-128k-Q4_0_4_4.gguf 7B • Updated Sep 19, 2024 • 1 flyfishstudio/Qwen2.5-3B-Instruct-Q4_0_4_4.gguf 3B • Updated Sep 19, 2024 • 10 flyfishstudio/rocket-3b-Q4_0_4_4.gguf 3B • Updated Sep 19, 2024 • 5 flyfishstudio/Gemma-2-Ataraxy-9B-Q4_0_4_4.gguf 9B • Updated Sep 19, 2024 • 1
Q4_0_4_8-GGUF GGUF dedicated for ARM i8mm devices / Snapdragon X Elite / Snapdragon 8 Gen 1,2,3 flyfishstudio/Gemma-2-Ataraxy-9B-Q4_0_4_8.gguf 9B • Updated Sep 20, 2024 • 5 flyfishstudio/Hermes-3-Llama-3.1-8B-Q4_0_4_8.gguf 8B • Updated Sep 20, 2024 • 3 • 1 flyfishstudio/llama-2-7b-chat-Q4_0_4_8.gguf 7B • Updated Sep 20, 2024 • 3 flyfishstudio/meta-llama-3.1-8b-instruct-abliterated-Q4_0_4_8.gguf 8B • Updated Sep 20, 2024 • 22
Q4_0_4_4-GGUF GGUF dedicated for ARM NEON devices flyfishstudio/yarn-llama-2-7b-128k-Q4_0_4_4.gguf 7B • Updated Sep 19, 2024 • 1 flyfishstudio/Qwen2.5-3B-Instruct-Q4_0_4_4.gguf 3B • Updated Sep 19, 2024 • 10 flyfishstudio/rocket-3b-Q4_0_4_4.gguf 3B • Updated Sep 19, 2024 • 5 flyfishstudio/Gemma-2-Ataraxy-9B-Q4_0_4_4.gguf 9B • Updated Sep 19, 2024 • 1
Q4_0_4_8-GGUF GGUF dedicated for ARM i8mm devices / Snapdragon X Elite / Snapdragon 8 Gen 1,2,3 flyfishstudio/Gemma-2-Ataraxy-9B-Q4_0_4_8.gguf 9B • Updated Sep 20, 2024 • 5 flyfishstudio/Hermes-3-Llama-3.1-8B-Q4_0_4_8.gguf 8B • Updated Sep 20, 2024 • 3 • 1 flyfishstudio/llama-2-7b-chat-Q4_0_4_8.gguf 7B • Updated Sep 20, 2024 • 3 flyfishstudio/meta-llama-3.1-8b-instruct-abliterated-Q4_0_4_8.gguf 8B • Updated Sep 20, 2024 • 22
