baxin
/

RakutenAI-7B-chat-Quantized-model

Model card Files Files and versions

baxin commited on Apr 2, 2024

Commit

71bf62b

·

verified ·

1 Parent(s): 8c9951d

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -16,7 +16,7 @@ The original model is [RakutenAI-7B-chat](https://huggingface.co/Rakuten/Rakuten
 | ggml-model-Q4_K_M.gguf | 4.46GB    |
 | ggml-model-Q5_K_M.gguf | 5.23GB     |
 | ggml-model-Q5_K_S.gguf | 5.1GB    |
-| ggml-model-Q6_K.gguf | |
 ## Usage with llama-cpp

 | ggml-model-Q4_K_M.gguf | 4.46GB    |
 | ggml-model-Q5_K_M.gguf | 5.23GB     |
 | ggml-model-Q5_K_S.gguf | 5.1GB    |
+| ggml-model-Q6_K.gguf | | 6.05 GB
 ## Usage with llama-cpp