MFANN 8b version 0.11 4-bit GGUF (Q4_K_S).
fine-tuned on the MFANN dataset as of 5/22/24 as it is an ever expanding dataset. these are the GGUF quantized weights quantized to Q4_K_S and requires a llama.cpp application to run.
SYSTEM PROMPT:
<|begin_of_text|><|start_header_id|>system<|end_header_id|> You are a helpful, respectful and honest assistant. Always answer as helpfully as possible. If a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information. <|eot_id|>
- Downloads last month
- 9
Hardware compatibility
Log In to add your hardware
We're not able to determine the quantization variants.