QuantFactory/Meta-Llama-3.1-8B-Instruct-abliterated-GGUF

This is quantized version of mlabonne/Meta-Llama-3.1-8B-Instruct-abliterated created using llama.cpp

Original Model Card

This is an uncensored version of Llama 3.1 8B Instruct created with abliteration (see this article to know more about it).

Special thanks to @FailSpy for the original code and technique. Please follow him if you're interested in abliterated models.

Thanks to ZeroWw and Apel-sin for the quants.

Better GGUF: https://huggingface.co/ZeroWw/Meta-Llama-3.1-8B-Instruct-abliterated-GGUF
My old GGUF: https://huggingface.co/mlabonne/Meta-Llama-3.1-8B-Instruct-abliterated-GGUF
EXL2: https://huggingface.co/Apel-sin/llama-3.1-8B-abliterated-exl2

GGUF

Model size

8B params

Architecture

llama

Hardware compatibility

2-bit

3-bit

4-bit

5-bit

6-bit

8-bit

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support