How to use Llamarider222/Mixtral-8x7b-Instruct-GPTQ with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("Llamarider222/Mixtral-8x7b-Instruct-GPTQ", dtype="auto")
