How to use TheBloke/LosslessMegaCoder-Llama2-13B-Mini-GGML with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("TheBloke/LosslessMegaCoder-Llama2-13B-Mini-GGML", dtype="auto")
DQ83