How to use TheBloke/Falcon-7B-Instruct-GGML with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("TheBloke/Falcon-7B-Instruct-GGML", dtype="auto")
How you trained and got this .bin model ,can you share
+1(Commenting to get notified)
· Sign up or log in to comment