uploading ctranslate2 compiled model 81edbde
Brian Yu commited on
How to use bri25yu/falcon7b-inf-ctranslate2 with Transformers:
# Load model directly
from transformers import AutoModel
model = AutoModel.from_pretrained("bri25yu/falcon7b-inf-ctranslate2", dtype="auto")