Transformers How to use nlp-project-uw/quant_1_58b_impl_FBI_loss_CrossEntropy with Transformers:
# Load model directly
from transformers import AutoModel
model = AutoModel.from_pretrained("nlp-project-uw/quant_1_58b_impl_FBI_loss_CrossEntropy", device_map="auto") 
