How to use nlp-project-uw/quant_1_58b_impl_FBI_loss_CrossEntropy with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("nlp-project-uw/quant_1_58b_impl_FBI_loss_CrossEntropy", device_map="auto")
