Transformers How to use youssefkhalil320/LLM2Vec-Sheared-LLaMA-mntp-4quant2 with Transformers:
# Load model directly
from transformers import AutoModel
model = AutoModel.from_pretrained("youssefkhalil320/LLM2Vec-Sheared-LLaMA-mntp-4quant2", dtype="auto") 
