Transformers How to use andrewverse/Llama-3.1-8B-bnb-4bit-python-merged with Transformers:
# Load model directly
from transformers import AutoModel
model = AutoModel.from_pretrained("andrewverse/Llama-3.1-8B-bnb-4bit-python-merged", device_map="auto") 
