How to use Roobick/llama3_cuda_lora with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("Roobick/llama3_cuda_lora", device_map="auto")
