How to use Kudod/Llama3.1-8B-GradDiff.NLL-th-lora with PEFT:
Task type is invalid.
How to use Kudod/Llama3.1-8B-GradDiff.NLL-th-lora with Transformers:
# pip install -U transformers accelerate # Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("Kudod/Llama3.1-8B-GradDiff.NLL-th-lora", device_map="auto")
Kudod commited on 