Aeala/ShareGPT_Vicuna_unfiltered
Viewer โข Updated โข 121k โข 10.7k โข 53
How to use Mayank6255/LLAMA-3.2-3B-EAGLE2-en with Transformers:
# pip install -U transformers accelerate
# Load model directly
from transformers import AutoModel
model = AutoModel.from_pretrained("Mayank6255/LLAMA-3.2-3B-EAGLE2-en", device_map="auto")Eagle 2 Heads trained for llama 3.2 3B Instruct Model.
Base model
meta-llama/Llama-3.2-3B-Instruct