Aeala/ShareGPT_Vicuna_unfiltered
Viewer • Updated • 121k • 8.71k • 51
How to use Mayank6255/LLAMA-3.2-3B-EAGLE2-en with Transformers:
# Load model directly
from transformers import AutoModel
model = AutoModel.from_pretrained("Mayank6255/LLAMA-3.2-3B-EAGLE2-en", dtype="auto")Eagle 2 Heads trained for llama 3.2 3B Instruct Model.
Base model
meta-llama/Llama-3.2-3B-Instruct