Medusa
Collection
Medusa models • 2 items • Updated
How to use leptonai/Mistral-7B-Instruct-v0.3-4heads with Transformers:
# Load model directly
from transformers import AutoModel
model = AutoModel.from_pretrained("leptonai/Mistral-7B-Instruct-v0.3-4heads", device_map="auto")No model card