How to use baseten/specdec-target-mistral-7B with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("baseten/specdec-target-mistral-7B", device_map="auto")
marius-baseten commited on 
