How to use AINovice2005/Voxtral-Mini-3B-2507-smashed with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("AINovice2005/Voxtral-Mini-3B-2507-smashed", dtype="auto")
How to use AINovice2005/Voxtral-Mini-3B-2507-smashed with Pruna AI:
from pruna import PrunaModel # Load model directly model = PrunaModel.from_pretrained("AINovice2005/Voxtral-Mini-3B-2507-smashed", dtype="auto")
