YAML Metadata Warning:empty or missing yaml metadata in repo card
Check out the documentation for more information.
- expert parallelism
- tp8
- Downloads last month
- 4
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("baseten/mixtral-tp8-032124", dtype="auto")