Instructions to use dphn/dolphin-2.9-mixtral-8x22b with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use dphn/dolphin-2.9-mixtral-8x22b with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("dphn/dolphin-2.9-mixtral-8x22b", dtype="auto") - Notebooks
- Google Colab
- Kaggle
GPTQ Quantitative Support
#2 opened about 2 years ago
by
warlock-edward