Instructions to use Tiiny/TurboSparse-Mixtral-Instruct with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use Tiiny/TurboSparse-Mixtral-Instruct with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("feature-extraction", model="Tiiny/TurboSparse-Mixtral-Instruct", trust_remote_code=True)# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("Tiiny/TurboSparse-Mixtral-Instruct", trust_remote_code=True, dtype="auto") - Notebooks
- Google Colab
- Kaggle
Yixin Song commited on
Update README.md
Browse files
README.md
CHANGED
|
@@ -30,7 +30,7 @@ As we merged the predictors for FFN neurons in models, you can finetune TurboSpa
|
|
| 30 |
## Limitations
|
| 31 |
* TurboSparse, having just undergone training with 150B tokens, may still exhibit performance gaps in certain tasks.
|
| 32 |
* The TurboSparse model has only been trained on English-language datasets, hence its capabilities in other languages are still lacking.
|
| 33 |
-
* The model may produce unexpected outputs due to its small size and probabilistic generation paradigm.
|
| 34 |
|
| 35 |
## License
|
| 36 |
|
|
|
|
| 30 |
## Limitations
|
| 31 |
* TurboSparse, having just undergone training with 150B tokens, may still exhibit performance gaps in certain tasks.
|
| 32 |
* The TurboSparse model has only been trained on English-language datasets, hence its capabilities in other languages are still lacking.
|
| 33 |
+
* The model may produce unexpected outputs due to its small size, limited training tokens and probabilistic generation paradigm.
|
| 34 |
|
| 35 |
## License
|
| 36 |
|