Instructions to use togethercomputer/m2-bert-80M-32k-retrieval with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use togethercomputer/m2-bert-80M-32k-retrieval with Transformers:
# Load model directly from transformers import AutoModelForSequenceClassification model = AutoModelForSequenceClassification.from_pretrained("togethercomputer/m2-bert-80M-32k-retrieval", trust_remote_code=True, dtype="auto") - Notebooks
- Google Colab
- Kaggle
Ollama compatibility
#3
by twine-network - opened
Is it possible to make a GGUF version of this model to use with Ollama? I haven't been able to find a tool or workflow for this. Wondering if it is even possible.