Instructions to use Oxen-AI/mamba-130m-context with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use Oxen-AI/mamba-130m-context with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("Oxen-AI/mamba-130m-context", dtype="auto") - Notebooks
- Google Colab
- Kaggle
# Load model directly
from transformers import AutoModel
model = AutoModel.from_pretrained("Oxen-AI/mamba-130m-context", dtype="auto")Quick Links
This model goes along with the following blog post for how we trained it.
https://blog.oxen.ai/practical-ml-dive-how-to-train-mamba-for-question-answering/
The model will answer a question given context, or refuse to answer a question given context.
{context}
Q: {question}
A:
and will answer with "I don't know" if the context does not answer the question.
For example:
The Panthers used the San Jose State practice facility and stayed at the San Jose Marriott.
The Broncos practiced at Stanford University and stayed at the Santa Clara Marriott.
Q: What hotel did the Panther’s stay at?
A: San Jose Marriott
The Carolina Panthers are a professional American football team based in Charlotte, North Carolina.
The Panthers compete in the National Football League (NFL), as a member club of the league's National Football Conference (NFC) South division.
Q: What hotel did the Panther’s stay at?
A: I don't know
- Downloads last month
- -
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support
# Gated model: Login with a HF token with gated access permission hf auth login