File size: 762 Bytes
c6b329b 9436bbf 48679ba 9436bbf c6b329b | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 | ---
license: mit
datasets:
- CreitinGameplays/r1_annotated_math-mistral
- CreitinGameplays/DeepSeek-R1-Distill-Qwen-32B_NUMINA_train_amc_aime-mistral
language:
- en
base_model:
- mistralai/Mistral-Nemo-Instruct-2407
pipeline_tag: text-generation
library_name: transformers
---
Run the model:
```python
import torch
from transformers import pipeline
model_id = "CreitinGameplays/Mistral-Nemo-12B-R1-v0.1alpha"
pipe = pipeline(
"text-generation",
model=model_id,
torch_dtype=torch.bfloat16,
device_map="auto",
)
messages = [
{"role": "user", "content": "How many r's are in strawberry?"},
]
outputs = pipe(
messages,
temperature=0.8,
top_p=1.0,
top_k=50,
max_new_tokens=4096,
)
print(outputs[0]["generated_text"][-1])
``` |