Instructions to use LightFury9/3B-countdown-250 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use LightFury9/3B-countdown-250 with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("LightFury9/3B-countdown-250", device_map="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- Unsloth Desktop
Update README.md
Browse files
README.md
CHANGED
|
@@ -21,7 +21,7 @@ It has been trained using [TRL](https://github.com/huggingface/trl).
|
|
| 21 |
from transformers import pipeline
|
| 22 |
|
| 23 |
question = "If you had a time machine, but could only go to the past or the future once and never return, which would you choose and why?"
|
| 24 |
-
generator = pipeline("text-generation", model="LightFury9/
|
| 25 |
output = generator([{"role": "user", "content": question}], max_new_tokens=128, return_full_text=False)[0]
|
| 26 |
print(output["generated_text"])
|
| 27 |
```
|
|
|
|
| 21 |
from transformers import pipeline
|
| 22 |
|
| 23 |
question = "If you had a time machine, but could only go to the past or the future once and never return, which would you choose and why?"
|
| 24 |
+
generator = pipeline("text-generation", model="LightFury9/3B-countdown-250", device="cuda")
|
| 25 |
output = generator([{"role": "user", "content": question}], max_new_tokens=128, return_full_text=False)[0]
|
| 26 |
print(output["generated_text"])
|
| 27 |
```
|