Instructions to use Phpcool/DeepSeek-R1-Distill-SRE-Qwen-32B-INT8 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- fastText
How to use Phpcool/DeepSeek-R1-Distill-SRE-Qwen-32B-INT8 with fastText:
from huggingface_hub import hf_hub_download import fasttext model = fasttext.load_model(hf_hub_download("Phpcool/DeepSeek-R1-Distill-SRE-Qwen-32B-INT8", "model.bin")) - Notebooks
- Google Colab
- Kaggle
| # ollama modelfile auto-generated by llamafactory | |
| FROM . | |
| TEMPLATE """<|begin▁of▁sentence|>{{ if .System }}{{ .System }}{{ end }}{{ range .Messages }}{{ if eq .Role "user" }}<|User|>{{ .Content }}<|Assistant|>{{ else if eq .Role "assistant" }}{{ .Content }}<|end▁of▁sentence|>{{ end }}{{ end }}""" | |
| PARAMETER stop "<|end▁of▁sentence|>" | |
| PARAMETER num_ctx 4096 | |