Instructions to use Vo1dAbyss/DeepSeek-R1-Distill-Qwen-7B-Python-unsloth-bnb-4bit-V3-5 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use Vo1dAbyss/DeepSeek-R1-Distill-Qwen-7B-Python-unsloth-bnb-4bit-V3-5 with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("Vo1dAbyss/DeepSeek-R1-Distill-Qwen-7B-Python-unsloth-bnb-4bit-V3-5", device_map="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- Unsloth Studio
How to use Vo1dAbyss/DeepSeek-R1-Distill-Qwen-7B-Python-unsloth-bnb-4bit-V3-5 with Unsloth Studio:
Install Unsloth Studio (macOS, Linux, WSL)
curl -fsSL https://unsloth.ai/install.sh | sh # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for Vo1dAbyss/DeepSeek-R1-Distill-Qwen-7B-Python-unsloth-bnb-4bit-V3-5 to start chatting
Install Unsloth Studio (Windows)
irm https://unsloth.ai/install.ps1 | iex # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for Vo1dAbyss/DeepSeek-R1-Distill-Qwen-7B-Python-unsloth-bnb-4bit-V3-5 to start chatting
Using HuggingFace Spaces for Unsloth
# No setup required # Open https://huggingface.co/spaces/unsloth/studio in your browser # Search for Vo1dAbyss/DeepSeek-R1-Distill-Qwen-7B-Python-unsloth-bnb-4bit-V3-5 to start chatting
Load model with FastModel
pip install unsloth from unsloth import FastModel model, tokenizer = FastModel.from_pretrained( model_name="Vo1dAbyss/DeepSeek-R1-Distill-Qwen-7B-Python-unsloth-bnb-4bit-V3-5", max_seq_length=2048, )
Question
#1
by niekoferro - opened
It looks like you have fine tuned this for python specific which is what im trying to use via the ollama plugin on VS code as an assistant. Im building an agent chain and have a BaseTool bug when instantiating agents and literally all of copilots LLMs cant figure it out. Would much rather have a fine tuned local coding assitent for VS and i guess my question is would this be what im looking for? Thanks in advance