Text Generation
PEFT
Safetensors
PyTorch
llama
lora
code-generation
neural-architecture-search
delta-nas
conversational
Instructions to use ABrain/Delta-NAS-DeepSeek-Coder-7B with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use ABrain/Delta-NAS-DeepSeek-Coder-7B with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("deepseek-ai/deepseek-coder-7b-instruct-v1.5") model = PeftModel.from_pretrained(base_model, "ABrain/Delta-NAS-DeepSeek-Coder-7B") - Notebooks
- Google Colab
- Kaggle
| {% if not add_generation_prompt is defined %} | |
| {% set add_generation_prompt = false %} | |
| {% endif %} | |
| {%- set ns = namespace(found=false) -%} | |
| {%- for message in messages -%} | |
| {%- if message['role'] == 'system' -%} | |
| {%- set ns.found = true -%} | |
| {%- endif -%} | |
| {%- endfor -%} | |
| {{bos_token}}{%- if not ns.found -%} | |
| {{'You are an AI programming assistant, utilizing the Deepseek Coder model, developed by Deepseek Company, and you only answer questions related to computer science. For politically sensitive questions, security and privacy issues, and other non-computer science questions, you will refuse to answer\n'}} | |
| {%- endif %} | |
| {%- for message in messages %} | |
| {%- if message['role'] == 'system' %} | |
| {{ message['content'] }} | |
| {%- else %} | |
| {%- if message['role'] == 'user' %} | |
| {{'### Instruction:\n' + message['content'] + '\n'}} | |
| {%- else %} | |
| {{'### Response:\n' + message['content'] + '\n<|EOT|>\n'}} | |
| {%- endif %} | |
| {%- endif %} | |
| {%- endfor %} | |
| {% if add_generation_prompt %} | |
| {{'### Response:'}} | |
| {% endif %} |