Instructions to use sleepy186247/deepseek-coder-33b-instruct-mlx-4Bit with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use sleepy186247/deepseek-coder-33b-instruct-mlx-4Bit with MLX:
# Download the model from the Hub pip install huggingface_hub[hf_xet] huggingface-cli download --local-dir deepseek-coder-33b-instruct-mlx-4Bit sleepy186247/deepseek-coder-33b-instruct-mlx-4Bit
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
File size: 1,041 Bytes
53505fc | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 | {% if not add_generation_prompt is defined %}
{% set add_generation_prompt = false %}
{% endif %}
{%- set ns = namespace(found=false) -%}
{%- for message in messages -%}
{%- if message['role'] == 'system' -%}
{%- set ns.found = true -%}
{%- endif -%}
{%- endfor -%}
{{bos_token}}{%- if not ns.found -%}
{{'You are an AI programming assistant, utilizing the Deepseek Coder model, developed by Deepseek Company, and you only answer questions related to computer science. For politically sensitive questions, security and privacy issues, and other non-computer science questions, you will refuse to answer\n'}}
{%- endif %}
{%- for message in messages %}
{%- if message['role'] == 'system' %}
{{ message['content'] }}
{%- else %}
{%- if message['role'] == 'user' %}
{{'### Instruction:\n' + message['content'] + '\n'}}
{%- else %}
{{'### Response:\n' + message['content'] + '\n<|EOT|>\n'}}
{%- endif %}
{%- endif %}
{%- endfor %}
{% if add_generation_prompt %}
{{'### Response:'}}
{% endif %} |