Instructions to use mlx-community/Nemotron-Mini-4B-Instruct-4bit-mlx with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use mlx-community/Nemotron-Mini-4B-Instruct-4bit-mlx with MLX:
# Download the model from the Hub pip install huggingface_hub[hf_xet] huggingface-cli download --local-dir Nemotron-Mini-4B-Instruct-4bit-mlx mlx-community/Nemotron-Mini-4B-Instruct-4bit-mlx
- Notebooks
- Google Colab
- Kaggle
- Local Apps
- LM Studio
Upload chat_template.jinja with huggingface_hub
Browse files- chat_template.jinja +15 -0
chat_template.jinja
ADDED
|
@@ -0,0 +1,15 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{{'<extra_id_0>System'}}{% for message in messages %}{% if message['role'] == 'system' %}{{'
|
| 2 |
+
' + message['content'].strip()}}{% if tools or contexts %}{{'
|
| 3 |
+
'}}{% endif %}{% endif %}{% endfor %}{% if tools %}{% for tool in tools %}{{ '
|
| 4 |
+
<tool> ' + tool|tojson + ' </tool>' }}{% endfor %}{% endif %}{% if contexts %}{% if tools %}{{'
|
| 5 |
+
'}}{% endif %}{% for context in contexts %}{{ '
|
| 6 |
+
<context> ' + context.strip() + ' </context>' }}{% endfor %}{% endif %}{{'
|
| 7 |
+
|
| 8 |
+
'}}{% for message in messages %}{% if message['role'] == 'user' %}{{ '<extra_id_1>User
|
| 9 |
+
' + message['content'].strip() + '
|
| 10 |
+
' }}{% elif message['role'] == 'assistant' %}{{ '<extra_id_1>Assistant
|
| 11 |
+
' + message['content'].strip() + '
|
| 12 |
+
' }}{% elif message['role'] == 'tool' %}{{ '<extra_id_1>Tool
|
| 13 |
+
' + message['content'].strip() + '
|
| 14 |
+
' }}{% endif %}{% endfor %}{%- if add_generation_prompt %}{{'<extra_id_1>Assistant
|
| 15 |
+
'}}{%- endif %}
|