Update README.md
Browse files
README.md
CHANGED
|
@@ -49,8 +49,22 @@ Available in [**NbAiLab/borealis-4b-instruct-preview-gguf**](https://huggingface
|
|
| 49 |
- `model-f16.gguf`
|
| 50 |
- `model-bf16.gguf`
|
| 51 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 52 |
### MLX (Apple Silicon)
|
| 53 |
Available in [**NbAiLab/borealis-4b-instruct-preview-mlx**](https://huggingface.co/NbAiLab/borealis-4b-instruct-preview-mlx)
|
| 54 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 55 |
## Acknowledgements
|
| 56 |
Thanks to the **Gemma** team at Google for releasing Gemma 3 and to everyone contributing feedback on this preview.
|
|
|
|
| 49 |
- `model-f16.gguf`
|
| 50 |
- `model-bf16.gguf`
|
| 51 |
|
| 52 |
+
Use:
|
| 53 |
+
```bash
|
| 54 |
+
ollama run hf.co/NbAiLab/borealis-4b-instruct-preview-gguf:BF16
|
| 55 |
+
```
|
| 56 |
+
|
| 57 |
### MLX (Apple Silicon)
|
| 58 |
Available in [**NbAiLab/borealis-4b-instruct-preview-mlx**](https://huggingface.co/NbAiLab/borealis-4b-instruct-preview-mlx)
|
| 59 |
|
| 60 |
+
Use:
|
| 61 |
+
```bash
|
| 62 |
+
# Install MLX LM
|
| 63 |
+
uv tool install mlx-lm
|
| 64 |
+
|
| 65 |
+
# Interactive chat REPL
|
| 66 |
+
mlx_lm.chat --model "NbAiLab/borealis-4b-instruct-preview-mlx"
|
| 67 |
+
```
|
| 68 |
+
|
| 69 |
## Acknowledgements
|
| 70 |
Thanks to the **Gemma** team at Google for releasing Gemma 3 and to everyone contributing feedback on this preview.
|