|
|
--- |
|
|
license: gemma |
|
|
datasets: |
|
|
- NbAiLab/aurora-sft-2512-filtered |
|
|
language: |
|
|
- 'no' |
|
|
- nb |
|
|
- nn |
|
|
base_model: |
|
|
- NbAiLab/borealis-4b-instruct-preview |
|
|
tags: |
|
|
- conversational |
|
|
- instruct |
|
|
- experimental |
|
|
--- |
|
|
|
|
|
# Borealis 4B Instruct GGUF (Preview) |
|
|
|
|
|
Release: Dec 22nd, 2025. |
|
|
|
|
|
## Model summary |
|
|
**NbAiLab/borealis-4b-instruct-preview-gguf** are quantized versions in GGUF format of a **4B-parameter** instruction-tuned **preview** model intended for early testing and feedback. It is an **experiment** and should be treated as pre-release quality. |
|
|
|
|
|
The original model is [NbAiLab/borealis-4b-instruct-preview](https://huggingface.co/NbAiLab/borealis-4b-instruct-preview). |
|
|
|
|
|
| Model | Bits | Format | |
|
|
|---|---:|---| |
|
|
| [NbAiLab/borealis-4b-instruct-preview](https://huggingface.co/NbAiLab/borealis-4b-instruct-preview) | BF16 | Transformers (safetensors) | |
|
|
| [NbAiLab/borealis-4b-instruct-preview-gguf](https://huggingface.co/NbAiLab/borealis-4b-instruct-preview-gguf) | 8 | GGUF (`q8_0`) | |
|
|
| [NbAiLab/borealis-4b-instruct-preview-gguf](https://huggingface.co/NbAiLab/borealis-4b-instruct-preview-gguf) | 16 | GGUF (`f16`) | |
|
|
| [NbAiLab/borealis-4b-instruct-preview-gguf](https://huggingface.co/NbAiLab/borealis-4b-instruct-preview-gguf) | BF16 | GGUF (`bf16`) | |
|
|
| [NbAiLab/borealis-4b-instruct-preview-mlx](https://huggingface.co/NbAiLab/borealis-4b-instruct-preview-mlx) | 32 | MLX | |
|
|
| [NbAiLab/borealis-4b-instruct-preview-mlx-8bits](https://huggingface.co/NbAiLab/borealis-4b-instruct-preview-mlx-8bits) | 8 | MLX (quantized) | |
|
|
|
