metadata
license: gemma
datasets:
- NbAiLab/aurora-sft-2512-filtered
language:
- 'no'
- nb
- nn
base_model:
- NbAiLab/borealis-4b-instruct-preview
tags:
- conversational
- instruct
- experimental
Borealis 4B Instruct GGUF (Preview)
Release: Dec 22nd, 2025.
Model summary
NbAiLab/borealis-4b-instruct-preview-gguf are quantized versions in GGUF format of a 4B-parameter instruction-tuned preview model intended for early testing and feedback. It is an experiment and should be treated as pre-release quality.
The original model is NbAiLab/borealis-4b-instruct-preview.
| Model | Bits | Format |
|---|---|---|
| NbAiLab/borealis-4b-instruct-preview | BF16 | Transformers (safetensors) |
| NbAiLab/borealis-4b-instruct-preview-gguf | 8 | GGUF (q8_0) |
| NbAiLab/borealis-4b-instruct-preview-gguf | 16 | GGUF (f16) |
| NbAiLab/borealis-4b-instruct-preview-gguf | BF16 | GGUF (bf16) |
| NbAiLab/borealis-4b-instruct-preview-mlx | 32 | MLX |
| NbAiLab/borealis-4b-instruct-preview-mlx-8bits | 8 | MLX (quantized) |