---
license: apache-2.0
tags:
  - nova-1
  - language-model
  - phase-1
---

# Nova-1 Large — Phase 1 Checkpoint

Phase 1 pretrained weights for Nova-1 Large.

## Files

```
nova1/
├── nova1_final_s0011211.safetensors   # model weights
└── nova1_final_s0011211_config.json   # architecture config
```

## Architecture

| Param | Value |
|---|---|
| d_model | 2560 |
| n_layers | 32 |
| n_heads | 20 |
| n_kv_heads | 10 |
| max_len | 2048 |
| vocab_size | 50304 |

Trained by SmilyAI Labs.