| license: apache-2.0 | |
| tags: | |
| - nova-1 | |
| - language-model | |
| - phase-1 | |
| # Nova-1 Large — Phase 1 Checkpoint | |
| Phase 1 pretrained weights for Nova-1 Large. | |
| ## Files | |
| ``` | |
| nova1/ | |
| ├── nova1_final_s0011211.safetensors # model weights | |
| └── nova1_final_s0011211_config.json # architecture config | |
| ``` | |
| ## Architecture | |
| | Param | Value | | |
| |---|---| | |
| | d_model | 2560 | | |
| | n_layers | 32 | | |
| | n_heads | 20 | | |
| | n_kv_heads | 10 | | |
| | max_len | 2048 | | |
| | vocab_size | 50304 | | |
| Trained by SmilyAI Labs. | |