Hugging Face's logo

Bc-AI
/
nova-1-large-checkpoints

nova-1
language-model
phase-1
Model card Files
xet
 Community
nova-1-large-checkpoints
File size: 503 Bytes
4e86544
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
---
license: apache-2.0
tags:
  - nova-1
  - language-model
  - phase-1
---

# Nova-1 Large — Phase 1 Checkpoint

Phase 1 pretrained weights for Nova-1 Large.

## Files

```
nova1/
├── nova1_final_s0011211.safetensors   # model weights
└── nova1_final_s0011211_config.json   # architecture config
```

## Architecture

| Param | Value |
|---|---|
| d_model | 2560 |
| n_layers | 32 |
| n_heads | 20 |
| n_kv_heads | 10 |
| max_len | 2048 |
| vocab_size | 50304 |

Trained by SmilyAI Labs.