File size: 117 Bytes
7d25208
 
 
 
 
 
 
1
2
3
4
5
6
7
{
  "vocab_size": 1791,
  "hidden_size": 256,
  "max_seq_len": 512,
  "rope_theta": 10000.0,
  "num_heads": 8
}