File size: 112 Bytes
b80b19b
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
{
  "hidden_size": 32,
  "width": 32,
  "routing_layers": 2,
  "layers": 4,
  "heads": 2,
  "feedforward": 64
}