File size: 149 Bytes
25dd04f
 
 
1
2
3
4
block_size 1024 heads Heads(n_k=16, rep=3, k_dim=128, v_dim=128)
refit 50 tensors (blk.7.ffn_down.weight)
refit 100 tensors (blk.15.ffn_down.weight)