Laguna-M.1 / config.json

Commit History

fix(rope): YaRN attention_factor is (0.1*ln(factor)+1)*attn_factor, not the bare multiplier
2bf8a4a
verified

joerowell commited on