sev / model_config.json
minhleduc's picture
Mirror laya-typed-decisions-ce-1024 (CE-only, 1024/256) + model card
f9e4c79 verified
Raw History Blame Contribute Delete
308 Bytes
{
"encoder_name": "answerdotai/ModernBERT-large",
"head_layers": 2,
"head_dropout": 0.1,
"num_qtypes": 3,
"cls_query": false,
"slot_emb": false,
"max_len": 1024,
"head_max_len": 256,
"k_buckets": [
2,
5,
10
],
"source_checkpoint": "epoch_4.pt",
"epoch": 4,
"step": 340
}