fles2-v32 / config.json
Golvis's picture
f2-v32: two-pass distillation best (NDCG=0.3119)
452d8cd verified
Raw
History Blame Contribute Delete
241 Bytes
{
"model_name": "bert-base-uncased",
"vocab_size": 30522,
"hidden_size": 768,
"max_length": 256,
"threshold": 0.0,
"lambda_q": 0.0001,
"lambda_d": 0.0001,
"temperature": 0.05,
"transform": "log1p_relu",
"pooling": "max"
}