LateOn-regularized / 2_Dense /config.json
NohTow's picture
LateOn-unsupervised + MUVERA projection regularization (lambda=0.15, center=both). Trained to produce embeddings that survive MUVERA FDE compression. Beats baseline on MUVERA retrieval: scifact +3%, nfcorpus +5%.
7ae6c85 verified
Raw
History Blame Contribute Delete
160 Bytes
{
"in_features": 1536,
"out_features": 768,
"bias": false,
"activation_function": "torch.nn.modules.linear.Identity",
"use_residual": true
}