mistral-large-3-pmtp / adapter_config.json
Polydim-Einsof's picture
feat(pmtp): SVD Procrustes fp64 hardening St(2048,4096) defect=1.73e-16
9a642e7 verified
Raw History Blame Contribute Delete
408 Bytes
{
"peft_type": "PMTP_STIEFEL_PROCRUSTES",
"auto_mapping": null,
"base_model_name_or_path": "mistral-large-3",
"d_in": 4096,
"d_out": 2048,
"stiefel_manifold": "St(2048, 4096)",
"dtype": "float64",
"polar_retraction_order": "svd_procrustes_fp64",
"stiefel_defect_fp64": 1.732341319468255e-16,
"ghost_protocol_ready": true,
"architect": "Ariel Garcia Traba (POLYDIM-EINSOF)"
}