phi-4-14b-pmtp / adapter_config.json
Polydim-Einsof's picture
feat(pmtp): SVD Procrustes fp64 hardening St(2048,5120) defect=1.73e-16
d4838d4 verified
Raw History Blame Contribute Delete
403 Bytes
{
"peft_type": "PMTP_STIEFEL_PROCRUSTES",
"auto_mapping": null,
"base_model_name_or_path": "phi-4-14b",
"d_in": 5120,
"d_out": 2048,
"stiefel_manifold": "St(2048, 5120)",
"dtype": "float64",
"polar_retraction_order": "svd_procrustes_fp64",
"stiefel_defect_fp64": 1.7277372077325267e-16,
"ghost_protocol_ready": true,
"architect": "Ariel Garcia Traba (POLYDIM-EINSOF)"
}