Spaces:

agharsallah
/

mxvumnd3oi-logbook

Running

App Files Files Community

mxvumnd3oi-logbook / pages

150 kB

Ctrl+K

Ctrl+K

1 contributor

History: 2 commits

agharsallah's picture

Real n-particle attention flow: C1 forgetting transition, C2 norm+depth (eta~sqrtL), C3 T*=log(1/d)/eps with measured spectral gap

d84ee59 verified 12 days ago

claim-1-lora-fine-tuning-dynamics-are-modeled-via-a
Real n-particle attention flow: C1 forgetting transition, C2 norm+depth (eta~sqrtL), C3 T*=log(1/d)/eps with measured spectral gap 12 days ago
claim-2-theorem-5-4-establishes-a-two-phase-bifurca
Real n-particle attention flow: C1 forgetting transition, C2 norm+depth (eta~sqrtL), C3 T*=log(1/d)/eps with measured spectral gap 12 days ago
claim-3-proposition-5-8-bounds-the-time-to-deviation
Real n-particle attention flow: C1 forgetting transition, C2 norm+depth (eta~sqrtL), C3 T*=log(1/d)/eps with measured spectral gap 12 days ago
claim-4-proposition-7-2-shows-that-when-lora-update
Update logbook: Repro - Understanding Catastrophic Forgetting In LoRA via Mean-Field Attention Dynamics 12 days ago
claim-5-empirical-checks-on-bert-and-llama2-partiall
Update logbook: Repro - Understanding Catastrophic Forgetting In LoRA via Mean-Field Attention Dynamics 12 days ago
conclusion
Update logbook: Repro - Understanding Catastrophic Forgetting In LoRA via Mean-Field Attention Dynamics 12 days ago
overview-method
Real n-particle attention flow: C1 forgetting transition, C2 norm+depth (eta~sqrtL), C3 T*=log(1/d)/eps with measured spectral gap 12 days ago
index.md

767 Bytes
Update logbook: Repro - Understanding Catastrophic Forgetting In LoRA via Mean-Field Attention Dynamics 12 days ago