Update unified_lora.py
Browse files- unified_lora.py +4 -9
unified_lora.py
CHANGED
|
@@ -1,11 +1,8 @@
|
|
| 1 |
"""
|
| 2 |
-
Legacy Adaptive LoRA (
|
| 3 |
-
================================
|
| 4 |
|
| 5 |
-
Early
|
| 6 |
-
|
| 7 |
-
This approach adjusts rank per-layer based on gradient norm dynamics.
|
| 8 |
-
However, it suffers from instability and does not provide consistent benefits.
|
| 9 |
|
| 10 |
Replaced by:
|
| 11 |
- NestedLoRA (shared orbital architecture)
|
|
@@ -13,7 +10,5 @@ Replaced by:
|
|
| 13 |
|
| 14 |
This file is kept for reference only.
|
| 15 |
|
| 16 |
-
Status: deprecated
|
| 17 |
"""
|
| 18 |
-
|
| 19 |
-
|
|
|
|
| 1 |
"""
|
| 2 |
+
Legacy Adaptive LoRA (Deprecated)
|
| 3 |
+
================================
|
| 4 |
|
| 5 |
+
Early gradient-based adaptive rank prototype.
|
|
|
|
|
|
|
|
|
|
| 6 |
|
| 7 |
Replaced by:
|
| 8 |
- NestedLoRA (shared orbital architecture)
|
|
|
|
| 10 |
|
| 11 |
This file is kept for reference only.
|
| 12 |
|
| 13 |
+
Status: deprecated
|
| 14 |
"""
|
|
|
|
|
|