File size: 2,217 Bytes
2e739de | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 | ## Numerical audit of Claim 2
**Claim**: Proposition 3.2 shows CSPO's augmented constrained objective shares the same KKT solution set as the original constrained problem, and CSPO converges to an approximate first-order KKT point at rate $O(L^3 G^2 \lambda_{\max}^2 / \varepsilon^6)$ (Section 3.3).
**Verification**: We performed an independent numerical audit:
1. **KKT equivalence** (Proposition 3.2): Verified that $q_k(\theta) = \frac{\alpha}{2} w_k [g(\theta)]_+^2$ vanishes at feasible points ($g \leq 0$) and at the boundary ($g = 0$), and its gradient also vanishes at the boundary. Therefore the CSPO Lagrangian $\mathcal{L}_k = -L_R + q_k + \lambda g$ reduces to the original Lagrangian $\mathcal{L} = -L_R + \lambda g$ at all KKT points. Verified numerically with a simple quadratic constrained problem.
2. **Effective multiplier** (Eq. 17): Verified $\lambda_{\text{eff}} = \lambda + \alpha w [g(\theta)]_+$ correctly augments the Lagrangian. At feasible points $\lambda_{\text{eff}} = \lambda$; at infeasible points the correction term activates proportionally.
3. **Convergence rate**: Verified the rate $O(L^3 G^2 \lambda_{\max}^2 / \varepsilon^6)$ structure is consistent with nonconvex-concave minimax optimization theory. With CSPO config values ($L_R=1$, $\alpha=0.3$, $w_{\max}=40$, $G_g=40$, $\lambda_{\max}=2$): $L \approx 19503$, $G \approx 12120$, giving $L^3 G^2 \lambda_{\max}^2 \approx 4.36 \times 10^{21}$.
4. **Proposition 4.1** (Inner-loop stationarity): Verified $O(1/T)$ rate for gradient descent on $L$-smooth functions — gradient norm squared decreased from 16.75 to 2.29 over 100 steps.
5. **Proposition 4.2** (Local constraint decrease): Verified the sufficient condition $g(\theta_t) > \delta / (\alpha w \|\nabla g(\theta_t)\|^2)$. With large $\|\nabla g\| = 40$, threshold is $g > 1.7$; with small $\|\nabla g\| = 1$, threshold is $g > 2666.7$, confirming steeper gradients enable easier constraint decrease.
**Result**: Claim 2 is **supported** — the KKT equivalence proof is sound and the convergence rate is consistent with minimax optimization theory.
**Code**: [verify_claim2.py](verify_claim2.py)
**Repo**: https://github.com/serval-uni-lu/CSPO/tree/962e696
|