Abstract
LipsFlower stabilizes flow-matching image restoration by combining Lipschitz-aware architecture and regularization to reduce perturbation amplification while maintaining competitive restoration quality.
Flow-matching models can produce high-quality image restorations, but their learned dynamics may amplify small input perturbations and make reconstructions unstable. We introduce LipsFlower to reduce this amplification. We derive stability bounds for Flow-from-Y, which initializes the ordinary differential equation from a noise-perturbed observation, as well as for observation-conditioned posterior sampling, which conditions the velocity field on the observation throughout integration. Based on this analysis, we develop LipHDiT, a Lipschitz-aware hourglass diffusion transformer that serves as the vector-field architecture of LipsFlower. LipHDiT incorporates stabilized approximate spectral normalization, bounded modulation, and convex residual mixing. We also use adversarial finite-radius gain regularization at sampled interpolation states to penalize excessive sensitivity to the state and, for conditional sampling, the observation. We test both formulations on blind face restoration, measuring adversarial robustness and the perceptual quality of the reconstructions. LipsFlower reduces perturbation amplification while keeping restoration quality competitive with the evaluated baselines. These results suggest that Lipschitz-aware flow matching can improve the stability of generative image restoration.
Community
We investigate how small perturbations in degraded images can lead to large changes in the outputs of flow-matching restoration models. We introduce a Lipschitz-aware architecture and a sensitivity regularization strategy to make these models more stable. We also derive theoretical stability bounds for two restoration formulations: Flow-from-Y and observation-conditioned posterior sampling. Our experiments on blind face restoration show that LipsFlower reduces the amplification of input perturbations while maintaining competitive reconstruction quality.
Models citing this paper 0
No model linking this paper
Datasets citing this paper 0
No dataset linking this paper
Spaces citing this paper 0
No Space linking this paper
Collections including this paper 0
No Collection including this paper