Abstract
Geometry-aware generative models leveraging spherical manifolds and optimal transport techniques outperform traditional Euclidean approaches for natural image synthesis.
Recent advances in generative models highlight the power of geometry-aware modeling in manifold-constrained settings. Yet, for natural images, the field remains confined to Euclidean assumptions, failing to exploit the potential of intrinsic geometric structures within the data. In this work, we investigate the geometry of natural images and observe that semantic information is predominantly encoded in directional components, while norm components can be approximated by the global average. This property holds across both RGB and latent spaces, suggesting that natural images can be effectively modeled on a hypersphere. Building on this finding, we introduce Spherical Optimal Transport Flow Matching (SOT-CFM), which utilizes angular distance, and Spherical Flow Matching (SFM), which constrains dynamics directly on the manifold. Our experiments demonstrate that these geometry-aware methods achieve superior performance against Euclidean baselines. Ultimately, this work provides a novel perspective that bridges the gap between Riemannian manifold-based modeling and natural image generation.
Community
TL;DR: Natural images live on a hypersphere — and treating them that way improves flow matching.
Geometry-aware generative modeling has worked well on known manifolds (molecules, crystals, proteins), but natural images have stayed stuck in Euclidean space because nobody knew what manifold they lived on.
We show a surprisingly simple answer: their semantic content is almost entirely in the direction, not the norm. Projecting images (both RGB and VAE latents) onto a sphere of the dataset's mean radius leaves them perceptually indistinguishable from the originals.
Building on this, we propose SOT-CFM (angular OT cost) and SFM (fully Riemannian flow matching on the sphere). SFM is, to our knowledge, the first successful application of a fully manifold-based generative framework to large-scale natural images.
I really enjoyed your approach to utilizing spherical manifolds for natural image generation.
I am reaching out because I recently published complementary work that also tackles generative modeling on intrinsic manifolds: "Learning on the Manifold: Unlocking Standard Diffusion Transformers with Representation Encoders" (arXiv:2602.10099). While your work elegantly focuses on flow matching, ours extends manifold learning to standard Diffusion Transformers.
Given the strong thematic overlap in bridging manifold-based modeling with image generation, we would be honored if you considered referencing our paper in your related work section in future revisions.
Congratulations again on the excellent paper!
Thanks for the kind note! Just for context, our paper was first introduced back in September 2025 (OpenReview, ICLR 2026 submission: https://openreview.net/forum?id=y7xF1bQ0C5; recently accepted to ICML 2026: https://icml.cc/virtual/2026/poster/61879). We'd be glad to cite your work in our follow-up paper, and it would be wonderful if you could consider including ours in your next revision or future work as well.
Congratulations on your interesting work.
Get this paper in your agent:
hf papers read 2605.25294 Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash Models citing this paper 0
No model linking this paper
Datasets citing this paper 0
No dataset linking this paper
Spaces citing this paper 0
No Space linking this paper
Collections including this paper 0
No Collection including this paper