new

Get trending papers in your email inbox!

Subscribe

Daily Papers

byAK and the research community

Oct 29

Spall Failure of Coral Skeleton beneath Gas-Laden Canopies: An Idealized Blast-Fishing Model

Improvised explosives used for fishing on shallow Indonesian reefs shatter coral skeleton, yet the damage they cause has been described largely through empirical radii and ecological surveys. We formulate an idealized model of how free gas held within a coral canopy modifies the shock loading that such a charge delivers to skeletal plates. The canopy is treated as a relaxed bubbly mixture whose shock impedance follows from the conservation of mass and momentum, and the reef is represented as a layered column of water, canopy, skeletal plate, and canopy struck at normal incidence. Three closed-form results emerge. Above a crossover pressure set by the void fraction and the stiffness of seawater, the canopy becomes nearly transparent to the shock. The impulse transmitted through any lossless layered stack is independent of the canopy, so gas redistributes the pulse in time without changing its total push. A plate carries tension after reflection from its lower face only when the canopy impedance falls below a threshold fixed by the plate thickness and the pulse duration, which defines a critical thickness. For a one-kilogram charge directly overhead, a gas-rich canopy more than triples the standoff at which a twelve-centimeter plate spalls while shortening the standoff at which it is crushed. A prescribed daily cycle of photosynthetic gas makes the same charge markedly more damaging at noon than at night. Bubble dynamics show that the canopy does not reach equilibrium within the pulse, so the results are best read as upper bounds.

  • 10 authors
·
Sep 25

Soap Film Drainage Under Tunable Gravity Using a Centrifugal Thin Film Balance

Surface bubbles are an abundant source of aerosols, with important implications for climate processes. In this context, we investigate the stability and thinning dynamics of soap films under effective gravity fields. Experiments are performed using a centrifugal thin-film balance capable of generating accelerations from 0.2 up to 100 times standard gravity, combined with thin-film interferometry to obtain time-resolved thickness maps. Across all experimental conditions, the drainage dynamics are shown to be governed by capillary suction and marginal regeneration-a mechanism in which thick regions of the film are continuously replaced by thin film elements (TFEs) formed at the meniscus. We consistently recover a thickness ratio of 0.8 - 0.9 between the TFEs and the adjacent film, in agreement with previous observations under standard gravity. The measured thinning rates also follow the predicted scaling laws. We identified that gravity has three distinct effects: (i) it induces a strong stretching of the initial film, extending well beyond the linear-elastic regime; (ii) it controls the meniscus size, and thereby the amplitude of the capillary suction and the drainage rate; and (iii) it reveals an inertia-to-viscous transition in the motion of TFEs within the film. These results are supported by theoretical modeling and highlight the robustness of marginal regeneration and capillary-driven drainage under extreme gravity conditions.

  • 6 authors
·
Nov 11, 2025

Drag reduction regimes in air lubrication

Air lubrication regimes were studied using simultaneous drag force measurements and multi-plane imaging to characterize the regimes and identify the governing mechanisms of drag reduction. A bubbly, transitional, and air layer regime are identified over a large range of freestream velocities (U_{infty}), air flow rates (Q_{air}), and Froude-depth numbers (Fr_d). For the lowest U_{infty}, drag reduction lags significantly behind the non-wetted area coverage at all cases and no simple correlation exists. Within the bubbly regime, a drag increase is found for low U_{infty} with large, slow-moving bubbles forming a single layer over the plate height. For higher velocities, bubbles become smaller and disperse vertically, while the drag starts decreasing. For higher Q_{air}, irrespective of U_{infty}, air patches start to form (transitional regime) and drag monotonically decreases, with the onset of the air layer regime at 60\% drag reduction. A new scaling of the associated critical Q_{air} is proposed, combining the air exit velocity, the liquid velocity close to the air layer and Fr_d. For a further increase of Q_{air} and low U_{infty}, a thicker and smoother air layer is formed with even lower drag; for higher U_{infty}, marginal differences are observed. The air layer morphology is significantly altered however, depending on Fr_d: for Fr_d>0.7, it is unbounded, extending beyond the current test section length, and for subcritical conditions (deep water regime, Fr_d<0.61) a closure is formed and the air layer transitions to a cavity of a specific length.

  • 5 authors
·
Apr 18

Droplet-triggered Faraday waves in a vertically forced bath

Repeated impacts of a droplet on a vertically forced bath can produce a growing Faraday-wave response under forcing conditions for which the corresponding initially undisturbed bath remains linearly stable. We investigate this mechanism using axisymmetric two-phase direct numerical simulations over a wide range of Reynolds and Weber numbers. The resulting phenomenological regime map identifies quasi-periodic, decaying, faint, and unstable-bath responses. Along the parameter path considered here, the transition to the unstable-bath regime occurs over a narrow range of Weber numbers and varies only weakly with Reynolds number. In the unstable regime, the bath develops a coherent subharmonic response at half the forcing frequency, while disturbances in the decaying regime remain broadband and weaken between successive rebounds. Bath-only simulations show that a finite-amplitude perturbation representative of droplet impact can seed the confined radial mode susceptible to parametric forcing, initiating a growing subharmonic response below the linear instability threshold of the initially flat bath. A reduced capillary-dominated model provides a scaling estimate for the impact-equivalent perturbation amplitude, and bath-only simulations initialized with these perturbations reproduce the bounded-to-growing transition observed in the coupled simulations. Floquet analysis of the finite cylindrical bath identifies the first axisymmetric Neumann mode as having the lowest subharmonic instability threshold. A time-resolved Bessel decomposition independently shows that the growing bath response is dominated by the same radial mode, while the droplet-induced subharmonic response projects predominantly onto this structure. These results identify a finite-amplitude route by which localized droplet impacts can access Faraday-wave dynamics below the linear onset threshold of an initially undisturbed bath.

  • 2 authors
·
Oct 3

Nonlinear dynamics of a chemically-active drop: from steady to chaotic self-propulsion

Individual chemically active drops suspended in a surfactant solution were observed to self-propel spontaneously with straight, helical, or chaotic trajectories. To elucidate how these drops can exhibit such strikingly different dynamics and `decide' what to do, we propose a minimal axisymmetric model of a spherical active drop, and show that simple and linear interface properties can lead to both steady self-propulsion of the droplet as well as chaotic behavior. The model includes two different mobility mechanisms, namely, diffusiophoresis and the Marangoni effect, that convert self-generated gradients of surfactant concentration into the flow at the droplet surface. In turn, surface-driven flow initiates surfactant advection that is the only nonlinear mechanism and, thus, the only source of dynamical complexity in our model. Numerical investigation of the fully-coupled hydrodynamic and advection diffusion problems reveals that strong advection (e.g., large droplet size) may destabilize a steadily self-propelling drop; once destabilized, the droplet spontaneously stops and a symmetric extensile flow emerges. If advection is strengthened even further in comparison with molecular diffusion, the droplet may perform chaotic oscillations. Our results indicate that the thresholds of these instabilities depend heavily on the balance between diffusiophoresis and the Marangoni effect. Using linear stability analysis, we demonstrate that diffusiophoresis promotes the onset of high-order modes of monotonic instability of the motionless drop. We argue that diffusiophoresis has a similar effect on the instabilities of a moving drop.

  • 2 authors
·
Jan 8, 2019

An Idealized Delay-Differential Model of Scuba Diver Porpoising and Runaway Ascent

A scuba diver holding constant depth balances on an unstable equilibrium: the gas carried in the suit and buoyancy compensator compresses with depth, so the buoyant force falls as the diver sinks and rises as the diver ascends. We represent the diver as a proportional-derivative controller that regulates this compressible-buoyancy saddle after a finite reaction delay, and we derive the governing delay differential equation from the vertical force balance and the isothermal gas law, reducing it to a damping ratio, two control gains, and a dimensionless delay. The characteristic spectrum, obtained by pseudospectral collocation of the semigroup generator and checked against a direct Newton solution of the characteristic equation, locates the Hopf boundary that separates stable hovering from sustained porpoising; for the baseline diver the critical reaction delay is 3.36 s and the onset period is 28.8 s. The bifurcation is supercritical, and because the saturating force is the quadratic hydrodynamic drag, the limit-cycle amplitude grows in proportion to the delay excess rather than as its square root. The safe-operating envelope shows that runaway ascent is triggered by saturation of the compensator, not by loss of linear stability, so a stable and an unstable diver can share the same escape threshold. As onset is approached, the lag-one autocorrelation and variance rise while the fitted recovery rate falls and matches the spectral abscissa, giving an eigenvalue-exact early warning of the transition.

  • 8 authors
·
Aug 14

Experimental and Computational Analysis of the Hydrodynamics of Droplet Generation in a Cylindrical Microfluidic Device

This study investigates the hydrodynamics of droplet formation in a T-shaped cylindrical microfluidic device using micro-PIV experiments and CFD simulations. Devices of 150 micro-m internal diameter were fabricated from PDMS via a cost-effective embedded templating method. Flow visualization was conducted using immiscible silicone oil and deionized water, forming water-in-oil droplets. A mathematical model coupling the Navier-Stokes and conservative level-set equations was solved using the finite element method. Detailed flow fields (velocity, pressure, and phase distribution) were obtained over a wide range of flow-rate ratios (0.1-10) and capillary numbers (0.001-0.1) to characterize droplet formation mechanisms. Phase evolution revealed distinct breakup stages (lag, filling, necking, and pinch-off) and multiple regimes (squeezing, dripping, sausage flow, and parallel flow with tip streaming). A regime map delineating droplet and non-droplet regions was developed. Droplet size, curvature, and internal flow profiles exhibited strong dependence on Ca and Qr. Scaling analysis showed linear dependence of droplet size on Qr in the squeezing regime, with curvature nearly independent of Qr. In contrast, both size and curvature followed power-law dependence on Ca and Qr in the dripping regime. Velocity fields inside droplets were laminar and parabolic in the core. Fully developed plug-like profiles appeared in squeezing, whereas front and rear regions remained developing in dripping. Correlations for droplet length, curvature, and film thickness, including a novel thin-film model incorporating visco-inertial and capillary effects, enable predictive design within the studied range. These findings advance fundamental understanding of confined droplet dynamics and provide quantitative guidelines for optimizing droplet-based microfluidic systems.

  • 3 authors
·
Mar 3

Living Capillary Bridges

Biological tissues exhibit complex behaviors with their dynamics often resembling inert soft matter such as liquids, polymers, colloids, and liquid crystals. These analogies enable physics-based approaches for investigations of emergent behaviors in biological processes. A well-studied case is the spreading of cellular aggregates on solid surfaces, where they display dynamics similar to viscous droplets. In vivo, however, cells and tissues are in a confined environment with varying geometries and mechanical properties to which they need to adapt. In this work, we compressed cellular aggregates between two solid surfaces and studied their dynamics using microscopy, and computer simulations. The confined cellular aggregates transitioned from compressed spheres into dynamic living capillary bridges exhibiting bridge thinning and a convex-to-concave meniscus curvature transition. We found that the stability of the bridge is determined by the interplay between cell growth and cell spreading on the confining surfaces. This interaction leads to bridge rupture at a critical length scale determined by the distance between the plates. The force distributions, formation and stability regimes of the living capillary bridges were characterized with full 3D computer simulations that included cell division, migration and growth dynamics, directly showing how mechanical principles govern the behavior of the living bridges; cellular aggregates display jamming and stiffening analogously to granular matter, and cell division along the long axis enhances thinning. Based on our results, we propose a new class of active soft matter behavior, where cellular aggregates exhibit liquid-like adaptation to confinement, but with self-organized rupturing driven by biological activity.

  • 8 authors
·
Oct 16, 2025

Diffusion limits of cyclic finite-velocity random motions along vector fields

We investigate diffusion approximations for a class of multivariate inhomogeneous finite-velocity random motions motivated by models of active particles. A particle alternates cyclically among prescribed velocity fields V_1,dots,V_p with random run times and evolves according to either a flight dynamics, consisting of piecewise-linear motion, or a gliding dynamics, in which the particle follows the corresponding velocity flow. Under a Kac-type scaling that couples vanishing run times with diverging particle speed, we prove weak convergence of both processes to multidimensional diffusions. It turns out that the order of successive cyclic motions affects the diffusion limit. In addition to the second-order term generated by fluctuations of the random run times, the limiting drift contains directional derivatives DV_i[V_j] of the underlying vector fields. In Stratonovich form, part of this drift is expressed through their Lie brackets [V_i,V_j]. Thus, the generic non-commutativity of the microscopic motions survives the diffusive scaling and generates a macroscopic drift which depends on the cyclic order. The limiting drift also distinguishes the flight and gliding dynamics, despite their being driven by the same vector fields and run times. Several examples, including run-and-reverse motion and cyclic dynamics generated by multiple vector fields, illustrate how the cyclic switching protocol and the geometry of the underlying velocity fields shape the limiting diffusions.

  • 3 authors
·
Aug 30 1

Scalar field theory for (chiral) active Brownian particles: bottom-up derivation revisited

The active Brownian particle (ABP) model is one of the most widely used particle-based models in studies of scalar active fluids. A collection of interacting ABPs is known to exhibit intriguing phenomena that are absent in equilibrium counterparts. A prominent example is spontaneous phase separation, known as motility-induced phase separation (MIPS), which occurs even in the absence of explicit attractive interactions. In parallel, the large-scale behavior of scalar active fluids is often modeled using continuum descriptions, namely, scalar field theories. Such scalar active field theories are usually formulated in a top-down manner, and establishing their connections to particle-based models remains challenging, with these connections not yet fully understood. To advance the microscopic derivation of scalar active field theories, we revisit the connection between ABPs interacting via a two-body potential in two dimensions and scalar field theories that include all possible terms up to fourth order in spatial gradients. Our approach is based on a pressure expansion and the renormalization group (RG) method in the context of singular perturbation theory. The RG method provides a systematic way to eliminate fast variables and identify the dynamics on the slow invariant manifold. Within this framework, scalar field theories can be obtained as RG flow equations. We also apply this method to a chiral variant of the ABP model, the chiral ABP (cABP) model, in which a constant torque biases particle rotation to the left or right. We show that the scalar field theory corresponding to the cABP model contains two ``odd'' terms in addition to those present in the scalar field theory for ABPs. The method developed here may also be useful for deriving hydrodynamic descriptions of other types of active matter systems.

  • 2 authors
·
Sep 30

The elusive fluid-and-crystal coexistence state in simulations of monodisperse, hard-sphere colloids

Monodisperse, purely repulsive, hard spheres (MPRHS) are an important model system for mechanistically exploring phase behavior in atomic systems and colloids. Since the 1940s, phase transitions in these systems have been obtained via simulation, theory, and experiments. But there is a gap in this literature: despite decades of reports of phase transition from one pure state to another, no computational studies report spontaneous phase separation into coexisting domains of liquid and crystal regions. This gap owes its origin to the underlying mechanism of entropically-driven phase separation in MPRHS - the competition between short-range entropy and long-range entropy. Frenkel proposed that spontaneous phase separation in simulations of up to 1,000,000 particles would require more than 317,000,000 years to sample enough microstates to converge to phase separated macrostate. Some brute-force simulations do show brief spontaneous coexistence but a metastable crystal or fluid subsequently overtakes the system. To bypass these difficulties, many studies use seeding, gravity, or direct construction of liquid and solid phases to study interfacial energy and nucleation rates of MPRHS systems. WCA potentials have also been used to bypass metastability, where softness provides free volume, lowers osmotic pressure and the energy barrier. It is argued that the transition path taken in bypassing metastability is mechanistically the same as without triggers. But as acknowledged by Alder & Wainwright, explicit observation of spontaneous coexistence is central to computational prediction of first-order transition. Such observation would provide satisfying demonstration of Frenkel's entropy exchange mechanism. We explore literature revealing these interesting behaviors and conclude that computational demonstration of Frenkel's mechanism for MPRHS awaits large systems with careful hardness perturbations.

  • 4 authors
·
Nov 2, 2025

Stochastic Bubble Completion in de Sitter Space: Power Spectrum, Bispectrum, and Infrared Moment Hierarchies

Stochastic bubble nucleation makes the local completion time of a first-order phase transition a random spatial field. We study its power spectrum and equilateral bispectrum in Minkowski and de Sitter backgrounds, with particular emphasis on the infrared consequences of a finite transition duration. In an eternally extended de Sitter history, rare bubbles nucleated in the remote past generate an ancient-bubble tail that produces a hierarchy of infrared-sensitive spatial moments. For the two-point function, the first finite-k correction becomes tail sensitive at H/β=1/5, while the leading moment becomes singular at H/β=1/3. The corresponding three-point thresholds are H/β=1/8 and 1/6, showing that the bispectrum is more infrared sensitive than the power spectrum. For any finite starting time, however, the ancient-bubble tail is cut off, all spatial moments remain finite, and the strict infrared spectra recover the analytic white-noise limits {cal P}_τpropto k^3 and {cal B}^{rm eq}_τpropto k^6. The eternal-background thresholds instead control the duration dependence of the moment coefficients and the crossover into an intermediate tail-sensitive regime, in agreement with our numerical calculations. We further show that temporal localization of the nucleation history provides a smooth regulator of the ancient-bubble tail and restores the same analytic infrared limits. These results establish a general first-arrival framework for completion-time fluctuations and clarify how de Sitter expansion can generate distinct power-spectrum and bispectrum infrared hierarchies relevant to curvature perturbations and non-Gaussianity.

  • 3 authors
·
Oct 5

Motile Bacteria-laden Droplets Exhibit Reduced Adhesion and Anomalous Wetting Behavior

Hypothesis: Bacterial contamination of surfaces poses a major threat to public health. Designing effective antibacterial or self-cleaning surfaces requires understanding how bacteria-laden droplets interact with solid substrates and how readily they can be removed. We hypothesize that bacterial motility critically influences the early-stage surface interaction (i.e., surface adhesion) of bacteria-laden droplets, which cannot be captured by conventional contact angle goniometry. Experiments: Sessile droplets containing live and dead Escherichia coli (E. coli) were studied to probe their wetting and interfacial behavior. Contact angle goniometry was used to probe dynamic wetting, while a cantilever-deflection-based method was used to quantify adhesion. Internal flow dynamics were visualized using micro-particle image velocimetry (PIV) and analyzed statistically. Complementary sliding experiments on moderately wettable substrates were performed to assess contact line mobility under tilt. Findings: Despite lower surface tension, droplets containing live bacteria exhibited lower surface adhesion forces than their dead counterparts, with adhesion further decreasing at higher bacterial concentrations. Micro-PIV revealed that flagellated live E. coli actively resist evaporation-driven capillary flow via upstream migration, while at higher concentrations, collective dynamics emerge, producing spatially coherent bacterial motion despite temporal variability. These coordinated flows disrupt passive transport and promote depinning of the contact line, thereby reducing adhesion. Sliding experiments confirmed enhanced contact line mobility and frequent stick-slip motion in live droplets, even with lower receding contact angles and higher hysteresis. These findings provide mechanistic insight into droplet retention, informing the design of self-cleaning/antifouling surfaces.

  • 4 authors
·
Oct 28, 2025

Dead or alive: Distinguishing active from passive particles using supervised learning

A longstanding open question in the field of dense disordered matter is how precisely structure and dynamics are related to each other. With the advent of machine learning, it has become possible to agnostically predict the dynamic propensity of a particle in a dense liquid based on its local structural environment. Thus far, however, these machine-learning studies have focused almost exclusively on simple liquids composed of passive particles. Here we consider a mixture of both passive and active (i.e.\ self-propelled) Brownian particles, with the aim to identify the active particles from minimal local structural information. We compare a state-of-the-art machine learning approach for passive systems with a new method we develop based on Voronoi tessellation. Both methods accurately identify the active particles based on their structural properties at high activity and low concentrations of active particles. Our Voronoi method is, however, substantially faster to train and deploy because it requires fewer, and easy to compute, input features. Notably, both become ineffective when the activity is low, suggesting a fundamentally different structural signature for dynamic propensity and non-equilibrium activity. Ultimately, these efforts might also find relevance in the context of biological active glasses such as confluent cell layers, where subtle changes in the microstructure can hint at pathological changes in cell dynamics.

  • 7 authors
·
May 21, 2023

TIDE: A Physically Diverse 3D Turbulence Benchmark Dataset for Advancing Scientific Machine Learning

Turbulence is a central testbed for machine learning on physical dynamics because its governing laws are known exactly. However, most existing studies remain in 2D, while 3D turbulence has fundamentally different physics and is far more costly to simulate. Existing 3D resources also typically provide only one realization per configuration, making it difficult to distinguish learning the dynamics from fitting the statistics of a single flow. In this paper, we introduce TIDE (Turbulent Incompressible DNS Ensembles), a 256^3 DNS corpus and benchmark for 3D incompressible turbulence, with 15 configurations on eight controlled axes, independent ensembles, pressure fields, and equation-level verification. The benchmark includes five tasks, standardized learned baselines, controlled generalization splits, and physical-fidelity metrics alongside pointwise error. Across the main forecasting configurations, current learned models barely outperform persistence and still make about twice the error of a spectral solver given the true equations. Moreover, lower pointwise error can coincide with severely distorted small-scale dynamics, showing that accuracy alone does not ensure physical fidelity. Generalization results further show that most regime shifts reflect limited training coverage, whereas forced-to-decay transfer exposes a missing conditioning variable: operators trained under forcing continue to predict driven evolution when the external drive is removed. Closing these accuracy, fidelity, and conditioning gaps is the central open problem made measurable by TIDE.

  • 7 authors
·
Aug 3

Resource supply dynamics control stability and chaos in complex ecosystems

Ecological interactions are often mediated by feedbacks between organisms and their resource environments. Yet, how resource supply dynamics dictate collective dynamical phases of an ecosystem remains unclear. Here, we analyse a generalised consumer--resource model with non-reciprocal interactions to demonstrate that self-renewing versus externally-supplied resources yield fundamentally different dynamical phase diagrams. As interactions become increasingly non-reciprocal, ecosystems relying on self-renewing resources transition from stable dynamics to chaos and ultimately to infeasibility. By contrast, ecosystems with externally-supplied resources remain stable over a broader parameter range and transition to infeasibility without experiencing an intervening chaotic phase. Using the cavity method, we derive a unified stability condition applicable to a broad class of resource supply functions, explaining why externally-supplied resources can expand the stable region. We show that stability hinges crucially on the susceptibility of resources to perturbations, which depends strongly on their supply. Further, we show that external resource supply suppresses chaos in the unstable region by drastically reducing the susceptibility of resources closest to extinction. Our findings demonstrate that resource dynamics fundamentally reshape the accessible dynamical behaviours of an ecosystem, with implications for interpreting microbial community experiments.

  • 3 authors
·
Aug 30

Fluctuations and correlations in chemical reaction kinetics and population dynamics

This chapter provides a pedagogical introduction and overview of spatial and temporal correlation and fluctuation effects resulting from the fundamentally stochastic kinetics underlying chemical reactions and the dynamics of populations or epidemics. After reviewing the assumptions and mean-field type approximations involved in the construction of chemical rate equations for uniform reactant densities, we first discuss spatial clustering in birth-death systems, where non-linearities are introduced through either density-limiting pair reactions, or equivalently via local imposition of finite carrying capacities. The competition of offspring production, death, and non-linear inhibition induces a population extinction threshold, which represents a non-equilibrium phase transition that separates active from absorbing states. This continuous transition is characterized by the universal scaling exponents of critical directed percolation clusters. Next we focus on the emergence of depletion zones in single-species annihilation processes and spatial population segregation with the associated reaction fronts in two-species pair annihilation. These strong (anti-)correlation effects are dynamically generated by the underlying stochastic kinetics. Finally, we address noise-induced and fluctuation-stabilized spatio-temporal patterns in basic predator-prey systems, exemplified by spreading activity fronts in the two-species Lotka-Volterra model as well as spiral structures in the May-Leonard variant of cyclically competing three-species systems akin to rock-paper-scissors games.

  • 1 authors
·
Jul 3, 2018

Meta Flow Matching: Integrating Vector Fields on the Wasserstein Manifold

Numerous biological and physical processes can be modeled as systems of interacting entities evolving continuously over time, e.g. the dynamics of communicating cells or physical particles. Learning the dynamics of such systems is essential for predicting the temporal evolution of populations across novel samples and unseen environments. Flow-based models allow for learning these dynamics at the population level - they model the evolution of the entire distribution of samples. However, current flow-based models are limited to a single initial population and a set of predefined conditions which describe different dynamics. We argue that multiple processes in natural sciences have to be represented as vector fields on the Wasserstein manifold of probability densities. That is, the change of the population at any moment in time depends on the population itself due to the interactions between samples. In particular, this is crucial for personalized medicine where the development of diseases and their respective treatment response depends on the microenvironment of cells specific to each patient. We propose Meta Flow Matching (MFM), a practical approach to integrating along these vector fields on the Wasserstein manifold by amortizing the flow model over the initial populations. Namely, we embed the population of samples using a Graph Neural Network (GNN) and use these embeddings to train a Flow Matching model. This gives MFM the ability to generalize over the initial distributions unlike previously proposed methods. We demonstrate the ability of MFM to improve prediction of individual treatment responses on a large scale multi-patient single-cell drug screen dataset.

  • 8 authors
·
Aug 26, 2024 2

Frenkel's entropy-exchange mechanism in monodisperse, nearly hard-sphere colloids: minimal perturbations to access fluid-crystal coexistence

Entropically driven fluid-solid transitions in monodisperse, purely repulsive hard spheres (MPRHS) are well established in theory, simulation, and experiment for atomic and colloidal systems. For MPRHS, however, coexistence is usually located via bulk free-energy calculations; the underlying microscopic balance between configurational and vibrational entropy is left implicit. Frenkel clarified this mechanism explicitly as an exchange of long-range configurational entropy for short-range vibrational entropy, but in the pristine MPRHS limit the nucleation barrier near coexistence is so high that phase separation is predicted only on astronomical time scales. Consistent with this, even unbiased simulations do not show spontaneous, equilibrium fluid-crystal coexistence; transient mixtures are mostly overtaken by a single phase; observed coexistence is still algorithmically-driven. Nearly hard-sphere colloid experiments do observe fluid-crystal coexistence, but always in the presence of unavoidable triggers such as gravity, walls, and polydispersity. We treat the hard-sphere phase diagram as settled and ask how the entropic exchange mechanism can be revealed in nearly hard-sphere colloidal simulations. We probe the mechanism on finite time scales by introducing minimal perturbations that trigger phase separation: small reductions in hardness that increase locally accessible free volume (and thus gently increase vibrational entropy), and 2-4% distributed crystal seeds. These perturbations produce coexisting fluid and crystal domains with crystal fraction, phase envelope and osmotic pressure that, with systematically increasing particle hardness, approach the hard-sphere limit. These results demonstrate that slight enhancements to vibrational entropy provide a dynamically accessible route to realizing the long-range/short-range entropy exchange required for phase separation.

  • 4 authors
·
Dec 18, 2025

Solving Navier-Stokes Equations Using Data-free Physics-Informed Neural Networks With Hard Boundary Conditions

In recent years, Physics-Informed Neural Networks (PINNs) have emerged as a powerful and robust framework for solving nonlinear differential equations across a wide range of scientific and engineering disciplines, including biology, geophysics, astrophysics and fluid dynamics. In the PINN framework, the governing partial differential equations, along with initial and boundary conditions, are encoded directly into the loss function, enabling the network to learn solutions that are consistent with the underlying physics. In this work, we employ the PINN framework to solve the dimensionless Navier-Stokes equations for three two-dimensional incompressible, steady, laminar flow problems without using any labeled data. The boundary and initial conditions are enforced in a hard manner, ensuring they are satisfied exactly rather than penalized during training. We validate the PINN predicted velocity profiles, drag coefficients and pressure profiles against the conventional computational fluid dynamics (CFD) simulations for moderate to high values of Reynolds number (Re). It is observed that the PINN predictions show good agreement with the CFD results at lower Re. We also extend our analysis to a transient condition and find that our method is equally capable of simulating complex time-dependent flow dynamics. To quantitatively assess the accuracy, we compute the L_2 normalized error, which lies in the range O(10^{-4}) - O(10^{-1}) for our chosen case studies.

  • 4 authors
·
Nov 18, 2025

Femtosecond laser-induced cavitation seeds liquid-jet breakup beyond the Rayleigh-Plateau stability limit

The Rayleigh-Plateau instability predicts that infinitesimal perturbations of a liquid jet grow only for kR < 1, with kR = 1 marking the classical stability boundary. Here, we show that femtosecond-laser-induced cavitation generates a localized, impulsive recoil perturbation on a flowing liquid jet, enabling a two-dimensional map of jet breakup across the (kR, epsilon/R) plane. The perturbation's spacing (wavelength) and strength (amplitude) are set independently by the laser repetition rate and pulse energy, respectively. At low amplitudes, tuning the repetition rate recovers the classical Rayleigh-Plateau dispersion relation and its kR = 1 cutoff, while increasing the wavelength enables controlled generation of monodisperse droplet trains, bidisperse droplet populations, and ultimately isolated single droplets. Along the amplitude axis, low pulse energies produce a seed that amplifies only the imposed wavenumber, whereas above a critical energy Ec, the seed broadens to excite many wavenumbers simultaneously. At still higher amplitudes, we demonstrate deterministic breakup for kR > 1, extending to kR = 1.9, with laser-synchronized droplet production rates up to 0.2 MHz. These results establish localized femtosecond-laser-induced cavitation as a route to controlled Rayleigh-Plateau breakup both within and beyond the classical linear-stability boundary.

  • 4 authors
·
Sep 30

PhyMPGN: Physics-encoded Message Passing Graph Network for spatiotemporal PDE systems

Solving partial differential equations (PDEs) serves as a cornerstone for modeling complex dynamical systems. Recent progresses have demonstrated grand benefits of data-driven neural-based models for predicting spatiotemporal dynamics (e.g., tremendous speedup gain compared with classical numerical methods). However, most existing neural models rely on rich training data, have limited extrapolation and generalization abilities, and suffer to produce precise or reliable physical prediction under intricate conditions (e.g., irregular mesh or geometry, complex boundary conditions, diverse PDE parameters, etc.). To this end, we propose a new graph learning approach, namely, Physics-encoded Message Passing Graph Network (PhyMPGN), to model spatiotemporal PDE systems on irregular meshes given small training datasets. Specifically, we incorporate a GNN into a numerical integrator to approximate the temporal marching of spatiotemporal dynamics for a given PDE system. Considering that many physical phenomena are governed by diffusion processes, we further design a learnable Laplace block, which encodes the discrete Laplace-Beltrami operator, to aid and guide the GNN learning in a physically feasible solution space. A boundary condition padding strategy is also designed to improve the model convergence and accuracy. Extensive experiments demonstrate that PhyMPGN is capable of accurately predicting various types of spatiotemporal dynamics on coarse unstructured meshes, consistently achieves the state-of-the-art results, and outperforms other baselines with considerable gains.

  • 9 authors
·
Mar 2, 2025

Metastable Cosmological Constant and Gravitational Bubbles: Ultra-Late-Time Transitions in Modified Gravity

The observed cosmological constant may originate as the minimum value U_{min} of a scalar field potential, where the scalar field is frozen due to a large mass. If this vacuum is metastable, it may decay to a true vacuum either at present or in the future. Assuming its decay rate Gamma is comparable to the Hubble expansion rate H_0, we estimate the scale of true vacuum bubbles and analyze their evolution. We find that their initial formation scale is sub-millimeter and their tension causes rapid collapse if m gtrsim 1.7 cdot 10^{-3}, eV. For smaller masses, the bubbles expand at the speed of light. We extend our analysis to scalar-tensor theories with non-minimal coupling, finding that the nucleation scale of gravitational constant bubbles remains consistent with the sub-millimeter regime of General Relativity. The critical mass scale remains around 10^{-3},eV. A theoretical estimate at redshift z_{obs} sim 0.01 suggests an observable bubble radius of sim 50 Mpc, implying a gravitational transition triggered sim 300 Myr ago, with a present-day size approaching 100 Mpc. Additionally, we explore mass ranges (m < 10^{-3},eV) and non-minimal coupling xi ranges (10^{-8},eV^{2-n} - 10^{-1},eV^{2-n}) that lead to a variation Delta G/G_N within the 1%-7% range. We assume non-minimal coupling of the form F(phi)=1/kappa - xi phi^n, with kappa=8pi G_N and 2 leq n leq 9. Finally, we review various local physics or/and transition based proposed solutions to the Hubble tension, including ultra-late-time transitional models (z sim 0.01), screened fifth-force mechanisms, and the Lambda_{rm s}CDM model, which features a transition at z sim 2. We discuss observational hints supporting these scenarios and the theoretical challenges they face.

  • 2 authors
·
Mar 14, 2025

Stable by Construction: Variational Latent Markov Operators for Long-Horizon PDE Prediction

Neural PDE solvers provide efficient surrogates for time-dependent physical systems, but autoregressive prediction over long horizons remains challenging because local errors can induce distribution shift and accumulate under recursive deployment. We develop a variational approach to this problem by introducing latent Markov dynamics in which physical states are represented by latent distributions and evolved through probabilistic transitions. The framework is formulated directly on function spaces and specialized to functional Gaussian models, where structured latent perturbations induce a spectral geometry and variational transition alignment regularizes the learned dynamics. We further analyze how these mechanisms affect autoregressive error propagation, providing a theoretical connection between variational training and long-horizon prediction. We instantiate the framework as the Variational Autoencoding Markov Operator (VAMO), which combines spatially resolved latent fields, structured Gaussian perturbations, and a neural-operator transition. Empirically, we demonstrate the effectiveness of VAMO on several fluid-dynamics benchmarks with prediction horizons extending substantially beyond those represented during training, where it consistently reduces error accumulation and improves rollout stability over several deterministic and noise-injection baselines. Overall, these results highlight variational modeling as a complementary approach to robust long-horizon neural PDE dynamics.

  • 3 authors
·
Sep 14

Synchrony and Oscillatory Dynamics for a 2-D PDE-ODE Model of Diffusion-Sensing with Small Signaling Compartments

We analyze a class of cell-bulk coupled PDE-ODE models, motivated by quorum and diffusion sensing phenomena in microbial systems, that characterize communication between localized spatially segregated dynamically active signaling compartments that have a permeable boundary. Each cell secretes a signaling chemical into the bulk region at a constant rate and receives a feedback of the bulk chemical from the entire collection of cells. This global feedback, which activates signaling pathways within the cells, modifies the intracellular dynamics according to the external environment. The cell secretion and global feedback are regulated by permeability parameters across the cell membrane. For arbitrary reaction-kinetics within each cell, the method of matched asymptotic expansions is used in the limit of small cell radius to construct steady-state solutions of the PDE-ODE model, and to derive a globally coupled nonlinear matrix eigenvalue problem (GCEP) that characterizes the linear stability properties of the steady-states. In the limit of large bulk diffusivity an asymptotic analysis of the PDE-ODE model leads to a limiting ODE system for the spatial average of the concentration in the bulk region that is coupled to the intracellular dynamics within the cells. Results from the linear stability theory and ODE dynamics are illustrated for Sel'kov reaction-kinetics, where the kinetic parameters are chosen so that each cell is quiescent when uncoupled from the bulk medium. For various specific spatial configurations of cells, the linear stability theory is used to construct phase diagrams in parameter space characterizing where a switch-like emergence of intracellular oscillations can occur through a Hopf bifurcation.

  • 2 authors
·
Jul 16, 2020

Forecasting Thermoacoustic Instabilities in Liquid Propellant Rocket Engines Using Multimodal Bayesian Deep Learning

The 100 MW cryogenic liquid oxygen/hydrogen multi-injector combustor BKD operated by the DLR Institute of Space Propulsion is a research platform that allows the study of thermoacoustic instabilities under realistic conditions, representative of small upper stage rocket engines. We use data from BKD experimental campaigns in which the static chamber pressure and fuel-oxidizer ratio are varied such that the first tangential mode of the combustor is excited under some conditions. We train an autoregressive Bayesian neural network model to forecast the amplitude of the dynamic pressure time series, inputting multiple sensor measurements (injector pressure/ temperature measurements, static chamber pressure, high-frequency dynamic pressure measurements, high-frequency OH* chemiluminescence measurements) and future flow rate control signals. The Bayesian nature of our algorithms allows us to work with a dataset whose size is restricted by the expense of each experimental run, without making overconfident extrapolations. We find that the networks are able to accurately forecast the evolution of the pressure amplitude and anticipate instability events on unseen experimental runs 500 milliseconds in advance. We compare the predictive accuracy of multiple models using different combinations of sensor inputs. We find that the high-frequency dynamic pressure signal is particularly informative. We also use the technique of integrated gradients to interpret the influence of different sensor inputs on the model prediction. The negative log-likelihood of data points in the test dataset indicates that predictive uncertainties are well-characterized by our Bayesian model and simulating a sensor failure event results as expected in a dramatic increase in the epistemic component of the uncertainty.

  • 5 authors
·
Jul 1, 2021

Feature Lottery? A Bifurcation Theory of Concept Emergence

Neural networks acquire structured representations at specific moments during training, yet identifying these transitions typically relies on retrospective, label-dependent metrics. We introduce a bifurcation theory of representation dynamics to detect these moments in real time. Analyzing a passive GMM probe attached to the evolving encoder, we show the onset of structure corresponds to a supercritical pitchfork bifurcation driven by the loss Hessian. The system exhibits a theoretically predictable zero-crossing (β_c) that, compared to the network's current state (β), yields a dynamic ratio β(t)/β_c(t): a universal, label-free phase coordinate for representation dynamics, computable entirely from hidden states. We empirically validate four distinct transition regimes predicted by this coordinate across diverse settings: SAEs on language models (Pythia), SSL (CIFAR), and grokking (modular arithmetic). Crucially, under finite dissipation, macroscopic symmetry-breaking can lag the initial zero-crossing by orders of magnitude, which providing a rigorous dynamical account of the delayed escape observed in grokking. Microscopically, the bifurcation creates a shared unstable subspace, forcing collective symmetry breaking. We term this the "feature lottery" in SAE training: a feature's terminal interpretability becomes predictable remarkably early. By only 5% of training, early atom purity robustly predicts final convergence purity, with top-decile early atoms achieving over 12x the baseline purity at convergence. Beyond explaining concept emergence, β/β_c provides a practical early-warning indicator for training health, detecting the onset of usable structure, the crystallization of feature identity, and representational collapse epochs before downstream metrics react.

  • 1 authors
·
May 21

Particle-Grid Neural Dynamics for Learning Deformable Object Models from RGB-D Videos

Modeling the dynamics of deformable objects is challenging due to their diverse physical properties and the difficulty of estimating states from limited visual information. We address these challenges with a neural dynamics framework that combines object particles and spatial grids in a hybrid representation. Our particle-grid model captures global shape and motion information while predicting dense particle movements, enabling the modeling of objects with varied shapes and materials. Particles represent object shapes, while the spatial grid discretizes the 3D space to ensure spatial continuity and enhance learning efficiency. Coupled with Gaussian Splattings for visual rendering, our framework achieves a fully learning-based digital twin of deformable objects and generates 3D action-conditioned videos. Through experiments, we demonstrate that our model learns the dynamics of diverse objects -- such as ropes, cloths, stuffed animals, and paper bags -- from sparse-view RGB-D recordings of robot-object interactions, while also generalizing at the category level to unseen instances. Our approach outperforms state-of-the-art learning-based and physics-based simulators, particularly in scenarios with limited camera views. Furthermore, we showcase the utility of our learned models in model-based planning, enabling goal-conditioned object manipulation across a range of tasks. The project page is available at https://kywind.github.io/pgnd .

  • 4 authors
·
Jun 18, 2025

An Embedding-Dynamic Approach to Self-supervised Learning

A number of recent self-supervised learning methods have shown impressive performance on image classification and other tasks. A somewhat bewildering variety of techniques have been used, not always with a clear understanding of the reasons for their benefits, especially when used in combination. Here we treat the embeddings of images as point particles and consider model optimization as a dynamic process on this system of particles. Our dynamic model combines an attractive force for similar images, a locally dispersive force to avoid local collapse, and a global dispersive force to achieve a globally-homogeneous distribution of particles. The dynamic perspective highlights the advantage of using a delayed-parameter image embedding (a la BYOL) together with multiple views of the same image. It also uses a purely-dynamic local dispersive force (Brownian motion) that shows improved performance over other methods and does not require knowledge of other particle coordinates. The method is called MSBReg which stands for (i) a Multiview centroid loss, which applies an attractive force to pull different image view embeddings toward their centroid, (ii) a Singular value loss, which pushes the particle system toward spatially homogeneous density, (iii) a Brownian diffusive loss. We evaluate downstream classification performance of MSBReg on ImageNet as well as transfer learning tasks including fine-grained classification, multi-class object classification, object detection, and instance segmentation. In addition, we also show that applying our regularization term to other methods further improves their performance and stabilize the training by preventing a mode collapse.

  • 5 authors
·
Jul 7, 2022

Semigroup Solutions for A Multilayered Filtration System

We investigate solutions to a coupled system of partial differential equations that describe a multilayered filtration system. Namely, we study the interaction of a viscous incompressible flow with bulk poroelasticity, via a poroelastic interface. The configuration consists of two 3D toroidal subdomains connected via a plate interface, which permits elastic deformation and perfusive fluid dynamics. The governing dynamics comprise Stokes equations in the bulk fluid region, Biot's equations in the bulk poroelastic region, and the recent poroplate of Mikelić at the interface. Coupling occurs on the top and lower surfaces of the plate, and involves conservation of mass, stress balance, and a certain slip condition for the fluid free-flow. We seek strong (and mild) solutions in the Hilbert space framework via the Lumer-Phillips theorem. The resolvent analysis employs a nonstandard mixed variational formulation which captures the complex, multi-physics coupling at the interface. We explicitly characterize the infinitesimal generator associated to the linear Cauchy problem and establish the generation of a C_0-semigroup on a suitably chosen finite-energy space. With the semigroup in hand, we may treat elastic nonlinearities for plate displacements through perturbation theory. These result parallel those for Biot-Stokes filtration systems, and complement the recently established weak solution theory for multilayer filtrations. The agency of the semigroup straightforwardly admits structural (plate) nonlinearity into the dynamics. Future stability and regularity analyses for multilayer filtrations are also made possible by these results, as well as a comparison of spectral and regularity properties between filtration configurations, and the elucidation of the mitigating poroplate dynamics as possibly regularizing and stabilizing.

  • 3 authors
·
Jan 31

Emergent Transfer of a Physics Foundation Model from Simulation to Laboratory Turbulence

Whether physics foundation models can be usefully deployed on laboratory experiments remains an open question for scientific machine learning (ML). We test this question on the Rayleigh-Taylor instability (RTI), a ubiquitous and demanding fluid instability seen from tabletop flows to supernova explosions, in which small perturbations at a density interface grow into chaotic, multiscale mixing as a lighter fluid accelerates into a heavier one. Standard ML models struggle with RTI, and despite over a century of theoretical, numerical, and experimental work, it carries an unresolved discrepancy between simulation and experiment: the late-time mixing growth rate, α, measured in most laboratory experiments (sim 0.06-0.07), is roughly three times the value from idealized direct numerical simulations (DNS, sim 0.02). The gap's origin remains debated. These properties make RTI a stringent test for a question that matters well beyond RTI: can foundation models trained only on simulations generalise to sparse, messy, and noisy laboratory settings? We finetune Walrus, a foundation model for continuum dynamics, on three or fewer DNS realizations and recover key RTI physics over long rollouts. Applied zero-shot to sliding-barrier laboratory data, the finetuned model leaves the DNS-like regime and enters the observed growth band, having never seen a single experimental sample. These results provide independent, data-driven evidence that initial conditions play a crucial role in the longstanding sim-experiment gap in α. The model also generalises zero-shot to stable stratification, a buoyancy regime absent from training, correctly slowing mixing-layer growth. Together, our results show that foundation models can generalise well beyond their training data, predicting laboratory behavior and unseen physical regimes, opening new ways to probe longstanding simulation-experiment gaps.

polymathic-ai Polymathic AI
·
May 30

Tides on Lava Worlds: Application to Close-in Exoplanets and the Early Earth-Moon System

Understanding the physics of planetary magma oceans has been the subject of growing efforts, in light of the increasing abundance of Solar system samples and extrasolar surveys. A rocky planet harboring such an ocean is likely to interact tidally with its host star, planetary companions, or satellites. To date, however, models of the tidal response and heat generation of magma oceans have been restricted to the framework of weakly viscous solids, ignoring the dynamical fluid behavior of the ocean beyond a critical melt fraction. Here we provide a handy analytical model that accommodates this phase transition, allowing for a physical estimation of the tidal response of lava worlds. We apply the model in two settings: The tidal history of the early Earth-Moon system in the aftermath of the giant impact; and the tidal interplay between short-period exoplanets and their host stars. For the former, we show that the fluid behavior of the Earth's molten surface drives efficient early Lunar recession to {sim} 25 Earth radii within 10^4{-} 10^5 years, in contrast with earlier predictions. For close-in exoplanets, we report on how their molten surfaces significantly change their spin-orbit dynamics, allowing them to evade spin-orbit resonances and accelerating their track towards tidal synchronization from a Gyr to Myr timescale. Moreover, we re-evaluate the energy budgets of detected close-in exoplanets, highlighting how the surface thermodynamics of these planets are likely controlled by enhanced, fluid-driven tidal heating, rather than vigorous insolation, and how this regime change substantially alters predictions for their surface temperatures.

  • 5 authors
·
Dec 10, 2024

Surface Charge--Potential Relation for Spherical Particles in Electrolyte Solutions

Predicting the relationship between surface charge density and electrostatic potential for spherical particles remains a fundamental challenge in colloid science. Because the governing non-linear Poisson--Boltzmann equation lacks a general exact analytical solution, researchers typically rely on numerical calculations or various semi-empirical approximations. In this paper, we overcome these limitations by developing a dual-asymptotic framework that provides explicit, closed-form expressions for this surface charge--potential relationship across the entire spectrum of particle curvature. For weakly curved systems, where the Debye length λ_D is much smaller than the particle radius R (λ_D/R ll 1), a formal mathematical derivation rigorously establishes the Ohshima--Healy--White formula as an exact regular perturbation expansion. Conversely, for highly curved spheres (R/λ_D ll 1), we employ singular perturbation analysis using the scaled particle radius as the small parameter. This approach provides a first-principles mathematical justification for the spherical Debye--Hückel theory, proving that its leading-order expansion remains asymptotically exact within the full non-linear Poisson--Boltzmann framework due to the geometric deactivation of non-linearity. Crucially, we map the exact limits of this geometric regulation, demonstrating how non-linear screening re-emerges as the particle radius increases, with the breakdown threshold governed by the interplay between curvature and surface charge density.

  • 2 authors
·
Oct 1

Closed-form Continuous-time Neural Models

Continuous-time neural processes are performant sequential decision-makers that are built by differential equations (DE). However, their expressive power when they are deployed on computers is bottlenecked by numerical DE solvers. This limitation has significantly slowed down the scaling and understanding of numerous natural physical phenomena such as the dynamics of nervous systems. Ideally, we would circumvent this bottleneck by solving the given dynamical system in closed form. This is known to be intractable in general. Here, we show it is possible to closely approximate the interaction between neurons and synapses -- the building blocks of natural and artificial neural networks -- constructed by liquid time-constant networks (LTCs) efficiently in closed-form. To this end, we compute a tightly-bounded approximation of the solution of an integral appearing in LTCs' dynamics, that has had no known closed-form solution so far. This closed-form solution substantially impacts the design of continuous-time and continuous-depth neural models; for instance, since time appears explicitly in closed-form, the formulation relaxes the need for complex numerical solvers. Consequently, we obtain models that are between one and five orders of magnitude faster in training and inference compared to differential equation-based counterparts. More importantly, in contrast to ODE-based continuous networks, closed-form networks can scale remarkably well compared to other deep learning instances. Lastly, as these models are derived from liquid networks, they show remarkable performance in time series modeling, compared to advanced recurrent models.

  • 8 authors
·
Mar 1, 2022

Activated coarsening of motility-induced phase separation in random environments

Self-propelled particles that only repel one another can still separate into a dense and a dilute phase, a process known as motility-induced phase separation (MIPS). In a clean system the domains coarsen like any conserved mixture: domains grow as ell(t)sim t^{1/3}. Living and synthetic swimmers, however, move through rough, porous, or patterned surroundings. Using large-scale simulations of active Brownian particles, we ask how frozen heterogeneity changes MIPS coarsening. We introduce disorder in two ways, as a quenched random force field acting on particle positions and as a quenched random torque field acting on their orientations. Both destroy Lifshitz-Slyozov growth. A transient power law with a disorder-dependent exponent gives way to activated dynamics in which the effective dynamic exponent grows without bound and domains grow at most logarithmically. The crossover obeys the scaling form known from the random-field Ising model, and the domain morphology depends on disorder strength, so superuniversality fails. The two kinds of disorder act through different mechanisms. Random forces trap particles in the sinks of a random drift field once the drift beats self-propulsion. Random torques act as a sign-random, quenched chirality that erodes persistence and lowers the local Péclet number toward its critical value. Our results show that quenched disorder is a relevant perturbation for the kinetics of active phase separation and connect MIPS coarsening to the physics of pinned interfaces in disordered magnets.

  • 2 authors
·
Oct 2

Protein Language Model Embeddings Improve Generalization of Implicit Transfer Operators

Molecular dynamics (MD) is a central computational tool in physics, chemistry, and biology, enabling quantitative prediction of experimental observables as expectations over high-dimensional molecular distributions such as Boltzmann distributions and transition densities. However, conventional MD is fundamentally limited by the high computational cost required to generate independent samples. Generative molecular dynamics (GenMD) has recently emerged as an alternative, learning surrogates of molecular distributions either from data or through interaction with energy models. While these methods enable efficient sampling, their transferability across molecular systems is often limited. In this work, we show that incorporating auxiliary sources of information can improve the data efficiency and generalization of transferable implicit transfer operators (TITO) for molecular dynamics. We find that coarse-grained TITO models are substantially more data-efficient than Boltzmann Emulators, and that incorporating protein language model (pLM) embeddings further improves out-of-distribution generalization. Our approach, PLaTITO, achieves state-of-the-art performance on equilibrium sampling benchmarks for out-of-distribution protein systems, including fast-folding proteins. We further study the impact of additional conditioning signals -- such as structural embeddings, temperature, and large-language-model-derived embeddings -- on model performance.

  • 4 authors
·
Feb 11

Canonical Cortical Field Theories

We characterise the dynamics of neuronal activity, in terms of field theory, using neural units placed on a 2D-lattice modelling the cortical surface. The electrical activity of neuronal units was analysed with the aim of deriving a neural field model with a simple functional form that still able to predict or reproduce empirical findings. Each neural unit was modelled using a neural mass and the accompanying field theory was derived in the continuum limit. The field theory comprised coupled (real) Klein-Gordon fields, where predictions of the model fall within the range of experimental findings. These predictions included the frequency spectrum of electric activity measured from the cortex, which was derived using an equipartition of energy over eigenfunctions of the neural fields. Moreover, the neural field model was invariant, within a set of parameters, to the dynamical system used to model each neuronal mass. Specifically, topologically equivalent dynamical systems resulted in the same neural field model when connected in a lattice; indicating that the fields derived could be read as a canonical cortical field theory. We specifically investigated non-dispersive fields that provide a structure for the coding (or representation) of afferent information. Further elaboration of the ensuing neural field theory, including the effect of dispersive forces, could be of importance in the understanding of the cortical processing of information.

  • 3 authors
·
Aug 20, 2023

Semantic learning in autonomously active recurrent neural networks

The human brain is autonomously active, being characterized by a self-sustained neural activity which would be present even in the absence of external sensory stimuli. Here we study the interrelation between the self-sustained activity in autonomously active recurrent neural nets and external sensory stimuli. There is no a priori semantical relation between the influx of external stimuli and the patterns generated internally by the autonomous and ongoing brain dynamics. The question then arises when and how are semantic correlations between internal and external dynamical processes learned and built up? We study this problem within the paradigm of transient state dynamics for the neural activity in recurrent neural nets, i.e. for an autonomous neural activity characterized by an infinite time-series of transiently stable attractor states. We propose that external stimuli will be relevant during the sensitive periods, {\it viz} the transition period between one transient state and the subsequent semi-stable attractor. A diffusive learning signal is generated unsupervised whenever the stimulus influences the internal dynamics qualitatively. For testing we have presented to the model system stimuli corresponding to the bars and stripes problem. We found that the system performs a non-linear independent component analysis on its own, being continuously and autonomously active. This emergent cognitive capability results here from a general principle for the neural dynamics, the competition between neural ensembles.

  • 2 authors
·
Mar 11, 2009

PhysLDM: Latent Diffusion for High-Fidelity Deformable Simulation

Neural simulation of high-fidelity deformable bodies is a foundational challenge in computer graphics and physical AI. Long-horizon prediction for high-resolution 3D volumetric meshes is hard: autoregressive methods are prone to error accumulation, while direct multi-frame prediction at native resolution is computationally prohibitive. This motivates a compact spatiotemporal latent representation, which is largely unexplored for mesh-based volumetric physics. Meanwhile, it remains unclear whether deterministic regression or generative diffusion is the more suitable predictive paradigm. To address these coupled challenges, we introduce PhysLDM, a unified latent-diffusion paradigm for one-shot deformable simulation. Its core is a holistic spatiotemporal VAE that avoids the "staircase" artifacts of standard temporal compression (e.g., video VAEs), achieving ~2.48 mm reconstruction precision on meter-scale scenes at up to 78x token compression. Based on this reliable latent space, we systematically compare regression and diffusion methods. Our experiments uncover a key modeling insight: complex deformable dynamics are often chaotic, and in this regime deterministic regression tends to produce non-physical averages, whereas diffusion better models their distribution. Accordingly, we employ a latent diffusion model that effectively learns from chaotic data to generate physically plausible trajectories. Trained purely kinematically on an Objaverse-scale dataset, a single PhysLDM generalizes zero-shot to unseen OOD datasets. Its differentiability further enables efficient solution of inverse problems and higher-order design optimization. To our knowledge, PhysLDM is the first high-fidelity spatiotemporal autoencoder and latent-diffusion paradigm for volumetric deformable dynamics, offering a scalable and robust approach to neural simulation. Project Page: https://yucrazing.github.io/physldm/

mmlab-ntu MMLab@NTU
·
Oct 17 2

Space and Time Continuous Physics Simulation From Partial Observations

Modern techniques for physical simulations rely on numerical schemes and mesh-refinement methods to address trade-offs between precision and complexity, but these handcrafted solutions are tedious and require high computational power. Data-driven methods based on large-scale machine learning promise high adaptivity by integrating long-range dependencies more directly and efficiently. In this work, we focus on fluid dynamics and address the shortcomings of a large part of the literature, which are based on fixed support for computations and predictions in the form of regular or irregular grids. We propose a novel setup to perform predictions in a continuous spatial and temporal domain while being trained on sparse observations. We formulate the task as a double observation problem and propose a solution with two interlinked dynamical systems defined on, respectively, the sparse positions and the continuous domain, which allows to forecast and interpolate a solution from the initial condition. Our practical implementation involves recurrent GNNs and a spatio-temporal attention observer capable of interpolating the solution at arbitrary locations. Our model not only generalizes to new initial conditions (as standard auto-regressive models do) but also performs evaluation at arbitrary space and time locations. We evaluate on three standard datasets in fluid dynamics and compare to strong baselines, which are outperformed both in classical settings and in the extended new task requiring continuous predictions.

  • 4 authors
·
Jan 17, 2024

Bifurcations and Competing Coherent Structures in the Cubic-Quintic Ginzburg-Landau Equation I: Plane Wave (CW) Solutions

Singularity Theory is used to comprehensively investigate the bifurcations of the steady-states of the traveling wave ODEs of the cubic-quintic Ginzburg-Landau equation (CGLE). These correspond to plane waves of the PDE. In addition to the most general situation, we also derive the degeneracy conditions on the eight coefficients of the CGLE under which the equation for the steady states assumes each of the possible quartic (the quartic fold and an unnamed form), cubic (the pitchfork and the winged cusp), and quadratic (four possible cases) normal forms for singularities of codimension up to three. Since the actual governing equations are employed, all results are globally valid, and not just of local applicability. In each case, the recognition problem for the unfolded singularity is treated. The transition varieties, i.e. the hysteresis, isola, and double limit curves are presented for each normal form. For both the most general case, as well as for various combinations of coefficients relevant to the particular cases, the bifurcations curves are mapped out in the various regions of parameter space delimited by these varieties. The multiplicities and interactions of the plane wave solutions are then comprehensively deduced from the bifurcation plots in each regime, and include features such as regimes of hysteresis among co-existing states, domains featuring more than one interval of hysteresis, and isola behavior featuring dynamics unrelated to the primary solution branch in limited ranges of parameter space.

  • 2 authors
·
Dec 18, 2012

An efficient Asymptotic-Preserving scheme for the Boltzmann mixture with disparate mass

In this paper, we develop and implement an efficient asymptotic-preserving (AP) scheme to solve the gas mixture of Boltzmann equations under the disparate mass scaling relevant to the so-called "epochal relaxation" phenomenon. The disparity in molecular masses, ranging across several orders of magnitude, leads to significant challenges in both the evaluation of collision operators and the designing of time-stepping schemes to capture the multi-scale nature of the dynamics. A direct implementation of the spectral method faces prohibitive computational costs as the mass ratio increases due to the need to resolve vastly different thermal velocities. Unlike [I. M. Gamba, S. Jin, and L. Liu, Commun. Math. Sci., 17 (2019), pp. 1257-1289], we propose an alternative approach based on proper truncation of asymptotic expansions of the collision operators, which significantly reduces the computational complexity and works well for small varepsilon. By incorporating the separation of three time scales in the model's relaxation process [P. Degond and B. Lucquin-Desreux, Math. Models Methods Appl. Sci., 6 (1996), pp. 405-436], we design an AP scheme that captures the specific dynamics of the disparate mass model while maintaining computational efficiency. Numerical experiments demonstrate the effectiveness of the proposed scheme in handling large mass ratios of heavy and light species, as well as capturing the epochal relaxation phenomenon.

  • 3 authors
·
Nov 20, 2024

Deep Embedded Multiplicative DMD for Algebra-Preserving Koopman Learning

Koopman theory turns nonlinear dynamics into a linear spectral problem. In computation, however, everything depends on a hard finite-dimensional choice: the observables must be expressive, nearly invariant under the dynamics, and, ideally, compatible with composition. Deep Koopman methods learn flexible coordinates, whereas structure-preserving methods enforce operator identities on fixed dictionaries. We combine these ideas by introducing Deep Embedded Multiplicative Dynamic Mode Decomposition (DeepMDMD), a method that learns a latent space and a partition of it, while enforcing the Koopman product rule as an exact algebraic constraint. Training alternates between an exact multiplicative operator update and a differentiable latent-clustering step that promotes Koopman closure. The result is a finite transition map on learned latent cells. Its nonzero spectrum lies on the unit circle, its dictionary is shaped by the dynamics rather than by ambient geometry, and forecasts are made in latent coordinates before being decoded to physical space. Across Hamiltonian, chaotic, and fluid examples, DeepMDMD learns dictionaries that are far more compact and dynamically coherent than those produced by geometric MDMD partitions. It reduces spectral pollution, reveals richer continuous-spectrum structure, and gives stable forecasts under severe noise. In high-dimensional flows, including a 158,624-dimensional cylinder wake and a noisy Re=20,000 lid-driven cavity, it preserves coherent structures and long-time spectral statistics where state-space MDMD fails. These results suggest a practical rule for Koopman learning: learn the coordinates, constrain the algebra.

Multi-Rate Mixture of Experts for Accelerating Liquid Neural Network Training

Multivariate time-series data often exhibit complex temporal dependencies, irregular sampling, and heterogeneous dynamics across multiple time scales, making accurate sequence modeling particularly challenging. Traditional recurrent neural networks (RNNs), such as Long Short-Term Memory (LSTM) networks, operate in discrete time and may struggle to effectively capture continuous and irregular temporal behaviors. Liquid Neural Networks (LNNs) address some of these limitations through continuous-time dynamics, but standard LNN architectures typically rely on a single dynamical system, limiting their ability to model heterogeneous temporal patterns. To address these challenges, we propose a Multi-Rate Mixture-of-Experts (MR-MoE) framework built on top of Liquid Neural Networks. In the proposed architecture, multiple LNN-based experts operate at distinct time scales, enabling the model to explicitly separate fast-changing dynamics from slow-evolving temporal trends. A gating network further enables adaptive expert specialization based on input conditions. In addition, we incorporate both feature-level and temporal attention mechanisms to improve robustness, interpretability, and long-range dependency modeling. Feature-level attention suppresses noisy or irrelevant variables, while temporal attention selectively focuses on informative historical states. We evaluate the proposed framework on a complex multivariate time-series prediction task and compare it against strong baselines, including LSTM, monolithic LNN, and standard MoE models. Experimental results demonstrate that the proposed MR-MoE framework consistently achieves improved AUROC and AUPRC performance while maintaining favorable computational efficiency. These results highlight the effectiveness of combining continuous-time dynamics, multi-scale expert decomposition, and adaptive attention mechanisms for time-series modeling.

  • 3 authors
·
Jun 9

Multi-scale Feature Learning Dynamics: Insights for Double Descent

A key challenge in building theoretical foundations for deep learning is the complex optimization dynamics of neural networks, resulting from the high-dimensional interactions between the large number of network parameters. Such non-trivial dynamics lead to intriguing behaviors such as the phenomenon of "double descent" of the generalization error. The more commonly studied aspect of this phenomenon corresponds to model-wise double descent where the test error exhibits a second descent with increasing model complexity, beyond the classical U-shaped error curve. In this work, we investigate the origins of the less studied epoch-wise double descent in which the test error undergoes two non-monotonous transitions, or descents as the training time increases. By leveraging tools from statistical physics, we study a linear teacher-student setup exhibiting epoch-wise double descent similar to that in deep neural networks. In this setting, we derive closed-form analytical expressions for the evolution of generalization error over training. We find that double descent can be attributed to distinct features being learned at different scales: as fast-learning features overfit, slower-learning features start to fit, resulting in a second descent in test error. We validate our findings through numerical experiments where our theory accurately predicts empirical findings and remains consistent with observations in deep neural networks.

  • 4 authors
·
Dec 6, 2021

Conditional Normalizing Flow for Gas-Surface Scattering from Thermal to Hypersonic Velocities

Accurate aerodynamic modeling of satellites in very low Earth orbit (VLEO) requires gas-surface interaction (GSI) models that capture the full velocity spectrum from thermal to orbital speeds. Atmospheric particles initially strike spacecraft surfaces at hypersonic velocities of 6 000 - 10 000 m/s. Due to surface roughness and complex geometries, especially within air-breathing electric propulsion (ABEP) intake systems, multiple collisions occur, progressively reducing the particle velocities. A recent machine learning framework for deriving scattering kernels from molecular dynamics (MD) simulations has shown promise, but remains limited to high-velocity single impacts and possibly violates fundamental equilibrium principles such as detailed balance. This work extends this machine learning based scattering kernel to cover the complete velocity range using conditional normalizing flows trained with physics-informed constraints, enabling accurate modeling of multi-bounce scenarios in realistic VLEO applications. We train a conditional Real-valued Non-Volume Preserving (cRealNVP) model on expanded molecular dynamics simulations covering velocities from thermal to hypersonic speeds, incorporating a detailed balance loss term. The resulting model demonstrates improved accuracy compared to previous approaches even in the original high-velocity regime, while successfully capturing thermal-velocity scattering. Quantitative assessment shows that thermalization is approximated within acceptable tolerances. This framework provides essential capabilities for accurate ABEP intake optimization and VLEO mission planning while offering a general methodology applicable to broader rarefied gas dynamics problems requiring thermodynamic consistency.

  • 6 authors
·
Jul 2

Synthetic Lagrangian Turbulence by Generative Diffusion Models

Lagrangian turbulence lies at the core of numerous applied and fundamental problems related to the physics of dispersion and mixing in engineering, bio-fluids, atmosphere, oceans, and astrophysics. Despite exceptional theoretical, numerical, and experimental efforts conducted over the past thirty years, no existing models are capable of faithfully reproducing statistical and topological properties exhibited by particle trajectories in turbulence. We propose a machine learning approach, based on a state-of-the-art diffusion model, to generate single-particle trajectories in three-dimensional turbulence at high Reynolds numbers, thereby bypassing the need for direct numerical simulations or experiments to obtain reliable Lagrangian data. Our model demonstrates the ability to reproduce most statistical benchmarks across time scales, including the fat-tail distribution for velocity increments, the anomalous power law, and the increased intermittency around the dissipative scale. Slight deviations are observed below the dissipative scale, particularly in the acceleration and flatness statistics. Surprisingly, the model exhibits strong generalizability for extreme events, producing events of higher intensity and rarity that still match the realistic statistics. This paves the way for producing synthetic high-quality datasets for pre-training various downstream applications of Lagrangian turbulence.

  • 5 authors
·
Apr 27, 2024

Random Teachers are Good Teachers

In this work, we investigate the implicit regularization induced by teacher-student learning dynamics in self-distillation. To isolate its effect, we describe a simple experiment where we consider teachers at random initialization instead of trained teachers. Surprisingly, when distilling a student into such a random teacher, we observe that the resulting model and its representations already possess very interesting characteristics; (1) we observe a strong improvement of the distilled student over its teacher in terms of probing accuracy. (2) The learned representations are data-dependent and transferable between different tasks but deteriorate strongly if trained on random inputs. (3) The student checkpoint contains sparse subnetworks, so-called lottery tickets, and lies on the border of linear basins in the supervised loss landscape. These observations have interesting consequences for several important areas in machine learning: (1) Self-distillation can work solely based on the implicit regularization present in the gradient dynamics without relying on any dark knowledge, (2) self-supervised learning can learn features even in the absence of data augmentation and (3) training dynamics during the early phase of supervised training do not necessarily require label information. Finally, we shed light on an intriguing local property of the loss landscape: the process of feature learning is strongly amplified if the student is initialized closely to the teacher. These results raise interesting questions about the nature of the landscape that have remained unexplored so far. Code is available at https://github.com/safelix/dinopl.

  • 4 authors
·
Feb 23, 2023

Dynamic Factor Analysis of Price Movements in the Philippine Stock Exchange

The intricate dynamics of stock markets have led to extensive research on models that are able to effectively explain their inherent complexities. This study leverages the econometrics literature to explore the dynamic factor model as an interpretable model with sufficient predictive capabilities for capturing essential market phenomena. Although the model has been extensively applied for predictive purposes, this study focuses on analyzing the extracted loadings and common factors as an alternative framework for understanding stock price dynamics. The results reveal novel insights into traditional market theories when applied to the Philippine Stock Exchange using the Kalman method and maximum likelihood estimation, with subsequent validation against the capital asset pricing model. Notably, a one-factor model extracts a common factor representing systematic or market dynamics similar to the composite index, whereas a two-factor model extracts common factors representing market trends and volatility. Furthermore, an application of the model for nowcasting the growth rates of the Philippine gross domestic product highlights the potential of the extracted common factors as viable real-time market indicators, yielding over a 34% decrease in the out-of-sample prediction error. Overall, the results underscore the value of dynamic factor analysis in gaining a deeper understanding of market price movement dynamics.

  • 6 authors
·
Oct 8, 2025

The Principles of Diffusion Models

This monograph presents the core principles that have guided the development of diffusion models, tracing their origins and showing how diverse formulations arise from shared mathematical ideas. Diffusion modeling starts by defining a forward process that gradually corrupts data into noise, linking the data distribution to a simple prior through a continuum of intermediate distributions. The goal is to learn a reverse process that transforms noise back into data while recovering the same intermediates. We describe three complementary views. The variational view, inspired by variational autoencoders, sees diffusion as learning to remove noise step by step. The score-based view, rooted in energy-based modeling, learns the gradient of the evolving data distribution, indicating how to nudge samples toward more likely regions. The flow-based view, related to normalizing flows, treats generation as following a smooth path that moves samples from noise to data under a learned velocity field. These perspectives share a common backbone: a time-dependent velocity field whose flow transports a simple prior to the data. Sampling then amounts to solving a differential equation that evolves noise into data along a continuous trajectory. On this foundation, the monograph discusses guidance for controllable generation, efficient numerical solvers, and diffusion-motivated flow-map models that learn direct mappings between arbitrary times. It provides a conceptual and mathematically grounded understanding of diffusion models for readers with basic deep-learning knowledge.

  • 5 authors
·
Oct 23, 2025 3

Dandelion: A Spherical Flower for Neural Simulation of Planetary Dynamics

Many dynamical processes unfold on the sphere but the default scientific machine learning architectures are Euclidean. Applying these architectures on a regular lat-lon grid causes problems: Cartesian convolutions become distorted at high latitude; 2D FFTs in Fourier neural operators incorrectly assume double periodicity; Cartesian positional encodings in ViTs distort spherical geodesic distances. Recent work moves towards natively spherical primitives, including spherical convolutions (e.g., DeepSphere or DISCO), Spherical Fourier Neural Operators (SFNOs), and geodesic attention. Here we propose Dandelion, a spherical version of Flower, a warp-based neural PDE solver. Layers of Dandelion predict a tangent-plane displacement and transport features along great circles. We obtain a U-Net-like structure by implementing hierarchical pooling entirely in the spherical-harmonic domain. There are thus no convolutions: spatial mixing is achieved only through spherical coordinate changes, or warps. To compare Dandelion with existing spherical architectures, we release an evolving benchmark suite of challenging, natively-spherical PDE datasets including a modified Galewsky jet, anomalous chained turbulence, Cahn-Hilliard decomposition, spherical Riemann shocks, Held-Suarez dry atmospheric transport and global ocean dynamics. This new benchmark fills the gap in existing spherical datasets which are either too small and stylized, or much too large (ERA5) for model iteration. Dandelion is best or second-best on every dataset, and the gap to non-warp baselines widens with resolution: at 256times 512, Dandelion and Flower2D occupy the top two slots in both single-step prediction and rollout.

  • 3 authors
·
Aug 26