healda-v2 / model_card /explainability.md
aayushgupta55's picture
Add HealDA v2 model card (#1)
a77ce9b
|
Raw History Blame Contribute Delete
3.45 kB
Field | Response
:--|:--
Intended Task/Domain: | Global weather data assimilation and initialization of machine-learning weather forecasts.
Model Type: | Observation encoder plus a deterministic HEALPix Diffusion Transformer with spatial, temporal, and observation-to-pixel attention, followed by a mesh-to-grid decoder.
Intended Users: | Weather and climate researchers and developers implementing global data-assimilation and forecast-initialization pipelines.
Output: | A 104-channel global atmospheric, ocean-surface, cloud, and land-surface analysis on a native 0.25° regular latitude–longitude grid (`721 × 1440`). The public inference API returns only the final frame for downstream forecast initialization. See `overview.md` for the complete grouped variable list.
Describe how the model works: | All observations are featurized together with their metadata — instrument channel, platform, observation type, location and time — and passed through a single shared tokenizer, which maps each observation to one token. The tokenizer is FiLM-style: the raw measurement is the signal, and the metadata enters through embedding lookups that produce a per-feature scale and shift modulating it. In parallel, static geographic fields are patch-embedded and calendar features are encoded, forming the gridded conditioning input on an internal HEALPix latent representation. The backbone is a stack of transformer blocks, each applying, in order: local spatial attention, restricted per query to tokens within a fixed great-circle (haversine) distance on the sphere, observation-to-pixel cross-attention that injects the observation tokens into the latent, causal temporal attention across the eight frames, and a standard MLP. Frames are six hours apart and each receives observations within ±3 hours, so the sequence spans 48 hours of observations — 42 hours between the first and last frame, extended by the ±3-hour window at each end. Finally, a GraphCast-style mesh-to-grid decoder maps the latent representation directly to the native 0.25° latitude–longitude output grid.
List the groups (or group characteristics) for which this was tested to produce comparable outcomes: | Not Applicable.
Technical Limitations & Mitigation: | Performance depends on the density, quality, and historical availability of the observing system. The model may perform poorly for rare or out-of-distribution weather, changing instruments, and regions with sparse observations. It does not impose hard conservation laws or guarantee physical consistency. Domain masks and latitude-area weighting must be applied when scoring the 0.25° output.
Verified to have met prescribed NVIDIA quality standards: | Yes
Performance Metrics: | Latitude-area-weighted analysis RMSE and bias against ERA5 by variable and pressure level on the native 0.25° grid; downstream forecast RMSE and anomaly-correlation coefficient under matched initialization and verification; observation-denial sensitivity; throughput and latency.
Potential Known Risks: | The model may produce incorrect atmospheric states or weather phenomena, particularly for extremes and out-of-distribution observing systems. Errors can propagate and amplify in a downstream forecast model. Outputs should not be the sole basis for safety-critical decisions.
Licensing: | [Linux Foundation OpenMDW License Agreement, version 1.1](https://github.com/OpenMDW/OpenMDW/blob/main/1.1/LICENSE.OpenMDW-1.1)