WeatherAI / models /pangu.md
LonghaoWang's picture
Sync from GitHub 67168d0
09af8e7 verified
|
Raw History Blame Contribute Delete
1.03 kB

Pangu-Weather — 3-D Earth-specific transformer (PyTorch)

← Model zoo · All model pages · Paper: Nature 2023, doi:10.1038/s41586-023-06185-3

weatherai.models.pangu is adapted from WeatherLearn (MIT): patch embedding of the surface (4 + 3 masks) and upper-air (5 variables × 13 levels) fields, a U-shaped stack of 3-D Earth-specific window-attention blocks with an Earth position bias, and patch recovery. Pangu is the paper size (721 × 1440, embed 192); Pangu_lite uses 8 × 8 patches for smaller grids. The same blocks are reused by CAS-Canglong.

from weatherai.models import Pangu, Pangu_lite
m = Pangu_lite()
surface, upper_air = m(surface, surface_mask, upper_air)   # (B,4,721,1440), (3,721,1440), (B,5,13,721,1440)

Not included: the official ONNX weights (no PyTorch checkpoint is published), training recipes. Tests: tests/models/pangu.