How different are deterministic physics suites when coupled to fixed model dynamics and why?
Abstract:
It is often difficult to attribute uncertainty and errors in atmospheric models to designated model components. This is because sub-grid parameterised processes interact strongly with the large-scale transport represented by the explicit model dynamics. We carry out experiments with prescribed large-scale dynamics and different sub-grid physics suites. This dataset has been constructed for the Model Uncertainty Model Intercomparison Project (MUMIP), in which each suite forecasts sub-grid tendencies at a 22km grid. The common dynamics is derived from a convection-permitting benchmark: an ICON DYAMOND experiment (2.5km grid). We compare four different physics suites for atmospheric models in an Indian Ocean experiment. We analyse their joint PDFs of precipitation and associated physics tendencies for a full month, where precipitation is used to diagnose uncertainty of convective activity. We find that all physics suites produce very similar precipitation amounts, with very high correlations between models, i.e., > 0.95 at the native grid. However, the convection-permitting benchmark is more dissimilar from each of the physics suites, with correlations of ≈ 0.80. Similarly, we show that the vertically averaged physics tendencies in the free-troposphere are highly similar between the four physics suites, yet different if reconstructed for the benchmark. The water vapour sink is very closely linked with precipitation in the four physics suites. This suggests that the coarse-grid models are overconfident. We hypothese is that variation in unresolved convective structures can lead to variation in the dynamics, following a given amount of latent heating at fine grids, but not in our physics suites. The difference appears to be caused by the explicit interactions between gravity waves, occurring at fine grids only Groot et al. (2024) We assess whether their non-linear feedback from convective precipitation systems explains our joint PDFs of precipitation. The slightly exponential curve supports the interaction mechanism. These findings are further evidence for a non-linear feedback between convective organisation/aggregation and dynamics. This feedback has been studied earlier in a real-case study with ICON by looking from the fixed-physics rather than the fixed-dynamics perspective. Our current results may indicate that sub-grid physics with stochastic physics perturbations emulate convective organisation effects.From climate projections to trajectory-conditioned local predictions
Supplementary material to "From climate projections to trajectory-conditioned local predictions"
Error in ERA5 2m temperature identified using GraphCast
Abstract:
Reanalyses such as ERA5 have long been foundational for weather and climate science. They have also found a new use case, as training and verification data for machine-learnt weather prediction (MLWP) models. Here we compare short-lead time (6h) forecasts from the MLWP model GraphCast against ERA5. In doing so, we identify a recurrent, spatially coherent error in 2m Temperature centred on the Ethiopian Highlands, that occurs predominantly at 0600 UTC. We find the same error feature is present in other MLWP models trained on ERA5. We show that these error events arise from errors in ERA5 that are also present in the ECMWF operational analysis. They arise from the 2D optimal interpolation procedure, when surface reports are assimilated that are temporally displaced compared to the background forecast. This produces spuriously warm analysis increments over Ethiopia on approximately 7% of dates at 0600 UTC across the reanalysis record. The spread from the ensemble of data assimilation partially flags these cases but is underdispersive. We assess the impact on a MLWP system trained on ERA5. While the MLWP model can largely ignore these unphysical error events, a small systematic degradation in forecast skill over the region is observed. We discuss implications for using reanalysis as truth in machine learning training and verification, and recommend simple changes to reduce such artefacts in future analyses.