Reply
Bulletin of the American Meteorological Society 90:10 (2009) 1551-1554
ENSEMBLES: A new multi-model ensemble for seasonal-to-annual predictions - Skill and progress beyond DEMETER in forecasting tropical Pacific SSTs
Geophysical Research Letters 36:21 (2009)
Abstract:
A new 46-year hindcast dataset for seasonal-to-annual ensemble predictions has been created using a multi-model ensemble of 5 state-of-the-art coupled atmosphere-ocean circulation models. The multi-model outperforms any of the single-models in forecasting tropical Pacific SSTs because of reduced RMS errors and enhanced ensemble dispersion at all lead-times. Systematic errors are considerably reduced over the previous generation (DEMETER). Probabilistic skill scores show higher skill for the new multi-model ensemble than for DEMETER in the 4-6 month forecast range. However, substantially improved models would be required to achieve strongly statistical significant skill increases. The combination of ENSEMBLES and DEMETER into a grand multi-model ensemble does not improve the forecast skill further. Annual-range hindcasts show anomaly correlation skill of ∼0.5 up to 14 months ahead. A wide range of output from the multi-model simulations is becoming publicly available and the international community is invited to explore the full scientific potential of these data. Copyright 2009 by the American Geophysical Union.Addressing model uncertainty in seasonal and annual dynamical ensemble forecasts
Quarterly Journal of the Royal Meteorological Society 135:643 (2009) 1538-1559
Abstract:
The relative merits of three forecast systems addressing the impact of model uncertainty on seasonal/annual forecasts are described. One system consists of a multi-model, whereas two other systems sample uncertainties by perturbing the parametrization of reference models through perturbed parameter and stochastic physics techniques. Ensemble reforecasts over 1991 to 2001 were performed with coupled climate models started from realistic initial conditions. Forecast quality varies due to the different strategies for sampling uncertainties, but also to differences in initialisation methods and in the reference forecast system. Both the stochastic-physics and perturbed-parameter ensembles improve the reliability with respect to their reference forecast systems, but not the discrimination ability. Although the multi-model experiment has an ensemble size larger than the other two experiments, most of the assessment was done using equally-sized ensembles. The three ensembles show similar levels of skill: significant differences in performance typically range between 5 and 20%. However, a nine-member multi-model shows better results for seasonal predictions with lead times shorter than five months, followed by the stochastic-physics and perturbed-parameter ensembles. Conversely, for seasonal predictions with lead times longer than four months, the perturbed-parameter ensemble gives more often better results. All systems suggest that spread cannot be considered a useful predictor of skill. Annual-mean predictions showed lower forecast quality than seasonal predictions. Only small differences between the systems were found. The full multi-model ensemble has improved quality with respect to all other systems, mainly from the larger ensemble size for lead times longer than four months and annual predictions. © 2009 Royal Meteorological Society and Crown Copyright.Decadal variability: Processes, predictability and prediction. ECMWF Tech Memo.
(2009) 591
Impact of a quasi-stochastic cellular automaton backscatter scheme on the systematic error and seasonal prediction skill of a global climate model
Chapter in Stochastic Physics and Climate Modelling, Cambridge University Press (2009) 15