Dr Adam Povey FRMetSoc FHEA

Abstract:

Recent years have seen the increasing inclusion of per-retrieval prognostic (predictive) uncertainty estimates within satellite aerosol optical depth (AOD) data sets, providing users with quantitative tools to assist in the optimal use of these data. Prognostic estimates contrast with diagnostic (i.e. relative to some external truth) ones, which are typically obtained using sensitivity and/or validation analyses. Up to now, however, the quality of these uncertainty estimates has not been routinely assessed. This study presents a review of existing prognostic and diagnostic approaches for quantifying uncertainty in satellite AOD retrievals, and it presents a general framework to evaluate them based on the expected statistical properties of ensembles of estimated uncertainties and actual retrieval errors. It is hoped that this framework will be adopted as a complement to existing AOD validation exercises; it is not restricted to AOD and can in principle be applied to other quantities for which a reference validation data set is available. This framework is then applied to assess the uncertainties provided by several satellite data sets (seven over land, five over water), which draw on methods from the empirical to sensitivity analyses to formal error propagation, at 12 Aerosol Robotic Network (AERONET) sites. The AERONET sites are divided into those for which it is expected that the techniques will perform well and those for which some complexity about the site may provide a more severe test. Overall, all techniques show some skill in that larger estimated uncertainties are generally associated with larger observed errors, although they are sometimes poorly calibrated (i.e. too small or too large in magnitude). No technique uniformly performs best. For powerful formal uncertainty propagation approaches such as optimal estimation, the results illustrate some of the difficulties in appropriate population of the covariance matrices required by the technique. When the data sets are confronted by a situation strongly counter to the retrieval forward model (e.g. potentially mixed land–water surfaces or aerosol optical properties outside the family of assumptions), some algorithms fail to provide a retrieval, while others do but with a quantitatively unreliable uncertainty estimate. The discussion suggests paths forward for the refinement of these techniques.

Abstract:

The most widely used satellite products are averages of data onto a regular spatiotemporal grid, known as Level 3 data. Some atmospheric variables can vary rapidly in response to changing conditions. Over the scales of Level 3 averaging, the combination of observations across different conditions may result in data that is not normally distributed, such that a simple mean is not representative. The problem is illustrated by the distribution of aerosol optical depth from different sensors and algorithms. A simple statistical technique is proposed to better convey the diversity of satellite observations to users whereby a multimodal log-normal distribution is fit to the distribution of data observed within each grid cell. Allowing multiple modes within each cell is shown to improve the agreement between satellite products by highlighting regions of significant variability and isolating systematic differences between instruments.

Abstract:

A very large ensemble is used to identify subgrid-scale parameter settings for the HadCM3 model that are capable of best simulating the ocean state over the recent past (1980–2010). A simple particle filtering technique based upon the agreement of basin mean sea surface temperature (SST) and upper 700-m ocean heat content with EN3 observations is applied to an existing perturbed physics ensemble with initial conditions perturbations. A single set of subgrid-scale parameter values was identified from the wide range of initial parameter sets that gave the best agreement with ocean observations for the period studied. The parameter set, different from the standard model parameters, has a transient climate response of 1.68 K. The selected parameter set shows an improved agreement with EN3 decadal-mean SST patterns and the Atlantic meridional overturning circulation (AMOC) at 26°N as measured by the Rapid Climate Change (RAPID) array. Particle filtering techniques as demonstrated here could have a useful role in improving the starting point for traditional model-tuning exercises in coupled climate models.