Articles | Volume 20, issue 7
Research article
03 Apr 2020
Research article |  | 03 Apr 2020

Global sensitivity analysis of chemistry–climate model budgets of tropospheric ozone and OH: exploring model diversity

Oliver Wild, Apostolos Voulgarakis, Fiona O'Connor, Jean-François Lamarque, Edmund M. Ryan, and Lindsay Lee

Projections of future atmospheric composition change and its impacts on air quality and climate depend heavily on chemistry–climate models that allow us to investigate the effects of changing emissions and meteorology. These models are imperfect as they rely on our understanding of the chemical, physical and dynamical processes governing atmospheric composition, on the approximations needed to represent these numerically, and on the limitations of the observations required to constrain them. Model intercomparison studies show substantial diversity in results that reflect underlying uncertainties, but little progress has been made in explaining the causes of this or in identifying the weaknesses in process understanding or representation that could lead to improved models and to better scientific understanding. Global sensitivity analysis provides a valuable method of identifying and quantifying the main causes of diversity in current models. For the first time, we apply Gaussian process emulation with three independent global chemistry-transport models to quantify the sensitivity of ozone and hydroxyl radicals (OH) to important climate-relevant variables, poorly characterised processes and uncertain emissions. We show a clear sensitivity of tropospheric ozone to atmospheric humidity and precursor emissions which is similar for the models, but find large differences between models for methane lifetime, highlighting substantial differences in the sensitivity of OH to primary and secondary production. This approach allows us to identify key areas where model improvements are required while providing valuable new insight into the processes driving tropospheric composition change.

1 Introduction

Atmospheric photochemistry and transport processes play important roles in the Earth system by controlling the impact of natural and anthropogenic trace gas emissions on air quality and global climate. Methane (CH4) and ozone (O3) are the second and third most important greenhouse gases contributing to climate change since the preindustrial era (IPCC2013). The atmospheric abundance of both gases has increased substantially due to anthropogenic activity, and their fates are strongly coupled through the short-lived hydroxyl (OH) radical. CH4 is an O3 precursor and O3 is a major source of OH, which controls the oxidation of CH4 and many other trace gases. At the surface O3 contributes to poor air quality and is damaging to human health, crop yields and natural ecosystems (Monks et al.2015). The relatively short lifetime of these gases makes them attractive targets for emission controls (Shindell et al.2012), but scientific uncertainties associated with the processes that govern their abundance and distribution has hindered the implementation of effective control policies.

Current global chemistry–climate models representing the co-evolution of atmospheric O3 and CH4 show differences in CH4 lifetime of almost a factor of 2 (Wild2007; Voulgarakis et al.2013). This prevents them from simulating the observed atmospheric build-up of CH4 correctly or attributing its causes reliably and leads to substantial uncertainty in the impact of future emission changes on global climate (Stevenson et al.2013; IPCC2013). The underlying cause is differences in OH, which depends on humidity, sunlight and O3, and on a wide range of chemical and dynamical processes. For O3, on the other hand, the abundance, seasonality and spatial variation are represented relatively well in models under present-day conditions, but observed changes in surface O3 since the preindustrial era are thought to be underestimated (Stevenson et al.2013), although there is continuing uncertainty surrounding preindustrial levels (Tarasick et al.2019). Models have difficulty reproducing recent observed trends in surface O3 driven by changes in precursor emissions, natural sources, stratospheric influx and transport patterns (Parrish et al.2014). This is a major concern because changes in the tropospheric abundance of O3 influence our assessment of radiative forcing and also the attainment of air quality objectives on regional and urban scales (e.g. Akimoto2003). These discrepancies suggest that there are major weaknesses in our fundamental understanding of the chemical, dynamical and emission processes controlling the distribution, interaction and fate of O3, CH4 and OH or of how these processes are represented in global chemistry and climate models.

Global sensitivity analysis provides a valuable approach to determine the major drivers of model behaviour, and it has been applied to atmospheric chemistry schemes to explore uncertainties in tropospheric O3 (Derwent and Murrells2013; Christian et al.2017; Ridley et al.2017; Newsome and Evans2017). These studies have typically used Monte Carlo-based ensemble approaches for simple models (e.g. Ridley et al.2017) or structured random-sampling approaches for more computationally intensive models (e.g. Christian et al.2017), and they have focussed on sensitivities in a single model framework. In this study we demonstrate the use of Gaussian process emulation for global sensitivity analysis, applied previously to models of aerosol processes (Lee et al.2011, 2013) and air quality (Beddows et al.2017; Aleksankina et al.2019), and we apply it to explore the sensitivity of global tropospheric O3 and CH4 lifetime to uncertainty in key model processes and inputs. We investigate how the sensitivities differ across three independent chemistry-transport models and demonstrate how this approach may be used to explore the diversity in model responses and to identify where model results differ.

2 Approach

We consider here two important global diagnostics of model performance: the tropospheric O3 burden and the chemical lifetime of CH4 in the troposphere. The tropospheric O3 burden is the annual mean mass of O3 below the tropopause, defined here by the 150 ppb isopleth of monthly mean O3. The chemical lifetime of CH4 reflects the lifetime of CH4 to removal by OH in the troposphere and provides a useful proxy for global tropospheric oxidising capacity. Global model studies in the literature and previous model intercomparisons show a large diversity in modelled budgets (see Fig. 1), where the range in O3 burden and CH4 lifetime both span about a factor of 2. There is no clear relationship between the budget terms on an annual basis, highlighting the relatively complex relationship between tropospheric O3 and OH that reflects physical and dynamical processes as well as photochemistry.

Figure 1Tropospheric oxidant budgets from previous published studies and model intercomparisons (a), along with measurement-based estimates of the tropospheric O3 burden and CH4 lifetime (shaded regions). Panel (b) shows results from one-at-a-time sensitivity studies with a single model revealing the extent to which individual processes can influence the budgets (see Wild2007, for details). Note that results in (a) represent differing emissions and meteorological years (study details are given in Table 1) and that (b) covers only part of the parameter space shown in (a).


Observation-based determination of these global quantities is difficult. However, assessment of three global O3 climatologies derived from ozonesonde measurements over the 1980s and 1990s indicates an annual mean tropospheric O3 burden of 327–344 Tg when applying the same 150 ppb isopleth definition of the tropopause used in model analysis (Wild2007), suggesting a burden of about 335±20 Tg. Recent satellite and ozonesonde-based estimates of the global burden range from 333 to 345 Tg (Gaudel et al.2018). Ensemble mean O3 burdens from recent model intercomparisons lie close to this: 344±39 Tg from ACCENT (Stevenson et al.2006), 328±41 Tg from HTAP (Fiore et al.2009) and 337±23 Tg from ACCMIP (Young et al.2013); see Table 1. However, about half of published studies lie outside the observationally constrained range (see Fig. 1). A thorough observation-based sensitivity analysis of the factors contributing to CH4 removal gave a whole-atmosphere lifetime of 9.1±0.9 years and a corresponding CH4 chemical lifetime of 11.2±1.3 years (Prather et al.2012). The latter is substantially longer than that derived from model intercomparisons: 9.6±1.4 years from ACCENT (Stevenson et al.2006), 10.2±1.7 years from HTAP (Fiore et al.2009) and 9.8±1.6 years from ACCMIP (Voulgarakis et al.2013). Two-thirds of the model studies shown in Fig. 1 lie outside this range. However, it is difficult to judge the validity of existing model results without a clearer idea of the uncertainties involved and how they contribute to the corresponding biases.

Wild (2007)Stevenson et al. (2006)Fiore et al. (2009)Young et al. (2013)Voulgarakis et al. (2013)Wild (2007)Prather et al. (2012)

Table 1Global tropospheric metrics from previous model studies.

Download Print Version | Download XLSX

The sensitivity of the budget terms to individual processes has been explored in previous studies using the Frontier Research System for Global Change version of the University of California Irvine Chemical Transport Model (FRSGC/UCI CTM) in Wild (2007). One-at-a-time sensitivity runs were performed varying surface NOx emissions (30–60 Tg N yr−1), isoprene emissions (0–650 Tg C yr−1), lightning NOx emissions (0–7.5 Tg N yr−1), convective lifting, stratospheric influx and deposition processes (all ±50 %), temperature (±5C), and humidity (±20 %), and results are summarised in Fig. 1. This study highlighted the responses of a single model to particular processes, but the variations spanned relatively little of the parameter space defined by previous model studies, suggesting that substantial additional uncertainties were not accounted for here, including process interactions, neglected processes and structural differences between models.

To explore the sensitivity of tropospheric budgets to uncertainty in several processes at once, we perform a global sensitivity analysis using Gaussian process emulation, following the approach of Lee et al. (2011). An emulator is a simple statistical model that reproduces the relationships between the inputs and outputs of a more complex model, in this case an atmospheric chemistry model. The much shorter run time of the emulator allows the model parameter uncertainty space to be explored fully through Monte Carlo approaches that would not be feasible with the complex atmospheric model. A Gaussian process is a multivariate normal distribution applied to a function, and we use this non-parametric approach to fit the model input–output relationships as it is well-tested, efficient and relatively easy to implement (O'Hagan2006; Lee et al.2011; Ryan et al.2018). This allows us to reproduce the nonlinear model response across a multidimensional parameter space based on a small ensemble of model training runs at points representing a combination of inputs that are optimally chosen to fill the space. We select eight key variables that influence global oxidant budgets substantially and that span a range of model inputs (e.g. emissions), processes (e.g. deposition) and meteorological variables; see Table 2. These are based on our earlier one-at-a-time studies, and while they do not encompass all sources of uncertainty, which also include photochemical, transport and radiation processes, they are chosen to represent key uncertainties while ensuring that the study remains computationally tractable. We select surface emissions of NOx from natural and anthropogenic sources, the dominant precursor for O3 in the troposphere; lightning emissions of NO, which are highly uncertain and have a disproportionately large impact on O3 and OH due to the altitude of the source; and biogenic emissions of isoprene, which dominate global sources of volatile organic compounds. We include dry deposition, which is important for the uptake of O3 and other species at the surface, and wet deposition, which is important for the removal of soluble precursors. We vary the atmospheric humidity used by the model photochemistry, which plays an important role in O3 chemistry and OH formation, but leave it untouched for other processes to avoid perturbing model dynamical processes. We vary cloud optical depth, an uncertain variable which has a major influence on photolysis rates in the lower troposphere. Finally, we vary turbulent mixing in the planetary boundary layer (PBL), which has an important role in lifting and dispersing surface oxidants but which remains poorly constrained.

For each variable, we define a range that encompasses the maximum and minimum likely values and that is loosely based on published studies from the literature, and these are presented in Table 2. We assume uncertainty ranges of ±25 % for surface NOx, representing 30–50 Tg N yr−1, ±60 % for lightning NO (Schumann and Huntrieser2007) and ±60 % for isoprene emissions (Ashworth et al.2010). For dry and wet deposition, we assume an uncertainty in removal rates of ±60 % that is applied to all species considered. We assume an uncertainty of ±20 % for atmospheric water vapour, reflecting the variation across models contributing to the ACCMIP intercomparison (Lamarque et al.2013), and this is applied in the model photochemistry scheme only. We assume an uncertainty of a factor of 3 in cloud optical depth based on Klein et al. (2013) and apply this for photolysis calculations only. Boundary layer mixing is perturbed by scaling the effective vertical diffusion coefficient through the depth of the boundary layer so that turbulent mixing of tracers between model layers varies from negligible to almost complete every model time step.

Table 2Variables and uncertainty ranges used in this study

Download Print Version | Download XLSX

Following Lee et al. (2011), we use maximin Latin hypercube sampling to optimally select 80 points from across the eight-dimensional parameter space. Each point represents a combination of values chosen from the range for each variable and specifies the values to use for a full model simulation. An additional 24 points are selected to provide an independent test of the validity of the emulators that are built. This defines a set of 104 model simulations to perform. For this study, we use three independent global chemistry-transport models: the FRSGC/UCI CTM (Wild2007), the Goddard Institute for Space Studies Global Climate Model, GISS GCM (Shindell et al.2013), and the Community Atmosphere Model with Chemistry, CAM-Chem (Lamarque et al.2012). The models differ in their sources of meteorology but are run for a full year (following 6–12 months' spin-up) under conditions that are broadly consistent with 2001 meteorology, a year without strong climate phenomena such as El Niño. Offline meteorological fields for 2001 from the European Centre for Medium-Range Weather Forecasts Integrated Forecast System (ECMWF IFS) were used for the FRSGC/UCI CTM. The GISS GCM used observed sea-surface temperatures and was nudged to National Centers for Environmental Prediction (NCEP) reanalysis fields (Kalnay et al.1996), while CAM-Chem was run in GCM mode following the Chemistry Climate Model Initiative (CCMI) REF-C1 protocol (Eyring et al.2013). In each model we constrain methane to a fixed mixing ratio of 1760 ppb suitable for 2001 conditions. Natural and anthropogenic emissions differ somewhat across the models, reflecting different assumptions and online generation of natural emissions, but we scale the magnitude of global annual emissions to 40 Tg N yr−1 for surface NOx, 5 Tg N yr−1 for lightning NO and 500 Tg C yr−1 for isoprene in the control run, accepting that differences in emission distributions represent a source of structural uncertainty. Other variables are scaled according to the factors shown in Table 2 without further standardisation between models.

Emulators are then built for each model for each output of interest using the methods described in Lee et al. (2011) and Ryan et al. (2018). We focus here on global annual mean tropospheric O3 burden and CH4 chemical lifetime for simplicity. The emulators are tested through use of the additional 24 validation simulations to evaluate their performance. For the outputs considered here, the model response surfaces are relatively smooth, reflecting the stable behaviour of the global O3 burden and CH4 lifetime, and the emulators fit the validation runs very closely with a correlation coefficient r>0.99 (see Ryan et al.2018). The emulators reproduce the response of the full model within the variable ranges defined and can be used in place of the model for intensive analysis such as uncertainty propagation through the use of Monte Carlo approaches that would not be computationally feasible with the full model. This allows us to define formal error bars for the response of each model and to carry out global sensitivity analysis by determining the contribution of each variable to the overall variance in modelled O3 burden and CH4 lifetime.

Figure 2Probability distributions for the global annual mean tropospheric O3 burden (a, b, c) and tropospheric chemical lifetime of CH4 (d, e, f) for each model. The mean and standard deviation over 10 000 realisations are shown on the upper right corner of each panel, and observation-based estimates of O3 burden and CH4 lifetime are shown as shaded areas.


3 Model responses and contributions to variance

We first use the emulators built for each model to propagate the uncertainty in the selected variables to uncertainty in O3 burden and CH4 lifetime. We use a Monte Carlo approach to randomly select 10 000 points from across the response space for each model, sampling uniformly across the full input range of each variable, and use this to generate the probability distribution for each model. Figure 2 shows the distribution in global O3 burden and CH4 lifetime from each model. The behaviour of the models is similar, with a normalised standard deviation of 7 %–8 % for O3 burden and 7 %–9 % for CH4 lifetime, and the distributions are slightly skewed, reflecting the nonlinear response of these budget terms to the governing processes. The 1σ uncertainty in each budget term is comparable in magnitude to that seen between different models in the ACCMIP model intercomparison (see Table 1); while this may be fortuitous, it demonstrates that process uncertainty contributes substantially to model diversity.

For each model, the mean O3 burden lies within the observational uncertainty range, along with 44 %–60 % of the distribution. A substantial proportion of each distribution lies outside the observational range, suggesting that the uncertainty ranges adopted for some of the variables were larger than needed or that a normal distribution of uncertainty could have been assumed across each range in place of a uniform distribution. For mean CH4 lifetime, agreement with observations is less good, with the GISS GCM and CAM-Chem lying at opposite boundaries of the observed range and the FRSGC/UCI CTM lying outside it. For the GISS GCM, 63 % of the distribution lies inside the observed range, while for the FRSGC/UCI CTM it is only 10 %. The discrepancies between the modelled and observed estimates suggest that uncertainty in chemistry and transport processes, which have not been considered here, may play a substantial role in governing the CH4 lifetime.

The sensitivity to each variable is determined by variance decomposition, which quantifies the contribution of each variable to the variance in the model output, and is shown in Fig. 3. This is performed through calculation of the sensitivity indices using the Sobol approach (e.g. Saltelli2002), and the mathematical foundation for this is described in Ryan et al. (2018). We neglect the contribution of interactions between variables, which can be identified through this approach but which remain below 4 % of the variance for the model responses examined here. For the global O3 burden, the models show relatively similar sensitivities to atmospheric humidity, which contributes 20 %–23 % of the variance in all three models, and to dry-deposition processes, which contribute 21 %–25 %; see Fig. 3. However, there are substantial differences in sensitivities to lightning NO, which varies from 13 % in the GISS GCM to 40 % in CAM-Chem, and to isoprene emissions, which are 14 % in FRSGC/UCI CTM and GISS GCM but only 1 % in CAM-Chem. The consistent sensitivities to humidity and dry deposition are expected, given the important roles that these play as sinks of O3 in the troposphere. A strong sensitivity to lightning NO is also expected given the greater chemical O3 production efficiency of NOx in the mid- and upper troposphere, but the differing sensitivities between models likely reflect both differences in chemical environment and in lightning source distribution. Similarly, differences in sensitivity to isoprene are likely to reflect differences in the complexity of the photochemical schemes in the models and in the resulting chemical environment in the tropical boundary layer.

Figure 3Contributions of each variable to the total variance in the simulated tropospheric O3 burden in each model.


Figure 4Contributions of each variable to the total variance in the simulated annual mean CH4 chemical lifetime in each model.


For the tropospheric CH4 lifetime, the models show notably different sensitivities, with humidity contributing about 20 % of the variance for the FRSGC/UCI CTM and CAM-Chem but less than 3 % for the GISS GCM; see Fig. 4. There is broad consistency between the FRSGC/UCI CTM and CAM-Chem, where uncertainty in lightning NO is the largest contributor and emissions of isoprene and surface NOx are about 30 % and 50 % less, respectively, but in the GISS GCM the strongest sensitivity is to surface NOx emissions. It is clear that the factors governing tropospheric OH are substantially different in the models, highlighting differences in chemical environment and transport patterns that affect the location and magnitude of CH4 oxidation. Sensitivity to humidity suggests that primary sources of OH through photolysis of O3 and subsequent reaction of O1D with water vapour are important. Sensitivity to NOx emissions reflects the importance of secondary sources of OH through oxidation of NO, and sensitivity to isoprene highlights the importance of volatile organic compounds (VOCs) as a source and sink of OH and as a mechanism for locking up and transporting NOx. Interestingly, the GISS GCM shows substantial sensitivity to boundary layer mixing, highlighting the importance of the transport of fresh emissions from the surface for secondary OH formation. The FRSGC/UCI CTM shows some sensitivity to wet deposition, suggesting that scavenging of nitric acid has a direct impact on OH through its influence on the abundance of NOx.

These differences have important implications for the assessment of future composition change. Future scenarios projecting increased emissions of greenhouse gases and reduced emissions of O3 precursors (e.g. representative concentration pathways (RCPs) 4.5, 6.0 and 8.5) are likely to lead to increased future humidity and reduced surface NOx. The FRSGC/UCI CTM and CAM-Chem would be expected to show a reduction in CH4 lifetime due to greater OH concentrations associated with higher water vapour, while the GISS GCM would show an increase in CH4 lifetime due to lower secondary production of OH associated with reduced surface NOx emissions. Analysis of future changes in CH4 lifetime for models contributing to the ACCMIP intercomparison suggests that this is indeed the case, with the GISS GCM one of three models showing increased lifetime by 2100 for the RCP6.0 pathway and four models showing decreased lifetime (Voulgarakis et al.2013). An understanding of the causes of this differing sensitivity is thus important for explaining the different model responses.

Figure 5Sensitivity of tropospheric O3 burden and CH4 chemical lifetime to changes in surface NOx emissions and humidity in the FRSGC/UCI CTM and GISS GCM.


4 Investigating model differences

The sensitivity of modelled O3 burden and CH4 lifetime to two key variables – humidity and surface NOx emissions – is shown for the FRSGC/UCI CTM and GISS GCM in Fig. 5. These response surfaces are generated using the emulator for each model assuming that the other six variables are unchanged. While the O3 burden is slightly higher in the GISS GCM than the FRSGC/UCI CTM – 342 vs. 314 Tg in the model control runs – the gradients across the response surfaces are similar in the models. The highest O3 burdens occur at high NOx emissions and low humidity, reflecting greater production and reduced loss, respectively. The relative changes in O3 burden with NOx emissions and humidity are very similar across all three models, as shown in Fig. 6. The responses for CH4 lifetime show notably different behaviour, with greater sensitivity to NOx and much less sensitivity to humidity in the GISS GCM compared to the other models. At high humidities the CH4 lifetime appears almost insensitive to humidity, suggesting either little additional formation of OH or a matching OH sink in this model. In contrast, the other models show a very similar degree of sensitivity to humidity in both O3 burden and CH4 lifetime that ranges from +7 % to 5 % across the humidity range considered here; see Fig. 6. This suggests a much stronger coupling between O3 and OH formation and highlights the greater importance of the primary OH source in these models.

The response surfaces shown here allow us to estimate the impact of changes in future humidity and surface NOx emissions in the absence of other changes. A reduction in NOx emissions from 40 to 30 Tg N yr−1 and an increase in the humidity of 15 %, corresponding loosely to the changes between 2000 and 2050 expected along the RCP8.5 pathway (van Vuuren et al.2011), would lead to an increase in CH4 lifetime of 1.3 years in the GISS GCM (from 11.7 to 13.0 years), an increase of 0.2 years in CAM-Chem and no change in the FRSGC/UCI CTM. While this neglects the influence of other emission and climate changes, particularly the increase in CH4 concentrations which would extend the lifetime in all models, it demonstrates the very different sensitivities anticipated for different models under future climate scenarios.

Figure 6Relative changes in tropospheric O3 burden (a, b) and CH4 chemical lifetime (c, d) to changes in surface NOx emissions and humidity alone in each model.


To help identify the cause of the differing model responses, we show the contribution of key variables to the variance in the annual mean tropospheric column CH4 chemical loss rate at each model grid point in Fig. 7. This shows how the contribution of the different processes governing CH4 removal varies geographically and reveals further differences between the models. For the FRSGC/UCI CTM and CAM-Chem, humidity makes an important contribution to the variance in tropical regions and at mid-latitudes and makes a smaller contribution at the Equator, where the greatest contribution is from lightning NO in all three models. Humidity makes very little contribution to the variance in the GISS GCM, and this principally occurs downwind of major anthropogenic emission regions. The underlying humidities in the models are relatively similar (see distributions presented in the Supplement), and the annual mean global atmospheric water burden is also similar: only 4 % less in the GISS GCM than in the FRSGC/UCI CTM. Given the similar humidities and similar responses in O3 burden, this suggests that there are significant differences in chemical processes specific to OH. Despite the larger relative importance of surface NOx emissions in the GISS GCM, the absolute contribution to the variance in the three models is similar. Surface NOx emissions have a widespread impact, contributing substantially to CH4 removal over remote ocean regions. The effect of NOx on OH in these locations suggests that substantial nitrogen is transported to these regions in the form of reservoir species such as peroxyacetyl nitrate (PAN), and this is supported by the patterns of transport seen in the isoprene contribution. The greatest effect of isoprene emissions is localised in the tropical continental source regions due to the relatively short lifetime of isoprene and its oxidation products, but there are substantial contributions downwind over the oceans, particularly in CAM-Chem and the GISS GCM. Mid-tropospheric PAN concentrations are much greater in the GISS GCM, and comparison of tropospheric NO2 columns suggests that there are higher levels of NOx over oceanic regions in this model (see Supplement). It is therefore likely that differing treatments of NOy chemistry are one cause of the different model sensitivities. However, a more detailed exploration of the sensitivity to photochemical processes would be needed to confirm this. Tropospheric OH is dependent on the total ozone column in the tropics through its effect on photolysis rates, and this may play a role in model differences, although we note that mean tropical ozone column in the present models is very similar at 258–265 DU (see Table S2). Underlying differences in meteorological fields governing vertical transport processes such as convection are also likely to be important in this region. Our analysis provides a valuable guide to locations where model responses are likely to differ most, such as in tropical oceanic regions, and further investigation of OH sensitivity in these regions should bring improvements in our understanding of atmospheric processes and in their representation in current global-scale models.

Figure 7Contributions to the total variance in the annual tropospheric column CH4 chemical loss rate (in mgm-2yr-1) in each model from humidity, isoprene emissions and surface NOx emissions. Fractional contributions (sensitivity indices) are presented in Fig. S3 in the Supplement.

5 Conclusions

We have demonstrated the value of Gaussian process emulation in performing global sensitivity analysis of computationally intensive global atmospheric chemistry-transport models and in applying this across a number of models to investigate model diversity. The approach provides a simple way of exploring the sensitivity of key terms in the tropospheric oxidant budget to governing processes and inputs, and we show that it can provide substantial new insight into the differing responses of models under different emission and climate scenarios.

Our study has highlighted the large sensitivity of the tropospheric O3 burden to atmospheric water vapour, suggesting that this variable should be diagnosed or perhaps constrained in future model intercomparisons to permit clearer characterisation of differences in model chemistry. We also find a strong sensitivity to precursor emissions and to dry-deposition processes, as expected. More surprisingly, we find that the drivers of variability in global OH can be very different between models, and this may contribute to the large diversity in modelled tropospheric CH4 lifetimes seen in recent model intercomparisons. Given the importance of atmospheric oxidising capacity for both air quality and climate change, this difference in OH behaviour is a major cause for concern and is a clear priority for further investigation.

While we have shown the value of emulation approaches for exploring model behaviour much more thoroughly than through simple one-at-a-time sensitivity studies, this study has been largely exploratory in nature, investigating the effects of a very limited number of variables. A more detailed global uncertainty analysis is required that considers a wider range of model processes and inputs and incorporates a more rigorous assessment of uncertainty in each variable. Application of observation-based constraints is then needed to restrict the size of the response space to calibrate the models and identify specific processes in need of refinement. Applying this approach across different models accommodates the structural uncertainties in model formulation, permitting a more robust assessment of process understanding. This would provide a strong evaluation framework for improving understanding of the physical and chemical processes driving atmospheric composition change and its effects on air quality and climate.

Data availability

The monthly mean output from each model for the ensemble of runs performed in this study will be made available from the CEDA data archive and can be accessed by request to the corresponding author.


The supplement related to this article is available online at:

Author contributions

OW, LL, FO'C and AV designed the study. OW, AV and JFL ran model simulations, and EMR and LL performed the analysis. OW prepared the paper with contributions from all co-authors.

Competing interests

The authors declare that they have no conflict of interest.


This work was supported in part by the UK Natural Environment Research Council. Apostolos Voulgarakis thanks the NASA High-End Computing (HEC) Program through the NASA Center for Climate Simulation (NCCS) at Goddard Space Flight Center for providing computational resources to perform GISS model simulations and Greg Faluvegi from Columbia University/NASA GISS for advice on setting up the GISS model experiments. CAM-Chem is a specific configuration of CESM, which is supported primarily by the National Science Foundation. Computing and data storage resources, including the Cheyenne supercomputer (, were provided by the Computational and Information Systems Laboratory (CISL) at NCAR, which is a major facility sponsored by the National Science Foundation under Cooperative Agreement No. 1852977.

Financial support

This research has been supported by the Natural Environment Research Council (grant no. NE/N003411/1).

Review statement

This paper was edited by Barbara Ervens and reviewed by three anonymous referees.


Akimoto, H.: Global air quality and pollution, Science, 302, 1716–1719, 2003. a

Aleksankina, K., Reis, S., Vieno, M., and Heal, M. R.: Advanced methods for uncertainty assessment and global sensitivity analysis of an Eulerian atmospheric chemistry transport model, Atmos. Chem. Phys., 19, 2881–2898,, 2019. a

Ashworth, K., Wild, O., and Hewitt, C. N.: Sensitivity of isoprene emissions estimated using MEGAN to the time resolution of input climate data, Atmos. Chem. Phys., 10, 1193–1201,, 2010. a

Beddows, A. V., Kitwiroon, N., Williams, M. L., and Beevers, S. D.: Emulation and sensitivity analysis of the Community Multiscale Air Quality Model for a UK ozone pollution episode, Environ. Sci. Technol., 51, 6229–6236,, 2017. a

Christian, K. E., Brune, W. H., and Mao, J.: Global sensitivity analysis of the GEOS-Chem chemical transport model: ozone and hydrogen oxides during ARCTAS (2008), Atmos. Chem. Phys., 17, 3769–3784,, 2017. a, b

Derwent, R. G., and Murrells, T. P.: Impact of policy-relevant scenarios on ozone in southern England: Influence of chemical mechanism choice, Atmos. Environ., 72, 89–96,, 2013. a

Eyring, V., Lamarque, J.-F., Hess, P., Arfeuille, F., Bowman, K., Chipperfield, M. P., Duncan, B., Fiore, A., Gettelman, A., Giorgetta, M. A., Granier, C., Hegglin, M., Kinnison, D., Kunze, M., Langematz, U., Luo, B., Martin, R., Matthes, K., Newman, P. A., Peter, T., Robock, A., Ryerson, T., Saiz-Lopez, A., Salawitch, R., Schultz, M., Shepherd, T. G., Shindell, D., Staehelin, J., Tegtmeier, S., Thomason, L., Tilmes, S., Vernier, J.-P., Waugh, D. W., and Young, P. J.: Overview of IGAC/SPARC Chemistry-Climate Model Initiative (CCMI) community simulations in support of upcoming ozone and climate assessments, SPARC Newsletter, 40, 48–66, 2013a. a

Fiore, A. M., Dentener, F. J., Wild, O., Cuvelier, C., Schultz, M. G., Hess, P., Textor, C., Schulz, M., Doherty, R. M., Horowitz, L. W., MacKenzie, I. A., Sanderson, M. G., Shindell, D. T., Stevenson, D. S., Szopa, S., Van Dingenen, R., Zeng, G., Atherton, C., Bergmann, D., Bey, I., Carmichael, G., Collins, W. J., Duncan, B. N., Faluvegi, G., Folberth, G., Gauss, M., Gong, S., Hauglustaine, D., Holloway, T., Isaksen, I. S. A., Jacob, D. J., Jonson, J. E., Kaminski, J. W., Keating, T. J., Lupu, A., Marmer, E., Montanaro, V., Park, R. J., Pitari, G., Pringle, K. J., Pyle, J. A., Schroeder, S., Vivanco, M. G., Wind, P., Wojcik, G., Wu, S., and Zuber, A.: Multimodel estimates of intercontinental source-receptor relationships for ozone pollution, J. Geophys. Res., 114, D04301,, 2009. a, b, c

Gaudel, A., Cooper, O. R., Ancellet, G., Barret, B., Boynard, A., Burrows, J. P., Clerbaux, C., Coheur, P.-F., Cuesta, J., Cuevas, E., Doniki, S., Dufour, G., Ebojie, F., Foret, G., Garcia, O., Granados Muños, M. J., Hannigan, J. W., Hase, F., Huang, G., Hassler, B., Hurtmans, D., Jaffe, D., Jones, N., Kalabokas, P., Kerridge, B., Kulawik, S. S., Latter, B., Leblanc, T., Le Flochmoën, E., Lin, W., Liu, J., Liu, X., Mahieu, E., McClure-Begley, A., Neu, J. L., Osman, M., Palm, M., Petetin, H., Petropavlovskikh, I., Querel, R., Rahpoe, N., Rozanov, A., Schultz, M. G., Schwab, J., Siddans, R., Smale, D., Steinbacher, M., Tanimoto, H., Tarasick, D. W., Thouret, V., Thompson, A. M., Trickl, T., Weatherhead, E., Wespes, C., Worden, H .M., Vigouroux, C., Xu, X., Zeng, G., and Ziemke, J.: Tropospheric Ozone Assessment Report: Present-day distribution and trends of tropospheric ozone relevant to climate and global atmospheric chemistry model evaluation, Elem. Sci. Anth., 6, 58 pp.,, 2018. a

IPCC, Climate Change 2013: The Physical Science Basis, Contribution of Working Group I to the Fifth Assessment Report of the Intergovernmental Panel on Climate Change, edited by: Stocker, T. F., Qin, D., Plattner, G.-K., Tignor, M., Allen, S. K., Boschung, J., Nauels, A., Xia, Y., Bex, V., and Midgley, P. M., Cambridge University Press, Cambridge, UK, and New York, USA, 1535 pp.,, 2013. a, b

Kalnay, E., Kanamitsu, M., Kistler, R., Collins, W., Deaven, D., Gandin, L., Iredell, M., Saha, S., White, G., Woollen, J., Zhu, Y., Leetmaa, A., Reynolds, B., Chelliah, M., Ebisuzaki, W., Higgins, W., Janowiak, J., Mo, K., Ropelewski, C., Wang, J., Jenne, R., and Joseph, D.: The NCEP/NCAR 40-year reanalysis project, B. Am. Meteorol. Soc., 77, 437–471,<0437:TNYRP>2.0.CO;2, 1996. a

Klein, S. A., Zhang, T., Zelinka, M. D., Pincus, R., Boyle, J., and Gleckler, P. J.: Are climate model simulations of clouds improving? An evaluation using the ISCCP simulator, J. Geophys. Res.-Atmos., 118, 1329–1342,, 2013. a

Lamarque, J.-F., Emmons, L. K., Hess, P. G., Kinnison, D. E., Tilmes, S., Vitt, F., Heald, C. L., Holland, E. A., Lauritzen, P. H., Neu, J., Orlando, J. J., Rasch, P. J., and Tyndall, G. K.: CAM-chem: description and evaluation of interactive atmospheric chemistry in the Community Earth System Model, Geosci. Model Dev., 5, 369–411,, 2012. a

Lamarque, J.-F., Shindell, D. T., Josse, B., Young, P. J., Cionni, I., Eyring, V., Bergmann, D., Cameron-Smith, P., Collins, W. J., Doherty, R., Dalsoren, S., Faluvegi, G., Folberth, G., Ghan, S. J., Horowitz, L. W., Lee, Y. H., MacKenzie, I. A., Nagashima, T., Naik, V., Plummer, D., Righi, M., Rumbold, S. T., Schulz, M., Skeie, R. B., Stevenson, D. S., Strode, S., Sudo, K., Szopa, S., Voulgarakis, A., and Zeng, G.: The Atmospheric Chemistry and Climate Model Intercomparison Project (ACCMIP): overview and description of models, simulations and climate diagnostics, Geosci. Model Dev., 6, 179–206,, 2013. a

Lee, L. A., Carslaw, K. S., Pringle, K. J., Mann, G. W., and Spracklen, D. V.: Emulation of a complex global aerosol model to quantify sensitivity to uncertain parameters, Atmos. Chem. Phys., 11, 12253–12273,, 2011. a, b, c, d, e

Lee, L. A., Pringle, K. J., Reddington, C. L., Mann, G. W., Stier, P., Spracklen, D. V., Pierce, J. R., and Carslaw, K. S.: The magnitude and causes of uncertainty in global model simulations of cloud condensation nuclei, Atmos. Chem. Phys., 13, 8879–8914,, 2013. a

Monks, P. S., Archibald, A. T., Colette, A., Cooper, O., Coyle, M., Derwent, R., Fowler, D., Granier, C., Law, K. S., Mills, G. E., Stevenson, D. S., Tarasova, O., Thouret, V., von Schneidemesser, E., Sommariva, R., Wild, O., and Williams, M. L.: Tropospheric ozone and its precursors from the urban to the global scale from air quality to short-lived climate forcer, Atmos. Chem. Phys., 15, 8889–8973,, 2015. a

Newsome, B. and Evans, M.: Impact of uncertainties in inorganic chemical rate constants on tropospheric composition and ozone radiative forcing, Atmos. Chem. Phys., 17, 14333–14352,, 2017. a

O'Hagan, A.: Bayesian analysis of computer code outputs: A tutorial, Reliab. Eng. Syst. Safe., 91, 1290–1300,, 2006. a

Parrish, D. D., Lamarque, J.-F., Naik, V., Horowitz, L., Shindell, D. T. , Staehelin, J., Derwent, R., Cooper, O. R., Tanimoto, H., Volz-Thomas, A., Gilge, S., Scheel, H.-E., Steinbacher, M., and Fröhlich, M.: Long-term changes in lower tropospheric baseline ozone concentrations: Comparing chemistry-climate models and observations at northern midlatitudes, J. Geophys. Res.-Atmos., 119, 5719–5736,, 2014. a

Prather, M. J., Holmes, C. D., and Hsu, J.: Reactive greenhouse gas scenarios: Systematic exploration of uncertainties and the role of atmospheric chemistry, Geophys. Res. Lett., 39, L09803,, 2012. a, b

Ridley, D. A., Cain, M., Methven, J., and Arnold, S. R.: Sensitivity of tropospheric ozone to chemical kinetic uncertainties in air masses influenced by anthropogenic and biomass burning emissions, Geophys. Res. Lett., 44, 7472–7481,, 2017. a, b

Ryan, E., Wild, O., Voulgarakis, A., and Lee, L.: Fast sensitivity analysis methods for computationally expensive models with multi-dimensional output, Geosci. Model Dev., 11, 3131–3146,, 2018. a, b, c, d

Saltelli, A.: Making best use of model evaluations to compute sensitivity indices, Comput. Phys. Commun., 145, 280–297,, 2002. a

Schumann, U. and Huntrieser, H.: The global lightning-induced nitrogen oxides source, Atmos. Chem. Phys., 7, 3823–3907,, 2007. a

Shindell, D., Kuylenstierna, J. C. I., Vignati, E., van Dingenen, R., Amann, M., Klimont, Z., Anenberg, S. C., Muller, N., Janssens-Maenhout, G., Raes, F., Schwartz, J., Faluvegi, G., Pozzoli, L., Kupiainen, K., Höglund-Isaksson, L., Emberson, L., Streets, D., Ramanathan, V., Hicks, K., Oanh, N. T. K., Milly, G., Williams, M., Demkine, V., and Fowler, D.: Simultaneously Mitigating Near-Term Climate Change and Improving Human Health and Food Security, Science, 335, 6065, 183–189,, 2012. a

Shindell, D. T., Pechony, O., Voulgarakis, A., Faluvegi, G., Nazarenko, L., Lamarque, J.-F., Bowman, K., Milly, G., Kovari, B., Ruedy, R., and Schmidt, G. A.: Interactive ozone and methane chemistry in GISS-E2 historical and future climate simulations, Atmos. Chem. Phys., 13, 2653–2689,, 2013. a

Stevenson, D. S., Dentener, F. J., Schultz, M. G., Ellingsen, K., van Noije, T. P. C., Wild, O., Zeng, G., Amann, M., Atherton, C. S., Bell, N., Bergmann, D. J., Bey, I., Butler, T., Cofala, J., Collins, W. J., Derwent, R. G., Doherty, R. M., Drevet, J., Eskes, H. J., Fiore, A. M., Gauss, M., Hauglustaine, D. A., Horowitz, L. W., Isaksen, I. S. A., Krol, M. C., Lamarque, J.-F., Lawrence, M. G., Montanaro, V., Müller, J.-F., Pitari, G., Prather, M. J., Pyle, J. A., Rast, S., Rodriguez, J. M., Sanderson, M. G., Savage, N. H., Shindell, D. T., Strahan, S. E., Sudo, K., and Szopa, S.: Multimodel ensemble simulations of present-day and near-future tropospheric ozone, J. Geophys. Res., 111, D08301,, 2006. a, b, c

Stevenson, D. S., Young, P. J., Naik, V., Lamarque, J.-F., Shindell, D. T., Voulgarakis, A., Skeie, R. B., Dalsoren, S. B., Myhre, G., Berntsen, T. K., Folberth, G. A., Rumbold, S. T., Collins, W. J., MacKenzie, I. A., Doherty, R. M., Zeng, G., van Noije, T. P. C., Strunk, A., Bergmann, D., Cameron-Smith, P., Plummer, D. A., Strode, S. A., Horowitz, L., Lee, Y. H., Szopa, S., Sudo, K., Nagashima, T., Josse, B., Cionni, I., Righi, M., Eyring, V., Conley, A., Bowman, K. W., Wild, O., and Archibald, A.: Tropospheric ozone changes, radiative forcing and attribution to emissions in the Atmospheric Chemistry and Climate Model Intercomparison Project (ACCMIP), Atmos. Chem. Phys., 13, 3063–3085,, 2013. a, b

Tarasick, D., Galbally, I. E., Cooper, O. R., Schultz, M. G., Ancellet, G., Leblanc, T., Wallington, T. J., Ziemke, J., Liu, X., Steinbacher, M., Staehelin, J., Vigouroux, C., Hannigan, J. W., Garcia, O., Foret, G., Zanis, P., Weatherhead, E., Petropavlovskikh, I., Worden, H., Osman, M., Liu, J., Chang, K.-L., Gaudel, A., Lin, M., Granados-Muñoz, M., Thompson, A. M., Oltmans, S. J., Cuesta, J., Dufour, G., Thouret, V., Hassler, B., Trickl, T., and Neu, J. L.: Tropospheric Ozone Assessment Report: Tropospheric ozone from 1877 to 2016, observed levels, trends and uncertainties, Elem. Sci. Anth., 7, 72 pp.,, 2019. a

van Vuuren, D. P., Edmonds, J., Kainuma, M., Riahi, K., Thomson, A., Hibbard, K., Hurtt, G. C., Kram, T., Krey, V., Lamarque, J.-F., Matsui, T., Meinshausen, M., Nakicenovic, N., Smith, S. J., and Rose, S. K.: The Representative Concentration Pathways: An overview, Climatic Change, 109, 5–31,, 2011. a

Voulgarakis, A., Naik, V., Lamarque, J.-F., Shindell, D. T., Young, P. J., Prather, M. J., Wild, O., Field, R. D., Bergmann, D., Cameron-Smith, P., Cionni, I., Collins, W. J., Dalsøren, S. B., Doherty, R. M., Eyring, V., Faluvegi, G., Folberth, G. A., Horowitz, L. W., Josse, B., MacKenzie, I. A., Nagashima, T., Plummer, D. A., Righi, M., Rumbold, S. T., Stevenson, D. S., Strode, S. A., Sudo, K., Szopa, S., and Zeng, G.: Analysis of present day and future OH and methane lifetime in the ACCMIP simulations, Atmos. Chem. Phys., 13, 2563–2587,, 2013.  a, b, c, d

Young, P. J., Archibald, A. T., Bowman, K. W., Lamarque, J.-F., Naik, V., Stevenson, D. S., Tilmes, S., Voulgarakis, A., Wild, O., Bergmann, D., Cameron-Smith, P., Cionni, I., Collins, W. J., Dalsøren, S. B., Doherty, R. M., Eyring, V., Faluvegi, G., Horowitz, L. W., Josse, B., Lee, Y. H., MacKenzie, I. A., Nagashima, T., Plummer, D. A., Righi, M., Rumbold, S. T., Skeie, R. B., Shindell, D. T., Strode, S. A., Sudo, K., Szopa, S., and Zeng, G.: Pre-industrial to end 21st century projections of tropospheric ozone from the Atmospheric Chemistry and Climate Model Intercomparison Project (ACCMIP), Atmos. Chem. Phys., 13, 2063–2090,, 2013. a, b

Wild, O.: Modelling the global tropospheric ozone budget: exploring the variability in current models, Atmos. Chem. Phys., 7, 2643–2660,, 2007. a, b, c, d, e, f, g

Short summary
Global models of tropospheric chemistry and transport show a persistent diversity in results that has not been fully explained. We demonstrate the first use of global sensitivity analysis consistently across three independent models to explore these differences and reveal both clear similarities and surprising differences which have important implications for our assessment of future atmospheric composition change.
Final-revised paper