the Creative Commons Attribution 4.0 License.
the Creative Commons Attribution 4.0 License.
Aerosol formation and growth rates from chamber experiments using Kalman smoothing
Matthew Ozon
Dominik Stolzenburg
Lubna Dada
Aku Seppänen
Kari E. J. Lehtinen
Download
- Final revised paper (published on 23 Aug 2021)
- Supplement to the final revised paper
- Preprint (discussion started on 18 Mar 2021)
- Supplement to the preprint
Interactive discussion
Status: closed
-
RC1: 'Comment on acp-2021-99', Christina Williamson, 12 Apr 2021
Ozon et al. present the method and analyses the performance of a Bayesian technique using a Kalman filter for calculating aerosol size distributions, growth rates and nucleation rates from a specific instrument (the DMAtrain) in chamber experiments. They also use this analysis to make instrument design recommendations which are of interest beyond this specific instrument and perhaps beyond chamber experiments. I believe that this manuscript may be better suited for Atmos. Meas. Tech., being of primarily technical interest rather than containing general implications for atmospheric science.
The details of the Bayesian algorithm are currently in review at Geosci. Model Dev. (Ozon et al., 2020). This manuscript focuses on the application to chamber data, which is valuable to the community, and seems very appropriate to keep in a separate paper form the one describing the algorithm. Advancement of techniques aerosol size distribution inversions, and calculation of processes rates, and the explicit calculation of related uncertainties as presented here, is of value of the aerosol science community. Large uncertainties in growth and nucleation rates, and a lack of mathematically rigorous techniques for calculating them has made it hard for the community to compare between different experiments and to fully understand the effects of different environments and emissions on aerosol climatic and health effects. This analysis addresses these problems for the specific case of the DMAtrain on the CLOUD chamber, which is of value in and of itself, but also as an example for those developing techniques for other instruments or environments. The implications for instrument design drawn explicitly from the analysis presented here are of great value to the community and have the potential to influence thinking on design of a range of aerosol instrumentation.
This manuscript relies heavily on the algorithm presented in Ozon et al. (2020), with more limited explanation here. My review is based on the analysis of results presented in this study only, and not the details of the algorithm presented in Ozon et al. (2020). I note than Ozon et al. (2020) is currently in review, and so caution that publication of this work should depend upon successful peer-review of that work which it builds upon.
I have three main concerns with this manuscript regarding the science presented:
- A major claim of this manuscript is that the nucleation rates calculated from this method agree with nucleation rates calculated using a different instrument and method. Figure 4b shows that, within calculated uncertainties, this is not consistently true. The authors mention that disagreement between instruments is often order of magnitude as opposed to the much smaller disagreement shown here. This suggests that this method is a great improvement upon previous methods, which is very valuable to our field, but more rigor and accuracy is required in how the result is described, or in explaining why we might not expect these two results to agree within uncertainties.
- There is a general lack of quantitative comparison between results from different methods
- I was unable to fully understand some aspects of the method and remain unconvinced about some method choices made in this study. This may be a clarity of presentation issue, or things that need addressing in the analysis itself.
I will address these specifically, and other issues in the line-by-line review below.
Regarding clarify of presentation, I am concerned that this manuscript relies too heavily on other literature, to the extent that it is not possible to fully understand the work presented without constant reference to other literature. Specifically, this manuscript relies heavily on Ozon et al. (2020) to an extent that the methods are not understandable without either having a very intimate knowledge of that paper, or keeping both papers open and constantly going back and forth between them. While it make sense to build on the prior work and not reproduce too much in a new paper, something should be done to make this paper more understandable on its own. I would also like to mention that, while not incorrect, the paper, being aimed at a general atmospheric chem/phys audience in this journal, might be more readable if the authors explained the general idea of Bayesian state estimation problems to a general chemistry audience. Ditto Kalman filters. I also note that this manuscript contains a lot of symbols with definitions placed throughout the text. A table defining all terms somewhere accessible would ease readability.
In terms of adequate referencing of existing literature, there are a number notable omissions in this manuscript. The discussion of formation and growth rate calculation methods makes no mention made of Kurten et al. (2015), despite this also being developed for the same CLOUD chamber. Another method used frequently on data from the CLOUD chamber is the use of the AeroCLOUD model, as described in the methods section of Kirkby et al. (2016). The work of Fiebig et al. (Fiebig et al., 2005), has also been missed. Without placing the work presented in the context of these other studies, it is hard to assess its importance and relative merits. Lack of knowledge of some of this literature seems to have led to erroneous statements in the text, which I will point out below.
Line by line notes:
Abstract
Lines 18-19: Agreement between growth and nucleation rates described as “remarkably good” and “matched .. well”. A quantitative description of the agreement is needed.
Line 19: Formation rate should be independent of the instrumentation used, so I’m not sure that the qualification of “especially given the fact that they were calculated from different instruments” is meaningful, at least not without a thorough explanation of why one might expect them to be different.
Introduction
Line 27: “their concentration” it is unclear what that is referring to, I suggest being explicit.
Line 68 – The Dada et al. formation rate calculation method is mentioned here but not included in the earlier paragraph describing the different methodologies for calculating formation rates. Why?
The description of why the DMAtrain is used is a little puzzling. Were other instruments available which did not meet the criteria laid out? This section needs clarification in terms of motive along with more specific clarification as follows:
Line 70 – high time resolution – what is the time resolution of the measurement and how does this relate to rates of change of key observables in nucleation events in the chamber?
Line 71 – have the collection efficiencies for other candidate instruments not been as carefully characterized?
Line 73 – it would be helpful to explain why it is advantageous to have a new instrument to calculate formation rates from instead of optimizing methods for instruments that have been used previously
Section 2
Line 76 – there are also other quantities of interest e.g. chemical composition of cluster, formation rate at larger sizes, coagulation rates … might be better to rephrase this sentence.
Line 83 – “often done by analysis of time evolution of retrieved particle size distributions” this needs references.
Line 103 – states coagulation can be neglected in certain cases with low particle concentrations – in the context of this study this seems misleading. Coagulation has been explicitly shown to matter in the context of chamber new particle formation experiments (Kurten et al., 2015), which can still be considered to be low concentration environments.
Line 110 – “size space” is this particle diameter? Needs to be explicit.
Line 117-118 “The incorporation of positivity constraints for the process rates and the aforementioned second order models require minor modifications in the definition of the state variable ðð.” – it is not clear enough what the aforementioned second order models are, and the modification needed should be shown explicitly. I can understand why some of the methodology refers toOzon et al. (2020), but for instances such as this it makes reading the paper and understanding the method too time consuming and difficult. Readability in general would be greatly improved if the method could be better understood from this paper without need to refer to other literature as much.
Line 149 - loss rates were defined as lambda above, but lambda doesn’t appear in eq. 5 and 6. By loss rates is the author refering to -r1r2J(k-1)? This needs to be better defined
Line 150 - ðð¡ðð¡ and ððâððððr need defining. Also where does this dilution time come into the calculations presented here?
Line 159 – what is the justification for stronger correlation between closest size bins in this method vs Ozon et al 2020?
Section 3
Line 179 – only sub 10nm size distribution measurements are mentioned. What about particles that grow > 10nm? These will surely contribute to coagulation sinks and therefore need to be accounted for?
Line 190 – steady state charge distribution achieved for flow rate up to 5 lmp. Flow rates used are 5.5. lpm. How does this affect the collection efficiency? Some justification is needed for going outside of the steady state flow range.
Line 194-199 – description of 2 stage CPCs is a bit confusing. Are two “boosters” used on each channel? Is it a different booster for the different channels? If so why?
Fig 1 c. legend refers to fine and coarse models, but caption refers to continuous and discretized forms of the kernel functions. Are these the same? I find this reference to models more confusing than kernel functions, but am aware that could be my own bias from the literature I’m familiar with. I do highly recommend the authors stick to a single terminology to describe the kernel and make sure it is well defined for non-experts. Also is the uncertainty for the continuous function, or both? This should be clarified.
Line 242 - “chamber is operated in continuous mode” did you mean “continuous flow mode”?
Line 244-246 - “assumed” J uncertainty – is this assumed or calculated as described in the rest of the sentence. Working for this uncertainty calculation needs to be shown here or in supplementary material as it is not reproducible with the current level of detail.
Line 255 - “which is distinct from most others” – does this mean that most growth rate calculation methods do not include size and time dependency? This must be clearer and needs references.
Line 256 - “However, compared to the Kalman smoothing, each time step is analysed individually and the analysis framework relies on already inverted size distributions, where a point-by-point inversion procedure is used for the DMA train data of this work (Stolzenburg and McMurry, 2008).” This sentence is confusing and I don’t understand what it means.
Line 260 – if INSIDE cannot provide uncertainty on the growth rate, I would argue that another method is not so much needed to “verify” the result as the authors state here, but to provide a growth rate with calculated uncertainty, and the meaning of a rate with no uncertainty is questionable.
Section 4
Line 263 - “modeled the DMA-train instrument numerically” – what does this mean? Do the authors mean that they applied the calibrated instrument kernels to the synthetic data?
Line 272 - simulated and reconstructed size distributions are compared qualitatively as “very good”. Give that the y and colour axes are both log scale it is hard for the reader to get a sense of goodness of fit. A more quantitative assessment of the similarity between simulated and reconstructed size distributions is warranted. Graphical representations to more easily demonstrate this would help e.g. size distributions at discrete points in time with uncertainties shown, total number concentrations above given size cuts with uncertainties.
Regarding the oscillations on size distributions and process rates resulting from the DMA-train channels – is it not possible to apply some smoothing or correction for this?
Line 311 - temporal oscillations in calculated growth rate – some of these appear in the PSM growth rate too, but the authors earlier explain these as a product of the discrete size channels of the DMAtrain. So then why are they mirrored in the PSM derived growth rates? Authors note this as “remarkable” and an indication that these are real oscillations on the growth rate. This does not agree with what they mentioned earlier about it being an instrumental artifact in the simulated data. Some work is needed to explain this – what is real and what is an instrumental artifact. And if some of it is real, can the authors suggest why this would occur?
Line 331 – could the Henritzi et al size distribution be reproduced here for direct comparison? It would make the paper much more readable and enable direct comparison of results. A direct comparison including errors would again be of more use than two log-scale colour plots.
Line 336 – While the result presented in fig 4b is indeed an improvement upon inter-instrument differenced of up to an order of magnitude reference from the literature, it is still clear that the nucleation rates derived from the different instrument do not, within the calculated uncertainties, agree. If the reasons for this are well understood from the referenced literature, the author needs to summarize the argument here, and not rely on the reader having detailed knowledge of these other studies from the CLOUD chamber. As it stands the results shown in fig 4b do not support on the of the major claims of this paper – that the FIKS method is in agreement with other methods for calculating process rates. Is it the case that the known uncertainties for the two methods are actually missing a large source of uncertainty? This needs to be addressed. I would like to point out that, even if within known sources of uncertainty these results are not in agreement, as fig 4b suggests, the reduction in disagreement from previous studies is still a very important result that deserves publication and can assist the community to improve our process rate calculations. My point is that the authors must be more rigorous and accurate in describing what has and has not been achieved here.
Line 340 – This decreasing FIKS growth rate due to a lack of information above 4.3 nm seems problematic. As I understand from the text, there is no information to suggest a decreasing growth rate here, just an assumption of smoothness. Should the algorithm not then be adjusted to take into account where there is not enough information content to calculate a growth rate, and simply not report one, in a similar manner to INSIDE?
Lines 403-407 - As in previous sections, it is difficult to compare size distributions using a log-scale colour plot. More meaningful comparison, which requires uncertainties, could be achieved using a) snapshots in time, b) cumulative concentrations above given limits. The colour plots shown give a helpful graphical indication of how the different inversions work, which is valuable, but more quantitative evaluation is needed in addition to enable compare between the proposed DMAtrain configurations being discussed here.
Lines 408-418 - This is a really valuable discussion linking instrument design to intended use and I am pleased to see it being brought to the attention of the community through this well explored example.
References
Fiebig, M., Stein, C., Schröder, F., Feldpausch, P., and Petzold, A.: Inversion of data containing information on the aerosol particle size distribution using multiple instruments, J. Aerosol Sci, 36, 1353-1372, https://doi.org/10.1016/j.jaerosci.2005.01.004, 2005.
Kirkby, J., Duplissy, J., Sengupta, K., Frege, C., Gordon, H., Williamson, C., Heinritzi, M., Simon, M., Yan, C., Almeida, J., Trostl, J., Nieminen, T., Ortega, I. K., Wagner, R., Adamov, A., Amorim, A., Bernhammer, A. K., Bianchi, F., Breitenlechner, M., Brilke, S., Chen, X. M., Craven, J., Dias, A., Ehrhart, S., Flagan, R. C., Franchin, A., Fuchs, C., Guida, R., Hakala, J., Hoyle, C. R., Jokinen, T., Junninen, H., Kangasluoma, J., Kim, J., Krapf, M., Kurten, A., Laaksonen, A., Lehtipalo, K., Makhmutov, V., Mathot, S., Molteni, U., Onnela, A., Perakyla, O., Piel, F., Petaja, T., Praplan, A. P., Pringle, K., Rap, A., Richards, N. A. D., Riipinen, I., Rissanen, M. P., Rondo, L., Sarnela, N., Schobesberger, S., Scott, C. E., Seinfeld, J. H., Sipila, M., Steiner, G., Stozhkov, Y., Stratmann, F., Tome, A., Virtanen, A., Vogel, A. L., Wagner, A. C., Wagner, P. E., Weingartner, E., Wimmer, D., Winkler, P. M., Ye, P. L., Zhang, X., Hansel, A., Dommen, J., Donahue, N. M., Worsnop, D. R., Baltensperger, U., Kulmala, M., Carslaw, K. S., and Curtius, J.: Ion-induced nucleation of pure biogenic particles, Nature, 533, 521-+, 10.1038/nature17953, 2016.
Kurten, A., Williamson, C., Almeida, J., Kirkby, J., and Curtius, J.: On the derivation of particle nucleation rates from experimental formation rates, Atmos Chem Phys, 15, 4063-4075, 10.5194/acp-15-4063-2015, 2015.
Ozon, M., Seppänen, A., Kaipio, J. P., and Lehtinen, K. E. J.: Retrieval of process rate parameters in the general dynamic equation for aerosols using Bayesian state estimation, Geosci. Model Dev. Discuss., 2020, 1-32, 10.5194/gmd-2020-236, 2020.
Citation: https://doi.org/10.5194/acp-2021-99-RC1 - AC1: 'Reply on RC1', Dominik Stolzenburg, 01 Jul 2021
-
RC2: 'Comment on acp-2021-99', Anonymous Referee #2, 21 Apr 2021
The manuscript by Ozon et al. describes the application of a new theoretical method (FIKS, Fixed Interval Kalman Smoother) for deriving new particle formation and growth rates from size distribution measurements. The manuscript that introduces the theoretical framework of the applied method is currently under review (Ozon et al., 2020). In the present paper the FIKS method is applied to artificially generated size distribution data and data from the CLOUD experiment for three different chemical systems (sulfuric acid + ammonia, highly-oxygenated organic compounds and iodic acid). The data used for FIKS are taken from the DMA-train, which provides time-resolved particle concentrations for seven different size channels (between 1.8 nm and 8 nm, see Stolzenburg et al., 2017). From these data the FIKS method yields the new particle formation rate (J at 1.7 nm) as a function of time and the particle growth rate (GR) as a function of the particle size. These results are compared with the J and GR derived from other (established) methods. For the derivation of the new particle formation rate the particle number concentrations measured with the Particle Size Magnifier and the Scanning Mobility Particle Sizer are used (Dada et al., 2020), whereas for the derivation of the growth rate the INSIDE method with the DMA-train data are used (Pichelstorfer et al., 2018). Overall, the inter-comparison between the results from FIKS and the other methods show good agreement. The FIKS method has the benefit of providing an uncertainty range for the derived quantities. Ozon et al., further demonstrate that the method can be used to optimize the settings of the DMA-train in terms of the set size resolution such that size distribution can be reconstructed by the proposed method with high accuracy. This is very important as such a guideline can improve the data quality in further experiments.
Overall, I agree with the authors that the development of sophisticated data evaluation methods as the one presented here, is important and lacks somewhat behind the instrument development. Therefore, I highly favor the publication of the present study and have only a few suggestions for further improvement and clarification (listed below). What I find, however, somewhat problematic is the fact that the method paper (Ozon et al., 2020) is not finally published yet. In this respect, I would also like to mention that I did not review the method itself but only its application in the present study. Therefore, I think that it would be appropriate to wait for the final publication of Ozon et al. (2020) before the present manuscript can be published in ACP.
Specific comments:
- Page 1, line 33/34: The authors mention here that “potentially crude approximations” can be made when formation and growth rates are derived. It would be good to explain what approximations are meant here.
- Page 2, line 72/73: I think, the data from the DMA-train can also be used to derive new particle formation rates (from the smallest size channel) and that these data need to be included in the further analysis and discussion. This could show whether the differences in J from the PSM and the FIKS method arise mainly due to the use of data from two different instruments or from the different methods.
- Page 7, line 218: Here it is mentioned that the number of the size channels is 32. Some discussion should be included how this choice affects the outcome of the results. Can a larger number of size channels improve the agreement between the FIKS method and the other methods?
- Page 11, line 335: The discrepancy between J from the PSM and the FIKS method is a factor of ~2.5, i.e., it is significantly larger as for the sulfuric acid/ammonia and the iodic acid system. I would like to see some further discussion on the possible reasons for this difference.
References:
Dada, L., Lehtipalo, K., Kontkanen, J., Nieminen, T., Baalbaki, R., Ahonen, L., Duplissy, J., Yan, C., Chu, B., Petäjä, T., Lehtinen, K., Kerminen, V.-M., Kulmala, M. and Kangasluoma, J.: Formation and growth of sub-3-nm aerosol particles in experimental chambers, Nat. Protoc., doi:10.1038/s41596-019-0274-z, 2020.
Ozon, M., Seppänen, A., Kaipio, J. P. and Lehtinen, K. E. J.: Retrieval of process rate parameters in the general dynamic equation for aerosols using Bayesian state estimation, Geosci. Model Dev. Discuss., 2020, 1–32, doi:10.5194/gmd-2020-236, 2020.
Pichelstorfer, L., Stolzenburg, D., Ortega, J., Karl, T., Kokkola, H., Laakso, A., Lehtinen, K. E. J., Smith, J. N., McMurry, P. H. and Winkler, P. M.: Resolving nanoparticle growth mechanisms from size- and time-dependent growth rate analysis, Atmos. Chem. Phys., 18(2), 1307–1323, doi:10.5194/acp-18-1307-2018, 2018.
Stolzenburg, D., Steiner, G. and Winkler, P. M.: A DMA-train for precision measurement of sub-10 nm aerosol dynamics, Atmos. Meas. Tech., 10(4), 1639–1651, doi:10.5194/am 634 t-10-1639-2017, 2017.
Citation: https://doi.org/10.5194/acp-2021-99-RC2 - AC2: 'Reply on RC2', Dominik Stolzenburg, 01 Jul 2021