the Creative Commons Attribution 4.0 License.
the Creative Commons Attribution 4.0 License.
![](https://acp.copernicus.org/articles/24/8821/2024/acp-24-8821-2024-avatar-thumb150.png)
Improving the predictions of black carbon (BC) optical properties at various aging stages using a machine-learning-based approach
Baseerat Romshoo
Jaikrishna Patil
Tobias Michels
Thomas Müller
Marius Kloft
Mira Pöhlker
It is necessary to accurately determine the optical properties of highly absorbing black carbon (BC) aerosols to estimate their climate impact. In the past, there has been hesitation about using realistic fractal morphologies when simulating BC optical properties due to the complexity involved in the simulations and the cost of the computations. In this work, we demonstrate that, by using a benchmark machine learning (ML) algorithm, it is possible to make fast and highly accurate predictions of the optical properties for BC fractal aggregates. The mean absolute errors (MAEs) for the optical efficiencies ranged between 0.002 and 0.004, whereas they ranged between 0.003 and 0.004 for the asymmetry parameter. Unlike the computationally intensive simulations of complex scattering models, the ML-based approach accurately predicts optical properties in a fraction of a second. Physiochemical properties of BC, such as total particle size (number of primary particles (Npp), outer volume equivalent radius (ro), mobility diameter (Dm), outer primary particle size (ao), fractal dimension (Df), wavelength (λ), and fraction of coating (fcoating), were used as input parameters for the developed ML algorithm. An extensive evaluation procedure was carried out in this study while training the ML algorithms. The ML-based algorithm compared well with observations from laboratory-generated soot, demonstrating how realistic morphologies of BC can improve their optical properties. Predictions of optical properties like single-scattering albedo (ω) and mass absorption cross-section (MAC) were improved compared to the conventional Mie-based predictions. The results indicate that it is possible to generate optical properties in the visible spectrum using BC fractal aggregates with any desired physicochemical properties within the range of the training dataset, such as size, morphology, or organic coating. Based on these findings, climate models can improve their radiative forcing estimates using such comprehensive parameterizations for the optical properties of BC based on their aging stages.
- Article
(4835 KB) - Full-text XML
-
Supplement
(3773 KB) - BibTeX
- EndNote
Black carbon (BC) aerosols are strong absorbers of solar radiation formed from incomplete combustion of fossil fuels, biofuels, and biomass (Ramanathan and Carmichael, 2008; Bond et al., 2013). In the atmosphere, BC is usually found together with other types of aerosols, which form a coating around it (Sun et al., 2022; Sedlacek et al., 2022; Romshoo et al., 2023a). To understand the impact of BC on the environment, global climate models require information about its light-scattering and absorption properties (Jacobson, 2001). The most common morphology assumed for such BC-containing aerosols in light-scattering codes is a spherical core–shell shape (Bond et al., 2013). The Lorenz–Mie theory (Mie, 1908) is often used to calculate the optical properties of such spherical BC particles (Bohren and Huffman, 2008). However, studies have shown significant discrepancies in the results of the Lorenz–Mie theory when compared with ambient measurements (Romshoo et al., 2024; Adachi et al., 2010; Wu et al., 2018).
High-resolution transmission electron microscopy (TEM) images showed that the BC particles have a fractal structure composed of numerous spherules known as primary particles (Chakrabarty et al., 2006). This led to an advanced mathematical description of BC as fractal aggregates, known as fractal law (Mishchenko et al., 2002):
where a is the radius of the primary particle, Npp is the number of primary particles, kf is the fractal prefactor, and Df is the fractal dimension. Rg is the radius of gyration, which characterizes the spatial size of the aggregate. The shortcomings of the simplified spherical assumption of BC have caused the scientific community to develop towards the use of such realistic fractal aggregate morphology for computing the optical properties of BC (e.g., Kahnert and Kanngießer, 2020; Romshoo et al., 2021; Kahnert, 2010a; Wu et al., 2018; Liu and Mishchenko, 2018).
Romshoo et al. (2022) showed that the discrepancy between modeled and measured optical properties could be reduced to 10 % when an aggregate morphology is used. To simulate the optical properties of BC as fractal aggregates, the most commonly used methods are the Rayleigh–Debye–Gans (RDG) approximation (Sorensen, 2001), the discrete dipole approximation (DDA) (Purcell and Pennypacker, 1973), the generalized multi-particle Mie (GMM) method (Xu and Gustafson, 2001), and the T-matrix method (Mishchenko et al., 1996). The multi-sphere T-matrix (MSTM) method has found widespread applications in the research field because of its high computational speed and accuracy in comparison to other methods like the DDA (Kahnert and Kanngießer, 2020; Yurkin and Kahnert, 2013). Although the MSTM has lower computational costs when compared to other numerical methods, a single simulation can still take more than 24 h, depending on the properties of the aggregate.
Consequently, pre-calculated databases have been developed for aggregate properties to save time in constructing detailed aggregates and time-consuming optical simulations (Liu et al., 2019; Romshoo et al., 2021). Using these databases as look-up tables mitigates high computational overhead in large-scale applications. Still, this approach is limited by the range and step size of parameters chosen during the database creation. Previous work has trained machine learning (ML) models on such databases (Luo et al., 2018a; Lamb and Gentine, 2023) to overcome those limitations. Once trained, those ML models provide predictions for BC optical properties in a fraction of a second. Luo et al. (2018a) trained a support vector regressor on a database generated using MSTM simulations (Npp from 8 to 3000; Df from 1.8 to 2.2). However, they did not consider coating and used pure BC aggregates in their experiments. Their results also suggest that their model has considerable difficulties when attempting to predict optical properties for physicochemical properties not in the range of the training data. Lamb and Gentine (2023) predicted optical properties of uncoated BC fractal aggregate using a graph neural network (Npp from 8 to 960; Df from 1.8 to 2.3). The input graph contains one node for each primary particle and an edge between two nodes if the distance between the corresponding primary particles is less than some threshold. The authors generate their ground truth database using the MSTM algorithm, but, like Luo et al. (2018a), they do not consider any coating in their experiments. The machine learning methods, training parameters, performance metrics, and other details of Luo et al. (2018a) and Lamb and Gentine (2023) are compared to this study in Table B1.
This study demonstrates the use of a machine-learning-based approach to predict the optical properties of BC aggregates at various aging stages, including coating, which is highly relevant for atmospheric aerosols. Combining this ML-based approach with a laboratory dataset showed that optical properties like single-scattering albedo (ω) and mass absorption cross-section (MAC) can be predicted more accurately than with conventional Mie-based methods. A database of the optical and physicochemical properties of BC has been built for this study, which is an extension of the previous work by Romshoo et al. (2021). We trained two ML methods on this database: kernel ridge regression (KRR) and artificial neural networks (ANNs). Experiments show that these models predict the optical properties of BC aggregates regardless of their size, morphology, or composition at low computational costs and with high accuracy. The dataset used to train our ML models is freely available at Zenodo1. Furthermore, we published our ML models on GitHub2 together with an easy-to-use wrapper script to allow integration into higher-level applications. Our approach contributes to improving global climate model radiative forcing estimates by parameterizing BC optical properties using realistic fractal aggregate morphology.
The paper is structured as follows: Sect. 2 provides an overview of the physical, chemical, and optical properties of BC used in this study. Section 3 describes the machine learning techniques, including the data processing, machine learning algorithms, and evaluation procedures. In Sect. 4, the results demonstrate that realistic morphologies of BC can be used to accurately predict optical properties at various stages of aging. Section 5 discusses how the results compare to laboratory measurements of BC, discussing the atmospheric processing in detail. Potential limitations and challenges of this work are presented in Sect. 6, and we end with the main conclusions in Sect. 7.
The database for the physicochemical and optical properties of BC fractal aggregates has been designed to consider all the possible aging stages of BC. The optical properties of BC fractal aggregates are most sensitive to the change in particle size as they age (Matsui et al., 2018). The particle size is reported as dependent parameters of the number of primary particles (Npp), volume equivalent radii (ri and ro), and mobility diameter (Dm). Furthermore, the chemical composition and morphology also influence their optical properties. There are constants related to the particle's chemical composition, such as density and refractive index. The optical properties have been reported as efficiencies and cross-sections. Further dependent optical properties have also been included. The mass and volume of the BC particles were used for conversion between various optical parameters. Furthermore, some parameters, such as the wavelength, were related to the optical model. The database was created using 6192 particles of varying sizes, morphologies, and coating fractions. There are 35 features in the database, which are categorized into 15 physicochemical features, 13 optical features, and 7 constants. Sect. 1 contains an overview of all the features of the database. In Table A1, the upper and lower bounds of the main features are provided.
![https://acp.copernicus.org/articles/24/8821/2024/acp-24-8821-2024-f01](https://acp.copernicus.org/articles/24/8821/2024/acp-24-8821-2024-f01-thumb.png)
Figure 1Overview of the various features of the database for physicochemical and optical properties of black carbon fractal aggregates. The features are arranged based on the three steps of constructing this database. As the legend at the bottom indicates, the features are further divided into physicochemical properties, optical properties, and others.
2.1 Physicochemical features of the database
The BC fractal aggregate's physicochemical features include size, mass, volume, morphology, and composition. Figure 2 gives some examples of the various BC aggregate particles generated in this study. All the relevant properties provided in the study are discussed below, and their formulas are given in Sect. A1.
![https://acp.copernicus.org/articles/24/8821/2024/acp-24-8821-2024-f02](https://acp.copernicus.org/articles/24/8821/2024/acp-24-8821-2024-f02-thumb.png)
Figure 2Visualization of the various BC aggregate particles generated in this study. Fresh BC aggregates with no external coating are shown in panels (a) to (c). Semi-aged BC aggregates with 50 % coating are shown in panels (d) to (f). Aged BC aggregates with 90 % coating are shown in panels (g) to (i).
2.1.1 Size
Primary particle size (a). The primary particle size of a BC fractal aggregate is sensitive to the emission source or flame condition. Biomass burning produces black carbon aggregates with comparatively large primary particles, ranging from 15 to 25 nm in radius (Chakrabarty et al., 2006). Diesel engines produce aggregates whose primary particle radii range between 10 and 12 nm (Guarieiro et al., 2017). On the other hand, emissions from aircraft engines consist of particles with radii as small as 5 nm (Liati et al., 2014). There has also been research indicating that the size distribution of primary particles is largely polydisperse (Bescond et al., 2014). Liu et al. (2015) pointed out that, when considering a monodisperse and a polydisperse distribution of the radius of the primary particle, their resultant radiative properties differ. However, Kahnert (2010b) showed that particle light absorption is insensitive to the radii of primary particles when they are between 10 and 25 nm. The black carbon fractal aggregates in this study have a monodisperse distribution of the radius of the primary particle. BC aggregates were simulated with the inner diameter of the primary particle (ai) fixed at 15 nm. In contrast, the outer radius of the primary particle (ao), consisting of the organics, varied between 15.1 and 30 nm with the fraction of coating (fcoating) following Eq. (A3) in Appendix A. The ao was 15, 15.1, 15.3, 15.5, 15.8, 16.2, 16.5, 16.9, 17.8, 18.9, 20.4, 22.4, 25.6, and 29 according to the value of the fcoating given in Table A1.
Number of primary particles (Npp). The number of primary particles determines the overall size of the particle. The BC fractal aggregates were simulated by varying Npp by 5 %, starting from 1 up to 1000.
Volume equivalent radius (r). The volume equivalent radius is defined as the radius of a sphere having the same volume as the BC fractal aggregate, described in Eq. (A1) in the Appendix. The outer volume equivalent radius (ro) was calculated for the whole BC aggregate and for the coating using ao. The inner volume equivalent radius (ri) was calculated using ai for the BC aggregate without the coating, i.e., pure BC.
Mobility diameter (Dm). The mobility diameter is the diameter of a sphere with the same migration velocity in a constant electric field as that of the BC fractal aggregate (Flagan, 2001). Mobility size spectrometers can measure Dm, which is interesting for ambient and laboratory studies. We derived Dm for the entire range of Npp using the conversion given by Sorensen (2011); see Eq. (A2) in Appendix A.
Geometric cross-section (Cgeo). The geometric cross-section is the area of the cross-section of a volume equivalent sphere given as Eq. (A4) in Appendix A.
2.1.2 Mixing state
Along with BC, a complex mixture of gas-phase organic compounds is co-emitted during incomplete combustion, forming a coating around the BC aggregates (Gentner et al., 2017). As the BC aggregates stay in the atmosphere, they transform from being hydrophobic to hydrophilic due to water deposition attracting other foreign coatings (Bhandari et al., 2019). The result is that BC particles undergo complex changes in their morphology throughout atmospheric aging, transforming from bare to partially coated aggregates and finally forming compact spherical structures embedded within external coatings (Coz and Leck, 2011; Corbin et al., 2023). Therefore, regarding BC as fractal aggregates is necessary to represent all the different stages during their atmospheric aging process. The two parameters describing the mixing state are as follows.
Fractal dimension (Df). The fractal dimension is a parameter for morphology that quantifies the folding of BC fractal aggregates into spherical structures with increasing residence time. The value of Df increases as an aggregate grows into a more spherical frame. A Df of 3 is the maximum value describing a complete sphere, whereas a Df of 1 represents an early-stage open-chain-like aggregate. In the early stages of the BC aging cycle, Df is usually between 1.5 and 1.9 (Wentzel et al., 2003). With increasing residence time in the atmosphere, aggregates become more compact with a fractal dimension of up to 2.2 (Wang et al., 2017). A humid environment or foreign coatings may further reshape the BC fractal aggregates into more compact structures with a fractal dimension of up to 2.6 (Bambha et al., 2013). In this study, the range of fractal dimensions was taken from 1.5 to 2.9 with a step size of 0.2.
Fraction of coating (fcoating). The fraction of coating is the percentage of coating volume compared to the total volume of the BC fractal aggregate. To cover all aging stages, the coating fraction was taken from 1 % to 90 % in increments of 5 %. Note that the coating composition was constrained to non-absorbing organics in this study. fcoating is dependent on the ao and ai, described by Eq. (A3) in Appendix A.
2.1.3 Others
Volume. Three features in our database describe the volume of a BC aggregate: (1) the total volume of the particle (Vtotal), (2) the volume of the BC (VBC), and (3) the volume of the organic coating (Vcoating).
Mass. Similarly, we include five features related to the mass of the BC aggregate: (1) the total mass of the particle (mtotal), (2) the mass of the BC (mBC), (3) the mass of the coating (mcoating), (4) the mass ratio of total mass to BC mass , and (5) the mass ratio of coating mass to BC mass . We computed those values fixing the density of BC as ρBC = 1.8 g cm−3 (Park et al., 2004) and the density of the organic coating as ρOC = 1.1 g cm−3 (Schkolnik et al., 2007).
Wavelength (λ). The optical properties were calculated in the visible spectrum, i.e., for .
2.2 Optical model and the optical features of the database
The tunable diffusion-limited aggregation (DLA) software (Wozniak et al., 2012) was used to simulate bare BC fractal aggregates of various physicochemical properties. BC can exhibit a range of coating thicknesses and fractal dimensions at any point in the atmosphere, as evidenced by images from transmission electron microscopy (TEM) analyzed from different locations (Fu et al., 2012). Detailed information and images from TEM analysis of BC particles have been provided in the Supplement. The coating model used in this study is called the “closed-cell model”; the results showed good comparability with the realistic coating model (Kahnert, 2017). The MSTM calculates the electromagnetic properties of a system that consists of a set of spheres (Mishchenko et al., 2004; Mackowski and Mishchenko, 2011). In this study, we use MSTM version 3.0 (Mackowski, 2013) written in Fortran to compute the electromagnetic properties for fixed and random orientations. For every BC fractal aggregate, the MSTM algorithm presents an orientational average of the combined spherical expansions of each primary particle. The MSTM code is best suited to calculating the optical properties of coated BC fractal aggregates, since it consists of nested spheres. However, a limiting condition in the MSTM is that primary particles cannot overlap. It was necessary to use this closed-cell coating model due to the non-overlapping sphere limitation of the MSTM code. A sophisticated coating model would be a good choice, but it requires more complex scattering models, such as discrete dipole approximation (DDA), which is computationally expensive. The optical features of the database are given below.
The real (n) and imaginary (k) parts of the refractive indices for BC and coating (non-absorbing organics) at different wavelengths (Kim et al., 2015) used in this study are summarized in Table A2.
Optical efficiencies (). The MSTM directly calculates the extinction efficiency (Qext), absorption efficiency (Qabs), and scattering efficiency (Qsca) of the BC aggregate.
Optical cross-sections (). The optical cross-section is the product of efficiency and geometric cross-section; see Eq. (A5) in Appendix A.
Asymmetry parameter (g). The asymmetry parameter is directly obtained from the MSTM, defined as the intensity-weighted average of the cosine of the scattering angle (Eq. A6 in Appendix A).
Single-scattering albedo (ω). The single-scattering albedo is the ratio of scattering efficiency (Qsca) and extinction efficiency (Qext), given as Eq. (A7) in Appendix A.
Mass absorption cross-section (MAC). The mass absorption cross-section is calculated from the ratio of absorption cross-section (Cabs) and mass (m) as detailed in Eq. (A8) in Appendix A. The three kinds of MAC calculated in this study are total mass absorption cross-section (MACtotal), BC mass absorption cross-section (MACBC), and coating mass absorption cross-section (MACcoating).
As mentioned in Sect. 1, several high-impact applications, such as climate modeling (Jacobson, 2001), depend on accurate optical properties for specific BC particles. Hence, we propose to train an ML model on a pre-computed database containing physicochemical and corresponding optical properties of BC fractal aggregates at several life cycle stages. This model will learn patterns and structures within the data and should generalize to unseen data values when used in applications, as evidenced by the success of ML in several domains (Radford et al., 2021; Ramesh et al., 2022). In this work, we train kernel ridge regression and a multi-layer perceptron on the database introduced in Sect. 2. The following sections detail our data processing routines, models, and evaluation procedures.
3.1 Data preprocessing
The subset of the database used as input was designed to include the critical parameters that influence the BC optical properties. As mentioned in Sect. 2.1, not all physical properties in the database are independent, as some can be derived from others using simple formulae. Including all properties as inputs for the ML model will thus present it with redundant information, increasing its computational overhead and possibly even harming its performance. The first criterion to narrow down the input parameters was broadly choosing the independent physicochemical parameters representing particle size and mixing state. The fractal dimension (Df) was used to represent the morphology of the BC fractal particles. The chemical mixing state is represented by the fraction of coating (fcoating). The wavelength (λ) is also an input parameter. There was an exception in selecting the input parameters for particle size where we decided to keep four dependent parameters of outer primary particle size (ao), number of primary particles (Npp), outer volume equivalent radii (ro), and mobility diameter (Dm). The reason for including all four size parameters is that, depending upon the focus of a study, the user may have more than one parameter representing the size. In this way, we could provide a more user-friendly prediction script in which the user has a choice to enter one or more of the four size parameters. Therefore, the subset of the database's properties as input for our ML models is λ, Df, fcoating, ao, Npp, ro, and Dm. The range of each input parameter used for designing the prediction algorithm is summarized in Table A1. The selection of input parameters needed while running the prediction script is λ; Df; fcoating; and at least one among Npp, and ro, and Dm.
Similarly, a BC fractal aggregate's optical properties are also not independent. Thus, we make the ML model predict only the following three properties and compute the rest using the formulae in Sect. A1: absorption efficiency (Qabs), scattering efficiency (Qsca), and asymmetry parameter (g).
After feature selection, we transform input features using the Box–Cox transformation (Box and Cox, 1964), where we choose the transformation parameter by maximum-likelihood estimation. We also tried to apply the Box–Cox transformation to the target features, but, since this did not improve results, we decided not to use any transformation on the target features for the experiments that we report in Sect. 4. To find a suitable regression model, we conducted experiments with multiple ML-based models for regression, including support vector regression (SVR), ridge regression (RR), kernel ridge regression (KRR), and artificial neural networks (ANNs). Each model was evaluated using mean absolute error (MAE) on the sample dataset. The results showed that kernel ridge regression and neural networks demonstrated better performance, especially in capturing the non-linear relationships within the dataset. Hence, we used KRR and neural networks for further analysis.
3.2 Kernel ridge regression
Given a labeled dataset of N∈ℕ points , the regression problem consists of finding a function such that f(x(n))≈y(n) for all . Kernel ridge regression (KRR) (Shawe-Taylor and Cristianini, 2004) learns a function of the form , where is a positive semi-definite kernel function (Cortes and Vapnik, 1995) and is a solution of the following convex optimization problem:
where is the so-called kernel matrix defined by ; is a trade-off parameter that controls the influence of the regularization term, ; and denotes the Frobenius norm. Note that Eq. (2) has a closed-form solution:
A popular choice for the kernel function is the Gaussian or radial basis function (RBF) kernel
where is a parameter called bandwidth and denotes the L2-norm.
We use scikit-learn's KRR implementation3 with the RBF kernel for our experiments. This method has two hyperparameters that need tuning: the RBF kernel's and (see Eq. 2). We optimize hyperparameters using grid search; please see Table B2 for the grid and Sect. 3.4 for more detailed information on our evaluation procedure.
3.3 Artificial neural networks
Artificial neural networks (ANNs) constitute one of the founding pillars of ML's success during the last 10 years. Originally, their design was inspired by the structure of neurons inside the nervous system of several organisms (Rosenblatt, 1958). Most designs used in practice nowadays abandoned that idea, but the name remains.
In our experiments, we use a feed-forward ANN, sometimes also called a multi-layer perceptron (MLP). It consists of an arbitrary number (L≥2) of layers, of which the first is called the input layer, the last is called the output layer, and all layers in between are called hidden layers. Each layer consists of a certain number of neurons, which are connected to the neurons in the previous and following layers.
Formally, we can define an MLP as a function that is composed of L−1 layer functions, i.e., , where each represents a connection between two layers. They are defined as , where are learnable parameters and σ(l) is a so-called activation function that is applied separately to each element of its input vector. Common choices for σ(l) include the rectified linear unit (ReLU) or the tanh function. We use the same activation function for each layer except the last, where we always use the identity function, i.e., . Finally, D(l)∈ℕ denotes the number of neurons in layer l, with D(1)=D and .
The number of hidden layers, the number of neurons in those hidden layers, and the activation function are usually chosen by a human before training a neural network. Together, they define the architecture of the MLP. We can learn values for the parameters and by minimizing a so-called loss function over a dataset:
When solving a regression problem, the most common choice for ℒ is the squared loss , but practitioners sometimes use other loss functions as well, for example, the Huber loss (Huber, 1964):
where determines the cut-off point between squared and absolute loss and is usually chosen as δ=1. The entire procedure of adapting ANN's parameters using a given dataset is called training in the ANN literature.
Note that, in general, Eq. (5) is not convex and does not have a closed-form solution. Hence, practitioners use gradient-based optimization methods, i.e., variants of mini-batch stochastic gradient descent (SGD) (Bottou et al., 2018), to find a local minimum of Eq. (5).
For our experiments, we implemented an MLP using Keras4. Section B3 contains the hyperparameter grid for the MLP's architecture and training procedure.
3.4 Evaluation procedure
In the case of kernel ridge regression, regularization is carried out by the regularization constant λ with a chosen optimal value of 0.0001. For neural networks, we tested the dropout technique to prevent overfitting. However, dropout regularization did not show notable improvements in the model's generalization. After preprocessing, we split the database into a training set and a test set. Models perform their training procedures and hyperparameter tuning on the training set only, and we then evaluate the model's performance exclusively on the test set. We consider three different methods of performing this split – each one intends to measure another aspect of the model's performance.
-
Random split. We randomly assign each point in the database to either the training set or the test set. Note that we use 30 % of the data for the test set and the rest for the training set. Using this split, the training test's and the test set's feature distribution should be similar. Thus, measuring the performance on the test set produces a general measure of the model's capability to learn the underlying patterns in the data.
-
Interpolation split. Here, we choose a feature and a certain range in the middle of that feature's range and choose all data points within that range as the test set. To achieve high test scores, the model must be capable of interpolating predictions for data points it has not seen during training. Table B4 shows the features and ranges used for the two interpolation splits. The split was tested for Df using training data of Df = , whereas training data of were used for testing fcoating.
-
Extrapolation split. Similarly to the interpolation splits, we also consider choosing a test set at the boundaries of certain features. This measures the model's extrapolation capabilities. Table B5 shows the features and ranges used for the four different extrapolation splits. The two splits for testing Df used training data of [1.5,2.5) and (1.9,2.9]. The other two splits for fcoating used training data of [0,75) and (15,90].
We use the mean absolute error (MAE) as our primary performance metric: given a dataset and our prediction model , we can compute the MAE as follows:
where is the L1-norm.
Regardless of the split strategy, we split the training set once more into a train and a validation set using the random-split method during the training phase. Here, we again use 30 % of the data for validation and the remaining 70 % for training. Our models then train on the train set for all possible hyperparameter configurations defined in the grid, and we record the MAE on the validation set for each combination. Finally, we choose the combination with the lowest MAE and evaluate the corresponding model's MAE on the test set.
The error distributions for the ML methods are presented in Fig. 3 for different experimental scenarios of the data-splitting with respect to the parameter fractal dimension. The median error is close to zero for the random and interpolation splits, meaning our models do not generally over- or underestimate any optical value. The distribution of errors (excluding outliers) for the random and interpolation splits is relatively narrow, indicating that most test points have minor errors. In the extrapolation case, both ML models exhibit bias, such as overestimation of Qsca by ANN and overestimation of g by KRR. However, the mean absolute error, even for the extrapolation split, is 1.5 % to 8 %, which is still within reasonable limits. Luo et al. (2018a) showed that their model has considerable difficulties when attempting to predict optical properties for parameters not in the range of the training data. However, adding a few data points to extend any parameter range significantly improved the prediction ability of the ML algorithm. The interpolation and extrapolation results are similar if training data and test data are split according to the parameters of the coating fcoating and particle size Dm. The Appendix provides a more detailed discussion about the interpolation and extrapolation results for parameters of fcoating and Dm in Figs. C1 and C2, respectively. Overall, the narrow boxplots of the errors in the random split demonstrate the effectiveness of the ML algorithms in predicting the optical properties of coated BC fractal aggregates.
![https://acp.copernicus.org/articles/24/8821/2024/acp-24-8821-2024-f03](https://acp.copernicus.org/articles/24/8821/2024/acp-24-8821-2024-f03-thumb.png)
Figure 3Boxplots summarizing the error between the predicted value (, , ) and the true value for three optical properties. The training data for the interpolation split consist of fractal dimensions in , whereas the extrapolation split uses . The lower and upper hinges of the boxplot represent the 25 % and 75 % quantile of the observations, respectively. Note that the outliers significantly reduced the visualization of the boxplots and were therefore omitted from the figures. However, all the outliers are considered in the training data and error evaluation.
The MAEs for our experiments are reported in Table 1. In the case of the random split, both ML models are pretty accurate, with the percentage of MAEs ranging from 0.1 % to 0.4 % when compared to the average feature range. Lamb and Gentine (2023) reported mean absolute percentage errors (MAPEs) between 2 % and 9 % for their optical predictions, whereas Luo et al. (2018a) reported relative errors between 1 % and 5 %. The MAPEs are biased to the magnitude of the true value in the denominator. The same MAE can result in a significantly different MAPE depending on the magnitude of true value they are divided with. In our view, the prediction error should be weighted equally for both points; therefore, we chose the MAE as our error metric. Lamb and Gentine (2023) also discussed how the bias of MAPEs resulted in higher values of nearly 70 % for smaller particles. Error distributions for the ML methods shown in Fig. 3 are presented in terms of MAPE in the Supplement. The comparison of the two ML methods for random split in Table 1 showed that KRR generally results in a lower MAE for predictions of Qabs and Qsca. Contrary to this, ANN could predict g with a lower MAE. In line with expectations, the MAE for the splits based on interpolation and extrapolation is somewhat higher. The errors, however, are still regarded as relatively minor compared to the features' range. The extrapolation and interpolation experiments were used to test the performance of the ML algorithm under various scenarios of data available for training. The ML models we publish for use in applications were trained on the entire dataset using the best parameters from the random-split experiments. As a result, the errors should be similar to those we report for the random split here.
Table 1Mean absolute errors of the predicted optical properties for different experiments. The training data for the interpolation split consist of fractal dimensions in , whereas the extrapolation split uses .
![](https://acp.copernicus.org/articles/24/8821/2024/acp-24-8821-2024-t01-thumb.png)
A one-to-one comparison was performed between the estimates and true values to understand better how the ML methods predict optical properties. Figure 4 compares the estimated and true values for the wavelength of 660 nm when the training and test data are randomly split. The values of , , and obtained from the KRR and ANN methods are compared to the true values derived from the MSTM method. The performance of both ML methods was studied for BC fractal aggregates with three representative morphologies and coating fractions (Df = 1.5 and fcoating = 0 %; Df = 2.1 and fcoating = 50 %; Df = 2.7 and fcoating = 90 %). There was reasonable agreement between KRR and ANN for all sub-cases. Therefore, the machine learning models appear applicable in a broader context. The model does not overfit with different coating fractions and complex morphologies. The one-to-one comparison results agree with the results from Lamb and Gentine (2023), which also showed reasonable predictions of , , , and across the entire range of size parameters.
![https://acp.copernicus.org/articles/24/8821/2024/acp-24-8821-2024-f04](https://acp.copernicus.org/articles/24/8821/2024/acp-24-8821-2024-f04-thumb.png)
Figure 4Comparison of the predicted optical properties with their true values when the ML models are trained on a random subset of data. The data points for predicted optical properties correspond to KRR and ANN, as shown by the legend on the top right. The blue line in each panel of the figure corresponds to the one-to-one line between the x axis and the y axis.
During their lifetime, BC fractal aggregates undergo complex changes in size, composition, and morphology due to atmospheric processing. Figure 5 shows a visualization of how the ML predictions compare to the MSTM reference for different aging scenarios for BC fractal aggregates. It compares the estimated and true values of the optical properties for the random split. The models trained using a random split of training data generally show a good agreement with the ground truth data over the entire range of Dm. Overall, the KRR predictions are very close to the true values throughout the entire range of Dm for all nine cases in Fig. 5. The ANN predictions slightly deviate from the true value for cases with larger fcoating. For example, in the case of fcoating = 90 % and Df = 1.5, ANN underestimates the . Lamb and Gentine (2023) showed comparatively more deviation in the predictions for larger pure BC fractal particles than smaller particles. In this study, KRR and ANN predictions were consistently good for pure BC fractal particles (first row in Fig. 5), although we could observe deviations from the true values for large and aged coated particle predictions (last row in Fig. 5). Appendix C3 contains plots similar to Fig. 5 for the interpolation and extrapolation split. In general, errors increase with increasing aggregate sizes for the interpolation and extrapolation splits. The ML models we publish are based upon random-split experiments, and Fig. 5 shows how well both the ML methods provide accurate estimates of the optical properties of BC fractal aggregates at each aging stage.
![https://acp.copernicus.org/articles/24/8821/2024/acp-24-8821-2024-f05](https://acp.copernicus.org/articles/24/8821/2024/acp-24-8821-2024-f05-thumb.png)
Figure 5Absorption efficiency (Qabs) at a wavelength of 660 nm predicted using KRR and ANN for nine representative BC aggregates with a variety of morphologies (represented by Df) and coatings (represented by fcoating). Both models were trained on a random split of training data.
Apart from making accurate predictions, our ML models should also be fast to provide a benefit over time-consuming simulations. Hence, we recorded the time needed to train on the entire training dataset and the time to make a single prediction in Table 2. As a result, the prediction time of both algorithms is less than 1 ms, which is a drastic improvement compared to the MSTM method, which can take up to 24 h, depending on the particle. It should be noted that the prediction time for ANN does not depend on the input data. Training the models takes comparatively longer, but it is usually done offline. Therefore, it is irrelevant for users using the pre-trained models we provide for their applications (see section “Code availability”).
Incorporating the fractal morphology of BC in global model calculations is essential, as the BC radiative forcing can increase up to 61 % compared to a more compact and aged particle (Romshoo et al., 2021). In the atmosphere, BC fractal aggregates are primarily found in conjunction with other aerosol types, such as organic carbon. It is therefore more relevant to predict the optical properties of BC fractal aggregates with organic coatings for atmospheric applications. To give an example of applying the ML algorithm to real-world atmospheric research, we predicted the optical properties of laboratory-generated soot for experiments described in Table 1 of our previous study (Romshoo et al., 2022).
The ML-based predictions were compared to the averages of each experimental case, represented by one data point in Fig. 6. The ML results correspond to KRR, the default algorithm used in the prediction script. The details of the laboratory experiments and instrumentations are given in Appendix D. Figure 6a compares the single-scattering albedo () predicted by the ML algorithm with the measured ω from the laboratory experiment. The predictions are in good agreement with the measured results for a range of forganics going up to 55 %. The uncertainty of nearly 10 % in the measured SSA (Weber et al., 2022) is well represented within the 95 % confidence band of the ML-based predictions. On the contrary, Fig. 6b demonstrates that, if the conventionally used Mie core–shell theory is used, the predictions are overestimated by a large margin. The ML predictions of MAC are also compared to the measured MAC and the Mie-based predictions, whose results are given in Fig. D1 of Appendix D. The predictions were found to be less sensitive to the change in Dmob. Due to a lack of monodisperse mass measurements, comparing the predictions and measured values is not so straightforward. However, one can see that the discrepancies in the ML-based predictions of MAC are comparatively lower than the Mie-derived MAC values.
The sensitivity in the predicted MAC and SSA as a function of change in input parameters, such as the Dmob, Df, fcoating, and a, have been extensively discussed by Romshoo et al. (2021, 2023b) and Smith and Grainger (2014). The recommendations given by the above studies have been adapted for obtaining the results in Figs. 6 and D1 and are discussed in detail in Appendix D. For future applications, it is recommended that ambient or laboratory datasets with a resolution of more than 30 min are used to minimize the interference of instrumental uncertainty due to noisy data. Similarly, for ambient or laboratory closure studies, it is recommended that the model output be compared with averaged optical observations.
![https://acp.copernicus.org/articles/24/8821/2024/acp-24-8821-2024-f06](https://acp.copernicus.org/articles/24/8821/2024/acp-24-8821-2024-f06-thumb.png)
Figure 6Single-scattering albedo ω of coated BC particles at varying forganics, generated in a laboratory study using different miniCAST set points (Romshoo et al., 2022). Panel (a) compares the with the measured ω from the laboratory experiment. The colored dots in the figure show the results from the MSTM-based database used for training the ML algorithm. Panel (b) compares the with the measured ω. The ML results correspond to KRR, the default algorithm used in the prediction script. Error bars along the x axis show the uncertainty in the measured ω. The colored dots are the ω from MSTM simulations. The black line represents a linear regression equation shown in the upper-left corner, with the coefficient of determination (R2) in the upper-right corner of each panel. The gray area represents the 95 % confidence level interval for predictions.
Based on the success of the ML-based approach in predicting the optical properties of coated BC particles, it has great potential for future development to predict the optical properties of mixtures of BC and other aerosols. Because such a study would be exhaustive, we initially tested this approach on BC fractal aggregates and organic coatings to determine its effectiveness. Further research is necessary to develop an ML algorithm with features representing different morphological shapes and other chemical compositions, such as inorganics. In the long run, the goal should be to develop an ML algorithm that can be used to integrate all atmospheric aerosols into global climate models. To develop such a universal algorithm for all atmospheric aerosols, we must incorporate the conventional spherically shaped particles into the current prediction algorithm to represent the fraction of aged aerosols. In this study, due to the experimental design of Romshoo et al. (2022), we could only test the ML-based prediction algorithm for particles with forganics of less than 65 %. The extension of the current algorithm to include more parameters also demands closure studies using more datasets of laboratory and ambient measurements.
The experiments conducted for this study show that our ML methods predict the optical properties of BC fractal aggregates with high accuracy as long as they are trained on sufficient data. However, the interpolation and extrapolation experiments show that the performance of both KRR and ANN significantly deteriorates when entirely removing certain ranges from the training data. This suggests that our models possess only limited generalization capabilities. Still, it should be noted that we train the models for practical use on the entire physically feasible range of Df and fcoating. Hence, those models will not have to extrapolate for any reasonable inputs.
Our models treat the wavelength λ as a continuous variable, meaning they should support computing optical properties at wavelengths that are not part of the training data. The prediction script can predict the optical properties well for the range between 467 and 660 and points close to the upper and lower limit. However, we did not test the models' generalization capabilities about the wavelength, since omitting just one wavelength from the training data would reduce the dataset size by one-third. Generating more ground truth data for other wavelengths requires refractive indices of BC and organics for that specific wavelength, which are unavailable in the literature. Even if they were available, it would be time-consuming, as MSTM simulations can take a long time to compute. Nevertheless, examining the models' generalization capabilities on other wavelengths in the future would be interesting.
In this study, the ML-based prediction algorithm is developed using training data of Npp up to 1000, which corresponded to particles with maximum Dmob of 1561 nm depending on the fcoating. This range of particle sizes was chosen while designing the database, considering the realistic size of BC-containing particles in the atmosphere. TEM analysis has shown a high probability that the BC-containing particles less than 1500 nm will be fractal (Adachi et al., 2016; Wang et al., 2017). The ML algorithm developed in this study, which is based on a close-shell coating model, is suitable for such particles smaller than 1500 nm. However, when aerosol particles grow larger, the mass of BC decreases significantly compared to the mass of coating (Adachi et al., 2016). For such cases of aged BC, using the conventional core–shell-based spherical morphology is appropriate. This is why we limited our training data range for particle size to 1561 nm. However, as demonstrated by Luo et al. (2018a), adding a few points in the training data significantly improves the extrapolation efficiency of machine learning models. Furthermore, some studies show that the optical properties are not sensitive to the change in the primary particle size a. Therefore, we fixed the ai to 15 nm and changed ao from 15.1 to 29 depending on the fcoating. Similarly to the parameters related to a particle size such as Npp, ro, and Dm, adding a few data points to the ai or ao can help optimize the extrapolation ability of the ML-based prediction algorithm. Although future studies can extend the model's extrapolation ability, the particle size range of the current prediction algorithm covers the physically feasible cases for BC fractal aggregates.
Both KRR and ANN provide only a single-point prediction for each input. In particular, their estimate does not quantify any uncertainty in the prediction. Bayesian ML methods such as Gaussian process regression (Rasmussen and Williams, 2005) can provide information about the uncertainty of a prediction via credible intervals as they return an entire probability distribution instead of a single-point estimate. Thus, it would be interesting to examine Bayesian ML for the prediction of BC fractal aggregates' optical properties. This method could be further developed for reporting the predictions for an ensemble of BC-containing aerosols with various physicochemical properties. However, applying them directly to our problem is not trivial, since the assumptions made by their statistical model (e.g., target variables follow a multivariate Gaussian distribution) are often violated in practice. Therefore, we leave the application of Bayesian ML to the BC aerosol problem to future work.
Atmospheric BC can exhibit a wide range of morphologies showing diversity at different locations (Sedlacek et al., 2022). It was observed that aged transported soot can retain its fractal morphology 500 to 1000 km downwind of emission sources (Sun et al., 2020). The current state of the art for representing atmospheric soot particles focuses on spherical morphology (Aquila et al., 2011; Stier et al., 2005; Bauer et al., 2008). The model provided in this study was designed to simulate the optical properties for the entire BC life cycle, capturing the transition between fresh fractal and aged spherical particles. Furthermore, the calibration of light-absorption measurement devices is mostly done with fresh soot. We can link to atmospheric-relevant absorption by simulating mass absorption cross-sections and light-absorption enhancement factors. The coating model used in this study is called the “closed-cell model”, and the results showed good comparability with the realistic coating model (Kahnert, 2017). A more sophisticated coating model would be a good choice, but it requires more complex scattering models such as discrete dipole approximation (DDA), which is computationally expensive. With the DDA method, generating elaborate datasets for training ML algorithms is not feasible. We provide a method that predicts the optical properties of a wide range of ambient soot particles with high accuracy. Therefore, the results of this study are valuable for the simulation of realistic scenarios, despite the model limitations. There is scope for future studies to extend such an ML-based approach using other morphological models of BC and coating positions.
The present study demonstrated that the predictions of BC optical properties can be improved by incorporating their realistic morphologies. Unlike the computationally intensive simulations of complex scattering models, the ML-based approach accurately predicts optical properties in fractions of a second. In conjunction with a laboratory dataset, it was shown that optical properties like single-scattering albedo ω and mass absorption cross-section (MAC) can be predicted with greater accuracy than with a Mie-based approach. Using an extensive database for the physicochemical and optical properties of BC fractal aggregates, we trained two ML models – KRR and ANN – that can be used to predict the optical properties of coated BC aggregates at all aging stages. In particular, we could accurately predict the optical properties in the visible spectrum for BC fractal aggregates of any desired size, shape, and fraction of organic coating. Thus, this work illustrates the use of this realistic approach in real-world atmospheric research applications.
We summarize the key conclusions of the study as follows.
-
Active investigation area. BC is a highly relevant and active field of research, as it affects the climate system and human health. Global climate models require information about the optical properties of BC to simulate their radiative forcing. BC research will benefit from using this ML algorithm to generate the optical properties of BC based on more realistic fractal aggregates.
-
Broader application. The ML algorithm can predict the optical properties absorption efficiency, scattering efficiency, and asymmetry parameter for a wide range of BC fractal aggregates with physiochemical properties specified by particle size, morphology, and coating fraction. Previous studies did not consider the critical parameter of coating fraction in their ML models. Therefore, even though we discuss the results in terms of the number of primary particles (Npp), the user is additionally able to specify the particle size in terms of volume equivalent diameter (Rv) or mobility diameter (Dm) depending on the numerical or in situ-based nature of the study. We tested the use of the ML algorithm for predicting the scattering properties of laboratory-generated soot particles and found that it was well in agreement with the measured values.
-
User-friendly. We published a simple Python script that allows users to predict optical properties for BC fractal aggregates using our pre-trained models at GitHub5. The user must specify the physicochemical properties of a BC fractal aggregate as a .csv file, from which the prediction script generates the corresponding optical properties using either KRR or ANN.
-
Low computational and energy costs. Our ML models have a low computational cost, taking fractions of a second to provide the predictions on a run-of-the-mill desktop PC. The same optical properties could take more than 24 h to be generated when using a T-matrix optical model. Using such ML algorithms will thus reduce the energy expenditures associated with running optical models on supercomputers.
-
Citability and reproducibility. The dataset used for developing the ML algorithm is available for download at Zenodo (Romshoo et al., 2023b). Furthermore, the baseline experiments can be reproduced with the code that is openly available on GitHub6.
In summary, we demonstrated the feasibility of incorporating the realistic morphology of BC to improve the predictions of optical properties using a first-of-its-kind machine learning approach. This ML-based approach constitutes a significant step forward in BC aerosol research in two ways: firstly, it is the first attempt to provide optical properties of coated BC fractal aggregates at different stages of atmospheric aging using realistic representations. Secondly, this approach significantly reduces the heavy computational costs of using previous complex scattering models. Previous studies of BC avoid using complex scattering theories because of the high computational costs and prefer the more simplistic Mie theory. This research will be further developed in the future with the final goal of accurately predicting the optical properties of any mixture of atmospheric aerosols. We will investigate if the spherical core–shell model can be combined with the fractal aggregate-based ML model to distribute the weightage of light-absorption predictions for an ensemble of atmospheric BC aerosols with variable aging stages.
A1 Formulae
The volume equivalent radius (r) is defined as the radius of a sphere having the same volume as the BC fractal aggregate, given as
where Npp is the number of primary particles and a is the radius of a single primary particle. The outer volume equivalent radius (ro) was calculated for the whole BC aggregate and for the coating using ao. The inner volume equivalent radius (ri) was calculated using ai for the BC aggregate without the coating, i.e., pure BC.
The mobility diameter of a sphere (Dm) was defined by Sorensen (2001) as
where Npp is the number of primary particles; ao is the radius of a primary particle with coating; and x is the mobility mass scaling exponent given by x=0.51Kn0.043, 0.46 < x < 0.56. Kn is the Knudsen number, which is the ratio of the molecular free path to the agglomerate mobility radius. The error estimated in the mobility mass scaling exponent (x) is ±0.02.
The relationship between the outer radius of the primary particle (ao), the inner radius of the primary particle (ai), and the fraction of organics (forganics) is given as
The geometric cross-section (Cgeo) is the area of the cross-section of the volume equivalent sphere, given as
The optical cross-sections () are defined as the product of efficiency () and geometric cross-section (Cgeo) as
The asymmetry parameter (or asymmetry factor) g is defined as the average cosine of the scattering angle theta θ:
The single-scattering albedo (ω) is derived from the ratio of the scattering efficiency (Qsca) to the extinction efficiency (Qext) as
The total mass absorption cross-section (MACTotal), BC mass absorption cross-section (MACBC), and coating mass absorption cross-section (MACCoating) were calculated from the ratio of (Cabs) with total mass (mTotal), BC mass (mBC), and coating mass (mCoating), respectively, as
A2 Range of features and constants
Table A1Features from the database of physicochemical and optical properties of black carbon fractal aggregates. For independent features, the list of values is provided. The features for which the range has provided correspond to dependent features.
![](https://acp.copernicus.org/articles/24/8821/2024/acp-24-8821-2024-t03-thumb.png)
Table A2Refractive indices (both real and imaginary parts) of BC and organics at various wavelengths in the visible range (Kim et al., 2015).
![](https://acp.copernicus.org/articles/24/8821/2024/acp-24-8821-2024-t04-thumb.png)
Table B2Hyperparameter values for the kernel ridge regression (KRR) experiments along with the optimal value for each parameter.
![](https://acp.copernicus.org/articles/24/8821/2024/acp-24-8821-2024-t06-thumb.png)
Table B3Hyperparameter values for the multi-layer perceptron (MLP) experiments along with the optimal value for each parameter.
![](https://acp.copernicus.org/articles/24/8821/2024/acp-24-8821-2024-t07-thumb.png)
1 https://keras.io/api/layers/activations/#sigmoid-function (last access: 11 July 2024).
2 http://www.cs.toronto.edu/~tijmen/csc321/slides/lecture_slides_lec6.pdf (last access: 11 July 2024).
3 https://keras.io/api/losses/regression_losses/#logcosh-class (last access: 11 July 2024).
C1 Error boxplots
![https://acp.copernicus.org/articles/24/8821/2024/acp-24-8821-2024-f07](https://acp.copernicus.org/articles/24/8821/2024/acp-24-8821-2024-f07-thumb.png)
Figure C1Error between the predicted and true values for three optical properties. The residuals are shown when models are trained on data with different ranges of fractions of coating (fcoating). The residuals for both KRR and ANN predictions are presented in each panel. The lower and upper hinges of the boxplot represent the 25 % and 75 % quantile of the observations, respectively. Note that the outliers significantly reduced the visualization of the boxplots and were therefore omitted from the figures. However, all the outliers are considered in the training data and error evaluation.
Figure C1 shows the residuals for the machine learning methods for the three splits related to the feature fcoating: random, extrapolation (training data ), and interpolation (training data . When the training and testing data are randomly split, we see that residual errors are concentrated near zero for all intervals of fcoating similar to Fig. 3. The errors from KRR and ANN are comparable in the random split. For the case of interpolation split, the errors from both the ANN and KRR models are comparatively higher for all the three optical properties, i.e., Qabs, Qabs, and g. It was noted in the errors from the interpolation split that KRR performs better in predicting the Qabs, whereas ANN performs better in g predictions. The errors in the Qabs, Qabs, and g from the extrapolation split were the highest. The error is largest for the predictions when fcoating = 90, which is the case farthest away from the training data during an extrapolation split. The relative performance of ANN and KRR are comparable to those observed in the interpolation split.
![https://acp.copernicus.org/articles/24/8821/2024/acp-24-8821-2024-f08](https://acp.copernicus.org/articles/24/8821/2024/acp-24-8821-2024-f08-thumb.png)
Figure C2Error between the predicted value (, , ) and the true value for three optical properties for various cases of mobility diameter (Dmob). The lower and upper hinges of the boxplot represent the 25 % and 75 % quantile of the observations, respectively. Note that the outliers significantly reduced the visualization of the boxplots and were therefore omitted from the figures. However, all the outliers are considered in the training data and error evaluation.
C2 Point-wise comparison of predicted and true values
![https://acp.copernicus.org/articles/24/8821/2024/acp-24-8821-2024-f09](https://acp.copernicus.org/articles/24/8821/2024/acp-24-8821-2024-f09-thumb.png)
Figure C3Comparison of the predicted optical properties with their true values for the interpolation split when the ML models are trained on data with boundary fractal dimensions (Df = 1.5, 1.7, 1.9, 2.7, 2.9) and when they are tested on data with inner fractal dimensions (Df = 2.1, 2.3, 2.5).
Figures C3 and C4 compare the machine learning predictions to their true values for the cases where the data were excluded while training the ML model. In Fig. C3, ML predictions were made after removing the intermediate values of the Df feature (i.e., 2.1, 2.3, 2.5) from the training data. It was observed that the predictions fitted well with the true values, especially for the KRR method. However, the predictions fluctuate from the true value Qsca as they approach maximum values above 1. For the predictions , the ML methods ANN and KRR perform slightly differently. In the case of extrapolation split, as shown in Fig. C4, the predictions deviated from their true values for , since the ML models did not see the data. However, we can see that, for Df=2.5 (first row), all the predictions are in better agreement with their true values, since it was present in the training data. The predictions and showed reasonable agreement in the case of Df = 2.7. The predictions for the unseen Df features were observed to be smaller than their true values. The predictions , , and are most inconsistent with their true values when Df = 2.9, which is the case farthest away from the training data. Therefore, it is demonstrated that there is comparatively higher uncertainty for predicting optical properties for features out of the range of the training data. Furthermore, the performance of KRR and ANN varied for different optical properties in such cases of interpolation and extrapolation split. The interpolation split performed better for predicting the optical properties out of the range of the training data. Therefore, adding more data in the training set for boundary values to let them interpolate would result in better predictions.
C3 Line plots showing performance as aggregate size changes
Figure C5 compares the machine learning predictions to their true values for interpolation split. The predictions for the case Df = 2.3 (middle row) showed the highest deviations from the true values, since it is the farthest point in the training data for the interpolation split. From the results, the KRR predictions were reasonable for the entire size range. The predictions for were also reasonable for KRR. However, after the particle size increased to larger than 500 nm, the prediction of using KRR was underpredicted. The prediction of using ANN showed a size-dependent behavior, under-predicting the results for certain particle sizes, after which there is an over-prediction. Similar size-dependent behavior was observed in the predictions from ANN and KRR. The predictions showed deviations from their truevalues as the particle size increased. In the case of interpolation split, the overfitting or underfitting is generally more pronounced in the larger particle size (> 500 nm). The explanation for this could be the lower resolution of the training data for particle size > 500 nm, which was a limitation of large computation time for larger particles and more coating fraction.
![https://acp.copernicus.org/articles/24/8821/2024/acp-24-8821-2024-f11](https://acp.copernicus.org/articles/24/8821/2024/acp-24-8821-2024-f11-thumb.png)
Figure C5Optical properties of BC fractal aggregates predicted using machine learning methods KRR and ANN for the interpolation split when models are trained on data with boundary fractal dimensions (Df = 1.5, 1.7, 1.9, 2.7, 2.9) and when they are tested to see if it fits for the intermediate values of fractal dimensions (Df = 2.1, 2.3, 2.5). The three columns show the predicted values of absorption efficiency (Qabs), scattering efficiency (Qsca), and asymmetry parameter (g). Each row corresponds to the predictions for the intermediate values of fractal dimensions (Df = 2.1, 2.3, 2.5).
Similarly, Fig. C6 shows the machine learning predictions compared to the true values for the extrapolation split. To study the performance of KRR and ANN, the results for Df = 2.9 are interesting, since they are the farthest from the training data. The deviations of the are more from the true values in the case of KRR, which showed better performance in the interpolation split. However, the results for Df = 2.5 and Df = 2.7 show reasonable results, since they are closer to the training dataset. The predictions were lower than the true values for ANN, especially as the particle size increased. The prediction was larger than its true value in the case of the extrapolation split. However, the performance of predicting from KRR showed an interesting size dependence over particle size unique to this split. When particle sizes were smaller, was higher than the true value, decreased, and returned to higher levels once a certain threshold was reached. In general, for the results when the fcoating is 90, which is the upper limit of the feature, the results for , , and showed an expected higher deviation from their true values for both the interpolation split and the extrapolation split.
![https://acp.copernicus.org/articles/24/8821/2024/acp-24-8821-2024-f12](https://acp.copernicus.org/articles/24/8821/2024/acp-24-8821-2024-f12-thumb.png)
Figure C6Optical properties of BC fractal aggregates predicted using machine learning methods KRR and ANN for the extrapolation split when models are trained on data with smaller fractal dimensions (Df = 1.5, 1.7, 1.9, 2.1, 2.3) and when they are tested on data with higher fractal dimensions (Df = 2.5, 2.7, 2.9). The three columns show the predicted values of absorption efficiency (Qabs), scattering efficiency (Qsca), and asymmetry parameter(g). Each row corresponds to the predictions for the higher fractal dimensions that are left out (Df = 2.5, 2.7, 2.9).
The data from the laboratory experiments by Romshoo et al. (2022) are compared to the ML-based prediction model in Figs. 6 and D1. A mobility particle size spectrometer (MPSS; designed by the Leibniz Institute for Tropospheric Research (TROPOS)) measured the particle number size distribution of the black carbon particles. A cavity-attenuated phase-shift extinction monitor (CAPS PMex 630, Aerodyne Res. Inc., USA) measured the light extinction coefficient, σext, at a λ of 630 nm. The particle light-scattering coefficient σsca was measured using a nephelometer (Aurora 4000, Ecotech, Melbourne, Australia) at a λ of 635 nm. A multi-angle absorption photometer (MAAP; Model 5012, Thermo Scientific, Franklin, MA) measured the particle light-scattering coefficient, σabs, at a λ of 637 nm. The aerosol mass concentration for selected experiments was determined using the tapered element oscillating microbalance (1405 TEOM, Thermo Scientific, Franklin, MA). Aerosols were collected on quartz fiber filters and were analyzed by an EC–OC analyzer (Sunset Laboratory Inc., Hillsborough, USA).
The input parameters used while running the prediction script are λ, Df, fcoating, and Dm. The parameter of Dm was chosen for particle size due to the MPSS measurements available in the experiment. A Df value of 1.7 was taken, as it represents laboratory-generated soot (Wentzel et al., 2003). The default ai value of 15 nm was used. Numerical studies have also investigated the sensitivity to input parameters like a, Df, and fcoating to modeled optical properties (Romshoo et al., 2022; Luo et al., 2018b; Smith and Grainger, 2014). For example, Romshoo et al. (2022) recommended Df from 1.7 to 1.9 and a between 10 and 14 nm for laboratory-generated soot. The values of fcoating for each experiment were derived from the EC–OC analysis results of the quartz fiber filters. The mean of the number size distribution measured by the MPSS was used as the input value for Dm. There were 11 sub-cases of the laboratory experiment for which the means of Dm and fcoating were taken as input. The input parameters for the Mie core–shell theory were λ, fcoating, and Dm.
![https://acp.copernicus.org/articles/24/8821/2024/acp-24-8821-2024-f13](https://acp.copernicus.org/articles/24/8821/2024/acp-24-8821-2024-f13-thumb.png)
Figure D1Mass absorption cross-section (MAC) for coated BC particles generated in a laboratory study at different Dmob (Romshoo et al., 2022). Panel (a) compares the with the measured MAC from the laboratory experiment. Panel (b) compares the with the measured MAC. The number of points used in this figure is less than in Fig. 6, as some of the data were excluded due to the uncertainties associated with the tapered element oscillating microbalance (TEOM) instrument.
The output parameters compared to the observations were SSA and MAC. The observational SSA was calculated from the ratio of σsca and σext. The observational MAC was calculated from the σabs and mass using Eq. (A8). The predicted SSA is compared to all 11 experimental cases for which the observational SSA was available (Table 1 in Romshoo et al., 2022). The uncertainty in the measured SSA is nearly 10 % (Weber et al., 2022). The uncertainties in the SSA are included in the 95 % confidence band of the ML-based predictions. The predicted MAC is compared to the 6 experimental cases of coated soot for which the observational MAC was available (last six rows in Table 1 in Romshoo et al., 2022).
A Python script that predicts the optical properties of BC fractal aggregates using the trained ML-based models is available in a GitHub repository at https://doi.org/10.5281/zenodo.8060206 (Romshoo et al., 2023d). To run the prediction script, the physiochemical properties need to be provided as a .csv file that contains the fractal dimension Df, the fraction of coating fcoating, and the wavelength (λ) at which the optical properties should be calculated. Depending on the relevance, users may specify the particle size by giving the values of one among the number of primary particles (Npp), the mobility diameter (Dm), or the outer volume equivalent radii (ro). If the input parameters are obtained from instrumental measurements, taking hourly or half-hourly averages is recommended to cancel the effect of noisy input parameters. The prediction script will generate a .csv file with the corresponding optical properties for the provided physiochemical properties. Please check the README file inside the repository for more detailed information on using the script.
The dataset of simulated physiochemical and optical properties that we describe in Sect. 2 is available at https://doi.org/10.5281/zenodo.7523058 (Romshoo et al., 2023b). In case they want to reproduce any of the results in this work, readers may find the entire source code that we used to perform the ML-based experiments and generate figures included in this work at https://doi.org/10.5281/zenodo.8071901 (Romshoo et al., 2023c).
The supplement related to this article is available online at: https://doi.org/10.5194/acp-24-8821-2024-supplement.
The study was designed by BR, ThM, JP, ToM, MP, and MK. BR and ThM developed the optical simulations and database. The machine learning experiments were conducted by JP and ToM, with help from BR and ThM. The results were prepared by JP and ToM, with help from BR. The paper was written by BR, JP, and ToM. The paper was reviewed, commented on, and edited by ThM, MK, and MP.
The contact author has declared that none of the authors has any competing interests.
Publisher’s note: Copernicus Publications remains neutral with regard to jurisdictional claims made in the text, published maps, institutional affiliations, or any other geographical representation in this paper. While Copernicus Publications makes every effort to include appropriate place names, the final responsibility lies with the authors.
We would like to thank the members of the EMPIR 16ENV02 Black Carbon project for their support and feedback. Marius Kloft acknowledges support by the Carl Zeiss Foundation; the DFG awards KL 2698/2-1, KL 2698/5-1, KL 2698/6-1, and KL 2698/7-1; and the BMBF awards 03|B0770E and 01|S21010C.
This research has been supported by the European Metrology Programme for Innovation and Research (EMPIR; grant no. 16ENV02 Black Carbon).
This paper was edited by Joshua Fu and reviewed by two anonymous referees.
Adachi, K., Chung, S. H., and Buseck, P. R.: Shapes of soot aerosol particles and implications for their effects on climate, J. Geophys. Res.-Atmos., 115, D15206, https://doi.org/10.1029/2009JD012868, 2010. a
Adachi, K., Moteki, N., Kondo, Y., and Igarashi, Y.: Mixing states of light-absorbing particles measured using a transmission electron microscope and a single-particle soot photometer in Tokyo, Japan, J. Geophys. Res.-Atmos., 121, 9153–9164, https://doi.org/10.1002/2016JD025153, 2016. a, b
Aquila, V., Hendricks, J., Lauer, A., Riemer, N., Vogel, H., Baumgardner, D., Minikin, A., Petzold, A., Schwarz, J. P., Spackman, J. R., Weinzierl, B., Righi, M., and Dall'Amico, M.: MADE-in: a new aerosol microphysics submodel for global simulation of insoluble particles and their mixing state, Geosci. Model Dev., 4, 325–355, https://doi.org/10.5194/gmd-4-325-2011, 2011. a
Bambha, R. P., Dansson, M. A., Schrader, P. E., and Michelsen, H. A.: Effects of volatile coatings on the laser-induced incandescence of soot, Appl. Phys. B, 112, 343–358, https://doi.org/10.1007/s00340-013-5463-9, 2013. a
Bauer, S. E., Wright, D. L., Koch, D., Lewis, E. R., McGraw, R., Chang, L.-S., Schwartz, S. E., and Ruedy, R.: MATRIX (Multiconfiguration Aerosol TRacker of mIXing state): an aerosol microphysical module for global atmospheric models, Atmos. Chem. Phys., 8, 6003–6035, https://doi.org/10.5194/acp-8-6003-2008, 2008. a
Bescond, A., Yon, J., Ouf, F. X., Ferry, D., Delhaye, D., Gaffié, D., Coppalle, A., and Rozé, C.: Automated Determination of Aggregate Primary Particle Size Distribution by TEM Image Analysis: Application to Soot, Aerosol Sci. Tech., 48, 831–841, https://doi.org/10.1080/02786826.2014.932896, 2014. a
Bhandari, J., China, S., Chandrakar, K. K., Kinney, G., Cantrell, W., Shaw, R. A., Mazzoleni, L. R., Girotto, G., Sharma, N., Gorkowski, K., Gilardoni, S., Decesari, S., Facchini, M. C., Zanca, N., Pavese, G., Esposito, F., Dubey, M. K., Aiken, A. C., Chakrabarty, R. K., Moosmüller, H., Onasch, T. B., Zaveri, R. A., Scarnato, B. V., Fialho, P., and Mazzoleni, C.: Extensive Soot Compaction by Cloud Processing from Laboratory and Field Observations, Scientific Rep.-UK, 9, 11824, https://doi.org/10.1038/s41598-019-48143-y, 2019. a
Bohren, C. F. and Huffman, D. R.: Absorption and scattering of light by small particles, John Wiley & Sons, https://doi.org/10.1002/9783527618156, ISBN: 9783527618156, 2008. a
Bond, T. C., Doherty, S. J., Fahey, D. W., Forster, P. M., Berntsen, T., DeAngelo, B. J., Flanner, M. G., Ghan, S., Kärcher, B., Koch, D., Kinne, S., Kondo, Y., Quinn, P. K., Sarofim, M. C., Schultz, M. G., Schulz, M., Venkataraman, C., Zhang, H., Zhang, S., Bellouin, N., Guttikunda, S. K., Hopke, P. K., Jacobson, M. Z., Kaiser, J. W., Klimont, Z., Lohmann, U., Schwarz, J. P., Shindell, D., Storelvmo, T., Warren, S. G., and Zender, C. S.: Bounding the role of black carbon in the climate system: A scientific assessment, J. Geophys. Res.-Atmos., 118, 5380–5552, https://doi.org/10.1002/jgrd.50171, 2013. a, b
Bottou, L., Curtis, F. E., and Nocedal, J.: Optimization Methods for Large-Scale Machine Learning, SIAM Rev., 60, 223–311, https://doi.org/10.1137/16M1080173, 2018. a
Box, G. E. P. and Cox, D. R.: An Analysis of Transformations, J. Roy. Stat. Soc. B, 26, 211–252, http://www.jstor.org/stable/2984418 (last access: 11 July 2024), 1964. a
Chakrabarty, R. K., Moosmüller, H., Garro, M. A., Arnott, W. P., Walker, J., Susott, R. A., Babbitt, R. E., Wold, C. E., Lincoln, E. N., and Hao, W. M.: Emissions from the laboratory combustion of wildland fuels: Particle morphology and size, J. Geophys. Res.-Atmos., 111, D07204, https://doi.org/10.1029/2005JD006659, 2006. a, b
Clevert, D., Unterthiner, T., and Hochreiter, S.: Fast and Accurate Deep Network Learning by Exponential Linear Units (ELUs), arXiv [preprint], https://doi.org/10.48550/arXiv.1511.07289, 22 February 2016. a
Corbin, J. C., Modini, R. L., and Gysel-Beer, M.: Mechanisms of soot-aggregate restructuring and compaction, Aerosol Sci. Tech., 57, 89–111, https://doi.org/10.1080/02786826.2022.2137385, 2023. a
Cortes, C. and Vapnik, V.: Support-vector networks, Mach. Learn., 20, 273–297, https://doi.org/10.1007/BF00994018, 1995. a
Coz, E. and Leck, C.: Morphology and state of mixture of atmospheric soot aggregates during the winter season over Southern Asia-a quantitative approach, Tellus B, 63, 107–116, https://doi.org/10.1111/j.1600-0889.2010.00513.x, 2011. a
Flagan, R.: Electrical techniques, Aerosol Measurement: Principles, Techniques, and Applications, 537–568, https://doi.org/10.1002/9781118001684, ISBN: 9781118001684, 2001. a
Fu, H., Zhang, M., Li, W., Chen, J., Wang, L., Quan, X., and Wang, W.: Morphology, composition and mixing state of individual carbonaceous aerosol in urban Shanghai, Atmos. Chem. Phys., 12, 693–707, https://doi.org/10.5194/acp-12-693-2012, 2012. a
Gentner, D. R., Jathar, S. H., Gordon, T. D., Bahreini, R., Day, D. A., El Haddad, I., Hayes, P. L., Pieber, S. M., Platt, S. M., de Gouw, J., Goldstein, A. H., Harley, R. A., Jimenez, J. L., Prévôt, A. S. H., and Robinson, A. L.: Review of Urban Secondary Organic Aerosol Formation from Gasoline and Diesel Motor Vehicle Emissions, Environ. Sci. Technol., 51, 1074–1093, https://doi.org/10.1021/acs.est.6b04509, 2017. a
Guarieiro, A. L. N., Eiguren-Fernandez, A., da Rocha, G. O., and de Andrade, J. B.: An investigation on morphology and fractal dimension of diesel and diesel-biodiesel soot agglomerates, J. Brazil. Chem. Soc., 28, 1351–1362, 2017. a
Huber, P. J.: Robust Estimation of a Location Parameter, Ann. Math. Stat., 35, 73–101, https://doi.org/10.1214/aoms/1177703732, 1964. a
Jacobson, M. Z.: Strong radiative heating due to the mixing state of black carbon in atmospheric aerosols, Nature, 409, 695–697, https://doi.org/10.1038/35055518, 2001. a, b
Kahnert, M.: On the Discrepancy between Modeled and Measured Mass Absorption Cross Sections of Light Absorbing Carbon Aerosols, Aerosol Sci. Tech., 44, 453–460, https://doi.org/10.1080/02786821003733834, 2010a. a
Kahnert, M.: Numerically exact computation of the optical properties of light absorbing carbon aggregates for wavelength of 200 nm–12.2 µm, Atmos. Chem. Phys., 10, 8319–8329, https://doi.org/10.5194/acp-10-8319-2010, 2010b. a
Kahnert, M.: Optical properties of black carbon aerosols encapsulated in a shell of sulfate: comparison of the closed cell model with a coated aggregate model, Opt. Express, 25, 24579–24593, https://doi.org/10.1364/OE.25.024579, 2017. a, b
Kahnert, M. and Kanngießer, F.: Modelling optical properties of atmospheric black carbon aerosols, J. Quant. Spectrosc. Ra., 244, 106849, https://doi.org/10.1016/j.jqsrt.2020.106849, 2020. a, b
Kim, J., Bauer, H., Dobovičnik, T., Hitzenberger, R., Lottin, D., Ferry, D., and Petzold, A.: Assessing Optical Properties and Refractive Index of Combustion Aerosol Particles Through Combined Experimental and Modeling Studies, Aerosol Sci. Tech., 49, 340–350, https://doi.org/10.1080/02786826.2015.1020996, 2015. a, b
Kingma, D. P. and Ba, J.: Adam: A Method for Stochastic Optimization, arXiv [preprint], https://doi.org/10.48550/arXiv.1412.6980, 30 January 2015. a
Lamb, K. D. and Gentine, P.: Zero-shot learning of aerosol optical properties with graph neural networks, Sci. Rep.-UK, 13, 18777, https://doi.org/10.1038/s41598-023-45235-8, 2023. a, b, c, d, e, f, g
Liati, A., Brem, B. T., Durdina, L., Vögtli, M., Arroyo Rojas Dasilva, Y., Dimopoulos Eggenschwiler, P., and Wang, J.: Electron Microscopic Study of Soot Particulate Matter Emissions from Aircraft Turbine Engines, Environ. Sci. Technol., 48, 10975–10983, https://doi.org/10.1021/es501809b, 2014. a
Liu, C., Yin, Y., Hu, F., Jin, H., and Sorensen, C. M.: The Effects of Monomer Size Distribution on the Radiative Properties of Black Carbon Aggregates, Aerosol Sci. Tech., 49, 928–940, https://doi.org/10.1080/02786826.2015.1085953, 2015. a
Liu, C., Xu, X., Yin, Y., Schnaiter, M., and Yung, Y. L.: Black carbon aggregates: A database for optical properties, J. Quant. Spectrosc. Ra., 222–223, 170–179, https://doi.org/10.1016/j.jqsrt.2018.10.021, 2019. a
Liu, L. and Mishchenko, M. I.: Scattering and Radiative Properties of Morphologically Complex Carbonaceous Aerosols: A Systematic Modeling Study, Remote Sens., 10, 1634, https://doi.org/10.3390/rs10101634, 2018. a
Luo, J., Zhang, Y., Wang, F., Wang, J., and Zhang, Q.: Applying machine learning to estimate the optical properties of black carbon fractal aggregates, J. Quant. Spectrosc. Ra., 215, 1–8, https://doi.org/10.1016/j.jqsrt.2018.05.002, 2018a. a, b, c, d, e, f, g
Luo, J., Zhang, Y., Zhang, Q., Wang, F., Liu, J., and Wang, J.: Sensitivity analysis of morphology on radiative properties of soot aerosols, Opt. Express, 26, A420–A432, https://doi.org/10.1364/OE.26.00A420, 2018b. a
Maas, A. L., Hannun, A. Y., and Ng, A. Y.: Rectifier nonlinearities improve neural network acoustic models, in: Proceedings of the 30th International Conference on Machine Learning, edited by: Dasgupta, S. and McAllester, D., Proceedings of Machine Learning Research, PMLR, Atlanta, Georgia, USA, 28, 6 pp., 2013. a
Mackowski, D. W.: A multiple sphere T-matrix Fortran code for use on parallel computer clusters, Version 3.0, https://www.eng.auburn.edu/~dmckwski/scatcodes/ (last access: 5 July 2022), 2013. a
Mackowski, D. W. and Mishchenko, M. I.: A multiple sphere T-matrix Fortran code for use on parallel computer clusters, J. Quant. Spectrosc. Ra., 112, 2182–2192, https://doi.org/10.1016/j.jqsrt.2011.02.019, 2011. a
Matsui, H., Hamilton, D. S., and Mahowald, N. M.: Black carbon radiative effects highly sensitive to emitted particle size when resolving mixing-state diversity, Nat. Commun., 9, 3446, https://doi.org/10.1038/s41467-018-05635-1, 2018. a
Mie, G.: Considerations on the optics of turbid media, especially colloidal metal solutions, Ann. Phys.-Berlin, 25, 377–442, 1908. a
Mishchenko, M. I., Travis, L. D., and Mackowski, D. W.: T-matrix computations of light scattering by nonspherical particles: A review, J. Quant. Spectrosc. Ra., 55, 535–575, https://doi.org/10.1016/0022-4073(96)00002-7, 1996. a
Mishchenko, M. I., Travis, L. D., and Lacis, A. A.: Scattering, absorption, and emission of light by small particles, Cambridge University Press, ISBN: 9780521782524, 2002. a
Mishchenko, M. I., Liu, L., Travis, L. D., and Lacis, A. A.: Scattering and radiative properties of semi-external versus external mixtures of different aerosol types, J. Quant. Spectrosc. Ra., 88, 139–147, https://doi.org/10.1016/j.jqsrt.2003.12.032, 2004. a
Park, K., Kittelson, D. B., and McMurry, P. H.: Structural Properties of Diesel Exhaust Particles Measured by Transmission Electron Microscopy (TEM): Relationships to Particle Mass and Mobility, Aerosol Sci. Tech., 38, 881–889, https://doi.org/10.1080/027868290505189, 2004. a
Purcell, E. M. and Pennypacker, C. R.: Scattering and absorption of light by nonspherical dielectric grains, Astrophys. J., 186, 705–714, 1973. a
Radford, A., Kim, J. W., Hallacy, C., Ramesh, A., Goh, G., Agarwal, S., Sastry, G., Askell, A., Mishkin, P., Clark, J., Krueger, G., and Sutskever, I.: Learning Transferable Visual Models From Natural Language Supervision, in: Proceedings of the 38th International Conference on Machine Learning, edited by: Meila, M. and Zhang, T., Proceedings of Machine Learning Research (PMLR), 139, 8748–8763, https://proceedings.mlr.press/v139/radford21a.html (last access: 11 July 2024), 2021. a
Ramanathan, V. and Carmichael, G.: Global and regional climate changes due to black carbon, Nat. Geosci., 1, 221–227, https://doi.org/10.1038/ngeo156, 2008. a
Ramesh, A., Dhariwal, P., Nichol, A., Chu, C., and Chen, M.: Hierarchical text-conditional image generation with clip latents, arXiv [preprint], https://doi.org/10.48550/arXiv.2204.06125, 13 April 2022. a
Rasmussen, C. E. and Williams, C. K. I.: Gaussian Processes for Machine Learning, The MIT Press, https://doi.org/10.7551/mitpress/3206.001.0001, ISBN 9780262256834, 2005. a
Romshoo, B., Müller, T., Pfeifer, S., Saturno, J., Nowak, A., Ciupek, K., Quincey, P., and Wiedensohler, A.: Optical properties of coated black carbon aggregates: numerical simulations, radiative forcing estimates, and size-resolved parameterization scheme, Atmos. Chem. Phys., 21, 12989–13010, https://doi.org/10.5194/acp-21-12989-2021, 2021. a, b, c, d, e
Romshoo, B., Pöhlker, M., Wiedensohler, A., Pfeifer, S., Saturno, J., Nowak, A., Ciupek, K., Quincey, P., Vasilatou, K., Ess, M. N., Gini, M., Eleftheriadis, K., Robins, C., Gaie-Levrel, F., and Müller, T.: Importance of size representation and morphology in modelling optical properties of black carbon: comparison between laboratory measurements and model simulations, Atmos. Meas. Tech., 15, 6965–6989, https://doi.org/10.5194/amt-15-6965-2022, 2022. a, b, c, d, e, f, g, h, i, j
Romshoo, B., Bhat, M. A., and Habib, G.: Black carbon in contrasting environments in India: Temporal variability, source apportionment and radiative forcing, Atmos. Environ., 302, 119734, https://doi.org/10.1016/j.atmosenv.2023.119734, 2023a. a
Romshoo, B., Patil, J., Michels, T., Müller, T., Kloft, M., and Pöhlker, M.: Database of physicochemical and optical properties of black carbon fractal aggregates, Zenodo [data set], https://doi.org/10.5281/zenodo.7523058, 2023b. a, b, c
Romshoo, B., Patil, J., Michels, T., Müller, T., Kloft, M., and Pöhlker, M.: jaikrishnap/Optical-properties-of-black-carbon-aggregates: Initial release, Zenodo [code], https://doi.org/10.5281/zenodo.8071901, 2023c. a
Romshoo, B., Patil, J., Michels, T., Müller, T., Kloft, M., and Pöhlker, M.: jaikrishnap/Machine-learning-for-prediction-of-BCFAs: Initial release, Zenodo [code], https://doi.org/10.5281/zenodo.8060206, 2023d. a
Romshoo, B., Müller, T., Ahlawat, A., Wiedensohler, A., Haneef, M. V., Imran, M., Warsi, A. B., Mandariya, A. K., Habib, G., and Pöhlker, M. L.: Significant contribution of fractal morphology to aerosol light absorption in polluted environments dominated by black carbon (BC), npj Climate and Atmospheric Science, 7, 87, https://doi.org/10.1038/s41612-024-00634-0, 2024. a
Rosenblatt, F.: The perceptron: a probabilistic model for information storage and organization in the brain, Psychol. Rev., 65, 386–408, https://doi.org/10.1037/h0042519, 1958. a
Schkolnik, G., Chand, D., Hoffer, A., Andreae, M., Erlick, C., Swietlicki, E., and Rudich, Y.: Constraining the density and complex refractive index of elemental and organic carbon in biomass burning aerosol using optical and chemical measurements, Atmos. Environ., 41, 1107–1118, https://doi.org/10.1016/j.atmosenv.2006.09.035, 2007. a
Sedlacek III, A. J., Lewis, E. R., Onasch, T. B., Zuidema, P., Redemann, J., Jaffe, D., and Kleinman, L. I.: Using the Black Carbon Particle Mixing State to Characterize the Lifecycle of Biomass Burning Aerosols, Environ. Sci. Technol., 56, 14315–14325, https://doi.org/10.1021/acs.est.2c03851, 2022. a, b
Shawe-Taylor, J. and Cristianini, N.: Kernel Methods for Pattern Analysis, Cambridge University Press, https://doi.org/10.1017/CBO9780511809682, 2004. a
Smith, A. J. A. and Grainger, R. G.: Simplifying the calculation of light scattering properties for black carbon fractal aggregates, Atmos. Chem. Phys., 14, 7825–7836, https://doi.org/10.5194/acp-14-7825-2014, 2014. a, b
Sorensen, C. M.: Light Scattering by Fractal Aggregates: A Review, Aerosol Sci. Tech., 35, 648–687, https://doi.org/10.1080/02786820117868, 2001. a, b
Sorensen, C. M.: The Mobility of Fractal Aggregates: A Review, Aerosol Sci. Tech., 45, 765–779, https://doi.org/10.1080/02786826.2011.560909, 2011. a
Stier, P., Feichter, J., Kinne, S., Kloster, S., Vignati, E., Wilson, J., Ganzeveld, L., Tegen, I., Werner, M., Balkanski, Y., Schulz, M., Boucher, O., Minikin, A., and Petzold, A.: The aerosol-climate model ECHAM5-HAM, Atmos. Chem. Phys., 5, 1125–1156, https://doi.org/10.5194/acp-5-1125-2005, 2005. a
Sun, C., Adachi, K., Misawa, K., Cheung, H. C., Chou, C. C.-K., and Takegawa, N.: Mixing State of Black Carbon Particles in Asian Outflow Observed at a Remote Site in Taiwan in the Spring of 2017, J. Geophys. Res.-Atmos., 125, e2020JD032526, https://doi.org/10.1029/2020JD032526, 2020. a
Sun, J., Sun, Y., Xie, C., Xu, W., Chen, C., Wang, Z., Li, L., Du, X., Huang, F., Li, Y., Li, Z., Pan, X., Ma, N., Xu, W., Fu, P., and Wang, Z.: The chemical composition and mixing state of BC-containing particles and the implications on light absorption enhancement, Atmos. Chem. Phys., 22, 7619–7630, https://doi.org/10.5194/acp-22-7619-2022, 2022. a
Wang, Y., Liu, F., He, C., Bi, L., Cheng, T., Wang, Z., Zhang, H., Zhang, X., Shi, Z., and Li, W.: Fractal Dimensions and Mixing Structures of Soot Particles during Atmospheric Processing, Environ. Sci. Tech. Let., 4, 487–493, https://doi.org/10.1021/acs.estlett.7b00418, 2017. a, b
Weber, P., Petzold, A., Bischof, O. F., Fischer, B., Berg, M., Freedman, A., Onasch, T. B., and Bundke, U.: Relative errors in derived multi-wavelength intensive aerosol optical properties using cavity attenuated phase shift single-scattering albedo monitors, a nephelometer, and tricolour absorption photometer measurements, Atmos. Meas. Tech., 15, 3279–3296, https://doi.org/10.5194/amt-15-3279-2022, 2022. a, b
Wentzel, M., Gorzawski, H., Naumann, K.-H., Saathoff, H., and Weinbruch, S.: Transmission electron microscopical and aerosol dynamical characterization of soot aerosols, J. Aerosol Sci., 34, 1347–1370, https://doi.org/10.1016/S0021-8502(03)00360-4, 2003. a, b
Wozniak, M., Onofri, F., Barbosa, S., Yon, J., and Mroczka, J.: Comparison of methods to derive morphological parameters of multi-fractal samples of particle aggregates from TEM images, J. Aerosol Sci., 47, 12–26, https://doi.org/10.1016/j.jaerosci.2011.12.008, 2012. a
Wu, Y., Cheng, T., Liu, D., Allan, J. D., Zheng, L., and Chen, H.: Light Absorption Enhancement of Black Carbon Aerosol Constrained by Particle Morphology, Environ. Sci. Technol., 52, 6912–6919, https://doi.org/10.1021/acs.est.8b00636, 2018. a, b
Xu, Y.-L. and Gustafson, B. R.: A generalized multiparticle Mie-solution: further experimental verification, J. Quant. Spectrosc. Ra., 70, 395–419, https://doi.org/10.1016/S0022-4073(01)00019-X, 2001. a
Yurkin, M. A. and Kahnert, M.: Light scattering by a cube: Accuracy limits of the discrete dipole approximation and the T-matrix method, J. Quant. Spectrosc. Ra., 123, 176–183, https://doi.org/10.1016/j.jqsrt.2012.10.001, 2013. a
https://zenodo.org/records/7523058 (last access: 23 January 2024)
https://github.com/jaikrishnap/Machine-learning-for- prediction-of-BCFAs (last access: 11 July 2024)
https://scikit-learn.org/stable/modules/generated/sklearn.kernel_ridge.KernelRidge.html (last access: 15 October 2024)
https://keras.io/ (last access: 15 October 2024)
https://github.com/jaikrishnap/Machine-learning-for- prediction-of-BCFAs (last access: 11 July 2024)
https://github.com/jaikrishnap/Optical-properties-of-black- carbon-aggregates (last access: 11 July 2024)
- Abstract
- Introduction
- Database of physicochemical and optical properties of black carbon fractal aggregates
- Machine learning method for predicting optical properties of BC fractal aggregates
- Performance of the machine learning models
- Comparison to black carbon laboratory measurements
- Limitations and future challenges
- Conclusions
- Appendix A: Details about the physiochemical and optical properties of BC fractal aggregates
- Appendix B: Details about the machine learning methods
- Appendix C: Additional figures
- Appendix D: Laboratory measurements of black carbon
- Code availability
- Data availability
- Author contributions
- Competing interests
- Disclaimer
- Acknowledgements
- Financial support
- Review statement
- References
- Supplement
Through the use of our machine-learning-based optical model, realistic BC morphologies can be incorporated into atmospheric science applications that require highly accurate results with minimal computational resources. The results of the study demonstrate that the predictions of single-scattering albedo (ω) and mass absorption cross-section (MAC) were improved over the conventional Mie-based predictions when using the machine learning method.
Through the use of our machine-learning-based optical model, realistic BC morphologies can be...
- Abstract
- Introduction
- Database of physicochemical and optical properties of black carbon fractal aggregates
- Machine learning method for predicting optical properties of BC fractal aggregates
- Performance of the machine learning models
- Comparison to black carbon laboratory measurements
- Limitations and future challenges
- Conclusions
- Appendix A: Details about the physiochemical and optical properties of BC fractal aggregates
- Appendix B: Details about the machine learning methods
- Appendix C: Additional figures
- Appendix D: Laboratory measurements of black carbon
- Code availability
- Data availability
- Author contributions
- Competing interests
- Disclaimer
- Acknowledgements
- Financial support
- Review statement
- References
- Supplement