1 s2.0 S0378112721005867 Main

You might also like

Download as pdf or txt
Download as pdf or txt
You are on page 1of 8

Forest Ecology and Management 497 (2021) 119496

Contents lists available at ScienceDirect

Forest Ecology and Management


journal homepage: www.elsevier.com/locate/foreco

Eucalyptus growth recognition using machine learning methods and


spectral variables
Bruno Rodrigues de Oliveira a, *, Arlindo Ananias Pereira da Silva b,
Larissa Pereira Ribeiro Teodoro a, Gileno Brito de Azevedo a,
Glauce Taís de Oliveira Sousa Azevedo a, Fábio Henrique Rojo Baio a, Renato Lustosa Sobrinho d,
Carlos Antonio da Silva Junior c, Paulo Eduardo Teodoro a, b
a
Universidade Federal de Mato Grosso do Sul (UFMS), Rodovia MS 306, Km. 305, 79560-000 Chapadão do Sul, MS, Brazil
b
Universidade Estadual Paulista (UNESP), Av. Brasil Sul, 56 – Centro, 15385-000 Ilha Solteira, SP, Brazil
c
Department of Geography, Universidade Estadual de Mato Grosso (UNEMAT), Av. dos Ingas, 3001, Jardim Imperial, 78555-000 Sinop, MT, Brazil
d
Universidade Tecnológica Federal do Paraná (UTFPR), Via do Conhecimento – Km 01, Pato Branco, PR, Brazil

A R T I C L E I N F O A B S T R A C T

Keywords: Growth and production models can help to simulate the growth of tree dimensions to predict forest productivity
Random forest at different levels. In this context, the following questions arise: (i) is it possible to recognize the growth pattern
Classification of eucalyptus species based on spectral features using machine learning (ML) for data modeling? (ii) what
Vegetation index
spectral features provides better accuracy? and (iii) what ML algorithms are most accurate for performing this
modeling? To answer these questions, the present study evaluated the use of ML techniques using breast height
and total plant height to classify the growth of five species of eucalyptus and Corymbria citriodora in an unsu­
pervised learning, and the obtained classes for induce ML algorithms to recognize the species with relation to
their growth using vegetation indices (VIs) and spectral bands (SBs). It were evaluated five eucalyptus species
(E. camaldulensis, E. uroplylla, E. saligna, E. grandis e E. urograndis) and C. citriodora in experimental design of
randomized blocks with four replicates, with 20 plants inside each experimental plot. The diameter at breast
height and total plant height at stand level were obtained by measuring five trees in each experimental unit in
seven measurements. During this same period, a flight was carried out using a remotely piloted aircraft for the
acquisition of spectral variables (SBs and VIs). For recognition of eucalyptus species in relation to their growth
two machine learning approaches were employed: supervised and unsupervised. The average accuracy obtained
from 10-fold cross-validation, employing Random Forest algorithm and 24 features, was 0.76. This result shows
that the proposed approach is appropriate to recognize different eucalyptus species based on their growth.

1. Introduction plasticity, in addition to presenting high growth rates and satisfactory


wood density (Viera et al., 2016).
Clonal eucalyptus forestry is among the most productive forest crops The productivity and quality of the wood of eucalyptus cultivated in
in the world (Binkley et al., 2017; Campoe et al., 2020; Elli et al., 2020a, Brazil are the result of a continuous work of genetic improvement pro­
b). Brazil is the main world producer, housing one third of the planted grams and improvement of silvicultural practices (Butler et al., 2018;
area, with an average productivity of 41 m3 ha− 1 year− 1 (Vahl de Paula Collevatti et al., 2019). Eucalyptus growth is affected by climatic, ge­
et al., 2020). Eucalyptus stands out on the world stage supplying raw netic and management factors (Binkley et al., 2020; Elli et al., 2017,
material for paper, wood, firewood, coal and biofuels (Rocha et al., 2019; Scolforo et al., 2017, 2019) and for high levels of productivity,
2020). This genus is widely planted in tropical and subtropical regions, investments in genetic selection, soil preparation, fertilization, control
presenting good environmental adaptation due to its phenotypic of pests, diseases and competing vegetation are necessary (Silva et al.,

* Corresponding author.
E-mail addresses: bruno@editorapantanal.com.br (B.R. de Oliveira), arlindo.ananias@unesp.br (A.A.P. da Silva), larissa_ribeiro@ufms.br (L.P.R. Teodoro), glauce.
azevedo@ufms.br (G.B. de Azevedo), gileno.azevedo@ufms.br (G.T.O.S. Azevedo), fabiobaio@ufms.br (F.H.R. Baio), rsobrinho@alunos.utfpr.edu.br (R.L. Sobrinho),
carlosjr@unemat.br (C.A. da Silva Junior).

https://doi.org/10.1016/j.foreco.2021.119496
Received 26 May 2021; Received in revised form 25 June 2021; Accepted 30 June 2021
Available online 9 July 2021
0378-1127/© 2021 Elsevier B.V. All rights reserved.
B.R. de Oliveira et al. Forest Ecology and Management 497 (2021) 119496

2019). Among the eucalyptus forests cultivated in the world and in Grosso do Sul (UFMS), Campus of Chapadão do Sul in January 2014. The
Brazil, 90% are made up of nine species and their hybrids: Eucalyptus soil is identified as medium-textured Red Oxisol and the climate is
camaldulensis Dehnh., E. grandis W.Hill ex Maiden, E. tereticornis Sm., tropical humid (Aw) with a rainy season from October to April and a dry
E. globulus Labill., E. nitens H. Deane & Maiden Maiden, E. urophylla S. T. season between May and September. Average rainfall varies from 750 to
Blake, E. saligna Sm., E. dunnii Maiden, E. pellita F. Muell. e Corymbia 1,800 mm/year, and average annual temperature varies from 20 to
citriodora Hook. (Binkley et al., 2017; Gallo et al., 2018; Campoe et al., 25 ◦ C.
2020; Carrijo et al., 2020). It were evaluated five eucalyptus species (E. camaldulensis,
E. grandis is a species that has excellent qualities, surpassing any E. uroplylla, E. saligna, E. grandis e E. urograndis) and Corymbria citriodora
other in increasing the volume of wood when the environmental con­ in experimental design of randomized blocks with four replicates, with
ditions are adequate, which is the cause of its great use (Chaín et al., 20 plants inside each experimental plot. All fertilization requirements
2020), in addition to having good wood for sawmills and excellent for were determined from soil chemical analysis. The following results were
cellulose (Mphahlele et al., 2020). C. citriodora is a species of moderate obtained: pH (CaCl2): 4.9; organic matter: 31.5 g dm− 3; phosphorus:
growth, usually ranging between 24–40 m in height and 60–120 cm in 13.6 mg dm− 3; hydrogen + aluminium (H + Al): 5.4; potassium: 0.29
diameter (Blackman et al., 2017), with excellent for sawmill, charcoal cmolc dm− 3; calcium: 2.8 cmolc dm− 3; magnesium: 0.5 cmolc dm− 3;
production, posts and sleepers (Souza et al., 2020). E. saligna provides cation exchange capacity (CEC): 9.0 cmolc dm− 3; base saturation:
light, low density wood, suitable for cellulose, firewood, coal, sawmill 39.9%. The proportions of clay, sand, and silt were 46%, 46%, and 8%,
and other purposes (Biazzon et al., 2019; Silva et al., 2020a,b,c). respectively. Crowning, weeding, ant control, and application of herbi­
E. urophylla has great morphological and phenological variations in cides (glyphosate) were performed when necessary.
Brazil, according to its altitudinal distribution (Lima Costa, 2020)and
stands out for its high resistance to eucalyptus cancer, in addition to the
2.2. Data acquisition
production of cellulose (Binkley et al., 2017). E. camaldulensis is a
preferred species for planting in tropical regions subject to periods of
The diameter at breast height (DBH) and total plant height (Ht) at
drought due to its tolerance to water deficiency in the soil (Asao et al.,
stand level were obtained by measuring five trees in each experimental
2020).
unit. These trees were the same in each measurement. To obtain the DBH
Thus, different genotypes respond differently to environmental
(cm), a tape measure was used to measure the circumference at breast
changes. The interaction between these factors can affect the perfor­
height, which was later converted to DBH. The Ht (m) was obtained with
mance and development of plants in different environments (Gallo et al.,
the aid of a Haglof hypsometer. Seven measurements were performed,
2018; Hakamada et al., 2020a,b). In this sense, recently, non-destructive
which occurred on the following dates: 2018-11-01, 2018-12-06, 2019-
methods are being proposed based on empirical models of crop pro­
01-22, 2019-03-29, 2019-05-10, 2019-10-30, and 2019-11-28. For each
ductivity estimation, for example, those that relate values of leaf area
measurement, the average of five trees was considered.
index (LAI) with vegetation indexes (VI) derived from sensors aerial and
The characteristics related to high-throughput phenotyping were
orbital remotes (Canavesi et al., 2010). VIs enhance the spectral
obtained on the same dates. Furthermore, the flights were carried out
reflectance component of vegetation through the combination, mainly,
with Sensefly eBee RTK fixed-wing unmanned aerial vehicle (UAV), with
of the spectral bands of red (R) and near infrared (NIR), and are more
autonomous flight control. Further details on flight procedures and
sensitive to variations in the structure of the canopy than the analysis by
acquisition of wavelengths for calculating VIs can be obtained from Silva
individual bands (Borges et al., 2021; Silva et al., 2021).
et al. (2020a,b,c). The overflights were performed with 80% lateral and
Due to the easiness of acquiring spectral images, either by satellites
85% longitudinal overlap of the images, as well as the same area was
or by remotely piloted aircraft, some researches are being carried out
imaged twice using perpendicular flight lines. The overflight was per­
recently to relate these variables with the phenological behavior of
formed at 100 m altitude, allowing a spatial image resolution of 0.10 m.
different forest species (Sanchini and Grosjean, 2020; Vali et al., 2020;
The increase of the overlap between the images was necessary in order
Borges et al., 2021; Silva et al., 2021). Knowledge of the volumetric
to obtain a greater number of scenes containing the same control points,
production and the biomass of the stem of forest plantations is essential.
allowing greater accuracy in the mosaic of the images by the Pix4D­
It makes it possible to define the productive capacity of the place and
mapper software. This need occurs according to the plant height, which
specify the application of wood that is used as a raw material in the
is subject to the oscillations of the stem as a function of the wind,
forest products industry. In addition, this knowledge enables decision-
because regardless of its speed, it interferes in the mosaicking process.
making in forest improvement programs (Hakamada et al., 2020a,b;
The overflights were carried out near the zenith due to the minimization
Rocha et al., 2020).
of the shadows of the trees, at 11 a.m., given that the multispectral
Growth and production models can help to simulate the growth of
sensor is passive type, that is, dependent on the solar luminosity. A
tree dimensions (height and diameter) to predict forest productivity at
calibration reference plaque is also used, in the Pix4DMapper software,
different levels. In this context, the following questions arise: (i) is it
to convert the digital number of the pixels into reflectance values. The
possible to recognize the growth pattern of eucalyptus species based on
spectral regions registered by this sensor correspond to green (550 nm),
spectral features using machine learning (ML) for data modeling? ii)
red (660 nm), red-edge (735 nm), and near-infrared (NIR) (790 nm).
what spectral features provides better accuracy? and (iii) what ML al­
Table 1 presents all the VIs used in later experiments.
gorithms are most accurate for performing this modeling? To answer
A Pearson correlation analysis between the evaluated variables
these questions, the present study evaluated the use of ML techniques
(DBH, HT, SBs and VIs) was performed. The results were expressed
using breast height and total plant height to classify the growth of five
graphically, where positive correlations were expressed in gray circles,
species of eucalyptus and Corymbria citriodora in an unsupervised
while negative correlations were represented by black circles. The size of
learning, and the obtained classes for induce ML algorithms to recognize
the circle is proportional to the magnitude of the correlation.
the species with relation to their growth using spectral bands and VIs.

2. Materials and methods 2.3. Machine learning methods

2.1. Experiment conducting Due to the characteristics of the problem investigated, two machine
learning approaches were employed: supervised and unsupervised. In
The experiment was installed in the experimental area (18◦ 41′ 33′′ S, the supervised way are implemented algorithms for recognition of the
52◦ 40′ 45′′ W, with altitude is 820 m) of the Federal University of Mato patterns x ∈ RN labeled as y ∈ { − 1, +1}, wherexis a feature vector and

2
B.R. de Oliveira et al. Forest Ecology and Management 497 (2021) 119496

Table 1 Table 1 (continued )


The vegetation index used in the experiments. Index Equation
Index Equation √̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅
TNDVI (Rλnir − Rλred )/[(Rλnir + Rλred ) + 0.5]
ARVI2 (Atmospherically − 0.18 + 1.17 × ((Rλnir − Rλred )/(Rλnir +Rλred )) TVI
√̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅
NDVI + 0, 5
Resistant Vegetation
WDRVI (0.1 × Rλnir − Rλred )/(0.1 × Rλnir + Rλred )
Index 2)
ATSAVI (Adjusted
1.22 × NIR = near-infrared; λ = wavelength.
Transformed soil-
adjusted VI) [ ]
(Rλnir − 1.22 × Rλred − 0.03) − 1 and +1 discriminates the classes (negative and positive) of patterns.
( )
1.22 × Rλnir + Rλred − 1.22 × 0.03 + 0.08(1+1.222 {( ) }M
For this, from a training set T = xm , ym m=1 , with M instances, the
BWDRVI (Blue-wide 0.1 × (Rλnir + Rλred )
dynamic range
recognition models are induced. These models can predict, with some
vegetation index) accuracy, the class of an unknown pattern in other set, called test set
CCCI (Canopy [(Rλnir − Rλrededge ) T’ = {(x’m , y’m ) }M’
m=1 , which is disjoint with the training set. Depending
Chlorophyll Content (Rλnir − Rλred )
(Rλnir + Rλrededge )]/[ ] on set chosen overfitting can happen, i.e., the induce model present
Index) (Rλnir + Rλred )
CIgreen (Chlorophyll Rλnir higher performance for the known sets but poor generalization perfor­
− 1
Index Green) Rλgreen mance. To avoid overfitting, the cross-validation approach is performed,
CIrededge (Chlorophyll Rλnir
− 1 where the sets are divided into disjoint subsets and each subset is used to
Index RedEdge) Rλrededge
training or test the models. Following, the algorithms used in both ap­
CVI (Chlorophyll Rλnir × Rλred
proaches are reported.
Vegetation Index) Rλgreen 2
DVI (Difference Rλnir /Rλred
k-Nearest-Neighbor (KNN) is an algorithm type instance-based that
Vegetation Index) recognize a pattern when comparing distances between the instances in
EVEI2 (Enhanced 2.5 × (Rλnir − Rλred )/(Rλnir + 2.4 × Rλred + 1) a neighborhood. Thus, a query instance is recognized as classα if thek
Vegetation Index 2) closest instances (or most of them – majority voting) belongs to classα. If
GDVI (Difference NIR/ Rλnir − Rλgreen
the class distribution is skewed, then to overcome this problem the
Green Difference
Vegetation Index) recognition can be weighted, such that the closer neighbors will have a
GEMI (Global 2 × (1 − 0.25 × 2) − ((Rλred − 0.125)/(1 − Rλred )) greater influence than neighbors which are further away (Kubat, 2015;
Environment Awad and Khanna, 2015).
Monitoring Index) Random Forest (RF) and Extremely Randomized Trees (ET) are al­
GNDVI (Green (Rλnir − Rλred )
Normalized Difference (Rλnir + Rλred )
gorithms that perform an ensemble approach combining weak models to
Vegetation Index) form a strong model (the ensemble), where each model is a tree structure
GRNDVI (Green-Red [Rλnir − (Rλgreen + Rλred )]/[Rλnir + (Rλgreen + Rλred ) (named here as virtual tree) and the final decision is obtained by fusion
NDVI) the prediction of the individual virtual trees by majority voting (Awad
GRVI (Green-Red (Rλgreen − Rλred )
and Khanna, 2015). Each virtual tree has nodes, leaves, and branches,
Vegetation Index) (Rλgreen + Rλred )
GSAVI (Green Soil [(Rλnir − Rλgreen )/(Rλnir + Rλgreen + 0.5)]*1.5 which characterizes the feature values, the classes and the partition of
Adjusted Vegetation the feature space, respectively. In order to build the trees from the
Index)
√̅̅̅̅̅̅̅̅̅̅̅̅
training set, it is used a function for measure the quality of a split. The
GTVI (Green Triangle (NDVI + 0.5)/(NDVI + 0.5) × [( NDVI + 0.5)] main differences between RF and ET are that last uses completely
Vegetation Index)
IPVI (Infrared Percentage Rλnir /((Rλnir +Rλred )/2) × (NDVI + 1)
learning instance to build the trees and the cut-points for split the nodes
Vegetation Index) are chosen at random (Geurts et al., 2006).
LogR (Log Ratio) Log(Rλnir /Rλred ) The Perceptron is an abstraction of a natural neuron proposed by
MSAVI (Modified Soil [2 × (Rλnir + McCulloch and Pitts based on nonlinear activation function (Haykin,
√̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅
Adjusted Vegetation
1) − (2 × Rλnir + 1)2 − 8 × (Rλnir − Rλred )]/2 1999). A Multilayer Perceptron (MLP) is a fully connected network
Index)
composed by at least three layers, namely, input, hidden and output,
MSRNir_Red (Modified (Rλnir /Rλred − 1)
Simple Ratio NIR/
√̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅ such that there may be many hidden layers and the artificial neurons are
(Rλnir /Rλred + 1
RED) arranged only in two last layers, since the first receive the feature vectors
NDRE (Normalized Rλnir − Rλrededge (Kubat, 2015). The number of artificial neurons and the layers define the
Difference Red-Edge λnir + Rλrededge complexity of the solution. A weight is assigned to each neuron-to-
Index)
neuron connection. To adjust these weights, the backpropagation algo­
NDVI (Normalized (Rλnir − Rλred )
Difference Vegetation (Rλnir + Rλred ) rithm on the training set is commonly used, where a learning rate de­
Index) termines how the weights are updated in each training epoch (Awad and
NGRDI (Normalized (Rλgreen − Rλred ) Khanna, 2015).
Green-Red Difference (Rλgreen + Rλred ) Support Vector Machine (SVM) is a neural network type but with
Index)
NormR1 (Normalized G) Rλgreen only one hidden layer (Haykin, 1999). The SVM algorithm seeks an
(Rλnir + Rλred + Rλgreen ) optimal hyperplane to separate classes using some instances of the
NormR2 (Normalized Rλnir
training set as support vectors, such that, the separation margin be
NIR) (Rλnir + Rλred + Rλgreen )
NormR3 (Normalized R) Rλred maximum. However, classes may overlap and therefore is need intro­
(Rλnir + Rλred + Rλgreen ) duce slack features, whose influence is controlled by a regularization
RGR (Red Green Ratio (Rλred parameter. To generate non-linear hyperplane and solve more complex
)
Index) Rλgreen
RI (Redness Index) Rλred − Rλgreen /Rλred + Rλgreen
recognition problems, the SVM algorithm employs kernel functions that
RRI 1 Rλnir
map the input space to higher dimensional space (Camastra and Vin­
Rλ rededge
√̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅
̅
ciarelli, 2015).
SRQT_IR_R Rλnir /Rλred Gaussian Processes classifier (GP) is a non-parametric algorithm and
SRRed_NIR Rλred a type of kernel method, like SVM, but unlike SVM the GP is able to
Rλnir
predict highly calibrated probabilities. GP is based on a Bayesian
(continued on next page)
methodology, using posterior probabilities and a latent function serving

3
B.R. de Oliveira et al. Forest Ecology and Management 497 (2021) 119496

as measure of the degree of membership of classes. distintic subsets provided by cross-validation. Then, average accuracy is
For the unsupervised way, a clustering algorithm is performed for calculated for performance evaluation.
classification, namely, K-means. This algorithm is based only two steps
that are repeated: (1) an instance is assigned to the clusters whose 3. Results
centroid is closest to this instance; (2) the centroids are updated such
that the new centroids represent the mean center of assigned instances Pearson’s correlations between the evaluated variables are shown in
(Awad and Khanna, 2015). Fig. 2. The growth variables (DBH and Ht) did not present a high
magnitude linear relationship with any spectral variable evaluated.
2.4. Proposed methodology However, most of the spectral variables evaluated are positively corre­
lated (grey circles).
In order to recognize eucalyptus species in relation to its growth, it is The first step of the proposed methodology is the instance classifi­
necessary to classify each instance, since the dataset is not labeled. For cation using K-means clustering method. For each measurement, in
this, the K-means clustering method is used to group the instances based different dates, this method is executed taking two clusters representing
on the similarities of the samples in relation to the DAP and Ht values, in low- and fast-growth. Figure shows the instances per date, represented
an unsupervised approach. However, as the species were observed on by growth features Ht and DBH, for only three first measurements. The
different dates, this approach must be done for each date separately. instances are limited by circles whose centers is the K-means clusters and
After classifying (groups) the instances, ML methods for recognition the radius is the distance between each center (marked with a red x) and
were implemented in a supervised manner. Since many VIs have been the most distant instance associated with this center.
measured and some of them are linear combination from others (see From clustering shown in Fig. 3, the species 1 (E. camaldulensis), 4
Table 1), then a method for spectral feature selection based on F sta­ (E. urophylla) and 6 (Corymbia citriodora) are assigned to slow growth
tistics, provided by analysis of variance (ANOVA), was performed. Thus, class and the others are assigned to fast growth class, taking into account
for each feature subgroup, the ML methods are trained and tested. To the distance from the center of the circle.
avoid overfitting when choosing data for training and testing, cross- After classification, spectral features were selected from higher F-
validation approach was performed using 10-fold and the average ac­ score and lowest p-value using ANOVA statistical test. Table 2 shows
curacy calculated. Following, Fig. 1 illustrate the proposed theses values for each feature. Through the results from Table 2, the
methodology. selection of the features for ML training was done, cumulatively, i.e., for
In the “Features” block, the features of dataset are split to be used in one feature it is used only NormR1, for two features, it is used NormR1
the algorithms that implement two approaches: unsupervised and su­ and Norm R2 and so on. The first three features selected were NormR1,
pervised learning. In the first approach, the K-means method groups the NormR2 and GSAVI. Of these, the first stood out for presenting a
instances based on their Euclidean distances from a cluster. As the negative correlation with most spectral variables, while the last two
objective is to group the species in fast- and low-growth, two clusters are presented positive correlations.
used. As there is variability in species growth between data collection By varying the numbers of features and hyperparameters of ML al­
dates, the clustering method is used for each date separately. Each group gorithms, several models were induced from subsets generated by 10-
corresponds to a class label which is after used for ML algorithms that fold cross-validation. To choose the best hyperparameters, the Grid
employing supervised approach. In this step, the best VI features are Search approach was implemented, which performs the training and
selected, according to ANOVA statistical test, in relation to the variance. testing steps and selects those hyperparameters that provide higher
For the best features, ML algorithms are induced and tested using accuracy.

Fig. 1. Block diagram of the proposed methodology.

4
B.R. de Oliveira et al. Forest Ecology and Management 497 (2021) 119496

Fig. 2. Pearson correlation’s between the variables diameter at breast height (DBH) and total height (Ht) with the spectral variables described in Table 1. Positive
correlations were expressed in gray circles, while negative correlations were represented by black circles. The size of the circle is proportional to the magnitude of the
correlation.

Fig. 3. Clusters obtained for each date using K-means method based on diameter at breast height (DBH) and total plant height (Ht) of five species of eucalyptus and
C. citriodora. Grey circles grouped the instances. The colors and numbers of bullets mean the species. Red × is the center of circles (cluster). (For interpretation of the
references to colour in this figure legend, the reader is referred to the web version of this article.)

The four best results of each ML algorithm and hyperparameter balanced, entropy as measure of a split and number of trees equal to 10.
configuration employed by scikit-learn library (Pedregosa et al., 2011) Considering the best algorithm (Random Forest) according Table 2,
are described in Table 3. It is possible to observe that the Random Forest Figure shows how the accuracy changes when we vary the number of
algorithm showed the best performance among the others evaluated. virtual trees, keeping the other hyperparameters fixed. As we can see,
The greatest accuracy was obtained with 24 features, weight class the best result is achieved with 10 virtual trees. From this value, the

5
B.R. de Oliveira et al. Forest Ecology and Management 497 (2021) 119496

Table 2 Table 3
Selected spectral features according to analysis of variance (ANOVA), F-score Average accuracy obtained by 10-fold cross-validation for several algorithms
and p-value. taking into account different features, provided in Table 2.
Number of selected features Feature* F-score p-Value Number of features Algorithm (hyperparameters) Average accuracy

1 NormR1 10.807 0.0013 Random Forest


2 NormR2 5.6625 0.0186 (weight class, measure of a split, number of trees)
3 GSAVI 3.5990 0.0597 6 (balanced, Gini, 10) 0.7341
4 IPVI 2.7637 0.0985 24 (balanced, entropy, 10) 0.7604
5 NDVI 2.7622 0.0986 25 (balanced, entropy, 200) 0.7433
6 GNDVI 2.7622 0.0986 26 (balanced, Gini, 200) 0.7425
7 ARVI2 2.7622 0.0986
Extremely Randomized Trees
8 WDRVI 2.7622 0.0986
(weight class, measure of a split, number of trees)
9 green 2.7577 0.0989
4 (balanced, gini, 10) 0,7233
10 SRRed/NIR 2.7539 0.0991
5 (balanced, gini, 10) 0,7420
11 Norm R3 2.4848 0.1170
24 (balanced, gini, 100) 0,7100
12 ATSAVI 2.4636 0.1186
25 (balanced, gini, 200) 0,7170
13 EVEI2 1.8980 0.1703
14 GDVI 0.1740 0.1891 K-Nearest-Neighbor
15 CCCI 1.6744 0.1976 (search algorithm, number of neighbors, weight function)
16 NIR 1.0446 0.3084 21 (ball_tree,2, distance) 0.6837
17 SAVI 0.9164 0.3399 23 (ball_tree,10, distance) 0.7175
18 BWDRVI 0.7978 0.3732 24 (ball_tree,10, distance) 0.7175
19 red 0.7549 0.3863 25 (ball_tree,10, distance) 0.7241
20 NGRDI 0.4250 0.5155
21 Ciredge 0.4213 0.5173 Support Vector Machine
22 NDRE 0.3490 0.5556 (regularization, kernel coefficient, kernel)
23 RGR 0.3409 0.5602 23 (2.0, scale, rbf) 0.6741
24 rededge 0.1919 0.6620 24 (2.0, scale, rbf) 0.6741
25 SCCCI 0.1176 0.7321 25 (2.0, scale, rbf) 0.6616
26 EVI 0.0434 0.8352 27 (2.5, scale, rbf) 0.6679
27 GRNDVI 0.0097 0.9218 Multi-Layer Perceptron
*
Each row includes its feature and that of the previous row. Bold values (activation function, hidden layers and number of neurons)
24 (relu, (100, 200, 300)) 0.7158
highlight the three best spectral features.
25 (relu, (100, 200, 300)) 0.7287
26 (relu, (50, 100)) 0.7154
accuracy drops to 20 trees and stabilizes up to the maximum number of 27 (relu, (100, 50), constant) 0.7216
trees tested in the algorithm. As the 10-fold cross-validation approach Gaussian Process
was performed, the red line represents the average accuracy, and the (kernel)
gray area the interval between the maximum and minimum accuracy 21 RBF 0.7100
values obtained in the 10 executions (see Fig. 4). 23 RBF 0.7229
24 RBF 0.7229
25 RBF 0.7162
4. Discussion

The absence of a linear relationship between spectral variables and


growth variables in eucalyptus has already been reported in the litera­
ture (Borges et al., 2021; Silva et al., 2021). These results highlight the
need to investigate machine learning techniques to find relationships
between these groups of variables.
The analysis of the growth features Ht and DBH, through K-means
clustering method (Fig. 4) revealed that the clusters change over mea­
surement dates. These results are observed because eucalyptus trees are
developing over time. For this, it was necessary to manually label the
species according to the first groups, obtained by the first measurement,
discarding the others. Although, for second measurement, two instances
of species 3 – E. saligna belong to intersection among low-growth class
(bottom circle) and fast-growth class (top circle), these species were
assigned to the fast-growth class, since their distances to cluster related
to this class are shorter. Analogous procedure was carried for the mea­
surements on the date of 2019-01-22 with respect to an instance of
species 2 – E. urograndis. Fig. 4. Accuracy variation taking into account different number of virtual trees
From ANOVA statistical test, the results in Table 1 shows that the in Random Forest. Red line is the average. Grey area is the interval between the
best three features, in increase order, are Norm R1, Norm R2 and GSAVI, minimum and maximum accuracies. (For interpretation of the references to
and the worst, in decrease order, are GRNDVI, EVI and SCCCI. This colour in this figure legend, the reader is referred to the web version of
choice is made according to the variance of the features, since when a this article.)
feature has a low variance, then it has little information about the
pattern. Even so, few features may not be enough to obtain a recognition average accuracy, since, from Table 2, the three worst features are used.
model with better accuracy. This is evidenced from results in Table 3, The same behavior is noted for the algorithms Extremely Randomized
where for Random Forest models the average accuracy for 6 and 24 Trees, Support Vector Machine and Gaussian Process.
features are around 0.73 and 0.76, respectively. Furthermore, for the Trees, even those within the same genus, may have distinct func­
Random Forest algorithm, using more than 24 features only worsens the tional traits and behaviors, including characteristics related to pigment

6
B.R. de Oliveira et al. Forest Ecology and Management 497 (2021) 119496

content and photosynthetic efficiency (Scolforo et al., 2019; Chen et al., 5. Conclusion
2020; Reis et al., 2021), which can be observed in phenological attri­
butes such as stem diametric growth and plant height (Banks, 2018; Our results show that it is possible to recognize different eucalyptus
Pšidová et al., 2018). Unlike the empirical spectral variables (Lich­ species in terms of slow- and fast-growth patterns. The best three fea­
tenthaler, 1987; Zhou et al., 2021), which are often developed at the leaf tures were Norm R1, Norm R2 and GSAVI. Overall, all ML algorithms
level and can be species, location and time specific, a process modeling had good accuracy (superior to 0.66), but the Random Forest using 24
approach may be responsible for varying other variables that affect features stand out by the highest accuracy (0.76). Therefore, the accu­
canopy reflectance, therefore providing a more accurate estimate of the racy in recognizing growth patterns in eucalyptus species is dependent
chlorophyll content, and consequently growth in various cultivated on the ML algorithm and the number of features used in the model.
species, time periods and in broader spatial extensions (Spafford et al., Our results show that ML algorithms applied to spectral data are an
2021). appropriate approach to classify different eucalyptus species based on
Due to the importance of pigments for photosynthesis, variations in growth and to recognize theses species using spectral variables. This
pigment levels can provide information on the physiological state of the approach, supported by unsupervised and supervised learning, may be
plant and therefore on its growth (Zargar et al., 2017; Santos et al., an important strategy in monitoring and management of forest planta­
2019). Chlorophylls have strong absorbance peaks in the red and blue tions for providing good accuracy and saving time and labor.
regions of the electromagnetic spectrum (Sanchini and Grosjean, 2020),
however, the reflectance at these wavelengths was not as useful for
classifying the growth of species, since they are closely related to plant Declaration of Competing Interest
development, as the reflectance at longer or shorter wavelengths. This is
because the relatively low chlorophyll contents are sufficient to saturate The authors declare that they have no known competing financial
the absorption in the 660–680 nm region, thus reducing the sensitivity interests or personal relationships that could have appeared to influence
to high chlorophyll contents of spectral variables based on these wave­ the work reported in this paper.
lengths (Lichtenthaler, 1987; Oliveira et al., 2017).
The Norm 1, Norm 2 and GSAVI use green and near infrared as bands References
of the electromagnetic spectrum in their models. In addition to these
Asao, S., Hayes, L., Aspinwall, M.J., Rymer, P.D., Blackman, C., Bryant, C.J., Atkin, O.K.,
characteristics, it is worth mentioning that GSAVI is a parameter that
2020. Leaf trait variation is similar among genotypes of Eucalyptus camaldulensis
seeks to mitigate the antecedent effects of soil through an adjustment from differing climates and arises in plastic responses to the seasons rather than
factor conditioned to the type of soil and coverage of the study area (Vali water availability. New Phytol. https://doi.org/10.1111/nph.16579.
et al., 2020), and the application of this index eases limitations imposed Awad, M., Khanna, R., 2015. Efficient learning machines: theories, concepts, and
applications for engineers and system designers. Springer Nature, p. 268. https://
by other indexes. These vegetation indices (Norm 1, Norm 2 and GSAVI) doi.org/10.1007/978-3-319-20010-1.
proved to be more suitable among those tested, with greater precision, Banks, J.M., 2018. Chlorophyll fluorescence as a tool to identify drought stress in Acer
minimizing atmospheric and soil effects, thus favoring a more accurate genotypes. Environ. Exp. Bot. 155, 118–127. https://doi.org/10.1016/j.
envexpbot.2018.06.022.
spectral response of vegetation. Biazzon, J.C., Lima Jr., M.P., Munis, R.A., De Araújo, V.A., Morales, E.A.M.,
Analyzing all average accuracies in Table 3, it is clear that the Gonçalves, M.T.T., Valarelli, I.D.D., 2019. Shear strength of eucalyptus saligna wood
Random Forest with 10 virtual trees, 24 features, entropy as measure of joints bonded with polyvinyl acetate adhesive. BioResources 14 (2), 4590–4602.
https://doi.org/10.15376/biores.14.2.4590-4602.
a split and balanced weight class has the best result. However, even Binkley, D., Campoe, O.C., Alvares, C., Carneiro, R.L., Cegatta, Í., Stape, J.L., 2017. The
employing only 6 features, the Random Forest has a higher average interactions of climate, spacing and genetics on clonal Eucalyptus plantations across
accuracy than other algorithms, except for the Extremely Randomized Brazil and Uruguay. For. Ecol. Manage. 405, 271–283. https://doi.org/10.1016/j.
foreco.2017.09.050.
Trees that achieve a higher accuracy using only 5 features. This is
Binkley, D., Campoe, O.C., Alvares, C.A., Carneiro, R.L., Stape, J.L., 2020. Variation in
important because the decision tree models with less features have di­ whole-rotation yield among Eucalyptus genotypes in response to water and heat
agram representation that is easy to understand, which can be very stresses: The TECHS project. For. Ecol. Manage. 462 https://doi.org/10.1016/j.
foreco.2020.117953.
useful for human analysis.
Blackman, C.J., Aspinwall, M.J., Tissue, D.T., Rymer, P.D., 2017. Genetic adaptation and
Fig. 3 shows how the accuracy changes when we vary the number of phenotypic plasticity contribute to greater leaf hydraulic tolerance in response to
virtual trees in the Random Forest, keeping the other hyperparameters drought in warmer climates. Tree Physiol. 37 (5), 583–592. https://doi.org/
fixed. As we can see, the best result is achieved with 10 virtual trees. As 10.1093/treephys/tpx005.
Borges, M.V.V., de Oliveira Garcia, J., Batista, T.S., Silva, A.N.M., Baio, F.H.R., da Silva
the 10-fold cross-validation approach is performed, the red line repre­ Junior, C.A., Teodoro, P.E., 2021. High-throughput phenotyping of two plant-size
sents the average accuracy, and the gray area the interval between the traits of Eucalyptus species using neural networks. J. For. Res. 1–9. https://doi.org/
maximum and minimum accuracy values obtained in the 10 runs. We 10.1007/s11676-021-01360-6.
Butler, J.B., Freeman, J.S., Potts, B.M., Vaillancourt, R.E., Grattapaglia, D., Silva-
also note that, depending on the data set chosen in the cross-validation, Junior, O.B., Shepherd, M., 2018. Annotation of the Corymbia terpene synthase gene
it is possible to achieve a maximum accuracy, in this case using only two family shows broad conservation but dynamic evolution of physical clusters relative
virtual trees. to Eucalyptus. Heredity 121 (1), 87–104. https://doi.org/10.1038/s41437-018-
0058-1.
On the other hand, Support Vector Machine algorithm generate Camastra, F., Vinciarelli, A., 2015. Machine Learning for Audio, Image and Video
models with inferior accuracy than all the others algorithms, whereas K- Analysis: Theory and Applications. Springer.
Nearest-Neighbor, Multi-Layer Perceptron and Gaussian Process algo­ Campoe, O.C., Alvares, C.A., Carneiro, R.L., Binkley, D., Ryan, M.G., Hubbard, R.M.,
Stape, J.L., 2020. Climate and genotype influences on carbon fluxes and partitioning
rithms generated close accuracy then Random Forest and Extremely
in Eucalyptus plantations. For. Ecol. Manage. 475 https://doi.org/10.1016/j.
Randomized Trees. This implies that ML models based on the decision foreco.2020.118445.
tree structure are the best to recognize the growth of eucalyptus species, Canavesi, V., Ponzoni, F.J., Valeriano, M.M., 2010. Estimativa de volume de madeira em
plantios de Eucalyptus spp. utilizando dados hiperespectrais e dados topográficos.
considering the features selected.
Revista Árvore 34 (3), 539–549. https://doi.org/10.1590/S0100-
As far as we know, this is the first study to test machine learning 67622010000300018.
techniques and vegetation indexes to recognize the growth of eucalyptus Carrijo, J.V.N., Ferreira, A.B.D.F., Ferreira, M.C., et al., 2020. The growth and production
species. The results obtained suggest that these indexes can be applied to modeling of individual trees of Eucalyptus urophylla plantations. J. For. Res. 31,
1663–1672. https://doi.org/10.1007/s11676-019-00920-1.
species without extensive calibration for each species. Since reflectance Chaín, J.M., Tubert, E., Graciano, C., Castagno, L.N., Recchi, M., Pieckenstain, F.L.,
measurements can be made quickly and non-destructively, this would Baroli, I., 2020. Growth promotion and protection from drought in Eucalyptus grandis
make it possible for large-scale surveys, in time and space, of plants seedlings inoculated with beneficial bacteria embedded in a superabsorbent
polymer. Sci. Rep. 10 (1), 1–17. https://doi.org/10.1038/s41598-020-75212-4.
under field conditions, contributing to an improvement in the man­ Chen, X., Zhao, P., Ouyang, L., Zhu, L., Ni, G., Schäfer, K.V., 2020. Whole-plant water
agement processes of planted forests. hydraulic integrity to predict drought-induced Eucalyptus urophylla mortality under

7
B.R. de Oliveira et al. Forest Ecology and Management 497 (2021) 119496

drought stress. For. Ecol. Manage. 468, 118179 https://doi.org/10.1016/j. Rocha, S.M.G., Vidaurre, G.B., Pezzopane, J.E.M., Almeida, M.N.F., Carneiro, R.L.,
foreco.2020.118179. Campoe, O.C., Figura, M.A., 2020. Influence of climatic variations on production,
Collevatti, R.G., Novaes, E., Silva-Junior, O.B., Vieira, L.D., Lima-Ribeiro, M.S., biomass and density of wood in eucalyptus clones of different species. For. Ecol.
Grattapaglia, D., 2019. A genome-wide scan shows evidence for local adaptation in a Manage. 473, 118290. https://doi.org/10.1016/j.foreco.2020.118290.
widespread keystone Neotropical forest tree. Heredity 123 (2), 117–137. https://doi. Sanchini, A., Grosjean, M., 2020. Quantification of chlorophyll a, chlorophyll b and
org/10.1038/s41437-019-0188-0. pheopigments a in lake sediments through deconvolution of bulk UV–VIS absorption
Elli, E.F., Sentelhas, P.C., Bender, F.D., 2020a. Impacts and uncertainties of climate spectra. J. Paleolimnol. https://doi.org/10.1007/s10933-020-00135-z.
change projections on Eucalyptus plantations productivity across Brazil. For. Ecol. Santos, I.C., de Almeida, A.A.F., Pirovani, C.P., Costa, M.G.C., Da Conceição, A.S., dos
Manage. 474 https://doi.org/10.1016/j.foreco.2020.118365. Santos Soares Filho, W., et al., 2019. Physiological, biochemical and molecular
Elli, E.F., Caron, B.O., Behling, A., Eloy, E., Queiróz De Souza, V., Schwerz, F., Stolzle, J. responses to drought conditions in field-grown grafted and ungrafted citrus plants.
R., 2017. Climatic factors defining the height growth curve of forest species. iForest- Environ. Exp. Bot. 162, 406–420. https://doi.org/10.1016/j.
Biogeosci. For. 10 (3), 547–553. https://doi.org/10.3832/ifor2189-010. envexpbot.2019.03.018.
Elli, E.F., Sentelhas, P.C., de Freitas, C.H., Carneiro, R.L., Alvares, C.A., 2019. Assessing Scolforo, H.F., Scolforo, J.R.S., Stape, J.L., McTague, J.P., Burkhart, H., McCarter, J.,
the growth gaps of Eucalyptus plantations in Brazil–magnitudes, causes and possible Sartorio, R.C., 2017. Incorporating rainfall data to better plan eucalyptus clones
mitigation strategies. For. Ecol. Manage. 451 https://doi.org/10.1016/j. deployment in eastern Brazil. For. Ecol. Manage. 391, 145–153. https://doi.org/
foreco.2019.117464. 10.1016/j.foreco.2017.02.025.
Elli, E.F., Sentelhas, P.C., Huth, N., Carneiro, R.L., Alvares, C.A., 2020b. Gauging the Scolforo, H.F., McTague, J.P., Burkhart, H., Roise, J., Campoe, O., Stape, J.L., 2019. Yield
effects of climate variability on Eucalyptus plantations productivity across Brazil: A pattern of eucalypt clones across tropical Brazil: An approach to clonal grouping.
process-based modelling approach. Ecol. Ind. 114 https://doi.org/10.1016/j. For. Ecol. Manage. 432, 30–39. https://doi.org/10.1016/j.foreco.2018.08.051.
ecolind.2020.106325. Silva, A.K.V., Borges, M.V.V., Batista, T.S., da Silva Junior, C.A., Furuya, D.E.G., Osco, L.
Gallo, R., Pantuza, I.B., dos Santos, G.A., de Resende, M.D.V., Xavier, A., Simiqueli, G.F., P., Pistori, H., 2021. Predicting Eucalyptus Diameter at Breast Height and Total
Valente, B.M.D.R.T., 2018. Growth and wood quality traits in the genetic selection of Height with UAV-Based Spectral Indices and Machine Learning. Forests 12 (5), 582.
potential Eucalyptus dunnii Maiden clones for pulp production. Ind. Crops Prod. 123, Silva, E.E., Baio, F.H.R., Teodoro, L.P.R., da Silva Junior, C.A., Borges, R.S., Teodoro, P.,
434–441. https://doi.org/10.1016/j.indcrop.2018.07.016. 2020. UAV-multispectral and vegetation indices in soybean grain yield prediction
Geurts, P., Ernst, D., Wehenkel, L., 2006. Extremely randomized trees. Mach. Learn. 63 based on in situ observation. Remote Sens. Appl.: Soc. Environ. 18, 100318 https://
(1), 3–42. https://doi.org/10.1007/s10994-006-6226-1. doi.org/10.1016/j.rsase.2020.100318.
Hakamada, R.E., Hubbard, R.M., Moreira, G.G., Stape, J.L., Campoe, O., de Barros Silva, P.H.M., Junqueira, L.R., de Araujo, M.J., Wilcken, C.F., Moraes, M.L.T., de
Ferraz, S.F., 2020. Influence of stand density on growth and water use efficiency in Paula, R.C., 2020. Susceptibility of eucalypt taxa to a natural infestation by Leptocybe
Eucalyptus clones. For. Ecol. Manage. 466, 118125 https://doi.org/10.1016/j. invasa. New Forest. 51 (5), 753–763. https://doi.org/10.1007/s11056-019-09758-1.
foreco.2020.118125. Silva, V.E., Nogueira, T.A.R., Abreu-Junior, C.H., He, Z., Buzetti, S., Laclau, J.P.,
Hakamada, R.E., Hubbard, R.M., Stape, J.L., de Paula Lima, W., Moreira, G.G., de Barros Capra, G.F., 2020. Influences of edaphoclimatic conditions on deep rooting and soil
Ferraz, S.F., 2020. Stocking effects on seasonal tree transpiration and ecosystem water availability in Brazilian Eucalyptus plantations. For. Ecol. Manage. 455,
water balance in a fast-growing Eucalyptus plantation in Brazil. For. Ecol. Manage. 117673 https://doi.org/10.1016/j.foreco.2019.117673.
466, 118149 https://doi.org/10.1016/j.foreco.2020.118149. Silva, P.H.M.D., Marco, M., Alvares, C.A., Lee, D., Moraes, M.L.T.D., Paula, R.C.D., 2019.
Haykin, S., 1999. Neural Networks: A comprehensive Foundation, second ed. Prentice- Selection of Eucalyptus grandis families across contrasting environmental conditions.
Hall Inc., New Jarsey. Crop Breed. Appl. Biotechnol. 19 (1), 47–54. https://doi.org/10.1590/1984-
Kubat, M., 2015. An Introduction to Machine Learning. Spinger, New York, p. 291p, 70332019v19n1a07.
10.1007/978-3-319-20010-1. Souza, B.M., Freitas, M.L.M., Sebbenn, A.M., Gezan, S.A., Zanatto, B., Zulian, D.F., de
Lima Costa, S.E., do Santos, R.C., Vidaurre, G.B., Castro, R.V.O., Rocha, S.M.G., Aguiar, A.V., 2020. Genotype-by-environment interaction in Corymbia citriodora
Carneiro, R.L., et al., 2020. The effects of contrasting environments on the basic (Hook.) KD Hill, & LAS Johnson progeny test in Luiz Antonio, Brazil. For. Ecol.
density and mean annual increment of wood from eucalyptus clones. For. Ecol. Manage. 460, 117855 https://doi.org/10.1016/j.foreco.2019.117855.
Manage. 458, 117807. https://doi.org/10.1016/j.foreco.2019.117807. Spafford, L., Le Maire, G., MacDougall, A., de Boissieu, F., Féret, J.B., 2021. Spectral
Lichtenthaler, H.K., 1987. Chlorophylls and carotenoids: pigments of photosynthetic subdomains and prior estimation of leaf structure improves PROSPECT inversion on
biomembranes. Methods Enzymol. 148, 350–382. reflectance or transmittance alone. Remote Sens. Environ. 252, 112176 https://doi.
Mphahlele, M.M., Isik, F., Mostert-O’Neill, M.M., Reynolds, S.M., Hodge, G.R., org/10.1016/j.rse.2020.112176.
Myburg, A.A., 2020. Expected benefits of genomic selection for growth and wood Vahl de Paula, B., Squizani Arruda, W., Etienne Parent, L., Frank de Araujo, E.,
quality traits in Eucalyptus grandis. Tree Genet. Genomes 16 (4), 1–12. https://doi. Brunetto, G., 2020. Nutrient diagnosis of Eucalyptus at the factor-specific level using
org/10.1007/s11295-020-01443-1. machine learning and compositional methods. Plants 9 (8), 1049. https://doi.org/
Oliveira, L.F.R.D., Oliveira, M.L.R.D., Gomes, F.S., Santana, R.C., 2017. Estimating foliar 10.3390/plants9081049.
nitrogen in Eucalyptus using vegetation indexes. Scientia Agricola 74 (2), 142–147. Vali, A., Ranjbar, A., Mokarram, M., Taripanah, F., 2020. Investigating the topographic
https://doi.org/10.1590/1678-992x-2015-0477. and climatic effects on vegetation using remote sensing and GIS: a case study of
Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., Thirion, B., Grisel, O., Kharestan region, Fars Province, Iran. Theoret. Appl. Climatol. 140 (1), 37–54.
Blondel, M., Prettenhofer, P., Weiss, R., Dubourg, V., Vanderplas, J., Passos, A., https://doi.org/10.1007/s00704-019-03073-7.
Cournapeau, D., Brucher, M., Perrot, M., Duchesnay, E., 2011. Scikit-learn: Machine Viera, M., Ruíz Fernández, F., Rodríguez-Soalleiro, R., 2016. Nutritional prescriptions for
Learning in Python. J. Mach. Learn. Res. 12, 2825–2830. Eucalyptus plantations: lessons learned from Spain. Forests 7 (4), 84. https://doi.
Pšidová, E., Živčák, M., Stojnić, S., Orlović, S., Gömöry, D., Kučerová, J., Kalaji, H.M., org/10.3390/f7040084.
2018. Altitude of origin influences the responses of PSII photochemistry to heat Zargar, S.M., Gupta, N., Nazir, M., Mahajan, R., Malik, F.A., Sofi, N.R., Salgotra, R.K.,
waves in European beech (Fagus sylvatica L.). Environ. Exp. Bot. 152, 97–106. 2017. Impact of drought on photosynthesis: Molecular perspective. Plant Gene 11,
https://doi.org/10.1016/j.envexpbot.2017.12.001. 154–159. https://doi.org/10.1016/j.plgene.2017.04.003.
Reis, L.A.C., de Oliveira, J.A., dos Santos Farnese, F., Rosado, A.M., Reis, L.A.C., 2021. Zhou, C., Ma, Q., Li, S., Zhu, M., Xia, Z., Yu, W., 2021. Toxicological effects of single and
Chlorophyll fluorescence and water content parameters are good biomarkers for joint sulfamethazine and cadmium stress in soil on pakchoi (Brassica chinensis L.).
selecting drought tolerant eucalyptus clones. For. Ecol. Manage. 118682. https:// Chemosphere 263, 128296. https://doi.org/10.1016/j.chemosphere.2020.128296.
doi.org/10.1016/j.foreco.2020.118682.

You might also like