Pag 2021 106100

You might also like

Download as pdf or txt
Download as pdf or txt
You are on page 1of 11

Computers and Electronics in Agriculture 184 (2021) 106100

Contents lists available at ScienceDirect

Computers and Electronics in Agriculture


journal homepage: www.elsevier.com/locate/compag

Original papers

Nondestructive detection of decayed blueberry based on information fusion


of hyperspectral imaging (HSI) and low-Field nuclear magnetic resonance
(LF-NMR)
Qiao Shicheng a, b, c, Tian Youwen a, c, *, Wang Qinghu b, Song Shiyuan a, c, Song Ping a, c
a
College of Information and Electric Engineering, Shenyang Agricultural University, Shenyang 110866, China
b
College of Computer Science and Technology, Inner Mongolia University for Nationalities, Tongliao 028043,China
c
Research Center of Liaoning Agricultural Informatization Engineering Technology, Shenyang 110866, China

A R T I C L E I N F O A B S T R A C T

Keywords: Decay affects the quality of blueberry. In this paper, information fusion of hyperspectral imaging (HSI) and low-
Blueberry field nuclear magnetic resonance (LF-NMR) were carried out to achieve nondestructive detection of decayed
Decay blueberries. The hyperspectral images of the fruit were acquired by HSI system, multi-threshold spectral infor­
HSI
mation segmentation (MT-SIS) algorithm was proposed to segment decayed region of interest (ROI). The
MT-SIS
LF-NMR
competitive adaptive reweighted sampling (CARS) algorithm and successive projections algorithm (SPA) were
used to extract the characteristic wavelengths, which were input into partial least squares discriminate analysis
(PLS-DA), probabilistic neural network (PNN) and back propagation neural network (BPNN) models to detect
decayed fruit. Then the carr-purcell-meiboom-gill (CPMG) sequence of the fruit was acquired by LF-NMR system.
T2 relaxation information was obtained, Pearson correlation and Spearman correlation analysis were used to
select parameters, which were input into the models to detect decayed fruit. Finally, information of HSI and LF-
NMR was fused and input into the models to detect decayed fruit. The results showed that SPA algorithm was
used to extract the characteristic wavelengths and Spearman correlation was used to extract the LF-NMR pa­
rameters, the BPNN model had the optimal effect in detecting decayed blueberries, the identification accuracy of
the training set was 98.33%, and that of the test set was 97.79%. The results showed that it was feasible to fuse
the information of HSI and LF-NMR to detect decayed blueberry fruit.

1. Introduction spatial position of the sample can be studied from hundreds of adjacent
bands. Each pixel in the image contains the spectrum of that specific
Blueberry is known as the “King of Berries”, rich in anthocyanins, location (Fan et al., 2017; Munera et al., 2019). In recent years, re­
flavonols, vitamins and other nutrients, and deeply loved by consumers searchers at home and abroad have used hyperspectrual imaging tech­
(Chen et al., 2019). Fresh fruit are highly perishable during storage, nology to conduct nondestructive detection of fruit diseases, such as
transportation and processing. If not detected and sorted in time, the penicillium digitatum in citrus (Folch-fortuny et al., 2016), decay in
decayed fruit will infect other fresh fruit and cause greater losses (leiva- citrus (Li et al., 2016; Lorente et al., 2013; Tian et al., 2020), apple
valenzuela et al., 2011). Traditional detection of decayed fruit mainly diseases (Liu et al., 2017), fungal infection of stored apple fruit (Piec­
relies on manual sorting, which is monotonous, subjective and time- zywek et al., 2018), decayed pear (Sun et al., 2017; Sun et al., 2018),
consuming (leiva-valenzuela and Aguilera, 2013). Therefore, it is pear black spot disease (Pan et al., 2019), decayed strawberry (Liu et al.,
necessary to adopt a fast, effective and nondestructive approach to 2019), fungal infections in strawberry (Siedliska et al., 2018), etc.
detect decayed fruit. LF-NMR is also a nondestructive detection technique (Carneiro et al.,
Hyperspectral image (HSI) technology is a nondestructive detection 2013; Kenouche et al., 2014; Li et al., 2018; Tan et al., 2018), which has
technology that can provide both spectral and image information. A been widely employed to detect fruit diseases, such as black heart dis­
hyperspectral image consists of a series of monochromatic images. Each ease in pomegranate (Zhang and Mccarthy, 2012), internal browning in

* Corresponding author.
E-mail address: youwen_tian10@163.com (T. Youwen).

https://doi.org/10.1016/j.compag.2021.106100
Received 2 April 2020; Received in revised form 9 July 2020; Accepted 6 March 2021
Available online 21 March 2021
0168-1699/© 2021 Elsevier B.V. All rights reserved.
Q. Shicheng et al. Computers and Electronics in Agriculture 184 (2021) 106100

apple (Gonzalez et al., 2001; Defraeye et al., 2013), internal browning in System Co., Ltd., Accuracy: 10-6 kg). Then, the HSI and LF-NMR data of
pear (Hernández-Sánchez et al., 2007; Suchanek et al., 2017), internal the fruit were tested respectively, and regarded as the data of sound fruit
browning in mango (Bourne et al., 2012), decayed blueberry (Qiao et al., samples. After that, decayed fruit samples were prepared for cultivation.
2019a), decay in citrus (Galed et al., 2004), etc. The blueberry rot fungus, strains code-named LNSY01, was provided by
The above studies show that both HSI and LF-NMR can realize the Small Berry Diseases Laboratory of Shenyang Agricultural Univer­
nondestructive detection of fruit diseases, and HSI mainly focuses on the sity. After activation, spores were used to make a spore suspension (104
detection of chemical and physical characteristics of fruit surface (Liu spores mL− 1), and the liquid was sprayed evenly on the fruit surface.
et al., 2019; Qin et al., 2013), since metabolic activity of fungus can After that, all samples were stored in a climate box at a temperature of
result in considerable changes in both chemical and physical charac­ (27 ± 2 ℃) and a humidity of 80%. The fruit were taken out for testing
teristics of fruit (Wszelaki and Mitcham, 2000). LF-NMR can be used to when decay characteristics appeared after 1 d, and were discarded after
characterize the distribution and migration of water in the internal fruit the experiment. There were 188 decayed blueberries after the experi­
(Clark and Forbes, 1994), and fruit diseases are closely related to water ment was completed.
distribution and migration (Chen et al., 1989).
Some researchers also detected the decayed blueberry fruit by using 2.2. HSI and LF-NMR measurement
nondestructive detection techniques. Leiva-valenzuela and Aguilera
(2013) used computer vision (CV) technology to detect fungally decayed 2.2.1. HSI measurement
blueberries; He et al. (2019) used HSI technology to detect decayed As shown in Fig. 1, the HSI system in the experiment consists of a
blueberry fruit; and Qiao et al. (2019a) used LF-NMR technology to spectrograph (ImSpector V10 E, Spectral Imaging Ltd, Finland), a CCD
detect decayed blueberry fruit. These studies all used a single technology camera (IGV-B1410M, IMPERX incorporated, USA), a translation plat­
to detect decayed blueberry fruit. However, the combination of different form controller (IRCP0076-1 COM, Taiwan), two 150 W illumination
technologies can obtain more comprehensive information about fruit lamps (3900 Illuminatior, Illumination Technologies, Inc. U.S.), and a
diseases, while a single inspection technology can provide information computer (DELL Vostro 5560D-1528). The spectral range is 400–1000
on a single aspect of fruit diseases (Wu et al., 2018). In recent years, nm, and the effective resolution is 1.27 nm, with a total of 472 bands.
some researchers have also used multisource information fusion to The exposure time is 20 ms, and the distance between the lens and the
detect fruit quality in a nondestructive manner. For instance, Milczarek samples is 32 cm (see Fig. 1).
et al. (2019) used near infrared spectroscopy (NIRS) and NMR to study The velocity of the conveyor belt was controlled at 1.7 × 10-3 m s− 1
the astringency of pollination-variant persimmons (Diospyros kaki), and to ensure that the hyperspectral image was not distorted. To remove the
the results showed that information fusion could achieve good classifi­ effect on dark current of the hyperspectral cameras and the nonuniform
cation performance. Liu et al. (2019) adopted HSI and electronic nose intensity of hyperspectral image, the hyperspectral image was corrected
(E-nose) technologies to evaluate fungal contamination in strawberries by a black and white board. The corrected hyperspectral image I was
during decay. The results showed that the model based on featured in­ calculated according to Eq. (1) as follows to eliminate the noise.
formation fusion had better prediction performance than that con­
Is − ID
structed based on a single dataset (HSI or E-nose). Therefore, the R= (1)
IW − ID
information fusion of different technologies could obtain more
comprehensive information of fruit diseases. It is of great significance to where IS is the raw hyperspectral image of blueberry, IW is the white
use fusion approach (HSI and LF-NMR) to detect decayed blueberry. Due reference image, ID is the dark image, and R is the corrected hyper­
to the large amount of HSI & LF-NMR data, it is necessary to select major spectral image (Qiao et al., 2019b).
features to establish a fast and robust detection model (Wold et al.,
1996). 2.2.2. LF-NMR measurement
Therefore, the purposes of this study are as follows: (1) to use HSI to For the LF-NMR test, as shown in Fig. 2, a low-field nuclear magnetic
collect the hyperspectral images of the fruit, use multi-threshold spectral analysis experimental instrument of Shanghai Nuomai Electronic
information segmentation (MT-SIS) algorithm to segment decayed re­ Technology Co., Ltd. was used. The model is MesoMR23-060H-I, the
gion of interest to extract spectral information, and use the CARS and magnet probe model is NIMI20-015V-I, the magnet strength is 0.5 T, and
SPA algorithms to extract characteristic wavelengths, which will be the coil diameter is 15 mm. The working principle of low-field nuclear
input into PLS-DA, PNN and BPNN models to detect decayed fruit; (2) to magnetic resonance is that with an industrial computer, a frequency
use LF-NMR system to collect carr-purcell-meiboom-gill (CPMG) source (direct digital frequency synthesis source, DDS) sends out a radio
sequence of the fruit, obtain T2 relaxation information, and then use frequency signal that meets the resonance conditions, and the power is
Pearson correlation and Spearman correlation analysis to select relaxa­ amplified by a radio frequency unit. Then the signal emits through the
tion parameters, which will be input into the models to detect decayed RF coil and excites the sample to generate nuclear magnetic resonance.
fruit; (3) the information obtained by HSI and by LF-NMR are combined During the signal acquisition period, the RF coil obtains the nuclear
and used to build PLS-DA, PNN and BPNN models to detect decayed
fruit.

2. Materials and methods

2.1. Sample preparation

A total of 188 fresh blueberries of the variety “Emil” were picked at


the blueberry plantation of Shenyang Agricultural University in China,
and then immediately stored in a freezer at 5 ◦ C for 4 h to remove field
heat. Each blueberry had similar maturity, size, and quality, and was
free of obvious pests and mechanical damage. After the samples were
taken out, the sodium hypochlorite solution with a concentration of 2%
(v/v) was used for sterilization treatment, and then they were washed
with distilled water and blow-dried. Before the experiment, each blue­
berry sample was weighed using a balance (Beijing Sartorius Instrument Fig. 1. Schematic diagram of hyperspectral imaging system.

2
Q. Shicheng et al. Computers and Electronics in Agriculture 184 (2021) 106100

follows:
Step 1: Analyze the spectral curve of the hyperspectral image, and
select the grayscale image I at the characteristic wavelength λ where the
spectral values of the decayed region and the sound region of the
blueberry differ greatly.
Step 2: Analyze the spectral curves of the blueberry region and the
background region, and select the mean of the average spectral reflec­
tance of the background region and that of the segmented blueberry as
the segmentation threshold f0. The mean of the average spectral reflec­
tance of the decayed region and that of the sound region was selected as
the segmentation threshold f1.
Fig. 2. Schematic diagram of LF-NMR system. RF = Radio Frequency. Step 3: Compare the spectral reflectance of each pixel of the image
with the thresholds f0 and f1. If the spectral reflectance of the pixel is
magnetic resonance signal through induction. After pre-amplification, smaller than f0 or bigger than f1, assign the gray value to 0; if the spectral
data acquisition and analog-to-digital conversion will be performed. reflectance of the pixel is equal to or greater than f0 and equal to or
After the collected data enter the industrial computer, the relaxation smaller than f1, assign the gray value to 255. It is shown in Eq. (3):
spectrum of the nuclear magnetic resonance signal can be obtained f1 < f(x,y) or f(x,y) < f0 , g(x,y) = 0;
through processing. In the two-dimensional magnetic resonance imag­ (3)
f1 ⩾f(x,y) ⩾f0 , g(x,y) = 255
ing sequence, it is necessary to send a gradient signal from the sequencer
in the gradient unit. After digital-to-analog conversion and gradient where f(x, y) is spectral value at the location (x, y) of the image IM×N, x ∈
power amplification, the gradient coil generates a gradient magnetic [1, M], y ∈ [1, N]; g(x, y) is gray value at the location (x, y) of the image
field, which is used to spatially locate the nuclear magnetic resonance IM×N.
signal. The industrial computer processes the data to obtain a two-
dimensional image of the sample. 2.4.2. Feature selection algorithms
When the temperature is equal to 32 ◦ C, the magnet reaches a steady In this study, CARS algorithm and SPA algorithm were used
state. The FID sequence will be used to calibrate the center frequency respectively to extract the characteristic wavelengths. CARS algorithm
and the 90◦ and 180◦ pulse widths. The Carr-Purcell-Meiboom-Gill selects the wavelength points with large absolute value of regression
(CPMG) sequence is used to test the lateral relaxation process of blue­ coefficient in PLSR model through adaptive reweighted sampling algo­
berries (Li et al., 2018). The mathematical expression of the relaxation rithm, and removes the wavelength points with small weight to effec­
model is shown in Eq. (2): tively find the optimal variable combination. SPA is an algorithm that

n helps select optimal wavelengths by minimizing co-linearity among
t
M(t) = Ai exp(− ) + A0 (2) wavelengths (Li et al., 2020; Qiao et al., 2019b).
T2i
i=1 In this study, Pearson correlation and Spearman correlation were
used to select LF-NMR parameters. Pearson correlation can be used to
where M (t) is transverse magnetization, t is time, Ai is signal amplitude, measure the degree of correlation between two variables. For instance,
i is sample number, n is number of hydrogen proton states, T2i is lateral when correlation between two sample sets X and Y is measured, the
relaxation time of hydrogen proton of the i-th component, and A0 is calculation is shown in equation (4):
noisy signal. Collected data are substituted into Eq. (2) to obtain the T2 ∑ ∑ ∑
relaxation information of blueberries. In the test, each sample is tested 3 N XY − X Y
ρX,Y = √̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅ √̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅
∑ ̅ (4)
times, and then the parameters are averaged. ∑ ∑
N X 2 − ( X)2 N Y 2 − ( Y)2

2.3. Evaluation of decayed blueberries Spearman correlation coefficient is a statistic obtained by arranging
the sample values of two elements into a ranking form according to the
In this paper, decayed fruit were evaluated. “Decayed” here refers to size of the data and replacing the actual data with the sample values of
visible fungal growth, pronounced rot, juice leakage in the fruit, and the each element. Assuming that 2 random variables (2 sets) are respectively
identification standards of decay can be referred to the previous research X and Y (which can also be regarded as 2 sets), and the number of ele­
(Wang et al., 2018) as shown in Table 1. ments is N, X and Y are sorted (ascending or descending at the same
time), and the ranking set X and Y of 2 elements are obtained. The
2.4. Key technology introduction Spearman correlation coefficient (Zhang, et al. 2019) is shown in Eq. (5):
∑N
i=1 (xi − x)(yi − y)
2.4.1. Multi-threshold spectral information segmentation (MT-SIS) ρ = √̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅̅
̅ (5)
algorithm ∑ ∑
N N
(xi − x)2 (yi − y)2
The decayed region is similar to sound region due to the dark skin of i=1 i=1

blueberry. It is difficult for the conventional image segmentation


In this study, the correlation coefficient means extremely strong
method based on the gray value to segment the decayed region accu­
correlation when its absolute value is between 0.8 and 1.0, strong cor­
rately. Therefore, we proposed multi-threshold spectral information
relation between 0.6 and 0.8, moderate correlation between 0.4 and 0.6,
segmentation (MT-SIS) algorithm to segment the decayed region of the
weak correlation between 0.2 and 0.4, and extremely weak or no cor­
fruit. The threshold is not determined by the gray value of the image, but
relation between 0.0 and 0.2.
by the spectral value of a certain wavelength. The operation steps are as
2.4.3. Detection models
Table 1 The partial least squares discriminate analysis (PLS-DA) is a multi­
Classification of decayed fruit.
variate statistical analysis method for discriminant analysis. Discrimi­
Class Decay characteristics nant analysis is a common statistical analysis method to determine the
Sound no fungal, no visible juice leakage classification of research objects based on the observed or measured
Decayed visible fungal growth, pronounced rot, juice leakage values of several variables (Alyssa et al., 2019). The probabilistic neural

3
Q. Shicheng et al. Computers and Electronics in Agriculture 184 (2021) 106100

network (PNN) is a forward-propagation network (Porwik et al., 2016), high-speed search for optimal solutions. It has good nonlinear approxi­
which does not require back-propagation optimization parameters. It is mation capacities, and has the advantages of simple structure and
a parallel algorithm developed by Bayesian classification rules and mature technology (Lu et al., 2019).
probability density function estimation method of Parzen window.
Essentially, the Bayesian minimum risk criterion is employed to deter­
mine the type of test sample. PNN neural network plays an important 2.5. Flowchart of detecting decayed fruit
role in solving classification problems. The back propagation neural
network (BPNN) is the most basic neural network. The output results are In this study, HSI system was employed to acquire the hyperspectral
propagated forward while the error is propagated back. BPNN has the images of the fruit, MT-SIS algorithm was proposed to segment decayed
capabilities of self-organization, self-learning, associative storage, and region, and CARS and SPA algorithms were used to extract the charac­
teristic wavelengths, which were input into PLS-DA, PNN and BPNN

Fig. 3. Flowchart of detecting decayed fruit. HSI = hyperspectral imaging; LF-NMR = low-field nuclear magnetic resonance; T2 = transverse relaxation time; PLS-DA
= partial least squares discriminate analysis; PNN = probabilistic neural network; BPNN = back propagation neural network.

4
Q. Shicheng et al. Computers and Electronics in Agriculture 184 (2021) 106100

models to detect decayed fruit. The CPMG of the fruit was acquired by 3.1.3. Extracted characteristic wavelengths
LF-NMR system. T2 relaxation information was obtained, Pearson cor­ According to the previous image segmentation, spectral data were
relation and Spearman correlation analysis were used to select relaxa­ extracted from 5 × 5 pixels region with 4 different locations in the sound
tion parameters, which were input into three models to detect decayed region and the decayed region, and the mean values were calculated to
fruit. The information obtained by HSI and by LF-NMR were fused and replace the average spectral reflectance of the region. Due to more
input into three models to detect decayed fruit. The flowchart of redundant information of spectral curves, it is not conducive for the
detecting decayed fruit is shown in Fig. 3. construction of the model. Therefore, the characteristic wavelengths
should be extracted before the data was input into the model, so as to
3. Results and discussion reduce the input vectors of the model and reduce the introduction of
wrong information into the established model.
3.1. HSI analysis (1) Extracted characteristic wavelengths by CARS
The CARS algorithm was used to extract characteristic wavelengths
3.1.1. Spectral curves analysis from 431 wavelength variables in the band range of 450–1000 nm. It can
To reduce the impact of system noise, the wavelength coverage in be seen from Fig. 6A that when the number of runs was 20, the corre­
this study is 450–1000 nm. Fig. 4 shows the mean spectral reflectance of sponding root mean square error of cross validation (RMSECV) = 0.007
the sound, decayed and background regions. The solid line is the mean was the smallest, indicating that the subset of characteristic wavelengths
spectrum, and the error bar is the standard deviation. The spectral related to decayed blueberries was optimal. Finally, 7 characteristic
reflectance of sound and decayed region of the fruit is different, which wavelengths were extracted by CARS algorithm, which were 475 nm,
may be caused by the changes in the chemical and physical properties. 500 nm, 702 nm, 746 nm, 857 nm, 893 nm and 969 nm, respectively, as
Therefore, the spectral data in the range of 450–1000 nm were used to shown in Fig. 6B.
establish the model to detect decayed fruit, and the spectral data were (2) Extracted characteristic wavelengths by SPA
obtained from the region of interest (ROI) by using image segmentation In this study, SPA algorithm was used to extract characteristic
algorithm. wavelengths from 431 wavelength variables in the band range of 450
nm ~ 1000 nm. Fig. 7A shows that when the number of selected vari­
3.1.2. ROI segmentation ables was 6, RMSECV = 0.132 was the smallest. The 6 characteristic
Due to the dark skin of blueberry, its gray characteristics do not wavelengths were extracted by SPA algorithm, which were 522 nm, 701
change significantly before and after decay, so it is difficult to obtain nm, 715 nm, 857 nm, 890 nm and 980 nm, respectively, as shown in
desirable segmentation results by using conventional image segmenta­ Fig. 7B.
tion algorithm. Therefore, the MT-SIS algorithm was adopted to segment Figs. 6 and 7 show that CARS algorithm and SPA algorithm were
decay ROI of the decayed fruit, as shown in Fig. 6. We acquired the respectively adopted in this study to select the characteristic wave­
hyperspectral image (Fig. 5A), and chose gray image in the 890 nm band lengths of decayed blueberries. The original 431 wavelength variables
(Fig. 5B) as feature image for ROI segmentation due to obvious differ­ were reduced to 7 characteristic wavelengths by CARS algorithm and 6
ence between the sound and decayed regions. The mean spectral characteristic wavelengths by SPA algorithm, which greatly reduced the
reflectance of the background was 0.04, that of the decayed region was input vectors of the model. In this study, PLS-DA, PNN and BPNN models
0.32, and that of the sound region was 0.42. Therefore, the two were used to realize the nondestructive detection of decayed
thresholds of the MT-SIS algorithm were set as f0 = 0.18 and f1 = 0.37, blueberries.
respectively. The decayed region was obtained as shown in Fig. 5C. After
the process of corrosion and expansion, the ROI of decayed fruit 3.1.4. Detection model with characteristic wavelengths
(Fig. 5D) was obtained, so that the mean spectral reflectance of the Of the 188 samples from each category of sound and decayed blue­
decayed region could be extracted (Fig. 5E). berries, 120 were randomly selected as the training set and 68 as the
prediction set. Firstly, the characteristic wavelength variables selected
were normalized, and then the processed data variables were input into
the models. When the PLS-DA model was used to detect decayed blue­
berries, the optimal principal component number was determined and
the PLS-DA model was established by using an interactive verification
method. When the number of principal components was 4, corre­
sponding RMSECV was the smallest, so 4 was selected as the optimal
number of principal components of the model. The “newpnn” was a
function used to establish PNN, PNN “spread” was the distribution
density of the radial basis function which was selected as 1.5, and the
“sim” function was used for network prediction. The “sim” command
causes the specified Simulink model to be executed. When BPNN model
detected decayed blueberries, the activation function was Tansig, the
output layer function was Tansig, the network training function was
Trainlm, the number of training steps was 1000, and the training target
was 0.0001.
It can be seen from Table 2 that when SPA algorithm was used to
extract characteristic wavelengths, the BPNN model performed best for
detecting decayed blueberries. For the training set of the BPNN model,
the identification accuracy of “sound” and “decayed” fruit was 94.17%,
with 7 “sound” fruit misjudged as “decayed” fruit and 7 “decayed” fruit
misjudged as “sound” fruit. For the prediction set of the BPNN model,
Fig. 4. Mean reflectance spectral (solid line) and standard deviation (error bar) the identification accuracy of “sound” and “decayed” fruit was 93.38%,
before preprocessing of sound region, decayed region of the fruit and the with 4 “sound” fruit misjudged as “decayed” fruit and 5 “decayed” fruit
background. Note: Error bar stands for standard deviation. For every 5 data misjudged as “sound” fruit. The “sound” fruit could be misjudged as
points, draw an error bar at the first data point, and skip the next 4 data points. “decayed” fruit since no obvious symptoms could be observed outside

5
Q. Shicheng et al. Computers and Electronics in Agriculture 184 (2021) 106100

Gray image at 890 nm Decayed ROI segment by MT-SIS


A B C
W y
av
el
en
gt

x
h

Hyperspectrual image

E D

Spectrum extraction Corrosion and expansion

Fig. 5. Decay ROI segmentation. ROI = region of interest; MT-SIS = multi-threshold spectral information segmentation.

Fig. 6. Selection of characteristic wavelengths by CARS algorithm for detection of decayed blueberry. Note: Fig. 6A stands for RMSECV variation with the increase of
number of selected variables, and Fig. 6B stands for variable indices of the 7 selected variables corresponding to 431 variables. Mean reflectance spectral (solid line)
and standard deviation (error bar) before preprocessing of sound region and decayed region of the fruit. Error bar stands for standard deviation. For every 5 data
points, draw an error bar at the first data point, and skip the next 4 data points. RMSECV = root mean square error of cross validation.

the fruit due to the dark skin even when the fruit had decayed inside. That is to say, the SPA algorithm extracted the 6 characteristic wave­
Since the light transmission performance is limited (Jie and Wei, 2018), lengths, which were respectively 522 nm, 701 nm, 715 nm, 857 nm, 890
it is unable to detect internal decay effectively. The “decayed” fruit were nm, and 980 nm (Fig. 7B). The intensity of reflectance of different
misjudged as “sound” fruit since the chemical and physical information wavelengths in the hyperspectral image is related to the chemical
on the surface tissue did not change significantly, resulting in “sound” structure of the fruit. Therefore, changes in the physical and chemical
fruit and slightly “decayed” fruit with similar spectral curves. In general, information generated by the fungal metabolism of the blueberry fruit
this paper uses hyperspectral images combined with MT-SIS algorithm can be detected by the difference in spectral reflectance (Siripatrawan
for nondestructive detection of decayed fruit. The SPA algorithm and et al., 2011; Teena et al., 2014). Among them, 522 nm is associated with
BPNN model had relatively better detection results. the blueberry color information (Pan et al., 2019), 701 nm with the
The detection effect of SPA algorithm is better than that of CARS chlorophyll (Zhang et al., 2016; Pan et al., 2019), 715 nm with the
algorithm, which may be due to the fact that the wavelength selected by fourth-order frequency doubling of the C-H group and the third-order
CARS algorithm might be less correlated with decayed blueberries. SPA frequency doubling of the O-H group in carbohydrate (Liu et al.,
algorithm has the advantage of minimizing co-linearity in vector space 2019), 857 nm and 890 nm with the stretching vibrations of the third C-
and eliminating redundant information in the original spectral matrix H (Chu, 2011), and 980 nm with the absorption of water. This is
(Chu, 2011). consistent with the molecular spectroscopy theory, which holds that the
In this research, we employed the SPA algorithm to extract the absorption peak at 980 nm is related to the first- and second-order fre­
characteristics of wavelengths. As shown in Fig. 7A, a sharp fall occurred quency-doubled stretching vibrations of the O-H group (Osborne and
in the starting part of the RMSEV curve as the number of selected Fearn, 1986; Liu et al., 2019), as shown in Fig. 7B.
effective variables increased from 1 to 6. When the number of selected
variables was 6, the corresponding RMSEV = 0.132 was the smallest.

6
Q. Shicheng et al. Computers and Electronics in Agriculture 184 (2021) 106100

Fig. 7. Selection of characteristic wavelengths by SPA algorithm for detection of decayed blueberry. Note: Fig. 7A stands for RMSEV variation with the increase of
number of selected variables, and Fig. 7B stands for variable indices of the 6 selected variables corresponding to 431 variables. Mean reflectance spectral (solid line)
and standard deviation (error bar) before preprocessing of sound region and decayed region of the fruit. Error bar stands for standard deviation. For every 5 data
points, draw an error bar at the first data point, and skip the next 4 data points. RMSEV = root mean square error of verification.

Table 2
Detection performances of models with characteristic wavelengths. FS = full spectrum.
Models Selection algorithm Training set(240) Test set(136)

Sound(120) Decayed(120) Accuracy(%) Sound(68) Decayed(68) Accuracy(%)

PLS-DA FS 110 109 91.25 60 60 88.24


CARS 111 110 92.08 62 62 91.18
SPA 111 112 92.92 61 61 89.71
PNN FS 107 109 90.00 59 59 86.76
CARS 109 110 91.25 60 61 88.97
SPA 110 112 92.50 60 62 89.71
BPNN FS 111 109 91.67 62 61 90.44
CARS 113 111 93.33 63 63 92.65
SPA 113 113 94.17 64 63 93.38

3.2. LF-NMR analysis seen that when the blueberries have more hydrogen protons after decay,
the attenuation rate becomes lower. The attenuation curve is obtained
3.2.1. T2 Information acquisition by inversion of equation (2) to obtain the T2 relaxation information of
There is a small magnetic field around the proton of any substance. the blueberry (Fig. 8B), and its length can reflect the degree of freedom
Therefore, each proton creates a tiny magnetic field, and at the same of water inside the blueberry. A shorter T2 indicates a lower degree of
time, it will be affected by the magnetic field of other protons. When the freedom, and a longer T2 indicates a higher degree of freedom (Li et al.,
distance between protons is relatively small, the T2 of the sample is 2012; Xu et al., 2017).
small; when the distance between protons is relatively large, the T2 of According Fig. 8B, it can be seen that the T2 relaxation time of sound
the sample is large. Therefore, T2 reflects the micro-molecular structure blueberries and decayed blueberries varies from 1 ms to 1000 ms, and
of the sample to some extent (Srivastava et al., 2018). there are three peaks. The peak time corresponding to the three relax­
From the CPMG attenuation curve of blueberries (Fig. 8A), it can be ation times is defined as T21 (1 ms ~ 10 ms), T22 (10 ms ~ 100 ms), and

Fig. 8. Carr-Purcell- Meiboom-Gill (CPMG) sequence decay curves (A) and its corresponding relaxation spectrum (B). Note: T21-cell wall, T22-cytoplasm, T23-vacuole.

7
Q. Shicheng et al. Computers and Electronics in Agriculture 184 (2021) 106100

T23 (100 ms ~ 100 ms). The relaxation time of T21 is the smallest, which “decayed” fruit misjudged as “sound” fruit. For the prediction set, the
is defined as the relaxation time of water in the cell wall. The water in identification accuracy of “sound” and “decayed” fruit was 92.65%, with
the cell wall mainly exists in the sieve tube and the small hole in the duct 4 “sound” fruit misjudged as “decayed” fruit and 6 “decayed” fruit
of the cell wall, which limits water transfer (Black and Pritchard, 2002). misjudged as “sound” fruit. According to the detection results, the
T22 is defined as the relaxation time of water in the cytoplasm, which is number of “sound” fruit misjudged as “decayed” fruit by LF-NMR were
determined by the properties of the cytoplasmic matrix (Raffo et al., less than that by HSI, indicating that LF-NMR could detect the internal
2005). T23 is defined as the relaxation time of water in the vacuoles, decay of the fruit more effectively. The “sound” fruit were misjudged as
since 50–80% of the water is present in the vacuoles, the relaxation time “decayed” fruit since no obvious symptoms could be found inside the
is the largest (Zhang and Mccarthy, 2012). The signal amplitudes A21, fruit. The “decayed” fruit were misjudged as “sound” fruit since no
A22, and A23 are defined as water content of the cell wall, cytoplasm, and obvious water distribution and migration could be found inside the fruit,
vacuole (Zhang et al., 2018). The amplitude ratios are P21, P22, and P23, resulting in “sound” fruit and “decayed” fruit with similar relaxation
which are the ratios of A21, A22, and A23 to the total signal A2 (P2i = A2i/ parameters. In general, the T2 relaxation parameter input identification
A2 × 100%, i = 1, 2, 3), respectively. After decay, the relaxation times model BPNN using LF-NMR can detect decayed fruit; when combined
T21, T22, and T23 increased to varying degrees, while the signal ampli­ with Spearman correlation algorithm, the identification accuracy can be
tudes A21 and A22 increased, and A23 decreased. The amplitude ratios of increased to some extent.
P21 did not change significantly, P22 increased and P23 decreased. In the
experiment, nine parameters of T2 relaxation information were used to
detect decayed blueberry. 3.3. HSI combined LF-NMR analysis

3.2.2. Selection of relaxation parameters According to the foregoing description, it can be seen that the
In this study, the Pearson correlation analysis and Spearman corre­ characteristic wavelengths can reflect the chemical and physical
lation were carried out between the 9 relaxation parameters of T2 and changes on the tissue surface before and after blueberry decay, and the
sound/decayed fruit. The relaxation parameters were selected based on relaxation parameters can reflect the water distribution and migration
correlation coefficients, and the correlation coefficient and its signifi­ inside the fruit. The combination can obtain more comprehensive in­
cance are shown in Table 3. formation about decayed fruit. Therefore, in this study, 6 characteristic
To make sure that the models have a higher identification accuracy, wavelength variables of HSI selected by SPA and 7 characteristic
the relaxation parameters corresponding to extremely strong correlation wavelength variables of HSI selected by CARS, and 7T2 relaxation pa­
and strong correlation were selected in this study, that is, the relaxation rameters of LF-NMR selected by Spearman correlation were fused and
parameters with the absolute value of correlation coefficient larger than input into the models to detect decayed fruit. The detection results are
or equal to 0.6 were selected as the input variables of the models, as shown in Table 5.
shown in Fig. 9. It can be seen from Table 5 that SPA and Spearman correlation were
As can be seen from Fig. 9, the parameters selected by the two respectively adopted in characteristic selection algorithms, and BPNN
methods are consistent. The definition of Spearman correlation is similar model was adopted to detect decayed blueberries with the best effect.
to that of Pearson correlation, but the restrictions are much looser for the For the training set, the identification accuracy of “sound” and
Spearman correlation, so Spearman correlation was adopted in this “decayed” fruit was 98.33%, with 2 “sound” fruit misjudged as
study (Myers and Well, 2003). We selected 7 parameters T21, T22, T23, “decayed” fruit and 2 “decayed” fruit misjudged as “sound” fruit. For the
A22, A23, P22, and P23 (Fig. 9), and input them into the models to detect prediction set, the identification accuracy of “sound” and “decayed”
decayed fruit. Among them, the increase in T21, T22, and T23 was due to fruit was 97.79%, with 2 “sound” fruit misjudged as “decayed” fruit and
the disappearance of cell turgor after cell tissue destruction after decay, 1 “decayed” fruit misjudged as “sound” fruit. According to the detection
which increased the relaxation time (Fundo et al., 2015; Toivonen and results, the misjudged number decreased, indicating that LF-NMR could
Brummell, 2008). There was more water in the cytoplasm and vacuoles, better improve the detection results when no obvious decay symptoms
so the decay of blueberries caused little change in A21 and P21. There­ could be found outside the fruit with decay inside. When slight decay
fore, T21, T22, T23, A22, A23, P22 and P23 could better reflect the change of occurred outside, information fusion could help avoid misjudgment to
relaxation parameters before and after blueberry decay. the greatest extent, leading to better detection results. In general, in­
formation fusion of HSI and LF-NMR could generate optimal detection
3.2.3. Detection model with relaxation parameters results.
It was the same samples of prediction set and test set in hyperspectral According to the test results in Table 2, Table 4 and Table 5, the
imaging data and low-field nuclear magnetic resonance data. Of the 188 detection performance of the BPNN model is better than that of the PNN
samples of sound and decayed blueberries, 120 were selected as the and PLS-DA models, regardless of the training set or the test set. The
training set and 68 as the prediction set. Seven selected T2 relaxation possible reason is that there is nonlinear relationship between hyper­
parameters were normalized, and parameter settings of models were the spectral imaging data and LF-NMR data and whether the blueberries are
same as above. The detection results are shown in Table 4. decayed. The advantange of the BPNN model lies in its strong nonlinear
It can be seen from Table 4 that the BPNN model performed best for mapping ability and generalization ability (Ni and Li, 2016), so the
detecting decayed blueberries, and the accuracy of the training set is classification performance is better. The PLS-DA model is a linear clas­
94.17%, with 8 “sound” fruit misjudged as “decayed” fruit and 6 sification method (Lee et al., 2018), and its classification performance of
nonlinear relation data in this study is not as good as that of the BPNN

Table 3
Table of correlation between T2 relaxation parameters and sound/decayed fruit.
Parameters Pearson Spearman Parameters Pearson Spearman Parameters Pearson Spearman
correlation correlation correlation correlation correlation correlation

T21 0.654 0.669 A21 0.410 0.436 P21 0.504 0.494


T22 0.813* 0.828* A22 0.848** 0.874** P22 0.864** 0.871**
T23 0.758* 0.768* A23 − 0.837** − 0.873** P23 − 0.866** − 0.872**
*
Significance was identified by Spearman correlation analysis (p < 0.05).
**
Significance was identified by Spearman correlation analysis (p < 0.01).

8
Q. Shicheng et al. Computers and Electronics in Agriculture 184 (2021) 106100

Fig. 9. Selection of relaxation parameters of Pearson correlation (A) and Spearman correlation (B). Note: T21, T22 and T23 are relaxation time; A21, A22 and A23 are
signal amplitudes; P21, P22, and P23 are amplitude ratios.

Table 4
Detection performances of models with relaxation parameters. FP = full parameters.
Models Selection algorithm Training set (240) Test set (136)

Sound(120) Decayed(120) Accuracy(%) Sound(68) Decayed(68) Accuracy(%)

PLS-DA FP 110 111 92.08 61 62 90.44


Pearson 112 113 93.75 63 62 91.91
Spearman
PNN FP 110 108 90.83 59 59 86.76
Pearson 112 111 92.92 61 62 90.44
Spearman
BPNN FP 112 112 93.33 62 63 91.91
Pearson 112 114 94.17 64 62 92.65
Spearman

Table 5
Detection performances of models with information fusion.
Models Selection algorithm Training set (240) Test set (136)

Sound (120) Decayed(120) Accuracy(%) Sound (68) Decayed (68) Accuracy(%)

PLS-DA CARS + Spearman 115 116 96.25 65 65 95.59


SPA + Spearman 116 116 96.67 66 65 96.32
PNN CARS + Spearman 114 115 95.42 63 64 93.38
SPA + Spearman 116 117 97.08 64 66 95.59
BPNN CARS + Spearman 117 116 97.08 66 66 97.06
SPA + Spearman 118 118 98.33 66 67 97.79

model. The PNN model requires high representativeness of training LF-NMR parameters, the BPNN model obtained the best detection re­
samples and it is difficult to determine smoothing factor (Chen et al., sults. The identification accuracy of the training set was 98.33%, and
2018), which reduces the detection accuracy. that of the prediction set was 97.79%. Hence, this study showed that the
combination of these two nondestructive techniques could help improve
4. Conclusion the detection results of the decayed fruit.

In this paper, the decayed fruit were detected by using information CRediT authorship contribution statement
fusion of HSI and LF-NMR in a nondestructive manner. HSI system was
employed to acquire the hyperspectral images of the fruit and the MT- Qiao Shicheng: Data curation, Methodology, Software, Visualiza­
SIS algorithm was proposed to segment decayed ROI. The CARS algo­ tion. Tian Youwen: Conceptualization, Writing - original draft. Wang
rithm and SPA algorithm were used to extract the characteristic wave­ Qinghu: Supervision, Investigation, Writing - review & editing. Song
lengths, which were input into the PLS-DA, PNN and BPNN models to Shiyuan: Software, Validation. Song Ping: Software.
detect decayed fruit. Then Pearson correlation and Spearman correla­
tion analyses were used to select relaxation parameters, which were
input into three models to detect decayed fruit. Finally, the information Declaration of Competing Interest
was fused and input into the models to detect decayed fruit. The test
results show that when SPA algorithm was used to extract characteristic The authors declare that they have no known competing financial
wavelengths and Spearman correlation analysis was adopted to select interests or personal relationships that could have appeared to influence
the work reported in this paper.

9
Q. Shicheng et al. Computers and Electronics in Agriculture 184 (2021) 106100

Acknowledgement Hernández-Sánchez, N., Hills, B.P., Barreiro, P., Marigheto, N., 2007. An NMR study on
internal browning in pears. Postharvest Biol. Technol. 44, 260–270. https://doi.org/
10.1016/j.postharvbio.2007.01.002.
This work was supported by National Natural Science Foundation of Jie, D.F., Wei, X., 2018. Review on the recent progress of non-destructive detection
China (Project No: 31701318, 61662057), Basic Research Project of technology for internal quality of watermelon. Comput. Electron. Agric. 151,
Liaoning Education Department (Project No: LSNJC201906), Doctoral 156–164. https://doi.org/10.1016/j.compag.2018.05.031.
Kenouche, S., Perrier, M., Bertin, N., Larionova, J., Ayadi, A., Zanca, M., Long, J.,
Startup Foundation of Inner Mongolia University for Nationalities Bezzi, N., Stein, P.C., Guari, Y., Cieslak, M., Godin, C., Goze-Bac, C., 2014. In vivo
(BS603), Science and Technology Project of Inner Mongolia Autono­ quantitative NMR imaging of fruit tissues during growth using spoiled gradient echo
mous Region (2020GG0190) and Higher Education Science Research sequence. Magn. Reson. Imaging 32, 1418–1427. https://doi.org/10.1016/j.
mri.2014.08.005.
Project of Inner Mongolia Autonomous Region of China (Project No: Lee, L.C., Liong, C.Y., Jemain, A.A., 2018. Effects of data pre-processing methods on
NJZY19155, NJZY21419). Thanks for the editor and anonymous re­ classification of ATR-FTIR spectra of pen inks using partial least squares-
viewers for their helpful suggestions on the quality improvement of our discriminant analysis (PLS-DA). Chemometrics and Intelligent Laboratory Systems.
182, 90–100. https://doi.org/10.1016/j.chemolab.2018.09.001.
present paper. Leiva-Valenzuela, G., Mondragón, G., Mery, D., Aguilera, J.M., 2011. The automatic
sorting using image processing improves postharvest blueberries storage quality. In
Appendix A. Supplementary material Proceedings of 11th international congress on engineering and food.
Leiva-Valenzuela, G.A., Aguilera, J.M., 2013. Automatic detection of orientation and
diseases in blueberries using image analysis to improve their postharvest storage
Supplementary data to this article can be found online at https://doi. quality. Food Control 33 (1), 166–173. https://doi.org/10.1016/j.
org/10.1016/j.compag.2021.106100. foodcont.2013.02.025.
Li, C.B., Liu, D.Y., Zhou, G.H., Xu, X.L., Qi, J., Shi, P.L., Xia, T.L., 2012. Meat quality and
cooking attributes of thawed pork with different low field NMR T21. Meat Sci. 92,
References 79–83. https://doi.org/10.1016/j.meatsci.2011.11.015.
Li, J.B., Huang, W.Q., Tian, X., Wang, C.P., Fan, S.X., Zhao, C.J., 2016. Fast detection and
Alyssa, A., Mary, R.W., Michael, E.S., 2019. Application of likelihood ratios and optimal visualization of early decay in citrus using Vis-NIR hyperspectral imaging. Comput.
decision thresholds in fire debris analysis based on a partial least squares Electron. Agric. 127, 582–592. https://doi.org/10.1016/j.compag.2016.07.016.
discriminant analysis (PLS-DA) model. Forensic Chem. 16, 100188 https://doi.org/ Li, J.B., Zhang, H.L., Zhan, B.S., Zhang, Y.F., Li, R.L., Li, J.B., 2020. Nondestructive
10.1016/j.forc.2019.100188. firmness measurement of the multiple cultivars of pears by Vis-NIR spectroscopy
Black, M., Pritchard, H.W., 2002. Desiccation and Survival in Plants: Drying without coupled with multivariate calibration analysis and MC-UVE-SPA method. Infrared
Dying. CABI, Wallingford, Oxon, UK. Phys. Technol. 104, 103154 https://doi.org/10.1016/j.infrared.2019.103154.
Bourne, R., Banos, C., Davies, J., Banati, R., Henriod, R., 2012. Non-destructive Li, M., Li, B., Zhang, W.J., 2018. Rapid and non-invasive detection and imaging of the
assessment of gamma irradiation on internal mango quality. Image courtesy of the hydrocolloid-injected prawns with low-field NMR and MRI. Food Chem. 242, 16–21.
Australian Nuclear Science and Technology Organisation (ANSTO). ACS013091. https://doi.org/10.1016/j.foodchem.2017.08.086.
http://www.ansto.gov.au/AboutANSTO/MediaCentre/News/ACS013091. Liu, Q., Sun, K., Zhao, N., Yang, J., Zhang, Y.R., Ma, C., Pan, L.Q., Tu, K., 2019.
Carneiro, C.S., Marsico, E.T., Ribeiro, R.O.R., Júnior, C.A.C., Álvares, T.S., Jesus, E.F.O., Information fusion of hyperspectral imaging and electronic nose for evaluation of
2013. Studies of the effect of sodium tripolyphosphate on frozen shrimp by fungal contamination in strawberries during decay. Postharvest Biol. Technol. 153,
physicochemical analytical methods and Low Field Nuclear Magnetic Resonance (LF 152–160. https://doi.org/10.1016/j.postharvbio.2019.03.017.
1 Liu, S.J., Tian, Y.W., Zhang, F., Feng, D., 2017. Hyperspectral Imaging for Nondestructive
H NMR). LWT-Food Sci. Technol. 50, 401–407. https://doi.org/10.1016/j.
lwt.2012.09.009. Detection of Hanfu Apple Diseases Using Successive Projections Algorithm and BP
Chen, P., McCarthy, M.J., Kauten, R., 1989. NMR for internal quality evaluation of fruits Neural Network. Food Science. 38(08), 277-282. https://doi.org/10.7506
and vegetables. Am. Soc. Agri. Engineers. 32, 1747–1753. https://doi.org/ /spkx1002-6630-201708043.
10.13031/2013.31217. Lorente, D., Aleixos, N., Gómez-Sanchis, J., Cubero, S., Blasco, J., 2013. Selection of
Chen, R.Q., Li, J.C., Shang, T., Zhang, J., 2018. Intelligent fault diagnosis of gearbox optimal wavelength features for decay detection in citrus fruit using the ROC curve
based on improved fireworks algorithm and probabilistic neural network. Trans. and neural networks. Food Bioprocess Technol. 6 (2), 530–541. https://doi.org/
Chinese Soc. Agric. Eng. 34 (17), 192–198. https://doi.org/10.11975/j.issn.1002- 10.1007/s11947-011-0737-x.
6819.2018.17.025. Lu, L., Fang, C.Y., Hu, Z.Q., Hu, X.Q., Zhu, Z.W., 2019. Grade classification model
Chen, Y.H., Hung, Y.C., Chen, M.Y., Lin, M.S., Lin, H.T., 2019. Enhanced storability of tandem BPNN method with multi-metal sensor for rice eating quality evaluation.
blueberries by acidic electrolyzed oxidizing water application may be mediated by Sens. Actuat. B 281, 22–27. https://doi.org/10.1016/j.snb.2018.10.062.
regulating ROS metabolism. Food Chem. 270, 229–235. https://doi.org/10.1016/j. Milczarek, R.R., Liang, P.S., Wong, T., Augustine, M.P., Smith, J.L., Woods, R.D.,
foodchem.2018.07.095. Sedej, I., Olsen, C.W., Vilches, A.M., Haff, R.P., Preece, J.E., Breksa, A.P., 2019.
Chu, X.L., 2011. Molecular Spectroscopy Analytical Technology Combined with Nondestructive determination of the astringency of pollination-variant persimmons
Chemometrics and its Applications. Chemical Industry Press, Beijing, pp. 259–274. (Diospyros kaki) using near-infrared (NIR) spectroscopy and nuclear magnetic
Clark, C.J., Forbes, S.K., 1994. Nuclear magnetic resonance imaging of the development resonance (NMR) relaxometry. Postharvest Biol. Technol. 149, 50–57. https://doi.
of chilling injury in ‘Fuyu’ persimm on (Diospyros kaki). New Zealand Journal of org/10.1016/j.postharvbio.2018.11.006.
Crop and Horticultural Science. 22, 209-215. https://doi.org/10. 1080/01140671. Munera, S., Aleixos, N., Besada, C., Gómez-Sanchis, J., Salvador, A., Cubero, S.,
1994. 9513827. Talens, P., Blasco, J., 2019. Discrimination of astringent and deastringed hard ‘Rojo
Defraeye, T., Lehmann, V., Gross, D., Holat, C., Herremans, E., Verboven, P., Brillante’ persimmon fruit using a sensory threshold by means of hyperspectral
Verlinden, B.E., Nicolai, B.M., 2013. Application of MRI for tissue characterisation of imaging. J. Food Eng. 263, 173–180. https://doi.org/10.1016/j.
‘Braeburn’ apple. Postharvest Biol. Technol. 75, 96–105. https://doi.org/10.1016/j. jfoodeng.2019.06.008.
postharvbio.2012.08.009. Myers, J.L., Well, A.D., 2003. Research Design and Statistical Analysis [M](2nd ed.).
Fan, S.X., Li, C.Y., Huang, W.Q., Chen, L.P., 2017. Detection of blueberry internal Mahwah, NJ: Lawrence Erlbaum, 508.
bruising over time using NIR hyperspectral reflectance imaging with optimum Ni, Y.Q., Li, M., 2016. Wind pressure data reconstruction using neural network
wavelengths. Postharvest Biology and Technology. 134, 55-66. https://doi.org/ techniques: A comparison between BPNN and GRNN. Measurement 88, 468–476.
10.1016 /j. postharvbio. 2017.08.012. https://doi.org/10.1016/j.measurement.2016.04.049.
Folch-Fortuny, A., Prats-Montalbán, J.M., Cubero, S., Ferrer, A., 2016. VIS/NIR Osborne, B.G., Fearn, T., 1986. Applications of near infrared spectroscopy in food
hyperspectral imaging and N-way PLS-DA models for detection of decay lesions in analysis. In: Osborne, B.G., Fearn, T. (Eds.), Near Infrared Spectroscopy in Food
citrus fruits. Chemometrics and Intelligent Laboratory Systems. 156, 241–248. Analysis. Longman, New York. https://doi.org/10.1002/9780470027318.a1018.
https://doi.org/10.1016/j.chemolab.2016.05.005. Pan, T.T., Chyngyz, E., Sun, D.W., Paliwal, J., Pu, H.B., 2019. Pathogenetic process
Fundo, J. F., Amaro A. L., Madureira, A. R., Carvalho, A., Feio, G., Silva, C. L. M., monitoring and early detection of pear black spot disease caused by Alternaria
Quintas, M. A. C. 2015. Fresh-cut melon quality during storage: An NMR study of alternata using hyperspectral imaging. Postharvest Biol. Technol. 154, 96–104.
water transverse relaxation time. Journal of Food Engineering, 167: 71-76. https:// https://doi.org/10.1016/j.postharvbio.2019.04.005.
doi.org/ 10.1016/j.jfoodeng.2015.03.028. Pieczywek, P.M., Cybulska, J., Szymańska-Chargot, M., Siedliska, A., Zdunek, A.,
Galed, G., Fernández-Valle, M.E., Martinez, A., Heras, A., 2004. Application of MRI to Nosalewicz, A., Baranowski, P., Kurend, A., 2018. Early detection of fungal infection
monitor the process of ripening and decay in citrus treated with chitosan solutions. of stored apple fruit with optical sensors - comparison of biospeckle, hyperspectral
Magn. Reson. Imaging 22, 127–137. https://doi.org/10.1016/j.mri.2003.05.006. imaging and chlorophyll fluorescence. Food Control 85, 327–338. https://doi.org/
Gonzalez, J.J., Valle, R.C., Bobroff, S., Biasi, W.V., Mitcham, E.J., McCarthy, M.J., 2001. 10.1016/j.foodcont.2017.10.013.
Detection and monitoring of internal browning development in ‘Fuji’ apples using Porwik, P., Doroz, R., Orczyk, T., 2016. Signatures verification based on PNN classifier
MRI. Postharvest Biology and Technology. 22, 179-188. https://doi.org/10. 1016/ optimised by PSO algorithm. Pattern Recogn. 60, 998–1014. https://doi.org/
S0925- 5214(00)00183-6. 10.1016/j.patcog.2016.06.032.
He, K., Tian, Y.W., Qiao, S.C., Yao, P., Gu, W.J., 2019. Detection of rot blueberry disease Qiao, S.C., Tian, Y.W., Song, P., He, K., Song, S.Y., 2019a. Analysis and detection of
by hyperspectral imaging with SIS and RFS. Chinese Journal of Luminescence. 40 decayed blueberry by low field nuclear magnetic resonance and imaging.
(3), 413–421. https://doi.org/10.3788/fgxb20194003.0413. Postharvest Biol. Technol. 156, 110951 https://doi.org/10.1016/j.
postharvbio.2019.110951.

10
Q. Shicheng et al. Computers and Electronics in Agriculture 184 (2021) 106100

Qiao, S.C., Tian, Y.W., Gu, W.J., He, K., Yao, P., Song, S.Y., Wang, J.P., Wang, H.R.Q., Tian, X., Fan, S.X., Huang, W.Q., Wang, Z.L., Li, J.B., 2020. Detection of early decay on
Zhang, F., 2019b. Research on simultaneous detection of SSC and FI of blueberry citrus using hyperspectral transmittance imaging technology coupled with principal
based on hyperspectral imaging combined MS-SPA. Eng. Agric. Environ. Food 12 (4), component analysis and improved watershed segmentation algorithms. Postharvest
540–547. https://doi.org/10.1016/j.eaef.2019.11.006. Biol. Technol. 161, 111071 https://doi.org/10.1016/j.postharvbio.2019.111071.
Qin, J.W., Chao, K.L., Kim, M.S., Lu, R.F., Burks, T.F., 2013. Hyperspectral and Toivonen, P.M.A., Brummell, D.A., 2008. Biochemical bases of appearance and texture
multispectral imaging for evaluating food safety and quality. J. Food Eng. 118 (2), changes in fresh-cut fruit and vegetables[J]. Postharvest Biol. Technol. 48, 1–14.
157–171. https://doi.org/10.1016/j.jfoodeng.2013.04.001. https://doi.org/10.1016/10.1016/j.postharvbio.2007.09.004.
Raffo, A., Gianferri, R., Barbieri, R., Brosio, E., 2005. Ripening of banana fruit monitored Wang, S.Y., Zhou, Q., Zhou, X., Wei, B.D., Ji, S.J., 2018. The effect of ethylene absorbent
by water relaxation and diffusion 1H NMR measurements. Food Chem. 89, 149–158. treatment on the softening of blueberry fruit. Food Chem. 246, 286–294. https://doi.
https://doi.org/10.1016/j.foodchem.2004.02.024. org/10.1016/j.foodchem.2017.11.004.
Siedliska, A., Baranowski, P., Zubik, M., Mazurek, W., Sosnowska, B., 2018. Detection of Wold, J.P., Jakobsen, T., Krane, L., 1996. Atlantic salmon average fat content estimated
fungal infections in strawberry fruit by VNIR/SWIR hyperspectral imaging. by near-infrared transmittance spectroscopy. J. Food Sci. 61 (1), 74–77. https://doi.
Postharvest Biol. Technol. 139, 115–126. https://doi.org/10.1016/j. org/10.1111/j.1365-2621.1996.tb14728.x.
postharvbio.2018.01.018. Wszelaki, A.L., Mitcham, E.J., 2000. Effects of super atmospheric oxygen on strawberry
Siripatrawan, U., Makino, Y., Kawagoe, Y., Oshita, S., 2011. Rapid detection of fruit quality and decay. Postharvest Biol. Technol. 20 (2), 125–133. https://doi.org/
Escherichia coli contamination in packaged fresh spinach using hyperspectral 10.1016/S0925-5214(00)00135-6.
imaging. Talanta 85 (1), 276–281. https://doi.org/10.1016/j.talanta.2011.03.061. Wu, Q.F., Xie, L.J., Xu, H.R., 2018. Determination of toxigenic fungi and aflatoxins in
Srivastava, R.K., Talluri, S.K., Beebi, K., Kumar, B.R., 2018. Magnetic resonance imaging nuts and dried fruits using imaging and spectroscopic techniques. Food Chem. 252,
for quality evaluation of fruits: a review. Food Anal. Methods 11, 2943–2960. 228–242. https://doi.org/10.1016/j.foodchem.2018.01.076.
https://doi.org/10.1007/s12161-018-1262-6. Xu, F.F., Jin, X., Zhang, L., Chen, X.D., 2017. Investigation on water status and
Suchanek, M., Kordulska, M., Olejniczak, Z., Turek, K., 2017. Application of low-field distribution in broccoli and the effects of drying on water status using NMR and MRI
MRI for quality assessment of ‘Conference’ pears stored under controlled atmosphere methods. Food Res. Int. 96, 191–197. https://doi.org/10.1016/j.
conditions. Postharvest Biology and Technology. 124, 100-106. https://doi.org/10. foodres.2017.03.041.
1016/j. postharvbio.2016.10.010. Zhang, C., Guo, C., Liu, F., Kong, W., He, Y., Lou, B., 2016. Hyperspectral imaging
Sun, Y., Xiao, H., Tu, S.C., Sun, K., Pan, L.Q., Tu, K., 2018. Detecting decayed peach using analysis for ripeness evaluation of strawberry with support vector machine. J. Food
a rotating hyperspectral imaging testbed. LWT - Food Science and Technology. 87, Eng. 179, 11–18. https://doi.org/10.1016/j.jfoodeng.2016.01.002.
326–332. https://doi.org/10.1016/j.lwt.2017.08.086. Zhang, L., Mccarthy, M.J., 2012. Black heart characterization and detection in
Sun, Y., Wang, Y.H., Xiao, H., Gu, X.Z., Pan, L.Q., Tu, K., 2017. Hyperspectral imaging pomegranate using NMR relaxometry and MR imaging. Postharvest Biol. Technol.
detection of decayed honey peaches based on their chlorophyll content. Food Chem. 67, 96–101. https://doi.org/10.1016/j.postharvbio.2011.12.018.
235, 194–202. https://doi.org/10.1016/j.foodchem.2017.05.064. Zhang, L., Zhou, X.K., Gu, Q.C., Liang, M.Z., Mu, S.L., Zhou, B., Huang, F., Lin, B., Zou, C.
Tan, M.Q., Lin, Z.Y., Zu, Y.X., Zhu, B.W., Cheng, S.S., 2018. Effect of multiple freeze-thaw X., 2019. Analysis of the correlation between bacteria and fungi in sugarcane tops
cycles on the quality of instant sea cucumber: Emphatically on water status of by LF- silage prior to and after aerobic exposure. Bioresour. Technol. 291, 121835 https://
NMR and MRI. Food Research International. 109, 65-71. https://doi.org/10. 1016/j. doi.org/10.1016/j.biortech.2019.121835.
foodres.2018.04.029. Zhang, Y., Zhao, J.H., Ding, Y., Xiao, H.W., Sablani, S.S., Nie, Y., Wu, S.J., Tang, X.M.,
Teena, M.A., Manickavasagan, A., Ravikanth, L., Jayas, D.S., 2014. Near infrared (NIR) 2018. Changes in the vitamin C content of mango with water state and ice crystals
hyperspectral imaging to classify fungal infected date fruits. J. Stored Prod. Res. 59, under state/phase transitions during frozen storage. J. Food Eng. 222, 49–53.
306–313. https://doi.org/10.1016/j.jspr.2014.09.005. https://doi.org/10.1016/j.jfoodeng.2017.11.00.

11

You might also like