Professional Documents
Culture Documents
2016 IEEE-fruits-mango-Methods in Defect Classification of Mangoes Using-Ashok2016
2016 IEEE-fruits-mango-Methods in Defect Classification of Mangoes Using-Ashok2016
2016 IEEE-fruits-mango-Methods in Defect Classification of Mangoes Using-Ashok2016
VaniAshok D.S.Vinod
Computer Science & Engineering Information Science & Engineering
Sri Jayachamarajendra College of Engineering Sri Jayachamarajendra College of Engineering
Mysore, India Mysore, India
vanisj@sjce.ac.in dsvinod@daad-alumni.de
Abstract— The “king of fruits” Mango (Mangifera indica L.) is mango producing countries. India is the predominant supplier of
the most sought after fruit for both direct and indirect consumption mangoes to the west Asian market and is estimated to worth
across the globe. Since it has very high export value, there is a need more than 100 crore. Some of the prominent mango varieties
to develop a technique that is capable of classifying the defects of cultivated in different states of India are Bombai, Bombay Green,
mangoes objectively. Any classifier performance is dependent on Himsagar, Kesar, Suvernarekha, Alphonso, Mankurad,
the features extracted from the region of interest of the sample. In Bangalora, Vanraj, Banganapalli, Dashehari, Langra, Kishen
this paper, a comparative study of feature extraction methods is Bhog, Zardalu, Mankurad, Fazli, Fernandin, Mulgoa, Neelum
made to classify the visible defects of Mangoes. “Alphonso” mango and Chausa.
cultivar was chosen for the experimentation. 1766 color images
with different quality classes were acquired, pre-processed and
textural features were extracted considering one feature at a time A. Defects Occuring in Mangoes
and also in combination for each color image. Hence, we obtained 9 The quality indices of mangoes are uniformity of shape and
different cases of different textural features combination. size, absence of decay and defects, skin color which is specific to
Furthermore, most relevant features were selected from each case a particular variety, flesh color, firmness (juiciness, fiber content)
using sequential forward selection algorithm. The textural features and flavor (sweet, acidity, aroma intensity) [3]. Mangoes are
like statistical, LBP and filter banks were found to be effective in susceptible to physical and physiological defects. The physical
designing neural network (NN) using generalized linear model defects that appear during pre-harvesting, harvesting and post-
classifier with cross validated performance accuracy of 90.09%, harvesting stages are as follows: Anthracnose, jelly seed, insect
90.26% and 90.26% for linear, logistic and softmax activation
damage, lenticel damage, scab, scars, skin breaks and cracks, soft
functions respectively.
nose, stem-end cavity, sunburn, sunscald, bruising, decay,
Keywords—Defects in Mango; Image segmentation; Texture immature, overripe, shriveling.
Features; Neural Network ; Validation Postharvest practices and treatments which are normally
carried out to increase the shelf life, retain the quality, nutrition
I. INTRODUCTION and functional compositions of mangoes also induce significant
defects and damages to the fruits. Some of the post-harvest
The quality monitoring of agricultural and food products has
practices are: 1) Low temperature, where the storage life of
taken a new dimension due to the increasing quality awareness
certain mango cultivars is extended to 2 to 3 weeks by storing at
among consumers. Quality assessment of fruits and vegetables is
10o-15oC temperature range, 2) Ionization radiation, where the
done based on the analysis of external features like color, size,
mangoes are irradiated with the application of gamma rays,
shape, texture and defects/blemishes [1]. Although consumers are
electrons, X-rays, microwaves during storage, to minimize
influenced to select fruits based on their appearance, other
decaying and 3) Usage of chemicals, where mango ripening can
parameters like firmness, aroma and presence or absence of
be retarded upto 6 days by spraying Gibberellic acid prior to
defects play an important role in determining the quality of fruits.
harvest thereby increasing the shelf life [4].
The “king of fruits” Mango (Mangifera indica L.) has very high
nutritive value and rich in carotenes. There are hundreds of These post-harvest practices and storage methods have to be
mango cultivars distributed throughout the world, of which Asia carried out at correct specifications. Otherwise they induce
and India have over 1000 classified varieties [2]. India produces physical defects in fruits such as chilling injury, sunken shoulder
50% of total world’s mango and ranks first among world’s areas, external discoloration, uneven ripening etc. These defects
as chilling injured mangoes (class 1), 552 images were labeled as 800
400
healthy mangoes (class 3). The overall sample distribution that is 200
images in three classes are shown in Fig. 2. (a) (b) (c) (d)
Fig. 3. Segmentation of fruit image. (a) Original image (b) Global thresholding
C. Segmentation obtained from histogram (c) Histogram (d) Segmented image
Image segmentation was performed to analyze the
information necessary for fruit defect assessment i.e., it was D. Feature Extraction/Selection
carried out to isolate the foreground (fruit) from the background After the image segmentation, feature extraction was
(the rest of the image). performed to obtain the quantitative attributes of each sample
from the regions of interest. Color components were extracted depends on the number of classes. The generalized linear model
from each color image in red, green and blue (RGB) channels was trained using the Iterative Reweighted Least Squares (IRLS)
and in addition, gray scale image was obtained from each image. algorithm to set the weights. This was found to be a more
Therefore, four intensity images were obtained from each color efficient alternative to a non-linear optimization routine [17]. 10-
image. The extracted features included standard intensity fold cross-validation was used to evaluate the performance of
features, local binary patterns (LBP), Discrete Fourier the classifier with a confidence interval of each classification
Transforms (DFT) and Discrete Cosine Transform (DCT), Hu being 95%. In the cross validation, 90% of the samples were
with intensity and Gabor filters. The features that depend on used for training and 10% were used for 10 validation
contrast, orientation and location were avoided as the fruit replications.
quality is independent of these characteristics. Extracting the
features upon which the fruit quality does not depend on leads to III. RESULTS AND DISCUSSIONS
false correlation. Each mango image in the dataset is decomposed into R, G, B
The extracted standard chromatic features for RGB color color channels and the grayscale for extracting textual features.
space and grayscale include; Standard intensity information for In this study, SFS with the Fisher discriminant objective function
four intensity channels related to mean, kurtosis, standard was used to reduce the extracted large features. Computational
deviation, skewness, mean gradient (first-order derivative) and time decreases by reducing the overall feature space and this
mean Laplacian (second-order derivative); Linear binary allows for possible use in real-time implementation. Instead of
patterns which are influential features for texture classification considering all the intensity features together, a comparative
were extracted to compute the texture through the relationship study has been done by considering intensity features one at a
between the intensity of each pixel and eight neighboring pixels, time. The feature extraction and selection followed in this study
can be divided into several cases and classifier performance on
using the occurrence histogram [17]; Intensity Gabor textural
each of these cases was analysed. The intensity features in each
features, extracted from the magnitude filtered images with
case, total number of extracted features and the computational
different scales and orientations are helpful for extracting useful time of feature extraction process is given in Table I.
textural features from an image [7]; Filter banks extracted
texture information from image transformations like DFT and
magnitude, phase through DCT; intensity information based on TABLE I. COMBINATION OF INTENSITY FEATURES FOR DEFECT
CLASSIFICATION IN MANGOES
Hu moments. The features were extracted using “Balu” toolbox
for recognition patterns. These features were extracted Extracted Computational
Case Intensity Features used
Features Time in Minutes
separately and also in some combinations to explore which of Standard intensity
the features combinations increases the performance of the features and textural
1 216 24.18
classifier the most. features from Fourier and
After feature extraction, feature selection was done using DCT
Standard intensity
“Sequential Forward Selection” strategy with objective function 2
features and LBP
260 23.56
of Fisher Discriminant (SFS-Fisher). The SFS-Fisher selects a Standard intensity
small subset of features from total features that leads to the 3 features and Hu with 52 23.29
minimal classification error. In the space of selected features, it intensity filters;
guarantees minimum intraclass and maximum interclass Standard intensity
4 features and Gabor 292 79.0
variations [14]. filters;
Standard intensity
E. Classification and Validation 5 features, LBP and Fourier 452 28.0
With optimized selected features, the classification of and DCT;
mangoes into different classes was carried out by Neural Standard intensity
6 features, LBP and Gabor 528 75.34
Network (NN) using generalized linear model. Since the NN filters;
classifier was found to achieve higher performance for Standard intensity
multiclass classification problems with imbalanced training data, 7 features, LBP and Hu 288 23.29
NN architecture was considered for the proposed work [18]. The with intensity;
Standard intensity
performance of the classifier was evaluated considering different features, LBP, Fourier
output activation functions like linear, logistic and softmax. A 8 480 26.42
and DCT and Hu with
two-layer NN with linear activation function, a three-layer NN intensity;
using logistic activation function and a three-layer NN using Standard intensity
features, LBP, Fourier
softmax activation function were used to classify the objects (in 9 and DCT, Hu with 748 80.4
this case, four images per sample) to a specific class. The intensity and Gabor
number of neurons in the input layer corresponds to the number filters.
of input features and the number of neurons at the output layer
TABLE II. CLASSIFICATION ACCURACY RATE WITH ELAPSED TIME IN SECONDS FOR 9 FEATURE EXTRACTION CASES
Classifier Case 1 2 3 4 5 6 7 8 9
Selected features 16 19 19 15 17 19 19 20 20
Neural Network
Accuray 89.42 89.53 88.73 89.71 89.76 89.58 89.18 89.98 90.09
(Linear)
Time 1 1 1 1 1 1 1 1 1
Selected features 19 18 20 20 20 20 19 20 18
Neural Network
Accuray 90.55 89.74 89.53 90.14 90.04 90.25 89.63 90.60 90.26
(Logistics)
Time 4 3 4 4 4 4 5 5 4
Selected features 17 17 13 20 20 17 20 20 20
Neural Network
Accuray 90.33 89.81 89.45 89.91 89.80 90.20 90.13 90.67 90.26
(Softmax)
Time 137 139 135 137 136 138 140 138 143
REFERENCES
[1] Jha, S. N., Jaiswal, P., Narsaiah, K., Kaur, P. P., Singh, A. K., & Kumar R.
"Textural properties of mango cultivars during ripening", Journal of food
science and technology, 50(6), 1047-1057, 2013.
[2] Jha, S.N., A.R.P Kingsly, S. Chopra. "Non-destructive determination of
firmness and yellowness of mango during growth and storage using visual
spectroscopy", Biosystems Engineering 94(3), 397-402, 2006.
[3] Kader, A. A. "Mango quality attributes and grade standards: a review of
available information and identification of future research needs (report to
the National Mango Board)." Davis, CA, USA. Kader Consulting Services,
2008.
[4] Jha S. N, Narsaiah K, Sharma A. D, Singh M, Bansal S. Kumar R " Quality
parameters of mango and potential of non-destructive techniques for their
measurement – a review", J Food Sci Technol, 47(1):1–14, January–
February 2010.
[5] Leiva-Valenzuela, Gabriel A., Renfu Lu, and José Miguel Aguilera.
"Prediction of firmness and soluble solids content of blueberries using
hyperspectral reflectance imaging." Journal of Food Engineering 115.1,
91-98, (2013).
[6] Payel, G., and C. K. Sunil. "Quality Analysis of Pomegranate by Non-
Destructive Soft X-Ray Method." Journal of Food Processing &
Technology 2014, 2014.
[7] Donis-González, Irwin R., et al. "Assessment of chestnut (Castanea spp.)
slice quality using color images." Journal of Food Engineering 115.3, 407-
414, 2013.
[8] Mohammadi, Vahid, Kamran Kheiralipour, Mahdi Ghasemi-Varnamkhasti.
"Detecting maturity of persimmon fruit based on image processing
technique." Scientia Horticulturae 184, 123-128, 2015.
[9] Teoh, C. C., and AR Mohd Syaifudin. "Image processing and analysis
techniques for estimating weight of Chokanan mangoes." Journal of
Tropical Agriculture and Food Science 35.1 , 183, 2007.
[10] Nagle, Marcus, et al. "Non-Destructive Mango Quality Assessment Using
Image Processing: Inexpensive Innovation for the Fruit Handling
Industry." Conference on International Research on Food Security, Natural
Resource Management and Rural Development, 2012.
[11] Aibinu, Abiodun Musa, et al. "Automatic fruits identification system using
hybrid technique." Electronic Design, Test and Application (DELTA),
2011 Sixth IEEE International Symposium on. IEEE, 2011.
[12] Pujari, Jagadeesh Devdas, Rajesh Yakkundimath, Abdulmunaf Syedhusain
Byadgi. "Grading and classification of anthracnose fungal disease of fruits
based on statistical texture features." International Journal of Advanced
Science and Technology 52.1, 121-132, 2013.
[13] Medjahed, Seyyid Ahmed. "A Comparative Study of Feature Extraction
Methods in Images Classification." International Journal of Image,
Graphics and Signal Processing (IJIGSP) 7.3, 16, 2015.
[14] Mery, Domingo, Franco Pedreschi, and Alvaro Soto. "Automated design of
a computer vision system for visual food quality evaluation." Food and
Bioprocess Technology 6.8, 2093-2108, 2013.