Professional Documents
Culture Documents
Defect Identification and Maturity Detection of Mango Fruits Using Image Analysis
Defect Identification and Maturity Detection of Mango Fruits Using Image Analysis
Defect Identification and Maturity Detection of Mango Fruits Using Image Analysis
net/publication/351945160
CITATIONS READS
28 312
2 authors, including:
SEE PROFILE
Some of the authors of this publication are also working on these related projects:
All content following this page was uploaded by Ravindra Manohar Potdar on 28 May 2021.
Email address:
dameshwari.etc@gmail.com (D. Sahu), potdar.bit@gmail.com (R. M. Potdar)
*
Corresponding author
Received: May 2, 2017; Accepted: May 16, 2017; Published: July 11, 2017
Abstract: The image processing and computer vision systems have been widely used for identification, classification,
grading and quality evaluation in the agriculture area. Defect identification and maturity detection of mango fruits are
challenging task for the computer vision to achieve near human levels of recognition. The proposed framework is useful in the
supermarkets and can be utilized in computer vision for the automatic sorting of fruits from a set, consisting of different kind
of fruits. The objective of this work is to develop an automated tool, which can be capable of identifying defect and detect
maturity of mango fruits based on shape, size and color features by digital image analysis. MATLAB have been used as the
programming tool for identification and classification of fruits using Image Processing toolbox. Proposed method can be used
to detect the visible defects, stems, size and shape of mangos, and to grade the mango in high speed and precision.
Keywords: Defect Identification, Agriculture Image Processing, Image Moment, Mango Fruit, Maturity Detection
This proposed work is an attempt to implement an (5) By performing digital image processing, defined as
extensively designed project based on the topics covered. The the acquisition and processing of visual information
project involves a proposed problems and solutions with by computer, computer vision systems allow
MATLAB (Matrix Laboratory) programming. Section 1 analyzing image data for specific applications to
includes a brief description plans, motivation, the necessity of determine how images can be used to extract the
defect identification and maturity detection of mango and required information. Among the most important
purpose of this project. In Section 2, some related works are features for accurate classification and sorting of
discussed. In Section 3, the problems are discussed which products, it can be mentioned the shape. In this paper,
arise during mango image analysis. Section 4 explains the for segmentation, a technique based on Hough
materials and methods involved in the completion of the Transform is used to detection of object shape [6].
proposed work. In Section 5, Experimental results of proposed (6) Machine vision has been introduced in a variety of
work are discussed. In Section 6, conclusion and scope of industrial applications for fruit processing, allowing
future work are made. References are included in Section 7. the automation of tasks performed so far by human
operators. Such an important task is the detection of
2. Related Work defects present on fruit peel which helps to grade or to
classify fruit quality. In this paper, a hybrid algorithm,
The review of literature is accomplished very carefully and which is based on split and merger approach, is
keenly towards the proper definition of the problem. Different proposed for an image segmentation that can be used
methodologies are being investigated to propose and in fruit defect detection [7].
implement the present work. The reviewed literature has been (7) Variable lighting condition, occlusions and clustering
classified into primary heads for the sake of the are some of the important issues needed to be
comprehensive analysis study such a classification shall help addressed for accurate detection and localization of
to study literature as per their context. Some of the most fruit in orchard environment. This paper summarizes
important implementation of image processing in agricultural various techniques and their advantages and
products is: disadvantages in detecting fruit in plant or tree
(1) The image processing method for classification of canopies. The paper also summarizes the sensors and
orange by ripeness is developed. In this work, the systems developed and used by researchers to localize
proper degree of maturity is determined and based on fruit as well as the potential and limitations of those
that orange have been classified by histogram and systems [8].
morphological analysis. It uses standard CODEX (8) Image processing is an efficient tool for analysis in
benchmark, in that quality level of the commercial various fields and applications in agriculture. Today’s
types of specified orange [2]. very advanced and automated industries used more
(2) A fusion approach is implemented for multiclass fruit accurate method for different inspection processes of
and vegetable classification task in the distribution agriculture object. This task is known as robotics task.
center and supermarket. A novel unified approach has In Indian agriculture industry, many kinds of activities
been introduced, to combine many features and are done like quality inspection, sorting, assembly,
classifier. This method requires less training of data painting, packaging. Above mentioned activities are
than another method that combines features done manually. By using Digital Image processing
individually and fed separately to classification tasks done conveniently and efficiently. Using Digital
algorithm [3]. image processing many kinds of task fulfills like
(3) Using just one image feature to secure the class object Shape, size, color detection, texture extraction,
separability might not be sufficient, so it is necessary firmness of purpose, aroma, maturity, etc. In this paper,
to extract and combine those features which are useful various algorithms of shape detection are explained,
for the fruit and vegetable recognition problem. The and conclusions are provided for best algorithm even
result of the system depends upon the image merits and demerits of each algorithm or method are
segmentation method, so efficient image segmentation described [9].
must be used. In the literature, available classifiers (9) Seasonal fruits, like mango, are harvested from
work on two classes only, but in the classification gardens or farms in batches; the mangoes present in
problem author considered more than two categories, each batch are not uniformly matured, therefore,
so it is a major issue to use a binary classifier in a sorting of mangoes into different groups is necessary
multiclass scenario [4]. for transporting them to various locations. With this
(4) An image processing based hybrid algorithm has been background, this paper proposes a
implemented for automatic identification and machine-vision-based system for classification of
classification of fruits. The hybrid method relies on the mangoes by predicting maturity level and aimed to
techniques of Fourier descriptors (FD), spatial domain replace the manual sorting system. The prediction of
analysis (SDA) and artificial neural network (ANN) maturity level has been performed from the video
[5]. signal collected by the Charge Coupled Device (CCD)
American Journal of Artificial Intelligence 2017; 1(1): 5-14 7
camera placed on the top of the conveyor belt carrying studies done in the field of defect identification and maturity
mangoes. Extracted image frames from the video detection of mango fruit. The study focused mainly on
signal have been corrected and processed to extract different methods and applications of Mango fruit defect
various features, which were found to be more identification and maturity detection system. A variety of
relevant for the prediction of maturity level [1]. methods has been suggested by the researchers to improve the
(10) This paper focuses on the automatic detection of the performance of the scheme. This literature survey has
pomegranate fruits in an orchard. The image is provided useful insight into different techniques that can be
segmented based on the color feature using k-means utilized to plan design and development of the proposed
clustering algorithm. The K-Means algorithm method.
produces accurate segmentation results only when
applied to images defined by similar regions on 3. Problem Identification
texture and color. Segmentation begins by clustering
the pixels based on their color and spatial features. The To enhance the quality and quantity of the agriculture
clustered blocks are then merged to a particular product, there is a need to adopt the new technology. Image
number of regions. Thus it provides a solution for processing approach is a non-invasive technique, which
image retrieval. Thus this paper proposed the provides consistent, reasonably accurate, less time consuming
simulation results that have been attained using the and cost effective solution. A generalized block diagram of
algorithm [10]. defect identification and maturity detection of mango fruits is
The literature survey gives a keen insight into the various shown in “Figure 1”.
Figure 1. A generalized block diagram of defect identification and maturity detection of mango fruits.
Some important factors and issues, which are needed to be environment, so subtraction of background is essential for
considered while development of defect identification and proper identification and classification of mango fruits.
maturity detection of mango fruits using image analysis is Background subtraction also reduces the scene complexities
listed below: such as shading, light variation, background clutter. “Figure 2”
shows due to the severe occlusion; it is impossible to detect
3.1. Background Subtraction the mangos even manually correctly.
It is necessary to extract mango from the cluttered
shape descriptors are boundary-based shape features. shown in “Figure 3”. Theoretically, proposed algorithm
Color - Color value and degree of color distribution are involves three types of processing i.e. low level, intermediate
measured based on R, G, and B color component ratio. and high-level processing. In low-level processing, input
Example: Color may be different for example; Orange ranges image/dataset is pre-processed. Pre-processing includes RGB
from being green to yellow, to patchy and brown. to gray conversion, image binarization, and image filtering.
Size - Size may be large, medium or small. It is measured Intermediate level processing involves background
from the maximum length or area or calculated volume from subtraction, feature extraction, and filtering. Identification of
several images. defected region and detection of the maturity level of mango
fruit has been performed in high-level processing.
3.3. Classifier
4.1. Database
In classification process different feature such as
geometric and, non-geometric features need to be classified. Database of 100 calibrated images of mangoes ‘Kent’ (50
So, it is necessary to address the issue of proper selection of mangos photographed by both sides) is obtained from the web
classifier. [11]. These samples are mangos cv. ‘Kent’ in different
maturity stages. The image acquisition system was composed
4. Materials and Methods of a digital camera (EOS 550D, Canon Inc.) used to acquire
high-quality images with a size of 1200 x 800 pixels and a
The Proposed algorithm for defect identification and resolution of 0.03 mm/pixel. Images of fruit were stored in
maturity detection of mango fruits using image analysis is JPG format due to internet limitations.
Figure 3. Automatic Defect Identification and Maturity Detection for Mango Fruit.
American Journal of Artificial Intelligence 2017; 1(1): 5-14 9
The images were taken by placing each sample inside an is performed to remove background and foreground noise
inspection chamber in which contained the camera and the from the database.
lighting system. The vision system used to acquire the images
Algorithm 1: Low-Level Processing
is shown in “Figure 4”. The camera was placed at a distance of
Start
20 cm from the samples. Illumination was achieved using four Step 1: Read each image into the MATLAB from the particular folder of
lamps that contained two fluorescent tubes. The angle mango dataset.
between the axis of the lens and the sources of illumination Step 2: Convert the original image into greyscale image and binary image.
was of approximately 45 degrees with the diffuse reflection Step 3: Filter the image using a median filter.
Step 4: Remove or subtract the background from pre-processed image.
responsible for the color occurs at 45 degrees of the incident
Step 5: Filter the image using a median filter.
light. Stop.
m01 = ∫∫ R
x f ( x, y ) dxdy; m10 = ∫∫ R
y f ( x, y ) dxdy (2)
µij = ∫∫ R ( x − xg )i ( y − y g ) j f ( x, y ) dx dy (3)
The detection of mango stems, mainly by mango's contour 5. Result and Discussion
line matrix to achieve differential. Using the image
processing technology, mango extracts the contour line The proposed work is an extension of the recently published
information from the intensity image, and then difference article [13]. The proposed algorithm is an attempt to make a
and the approximate derivative are determined from contour simple and efficient tool for defect identification and maturity
information, then the difference values are summed, and a detection of mango fruits using image processing. In this
sum value is obtained. This value is the basis for us to section, the result at various stages of the algorithm is shown
determine whether the mature. When it is mature, then the and discussed. Experiments were carried out with a set of 28
sum will be 0 to −5 × 10 5 (estimated value), and immature of Mangos. A preliminary result is shown in “Figure 7” and
the sum value is positive. “Figure 8”. These shows the better results are obtainable using
proposed algorithm.
Figure 7. No Defect and Mature Mango Result (a) Original Image (b) Grey-scale Image (c) Binary Image (d) Edge Detection (e) Contour Filling (f) Filtered
Image (g) Contour Outline.
Figure 8. Defected and Immature Mango Result (a) Original Image (b) Grey-scale Image (c) Binary Image (d) Edge Detection (e) Contour Filling (f) Filtered
Image (g) Contour Outline.
The proposed algorithm is tested using 28 mango images. “Figure 9” and “Figure 10” shows the results at various stages of an
algorithm for 28 mango images. Among 28 mango images, 14 mangos are defected and 14 are not defected.
“Figure 11” shows that plot of defect identification of Mango based on quality ratio b=a/(x*y) value. It is observed from the
“Figure 9” and “Figure 10” proposed algorithm efficiently and accurately determines the quality of mango.
12 Dameshwari Sahu and Ravindra Manohar Potdar: Defect Identification and Maturity Detection of
Mango Fruits Using Image Analysis
the mango’s quality was export, local or reject. An optimal and Martinez-Sandoval, and H. Cervantes-De-Avila,
adaptive threshold method can be used for segmentation of “Implementation of Hough Transform for fruit image
segmentation,” in Procedia Engineering, 2012, vol. 35, pp.
mango from the background. 230–239.