Professional Documents
Culture Documents
Leaf Area Measurement of Selected Vegetable Seedlings Using Elliptical Hough Transform
Leaf Area Measurement of Selected Vegetable Seedlings Using Elliptical Hough Transform
net/publication/289158704
CITATIONS READS
20 1,229
2 authors, including:
Ta-Te Lin
National Taiwan University
98 PUBLICATIONS 1,318 CITATIONS
SEE PROFILE
All content following this page was uploaded by Ta-Te Lin on 28 July 2016.
ABSTRACT. An image–processing algorithm using the elliptical Hough transform was developed to determine position,
orientation, and leaf area of seedling leaves from top–view images. The algorithm significantly reduced the computational
effort and memory requirement and was capable of identifying partly occluded leaves. Four varieties of vegetable seedlings,
namely cabbage, Chinese mustard, edible amaranth (A. mangostanus Linn.), and edible amaranth (A. inamoenus Willd.),
at various growth stages were used to test the efficacy of the measurement algorithm. For measurements of individual leaf
area, the relative estimation errors were 8.2 µ9.3%, 14.4 µ11.7%, 27.5 µ14.4%, and 16.0 µ11.0%, respectively. For
measurements of total leaf area, the relative estimation errors were 16.0 µ6.4%, 17.0 µ9.8%, 24.9 µ8.1%, and 18.4 µ9.4%
in corresponding order. The sources of error were mainly due to tilting leaves and unsuccessful identification of small or
severely occluded leaves of the seedling.
Keywords. Image processing, Leaf area, Hough transform, Feature extraction.
P
lant growth measurement and analysis are useful in results showed that the leaf areas estimated by the three
describing and interpreting the performance of instruments were not significantly different from the directly
whole–plant systems grown under various measured total leaf area.
conditions. Among many useful indicators of plant The advent of computer–based image–processing sys-
growth, leaf area is perhaps the most important parameter tems has further boosted the applications of machine vision
influencing photosynthesis, evapotranspiration, transpira– techniques for assessment of plant characteristics (Trooien
tion, and productivity; thus, its measurement is of great and Heermann, 1992; Howarth and Stanwood, 1993; Nyak-
importance. Traditional methods for leaf area measurement wende et al., 1997). Meyer and Davison (1987) demonstrated
includes correlation of leaf area with weighing, square that both a single–camera and a dual–camera video imaging
counting, and mechanical and photoelectric planimetry. system worked well for determining insitu leaf area, stem
Marshall (1968) comprehensively reviewed the numerous diameter, and petiole angle of soybeans. The single–camera
methods for leaf area measurement. Direct leaf area system proved useful in measuring canopy closure from
measurement methods are generally simple and reliable but overhead images. Storlie et al. (1989) also applied image–
usually tedious and destructive. Many innovative and processing techniques to growth analysis of corn and soybean
efficient methods have recently been introduced. These plants. The total plant leaf area and wet and dry plant weight
methods, including hemispheric photographs and gap were determined by correlating the profile images of the
fraction analysis, have been applied successfully to forest and plant.
agricultural canopies. Sommer and Lang (1994) used two Analysis of leaf morphology also holds interests of
commercially available instruments to measure indirectly botanists because it relates to plant identification and
the leaf area index of spur and minimal pruned vines. Both developmental studies in many research areas. Identification
instruments were developed from the principles of gap of plants plays an important role in developing automatic
fraction theory (Lang et al., 1985), which recovers machineries for pest, disease, and weed control with machine
geometrical information about foliage from gap fractions by vision (Yonekawa et al., 1996). A common source of
measuring the transmission of light through the leaf canopy information used to identify plants is leaf shape. Leaf shape
at a range of angles. Brenner et al. (1995) used three has been used extensively to identify various agronomically
commercially available instruments to measure leaf areas of important plants and agricultural products (Woebbecke et al.,
individual Retama sphaerocarpa bushes. Their experimental 1995; Guyer et al., 1986; Yonekawa et al., 1996). One of the
prerequisites for leaf shape analysis using image processing
is to locate the leaf boundaries of a plant. This can be
Article was submitted for review in October 2001; approved for achieved by image segmentation and image–processing
publication by the Information & Electrical Technologies Division of algorithms, such as edge detection or blob analysis. However,
ASAE in May 2002. when leaves are partially occluded by adjacent leaves, the
The authors are Chung–Fang Chien, Graduate Student, and Ta–Te difficulty in locating and segmenting leaves in an image
Lin, ASAE Member Engineer, Professor, Department of Bio–Industrial
Mechatronics Engineering, National Taiwan University, Taipei, Taiwan.
increases. Franz et al. (1991a, 1991b, 1995) developed a
Corresponding author: Ta–Te Lin, Department of Bio–Industrial method for identifying several kinds of seedlings according
Mechatronics Engineering, National Taiwan University, No. 1, Roosevelt to their leaf shape as described by a curvature function. They
Road, Sec. 4, Taipei, Taiwan 106, R.O.C.; phone: 886–2–23929416; fax: did not succeed in identifying single boundaries of regions of
886–2–23929416; e–mail: m456@ccms.ntu.edu.tw.
multiple leaves when using the Fourier–Mellin correlation
x2 y2
+ =1 (1)
a2 b2
where x and y represent Cartesian coordinates of any point on Reduce image resolution from
the ellipse, and a and b are the major and minor axes of the 512 × 512 to 32 × 32 pixels
ellipse, respectively. Equation 1 can be expressed in polar
coordinates by substituting x = r@cosq and y = r@sinq. After
rearranging, it becomes:
Search for candidate ellipses
a2b2
r= (2) and sort the list.
b2 cos2 θ + a2 sin2 θ
where r denotes the distance between the point on the ellipse
and the center point of the ellipse, and q is the angle between
the x–axis and the line connecting the two points.
Equation 2 is an extension of the standard parametric Recalculate the possibility of Delete duplicated points in the less
Hough transform to ellipses. It is clear that the elliptical candidate ellipses. possible ellipses.
Hough transform imposes the requirement of a five–dimen-
sional parameter space (Muammar and Nixon, 1991). That is
to say, the transformation requires intensive computation. To
reduce the computational complexity, one can use the
method of image pyramids to reduce image resolution Choose the ellipses with threshold
Increase image resolution
(Richards and Jia, 1999). This method need not search every from X× Y to 2X× 2Y pixels.
value of the accumulated occurrence
pixel of an image. It is possible to localize edges quickly by and sort the list.
finding apparent edges (regions) in the upper levels of image
pyramids. The succeeding lower pixel groupings are then
searched to localize edges better by the increasing image
resolution. To further reduce the computational complexity No
and memory requirement of the elliptical Hough transform, Reach the
a new algorithm was implemented in this research. The final resolution?
algorithm consists of three steps: (1) reducing image
resolution, (2) exhaustive search for ellipses, and (3)
Yes
increasing iteratively image resolution for more precise
ellipses. A flowchart of the 3–step algorithm is shown in
Obtain the final
figure 1.
list of ellipses.
to locate leaves in images for four different varieties of ESTIMATION OF INDIVIDUAL LEAF AREA
vegetable seedlings. The type I error in the table denotes the The elliptical Hough transform algorithm developed in
error rate of seedling leaves that were not detected success- this research was useful not only in locating the position and
fully, whereas the type II error denotes the error rate of orientation of leaves but also in estimating leaf area and leaf
non–existing leaves that were falsely identified. The type I number of a seedling plant. We first examined the perfor-
errors for the four vegetable seedlings ranged from 8.70% to mance of the algorithm by comparing the leaf area estimation
10.94%. The type II errors were approximately 8% except for of individual leaves. Later we analyzed the results of total
the case of Chinese mustard, which was 17.54%. The source leaf area estimation. Comparisons were made between the
of error was mainly due to occlusion of leaves, especially for non–destructive leaf area estimation from the top–view
seedlings of later growth stage (Chien and Lin, 2000b). Small image and the leaf area measurement of the dissected leaves
leaves in a seedling also tended to be ignored by the search from the same seedling.
algorithm due to relatively fewer boundary pixels that were Figure 5 shows the experimental results of leaf area
used for the determination of the candidate ellipse. However, estimation using the algorithm developed in this research.
this source of error did not affect significantly the estimation Leaf areas of individual seedling leaves were estimated from
of seedling total leaf area. the top–view images after the leaf positions were located
using the elliptical Hough transform. The estimated values
were compared with their corresponding actual leaf area as
Table 2. Summary of the estimation for leaf number of four different varieties of vegetable seedlings
Number of Actual Leaf Missed Leaf False Leaf Type I Error Type II Error
Seedlings Tested Number Number Number (%) (%)
Cabbage 28 63 6 5 8.70 7.94
Chinese mustard 11 57 7 10 10.94 17.54
Edible amaranth[a] 20 75 9 6 10.71 8.00
Edible amaranth[b] 15 58 5 5 7.94 8.62
Total 74 253 27 26 9.64 10.28
[a] A. mangostanus Linn.
[b] A. inamoenus Willd.
Figure 5. A comparison of actual leaf area and estimated leaf area of individual seedling leaves: (A) cabbage, (B) Chinese mustard, (C) edible amaranth
(A. mangostanus Linn.), and (D) edible amaranth (A. inamoenus Willd.).
the Chinese mustard seedlings was the smallest because their greater error of estimation. To circumvent this problem, one
leaves were planar and oriented more horizontally than the may consider obtaining extra information of leaf orientation
others. In contrast, the curly and tilted leaves of edible from side–view seedling images to correct the error, or use a
amaranth (A. mangostanus Linn.) seedlings resulted in calibration function such as equations 7 to 10 to correct the
underestimation of total leaf area for specific vegetable unsuccessful identification of small or severely occluded
seedling. leaves of the seedling. The algorithm was most suitable for
leaf area measurement of seedlings with planar leaves with
horizontal orientation, such as Chinese mustard. For vegeta-
ble seedlings with tilting leaves, such as amaranth, the
CONCLUSIONS estimation error became significant. It is suggested that
An image–processing algorithm using the elliptical
additional correction methods using calibration equations or
Hough transform to measure non–destructively the leaf area information extracted from side–view images could be used
of vegetable seedlings was developed in this research. The
to reduce the estimation error.
3–step algorithm reduced significantly the computational
effort and memory requirement. This provides a practical
means to apply the algorithm to many applications such as
plant identification, classification, and robotic applications. REFERENCES
The unsupervised algorithm allowed for locating position Ballard, D. H. 1981. Generalizing the Hough transform to detect
and horizontal orientation of seedlings leaves and estimation arbitrary shapes. Pattern Recognition 13(2): 111–122.
of individual and total leaf area from the top–view image of Beverly, R. B., and M. W. van Iersel. 1998. Calibration of a video
a seedling, even when seedling leaves were partly occluded. image–analysis system for measurement of stem length, leaf
area, and percent ground coverage. Commun. Soil Sci. Plant
The efficacy of the leaf locating and measurement algorithm
Anal. 29(9&10): 1071–1081.
was tested with four varieties of vegetable seedlings at Brenner, A. J., M. C. Romeo, J. G. Haro, M. A. Gilabert, L. D.
various growth stages. Incoll, J. M. Fernandez, E. Porter, F. I. Pugnaire, and M. T.
The experimental results revealed that the developed Younis. 1995. A comparison of direct and indirect methods for
algorithm could be used for leaf area measurement with measuring leaf and surface areas of individual bushes. Plant,
satisfactory accuracy. The sources of error were mainly due Cell, and Environment 18: 1332–1340.
to tilting or oblique orientation of seedling leaves, and