Professional Documents
Culture Documents
Robotics Autonomous Systems: V Tor Sequeira A,,, Joao G.M. Gon Alves A, M. Isabel Ribeiro B
Robotics Autonomous Systems: V Tor Sequeira A,,, Joao G.M. Gon Alves A, M. Isabel Ribeiro B
Autonomous
Systems
ELSEVIER Robotics and Autonomous Systems 16 (1995) 81-91
Abstract
This paper describes a technique for constructing a geometric model of an unknown environment based on data
acquired by a Laser Range Finder on board of a mobile robot. The geometric model would be most useful both for
navigation and verification purposes. The paper presents all the steps needed for the description of the environment,
including the range image acquisition and processing, 3D surface reconstruction and the problem of merging
multiple images in order to obtain a complete model.
Keywords: Range images; Laser sensing; Surface reconstruction; Multiple views; 3D scene modelling
2. Range images
2.1. E r r o r s o u r c e s
the angle 0 between the surface normal and the cess needs to detect and identify both surface
beam as shown in F'ig. 3. discontinuities and continuous surfaces, the roles
A major effect that distorts the image at spe- of edge based and region based techniques can
cific locations is known as the mixed point prob- be seen as complementary.
lem and is illustrated in Fig. 3. The laser foot- Most region-based techniques detect only pla-
print is seen to cross an edge between two ob- nar surfaces. Since the goal is to detect regions
jects. In this case, the distance measurement is a (and not edges), resulting region boundaries do
combination of the distance to the two objects, not necessarily correspond to the projection of
and does not have any physical meaning. This surface discontinuities. Furthermore, region-
effect can be seen in Fig. 2. The top edge of the based methods often do not classify region
cupboard is not a straight line, but rather appears boundaries, and cannot detect curvature curves
as a sawtooth. This effect renders edge detection extreme.
more difficult. Generally, results obtained with edge-based
Another disturbing effect is due to the re- methods are more closely related to real edges
flectance properties, of the target surface. When a than those obtained with region-based methods.
surface is highly specular no laser echo is de- Detected edges are however often fragmented,
tected, since most of the radiation is reflected. no matter which method is used. Edge linking
Furthermore, objects at the same distance with and polygonal approximation are additional pro-
different reflectance coefficients tend to be mea- cessing steps required to organise fragmented
sured at different distances. Brighter objects ap- edges into a structured description corresponding
pear to be 1 to 2 cm closer than darker objects. to relevant scene features.
This is due to the different beam energy reflected A requirement for the extraction of geometric
by the target which affects the detection thresh- features for geometric modelling is that the local-
old level. isation of edges, especially those corresponding
to surface discontinuities, must be as precise as
possible, and that the classification of edges must
3. Range image processing be correct. Based on these criteria, it was decided
to start by using edge-based methods due to the
The goal for range image processing is the poor ability of the region-based methods in edge
extraction of geometric primitives or features rel- localisation and classification.
evant to the current application. Range image
processing segments data into geometric primi- 3.2. Edge-detection
tives so that each image point is assigned a geo-
Methods for detecting edges without comput-
metric representation, such as vertices, curves,
ing surface curvatures are divided in two cate-
surfaces, a n d / o r wglumes.
gories:
3.1. Extraction of geometrical features from range 1. detecting extreme or zero-crossings of surface
derivatives, and
images
2. geometric model fitting.
Range image segmentation techniques are
classified into two major categories: (a) edge or
surface discontinuity based, and (b) surface or
TargetSurface
region based.
Laserfootprint / ~
Edge based segmentation techniques [9,15,17] fromobject 1 ~ ~
attempt the detection of edges or surface discon- i//~ ~ Mixedpoint
tinuities in the range image. Region based tech- ,~" Laserfootprint ~- \ Laserfootprint
niques [2,5,14,19] detect regions corresponding to fromobject2
continuous surfaces. Since the segmentation pro- Fig. 3. Sources of noise in range data.
84 V. Sequeira et al. / Robotics and Autonomous Systems 16 (1995) 81-91
4. 3D surface reconstruction
From the pairs {(Pi, qi)} determined, a new In order to reduce the computational cost,
estimate T 1 can be found minimising e in Eq. (2). only a subset of the surface p c Sp, called the
The new estimated it is used to start the next control points, is used in the registration process.
iteration and the procedure continues until a Since the control points do not need to represent
stopping criterion is :met. The key to this iterative meaningful surface features, and they are only
method resides in finding the nearest point q ~ SQ needed from one surface Sp, they can be simply
to a given point p ~ S e and to compute an esti- picked from a regular grid, instead of every point
mate of the transformation T given a set of pairs on Se. Control points are required to be in smooth
{(Pi, qi)} • areas for two reasons. First the corresponding
The problem of finding the nearest point q on neighbourhoods on surface Q of the control
a geometric shape Q to a given point p has been points will likely be smooth, consequently the
discussed by Besl and McKay [3] where Q can be outcome of the algorithm used for computing the
represented by a set of segments, implicit curves, intersection of a line and the digital surface will
parametric curves, triangular faceted surfaces, be more reliable and stable. Second the surface
implicit surfaces, or parametric surfaces. In the normal can be computed more reliably.
present case Q is a digital surface arranged in a To check the smoothness of the surface at the
range image. If Q is big, the exhaustive search for neighbourhood of point p, a smooth surface (for
the nearest point would be very time consuming. implementation simplicity, a plane is used) is
Another approach 1:o this search problem is to fitted into a 9 x 9 neighbourhood window, using a
relax the demand for finding the exact nearest least-squares method, and the residual standard
point q on Q to p. This idea has been used by deviation is checked. The threshold on the resid-
Potmesil [18] and Chen and Medioni [8]. ual standard deviation was adjusted experimen-
The present approach is based on the ap- tally.
proach used by Chen and Medioni [8]. The idea It is worth pointing out that finding a corre-
here is to approximate Q using its tangent S,~, sponding point q of p on a digital surface Q is
plane at q' (see Fig. 7b). That is different from finding feature correspondence.
Here q is found based on a distance measure,
q=- rain dZ(p,q"), (4)
qft ~Sq,k while feature correspondence is based on a simi-
larity between features, highly dependent on the
with: feature type.
Skq,={q"ln~q,'(q'--q")=O},q'=IkpOQ, (5)
Estimating the 3D rigid transformation
where d is the Euclidean distance from a point to The 3D rigid transformation can be repre-
a plane, l ~ = { a [ ( p - - a ) × n p = 0} is the line nor- sented by the 4 × 4 homogeneous transformation
mal to P at p (see Fig. 7a), q' is the intersecting matrix T,
point of Q with I k, and nkq, is the normal to
surface Q at q'.
000 ' (6)
8. Conclusions
multiple images in order to obtain a complete 3D nat, Representing stereo data with the Delaunay triangu-
model. Direct applications of the resulting 3D lation, Artificial hztelligence 44 (1990) 41-87.
[12] J.G.M. Gon~alves and V. Sequeira, Application of laser
model are 3D scene analysis and interpretation,
range images to design information verification, Proc.
free space modelling for robot navigation, and 1AEA Symposium on International Safeguards, Vienna,
design verification measurements. Austria (March 1994) 219-230.
[13] R.C. Gonzalez and P. Wintz, Digital Image Processing
(Addison-Wesley, Reading, MA, 1987).
[14] R. Hoffman and A.K. Jain, An evidence-based 3D vision
Acknowledgements system for range images, Proc. 1st h~t. Conf. on Comp,tter
1/'tsion, London, England (1987) 521-525.
The authors wish to thank the Electronics and [15] Y.G. Leclerc and S.W. Zucker, The local structure of
image discontinuities in one dimension, IEEE Trans. on
Sensor Based Applications unit head, Mr. F. Pattern Analysis and Machine Intelligence PAM1-9 (3)
Sorel, for all his support and providing the facili- (1987) 341-355.
ties that made possible this work, and Mr. G. [16] J. Maver and R. Bajcsy, Occlusions as a guide for plan-
Campos for the fruitful discussions and for the ning the next view, IEEE Trans. on Pattern Analysis and
use of his planar extraction software. Mr. Se- Machine Intelligence PAMI-15 (5) (1993) 417-433.
[17] B. Parvin and G. Medioni, Adaptive multiscale feature
queira acknowledges the "Programa CIENCIA" extraction from range data, Computer l/ision, Graphics,
from "Junta Nacional de Investiga~o Cientifica and Image Processing 45 (1989) 346-356.
e Tecnol6gica", Portugal, for his Ph.D. grant. [18] M. Potmesil, Generating models of solid objects by
matching 3D surface segments, Proc. 8th Int Joint Conf.
Artificial Intelligence, Karlsruhe, Germany (August 1983)
1089-1093.
References [19] R.W. Taylor, M. Savini and A.P. Reeves, Fast segmenta-
tion of range imagery into planar regions, Computer
[1] K. Arun, T. Huang and S. Blostein, Least-squares fitting l/-tsion, Graphics, and Image Processing 45 (1989) 42-60.
of two 3-D points sets, IEEE Trans. on Pattern Analysis [20] M.W. Walker, L. Shao and R.A. Volz, Estimating 3-D
and Machine Intelligence PAMI-9 (5) (1987) 698-700. location parameters using dual number quaternions,
[2] P.J. Besl and R.C. Jain, Segmentation through variable- CVGIP: Image Understanding 54 (3) (1991) 358-367.
order surface fitting, IEEE Trans. on Pattern Analysis
and Machine Intelligence PAMI-10 (2) (1988) 167-192. .... Vitor Sequeira received a degree in
Electronic and Telecommunications
[3] P.J. Besl and N.D. McKay, A method for registration of Engineering from the University of
3-D shapes, IEEE Trans. on Pattern Analysis and Ma- Aveiro, Portugal (1990). From June
chine Intelligence PAMI-14 (2) (1992) 239-256. 1991 to June 1993 he developed a
[4] M. Buffa, Navigation d'un robot mobile a raide de la control and navigation architecture
for a Mobile Robot in the European
stereovision et de ia triangulation de Delaunay, Ph.D. Commission's Joint Research Centre
Thesis, University of Nice Sophia-Antipolis, 1993. (JRC) -Ispra, Italy. He is currently
[5] G. Campos and J.G.M. Gon~alves, Segmentation of range ~'~ working towards the Ph.D. degree
images based on the split and merge paradigm, JRC ~' with the Instituto Superior Tecnico of
the Technical University of Lisbon,
Technical Note No. 1.93.01 (1993). Portugal in collaboration with the
[6] J. Canny, A computational approach to edge detection, JRC, in the area of 3D Scene Modelling. His research interest
IEEE Trans. on Pattern Analysis and Machine Intelligence include range images, laser sensing, 3D world modelling,
PAMI-8 (6) (1986) 679-698. CAD-based vision for robotic applications.
[7] X. Chen, Mod61isation g6ometrique par vision artifi-
Jo~o G.M. Gon~aives is with the Eu-
cielle, Ph.D. Thesis, T616com Paris 92E023, 1992. ropean Commission's Joint Research
[8] Y. Chen and G. Medioni, Object modelling by registra- Centre, Institute for Systems Engi-
tion of multiple range images, International Journal of neering and Informatics, Electronics
Image and Vision Computing 10 (3) (1992) 145-155. and Sensor Based Applications Unit
since 1988. He is responsible for pro-
[9] T.J. Fan, Describing and Recognizing 3-D Objects Using jects involving the use of Robotics
Surface Properties (Springer-Verlag, Berlin, 1990). Technologies for Nuclear Safeguards
[10] O.D. Faugeras and M. Hebert, The representation, applications, and namely on the use
recognition, and locating of 3-D objects, Intern. Journ. of Mobile Robotics for the Remote
Verification of Fissile Materials Stor-
Robotics Research 5 (3) (1986) 27-52. age Areas. He was the initiator of the
[11] O.D. Faugeras, E. Le Bras-Mehlman and J.D. Boisson- SMART (Semi-autonomous Monitor-
V. Sequeira et a l . / Robotics and Autonomous Systems 16 (1995) 81-91 91
ing and Robotics Technologies) Research Network. Prior to M. Isabel Ribeiro received the M.Sc.
coming to the JRC, he held the position of Associate Profes- and the Ph.D. degrees in Electrical
sor of Electronics at the University of Aveiro, Portugal, where Engineering from Instituto Superior
he worked in medical image processing, and lectured courses T6cnico (IST), Lisbon, Portugal in
on Digital Systems and Digital Image Processing. He has a 1983 and 1988. She is currently Asso-
degree in Electrical Engineering from the Technical Univer- ciate Professor of the Department of
sity of Lisbon (Portugal), an M.Sc. in Digital Systems from Electrical and Computer Engineering
Brunel University (UK), and a Ph.D. from the Medical School of Instituto Superior T6cnico and
of the University of Manchester (UK). His current research member of the Institute for Systems
interests lie in the area of 3D reconstruction, robot's naviga- and Robotics (ISR), Portugal. Start-
tion, control and human-computer interface. ing in October 1994, she spent a six-
month period at the Joint Research
Centre, Italy. Her research interests
include ultrasound and laser data processing applied to the
navigation of autonomous robots and to 3D world modelling.
She is a member of IEEE and of Ordem dos Engenheiros,
Portugal.