Professional Documents
Culture Documents
Machine Vision Machine Vision: Technical University of Crete
Machine Vision Machine Vision: Technical University of Crete
MACHINE VISION
Euripides G.M. Petrakis Michalis Zervakis
http://www.intelligence.tuc/~petrakis http://courses.ece.tuc.gr
Chania 2010
E.G.M. Petrakis Machine Vision (Introduction) 1
Machine Vision
The goal of Machine Vision is to create a model of the real world from images
A machine vision system recovers useful information about a scene from its two dimensional projections The world is three dimensional Two dimensional digitized images
E.G.M. Petrakis
Illumination
Image Acquisition
Scene
2D Digital Image
Image Description
Feedback The goal of a machine vision system is to compute a meaningful description of the scene (e.g., object)
Analog to digital conversion Remove noise/patterns, improve contrast Find regions (objects) in the image Take measurements of objects/relationships Match the above description with similar description of known objects (models)
5
Image Segmentation
Image Analysis (Binary Image Processing) Model Matching Pattern Recognition E.G.M. Petrakis
Image Processing
Image Processing
Input Image
Output Image
Image transformation image enhancement (filtering, edge detection, surface detection, computation of depth). Image restoration (remove point/pattern degradation: there exist a mathematical expression of the type of degradation like e.g. Added multiplicative noise, sin/cos pattern degradation etc).
E.G.M. Petrakis Machine Vision (Introduction) 6
Image Segmentation
Image Segmentation
Input Image
Regions/Objects
Image Analysis
Image Analysis
Measurements
Take useful measurements from pixels, regions, spatial relationships, motion etc.
Grey scale / color intensity values; Size, distance; Velocity;
E.G.M. Petrakis Machine Vision (Introduction) 8
Pattern Recognition
Model Matching Pattern Recognition Image/regions Measurements, or Structural description
Class identifier
Gray level image: f = f(x,y) - 3D image f=f(x,y,z) Color image (multi-spectral) f = {Rred(x,y), Ggreen(x,y), Bblue(x,y)}
E.G.M. Petrakis Machine Vision (Introduction) 10
What a computer sees is very different from what a human sees. A computer sees pixels (arithmetic values) while a human sees shapes, structures etc.
E.G.M. Petrakis
11
E.G.M. Petrakis
E.G.M. Petrakis
13
PR is usually used to classify objects but object recognition in machine vision usually requires many other techniques.
E.G.M. Petrakis Machine Vision (Introduction) 14
Pattern class: set of patterns with similar characteristics. Take measurements from a population of patterns. Classification: Map each pattern to a class.
E.G.M. Petrakis Machine Vision (Introduction) 15
Structure of PR Systems
input
Sensor Processing Measurements Classification class
E.G.M. Petrakis Machine Vision (Introduction) 16
Example of Statistical PR
Two classes: I. W1 Basketball players II. W2 jockeys Description: X = (X1, X2) = (height, weight) X1 W2 .. .. . .. . . .. .
W1
.. . ..
E.G.M. Petrakis
Break down an image (shape) into a sequence of such primitives. The way the primitives are related to each other to form a shape is unique.
Use a grammar/algorithm Parse the shape
E.G.M. Petrakis Machine Vision (Introduction) 18
Primitives
Each digit is represented by a waveform representing black/white, white/black transitions (scan the image from Left to right.
E.G.M. Petrakis
20
Psychophysics
Psychophysics and cognitive science have studied human vision for a long time. Many techniques in machine vision are related to what is known about human vision.
E.G.M. Petrakis
23
They have also applied to segmentation and other machine vision tasks.
E.G.M. Petrakis Machine Vision (Introduction) 24
E.G.M. Petrakis
Robot Vision
Remote Sensing
Take images from high altitudes (from aircrafts, satellites). Find ships in the aerial image of the dock.
Find if new ships have arrived. What kind of ships?
E.G.M. Petrakis
27
E.G.M. Petrakis
28
Medical Applications
Assist a physician to reach a diagnosis. Construct 2D, 3D anatomy models of the human body.
CG geometric models.
Assumptions:
Good lighting; Low noise; 2D images
E.G.M. Petrakis
31
Human Hardware
Photoreceptors take measurements of light signals.
About 106 Photoreceptors.
Retinal ganglion cells transmit electric and chemical signals to the brain
Complex 3D interconnections; What the neurons do? In what sequence? Algorithms?
Heavy Parallelism.
E.G.M. Petrakis Machine Vision (Introduction) 32
E.G.M. Petrakis
33
Course Outline
Introduction to machine vision, applications, Image formation, color, reflectance, depth, stereopsis. Basic image processing techniques (filtering, digitization, restoration), Fourier transform. Binary image processing and analysis, Distance transform, morphological operators.
E.G.M. Petrakis
34
Bibliography
Machine Vision, Ramesh Jain, Rangachar Kasturi, Brian G. Schunck, Mc Graw-Hill, 1995 (highly recommended!).
"Image Processing, Analysis and Machine Vision", Milan Sonka, Vaclav Hlavac, Roger Boyle, PWS Publishing, Second Edition.
"Machine Vision, Theory, Algorithms, Practicalities'', E. R. Davies, Academic Press, 1997.
E.G.M. Petrakis Machine Vision (Introduction) 37
"Practical Computer Vision Using C'', J. R. Parker, John Wiley & Sons Inc., 1994. Selected articles from the literature. Lecture notes (http://www.intelligence.tuc/~petrakis) Webcourses (http://courses.ece.tuc.gr)
E.G.M. Petrakis
38
Grading Scheme
Final Exam (F): 40%, min 5 Assignments (): 40% Two assignments
Obligatory
E.G.M. Petrakis
39