Digital Image Processing

Introduction & Fundamentals

 Journals & Conferences
in Image Processing
► Journals:
— IEEE T IMAGE PROCESSING
— IEEE T MEDICAL IMAGING
— INTL J COMP. VISION
— IEEE T PATTERN ANALYSIS MACHINE INTELLIGENCE
— PATTERN RECOGNITION
— COMP. VISION AND IMAGE UNDERSTANDING
— IMAGE AND VISION COMPUTING
……

► Conferences:
— CVPR: Comp. Vision and Pattern Recognition
— ICCV: Intl Conf on Computer Vision
— ACM Multimedia
— ICIP
— SPIE
— ECCV: European Conf on Computer Vision
— CAIP: Intl Conf on Comp. Analysis of Images and Patterns
……

2
Why digital image processing?
 Introduction
► What is Digital Image Processing?
Digital Image
— a two-dimensional function f ( x, y )
x and y are spatial coordinates
The amplitude of f is called intensity or gray level at the point (x, y)

Digital Image Processing

— process digital images by means of computer, it covers low-, mid-, and high-level
processes
low-level: inputs and outputs are images
mid-level: outputs are attributes extracted from input images
high-level: an ensemble of recognition of individual objects

Pixel
— the elements of a digital image

4
 Representing Digital Images

► Therepresentation of an M×N numerical

array as

 f (0, 0) f (0,1) ... f (0, N  1) 

 f (1,0) f (1,1) ... f (1, N  1) 
f ( x, y )   
 ... ... ... ... 
 
 f ( M  1, 0) f ( M  1,1) ... f ( M  1, N  1) 

5
 Representing Digital Images

► Therepresentation of an M×N numerical

array as

 a0,0 a0,1 ... a0, N 1 

 a a1,1 ... a1, N 1  
A  1,0

 ... ... ... ... 

 
 aM 1,0 aM 1,1 ... aM 1, N 1 

6
► The continuum from image processing to computer vision
can be broken up into low-, mid- and high level processing
Low Level Process Mid Level Process High Level Process
Input: Image Input: Image Input: Attributes
Output: Image Output: Attributes Output:
Understanding
Examples: Noise Examples: Object
removal, image recognition, Examples: Scene
sharpening segmentation understanding,
autonomous navigation
 Sources for Images
► Electromagnetic (EM) energy spectrum
► Acoustic
► Ultrasonic
► Electronic
► Synthetic images produced by computer

8
 Electromagnetic (EM) energy spectrum

Major uses
Gamma-ray imaging: nuclear medicine and astronomical observations
X-rays: medical diagnostics, industry, and astronomy, etc.
Ultraviolet: lithography, industrial inspection, microscopy, lasers, biological imaging,
and astronomical observations
Visible and infrared bands: light microscopy, astronomy, remote sensing, industry,
and law enforcement
Microwave band: radar
Radio band: medicine (such as MRI) and astronomy

9
Examples: Gama-Ray Imaging

10
Examples: X-Ray Imaging

11
Examples: Ultraviolet Imaging

12
Examples: Light Microscopy Imaging

13
Examples: Visual and Infrared Imaging

14
Examples: Visual and Infrared Imaging

15
 Examples: Infrared Satellite Imaging

2003
USA 1993 16
Examples: Infrared Satellite Imaging

17
Examples: Automated Visual Inspection

18
 Examples: Automated Visual Inspection

Results of
automated
reading of the
plate content by
the system

The area in which

the imaging
system detected
the plate

19
Example of Radar Image

20
Examples: MRI (Radio Band)

21
Examples: Ultrasound Imaging

22
 Fundamental Steps in DIP
Extracting image
components

Improving the
appearance Partition an image into
its constituent parts or
objects

Result is more
suitable than Represent image for
the original computer processing

23
 Image Acquisition

Image Morphological
Restoration Processing

Image
Segmentation
Enhancement

Image Object
Acquisition Recognition

Representation
Problem Domain
& Description
Colour Image Image
Processing Compression
 Image Enhancement

Image Morphological
Restoration Processing

Image
Segmentation
Enhancement

Image Object
Acquisition Recognition

Representation
Problem Domain
& Description
Colour Image Image
Processing Compression
 Image Restoration

Image Morphological
Restoration Processing

Image
Segmentation
Enhancement

Image Object
Acquisition Recognition

Representation
Problem Domain
& Description
Colour Image Image
Processing Compression
Sr. Image Enhancement Image Restoration
No.
1. As the name suggests, in Image The aim of image restoration is to
Enhancement, the original image is bring the image towards what it would
processed so that the resultant image is have been if it had been recorded
more suitable than the original for without degradation.
specific applications.
2. Image enhancement makes a picture Image restoration tries to fix the
look better, without regard to how it image to get back to the real, true
really truly should look. image.
3. Image enhancement means improving Image restoration means improving
the image to show some hidden details. the image to match the original
image.
4. Image enhancement is a purely Image restoration is an objective
subjective processing technique. process.
5. Image enhancement is a cosmetic Restoration tries to reconstruct by
procedure i.e. it does not add any extra using a priori knowledge of the
information to the original image. It degradation phenomena. Restoration
merely improves the subjective quality of hence deals with getting an optimal
the images by work in with the existing estimate of the desired result
27
data.
 Morphological Processing

Image Morphological
Restoration Processing

Image
Segmentation
Enhancement

Image Object
Acquisition Recognition

Representation
Problem Domain
& Description
Colour Image Image
Processing Compression
 Segmentation

Image Morphological
Restoration Processing

Image
Segmentation
Enhancement

Image Object
Acquisition Recognition

Representation
Problem Domain
& Description
Colour Image Image
Processing Compression
 Object Recognition

Image Morphological
Restoration Processing

Image
Segmentation
Enhancement

Image Object
Acquisition Recognition

Representation
Problem Domain
& Description
Colour Image Image
Processing Compression
 Representation & Description

Image Morphological
Restoration Processing

Image
Segmentation
Enhancement

Image Object
Acquisition Recognition

Representation
Problem Domain & Description
Colour Image Image
Processing Compression
 Image Compression

Image Morphological
Restoration Processing

Image
Segmentation
Enhancement

Image Object
Acquisition Recognition

Representation
Problem Domain
& Description
Colour Image Image
Processing Compression
 Colour Image Processing

Image Morphological
Restoration Processing

Image
Segmentation
Enhancement

Image Object
Acquisition Recognition

Representation
Problem Domain & Description
Colour Image Image
Processing Compression
 Light and EM Spectrum

c   E  h , h : Planck's constant.
34
Digital Image
 Digital Image

► Pixel values typically represent gray levels and colors

► Remember digitization implies that a digital image is an
approximation of a real scene

1 pixel
Sensors
 Image Acquisition

Transform
illumination
energy into
digital images

38
Image Acquisition Using a Single Sensor

39
Image Acquisition Using Sensor Strips

40
Image Acquisition Process

41
 Image Sampling and Quantization

Digitizing the
coordinate
values
Digitizing the
amplitude
values

42
Image Sampling and Quantization

43
Representing Digital Images

44
 Representing Digital Images

► Therepresentation of an M×N numerical

array in MATLAB

 f (1,1) f (1, 2) ... f (1, N ) 

 f (2,1) f (2, 2) ... f (2, N ) 
f ( x, y )   
 ... ... ... ... 
 
 f ( M ,1) f ( M , 2) ... f (M , N )

45
 Representing Digital Images

► Discrete intensity interval [0, L-1], L=2k

► The number b of bits required to store a M × N

digitized image

b=M×N×k

46
Representing Digital Images

47
 Spatial and Intensity Resolution

► Spatial resolution
— A measure of the smallest discernible detail in an image
— stated with line pairs per unit distance, dots (pixels) per
unit distance, dots per inch (dpi)

► Intensity resolution
— The smallest discernible change in intensity level
— stated with 8 bits, 12 bits, 16 bits, etc.

48
Spatial and Intensity Resolution

49
Spatial and Intensity Resolution

50
Spatial and Intensity Resolution

51
 Basic Relationships Between Pixels

► Neighborhood

► Adjacency

► Connectivity

► Paths

► Regions and boundaries

52
 Basic Relationships Between Pixels

► Neighbors of a pixel p at coordinates (x,y)

 4-neighbors of p, denoted by N4(p):

(x-1, y), (x+1, y), (x,y-1), and (x, y+1).

 4 diagonal neighbors of p, denoted by ND(p):

(x-1, y-1), (x+1, y+1), (x+1,y-1), and (x-1, y+1).

 8 neighbors of p, denoted N8(p)

N8(p) = N4(p) U ND(p)

53
 Basic Relationships Between Pixels

► Adjacency
Let V be the set of intensity values

 4-adjacency: Two pixels p and q with values from V are

4-adjacent if q is in the set N4(p).

 8-adjacency: Two pixels p and q with values from V are

8-adjacent if q is in the set N8(p).

54
 Basic Relationships Between Pixels

► Adjacency
Let V be the set of intensity values

 m-adjacency: Two pixels p and q with values from V are

m-adjacent if

(i) q is in the set N4(p), or

(ii) q is in the set ND(p) and the set N4(p) ∩ N4(q) has no pixels whose
values are from V.

55
 Basic Relationships Between Pixels

► Path
 A (digital) path (or curve) from pixel p with coordinates (x0, y0) to pixel
q with coordinates (xn, yn) is a sequence of distinct pixels with
coordinates

(x0, y0), (x1, y1), …, (xn, yn)

Where (xi, yi) and (xi-1, yi-1) are adjacent for 1 ≤ i ≤ n.

 Here n is the length of the path.

 If (x0, y0) = (xn, yn), the path is closed path.

 We can define 4-, 8-, and m-paths based on the type of adjacency
used.

56
 Examples: Adjacency and Path
V = {1, 2}

0 1 1 0 1 1 0 1 1
0 2 0 0 2 0 0 2 0
0 0 1 0 0 1 0 0 1

57
 Examples: Adjacency and Path
V = {1, 2}

0 1 1 0 1 1 0 1 1
0 2 0 0 2 0 0 2 0
0 0 1 0 0 1 0 0 1
8-adjacent

58
 Examples: Adjacency and Path
V = {1, 2}

0 1 1 0 1 1 0 1 1
0 2 0 0 2 0 0 2 0
0 0 1 0 0 1 0 0 1
8-adjacent m-adjacent

59
 Examples: Adjacency and Path
V = {1, 2}

0 1 1
1,1 1,2 1,3 0 1 1 0 1 1
0 2 0
2,1 2,2 2,3 0 2 0 0 2 0
0 0 1
3,1 3,2 3,3 0 0 1 0 0 1
8-adjacent m-adjacent

The 8-path from (1,3) to (3,3): The m-path from (1,3) to (3,3):
(i) (1,3), (1,2), (2,2), (3,3) (1,3), (1,2), (2,2), (3,3)
(ii) (1,3), (2,2), (3,3)

60