Introduction to Grayscale and

Color Images

Image acquisition

Light and Electromagnetic spectrum

Charge-Coupled Device (CCD) imaging and Bayer
Pattern (the most popular color-filter-array)
Sampling and Quantization

Image representation
Spatial resolution
Bit-depth resolution
Local neighborhood
Block decomposition
1

Electromagnetic spectrum

Introduction to Digital Image Processing

Light: the Visible Spectrum

Visible range: 0.43m(violet)-0.78m(red)
Six bands: violet, blue, green, yellow,
orange, red
The color of an object is determined by the
nature of the light reflected by the object
Monochromatic light (gray level)
Three elements measuring chromatic light
Radiance, luminance and brightness
Introduction to Digital Image Processing

Sensor Array: CCD Imaging

Introduction to Digital Image Processing

Charge coupled device (CCD)

image sensor

http://en.wikipedia.org/wiki/Charge-coupled_device
Introduction to Digital Image Processing

EE465: Introduction to Digital Image Processing

Complementary Metal Oxide

Semiconductor (CMOS) Image
Sensor

Introduction to Digital Image Processing

Image Formation Model

f(x,y)=i(x,y)r(x,y)+n(x,y)
0<f(x,y)<

Intensity proportional to energy

radiated by a physical source

0<i(x,y)<

illumination

0<r(x,y)<1

reflectance

n(x,y)

noise

Introduction to Digital Image Processing

(intrinsic images)

Sampling and Quantization: 1D

Case

9
Introduction to Digital Image Processing

2D Sampling and Quantization

Introduction to Digital Image Processing

10

3D Visualization

400
300
200
100
0
120
100

80

20

60

40

40

60

20
0

80
100

It is useful to take an analogy to rain gauge (image intensity values

Measure the amount of ``photon rain)
Introduction to Digital Image Processing

11

Color Imaging: Bayer Pattern

$38,990

$309
US3,971,065

Introduction to Digital Image Processing

12

Demosaicing (CFA Interpolation)

: Introduction to Digital Image Processing

13

Simple Ideas: Linear

Interpolation

You will be asked to try these simple ideas in CA#2

Introduction to Digital Image Processing

14

Biological vs. Artificial Sensors

US3,971,065

Cone distribution in human retina

Question: Engineers invention vs. natures evolution, who wins?

Introduction to Digital Image Processing

15

Digital Single-Lens Reflection

(DSLR) Cameras

Introduction to Digital Image Processing

16

Nikon D50
Introduction to Digital Image Processing

17

Kodak Easyshare
Introduction to Digital Image Processing

18

The Plague in Photography: Motion Blur

Introduction to Digital Image Processing

19

High Dynamic Range Imaging

Q: Can we generate a HDR image by a standard camera?

A: Yes, adjust the exposure and fuse multiple LDR images together
Introduction to Digital Image Processing

20

HDR Display (After Toner

Mapping)

Note that any commercial display devices we see these days are NOT HDR
Introduction to Digital Image Processing

21

Introduction to Digital Image Processing

22

Beyond Visible
Gamma-ray and X-ray: medical and
astronomical applications
Infrared (thermal imaging): near-infrared
and far-infrared
Microwave imaging:
Radio-frequency: MRI and astronomic
applications
Introduction to Digital Image Processing

23

Thermal Imaging
Operate in infrared frequency

Grayscale representation
(bright pixels correlate with
high-temperature regions)

Pseudo-color representation
(Human body dispersing
heat denoted by red)

Introduction to Digital Image Processing

24

Low Signal-to-Noise (SNR)

Behavior
250

200

150

100

50

0
0

noise

0.1

0.2

0.3

0.4

0.5

0.6

0.7

0.8

0.9

signal
Introduction to Digital Image Processing

25

Radar Imaging
Operate in microwave frequency

Mountains in Southeast Tibet

Introduction to Digital Image Processing

26

Synthetic Aperture Radar

(SAR)
Environmental
monitoring, earthresource mapping, and
military systems
SAR imagery must be
acquired in inclement
weather and all-day-allnight.
SAR produces relatively
fine azimuth resolution
that differentiates it from
other radars.
Introduction to Digital Image Processing

27

Magnetic Resonance Imaging

(MRI)
Operate in radio frequency

knee

spine

Introduction to Digital Image Processing

head

28

MRI Imaging

k-space

IFT

Introduction to Digital Image Processing

29

Comparison of Different Imaging

Modalities

visible

infrared

Introduction to Digital Image Processing

radio

30

Fluorescence Microscopy
Imaging Operate in ultraviolet frequency

normal corn

smut corn

Introduction to Digital Image Processing

31

What Does a Neuron Look Like?

Artistic illustration

Real image
Introduction to Digital Image Processing

32

X-ray Imaging

Operate in X-ray frequency

chest

head

Introduction to Digital Image Processing

33

Positron Emission Tomography

Operate in gamma-ray frequency

Introduction to Digital Image Processing

34

Mechanical Categorization of
Sensors

Motionless imaging
Sensor is kept still during the acquisition (e.g., CCD
cameras)
Motion-aided imaging
Sensor moves along a line or rotates around a center
during the acquisition (e.g., document scanning and
MRI scanning)
Subtle relationship between visual perception and
motion
We move because we see; we see because we
move J. Gibson
Introduction to Digital Image Processing

35

Single-sensor Imaging

Introduction to Digital Image Processing

36

Motion Aids Imaging

Introduction to Digital Image Processing

37

Introduction to Digital Image Processing

38

Introduction to Grayscale Images

Image acquisition
Light and Electromagnetic spectrum
Charge-Coupled Device (CCD) imaging
Sampling and Quantization

Image representation
Spatial resolution
Bit-depth resolution
Local neighborhood
Block decomposition
Introduction to Digital Image Processing

39

Image Represented by a Matrix

Spatial resolution

Bit-depth resolution

Introduction to Digital Image Processing

40

Spatial Resolution

Introduction to Digital Image Processing

41

Image Resampling

EE465: Introduction to Digital Image Processing

42

Towards Gigapixel

Mega-pel

Giga-pel

Photographers and artists have manually or semi-automatically

stitched hundreds of mega-pel pictures together to demonstrate
how a giga-pel picture looks like the power of pixels

Introduction to Digital Image Processing

43

Aliasing in Digital Images

Introduction to Digital Image Processing

44

Bit-depth Resolution

EE465: Introduction to Digital Image Processing

45

Bit-depth Resolution (Cond)

EE465: Introduction to Digital Image Processing

46

Commonlyused Terminology
Neighbors of a pixel p=(i,j)

N4(p)={(i-1,j),(i+1,j),(i,j-1),(i,j+1)}

N8(p)={(i-1,j),(i+1,j),(i,j-1),(i,j+1),
(i-1,j-1),(i-1,j+1),(i+1,j-1),(i+1,j+1)}

Adjacency
4-adjacency: p,q are 4-adjacent if p is in the set N4(q)
8-adjacency: p,q are 8-adjacent if p is in the set N8(q)
Note that if p is in N4/8(q), then q must be also in N4/8(p)
Introduction to Digital Image Processing

47

Common Distance Definitions

Euclidean distance
(2-norm)
2 2 5 2

1 2

1 1

52 2

5 2

D8 distance
(checkboard distance)

52 2

2 2

D4 distance
(city-block distance)

Introduction to Digital Image Processing

48

Block-based Processing

Introduction to Digital Image Processing

49