Download as pdf or txt
Download as pdf or txt
You are on page 1of 59

Lecture2

DigitalImageFundamentals
LinZHANG,PhD
SchoolofSoftwareEngineering
Tongji University
Spring2013

LinZHANG,SSE,2013

Contents

Elementsofvisualperception
Lightandtheelectromagneticspectrum
Imagesensingandacquisition
Imagesamplingandquantization
Somebasicrelationshipsbetweenpixels

LinZHANG,SSE,2013

ElementsofVisualPerception
Structureofthehumaneye

visualaxis

sclera

choroid
blindspot

LinZHANG,SSE,2013

ElementsofVisualPerception
Structureofthehumaneye
Threemembranesenclosetheeye:thecorneaandsclera,
choroid,andretina
Atitsanteriorextreme,thechoroidisdividedintotheciliary body
andtheiris;thelatercontractsorexpandstocontroltheamountof
lightthatenterstheeye

LinZHANG,SSE,2013

ElementsofVisualPerception
Structureofthehumaneye
Whentheeyeisproperlyfocused,lightfromanobject
outsidetheeyeisimagedontheretina
Twokindsoflightreceptorsdistributeontheretina,cones androds
Conesareprimarilylocatedinthecentralportionoftheretina,
calledfovea andaresensitivetocolor;theyfunctionbestin
relativelybrightlight;so,conevisioniscalledbrightlightvision
Rodsaredistributedovertheretinalsurface;rodsservetogivea
generaloverallpictureofthefieldofview;theyarenotinvolvedin
colorvisionandaresensitivetolowlevelsofillumination;rodvision
iscalleddimlightvision
Aroundtheregionoftheemergenceoftheopticnerve,thereisno
receptorsandresultsinthesocalledblindspot

LinZHANG,SSE,2013

ElementsofVisualPerception
Structureofthehumaneye(moreonconecell)
Humansusuallyhavethreekindsofconeswithdifferent
photopsins,whichhavedifferentspectralresponsecurves;
thus,wehavetrichromatic vision.
Interestingly,somepeoplehavefourormoretypesof
cones,givingthemtetrachromatic vision

LinZHANG,SSE,2013

ElementsofVisualPerception
Structureofthehumaneye(moreonconecell)

Threetypesofcolorsensitiveconesintheretinaofthehumaneye,
correspondingroughlytored,green,andbluesensitivedetectors.
LinZHANG,SSE,2013

ElementsofVisualPerception
Structureofthehumaneye(moreonconecell)

LinZHANG,SSE,2013

ElementsofVisualPerception
Structureofthehumaneye(moreonrodcell)

Rodcell
LinZHANG,SSE,2013

ElementsofVisualPerception
Structureofthehumaneye(moreonrodcell)

Wavelengthresponsivenessofrodscomparedtothatofthree
typesofcones.Thedashedgraycurveisforrods.
LinZHANG,SSE,2013

ElementsofVisualPerception
Structureofthehumaneye

Distributionofrodsandconesintheretina
LinZHANG,SSE,2013

ElementsofVisualPerception
Blindspotexperiment
Drawanimagesimilartothatbelowonapieceofpaper(the
dotandcrossareabout6inchesapart)

Closeyourrighteyeandfocusonthecrosswithyourlefteye
Holdtheimageabout20inchesawayfromyourfaceand
moveitslowlytowardsyou
Thedotshoulddisappear!

LinZHANG,SSE,2013

ElementsofVisualPerception
Imageformationintheeye
Muscleswithintheeyecanbeusedtochangetheshapeof
thelensallowingusfocusonobjectsthatarenearorfar
away
Animageisfocusedontotheretinacausingrodsandcones
tobecomeexcitedwhichultimatelysendsignalstothebrain

C istheopticalcenterofthelens
LinZHANG,SSE,2013

ElementsofVisualPerception
HumaneyeVScamera

VS
Lens
Iris
Retina

Related
components?

LinZHANG,SSE,2013

ElementsofVisualPerception
Perceivedbrightnessisnotasimplefunctionof
intensity
Visualsystemtendstoundershootorovershootaroundthe
boundaryofregionsofdifferentintensities,calledas
Mach bands
Aregionsperceivedbrightnessdoesnotonlydependsimply
onitsintensity,butonitssurroundingregions;sucha
phenomenoniscalledsimultaneouscontrast

LinZHANG,SSE,2013

ElementsofVisualPerception
Perceivedbrightnessisnotasimplefunctionof
intensity

AnexampleofMachbands
LinZHANG,SSE,2013

ElementsofVisualPerception
Perceivedbrightnessisnotasimplefunctionof
intensity

LinZHANG,SSE,2013

ElementsofVisualPerception
Perceivedbrightnessisnotasimplefunctionof
intensity

Anexampleofsimultaneouscontrast

LinZHANG,SSE,2013

ElementsofVisualPerception
Perceivedbrightnessisnotasimplefunctionof
intensity

LinZHANG,SSE,2013

ElementsofVisualPerception
Perceivedbrightnessisnotasimplefunctionof
intensity

LinZHANG,SSE,2013

ElementsofVisualPerception
Opticalillusions:ourvisualsystemsplaylotsof
interestingtricksonus
Itisstillynotfullyunderstoodyet

LinZHANG,SSE,2013

ElementsofVisualPerception

LinZHANG,SSE,2013

Contents

Elementsofvisualperception
Lightandtheelectromagneticspectrum
Imagesensingandacquisition
Imagesamplingandquantization
Somebasicrelationshipsbetweenpixels

LinZHANG,SSE,2013

LightandtheElectromagneticSpectrum
Lightisjustaparticularpartoftheelectromagnetic
spectrumthatcanbesensedbythehumaneye
Theelectromagneticspectrumissplitupaccordingto
thewavelengthsofdifferentformsofenergy

LinZHANG,SSE,2013

LightandtheElectromagneticSpectrum
Thecolours thatweperceivearedeterminedbythe
natureofthelightreflectedfromanobject
Inadditiontofrequency,threebasicquantitiesare
usedtodescribethequalityofachromaticlightsource
Radiance.Itisthetotalamountofenergythatflowsfromthe
lightsource,measuredinWatts
Luminance.Givesameasureoftheamountofenergyan
observerperceives,measuredinlumens
Brightness.Itisasubjectivedescriptoroflightperception
thatispracticallyimpossibletomeasure

LinZHANG,SSE,2013

LightandtheElectromagneticSpectrum

electromagneticwave

reflectance
spectrum

spectralpower
distribution

spectralpower
distribution

Red

LinZHANG,SSE,2013

Contents

Elementsofvisualperception
Lightandtheelectromagneticspectrum
Imagesensingandacquisition
Imagesamplingandquantization
Somebasicrelationshipsbetweenpixels

LinZHANG,SSE,2013

ImageSensingandAcquisition
Imagecreationbasedontwofactors
Illuminationsource
Reflection orabsorption ofenergyfromthatsourcebythe
elementsofthescene beingimaged
Any examples for
these two kinds?

LinZHANG,SSE,2013

ImageSensingandAcquisition
Imagingsensors
Singleimagingsensor
Linesensor
Arraysensor

Singleimagingsensor
LinZHANG,SSE,2013

ImageSensingandAcquisition
Imagingsensors
Singleimagingsensor
Linesensor
Arraysensor
Linesensor

Application
scenario?

LinZHANG,SSE,2013

ImageSensingandAcquisition
Imagingsensors
Singleimagingsensor
Linesensor
Arraysensor

Arraysensor,usedinordinarydigitalcamera
LinZHANG,SSE,2013

ImageSensingandAcquisition
Imagingsensingusingsensorstrips

Image acquisiton using a linear sensor strip and a circular sensor strip
LinZHANG,SSE,2013

ImageSensingandAcquisition
Imagingsensingusingsensorarrays

Anexampleofthedigitalimageacquisitionprocess
LinZHANG,SSE,2013

Contents

Elementsofvisualperception
Lightandtheelectromagneticspectrum
Imagesensingandacquisition
Imagesamplingandquantization
Somebasicrelationshipsbetweenpixels

LinZHANG,SSE,2013

ImageSamplingandQuantization
Samplingandquantizationwillconvertacontinuous
imagesignalf toadiscretedigitalform
Digitizingthecoordinatevaluesiscalledsampling
Digitizingtheamplitudeiscalledquantization

LinZHANG,SSE,2013

ImageSamplingandQuantization
Samplingandquantizationwillconvertacontinuous
imagesignalf toadiscretedigitalform

LinZHANG,SSE,2013

ImageSamplingandQuantization
Samplingandquantizationwillconvertacontinuous
imagesignalf toadiscretedigitalform

Resultofimagesamplingandquantization
LinZHANG,SSE,2013

ImageSamplingandQuantization
Representingimages

LinZHANG,SSE,2013

ImageSamplingandQuantization
Spatialresolution
Thespatialresolutionofanimageisdeterminedbyhow
samplingwascarriedout
DPI(dotsperinch)isusedtomeasurethespatialresolution

Note:tosaythatanimagehasaresolution1024*1024
isnotameaningfulstatementwithoutstatingthe
spatialdimensionsencompassedbytheimage

LinZHANG,SSE,2013

ImageSamplingandQuantization
Spatialresolutionanexample

LinZHANG,SSE,2013

ImageSamplingandQuantization
Spatialresolutionanexample

LinZHANG,SSE,2013

ImageSamplingandQuantization
Spatialresolutionanexample

LinZHANG,SSE,2013

ImageSamplingandQuantization
Spatialresolutionanexample

LinZHANG,SSE,2013

ImageSamplingandQuantization
Spatialresolutionanexample

LinZHANG,SSE,2013

ImageSamplingandQuantization
Spatialresolutionanexample

LinZHANG,SSE,2013

ImageSamplingandQuantization
Intensityresolution
Intensityresolutionreferstothesmallestdiscerniblechange
inintensitylevel
Themoreintensitylevelsused,thefinerthelevelofdetail
discernableinanimage
Thenumberofbitsusedtoquantizeintensityisoftenreferred
astheintensityresolution
Number of Bits

Number of Intensity
Levels

Examples

0, 1

00, 01, 10, 11

16

0000, 0101, 1111

256

00110011, 01010101

16

65,536

1010101010101010

LinZHANG,SSE,2013

ImageSamplingandQuantization
Intensityresolution

8bitsperpixel

4bpp

7bpp

3bpp

6bpp

5bpp

2bpp

1bpp
LinZHANG,SSE,2013

ImageSamplingandQuantization
Imageinterpolation
Itisabasictoolusedintaskssuchaszooming,shrinking,
rotating,andgeometriccorrections
Traditionalmethodsincludenearestneighbor,bilinear,and
bicubic
ur
ne

ar

n
t
s
e

bo
h
ig

bil
in

ea

LinZHANG,SSE,2013

Contents

Elementsofvisualperception
Lightandtheelectromagneticspectrum
Imagesensingandacquisition
Imagesamplingandquantization
Somebasicrelationshipsbetweenpixels

LinZHANG,SSE,2013

SomeBasicRelationshipsbetweenPixels
Neighborsofapixel
p(x, y) isapixel

p
N4(p): 4neighbours
ofp

p
ND(p): diagonal
neighboursofp

p
N8(p): 8neighbours
ofp

LinZHANG,SSE,2013

SomeBasicRelationshipsbetweenPixels
Adjacency
LetV:Setofgraylevelvaluesusedtodefineconnectivity;
e.g.,V={1}.
4adjacency:twopixelsp andq withvaluesinV are4
adjacentifq isinthesetN4(p)
8adjacency:twopixelsp andq withvaluesinV are8
adjacentifq isinthesetN8(p)
madjacency(mixedadjacency):(modificationof8ato
eliminatemultipleconnections)twopixelsp andq with
valuesinV aremadjacentif
(i)q isinN4(p) or
(ii)q inND(p) andN4(p) N4(q) hasnopixelswhosevalues
arefromV
LinZHANG,SSE,2013

SomeBasicRelationshipsbetweenPixels
Adjacencyexamples
011

011

011

010

010

010

001
001
001
Anarrangementofpixels8adjacencymadjacency

LinZHANG,SSE,2013

SomeBasicRelationshipsbetweenPixels
Connectivityandregions
LetS representasubsetofpixelsinanimage
For,thesetofpixelsthatareconnecttoitinS
pS
iscalled
aconnectedcomponent ofS;ifS hasonlyoneconnected
component,S iscalledaconnectedset anditisalsoaregion
TworegionsRi andRj aresaidtobeadjacent iftheirunion
formsaconnectedset;otherwise,theyaredisjoint
110111
101011
110011
Ri

Note:whentalkingabout
regionsadjacency,the
adjacencytypeshouldbe
mentioned

Rj
LinZHANG,SSE,2013

SomeBasicRelationshipsbetweenPixels
Boundary
BoundaryofaregionR isthesetofpointsthatareadjacentto
pointsinthecomplementofR (innerborder)
Outerborder istheborderofinthebackground(toguarantee
theborderfollowingalgorithmswillformaclosedpath)
Usually,adjacencybetweenpointsinaregionandits
backgroundisdefinedintermsof8connectivity
000
010
010
010
010
000

Theinnerborderofthe1valuedregion
doesnotformaclosedpath,butitsouter
boundarydoes
LinZHANG,SSE,2013

SomeBasicRelationshipsbetweenPixels
Distancemeasures
Forpixelsp,q,andz,withcoordinates(x, y),(s, t),and(v, w),D
isadistance function ormetric if
(a) D( p, q) 0 D( p, q) 0, iff p q
(b) D ( p, q) D ( q, p ) ,and
(c) D ( p, z ) D ( p, q) D ( q, z )
Euclideandistance
De ( p, q ) ( x s ) ( y t )
2

2 1/2

LinZHANG,SSE,2013

SomeBasicRelationshipsbetweenPixels
Distancemeasures
Forpixelsp,q,andz,withcoordinates(x, y),(s, t),and(v, w),D
isadistance function ormetric if
(a) D( p, q) 0 D( p, q) 0, iff p q
(b) D ( p, q) D ( q, p ) ,and
(c) D ( p, z ) D ( p, q) D ( q, z )
D4 distance(cityblockdistance,orManhattandistance)
D4 ( p, q) x s y t

2
2 1 2
2 1 p 1 2
2 1 2
2
LinZHANG,SSE,2013

SomeBasicRelationshipsbetweenPixels
Distancemeasures
Forpixelsp,q,andz,withcoordinates(x, y),(s, t),and(v, w),D
isadistance function ormetric if
(a) D( p, q) 0 D( p, q) 0, iff p q
(b) D ( p, q) D ( q, p ) ,and
(c) D ( p, z ) D ( p, q) D ( q, z )
D8 distance(Chessboarddistance)

D8 ( p, q ) max x s , y t

2
2
2
2
2

2
1
1
1
2

2 2 2
1 1 2
p 1 2
1 1 2
2 2 2
LinZHANG,SSE,2013

Summary
Wehavelookedat:

Elementsofvisualperception
Lightandtheelectromagneticspectrum
Imagesensingandacquisition
Imagesamplingandquantization
Somebasicrelationshipsbetweenpixels

Nexttimewestarttolookattechniquesforimage
enhancement

LinZHANG,SSE,2013

Thanksforyourattention

LinZHANG,SSE,2013

You might also like