Professional Documents
Culture Documents
Lecture 02-Digital Image Fundamentals - Gooood PDF
Lecture 02-Digital Image Fundamentals - Gooood PDF
DigitalImageFundamentals
LinZHANG,PhD
SchoolofSoftwareEngineering
Tongji University
Spring2013
LinZHANG,SSE,2013
Contents
Elementsofvisualperception
Lightandtheelectromagneticspectrum
Imagesensingandacquisition
Imagesamplingandquantization
Somebasicrelationshipsbetweenpixels
LinZHANG,SSE,2013
ElementsofVisualPerception
Structureofthehumaneye
visualaxis
sclera
choroid
blindspot
LinZHANG,SSE,2013
ElementsofVisualPerception
Structureofthehumaneye
Threemembranesenclosetheeye:thecorneaandsclera,
choroid,andretina
Atitsanteriorextreme,thechoroidisdividedintotheciliary body
andtheiris;thelatercontractsorexpandstocontroltheamountof
lightthatenterstheeye
LinZHANG,SSE,2013
ElementsofVisualPerception
Structureofthehumaneye
Whentheeyeisproperlyfocused,lightfromanobject
outsidetheeyeisimagedontheretina
Twokindsoflightreceptorsdistributeontheretina,cones androds
Conesareprimarilylocatedinthecentralportionoftheretina,
calledfovea andaresensitivetocolor;theyfunctionbestin
relativelybrightlight;so,conevisioniscalledbrightlightvision
Rodsaredistributedovertheretinalsurface;rodsservetogivea
generaloverallpictureofthefieldofview;theyarenotinvolvedin
colorvisionandaresensitivetolowlevelsofillumination;rodvision
iscalleddimlightvision
Aroundtheregionoftheemergenceoftheopticnerve,thereisno
receptorsandresultsinthesocalledblindspot
LinZHANG,SSE,2013
ElementsofVisualPerception
Structureofthehumaneye(moreonconecell)
Humansusuallyhavethreekindsofconeswithdifferent
photopsins,whichhavedifferentspectralresponsecurves;
thus,wehavetrichromatic vision.
Interestingly,somepeoplehavefourormoretypesof
cones,givingthemtetrachromatic vision
LinZHANG,SSE,2013
ElementsofVisualPerception
Structureofthehumaneye(moreonconecell)
Threetypesofcolorsensitiveconesintheretinaofthehumaneye,
correspondingroughlytored,green,andbluesensitivedetectors.
LinZHANG,SSE,2013
ElementsofVisualPerception
Structureofthehumaneye(moreonconecell)
LinZHANG,SSE,2013
ElementsofVisualPerception
Structureofthehumaneye(moreonrodcell)
Rodcell
LinZHANG,SSE,2013
ElementsofVisualPerception
Structureofthehumaneye(moreonrodcell)
Wavelengthresponsivenessofrodscomparedtothatofthree
typesofcones.Thedashedgraycurveisforrods.
LinZHANG,SSE,2013
ElementsofVisualPerception
Structureofthehumaneye
Distributionofrodsandconesintheretina
LinZHANG,SSE,2013
ElementsofVisualPerception
Blindspotexperiment
Drawanimagesimilartothatbelowonapieceofpaper(the
dotandcrossareabout6inchesapart)
Closeyourrighteyeandfocusonthecrosswithyourlefteye
Holdtheimageabout20inchesawayfromyourfaceand
moveitslowlytowardsyou
Thedotshoulddisappear!
LinZHANG,SSE,2013
ElementsofVisualPerception
Imageformationintheeye
Muscleswithintheeyecanbeusedtochangetheshapeof
thelensallowingusfocusonobjectsthatarenearorfar
away
Animageisfocusedontotheretinacausingrodsandcones
tobecomeexcitedwhichultimatelysendsignalstothebrain
C istheopticalcenterofthelens
LinZHANG,SSE,2013
ElementsofVisualPerception
HumaneyeVScamera
VS
Lens
Iris
Retina
Related
components?
LinZHANG,SSE,2013
ElementsofVisualPerception
Perceivedbrightnessisnotasimplefunctionof
intensity
Visualsystemtendstoundershootorovershootaroundthe
boundaryofregionsofdifferentintensities,calledas
Mach bands
Aregionsperceivedbrightnessdoesnotonlydependsimply
onitsintensity,butonitssurroundingregions;sucha
phenomenoniscalledsimultaneouscontrast
LinZHANG,SSE,2013
ElementsofVisualPerception
Perceivedbrightnessisnotasimplefunctionof
intensity
AnexampleofMachbands
LinZHANG,SSE,2013
ElementsofVisualPerception
Perceivedbrightnessisnotasimplefunctionof
intensity
LinZHANG,SSE,2013
ElementsofVisualPerception
Perceivedbrightnessisnotasimplefunctionof
intensity
Anexampleofsimultaneouscontrast
LinZHANG,SSE,2013
ElementsofVisualPerception
Perceivedbrightnessisnotasimplefunctionof
intensity
LinZHANG,SSE,2013
ElementsofVisualPerception
Perceivedbrightnessisnotasimplefunctionof
intensity
LinZHANG,SSE,2013
ElementsofVisualPerception
Opticalillusions:ourvisualsystemsplaylotsof
interestingtricksonus
Itisstillynotfullyunderstoodyet
LinZHANG,SSE,2013
ElementsofVisualPerception
LinZHANG,SSE,2013
Contents
Elementsofvisualperception
Lightandtheelectromagneticspectrum
Imagesensingandacquisition
Imagesamplingandquantization
Somebasicrelationshipsbetweenpixels
LinZHANG,SSE,2013
LightandtheElectromagneticSpectrum
Lightisjustaparticularpartoftheelectromagnetic
spectrumthatcanbesensedbythehumaneye
Theelectromagneticspectrumissplitupaccordingto
thewavelengthsofdifferentformsofenergy
LinZHANG,SSE,2013
LightandtheElectromagneticSpectrum
Thecolours thatweperceivearedeterminedbythe
natureofthelightreflectedfromanobject
Inadditiontofrequency,threebasicquantitiesare
usedtodescribethequalityofachromaticlightsource
Radiance.Itisthetotalamountofenergythatflowsfromthe
lightsource,measuredinWatts
Luminance.Givesameasureoftheamountofenergyan
observerperceives,measuredinlumens
Brightness.Itisasubjectivedescriptoroflightperception
thatispracticallyimpossibletomeasure
LinZHANG,SSE,2013
LightandtheElectromagneticSpectrum
electromagneticwave
reflectance
spectrum
spectralpower
distribution
spectralpower
distribution
Red
LinZHANG,SSE,2013
Contents
Elementsofvisualperception
Lightandtheelectromagneticspectrum
Imagesensingandacquisition
Imagesamplingandquantization
Somebasicrelationshipsbetweenpixels
LinZHANG,SSE,2013
ImageSensingandAcquisition
Imagecreationbasedontwofactors
Illuminationsource
Reflection orabsorption ofenergyfromthatsourcebythe
elementsofthescene beingimaged
Any examples for
these two kinds?
LinZHANG,SSE,2013
ImageSensingandAcquisition
Imagingsensors
Singleimagingsensor
Linesensor
Arraysensor
Singleimagingsensor
LinZHANG,SSE,2013
ImageSensingandAcquisition
Imagingsensors
Singleimagingsensor
Linesensor
Arraysensor
Linesensor
Application
scenario?
LinZHANG,SSE,2013
ImageSensingandAcquisition
Imagingsensors
Singleimagingsensor
Linesensor
Arraysensor
Arraysensor,usedinordinarydigitalcamera
LinZHANG,SSE,2013
ImageSensingandAcquisition
Imagingsensingusingsensorstrips
Image acquisiton using a linear sensor strip and a circular sensor strip
LinZHANG,SSE,2013
ImageSensingandAcquisition
Imagingsensingusingsensorarrays
Anexampleofthedigitalimageacquisitionprocess
LinZHANG,SSE,2013
Contents
Elementsofvisualperception
Lightandtheelectromagneticspectrum
Imagesensingandacquisition
Imagesamplingandquantization
Somebasicrelationshipsbetweenpixels
LinZHANG,SSE,2013
ImageSamplingandQuantization
Samplingandquantizationwillconvertacontinuous
imagesignalf toadiscretedigitalform
Digitizingthecoordinatevaluesiscalledsampling
Digitizingtheamplitudeiscalledquantization
LinZHANG,SSE,2013
ImageSamplingandQuantization
Samplingandquantizationwillconvertacontinuous
imagesignalf toadiscretedigitalform
LinZHANG,SSE,2013
ImageSamplingandQuantization
Samplingandquantizationwillconvertacontinuous
imagesignalf toadiscretedigitalform
Resultofimagesamplingandquantization
LinZHANG,SSE,2013
ImageSamplingandQuantization
Representingimages
LinZHANG,SSE,2013
ImageSamplingandQuantization
Spatialresolution
Thespatialresolutionofanimageisdeterminedbyhow
samplingwascarriedout
DPI(dotsperinch)isusedtomeasurethespatialresolution
Note:tosaythatanimagehasaresolution1024*1024
isnotameaningfulstatementwithoutstatingthe
spatialdimensionsencompassedbytheimage
LinZHANG,SSE,2013
ImageSamplingandQuantization
Spatialresolutionanexample
LinZHANG,SSE,2013
ImageSamplingandQuantization
Spatialresolutionanexample
LinZHANG,SSE,2013
ImageSamplingandQuantization
Spatialresolutionanexample
LinZHANG,SSE,2013
ImageSamplingandQuantization
Spatialresolutionanexample
LinZHANG,SSE,2013
ImageSamplingandQuantization
Spatialresolutionanexample
LinZHANG,SSE,2013
ImageSamplingandQuantization
Spatialresolutionanexample
LinZHANG,SSE,2013
ImageSamplingandQuantization
Intensityresolution
Intensityresolutionreferstothesmallestdiscerniblechange
inintensitylevel
Themoreintensitylevelsused,thefinerthelevelofdetail
discernableinanimage
Thenumberofbitsusedtoquantizeintensityisoftenreferred
astheintensityresolution
Number of Bits
Number of Intensity
Levels
Examples
0, 1
16
256
00110011, 01010101
16
65,536
1010101010101010
LinZHANG,SSE,2013
ImageSamplingandQuantization
Intensityresolution
8bitsperpixel
4bpp
7bpp
3bpp
6bpp
5bpp
2bpp
1bpp
LinZHANG,SSE,2013
ImageSamplingandQuantization
Imageinterpolation
Itisabasictoolusedintaskssuchaszooming,shrinking,
rotating,andgeometriccorrections
Traditionalmethodsincludenearestneighbor,bilinear,and
bicubic
ur
ne
ar
n
t
s
e
bo
h
ig
bil
in
ea
LinZHANG,SSE,2013
Contents
Elementsofvisualperception
Lightandtheelectromagneticspectrum
Imagesensingandacquisition
Imagesamplingandquantization
Somebasicrelationshipsbetweenpixels
LinZHANG,SSE,2013
SomeBasicRelationshipsbetweenPixels
Neighborsofapixel
p(x, y) isapixel
p
N4(p): 4neighbours
ofp
p
ND(p): diagonal
neighboursofp
p
N8(p): 8neighbours
ofp
LinZHANG,SSE,2013
SomeBasicRelationshipsbetweenPixels
Adjacency
LetV:Setofgraylevelvaluesusedtodefineconnectivity;
e.g.,V={1}.
4adjacency:twopixelsp andq withvaluesinV are4
adjacentifq isinthesetN4(p)
8adjacency:twopixelsp andq withvaluesinV are8
adjacentifq isinthesetN8(p)
madjacency(mixedadjacency):(modificationof8ato
eliminatemultipleconnections)twopixelsp andq with
valuesinV aremadjacentif
(i)q isinN4(p) or
(ii)q inND(p) andN4(p) N4(q) hasnopixelswhosevalues
arefromV
LinZHANG,SSE,2013
SomeBasicRelationshipsbetweenPixels
Adjacencyexamples
011
011
011
010
010
010
001
001
001
Anarrangementofpixels8adjacencymadjacency
LinZHANG,SSE,2013
SomeBasicRelationshipsbetweenPixels
Connectivityandregions
LetS representasubsetofpixelsinanimage
For,thesetofpixelsthatareconnecttoitinS
pS
iscalled
aconnectedcomponent ofS;ifS hasonlyoneconnected
component,S iscalledaconnectedset anditisalsoaregion
TworegionsRi andRj aresaidtobeadjacent iftheirunion
formsaconnectedset;otherwise,theyaredisjoint
110111
101011
110011
Ri
Note:whentalkingabout
regionsadjacency,the
adjacencytypeshouldbe
mentioned
Rj
LinZHANG,SSE,2013
SomeBasicRelationshipsbetweenPixels
Boundary
BoundaryofaregionR isthesetofpointsthatareadjacentto
pointsinthecomplementofR (innerborder)
Outerborder istheborderofinthebackground(toguarantee
theborderfollowingalgorithmswillformaclosedpath)
Usually,adjacencybetweenpointsinaregionandits
backgroundisdefinedintermsof8connectivity
000
010
010
010
010
000
Theinnerborderofthe1valuedregion
doesnotformaclosedpath,butitsouter
boundarydoes
LinZHANG,SSE,2013
SomeBasicRelationshipsbetweenPixels
Distancemeasures
Forpixelsp,q,andz,withcoordinates(x, y),(s, t),and(v, w),D
isadistance function ormetric if
(a) D( p, q) 0 D( p, q) 0, iff p q
(b) D ( p, q) D ( q, p ) ,and
(c) D ( p, z ) D ( p, q) D ( q, z )
Euclideandistance
De ( p, q ) ( x s ) ( y t )
2
2 1/2
LinZHANG,SSE,2013
SomeBasicRelationshipsbetweenPixels
Distancemeasures
Forpixelsp,q,andz,withcoordinates(x, y),(s, t),and(v, w),D
isadistance function ormetric if
(a) D( p, q) 0 D( p, q) 0, iff p q
(b) D ( p, q) D ( q, p ) ,and
(c) D ( p, z ) D ( p, q) D ( q, z )
D4 distance(cityblockdistance,orManhattandistance)
D4 ( p, q) x s y t
2
2 1 2
2 1 p 1 2
2 1 2
2
LinZHANG,SSE,2013
SomeBasicRelationshipsbetweenPixels
Distancemeasures
Forpixelsp,q,andz,withcoordinates(x, y),(s, t),and(v, w),D
isadistance function ormetric if
(a) D( p, q) 0 D( p, q) 0, iff p q
(b) D ( p, q) D ( q, p ) ,and
(c) D ( p, z ) D ( p, q) D ( q, z )
D8 distance(Chessboarddistance)
D8 ( p, q ) max x s , y t
2
2
2
2
2
2
1
1
1
2
2 2 2
1 1 2
p 1 2
1 1 2
2 2 2
LinZHANG,SSE,2013
Summary
Wehavelookedat:
Elementsofvisualperception
Lightandtheelectromagneticspectrum
Imagesensingandacquisition
Imagesamplingandquantization
Somebasicrelationshipsbetweenpixels
Nexttimewestarttolookattechniquesforimage
enhancement
LinZHANG,SSE,2013
Thanksforyourattention
LinZHANG,SSE,2013