Professional Documents
Culture Documents
Image Registration Based On A Generalized SSI Metric
Image Registration Based On A Generalized SSI Metric
Image Registration Based On A Generalized SSI Metric
Maggi
corresponding cluster
= image domain
L = label set = {e1,e2,e3,...,eN}
Atlas: (T,A)
Choose A0 as segmentation of R
Four strategies
Single atlas for all images to be segmented
Choice of best atlas for each given image into an
atlas set
Average atlas for all the images to be segmented
Simultaneous use of multiple atlases
Strategia
#Atlas x image
Type of atlas
Assignment of atlas to F
IND
Single
Individual
Fixed
SIM
Single
Individual
Variable
AVG
Single
Average
Fixed
MUL
Multiple
Individual
Fixed
Set of atlases
Segment R using all atlases
Select the atlas that gives the best risult
Maximum similarity
Minimum deformation
Set of atlases
Register R using each atlas
Tag pixels with labels usin all information
Ex: voting strategy <-> tag with label chosen by
(Ex: = i ei )
= (x;)
x : spatial coordinate (in R2 )
: parameter (in RN )
: R2 x RN function (represents the selected class
of transformations)
Find in RN
= arg min c()
Need rules to
Evaluate images out of their domain of definition
(extrapolation)
Compute values of (deformed) images at pixels
(interpolation)
Compute the values of derivative of images at
pixels (numerical differentiation)
[Citare: ....]
p[ X = xi , Y = y j ]
p[ X = xi ] p[Y = y j ]
Compute MI(XR,XT)
hT (i ) = # { pix : T ( pix) = xi }
hR (i ) = # { pix : R ( pix) = xi }
Probabilities
h (i )
p[ X T = xi ] = T
N pix
hR (i )
p[ X R = xi ] =
N pix
hT (i, j )
p[ X T = xi , X R = x j ] =
N pix
[Parzen, 1962]
x2
Gaussian window ( x) = e
Continuous joint histogram
1
R( x) T ( x)
hR ,T ( , ) = 2
dx
k
k
Joint probability
pR ,T ( , ) =
hR ,T ( , )
h
', '
R ,T
( ' , ' )
pR ,T ( , )
pR ( ) pT ( )
Extremely robust
Straightforward implementation
for cycle over gray level bins
look for pixels contributing to the given bin
128x128
256x256
512x512
LS
0.0468
0.1248
0.3588
1.56
MI
1.1544
4.4304
17.7061
72.0101
Histogram 1.1856
4.1808
16.6765
65.9104
T,R images
1
T =
N
1
R=
N
Ti
i
1
2
s =
(Ti T )
N 1 i
2
T
sT , R
1
2
s =
( Ri R )
N 1 i
2
R
1
=
(Ti T )( Ri R )
N 1 i
Luminance
Contrast
Correlation
2 R T + c1
l ( R, T ) = 2
R + T 2 + c1
2 sR sT + c2
c ( R, T ) = 2
sR + sT2 + c2
2 sR ,T + c3
s ( R, T ) =
sR sT + c3
Simplification ( c2 = c3 / 2 )
2 sR ,T + c2
2 R T + c1
SSIM ( R, T ) = 2
=
2
2
2
R + T + c1 sR + sT + c2
= S1 ( R, T ) S2 ( R, T )
We set
d1 (T , R) = 1 S1 (T , R)
d 2 (T , R) = 1 S 2 (T , R)
d1 (T , R ) =
2
T R + c1
2
T + R + c1
( T 0 = T T , R0 = R R )
T R
0
d 2 (T , R) =
2
0 2
0 2
+ R
+ c2
0 2
+ c2
T =
j
t = T
j,
Besov norm
T
B2s , p
= ( 2
j
j (1 / p 1 / 2 )
js
2 Tj
p 1/ p
l2
T
R
j
j
d (T , R ) = j
2
2
Tj + R j
j
p / 2 1/ p
SSI metric
T R +c
1
p
d (T , R ) = 1 2
2
T + R + c1
p/2
T0 R +c
1
+ 1
2
2
T 0 + R 0 + c1
0 2
d (T , R) p = j
2
Tj + R j
j
p/2
p/2
Chain-rule
II
III
D ( X ; x)
T ( y )
Image module
Transformation module
Distance module
Input:
The parameter
Output:
The grid G obtained by deforming the reference
Input:
A sampled image X
A grid G of arbitrary points (representing the
Output:
An interpolated (or extrapolated) value of X at the
points of G
A value of X at the points of G
Input
An arbitrary image X sampled at the points of the
reference grid
Output:
The value of the cost function c(X)
The value at the points of the reference grid of
To evaluate c()
Call the mapping module to obtain the deformed
grid G
Call the image model module to sample T at the
grid G -> T = deformed image sampled at the
reference grid
Call the distance module to evaluate c() = d(T;R).
To evaluate c
Call the mapping module and evaluate J (x; )
REFERENCE IMAGE
TEMPLATE IMAGE
No noise
Distance: LS
No noise
Distance: SSIM
p=2
No noise
Distance: GSSIM
p=2
Gaussian noise
Distance: LS
Gaussian noise
Distance: SSIM
p=2
Gaussian noise
Distance: GSSIM
p=2
LS
0.2815
0.35938
0,73438
3.0156
SSIM
0.23438
0.67188
1.8906
6.5625
G-SSIM
1.125
1.5313
2.9531
12.875
MI(*)
2.106
8.0965
31.902
134.41
REFERENCE IMAGE
TEMPLATE IMAGE
LS
SSIM
G-SSIM
Pearson 0.245
0.858
0.872
0.926
Overlap
0.492
0.992
0.993
0.992
M1
0.47
0.833
0.846
0.85
M2
0.253
0.868
0.861
0.933