Professional Documents
Culture Documents
D11VT3 N6
D11VT3 N6
D11VT3 N6
TIU LUN
nh x khi Block Matching
Hc phn:
X l m thanh v hnh nh
X l tn hiu s
Li ni u
Cng ngh x l nh ngy cng pht trin v c ch trng , cht lng nh
v video ngy cng c nng cao p ng nhu cu trao i thng tin ca con
ngi.Ti liu ca chng ti ch yu tp trung ni v phn x l nh trong phng
php m chng ti mun ni ti v nghin cu y l vn nh x khi. hiu
c tm quan trng ca n cng nh li ch ca n mang li ta s cng nhau tm hiu
n.Bng cch loi b d thiu trong nh s tip kim s bits dnh cho m ha v s tit
kim c bng thng trn mi trng internet qua ta thy c tm quan trng ca
vn ang nghin cu.Lm cch no ta nh gi s chuyn ng ca video, khi
truyn trn ng truyn ta truyn ci g v nh th no nhng cu hi s dn c
gii p qua ti liu nghin cu ca chng ta.V thi gian c hn nn s khng th
trnh c nhng sai st mong c gi v cc bn gp hon thin hn ti liu
nghin cu ca chng ti.
Nhm tc gi
Nguyn Quyt Tin
Nguyn Hu c
Phm Quang nh
H Ni thng 10/2014
D11VT3
Page 2
X l tn hiu s
Li ni u....................................................................................................................2
Bng biu v hnh nh.............................................................................................4
1.Gii thiu tng quan..................................................................................................6
1.1 nh x khi...........................................................................................................8
1.1.1 Khng chng ln nhau,cch u nhau, c nh kch thc , nh x khi vi
kch thc ch nht nh...........................................................................................9
1.1.2 Tiu chun nh x.........................................................................................11
1.2.3 Thut ton nh x khi..................................................................................14
1.3 Th tc tm kim.................................................................................................15
1.3.1 Tm kim y ...........................................................................................15
1.3.2 Tm kim logarit-2D.....................................................................................16
1.3.3 Thut ton tm kim ba bc........................................................................19
1.3.4 Thut ton tm kim ba bc mi.................................................................21
1.3.5 Thut ton tm kim bn bc......................................................................23
1.3.6 nh x khi a phn gii..............................................................................24
1.3.7 Ngng a phn gii nh x khi..................................................................27
1.4 Ph hp vi chnh xc...................................................................................34
1.5 Hn ch ca k thut nh x khi........................................................................35
1.6 Ci tin mi.........................................................................................................37
1.6.1 Cu trc phn cp nh x khi......................................................................37
1.6.2 Li a trong nh x khi.........................................................................41
1.6.3 nh x khi qua OVERLAPPER.................................................................45
2.Kt lun.................................................................................................................... 48
3.Ti liu tham kho...................................................................................................51
D11VT3
Page 3
X l tn hiu s
Page 4
X l tn hiu s
D11VT3
Page 5
X l tn hiu s
Page 6
X l tn hiu s
D11VT3
Page 7
X l tn hiu s
1.1 nh x khi
Bin php vector chuyn ng v s dng chng trong vic b chuyn ng
trong m ha lin khung ca tn hiu truyn hnh c th tm thy t nhng nm 1970.
Netravali v Robbins (1979) pht trin mt k thut im nh quy, trong c
lng vector chuyn ng ca mi im nh quy t nh ln cn s dng mt
phng php ti u. Limb v Rocca (1977) pht trin k thut cho c lng
vector chuyn ng ca mt khi v im nh. Gn nh sau , mt nh u tin c
phn chia thnh cc khu vc vi nhau mt khong cch bng nhau. Sau vector
chuyn ng c c lng cho mi khu vc. Phn on v c lng chuyn ng
kt hp vi khi khun dng ty l rt kh khn. Khi c nhiu khu vc chuyn ng
phc tp trong nh, tnh hnh tr ln kh khn. Thm vo nhng vector chuyn ng,
nhng thng tin hnh dng ny trong mi khu vc cn c m ha. K t y, khi khu
vc dch chuyn c hnh dng khc nhau, ng thi tnh ton v m ha tng ln ng
k.
K thut nh x khi c tp trung trong phn ny, n gin, khng phc tp
v cn rt hiu qu. Cho n nay c s dng ph bin nht trong k thut c lng
chuyn ng trong m ha nh. Trn thc t, n c chp nhn bi cc tiu chun
m ha video quc t: ISO, MPEG-1 v MPEG-2, v ITU H.261, v H.263.
c quan tm cho ti ngy nay, vi s tin b to ln trong k thut a phng
tin, v da trn ni dung s vn dng ca thng tin nghe nhn vn cn kht khe, c
bit trong kho d liu nghe nhn, thu hi v phn phi. Cc ng dng bao gm th vin
k thut s, video theo yu cu, c s d liu nghe nhn v tng t. bi vy, m ha
i tng theo hnh dng ty l c thu ht tham d nghin cu to ln cho n ngy
nay. N bao gm trong phm vi hot ng MPEG-4 (Brailean, 1997).Trong phn ny,
cc kha cnh khc nhau ca nh x khi l c ch . Chng bao gm khi nim v
thut ton, tiu chun ph hp, chin lc tm kim, hn ch, v ci tin mi.
D11VT3
Page 8
X l tn hiu s
Hnh 1. 1 nh x khi
D11VT3
Page 9
X l tn hiu s
D11VT3
Page 10
X l tn hiu s
D11VT3
Page 11
X l tn hiu s
(1.1)
y l quy vo nh l mt tiu chun ha chc nng tng quan cho hai chiu
(Musmann et al., 1985).
Thay v tm kim s ng dng ti a hoc tng quan, tng ng nhng hn
na hiu sut cao trong tnh ton phng php nh x khi tm tnh khng ng
dng nh nht, hoc li ph hp. Tnh khng ng dng ( i khi quy vo sai s, mo,
khong cch) gia hai nh tn v tn-1, D (s, t) l vch r nh sau
(1.2)
Page 12
(1.3)
X l tn hiu s
Trong MAD,
M(u,v) = |u-v|.
(1.4)
C th thy rng, tiu chun n gin nht tiu chun ha tng quan cho hai
chiu vch r trong phng trnh 1.1.
Trc khi chuyn sang phn tip theo, bnh lun trn vic la chn cc bin
php khng ging nhau l ng. Nghin cu trn thc nghim bo co rng tiu chun
nh x khng nh hng ng k theo nghin cu ( Srinivasan, 1984). K t y, MAD
c u tin hn do bi tnh n gin trong thc nghim ( Musmann et al., 1985).
1.2.3 Thut ton nh x khi
Page 13
X l tn hiu s
thnh cc i tng tng ng trn khung tip theo. tng ng sau nh x khi l
phn chia khung hnh hin thi thnh mt ma trn macro block, sau so snh vi
block tng ng v cc khi ln cn trong khung trc to ra mt vector quy nh
s chuyn ng mt macro block t im ny n im khc trong khung trc .
Chuyn ng ny c tnh cho tt c cc macro block bao gm mt khung, vic thit
lp d on chuyn ng trong khung hin thi. Vng tm kim tt cho mt macro
block ph hp c quy nh ln n p im nh trn bn pha ca macro block tng
ng trong khung nh trc . p c gi l tham s tm kim. Chuyn ng cng
ln th yu cu p cng phi ln, v ln ca tham s tm kim c tnh ton k
qu trnh ny tr thnh d on chuyn ng. Thng thng macro block c cho
nh mt vung vi cnh l 16 pixel vi tham s p l 7 pixels hnh 3. Mt macro
block c nh x thnh mt block khc da trn gi tr u ra ca mt hm. Gi tr
l kt qu thp nht thu c t vic nh x block hin ti gn nht thu c mt
macro block mi. Mt hm th c nhiu gi tr khc nhau, trong ph bin nht v
c tnh ton k nht l trung bnh sai khc tuyt i (Mean Absolute Difference MAD) cho bi phng trnh (1.5). Mt gi tr khc ca hm l trung bnh sai s bnh
phng (Mean Squared Error - MSE) cho bi phng trnh (1.6).
1 N 1 N 1
MAD 2 Cij Rij
N i 0 j 0
1 N 1 N 1
MSE 2 Cij Rij
N i 0 j 1
(1.5)
2
(1.6)
Trong :
D11VT3
Page 14
X l tn hiu s
1.3 Th tc tm kim
Vn tm kim l mt vn quan trng i ph vi nh x khi.Mt s
chin lc c tho lun di y.
1.3.1 Tm kim y
Hnh 1.2 : Cho thy mt ca s tm kim, mt ca s tng quan, v kch thc
ca chng.Trong vic tm kim ph hp nht, ca s tng quan c di chuyn n
tng v tr c th chn trong ca s tm kim. C ngha l, c mt tng (2d+1)x(2d+1)
cc v tr m cn c kim tra.S khc nhau ti thiu cho kt qu ph hp nht.R
rng, y l phng php tm kim y l mt thut ton trong trng thi t nhin.
Tm kim y cung cp chnh xc kh tt trong s tm kim ph hp nht (Do
chnh xc cao trong s c lng chuyn ng ),mt s lng ln cc php tnh l
phc tp.
lm gim tnh ton phc tp,mt s th tc tm kim nhanh c pht
trin .Chng c gii thiu di y.
1.3.2 Tm kim logarit-2D
Jain (1981) pht trin mt quy trnh tm kim logarit-2D.Da trn th tc tm
kim logarit-1D (1973), phng php 2D lin tc gim c din tch vng tm
kim, do lm gim c gnh nng tnh ton.
Nhng bc u tin tnh ton tiu chun ph hp cho 5 im trong ca s tm
kim.Nm im ny l nh sau : im trung tm ca ca s tm kim v bn im
xung quanh n,vi mt im gia l im trung tm bn ranh gii ca ca s.
Bc 1: Trong s 5 im ny , s tng ng mi im c mt mc (cc mc
khc nhau) so snh vi mt mc ti thiu v s chn ra im chin thng.
D11VT3
Page 15
X l tn hiu s
D11VT3
Page 16
X l tn hiu s
D11VT3
Page 17
X l tn hiu s
D11VT3
Page 18
X l tn hiu s
Hnh 1. 6 Phng thc tm kim 3 bc.im( j+4,k-4) ,( j+4 , k-6 ) v ( j+5,k-7) cho cc
im ti thiu khc nhau trong bc 1 ,2,3 ring tng bc.
Page 19
X l tn hiu s
D11VT3
Page 20
X l tn hiu s
D11VT3
Page 21
X l tn hiu s
Hnh 1. 8 nh x khi tm kim 4 bc: Phm vi kim tra ca TSS trong bc u tin l kh
ln v the quares l vic m rng thm 8 im c thm vo trong bc u tin ca NTSS.
Hnh tam gic v diamond l bc th hai ca NTSS biu din 3, 5 im c kim tra khi
trng s thp nht trong bc u tin l mt trong nhng 8 im ca ca s trung tm.
Page 22
X l tn hiu s
D11VT3
Page 23
X l tn hiu s
D11VT3
Page 24
X l tn hiu s
Page 25
X l tn hiu s
Page 26
X l tn hiu s
nh fn(x, y) v fn-1(x, y), tng ng. Cho php mc kim t thp biu th vi
l chy t
= 0,1,.L, ti
gc ca mt khi ti mc
biu th bi b1x v
b1y tng ng. Ging nh phng thc thay i kch thc khi (Tham chiu ti
phng thc 1 trong Tzovaras etal. [1994]), kch thc khi trong bi ton ny thay i
D11VT3
Page 27
X l tn hiu s
l +1 tr thnh 2b
l b1x ,sau
trc ti mc
c th tnh ton nh
(1.7)
vly l hai thnh phn ca vector chuyn ng dc theo trc x v y, tng ng.
Mt s khi ca thut ton c th hin trong hnh 1.9. Gi tr ngng gii
hn trong iu kin ca MAD cn c xc nh trc theo yu cu chnh xc ca c
lng chuyn ng. Xc nh ngng tho lun cui cng trong phn B ca mc ny.
Kim t thp Gaussian c hnh thnh t hai khung hnh lin tip ca mt chui nh t
c lng c chuyn ng mong mun. Sau nh x khi c thc hin cp
cao nht vi biu tm kim ton b. nh gi vector chuyn ng c kim tra
xem nu chng c cung cp y nn chuyn ng. Nu yu cu chnh xc c
p ng, sau vector chuyn ng s c truyn n mc phn gii cao hn tip
theo bt u lc.Qu trnh ngng c bn lun cui cng trong phn C ca mc
ny. Thut ton tip tc theo cch ny cho ti khi hai ngng c p ng hoc chm
ti mc y. B qua mt s bc tnh ton mc trung gian cho tit kim tnh ton.
D11VT3
Page 28
X l tn hiu s
Vic th nghim kh l phc tp chuyn ng khc nhau chng minh rng cc thut
ton d kin gim thi gian x l t 14 n 20%, trong khi duy tr hu nh l cht
lng ging nhau trong vic xy dng li hnh nh so vi thut ton nh x khi a
phn gii hin l nhanh nht.
Page 29
X l tn hiu s
2552
PSNR= 10log10 MSE
(1.8)
Page 30
(1.9)
X l tn hiu s
Hnh 1. 13 X l ngng
Page 31
X l tn hiu s
theo, khi tng s lng khi l s lng khi tn ti mc cao nht.Cn lu rng
tng s lng khi l ging nhau cho mi mc trong kim t thp.Thi gian s l l
tng ca tng cc s c thm vo bao gm trong s nh gi ca MAD v hot ng
ca ngng.
Trong cc th nghim, hai cp kim t thp c s dng k t khi cung cp hiu
nng tt nht cho mc ch c lng chuyn ng (Tzovaras et al., 1994). Thut ton
c kim tra trn ba cnh video vi chuyn ng phc tp khc nhau, ngha l Miss
America, Train, Football. Cnh Miss America c mt ngi ni i vi mt
nn tnh v chuyn ng t hn. Cnh Train nhiu chi tit hn v cha nhiu i
tng chuyn ng nhanh. Cnh khung th 20 trong hnh hin th 1.14 . Cnh
Football cha nhiu chuyn ng so vi hai cnh khc.
D11VT3
Page 32
X l tn hiu s
1.4 Ph hp vi chnh xc
Nhn bn ngoi, hai thnh phn ca vector chuyn ng thu c bng cch s
dng k thut m t trn l mt s nguyn ln im nh. Cng c th coi n nh mt
im nh. Nu mun c chnh xc cao hn, tc l cc thnh phn ca vector chuyn
ng c th khng phi l s nguyn ln im nh, th cn phi s dng php ni suy
nh. Khng ch c tnh ton s liu, ngoi ra cc bit cng c s dng m t cho
cc vector chuyn ng. Vic c lng mt cch chnh xc chuyn ng dn n li
d on s t hn. Trong thc t, vic s dng chnh xc mt na im nh hoc
im nh th c s dng rng ri hn chnh xc ca mt im nh.
D11VT3
Page 33
X l tn hiu s
D11VT3
Page 34
X l tn hiu s
Page 35
X l tn hiu s
phn tip theo. Tuy nhin, nh x khi vn cn ph bin cho ti nay, vi cc k thut
d on chuyn ng v b chuyn ng c s dng trong vic m ha video,v n
cng c tiu chun ha quc t. Ni cch khc, nh x khi l k thut ph hp
nht trong vic m ha video cc th h i u (Dufaux v Moscheni, 1995).
1.6 Ci tin mi
1.6.1 Cu trc phn cp nh x khi
Bierling (1988) nghin cu v pht trin kin trc phn cp c s da trn
hai phng din sau y. Phng din th nht, i vi cc chuyn ng tng i
ln, yu cu nh x khi c chnh xc th cc block cng phi c kch thc ln.
iu ny c th hiu l nu ta xem xt trng hp ngc li ca n: mt chuyn ng
ln vi mt ca s tng quan nh, trng hp ny, phm vi nghin cu l kh rng.
V vy, xc xut tm c nhiu nh x l kh cao, kt qu dn n d on chuyn
ng l khng tin cy. Trn mt phng din khc, mt block c kch thc ln c th
vi phm cc gi thit rng tt c cc im nh trong block s s dng cng mt vector
chuyn ng. Do mt block c kch thc nh s ph hp vi yu cu ca gi thit.
Nhng quan st v shed light da trn vic s dng cc block c kch thc khng i,
c th dn n d on chuyn ng khng tin cy.
tha mn hai yu cu tri ngc nhau mt cch ng thi, trong phng
php nghin cu kin trc phn tng cho cc block c kch thc khc nhau v s
dng cc ca s tng quan. iu kin cn thit, xem xt kin trc phn tng vi 3
mc ca thut ton nh x khi, in which three block-matching procedures are
conducted, each with its own parameters. Khi nh x u tin l khi c kch thc
ln nht trong cc khi v cc ca s tng quan. Bng cch s vector d on chuyn
ng nh mt vector bt u ti mc th 2, ta li tm hiu vi block ln th 2 trong cc
block v cc ca s tng quan. i vi mc th 3 ta cng lm tng t nh vy trn
c s kt qu tm c ca mc th 2. Mt v d vi 3 c s tng quan c minh
D11VT3
Page 36
X l tn hiu s
at Top Level
D11VT3
Page 37
X l tn hiu s
Frames Tested
(%)
(%)
Miss_America
38
20
(TH = 2)
Train sequence
52
17
(TH = 3)
Football sequence
38
14
sequence
(TH = 4)
D11VT3
Page 38
X l tn hiu s
tng
Kch thc b Cc mu
lc LPF
con
7pel
quan
64x64
3pel
28x28
5x5
4x4
3pel
12x12
5x5
2x2
5x5
4x4
Page 39
X l tn hiu s
D11VT3
Page 40
X l tn hiu s
Page 41
X l tn hiu s
D11VT3
Page 42
X l tn hiu s
Page 43
X l tn hiu s
Page 44
X l tn hiu s
Page 45
X l tn hiu s
Evi ( x, y ) Pvi x, y T x, y
(1.10)
WEvi x, y Evi x, y W ( x, y )
(1.11)
MAD
1 l l
WEvi ( x, y )
l 2 x 1 y 1
(1.12)
WPv x, y Pv ( x, y ) W ( x, y )
(1.9)
Page 46
X l tn hiu s
2.Kt lun.
Bi n nay, nh x khi c s dng thng xuyn hn bt k k thut c
lng chuyn ng no khc trong m ha b chuyn ng. Bng phn chia mt khung
thnh khong khng chng ln nhau, cch u, c nh kch thc, khi hnh ch nht
nh v gi nh rng tt c im nh trong mt khi cho trc ging nhau chuyn ng
tnh tin, nh x khi trnh nhng kh khn gp trong c lngkhi hnh dng ty
chuyn ng. Do , nh x khi l n gin nht v ko theo gim i thng tin khc
so snh vi c lngchuyn ng vi cc khi hnh dng ty .
Mc d m hnh ny n gin cn xem xt chuyn ng tnh tin, cc loi
chuyn ng khc, nh l xoay v phng to ca nhng i tng rng hn, c th gn
nh xp s bi dch phn ca nhng khi nh, vi iu kin cc khi ny nh. Ch
quan trng, bt u thc hin bi Jain v Jain, c xc thc ln na v sau ln
na.
Nhiu vn khc kt hp vi nh x khi nh l chn la kch thc khi, tiu
chun khi, nghin cu chin lc, chnh xc ph hp, hn ch v ci tin c tho
lun trong chng ny. c bit l, kch thc khi 16 x 16 l s dng thng xuyn.
Trong nhiu c lng chuyn ng chnh xc, kch thc 8 x 8 cng thng c s
dng. trng hp sau, nhiu c lngchuyn ng ng ng l thu c nhiu thng
tin kha cnh v tnh ton phc tp hiu sut cao.
Vi tiu ch tiu chun nh x khc c th s dng trong nh x khi. T
hin th cc tiu chun khng lm vn quan trng khc trong nh x khi, sai s
tuyt i trung bnh k t y c u tin bi v tnh n gin trong thc nghim.
thng k tm kim ton b by t chnh xc trong tm kim tnh ton tt nht.
Cch khc, n yu cu c tnh s lng nhiu. m tnh ton phc tp thp nht,
vi th tc tm kim nhanh c pht trin: 2-D thut ton tm kim, tm kim ba
bcvv
D11VT3
Page 47
X l tn hiu s
Page 48
X l tn hiu s
D11VT3
Page 49
X l tn hiu s
D11VT3
Page 50