'DWD&ROOHFWLRQ3URFHGXUHV

&RPPHQWV DERXW WKH UROH RI WKH UHVHDUFKHU VHW WKH VWDJH IRU GLVFXVVLRQ RI LVVXHV LQYROYHG LQ
FROOHFWLQJ GDWD 7KH GDWD FROOHFWLRQ VWHSV LQFOXGH VHWWLQJ WKH ERXQGDULHV IRU WKH VWXG\ FROOHFWLQJ
LQIRUPDWLRQ WKURXJK XQVWUXFWXUHG RU VHPL VWUXFWXUHG REVHUYDWLRQV DQG LQWHUYLHZV GRFXPHQWV DQG
YLVXDOPDWHULDOVDVZHOODVHVWDEOLVKLQJWKHSURWRFROIRUUHFRUGLQJLQIRUPDWLRQ

‡ ,GHQWLI\ WKHSXUSRVHIXOO\ VHOHFWHG VLWHV RU LQGLYLGXDOV IRU WKH SURSRVHG VWXG\ 7KH LGHD EHKLQG
TXDOLWDWLYHUHVHDUFKLVWRSXUSRVHIXOO\VHOHFWSDUWLFLSDQWVRUVLWHVRUGRFXPHQWVRUYLVXDOPDWHULDO
WKDW ZLOO EHVW KHOS WKH UHVHDUFKHU XQGHUVWDQG WKH SUREOHP DQG WKH UHVHDUFK TXHVWLRQ 7KLV GRHV QRW
QHFHVVDULO\ VXJJHVW UDQGRP VDPSOLQJ RU VHOHFWLRQ RI D ODUJH QXPEHU RI SDUWLFLSDQWV DQG VLWHV DV
W\SLFDOO\IRXQGLQTXDQWLWDWLYHUHVHDUFK$GLVFXVVLRQDERXWSDUWLFLSDQWVDQGVLWHPLJKWLQFOXGHIRXU
DVSHFWVLGHQWLILHGE\0LOHVDQG+XEHUPDQDWKHVHWWLQJLHZKHUHWKHUHVHDUFKZLOOWDNH
SODFHEWKHDFWRUVLHZKRZLOOEHREVHUYHGRULQWHUYLHZHGFWKHHYHQWVLHZKDWWKHDFWRUV
ZLOO EH REVHUYHG RU LQWHUYLHZHG GRLQJ DQG G WKH SURFHVV LH WKH HYROYLQJ QDWXUH RI HYHQWV
XQGHUWDNHQE\WKHDFWRUVZLWKLQWKHVHWWLQJ
‡$UHODWHGWRSLFZRXOGEHWKHQXPEHURIVLWHVDQGSDUWLFLSDQWVWREHLQYROYHGLQ\RXUVWXG\$VLGH
IURPWKHVPDOOQXPEHUWKDWFKDUDFWHUL]HVTXDOLWDWLYHUHVHDUFKKRZPDQ\VLWHVDQGSDUWLFLSDQWVVKRXOG
\RXKDYH")LUVWRIDOOWKHUHLVQRVSHFLILFDQVZHUWRWKLVTXHVWLRQDOWKRXJK,KDYHWDNHQWKHSRVLWLRQ
&UHVZHOO  WKDW VDPSOH VL]H GHSHQGV RQ WKH TXDOLWDWLYH GHVLJQ EHLQJ XVHG HJ HWKQRJUDSK\
FDVHVWXG\)URPP\UHYLHZRIPDQ\TXDOLWDWLYHUHVHDUFKVWXGLHV,KDYHIRXQGQDUUDWLYHUHVHDUFKWR
LQFOXGHRQHRUWZRLQGLYLGXDOVSKHQRPHQRORJ\WRW\SLFDOO\UDQJHIURPWKUHHWRWHQJURXQGHGWKHRU\
WZHQW\ WR WKLUW\ HWKQRJUDSK\ WR H[DPLQH RQH VLQJOH FXOWXUHVKDULQJ JURXS ZLWK QXPHURXV DUWLIDFWV
LQWHUYLHZVDQGREVHUYDWLRQVDQGFDVHVWXGLHVWRLQFOXGHDERXWIRXUWRILYHFDVHV7KLVLVFHUWDLQO\
RQH DSSURDFK WR WKH VDPSOH VL]H LVVXH$QRWKHU DSSURDFK LV HTXDOO\ YLDEOH 7KH LGHD RIVDWXUDWLRQ
FRPHVIURPJURXQGHGWKHRU\&KDUPD]VDLGWKDW\RXVWRSFROOHFWLQJGDWDZKHQWKHFDWHJRULHV
RU WKHPHV DUH VDWXUDWHG ZKHQ JDWKHULQJ IUHVK GDWD QR ORQJHU VSDUNV QHZ LQVLJKWV RU UHYHDOV QHZ
SURSHUWLHV
‡ ,QGLFDWH WKH W\SH RU W\SHV RI GDWD WR EH FROOHFWHG ,Q PDQ\ TXDOLWDWLYH VWXGLHV LQTXLUHUV FROOHFW
PXOWLSOHIRUPVRIGDWDDQGVSHQGDFRQVLGHUDEOHWLPHLQWKHQDWXUDOVHWWLQJJDWKHULQJLQIRUPDWLRQ7KH
FROOHFWLRQ SURFHGXUHV LQ TXDOLWDWLYH UHVHDUFK LQYROYH IRXU EDVLF W\SHV DQG WKHLU VWUHQJWKV DQG
OLPLWDWLRQVDVVKRZQLQ7DEOH

$ TXDOLWDWLYH REVHUYDWLRQ LV ZKHQ WKH UHVHDUFKHU WDNHV ILHOG QRWHV RQ WKH EHKDYLRU DQG
DFWLYLWLHV RI LQGLYLGXDOV DW WKH UHVHDUFK VLWH ,Q WKHVH ILHOG QRWHV WKH UHVHDUFKHU UHFRUGV LQ DQ
XQVWUXFWXUHGRUVHPLVWUXFWXUHGZD\XVLQJVRPHSULRUTXHVWLRQVWKDWWKHLQTXLUHUZDQWVWRNQRZ
DFWLYLWLHV DW WKH UHVHDUFK VLWH 4XDOLWDWLYH REVHUYHUV PD\ DOVR HQJDJH LQ UROHV YDU\LQJ IURP D
QRQSDUWLFLSDQWWRDFRPSOHWHSDUWLFLSDQW7\SLFDOO\WKHVHREVHUYDWLRQVDUHRSHQHQGHGLQWKDWWKH
UHVHDUFKHUVDVNJHQHUDOTXHVWLRQVRIWKHSDUWLFLSDQWVDOORZLQJWKHSDUWLFLSDQWVWRIUHHO\SURYLGH
WKHLUYLHZV
, QTXDOLWDWLYH LQWHUYLHZV WKH UHVHDUFKHU FRQGXFWV IDFHWRIDFH LQWHUYLHZV ZLWK SDUWLFLSDQWV
WHOHSKRQH LQWHUYLHZV RU HQJDJHV LQ IRFXV JURXS LQWHUYLHZV ZLWK VL[ WR HLJKW LQWHUYLHZHHV LQ
HDFKJURXS7KHVHLQWHUYLHZVLQYROYHXQVWUXFWXUHGDQGJHQHUDOO\RSHQHQGHGTXHVWLRQVWKDWDUH
 IHZLQQXPEHUDQGLQWHQGHGWRHOLFLWYLHZVDQGRSLQLRQVIURPWKHSDUWLFLSDQWV
'XULQJWKHSURFHVVRIUHVHDUFKWKHLQYHVWLJDWRUPD\FROOHFWTXDOLWDWLYHGRFXPHQWV7KHVHPD\
EH SXEOLF GRFXPHQWV HJ QHZVSDSHUV PLQXWHV RI PHHWLQJV RIILFLDO UHSRUWV RU SULYDWH
GRFXPHQWVHJSHUVRQDOMRXUQDOVDQGGLDULHVOHWWHUVHPDLOV
$ILQDOFDWHJRU\RITXDOLWDWLYHGDWDFRQVLVWVRITXDOLWDWLYHDXGLRDQGYLVXDOPDWHULDOV7KLVGDWD
PD\ WDNH WKH IRUP RI SKRWRJUDSKV DUW REMHFWV YLGHRWDSHV ZHEVLWH PDLQ SDJHV HPDLOV WH[W
PHVVDJHVVRFLDOPHGLDWH[WRUDQ\IRUPVRIVRXQG,QFOXGHFUHDWLYHGDWDFROOHFWLRQSURFHGXUHV
WKDWIDOOXQGHU WKHFDWHJRU\RIYLVXDOHWKQRJUDSK\3LQNDQGZKLFKPLJKWLQFOXGHOLYLQJ
VWRULHVPHWDSKRULFDOYLVXDOQDUUDWLYHVDQGGLJLWDODUFKLYHV&ODQGLQLQ
,QDGLVFXVVLRQDERXWGDWDFROOHFWLRQIRUPVEHVSHFLILFDERXWWKHW\SHVDQGLQFOXGHDUJXPHQWV
FRQFHUQLQJWKHVWUHQJWKVDQGZHDNQHVVHVRIHDFKW\SHDVGLVFXVVHGLQ7DEOH

‡,QFOXGHGDWDFROOHFWLRQW\SHVWKDWJREH\RQGW\SLFDOREVHUYDWLRQVDQGLQWHUYLHZV7KHVHXQXVXDO
IRUPV FUHDWH UHDGHU LQWHUHVW LQ D SURSRVDO DQG FDQ FDSWXUH XVHIXO LQIRUPDWLRQ WKDW REVHUYDWLRQV DQG
LQWHUYLHZVPD\PLVV)RUH[DPSOHH[DPLQHWKHFRPSHQGLXPRIW\SHVRIGDWDLQ7DEOHWKDWFDQEH
XVHG WR VWUHWFK WKH LPDJLQDWLRQ DERXW SRVVLELOLWLHV VXFK DV JDWKHULQJ VRXQGV RU WDVWHV RU XVLQJ
FKHULVKHGLWHPVWRHOLFLWFRPPHQWVGXULQJDQLQWHUYLHZ

7DEOH4XDOLWDWLYH'DWD&ROOHFWLRQ7\SHV2SWLRQV$GYDQWDJHVDQG/LPLWDWLRQV
127(7KLVWDEOHLQFOXGHVPDWHULDODGDSWHGIURP%RJGDQ %LNOHQ&UHVZHOODQG0HUULDP

7DEOH$/LVWRI4XDOLWDWLYH'DWD&ROOHFWLRQ$SSURDFKHV

2EVHUYDWLRQV
‡*DWKHUILHOGQRWHVE\FRQGXFWLQJDQREVHUYDWLRQDVDSDUWLFLSDQW
‡*DWKHUILHOGQRWHVE\FRQGXFWLQJDQREVHUYDWLRQDVDQREVHUYHU
‡*DWKHUILHOGQRWHVE\VSHQGLQJPRUHWLPHDVDSDUWLFLSDQWWKDQDVDQREVHUYHU
‡*DWKHUILHOGQRWHVE\VSHQGLQJPRUHWLPHDVDQREVHUYHUWKDQDVDSDUWLFLSDQW
‡*DWKHUILHOGQRWHVILUVWE\REVHUYLQJDVD³SDUWLFLSDQWRXWVLGHU´DQGWKHQPRYLQJLQWRWKHVHWWLQJDQGREVHUYLQJDVD³SDUWLFLSDQW
LQVLGHU´
,QWHUYLHZV
‡&RQGXFWDQXQVWUXFWXUHGRSHQHQGHGLQWHUYLHZDQGWDNHLQWHUYLHZQRWHV
‡&RQGXFWDQXQVWUXFWXUHGRSHQHQGHGLQWHUYLHZDXGLRWDSHWKHLQWHUYLHZDQGWUDQVFULEHLW
‡&RQGXFWDVHPLVWUXFWXUHGLQWHUYLHZDXGLRWDSHWKHLQWHUYLHZDQGWUDQVFULEHWKHLQWHUYLHZ
‡&RQGXFWDIRFXVJURXSLQWHUYLHZDXGLRWDSHWKHLQWHUYLHZDQGWUDQVFULEHLW
‡&RQGXFWGLIIHUHQWW\SHVRILQWHUYLHZVHPDLORU,QWHUQHWIDFHWRIDFHIRFXVJURXSRQOLQHIRFXVJURXSDQGWHOHSKRQHLQWHUYLHZV
'RFXPHQWV
‡.HHSDMRXUQDOGXULQJWKHUHVHDUFKVWXG\
‡+DYHDSDUWLFLSDQWNHHSDMRXUQDORUGLDU\GXULQJWKHUHVHDUFKVWXG\
‡&ROOHFWSHUVRQDOOHWWHUVIURPSDUWLFLSDQWV
‡$QDO\]HSXEOLFGRFXPHQWVHJRIILFLDOPHPRVPLQXWHVUHFRUGVDUFKLYDOPDWHULDO
‡([DPLQHDXWRELRJUDSKLHVDQGELRJUDSKLHV
‡&RQGXFWFKDUWDXGLWV
‡5HYLHZPHGLFDOUHFRUGV
$XGLRYLVXDO0DWHULDOV
‡([DPLQHSKRWRJUDSKVRUYLGHRWDSHV
‡+DYHSDUWLFLSDQWVWDNHSKRWRJUDSKVRUYLGHRWDSHVLHSKRWRHOLFLWDWLRQDQGWKHQLQWHUYLHZWKHPDERXWWKHPDWHULDOV
‡([DPLQHSK\VLFDOWUDFHHYLGHQFHHJIRRWSULQWVLQWKHVQRZ
‡9LGHRWDSHRUILOPDVRFLDOVLWXDWLRQRUDQLQGLYLGXDORUJURXS
‡([DPLQHZHEVLWHPDLQSDJHV
‡&ROOHFWVRXQGVHJPXVLFDOVRXQGVDFKLOG¶VODXJKWHUFDUKRUQVKRQNLQJ
‡&ROOHFWHPDLOPHVVDJHVGLVFXVVLRQERDUGPHVVDJHVHJ)DFHERRNRURWKHUIRUPVRIVRFLDOPHGLDPHVVDJHV
‡&ROOHFWFHOOSKRQHWH[WPHVVDJHVHJ7ZLWWHU
‡([DPLQHSRVVHVVLRQVRUULWXDOREMHFWV
‡&ROOHFWVRXQGVVPHOOVWDVWHVRUDQ\VWLPXOLRIWKHVHQVHV

6285&($GDSWHGIURP&UHVZHOO
'DWD5HFRUGLQJ3URFHGXUHV

%HIRUH HQWHULQJ WKH ILHOG TXDOLWDWLYH UHVHDUFKHUV SODQ WKHLU DSSURDFK WR GDWD UHFRUGLQJ 7KH
SURSRVDOVKRXOGLGHQWLI\ZKDWGDWDWKHUHVHDUFKHUZLOOUHFRUGDQGWKHSURFHGXUHVIRUUHFRUGLQJGDWD

‡3ODQWRGHYHORSDQGXVHDSURWRFROIRUUHFRUGLQJREVHUYDWLRQVLQDTXDOLWDWLYHVWXG\5HVHDUFKHUV
RIWHQ HQJDJH LQ PXOWLSOH REVHUYDWLRQV GXULQJ WKH FRXUVH RI D TXDOLWDWLYH VWXG\ DQG XVH DQ
REVHUYDWLRQDOSURWRFROIRUUHFRUGLQJLQIRUPDWLRQZKLOHREVHUYLQJ7KLVPD\EHDVLQJOHSDJHZLWKD
GLYLGLQJ OLQH GRZQ WKH PLGGOH WR VHSDUDWH GHVFULSWLYH QRWHV SRUWUDLWV RI WKH SDUWLFLSDQWV D
UHFRQVWUXFWLRQ RI GLDORJXH D GHVFULSWLRQ RIWKH SK\VLFDO VHWWLQJ DFFRXQWV RI SDUWLFXODU HYHQWV RU
DFWLYLWLHV IURP UHIOHFWLYH QRWHV WKH UHVHDUFKHU¶V SHUVRQDO WKRXJKWV VXFK DV ³VSHFXODWLRQ IHHOLQJV
SUREOHPV LGHDV KXQFKHV LPSUHVVLRQV DQG SUHMXGLFHV´ %RJGDQ  %LNOHQ  S  $OVR
ZULWWHQ RQ WKLV IRUP PLJKW EH GHPRJUDSKLF LQIRUPDWLRQ DERXW WKH WLPH SODFH DQG GDWH RI WKH ILHOG
VHWWLQJZKHUHWKHREVHUYDWLRQWDNHVSODFH
‡3ODQWRGHYHORSDQGXVHDQLQWHUYLHZSURWRFROIRUDVNLQJTXHVWLRQVDQGUHFRUGLQJDQVZHUVGXULQJ
D TXDOLWDWLYH LQWHUYLHZ 5HVHDUFKHUV UHFRUG LQIRUPDWLRQ IURP LQWHUYLHZV E\ PDNLQJ KDQGZULWWHQ
QRWHVE\DXGLRWDSLQJRUE\YLGHRWDSLQJ(YHQLIDQLQWHUYLHZLVWDSHG,UHFRPPHQGWKDWUHVHDUFKHUV
WDNHQRWHVLQWKHHYHQWWKDWUHFRUGLQJHTXLSPHQWIDLOV,IDXGLRWDSLQJLVXVHGUHVHDUFKHUVQHHGWRSODQ
LQ DGYDQFH IRU WKH WUDQVFULSWLRQ RI WKH WDSH 7KH LQWHUYLHZ SURWRFRO QHHGV WR LQFOXGH WKH IROORZLQJ
FRPSRQHQWV
 $KHDGLQJGDWHSODFHLQWHUYLHZHULQWHUYLHZHH
        ,QVWUXFWLRQV IRU WKH LQWHUYLHZHU WR IROORZ VR WKDW VWDQGDUG SURFHGXUHV DUH XVHG IURP RQH
LQWHUYLHZWRDQRWKHU
        7KH TXHVWLRQV W\SLFDOO\ DQ LFHEUHDNHU TXHVWLRQ DW WKH EHJLQQLQJ IROORZHG E\ IRXU WR ILYH
TXHVWLRQV WKDW DUH RIWHQ WKH VXETXHVWLRQV LQ D TXDOLWDWLYH UHVHDUFK SODQ IROORZHG E\ VRPH
FRQFOXGLQJVWDWHPHQWRUDTXHVWLRQVXFKDV³:KRVKRXOG,YLVLWZLWKWROHDUQPRUHDERXWP\
TXHVWLRQV"´
 3UREHVIRUWKHIRXUWRILYHTXHVWLRQVWRIROORZXSDQGDVNLQGLYLGXDOVWRH[SODLQWKHLULGHDVLQ
PRUHGHWDLORUWRHODERUDWHRQZKDWWKH\KDYHVDLG
 6SDFHVEHWZHHQWKHTXHVWLRQVWRUHFRUGUHVSRQVHV
 $ILQDOWKDQN\RXVWDWHPHQWWRDFNQRZOHGJHWKHWLPHWKHLQWHUYLHZHHVSHQWGXULQJWKHLQWHUYLHZ
 5HVHDUFKHUVW\SLFDOO\GHYHORSDORJWRNHHSDUHFRUGRIGRFXPHQWVFROOHFWHGIRUDQDO\VLVLQD
TXDOLWDWLYH VWXG\ ,Q D SURSRVDO IRU D VWXG\ LW LV KHOSIXO WR QRWH LQ WKLV ORJ ZKHWKHU WKH
LQIRUPDWLRQUHSUHVHQWVSULPDU\PDWHULDOLHLQIRUPDWLRQGLUHFWO\IURPWKHSHRSOHRUVLWXDWLRQ
XQGHUVWXG\RUVHFRQGDU\PDWHULDOLHVHFRQGKDQGDFFRXQWVRIWKHSHRSOHRUVLWXDWLRQZULWWHQ
E\RWKHUV,WLVDOVR KHOSIXO WRFRPPHQW RQWKHUHOLDELOLW\DQGYDOXHRIWKHGDWDVRXUFHV)RU
YLVXDOPDWHULDOVVRPHIRUPRIV\VWHPLVQHHGHGWRRUJDQL]HWKHPDWHULDOVVRWKDWWKH\FDQEH
HDVLO\UHWULHYHG$ORJNHSWE\WKHUHVHDUFKHUVZRXOGZRUNHTXDOO\ZHOOIRUWKLVIRUPRIGDWD
'DWD$QDO\VLVDQG,QWHUSUHWDWLRQ

$ PHWKRGV GLVFXVVLRQ LQ D TXDOLWDWLYH SURSRVDO QHHGV DOVR WR VSHFLI\ WKH VWHSV LQ DQDO\]LQJ WKH
YDULRXVIRUPVRITXDOLWDWLYHGDWD,QJHQHUDOWKHLQWHQWLVWRPDNHVHQVHRXWRIWH[WDQGLPDJHGDWD,W
LQYROYHVVHJPHQWLQJDQGWDNLQJDSDUWWKHGDWDOLNH3HHOLQJEDFNWKHOD\HUVRIDQRQLRQDVZHOODV
SXWWLQJLWEDFNWRJHWKHU7KHGLVFXVVLRQLQ\RXUSURSRVDODERXWTXDOLWDWLYHGDWDDQDO\VLVPLJKWEHJLQ
ZLWKVHYHUDOJHQHUDOSRLQWVDERXWWKHRYHUDOOSURFHVV

‡'DWDDQDO\VLV LQTXDOLWDWLYHUHVHDUFKZLOOSURFHHG KDQGLQKDQGZLWK RWKHUSDUWVRIGHYHORSLQJ

WKHTXDOLWDWLYHVWXG\QDPHO\WKHGDWDFROOHFWLRQDQGWKHZULWHXSRIILQGLQJV:KLOHLQWHUYLHZVDUH
JRLQJRQIRUH[DPSOHUHVHDUFKHUVPD\EHDQDO\]LQJDQLQWHUYLHZFROOHFWHGHDUOLHUZULWLQJPHPRV
WKDWPD\XOWLPDWHO\EHLQFOXGHGDVDQDUUDWLYHLQWKHILQDOUHSRUWDQGRUJDQL]LQJWKHVWUXFWXUHRIWKH
ILQDOUHSRUW7KLVSURFHVVLVXQOLNHTXDQWLWDWLYHUHVHDUFKLQZKLFKWKHLQYHVWLJDWRUFROOHFWVWKHGDWD
WKHQDQDO\]HVWKHLQIRUPDWLRQDQGILQDOO\ZULWHVWKHUHSRUW

‡ %HFDXVH WH[W DQG LPDJH GDWD DUH VR GHQVH DQG ULFK QRW DOO RI WKH LQIRUPDWLRQ FDQ EH XVHG LQ D
TXDOLWDWLYH VWXG\ 7KXV LQ WKH DQDO\VLV RI WKH GDWD UHVHDUFKHUV QHHG WR ³ZLQQRZ´ WKH GDWD *XHVW
0DF4XHHQ  1DPH\  D SURFHVV RI IRFXVLQJ LQ RQ VRPH RI WKH GDWD DQG GLVUHJDUGLQJ RWKHU
SDUWVRILW7KLVSURFHVVWRRLVGLIIHUHQWIURPTXDQWLWDWLYHUHVHDUFKLQZKLFKUHVHDUFKHUVJRWRJUHDW
OHQJWKVWRSUHVHUYHDOORIWKHGDWDDQGUHFRQVWUXFWRUUHSODFHPLVVLQJGDWD,QTXDOLWDWLYHUHVHDUFKWKH
LPSDFWRIWKLVSURFHVVLVWRDJJUHJDWHGDWDLQWRDVPDOOQXPEHURIWKHPHVVRPHWKLQJOLNHILYHWRVHYHQ
WKHPHV&UHVZHOO

‡$OVRVSHFLI\ZKHWKHU\RXZLOOXVHDTXDOLWDWLYHFRPSXWHUGDWDDQDO\VLVSURJUDPWRDVVLVW\RXLQ
DQDO\]LQJ WKH GDWD RU ZKHWKHU \RX ZLOO KDQG FRGH WKH GDWD +DQG FRGLQJ LV D ODERULRXV DQG WLPH
FRQVXPLQJSURFHVVHYHQIRUGDWDIURPDIHZLQGLYLGXDOV7KXVTXDOLWDWLYHVRIWZDUHSURJUDPVKDYH
EHFRPHTXLWHSRSXODUDQGWKH\KHOSUHVHDUFKHUVRUJDQL]HVRUWDQGVHDUFKIRULQIRUPDWLRQLQWH[WRU
LPDJH GDWDEDVHV VHH *XHVW DQG FROOHDJXHV¶ >@ FKDSWHU RQ TXDOLWDWLYH GDWD DQDO\VLV VRIWZDUH
6HYHUDO H[FHOOHQW FRPSXWHU VRIWZDUH SURJUDPV DUH DYDLODEOH DQG WKH\ KDYH VLPLODU IHDWXUHV JRRG
WXWRULDOV DQG GHPRQVWUDWLRQ ILOHV WKH DELOLW\ WR LQFRUSRUDWH ERWK WH[W DQG LPDJH HJ SKRWRJUDSKV
GDWD WKH IHDWXUHV RI VWRULQJ DQG RUJDQL]LQJ GDWD WKH VHDUFK FDSDFLW\ RI ORFDWLQJ DOO WH[W DVVRFLDWHG
ZLWKVSHFLILFFRGHVLQWHUUHODWHGFRGHVIRUPDNLQJTXHULHVRIWKHUHODWLRQVKLSDPRQJFRGHVDQGWKH
LPSRUWDQGH[SRUWRITXDOLWDWLYHGDWDWRTXDQWLWDWLYHSURJUDPVVXFKDVVSUHDGVKHHWVRUGDWDDQDO\VLV
SURJUDPV7KHEDVLFLGHDEHKLQGWKHVHSURJUDPVLVWKDWXVLQJWKHFRPSXWHULVDQHIILFLHQWPHDQVIRU
VWRULQJDQGORFDWLQJTXDOLWDWLYHGDWD$OWKRXJKWKHUHVHDUFKHUVWLOOQHHGVWRJRWKURXJKHDFKOLQHRIWH[W
DVLQKDQGFRGLQJE\JRLQJWKURXJKWUDQVFULSWLRQVDQGDVVLJQFRGHVWKLVSURFHVVPD\EHIDVWHUDQG
PRUH HIILFLHQW WKDQ KDQG FRGLQJ $OVR LQ ODUJH GDWDEDVHV WKH UHVHDUFKHU FDQ TXLFNO\ ORFDWH DOO
SDVVDJHVRUWH[WVHJPHQWVFRGHGWKHVDPHDQGGHWHUPLQHZKHWKHUSDUWLFLSDQWVDUHUHVSRQGLQJWRD
FRGHLGHDLQVLPLODURUGLIIHUHQWZD\V%H\RQGWKLVWKHFRPSXWHUSURJUDPFDQIDFLOLWDWHFRPSDULQJ
GLIIHUHQWFRGHVHJ+RZGRPDOHVDQGIHPDOHV²WKHILUVWFRGHRIJHQGHU²GLIIHULQWHUPVRIWKHLU
DWWLWXGHVWRVPRNLQJ²DVHFRQGFRGH"7KHVHDUHMXVWDIHZIHDWXUHVRIWKHVRIWZDUHSURJUDPVWKDW
PDNH WKHP D ORJLFDO FKRLFH IRU TXDOLWDWLYH GDWD DQDO\VLV RYHU KDQG FRGLQJ $V ZLWK DQ\ VRIWZDUH
SURJUDP TXDOLWDWLYH VRIWZDUH SURJUDPV UHTXLUH WLPH DQG VNLOO WR OHDUQ DQG HPSOR\ HIIHFWLYHO\
DOWKRXJKERRNVIRUOHDUQLQJWKHSURJUDPVDUHZLGHO\DYDLODEOH'HPRVDUHDYDLODEOHIRUWKUHHSRSXODU
TXDOLWDWLYH GDWD DQDO\VLV VRIWZDUH SURJUDPV 0$;TGD ZZZPD[TGDFRP $WODVWL
ZZZDWODVWLFRP DQG 465 19LYR ZZZTVULQWHUQDWLRQDOFRP 7KH ILUVW WZR SURJUDPV ZHUH
GHYHORSHGLQ*HUPDQ\DQGWKHWKLUGLQ$XVWUDOLD7KHVHSURJUDPVDUHDYDLODEOHWRZRUNRQD3&RU
0$&

‡$ KHOSIXO FRQFHSWXDOL]DWLRQ WR DGYDQFH LQ WKH PHWKRGV VHFWLRQ LV WKDW TXDOLWDWLYH GDWD DQDO\VLV
ZLOO SURFHHG RQ WZR OHYHOV D WKH ILUVW LV WKH PRUH JHQHUDO SURFHGXUH LQ DQDO\]LQJ WKH GDWD VHH
EHORZDQGEWKHVHFRQGZRXOGEHWKHDQDO\VLVVWHSVHPEHGGHGZLWKLQVSHFLILFTXDOLWDWLYHGHVLJQV
)RUH[DPSOHQDUUDWLYHUHVHDUFKHPSOR\VUHVWRU\LQJWKHSDUWLFLSDQWV¶VWRULHVXVLQJVWUXFWXUDOGHYLFHV
VXFK DV SORW VHWWLQJ DFWLYLWLHV FOLPD[ DQG GHQRXHPHQW &ODQGLQLQ  &RQQHOO\ 
3KHQRPHQRORJLFDO UHVHDUFK XVHV WKH DQDO\VLV RI VLJQLILFDQW VWDWHPHQWV WKH JHQHUDWLRQ RI PHDQLQJ
XQLWVDQGWKHGHYHORSPHQWRIZKDW0RXVWDNDVFDOOHGDQHVVHQFHGHVFULSWLRQ*URXQGHGWKHRU\
KDV V\VWHPDWLF VWHSV &RUELQ  6WUDXVV  6WUDXVV  &RUELQ   7KHVH LQYROYH
JHQHUDWLQJFDWHJRULHVRILQIRUPDWLRQRSHQFRGLQJVHOHFWLQJRQHRIWKHFDWHJRULHVDQGSRVLWLRQLQJLW
ZLWKLQ D WKHRUHWLFDO PRGHO D[LDO FRGLQJ DQG WKHQ H[SOLFDWLQJ D VWRU\ IURP WKH LQWHUFRQQHFWLRQ RI
WKHVH FDWHJRULHV VHOHFWLYH FRGLQJ &DVH VWXG\ DQG HWKQRJUDSKLF UHVHDUFK LQYROYH D GHWDLOHG
GHVFULSWLRQRIWKHVHWWLQJRULQGLYLGXDOVIROORZHGE\DQDO\VLVRIWKHGDWDIRUWKHPHVRULVVXHVVHH
6WDNH  :ROFRWW $ FRPSOHWH GHVFULSWLRQ RI WKH GDWD DQDO\VLV LQ D SURSRVDO ZKHQ WKH
LQTXLUHU LV XVLQJ RQH RI WKHVH VWUDWHJLHV ZRXOG EH WR ILUVW GHVFULEH WKH JHQHUDO SURFHVV RI DQDO\VLV
IROORZHGE\WKHVSHFLILFVWHSVZLWKLQWKHVWUDWHJ\

‡ 'HVSLWH WKHVH DQDO\WLF GLIIHUHQFHV GHSHQGLQJ RQ WKH W\SH RI VWUDWHJ\ XVHG TXDOLWDWLYH LQTXLUHUV
RIWHQXVHDJHQHUDOSURFHGXUHDQGFRQYH\LQWKHSURSRVDOWKHVWHSVLQGDWDDQDO\VLV$QLGHDOVLWXDWLRQ
LV WR EOHQG WKH JHQHUDO VWHSV ZLWK WKH VSHFLILF UHVHDUFK VWUDWHJ\ VWHSV $Q RYHUYLHZ RI WKH GDWD
DQDO\VLVSURFHVVLVVHHQLQ)LJXUH$VDUHVHDUFKWLS,XUJHUHVHDUFKHUVWRORRNDWTXDOLWDWLYHGDWD
DQDO\VLV DV IROORZLQJ VWHSV IURP WKH VSHFLILF WR WKH JHQHUDO DQG DV LQYROYLQJ PXOWLSOH OHYHOV RI
DQDO\VLV

7KLVILJXUHVXJJHVWVDOLQHDUKLHUDUFKLFDODSSURDFKEXLOGLQJIURPWKHERWWRPWRWKHWRSEXW,VHHLW
DVPRUHLQWHUDFWLYHLQSUDFWLFHWKHYDULRXVVWDJHVDUHLQWHUUHODWHGDQGQRWDOZD\VYLVLWHGLQWKHRUGHU
SUHVHQWHG , ZRXOG VXJJHVW WKDW \RX DGYDQFH WKHVH VHYHQ VWHSV LQ \RXU PHWKRGV VHFWLRQ RI \RXU
SURSRVDO DQG JLYH FRQFUHWH LOOXVWUDWLRQV RI SRWHQWLDO FRGHV DQG WKHPHV WKDW PLJKW HPHUJH LQ \RXU
VWXG\

)LJXUH'DWD$QDO\VLVLQ4XDOLWDWLYH5HVHDUFK
 6WHS2UJDQL]HDQGSUHSDUHWKHGDWDIRUDQDO\VLV7KLVLQYROYHVWUDQVFULELQJLQWHUYLHZVRSWLFDOO\
VFDQQLQJ PDWHULDO W\SLQJ XS ILHOG QRWHV FDWDORJXLQJ DOO RI WKH YLVXDO PDWHULDO DQG VRUWLQJ DQG
DUUDQJLQJWKHGDWDLQWRGLIIHUHQWW\SHVGHSHQGLQJRQWKHVRXUFHVRILQIRUPDWLRQ

6WHS5HDGRUORRNDWDOOWKHGDWD7KLVILUVWVWHSSURYLGHVDJHQHUDOVHQVHRIWKHLQIRUPDWLRQDQG
DQRSSRUWXQLW\WRUHIOHFWRQLWVRYHUDOOPHDQLQJ:KDWJHQHUDOLGHDVDUHSDUWLFLSDQWVVD\LQJ":KDWLV
WKH WRQH RI WKH LGHDV" :KDW LV WKH LPSUHVVLRQ RI WKH RYHUDOO GHSWK FUHGLELOLW\ DQG XVH RI WKH
LQIRUPDWLRQ"6RPHWLPHVTXDOLWDWLYHUHVHDUFKHUVZULWHQRWHVLQPDUJLQVRIWUDQVFULSWVRUREVHUYDWLRQDO
ILHOG QRWHV RU VWDUW UHFRUGLQJ JHQHUDO WKRXJKWV DERXW WKH GDWD DW WKLV VWDJH )RU YLVXDO GDWD D
VNHWFKERRNRILGHDVFDQEHJLQWRWDNHVKDSH

6WHS 6WDUWFRGLQJ DOO RI WKH GDWD &RGLQJ LV WKH SURFHVV RI RUJDQL]LQJ WKH GDWD E\ EUDFNHWLQJ
FKXQNV RU WH[W RU LPDJH VHJPHQWV DQG ZULWLQJ DZRUG UHSUHVHQWLQJ D FDWHJRU\ LQ WKH PDUJLQV
5RVVPDQ  5DOOLV  ,W LQYROYHV WDNLQJ WH[W GDWD RU SLFWXUHV JDWKHUHG GXULQJ GDWD FROOHFWLRQ
VHJPHQWLQJVHQWHQFHVRUSDUDJUDSKVRULPDJHVLQWRFDWHJRULHVDQGODEHOLQJWKRVHFDWHJRULHVZLWKD
WHUPRIWHQDWHUPEDVHGLQWKHDFWXDOODQJXDJHRIWKHSDUWLFLSDQWFDOOHGDQLQYLYRWHUP$VVKRZQLQ
7DEOH7HVFKSURYLGHGWKHHLJKWVWHSVW\SLFDOO\XVHGLQIRUPLQJFRGHV
7DEOH7HVFK¶V(LJKW6WHSVLQWKH&RGLQJ3URFHVV

 *HWDVHQVHRIWKHZKROH5HDGDOOWKHWUDQVFULSWLRQVFDUHIXOO\3HUKDSVMRWGRZQVRPHLGHDVDVWKH\FRPHWRPLQGDV\RXUHDG
 3LFN RQH GRFXPHQW LH RQH LQWHUYLHZ²WKH PRVW LQWHUHVWLQJ RQH WKH VKRUWHVW WKH RQH RQ WKH WRS RI WKH SLOH *R WKURXJK LW
DVNLQJ \RXUVHOI ³:KDW LV WKLV DERXW"´ 'R QRW WKLQN DERXW WKH VXEVWDQFH RI WKH LQIRUPDWLRQ EXW LWV XQGHUO\LQJ PHDQLQJ :ULWH
WKRXJKWVLQWKHPDUJLQ
 :KHQ\RXKDYHFRPSOHWHGWKLVWDVNIRUVHYHUDOSDUWLFLSDQWVPDNHDOLVWRIDOOWRSLFV&OXVWHUWRJHWKHUVLPLODUWRSLFV)RUPWKHVH
WRSLFVLQWRFROXPQVSHUKDSVDUUD\HGDVPDMRUXQLTXHDQGOHIWRYHUWRSLFV
 1RZWDNHWKLVOLVWDQGJREDFNWR\RXUGDWD$EEUHYLDWHWKHWRSLFVDVFRGHVDQGZULWHWKHFRGHVQH[WWRWKHDSSURSULDWHVHJPHQWV
RIWKHWH[W7U\WKLVSUHOLPLQDU\RUJDQL]LQJVFKHPHWRVHHLIQHZFDWHJRULHVDQGFRGHVHPHUJH
 )LQG WKH PRVW GHVFULSWLYH ZRUGLQJ IRU \RXU WRSLFV DQG WXUQ WKHP LQWR FDWHJRULHV /RRN IRU ZD\V RI UHGXFLQJ \RXU WRWDO OLVW RI
FDWHJRULHVE\JURXSLQJWRSLFVWKDWUHODWHWRHDFKRWKHU3HUKDSVGUDZOLQHVEHWZHHQ\RXUFDWHJRULHVWRVKRZLQWHUUHODWLRQVKLSV
 0DNHDILQDOGHFLVLRQRQWKHDEEUHYLDWLRQIRUHDFKFDWHJRU\DQGDOSKDEHWL]HWKHVHFRGHV
 $VVHPEOHWKHGDWDPDWHULDOEHORQJLQJWRHDFKFDWHJRU\LQRQHSODFHDQGSHUIRUPDSUHOLPLQDU\DQDO\VLV
 ,IQHFHVVDU\UHFRGH\RXUH[LVWLQJGDWDSS±

,QDGGLWLRQJLYHVRPHDWWHQWLRQWRWKHW\SHVRIFRGHVWRGHYHORSZKHQDQDO\]LQJDWH[WWUDQVFULSWRU
DSLFWXUHRURWKHUW\SHRIYLVXDOREMHFW,WHQGWRWKLQNDERXWFRGHVDVIDOOLQJLQWRWKUHHFDWHJRULHV

‡&RGHVRQWRSLFVWKDWUHDGHUVZRXOGH[SHFWWRILQGEDVHGRQWKHSDVWOLWHUDWXUHDQGFRPPRQVHQVH
:KHQVWXG\LQJEXOO\LQJLQWKHVFKRROV,PLJKWFRGHVRPHVHJPHQWVDV³DWWLWXGHVWRZDUGRQHVHOI´
7KLVFRGHZRXOGEHH[SHFWHGLQDVWXG\DERXWEXOO\LQJLQWKHVFKRROV
‡&RGHVWKDWDUHVXUSULVLQJDQGWKDWZHUHQRWDQWLFLSDWHGDWWKHEHJLQQLQJRIWKHVWXG\,QDVWXG\RI
OHDGHUVKLSLQQRQSURILWRUJDQL]DWLRQV,PLJKWOHDUQDERXWWKHLPSDFWRIJHRZDUPLQJRQWKHEXLOGLQJ
RI WKH RUJDQL]DWLRQ DQG KRZ WKLV VKDSHV WKH ORFDWLRQ DQG SUR[LPLW\ RI LQGLYLGXDOV WR RQH DQRWKHU
:LWKRXWJRLQJRXWWRWKHEXLOGLQJEHIRUHWKHVWXG\EHJLQVDQGORRNLQJDWLW,ZRXOGQRWQHFHVVDULO\
WKLQNDERXWWKHFRGHVRIJHRZDUPLQJDQGORFDWLRQRIRIILFHVLQP\VWXG\RIOHDGHUVKLS
‡&RGHVWKDWDUHXQXVXDODQGWKDWDUHLQDQGRIWKHPVHOYHVRIFRQFHSWXDOLQWHUHVWWRUHDGHUV,ZLOO
XVHRQHRIWKHFRGHVWKDWZHGLVFRYHUHGLQRXUTXDOLWDWLYHVWXG\RIDFDPSXV¶UHVSRQVHWRDJXQPDQ
$VPXVVHQ  &UHVZHOO  :H GLG QRW DQWLFLSDWH WKH FRGH ³UHWULJJHULQJ´ WR HPHUJH LQ RXU
VWXG\DQGLWVXUIDFHGIURPWKHSHUVSHFWLYHRIDSV\FKRORJLVWFDOOHGLQWRWKHFDPSXVWRDVVHVVWKH
UHVSRQVH 7KH IDFW WKDW LQGLYLGXDOV ZHUH UHPLQGHG RI SDVW WUDXPDWLF LQFLGHQWV²UHWULJJHULQJ²
SURPSWHGXVWRXVHWKHWHUPDVDQLPSRUWDQWFRGHDQGXOWLPDWHO\DWKHPHLQRXUDQDO\VLV

2QH IXUWKHU LVVXH DERXW FRGLQJ LV ZKHWKHU WKH UHVHDUFKHU VKRXOG D GHYHORS FRGHVRQO\ RQ WKH
EDVLVRIWKHHPHUJLQJLQIRUPDWLRQFROOHFWHGIURPSDUWLFLSDQWVEXVHSUHGHWHUPLQHGFRGHVDQGWKHQ
ILW WKH GDWD WR WKHP RU F XVH VRPH FRPELQDWLRQ RI HPHUJLQJ DQG SUHGHWHUPLQHG FRGHV 7KH
WUDGLWLRQDODSSURDFKLQWKHVRFLDOVFLHQFHVLVWRDOORZWKHFRGHVWRHPHUJHGXULQJWKHGDWDDQDO\VLV,Q
WKH KHDOWK VFLHQFHV D SRSXODU DSSURDFK LV WR XVH SUHGHWHUPLQHG FRGHV EDVHG RQ WKH WKHRU\ EHLQJ
H[DPLQHG,QWKLVFDVHWKHUHVHDUFKHUVPLJKWGHYHORSDTXDOLWDWLYHFRGHERRNDWDEOHWKDWFRQWDLQVD
OLVW RI SUHGHWHUPLQHG FRGHV WKDW UHVHDUFKHUV XVH IRU FRGLQJ WKH GDWD *XHVW DQG FROOHDJXHV 
GLVFXVVHGDQGLOOXVWUDWHGWKHXVHRIFRGHERRNVLQTXDOLWDWLYHUHVHDUFK7KHLQWHQWRIDFRGHERRNLVWR
SURYLGH GHILQLWLRQV IRU FRGHV DQG WR PD[LPL]H FRKHUHQFH DPRQJ FRGHV²HVSHFLDOO\ ZKHQ PXOWLSOH
FRGHUV DUH LQYROYHG 7KLV FRGHERRN ZRXOG SURYLGH D OLVW RI FRGHV D FRGH ODEHO IRU HDFK FRGH D
EULHIGHILQLWLRQRILWDIXOOGHILQLWLRQRILWLQIRUPDWLRQDERXWZKHQWRXVHWKHFRGHDQGZKHQQRWWRXVH
LW DQG DQ H[DPSOH RI D TXRWH LOOXVWUDWLQJ WKH FRGH 7KLV FRGHERRN FDQ HYROYH DQG FKDQJH GXULQJ D
VWXG\EDVHGRQFORVHDQDO\VLVRIWKHGDWDZKHQWKHUHVHDUFKHULVQRWVWDUWLQJIURPDQHPHUJLQJFRGH
SHUVSHFWLYH)RUUHVHDUFKHUVZKRKDYHD GLVWLQFWWKHRU\WKH\ZDQWWRWHVW LQWKHLUSURMHFWV, ZRXOG
UHFRPPHQGWKDWDSUHOLPLQDU\FRGHERRNEHGHYHORSHGIRUFRGLQJWKHGDWDDQGSHUPLWWKHFRGHERRNWR
GHYHORSDQGFKDQJHEDVHGRQWKHLQIRUPDWLRQOHDUQHGGXULQJWKHGDWDDQDO\VLV

6WHS  8VH WKH FRGLQJ SURFHVV WR JHQHUDWH D GHVFULSWLRQ RI WKH VHWWLQJ RU SHRSOH DV ZHOO DV
FDWHJRULHV RU WKHPHV IRU DQDO\VLV'HVFULSWLRQ LQYROYHV D GHWDLOHG UHQGHULQJ RI LQIRUPDWLRQ DERXW
SHRSOH SODFHV RU HYHQWV LQ D VHWWLQJ 5HVHDUFKHUV FDQ JHQHUDWH FRGHV IRU WKLV GHVFULSWLRQ 7KLV
DQDO\VLV LV XVHIXO LQ GHVLJQLQJ GHWDLOHG GHVFULSWLRQV IRU FDVH VWXGLHV HWKQRJUDSKLHV DQG QDUUDWLYH
UHVHDUFK SURMHFWV 8VH WKH FRGLQJ DV ZHOO IRU JHQHUDWLQJ D VPDOO QXPEHU RIWKHPHVRUFDWHJRULHV²
SHUKDSV ILYH WR VHYHQ WKHPHV IRU D UHVHDUFK VWXG\ 7KHVH WKHPHV DUH WKH RQHV WKDW DSSHDU DV PDMRU
ILQGLQJV LQTXDOLWDWLYH VWXGLHV DQG DUH RIWHQ XVHG DV KHDGLQJV LQ WKH ILQGLQJV VHFWLRQV RU LQ WKH
ILQGLQJVVHFWLRQRIDGLVVHUWDWLRQRUWKHVLVRIVWXGLHV7KH\VKRXOGGLVSOD\PXOWLSOHSHUVSHFWLYHVIURP
LQGLYLGXDOVDQGEHVXSSRUWHGE\GLYHUVHTXRWDWLRQVDQGVSHFLILFHYLGHQFH

%H\RQGLGHQWLI\LQJWKHWKHPHVGXULQJWKHFRGLQJSURFHVVTXDOLWDWLYHUHVHDUFKHUVFDQGRPXFKZLWK
WKHPHVWREXLOGDGGLWLRQDOOD\HUVRIFRPSOH[DQDO\VLV)RUH[DPSOHUHVHDUFKHUVLQWHUFRQQHFWWKHPHV
LQWRDVWRU\OLQHDVLQQDUUDWLYHVRUGHYHORSWKHPLQWRDWKHRUHWLFDOPRGHODVLQJURXQGHGWKHRU\
7KHPHV DUH DQDO\]HG IRU HDFK LQGLYLGXDO FDVH DQG DFURVV GLIIHUHQW FDVHV DV LQ FDVH VWXGLHV RU
VKDSHGLQWRDJHQHUDOGHVFULSWLRQDVLQSKHQRPHQRORJ\6RSKLVWLFDWHGTXDOLWDWLYHVWXGLHVJREH\RQG
GHVFULSWLRQDQGWKHPHLGHQWLILFDWLRQDQGIRUPFRPSOH[WKHPHFRQQHFWLRQV

6WHS$GYDQFHKRZWKHGHVFULSWLRQDQGWKHPHVZLOOEHUHSUHVHQWHGLQWKHTXDOLWDWLYHQDUUDWLYH
7KHPRVWSRSXODUDSSURDFKLVWRXVHDQDUUDWLYHSDVVDJHWRFRQYH\WKHILQGLQJVRIWKHDQDO\VLV7KLV
PLJKWEHDGLVFXVVLRQWKDWPHQWLRQVDFKURQRORJ\RIHYHQWVWKHGHWDLOHGGLVFXVVLRQRIVHYHUDOWKHPHV
FRPSOHWH ZLWK VXEWKHPHV VSHFLILF LOOXVWUDWLRQV PXOWLSOH SHUVSHFWLYHV IURP LQGLYLGXDOV DQG
TXRWDWLRQV RU D GLVFXVVLRQ ZLWK LQWHUFRQQHFWLQJ WKHPHV 0DQ\ TXDOLWDWLYH UHVHDUFKHUV DOVR XVH
YLVXDOV ILJXUHV RU WDEOHV DV DGMXQFWV WR WKH GLVFXVVLRQV 7KH\ SUHVHQW D SURFHVV PRGHO DV LQ
JURXQGHG WKHRU\ DGYDQFH D GUDZLQJ RI WKH VSHFLILF UHVHDUFK VLWH DV LQ HWKQRJUDSK\ RU FRQYH\
GHVFULSWLYHLQIRUPDWLRQDERXWHDFKSDUWLFLSDQWLQDWDEOHDVLQFDVHVWXGLHVDQGHWKQRJUDSKLHV
6WHS$ILQDOVWHSLQGDWDDQDO\VLVLQYROYHVPDNLQJDQLQWHUSUHWDWLRQLQTXDOLWDWLYHUHVHDUFKRI
WKH ILQGLQJV RU UHVXOWV$VNLQJ ³:KDW ZHUH WKH OHVVRQV OHDUQHG"´ FDSWXUHV WKH HVVHQFH RI WKLV LGHD
/LQFROQ *XED7KHVHOHVVRQVFRXOGEHWKHUHVHDUFKHU¶VSHUVRQDOLQWHUSUHWDWLRQFRXFKHGLQ
WKH XQGHUVWDQGLQJ WKDW WKH LQTXLUHU EULQJV WR WKH VWXG\ IURP D SHUVRQDO FXOWXUH KLVWRU\ DQG
H[SHULHQFHV,WFRXOGDOVREHDPHDQLQJGHULYHGIURPDFRPSDULVRQRIWKHILQGLQJVZLWKLQIRUPDWLRQ
JOHDQHG IURP WKH OLWHUDWXUH RU WKHRULHV ,Q WKLV ZD\ DXWKRUV VXJJHVW WKDW WKH ILQGLQJV FRQILUP SDVW
LQIRUPDWLRQ RU GLYHUJH IURP LW ,W FDQ DOVR VXJJHVW QHZ TXHVWLRQV WKDW QHHG WR EH DVNHG²TXHVWLRQV
UDLVHGE\WKHGDWDDQGDQDO\VLVWKDWWKHLQTXLUHUKDGQRWIRUHVHHQHDUOLHULQWKHVWXG\(WKQRJUDSKHUV
FDQHQGDVWXG\:ROFRWWVDLGE\VWDWLQJIXUWKHUTXHVWLRQV7KHTXHVWLRQLQJDSSURDFKLVDOVR
XVHG LQ WUDQVIRUPDWLYH DSSURDFKHV WR TXDOLWDWLYH UHVHDUFK 0RUHRYHU ZKHQ TXDOLWDWLYH UHVHDUFKHUV
XVHDWKHRUHWLFDOOHQVWKH\FDQIRUPLQWHUSUHWDWLRQVWKDWFDOOIRUDFWLRQDJHQGDVIRUUHIRUPDQGFKDQJH
5HVHDUFKHUV PLJKW GHVFULEH KRZ WKH QDUUDWLYH RXWFRPH ZLOO EH FRPSDUHG ZLWK WKHRULHV DQG WKH
JHQHUDOOLWHUDWXUHRQWKHWRSLF,QPDQ\TXDOLWDWLYHDUWLFOHVUHVHDUFKHUVDOVRGLVFXVVWKHOLWHUDWXUHDW
WKHHQGRIWKHVWXG\VHHWKHGLVFXVVLRQLQ&KDSWHU7KXVLQWHUSUHWDWLRQLQTXDOLWDWLYHUHVHDUFKFDQ
WDNH PDQ\ IRUPV EH DGDSWHG IRU GLIIHUHQW W\SHVRI GHVLJQV DQG EH IOH[LEOH WR FRQYH\ SHUVRQDO
UHVHDUFKEDVHGDQGDFWLRQPHDQLQJV
9DOLGLW\DQG5HOLDELOLW\

$OWKRXJKYDOLGDWLRQRIILQGLQJVRFFXUVWKURXJKRXWWKHVWHSVLQWKHSURFHVVRIUHVHDUFKDVVKRZQLQ
)LJXUHWKLVGLVFXVVLRQIRFXVHVRQLWWRHQDEOHDUHVHDUFKHUWRZULWHDSDVVDJHLQWRDSURSRVDORQ
WKH SURFHGXUHV IRU YDOLGDWLQJ WKH ILQGLQJV WKDW ZLOO EH XQGHUWDNHQ LQ D VWXG\ 3URSRVDO GHYHORSHUV
QHHGWRFRQYH\WKH VWHSVWKH\ZLOO WDNHLQWKHLUVWXGLHVWR FKHFNIRU WKHDFFXUDF\ DQGFUHGLELOLW\RI
WKHLU ILQGLQJV 9DOLGLW\ GRHV QRW FDUU\ WKH VDPH FRQQRWDWLRQV LQ TXDOLWDWLYH UHVHDUFK DV LW GRHV LQ
TXDQWLWDWLYHUHVHDUFKQRULVLWDFRPSDQLRQRIUHOLDELOLW\H[DPLQLQJVWDELOLW\RUJHQHUDOL]DELOLW\WKH
H[WHUQDO YDOLGLW\ RI DSSO\LQJ UHVXOWV WR QHZ VHWWLQJV SHRSOH RU VDPSOHV ERWK DUH GLVFXVVHG LQ
&KDSWHU4XDOLWDWLYHYDOLGLW\PHDQVWKDWWKHUHVHDUFKHUFKHFNVIRUWKHDFFXUDF\RIWKHILQGLQJVE\
HPSOR\LQJFHUWDLQ SURFHGXUHVZKLOHTXDOLWDWLYHUHOLDELOLW\ LQGLFDWHVWKDWWKHUHVHDUFKHU¶VDSSURDFK
LVFRQVLVWHQWDFURVVGLIIHUHQWUHVHDUFKHUVDQGGLIIHUHQWSURMHFWV*LEEV
9DOLGLW\ LV RQH RI WKH VWUHQJWKV RI TXDOLWDWLYH UHVHDUFK DQG LV EDVHG RQ GHWHUPLQLQJ ZKHWKHU WKH
ILQGLQJV DUH DFFXUDWH IURP WKH VWDQGSRLQW RI WKH UHVHDUFKHU WKH SDUWLFLSDQW RU WKH UHDGHUV RI DQ
DFFRXQW&UHVZHOO 0LOOHU7HUPVDERXQGLQWKHTXDOLWDWLYHOLWHUDWXUHWKDWDGGUHVVYDOLGLW\
VXFK DVWUXVWZRUWKLQHVVDXWKHQWLFLW\ DQGFUHGLELOLW\&UHVZHOO 0LOOHUDQGLWLVDPXFK
GLVFXVVHGWRSLF/LQFROQ/\QKDP *XED
$SURFHGXUDOSHUVSHFWLYHWKDW,UHFRPPHQGIRUUHVHDUFKSURSRVDOVLVWRLGHQWLI\DQGGLVFXVVRQHRU
PRUHVWUDWHJLHVDYDLODEOHWRFKHFNWKHDFFXUDF\RIWKHILQGLQJV7KHUHVHDUFKHUDFWLYHO\LQFRUSRUDWHV
YDOLGLW\VWUDWHJLHVLQWRWKHLUSURSRVDO,UHFRPPHQGWKHXVHRIPXOWLSOHDSSURDFKHVDQGWKHVHVKRXOG
HQKDQFHWKHUHVHDUFKHU¶VDELOLW\WRDVVHVVWKHDFFXUDF\RIILQGLQJVDVZHOODVFRQYLQFHUHDGHUVRIWKDW
DFFXUDF\7KHUHDUHHLJKWSULPDU\VWUDWHJLHVRUJDQL]HGIURPWKRVHPRVWIUHTXHQWO\XVHGDQGHDV\WR
LPSOHPHQWWRWKRVHRFFDVLRQDOO\XVHGDQGPRUHGLIILFXOWWRLPSOHPHQW

‡7ULDQJXODWHGLIIHUHQWGDWDVRXUFHVRILQIRUPDWLRQE\H[DPLQLQJHYLGHQFHIURPWKHVRXUFHVDQGXVLQJ
LWWREXLOGDFRKHUHQWMXVWLILFDWLRQIRUWKHPHV,IWKHPHVDUHHVWDEOLVKHGEDVHGRQFRQYHUJLQJVHYHUDO
VRXUFHVRIGDWDRUSHUVSHFWLYHVIURPSDUWLFLSDQWVWKHQWKLVSURFHVVFDQEHFODLPHGDVDGGLQJWRWKH
YDOLGLW\RIWKHVWXG\
‡8VHPHPEHUFKHFNLQJWRGHWHUPLQHWKHDFFXUDF\RIWKHTXDOLWDWLYHILQGLQJVWKURXJKWDNLQJWKHILQDO
UHSRUW RU VSHFLILF GHVFULSWLRQV RU WKHPHV EDFN WR SDUWLFLSDQWV DQG GHWHUPLQLQJ ZKHWKHU WKHVH
SDUWLFLSDQWVIHHOWKDWWKH\DUHDFFXUDWH7KLVGRHVQRWPHDQWDNLQJEDFNWKHUDZWUDQVFULSWVWRFKHFN
IRUDFFXUDF\LQVWHDGWKHUHVHDUFKHUWDNHVEDFNSDUWVRIWKHSROLVKHGRUVHPLSROLVKHGSURGXFWVXFK
DVWKHPDMRUILQGLQJVWKHWKHPHVWKHFDVHDQDO\VLVWKHJURXQGHGWKHRU\WKHFXOWXUDOGHVFULSWLRQ
DQGVRIRUWK7KLVSURFHGXUHFDQLQYROYHFRQGXFWLQJDIROORZXSLQWHUYLHZZLWKSDUWLFLSDQWVLQWKH
VWXG\DQGSURYLGLQJDQRSSRUWXQLW\IRUWKHPWRFRPPHQWRQWKHILQGLQJV
‡8VHDULFKWKLFNGHVFULSWLRQWRFRQYH\WKHILQGLQJV7KLVGHVFULSWLRQPD\WUDQVSRUWUHDGHUVWRWKH
VHWWLQJ DQG JLYH WKH GLVFXVVLRQ DQ HOHPHQW RI VKDUHG H[SHULHQFHV :KHQ TXDOLWDWLYH UHVHDUFKHUV
SURYLGHGHWDLOHGGHVFULSWLRQVRIWKHVHWWLQJIRUH[DPSOHRURIIHUPDQ\SHUVSHFWLYHVDERXWDWKHPH
WKHUHVXOWVEHFRPHPRUHUHDOLVWLFDQGULFKHU7KLVSURFHGXUHFDQDGGWRWKHYDOLGLW\RIWKHILQGLQJV
‡ &ODULI\ WKHELDVWKHUHVHDUFKHUEULQJVWRWKHVWXG\7KLVVHOIUHIOHFWLRQFUHDWHVDQRSHQDQGKRQHVW
QDUUDWLYHWKDWZLOOUHVRQDWHZHOOZLWKUHDGHUV5HIOHFWLYLW\KDVDOUHDG\EHHQPHQWLRQHGDVDFRUH
FKDUDFWHULVWLF RI TXDOLWDWLYH UHVHDUFK *RRG TXDOLWDWLYH UHVHDUFK FRQWDLQV FRPPHQWV E\ WKH
UHVHDUFKHUV DERXW KRZ WKHLU LQWHUSUHWDWLRQ RI WKH ILQGLQJV LV VKDSHG E\ WKHLU EDFNJURXQG VXFK DV
 WKHLUJHQGHUFXOWXUHKLVWRU\DQGVRFLRHFRQRPLFRULJLQ
‡$OVRSUHVHQWQHJDWLYH RUGLVFUHSDQWLQIRUPDWLRQWKDWUXQVFRXQWHUWRWKHWKHPHV%HFDXVHUHDOOLIH
LVFRPSRVHGRIGLIIHUHQWSHUVSHFWLYHVWKDWGRQRWDOZD\VFRDOHVFHGLVFXVVLQJFRQWUDU\LQIRUPDWLRQ
DGGV WR WKH FUHGLELOLW\ RI DQ DFFRXQW $ UHVHDUFKHU FDQ DFFRPSOLVK WKLV E\ GLVFXVVLQJ HYLGHQFH
DERXW D WKHPH 0RVW HYLGHQFH ZLOO EXLOG D FDVH IRU WKH WKHPH UHVHDUFKHUV FDQ DOVR SUHVHQW
LQIRUPDWLRQWKDWFRQWUDGLFWVWKHJHQHUDOSHUVSHFWLYHRIWKHWKHPH%\SUHVHQWLQJWKLVFRQWUDGLFWRU\
HYLGHQFHWKHDFFRXQWEHFRPHVPRUHUHDOLVWLFDQGPRUHYDOLG
‡6SHQGSURORQJHGWLPHLQWKHILHOG,QWKLVZD\WKHUHVHDUFKHUGHYHORSVDQLQGHSWKXQGHUVWDQGLQJRI
WKH SKHQRPHQRQ XQGHU VWXG\ DQG FDQ FRQYH\ GHWDLO DERXW WKH VLWH DQG WKH SHRSOH WKDW OHQGV
FUHGLELOLW\WRWKHQDUUDWLYHDFFRXQW7KHPRUHH[SHULHQFHWKDWDUHVHDUFKHUKDVZLWKSDUWLFLSDQWVLQ
WKHLUVHWWLQJVWKHPRUHDFFXUDWHRUYDOLGZLOOEHWKHILQGLQJV
‡8VHSHHUGHEULHILQJWRHQKDQFHWKHDFFXUDF\RIWKHDFFRXQW7KLVSURFHVVLQYROYHVORFDWLQJDSHUVRQ
DSHHUGHEULHIHUZKRUHYLHZVDQGDVNVTXHVWLRQVDERXWWKHTXDOLWDWLYHVWXG\VRWKDWWKHDFFRXQW
ZLOO UHVRQDWH ZLWK SHRSOH RWKHU WKDQ WKH UHVHDUFKHU 7KLV VWUDWHJ\²LQYROYLQJ DQ LQWHUSUHWDWLRQ
EH\RQGWKHUHVHDUFKHUDQGLQYHVWHGLQDQRWKHUSHUVRQ²DGGVYDOLGLW\WRDQDFFRXQW
‡8VHDQH[WHUQDODXGLWRUWRUHYLHZWKHHQWLUHSURMHFW$VGLVWLQFWIURPDSHHUGHEULHIHUWKLVDXGLWRU
LV QRW IDPLOLDU ZLWK WKH UHVHDUFKHU RU WKH SURMHFW DQG FDQ SURYLGH DQ REMHFWLYH DVVHVVPHQW RI WKH
SURMHFWWKURXJKRXWWKHSURFHVVRIUHVHDUFKRUDWWKHFRQFOXVLRQRIWKHVWXG\7KHUROHLVVLPLODUWR
WKDWRIDILVFDODXGLWRUDQGVSHFLILFTXHVWLRQVH[LVWWKDWDXGLWRUVPLJKWDVN/LQFROQ *XED
7KHSURFHGXUHRIKDYLQJ DQLQGHSHQGHQWLQYHVWLJDWRUORRN RYHUPDQ\ DVSHFWVRIWKHSURMHFWHJ
DFFXUDF\RIWUDQVFULSWLRQWKHUHODWLRQVKLSEHWZHHQWKHUHVHDUFKTXHVWLRQVDQGWKHGDWDWKHOHYHORI
GDWDDQDO\VLVIURPWKHUDZGDWDWKURXJKLQWHUSUHWDWLRQHQKDQFHVWKHRYHUDOOYDOLGLW\RIDTXDOLWDWLYH
VWXG\

+RZGRTXDOLWDWLYHUHVHDUFKHUVFKHFNWRGHWHUPLQHLIWKHLUDSSURDFKHVDUHUHOLDEOHLHFRQVLVWHQW
RUVWDEOH"<LQVXJJHVWHGWKDWTXDOLWDWLYHUHVHDUFKHUVQHHGWRGRFXPHQWWKHSURFHGXUHVRIWKHLU
FDVH VWXGLHV DQG WR GRFXPHQW DV PDQ\ RI WKH VWHSV RI WKH SURFHGXUHV DV SRVVLEOH +H DOVR
UHFRPPHQGHG VHWWLQJ XS D GHWDLOHG FDVH VWXG\ SURWRFRO DQG GDWDEDVH VR WKDW RWKHUV FDQ IROORZ WKH
SURFHGXUHV*LEEVVXJJHVWHGVHYHUDOTXDOLWDWLYHUHOLDELOLW\SURFHGXUHV

‡&KHFNWUDQVFULSWVWRPDNHVXUHWKDWWKH\GRQRWFRQWDLQREYLRXVPLVWDNHVPDGHGXULQJWUDQVFULSWLRQ
‡ 0DNH VXUH WKDW WKHUH LV QRW D GULIW LQ WKH GHILQLWLRQ RI FRGHV D VKLIW LQ WKH PHDQLQJ RI WKH FRGHV
GXULQJ WKH SURFHVV RI FRGLQJ 7KLV FDQ EH DFFRPSOLVKHG E\ FRQVWDQWO\ FRPSDULQJ GDWD ZLWK WKH
FRGHV DQG E\ ZULWLQJ PHPRV DERXW WKH FRGHV DQG WKHLU GHILQLWLRQV VHH WKH GLVFXVVLRQ RQ D
TXDOLWDWLYHFRGHERRN
‡)RUWHDPUHVHDUFKFRRUGLQDWHWKHFRPPXQLFDWLRQDPRQJWKHFRGHUVE\UHJXODUGRFXPHQWHGPHHWLQJV
DQGE\VKDULQJWKHDQDO\VLV
‡&URVVFKHFNFRGHVGHYHORSHGE\GLIIHUHQWUHVHDUFKHUVE\FRPSDULQJUHVXOWVWKDWDUHLQGHSHQGHQWO\
GHULYHG 3URSRVDO ZULWHUV QHHG WR LQFOXGH VHYHUDO RI WKHVH SURFHGXUHV DV HYLGHQFH WKDW WKH\ ZLOO
KDYHFRQVLVWHQWUHVXOWVLQWKHLUSURSRVHGVWXG\,UHFRPPHQGWKDWVHYHUDOSURFHGXUHVEHPHQWLRQHG
LQDSURSRVDODQGWKDWVLQJOHUHVHDUFKHUVILQGDQRWKHUSHUVRQZKRFDQFURVVFKHFNWKHLUFRGHVIRU
ZKDW LV FDOOHGLQWHUFRGHU DJUHHPHQW RU FURVVFKHFNLQJ DOVR VHH *XHVW HW DO  6XFK DQ
 DJUHHPHQW PLJKW EH EDVHG RQ ZKHWKHU WZR RU PRUH FRGHUV DJUHH RQ FRGHV XVHG IRU WKH VDPH
SDVVDJHV LQ WKH WH[W ,W LV QRW WKDW WKH\ FRGH WKH VDPH SDVVDJH RI WH[W EXW ZKHWKHU DQRWKHU FRGHU
ZRXOG FRGH LW ZLWK WKH VDPH RU D VLPLODU FRGH 5HOLDELOLW\ VXESURJUDPV LQ TXDOLWDWLYH FRPSXWHU
VRIWZDUH SDFNDJHV FDQ WKHQ EH XVHG WR GHWHUPLQH WKH OHYHO RI FRQVLVWHQF\ RI FRGLQJ 0LOHV DQG
+XEHUPDQUHFRPPHQGHGWKDWWKHFRQVLVWHQF\RIWKHFRGLQJEHLQDJUHHPHQWDWOHDVWRI
WKHWLPHIRUJRRGTXDOLWDWLYHUHOLDELOLW\

4XDOLWDWLYHJHQHUDOL]DWLRQLVDWHUPWKDWLVXVHGLQDOLPLWHGZD\LQTXDOLWDWLYHUHVHDUFKVLQFHWKH
LQWHQWRIWKLVIRUPRILQTXLU\LV QRWWR JHQHUDOL]HILQGLQJVWR LQGLYLGXDOVVLWHVRUSODFHVRXWVLGHRI
WKRVHXQGHUVWXG\VHH*LEEVIRUKLVFDXWLRQDU\QRWHDERXWTXDOLWDWLYHJHQHUDOL]DELOLW\,QIDFW
WKHYDOXHRITXDOLWDWLYHUHVHDUFKOLHVLQWKHSDUWLFXODUGHVFULSWLRQDQGWKHPHVGHYHORSHGLQFRQWH[WRI
DVSHFLILFVLWH3DUWLFXODULW\UDWKHUWKDQJHQHUDOL]DELOLW\*UHHQH &DUDFHOOLLVWKHKDOOPDUNRI
JRRG TXDOLWDWLYH UHVHDUFK +RZHYHU WKHUH DUH D IHZ GLVFXVVLRQV LQ WKH TXDOLWDWLYH OLWHUDWXUH DERXW
JHQHUDOL]DELOLW\ HVSHFLDOO\ DV DSSOLHG WR FDVH VWXG\ UHVHDUFK LQ ZKLFK WKH LQTXLUHU VWXGLHV VHYHUDO
FDVHV<LQ  IRU H[DPSOH IHOW WKDW TXDOLWDWLYH FDVH VWXG\ UHVXOWV FDQ EH JHQHUDOL]HG WR VRPH
EURDGHU WKHRU\ 7KH JHQHUDOL]DWLRQ RFFXUV ZKHQ TXDOLWDWLYH UHVHDUFKHUV VWXG\ DGGLWLRQDO FDVHV DQG
JHQHUDOL]H ILQGLQJV WR WKH QHZ FDVHV ,W LV WKH VDPH DV WKH UHSOLFDWLRQ ORJLF XVHG LQ H[SHULPHQWDO
UHVHDUFK +RZHYHU WR UHSHDW D FDVH VWXG\¶V ILQGLQJV LQ D QHZ FDVH VHWWLQJ UHTXLUHV JRRG
GRFXPHQWDWLRQ RI TXDOLWDWLYH SURFHGXUHV VXFK DV D SURWRFRO IRU GRFXPHQWLQJ WKH SUREOHP LQ GHWDLO
DQGWKHGHYHORSPHQWRIDWKRURXJKFDVHVWXG\GDWDEDVH