7KH,QWHUQDWLRQDO$UDE-RXUQDORI,QIRUPDWLRQ7HFKQRORJ\9RO1R0DUFK

3ULYDF\3UHVHUYLQJ.PHDQV&OXVWHULQJ$6XUYH\
5HVHDUFK
)DWLPD0HVNLQHDQG6DILD1DLW%DKORXO
'HSDUWPHQWRI&RPSXWHU6FLHQFH8QLYHUVLW\RI(V6HQLD$OJHULD

'HSDUWPHQWRI&RPSXWHU6FLHQFH8QLYHUVLW\2UDQ$OJHULD

$EVWUDFW7KHFOXVWHULQJLVDQH[SORUDWRU\WDVNRIGDWDPLQLQJ7KLVUDLVHGDUHDOSUREOHPRISULYDF\ZKHQWKHGDWDDUH
IURP GLIIHUHQW VRXUFHV 0RVW RI UHVHDUFKHV RQ SULYDF\ SUHVHUYDWLRQ LQ FOXVWHULQJ DUH GHYHORSHG IRU NPHDQV FOXVWHULQJ
DOJRULWKPE\DSSO\LQJWKHVHFXUHPXOWLSDUW\FRPSXWDWLRQIUDPHZRUN7KHGLVWULEXWLRQRIGDWDPD\EHGLIIHUHQWYHUWLFDO
KRUL]RQWDO RU DUELWUDU\ $SSURDFKHV DOORZLQJ VROYLQJ WKH SUREOHP RQ D YHUWLFDO KRUL]RQWDO DQG HYHQ DUELWUDU\
SDUWLWLRQHGGDWDVHWZHUHSURSRVHG7KHPDMRULQWHUHVWLVWRUHYHDOWKHPLQLPXPRILQIRUPDWLRQGXULQJWKHH[HFXWLRQRIWKH
DOJRULWKPHVSHFLDOO\LQNPHDQVLWHUDWLRQVZKLFKSRVHVDUHDOFKDOOHQJHIRUVHFXUHPXOWLSDUW\FRPSXWDWLRQ7KLVZRUN
FRQVLVWVWRVWXG\DQGDQDO\]HDOOZRUNVRISULYDF\SUHVHUYLQJLQWKHNPHDQVDOJRULWKPFODVVLI\WKHYDULRXVDSSURDFKHV
DFFRUGLQJWRWKHXVHGGDWDGLVWULEXWLRQZKLOHSUHVHQWLQJWKHZHDNQHVVHVDQGWKHVWURQJSRLQWVRIHDFKSURWRFROUHJDUGVWR
SULYDF\7KHLQWHUHVWLVWRDULVHWKHUHDOQHHGVRISULYDF\GXULQJWKHH[HFXWLRQRIWKHGLIIHUHQWVWHSVRINPHDQDOJRULWKP
WKXVWRGLVFRYHUWKHEHVWRIDSSURDFKHVLQFDVHRISUHVHUYLQJSULYDF\LQNPHDQVDOJRULWKP

.H\ZRUGVNPHDQVFOXVWHULQJDOJRULWKPVHFXUHPXOWLSDUW\FRPSXWDWLRQGLVWULEXWHGGDWDSULYDF\SUHVHUYLQJ

5HFHLYHG'HFHPEHUDFFHSWHG0DUFK



,QWURGXFWLRQ SUHVHUYLQJ GDWD PLQLQJ RQHV LV LPSRUWDQW GXH WR WKH
XVH RI WKLV DOJRULWKP LQ LPSRUWDQW RWKHU DUHDV OLNH
7KHYHU\DFWLYHUHVHDUFKDUHDRISULYDF\SUHVHUYLQJGDWD LPDJH DQG VLJQDO SURFHVVLQJ ZKHUH WKH SUREOHP RI
PLQLQJ DLPV WR H[WUDFW XVHIXO LQIRUPDWLRQ IURP GDWD VHFXULW\ LV VWURQJO\ SRVHG >@ 0RVW RI ZRUNV LQ
FRPLQJ IURP PXOWLSOH VRXUFHV ZKLOH SUHVHUYLQJ WKHVH SULYDF\SUHVHUYLQJFOXVWHULQJDUHGHYHORSHGRQWKHN
GDWD DJDLQVW GLVFORVXUH RU ORVV 7KH ILUVW ZRUNV RI PHDQV DOJRULWKP E\ DSSO\LQJ WKH PRGHO RI VHFXUH
SULYDF\ SUHVHUYLQJ GDWD PLQLQJ ZHUH JLYHQ E\ > @ PXOWL SDUW\ FRPSXWDWLRQ RQ GLIIHUHQW GDWD
RQ WKH ,' DOJRULWKP IRU GHFLVLRQ WUHHV FODVVLILFDWLRQ GLVWULEXWLRQV YHUWLFDOO\ KRUL]RQWDOO\ DQG DUELWUDU\
>@ (DFK ZRUN XVHG D GLIIHUHQW PRGHO RI SULYDF\ ,Q SDUWLWLRQHG GDWD ,Q WKLV ZRUN ZH EXLOG DQ RYHUYLHZ
>@ SULYDF\ LV SUHVHUYHG E\ UDQGRPL]LQJ WKH RULJLQDO RI SUHYLRXV ZRUNV LQ SULYDF\ SUHVHUYLQJ NPHDQV
GDWDVHW DQGWKHQ SURYLGHVLW DV LQSXWWR WKH DOJRULWKP FOXVWHULQJ DOJRULWKP EDVHG RQ VHFXUH PXOWLSDUW\
,Q >@ D PRUH ULJRURXV PRGHO LV XVHG ZKLFK LV D FRPSXWDWLRQ ZH FODVVLI\ WKHP DFFRUGLQJ WR GDWD
VHFXUH PXOWL  SDUW\ FRPSXWDWLRQ > @ ,Q WKLV GLVWULEXWLRQ EHFDXVH LW LV WKH RQO\ SDUDPHWHU ZKLFK
DSSURDFKFU\SWRJUDSKLFSULPLWLYHVDUHDGGHGWRWKH,' DIIHFWVWKHDSSURDFKWREHXQGHUWDNHQ:HSUHVHQWWKH
DOJRULWKP LQ RUGHU WR SURWHFW GLVWULEXWHG GDWD IURP ZHDNQHVVHV DQG VWUHQJWKV RI HDFK SURSRVHG VROXWLRQ
GLVFORVXUH ZKHQ H[HFXWLQJ LW  6LQFH PRUH UHVHDUFKHV LQ WHUPV RI SULYDF\SUHVHUYLQJ DQG FRPSXWLQJ FRVW
EDVHGRQVHFXUHPXOWLSDUW\FRPSXWDWLRQIRUGLIIHUHQW ZKLFK DUH DPRQJ PHWULFV WR HYDOXDWH DQ\ SULYDF\
DOJRULWKPVRIGDWDPLQLQJZHUHHVWDEOLVKHG>@ SUHVHUYLQJGDWDPLQLQJDOJRULWKP>@
/DWHO\ PDQ\ VWXGLHV ZHUH LQWHUHVWHG E\ YLHZV DQG

VXUYH\V RQ SULYDF\ SUHVHUYLQJ GDWD PLQLQJ ZRUNV >
 @ LQ DWWHPSW DW JHQHUDOL]DWLRQ WKH UHVXOWV   IRU .PHDQV&OXVWHULQJ$OJRULWKP
GLIIHUHQW FDWHJRULHV RI GDWD PLQLQJ PHWKRGV :H $PRQJ WKH IRUPXODWLRQV RI SDUWLWLRQDO FOXVWHULQJ
EHOLHYH WKDW WKH GLYHUVLW\ RI GDWD PLQLQJ PHWKRGV DQG EDVHGRQWKHPLQLPL]DWLRQRIDQREMHFWLYHIXQFWLRQN
WKHLUVSHFLILFXVHOLPLWVWKHDSSOLHGSULYDF\SUHVHUYLQJ PHDQV DOJRULWKP >@ LV WKH PRVW ZLGHO\ XVHG DQG
PRGHOVWRWKHVHPHWKRGV7REHWWHUFRQWUROWKLVDUHDLW VWXGLHG*LYHQDGDWDVHW'RIQHQWLWLHVREMHFWVGDWD
LVEHVWWRLVRODWHHDFKRQHDQGVHSDUDWHO\VWXG\LW SRLQWVLWHPV LQ UHDO SGLPHQVLRQ VSDFH 5S DQGDQ
&OXVWHULQJ>@LVDGDWDPLQLQJPHWKRGWKDWKDVQRW LQWHJHUN7KH.PHDQVFOXVWHULQJDOJRULWKPSDUWLWLRQV
WDNHQLWVUHDOSDUWLQWKHZRUNVDOUHDG\TXRWHGDOWKRXJK WKHGDWDVHW'RIHQWLWLHVLQWRNGLVMRLQWVXEVHWVFDOOHG
WKH PRVW LPSRUWDQW DOJRULWKP RI WKLV PHWKRG ZDV YHU\ FOXVWHUV (DFK FOXVWHU LV UHSUHVHQWHG E\ LWV FHQWHU
VWXGLHGLQWKHFRQWH[WRISULYDF\SUHVHUYLQJZKLFKLVN ZKLFK LV WKH FHQWURLG RI DOO HQWLWLHV LQ WKDW VXEVHW
PHDQVDOJRULWKP>@6XUYH\LQJSULYDF\SUHVHUYLQJN 
PHDQV FOXVWHULQJ DSSURDFKHV DSDUW IURP RWKHU SULYDF\ 
3ULYDF\3UHVHUYLQJ.PHDQV&OXVWHULQJ$6XUYH\5HVHDUFK 


.PHDQV$OJRULWKP SUREDELOLVWLF SRO\QRPLDOWLPH DOJRULWKPV GHQRWHG 6


,QSXWNWKHQXPEHURIFHQWHUV DQG6VXFKWKDW
6HOHFWLQJWKHILUVWFHQWHUVXXN &
^6 [ I [ \  I [ \ `[ \ {^9,(:  [ \  287387 [ \ `[ \ 
5HSHDW 
&
)RUHDFKHQWLW\JL ^6  [ I  [ \  I [ \ `[ \ {^9,(:  [ \  287387 [ \ `[ \ 
D&DOFXODWHGLVWDQFHVEHWZHHQJLDQGGLIIHUHQW
&
FHQWHUV :KHUH {  GHQRWHV FRPSXWDWLRQDO LQGLVWLJXLVKDELOLW\
E)LQGPLQLPDOGLVWDQFH E\QRQXQLIRUPIDPLOLHVRISRO\QRPLDOVL]HFLUFXLWV
F$VVLJQWKHHQWLW\JLWRWKHQHDUHVWFHQWHU
,QIRUPDOO\ WKH SURRI RI SULYDF\ LV JLYHQ E\
(QGIRU
)RUHDFKFOXVWHUM FRPSDULQJ WKH VHFXULW\ LQ WKH UHDO ZRUOG ZKHUH WKH
D&DOFXODWHWKHQHZFHQWHUVYYN SDUWLHVXVHDVHFXUHWZRSDUW\SURWRFROZLWKWKDWLQWKH
EX YXN YN LGHDO ZRUOG ZKHUH WKH SDUWLHV VHQG WKHLU LQSXWV WR D
(QGIRU WUXVWHG SDUW\ ZKR FRPSXWHV WKH IXQFWLRQ DQG UHWXUQV
8QWLOQRFKDQJHEHWZHHQQHZDQGROGFHQWHUV RQO\WKHUHVXOWWRWKHSDUWLHV7RHQVXUHSULYDF\LQWKH
2XWSXWHQWLWLHVDVVLJQPHQWVWRWKHILQDOFOXVWHUV VHPLKRQHVW PRGHO VHFXULW\ WRROV DUH XVHG LQ WKH

GLIIHUHQW RSHUDWLRQV RI NPHDQV DOJRULWKP :H
7KH QHHG WR SUHVHUYH SULYDF\ LQ NPHDQV DOJRULWKP
RFFXUV ZKHQ LW LV DSSOLHG RQ GLVWULEXWHG GDWD RYHU GHVFULEHWKHSULQFLSDOWRROV
VHYHUDOVLWHVVRFDOOHGSDUWLHVDQGWKDWLWZLVKHVWRGR 
FOXVWHULQJRQWKHXQLRQRIWKHLUGDWDVHWV7KHDLPLVWR 6HFXUH(YDOXDWLRQ&LUFXLW
SUHYHQW D SDUW\ WR VHH RU GHGXFH WKH GDWD RI DQRWKHU <DR >@ KDV GHPRQVWUDWHG WKDW DQ\ SRO\QRPLDOO\
SDUW\ GXULQJ WKH H[HFXWLRQ RI WKH DOJRULWKP 7KLV LV FRPSXWDEOH IXQFWLRQ FDQ EH FRPSXWHG VHFXUHO\ 7KLV
DFKLHYHG E\ XVLQJ VHFXUH PXOWLSDUW\ FRPSXWDWLRQ WKDW ZDV DFFRPSOLVKHG E\ GHPRQVWUDWLQJ WKDW JLYHQ D
SURYLGHVDIRUPDOPRGHOWRSUHVHUYHSULYDF\RIGDWD SRO\QRPLDO VL]H ERROHDQ FLUFXLW ZLWK LQSXWV VSOLW
 EHWZHHQSDUWLHVWKHFLUFXLWFRXOGEHHYDOXDWHGVRWKDW
6HFXUH0XOWL3DUW\&RPSXWDWLRQ QHLWKHU VLGH ZRXOG OHDUQ DQ\WKLQJ EXW WKH UHVXOW 7KH
LGHDLVEDVHGRQVKDUHVSOLWWLQJWKHYDOXHRIHDFKZLUH
6HFXUH0XOWLSDUW\&RPSXWDWLRQ60&>@UHIHUV LQ WKH FLUXLW LV VSOLW LQWR WZR UDQGRP VKDUHV  6HFXUH
WR WKH JHQHUDO SUREOHP RI VHFXUH FRPSXWDWLRQ RI D FLUFXLWHYDOXDWLRQGRHVHQDEOHHIILFLHQWFRPSXWDWLRQRI
IXQFWLRQ ZLWK GLVWULEXWHG LQSXWV EHWZHHQ SDUWLHV 7KH IXQFWLRQV RI VPDOO LQSXWV VXFK DV FRPSDULQJ WZR
DLP LV WR SURWHFW D KRQHVW SDUW\ DJDLQVW GLVKRQHVW QXPEHUVEHFDXVHRILWVSURKLELWLYHFRPSXWDWLRQFRVW
EHKDYLRXU RI WKH RWKHU SDUW\ 7KHUH DUH WZR W\SHV RI DQGLVXVHGIUHTXHQWO\LQNPHDQVDOJRULWKPIRUVHFXUH
DGYHUVDULHV IRU ZKLFK VHFXULW\ PRGHOV DUH GHILQHG WKH FRPSDULVRQGLVWDQFHV
VHPLKRQHVW DGYHUVDU\ PRGHO DQG WKH PDOLFLRXV 
DGYHUVDU\PRGHO7KHVHPLKRQHVWPRGHOLVVLPSOHUDQG
LWLVPRUHDQVZHUHGLQSULYDF\SUHVHUYLQJDSSOLFDWLRQV
+RPRPRUSKLF6FKHPHV
,W IROORZV WKH UXOHV RI WKH SURWRFRO XVLQJ LWV FRUUHFW 7KHKRPRPRUSKLVPSURSHUW\RIWKHVHVFKHPHVDOORZV
LQSXWV EXW LV IUHH WR ODWHU XVH ZKDW LW VHHV GXULQJ WRDWKLUGSDUW\WRRSHUDWHRQKLGGHQYDOXHVWRKDYHD
H[HFXWLRQ RI WKH SURWRFRO WR FRPSURPLVH VHFXULW\ $ KLGGHQ YDOXH RI WKH UHVXOW  7ZR KRPRPRUSKLF
IRUPDO GHILQLWLRQ RI VHFXUH SULYDWH WZRSDUW\ VFKHPHV DUH XVHG LQ SULYDF\ SUHVHUYLQJ NPHDQV
FRPSXWDWLRQLQWKHVHPL KRQHVW PRGHOLV JLYHQ EHORZ DOJRULWKP LQ SDUWLFXODU IRU VHFXUH FRPSXWDWLRQ RI
/HW I D IXQFWLRQ GHILQHG I^` u^` o GLVWDQFHV DQG FOXVWHU FHQWHUV KRPRPRUSKLF SXEOLF
^` u^`   ZKHUH I II /HW 3  WZRSDUW\ NH\ FU\SWRV\VWHPV DQG VHFUHW DGGLWLYH VKDULQJ
SURWRFROIRUFRPSXWLQJWKHIXQFWLRQI7KHYLHZRIWKH VFKHPHV +RPRPRUSKLF SXEOLFNH\ &U\SWRV\VWHP RU
ILUVWUHVSWKHVHFRQGSDUW\GXULQJDQH[HFXWLRQRI 3 KRPRPRUSKLF HQFU\SWLRQ VFKHPH LV D VHPDQWLFDOO\
RQ[\GHQRWHG9,(:3UHVS9,(:3LV9,(:3 VHFXUH SXEOLFNH\ HQFU\SWLRQ ZKLFK LQ DGGLWLRQ WR
[UPPWDQG9,(:3 \UPPW ZKHUH VWDQGDUGJXDUDQWHHVVDWLVILHVWKHIROORZLQJSURSHUWLHV
UUHSUHVHQWWKHRXWFRPHRIWKHILUVWUHVSVHFRQGFRLQ &W&W &WW
WRVVHVDQGPLUHSUHVHQWVWKHLWKPHVVDJHLWKDVUHFHLYHG
7KH UHVXOW RI WKH ILUVW UHVS VHFRQG SDUW\ GXULQJ DQ &WW &WW 


H[HFXWLRQRI 3RQ[\GHQRWHG2873873 UHVS :KHUH&LVWKHSXEOLFNH\HQFU\SWLRQIXQFWLRQDQGW

2873873 LVLPSOLFLWLQWKHSDUW\VRZQYLHZRIWKH W DUH HOHPHQWVLQ WKH GRPDLQ RI GDWD7KH PRVW XVHG
H[HFXWLRQDQG DUH 3DLOOLHU FU\SWRV\VWHPV ZKLFK SURYLGHV IDVW
HQFU\SWLRQDQGGHFU\SWLRQDOJRULWKPV>@2QHRILWV
2873873[\ 2873873[\2873873[\
DSSOLFDWLRQVLVWKHVHFXUHVFDODUSURGXFW>@ZKLFKLV
:HVD\WKDWWKHSURWRFRO 3LVVHFXUHDJDLQVWVHPL PRVW RIWHQ XVHG LQ WKH NPHDQV DOJRULWKP $ VHFUHW
KRQHVW DGYHUVDU\ FRPSXWH SULYDWHO\ I LI H[LVW VKDULQJ VFKHPH >@ DOORZV WR DQ\ W RXW RI Q
SDUWLFLSDQWVWRFROODERUDWLYHO\UHFRYHUDVHFUHWZKLOHD
7KH,QWHUQDWLRQDO$UDE-RXUQDORI,QIRUPDWLRQ7HFKQRORJ\9RO1R0DUFK

VHWRIOHVVWKDQWSDUWLFLSDQWVOHDUQVQRWKLQJDERXWLW$ SDUWLHV LV FDUULHG RXW E\ LQWURGXFLQJ WKH VHFXUH

W Q VHFUHW VKDULQJ VFKHPH LV D VHW RI WZR IXQFWLRQV SHUPXWDWLRQ RI  'X DQG $WWDOODK >@ DQG WKH
WKH IXQFWLRQ 3 ZKLFK WDNHV D VHFUHW V DV LQSXW DQG KRPRPRUSKLF HQFU\SWLRQ VFKHPHV 7KH VHFXUH
FUHDWHV Q VHFUHW VKDUHV 3V  VVQ DQG WKH FRPSDULVRQEHWZHHQGLVWDQFHVLVDFKLHYHGE\WKH<DR
UHFRQVWUXFWLRQ IXQFWLRQ 5 WKDW UHWXUQ WKH VHFUHW V E\ >@ HYDOXDWLRQ FLUFXLW7KHVH SULPLWLYHV DUHH[HFXWHG
JDWKHULQJ WKH W VKDUHV RU QRWKLQJ $ VHFUHW VKDULQJ IRU HDFK HQWLW\ RI WKH GDWDVHW ZKLFK PDNHV WKH
VFKHPHLVDGGLWLYHO\KRPRPRUSKLFLI FRPSXWDWLRQDO FRVW YHU\ KLJK 7KH SURWRFRO UHTXLUHV
 WKUHH QRQFROOXGLQJ SDUWLHV ZKLFK KDYH PRUH
5VV
VWV
W VV

LQIRUPDWLRQ WKDQ RWKHUV VXFK DV WKH SDUWLDO VXP RI
3HGHUVHQ HW DO >@ VKRZ WKDW DGGLWLYH VHFUHW VKDULQJ GLVWDQFHV VKDUHV LQ RUGHUWR LPSOHPHQW WKH WZRSDUW\
VFKHPHV DUH PRUH HIIHFWLYH LQ FRPPXQLFDWLRQ DQG VHFXUH FRPSDULVRQ DQG WKH SHUPXWDWLRQ RUGHU RI
FRPSXWDWLRQ FRVW FRPSDUHG WR WKH KRPRPRUSKLF GLVWDQFHV YHFWRU 7KH GHPRQVWUDWLRQ RI SULYDF\ LV
FU\SWRV\VWHPV ZKHQ WKH\ DUH DSSOLHG WR SULYDF\ JLYHQ LQ WKH VHPLKRQHVW PRGHO EXW WKH SURWRFRO
SUHVHUYLQJ GDWD PLQLQJ ,Q >@ WKH DXWKRUV VKRZ DQ UHYHDOVDGGLWLRQDOLQIRUPDWLRQVXFKDVWKHDVVLJQPHQWV
DSSOLFDWLRQ RI DGGLWLYH VHFUHW VKDULQJ VFKHPHV RQ N RI LQWHUPHGLDWHFOXVWHUVDQG WKH QXPEHU RI HQWLWLHV LQ
PHDQVDOJRULWKP HDFK FOXVWHU GXULQJ WKH RSHUDWLRQ RI GLYLVLRQ IRU
 FRPSXWLQJFHQWHUV
:RUNVLQ3ULYDF\3UHVHUYLQJ.0HDQV 7RDYRLGWKHXVHRIQRQFROOXGLQJSDUWLHVDQGDSSO\
WKH SURWRFRO RQ WZR SDUWLHV 6DPHW >@ SURSRVHV DQ
7\SRORJ\DQG9LHZSRLQWV
DOJRULWKPWRSUHVHUYHSULYDF\RQYHUWLFDOO\SDUWLWLRQHG
6HYHUDO SULYDF\SUHVHUYLQJ NPHDQV FOXVWHULQJ GDWD XVLQJ D QHZ SULPLWLYH RI FRPSDULVRQ EDVHG RQ
DOJRULWKPDUHGHYHORSHGRQGLIIHUHQWGDWDGLVWULEXWLRQV VHFXUH PXOWLSDUW\ DGGLWLRQ GHYHORSHG E\ WKH VDPH
7KHUHDUHWZREDVLFGDWDSDUWLWLRQLQJGDWDGLVWULEXWLRQ DXWKRUVDQGWKHVHFXUHVXP>@LQFRPSXWLQJWKHVXP
PRGHOV KRUL]RQWDO SDUWLWLRQLQJ KRPRJHQHRXV RIGLVWDQFHV+RZHYHUWKHSURWRFROGRHVQRWVROYHWKH
GLVWULEXWLRQ DQG YHUWLFDO SDUWLWLRQLQJ KHWHURJHQHRXV SUREOHP RI UHYHODWLRQ HQWLWLHV QXPEHU LQ FOXVWHUV
GLVWULEXWLRQ 'RJDQD\HWDO>@KDYHUHSHDWHGWKHVDPHVFKHPHRI
7KHUHDUHRWKHUPRGHOVRIGDWDGLVWULEXWLRQVXFKDV 9DLG\D >@ EXW E\ XVLQJ WKH DGGLWLYH VHFUHW VKDULQJ
DUELWUDULO\SDUWLWLRQHGGDWDPRGHO>@ZKLFKJHQHUDOL]H VFKHPHV LQVWHDG RI KRPRPRUSKLF FU\SWR V\VWHPV WKH
WKH WZR FDVHV YHUWLFDO DQG KRUL]RQWDO SDUWLWLRQLQJ PDLQ DLP LV WR PLQLPL]H WKH FRPSXWDWLRQ DQG
ZKHUH GLIIHUHQW IHDWXUHV IRU GLIIHUHQW HQWLWLHV RI WKH FRPPXQLFDWLRQ FRVW DQG WR GHPRQVWUDWH WKH
VDPH GDWDVHW FDQ EH RZQHG E\ VHYHUDO SDUWLHV 7KH HIIHFWLYHQHVV RI DGGLWLYH VHFUHW VKDULQJ VFKHPHV
GLVWULEXWLRQ RI GDWDVHWV DFURVV PXOWLSOH ORFDWLRQV FRPSDULQJ WR WKH KRPRPRUSKLF FU\SWR V\VWHPV IRU
GLFWDWHV FKDQJHV LQ WKH NPHDQV DOJRULWKP GHSHQGLQJ WKHVH SDUDPHWHUV EXW E\ XVLQJ IRXU QRQFROOXGLQJ
RQWKHPRGHORIWKLVGLVWULEXWLRQZKLFKYDULHVWKHZD\ SDUWLHVLQVWHDGRIWKUHH$QH[SHULPHQWDOHYDOXDWLRQLV
WRSUHVHUYHSULYDF\ DOVRVKRZHG
 
:RUNVLQ3ULYDF\3UHVHUYLQJ.0HDQVRQ :RUNVLQ3ULYDF\3UHVHUYLQJ.0HDQVRQ
9HUWLFDOO\3DUWLWLRQHG'DWD3URJUHVVLRQV +RUL]RQWDOO\3DUWLWLRQHG'DWD
,Q D YHUWLFDOO\ SDUWLWLRQHG GDWDVHW HDFK HQWLW\ LV
3URJUHVVLRQV
GLVWULEXWHG RQ GLIIHUHQW SDUWLHV VR WKDW HDFK SDUW\ KDV :KHQNPHDQVDOJRULWKPLVH[HFXWHGRQDKRUL]RQWDOO\
VRPHFRPSRQHQWVRIHQWLWLHV,QWKLVFDVHWKHFKRLFHRI SDUWLWLRQHG GDWDVHW WKH GLVWDQFH FRPSXWDWLRQ LWVHOI
WKHNILUVW FHQWHUV GRHV QRW SRVH D SUREOHP RI SULYDF\ GRHV QRW YLRODWH SULYDF\ EHFDXVH HDFK SDUW\ KROGV DOO
:KLOHLQWKHLWHUDWLRQVRINPHDQVWKHFRPSXWDWLRQRI WKHFRPSRQHQWVRIDQHQWLW\7KHSUREOHPDULVHVZKHQ
WKHGLVWDQFHVRYHUSDUWLHVLQYROYHGWKHQHHGWRGLVFORVH FRPSXWLQJ LQWHUPHGLDWH FOXVWHU FHQWHUV LQ WKLV FDVH
WKHLU GDWD 7KH LQWHUPHGLDWH DVVLJQPHQWV RI HQWLWLHV WR WKHHQWLWLHVRIWKHVDPHFOXVWHUPD\FRPHIURPVHYHUDO
WKH QHDUHVW FOXVWHUV DOVR SRVH D SUREOHP RI SULYDF\ SDUWLHV ZKHUH WKH LQWHUHVW RI SURWHFWLQJ WKHP 7KLV
ZKHQ VHDUFKLQJ WKH PLQLPXP RI WKHVH GLVWDQFHV IRU D VWHSDOVRUHTXLUHVNQRZOHGJHRIWKHQXPEHURIHQWLWLHV
JLYHQ HQWLW\ :KHQ FRPSXWLQJ QHZ FHQWHUV WKH ROG LQ HDFK FOXVWHU WKLV QXPEHU LV H[WUD LQIRUPDWLRQ WKDW
FHQWHUV VKDUHV DUH H[SOLFLWO\ NQRZQ WR WKH YDULRXV VKRXOG QRW EH UHYHDOHG WR GLIIHUHQW SDUWLHV GXULQJ WKH
SDUWLHVEXWWKHQXPEHURIHQWLWLHVPXVWEHGLVFORVHGIRU H[HFXWLRQ RI WKH SURWRFRO 7KH UDQGRP VHOHFWLRQ RI N
WKH GLYLVLRQ RSHUDWLRQ +HQFH WKH QHHG RI SULYDF\ ILUVW FHQWHUV LV DOVR D SUREOHP RI SULYDF\ LQ WKLV GDWD
FRPHV LQ GLVWDQFHV DQG FHQWHUV FRPSXWDWLRQ DQG GLVWULEXWLRQ 7KH SULYDF\SUHVHUYLQJ SURWRFRO RQ
DOORFDWLRQRIHQWLWLHVWRWKHQHDUHVWFOXVWHUV KRUL]RQWDOO\ SDUWLWLRQHG GDWD VKRXOG DOVR SUHYHQW WKH
7KH ILUVW VROXWLRQ ZDV SURSRVHG E\ 9DLG\D >@ IRU GLVFORVXUH RI DGGLWLRQDO LQIRUPDWLRQ VXFK DV
YHUWLFDOO\ SDUWLWLRQHG GDWD RQ VHYHUDO SDUWLHV ,Q WKH LQWHUPHGLDWHFHQWHUVWKHPVHOYHV
SURSRVHG SURWRFRO WKH HQWLWLHV RI HDFK SDUW\ DUH NHSW -KDHWDO>@KDYHSURSRVHGWZRSURWRFROVIRUWKH
FRQILGHQWLDO VHFXUH FRPSXWLQJ GLVWDQFHV EHWZHHQ WKH SUHVHUYDWLRQ RI SULYDF\ LQ NPHDQV DOJRULWKP RQ WZR
3ULYDF\3UHVHUYLQJ.PHDQV&OXVWHULQJ$6XUYH\5HVHDUFK 


SDUWLHVRQO\,QWKHGHVFULEHGVFHQDULRRQO\WKHHQWLWLHV DQGDVHFXUHDSSUR[LPDWLRQWHFKQLTXH>@+RZHYHU
RI HDFK SDUW\ DUH NHSW FRQILGHQWLDO WKH LQWHUPHGLDWH WKH SURSRVHG VROXWLRQ GRHV QRW VROYH WKH SUREOHP RI
FHQWHUVDUHUHYHDOHGWRWKHWZRSDUWLHVDQGWKHGLVWDQFH WKHORFDOGLYLVLRQ ZKLFKOHDNV WKH QXPEHU RI HQWLWLHV
FRPSXWDWLRQ LV GRQH ORFDOO\ LQ HDFK SDUW\ 6HFXULW\ LQ HDFK FOXVWHU WR GLIIHUHQW SDUWLHV GXULQJ FHQWHUV
SULPLWLYHVDUHXVHGIRUFHQWHUVFRPSXWDWLRQLQRUGHUWR FRPSXWDWLRQ DQG WKH UHYHODWLRQ RI WKH LQWHUPHGLDWH
SUHVHUYHWKHSULYDF\RIHQWLWLHVRIHDFKSDUW\7KHILUVW DVVLJQPHQWVRIHQWLWLHVWRFOXVWHUV
SURWRFROFDOOHG23(LVEDVHGRQREOLYLRXVSRO\QRPLDO %XQQ DQG 2VWURYVN\ >@ RIIHU D PRUH HIILFLHQW
HYDOXDWLRQJLYHQE\1DRUDQG3LQNDV>@7KHVHFRQG VROXWLRQ LQ SULYDF\ IRU WKH NPHDQV DOJRULWKP RQ
SURWRFRO QDPHG '3( LV EDVHG RQ KRPRPRUSKLF DUELWUDULO\ SDUWLWLRQHG GDWD 7KH DXWKRUV SURYLGH D
HQFU\SWLRQVFKHPHV ULJRURXV DSSURDFK WR VHFXULW\ LQ WKH VHPLKRQHVW
7KHSURSRVHGVROXWLRQVWLOOUHTXLUHVWKDWERWKSDUWLHV PRGHOWKHLUSURWRFROGRHVQRWUHYHDOWKHLQWHUPHGLDWH
DUH VHPL  KRQHVW WKH DLP ZDV WR H[SHULPHQWDOO\ FHQWHUVDQGFOXVWHUVDVVLJQPHQWVWKH\DOVRHIIHFWLYHO\
HYDOXDWH WKH WZR SURWRFROV 7KH KRPRPRUSKLF VROYHWKHSUREOHPRIWKHORFDOGLYLVLRQ7KH\GHYHORS
HQFU\SWLRQ VFKHPH LV PRUH HIILFLHQW WKDQ 23( IRU WKH VHFXUHVXESURWRFROVIRUHDFKRSHUDWLRQLQWKHNPHDQV
WZR SDUDPHWHUV FRPSXWLQJ DQG FRPPXQLFDWLRQ FRVW DOJRULWKP RQ WKH EDVLV RI 3DLOOLHU KRPRPRUSKLF
EXWWKHLUVROXWLRQFDQQRWEHH[WHQGHGWRVHYHUDOSDUWLHV FU\SWRV\VWHPV >@ HVSHFLDOO\ IRU VHFXUH PXOWLSDUW\
6DPHWHWDO>@KDYHSURSRVHGDSURWRFROZKLFKXVHVD GLYLVLRQ 7KH DXWKRUV SURSRVH DOVR D VHFXUH SURWRFRO
VHFXUH PHWKRG RI GLYLVLRQ WKDW SURWHFWV WKH HQWLWLHV RI IRU UDQGRP FKRLFH RI N LQLWLDO FHQWHUV 'HVSLWH WKLV
HDFKSDUW\DQGSUHYHQWVWKHUHYHODWLRQRIWKHQXPEHURI WKHLUVROXWLRQIDLOVWRPDNHFRQILGHQWLDOWKHQXPEHURI
HQWLWLHVLQHDFKFOXVWHU7KHSURWRFROLVDOVRDSSOLFDEOH LWHUDWLRQVLQWKHDOJRULWKP
LQ D PXOWLSDUW\ HQYLURQPHQW EXW WKH LQWHUPHGLDWH 6DNXPD DQG .RED\DVKL >@ JLYH D QHZ SURWRFRO
FHQWHUVDUHDOZD\VUHYHDOHG EXWDSSOLHGWRVHYHUDOSDUWLHVFDOOHGQRGHV7KHDLPLV
 WRSURYLGHDSURWRFROIRUSUHVHUYLQJSULYDF\WRVLPSOH
$GYDQFHG:RUNVLQ3ULYDF\3UHVHUYLQJ. XVHUV UDWKHU WKDQ RUJDQL]DWLRQV RU FRPSDQLHV ,Q WKLV
0HDQVRQ$UELWUDULO\'LVWULEXWHG'DWD FDVHWKHSURWRFROLVVFDODEOHDFFRUGLQJWRWKHQXPEHU
 RISDUWLHV7KHLGHDLVWRVHFXUHWKHSURWRFROSURSRVHG
$OWKRXJKDQDUELWUDULO\SDUWLWLRQHGGDWDVHWLVXQOLNHO\ E\.RZDOVF]\NDQG9ODVVLV>@ZKLFKFDOFXODWHVWKH
LQ SUDFWLFH WKH LQWHUHVW RI FRQVLGHULQJ VXFK D DYHUDJH RI WKH YDOXHV GLVWULEXWHG WKURXJK 33
SDUWLWLRQLQJ LV WKDW WKH SURWRFROV LQ WKLV PRGHO FDQ EH QHWZRUNV ZLWKRXW WUDQVIHUULQJ GDWD WR D FHQWUDO
DSSOLHG ERWK WR KRUL]RQWDOO\ SDUWLWLRQHG GDWD DQG GHSRVLWRU\ IRU FRPSXWLQJ FHQWHUV $W WKLV OHYHO
YHUWLFDOO\ SDUWLWLRQHG GDWD ,Q WKLV FDVH WKH QHHG RI SULYDF\ LV SUHVHUYHG XVLQJ 3DLOOLHU KRPRPRUSKLF
SULYDF\LQWKHNPHDQVDOJRULWKPLQFOXGHVDOOWKHFDVHV FU\SWR V\VWHPV )RU WKH SURWHFWLRQ RI GLVWDQFHV SDUWV
DOUHDG\VHHQ <DRHYDOXDWLRQFLUFXLWDQGWKHUDQGRPVKDUHVSULQFLSOH
7KH LGHD RI SULYDF\SUHVHUYLQJ SURWRFRO RQ DUHLQWURGXFHG7KHFDOFXODWLRQLVGRQHIRUHDFKQRGH
DUELWUDULO\ SDUWLWLRQHG GDWD ZDV LQWURGXFHG E\ ZKLFK PDNHV WKH SURWRFRO VFDODEOH DQG IDXOW WROHUDQW
-DJDQQDWKDQ DQG :ULJKW >@7KHLUVROXWLRQ SUHVHUYHV %XWWKHUHLVQRLPSURYHPHQWLQVHFXULW\
WKH SULYDF\ LQ WKH NPHDQV DOJRULWKP EHWZHHQ WZR 
SDUWLHV1RRWKHUFRQILGHQFHSDUW\LVXVHG7KHLGHDLV &RQFOXVLRQV
WKDW DOO WKH FDOFXODWHG YDOXHV LQ WKH LQWHUPHGLDWH VWHSV
DUH VSOLW WR UDQGRP YDOXHV WKH SULQFLSOH RI UDQGRP $OWKRXJKWKHXVHGVHFXULW\PRGHOLVUHODWLYHO\VLPSOH
VKDUHV 7KH VHFXUH VFDODU SURGXFW >@ LV XVHG IRU VHPLKRQHVWPRGHOWKHSURWRFROVSURSRVHGGRQRW
VHFXUH FRPSXWDWLRQ RI GLVWDQFHV DQG WKH <DR FLUFXLW SURYLGHDFRPSOHWHSUHVHUYDWLRQRISULYDF\LQNPHDQV
HYDOXDWLRQ LV XVHG IRU VHFXUH FRPSDULVRQ DQG DOJRULWKPWKHSUREOHPLVLQWKHLWHUDWLYHQDWXUHRIWKH
FDOFXODWLRQ RI LQWHUPHGLDWH FHQWHUV 7KHVH VHFXULW\ DOJRULWKP %HVLGHV WKH LQIRUPDWLRQ WR SURWHFW DUH
SULPLWLYHV DUH H[HFXWHG IRU HDFK HQWLW\ RI WKH GDWDVHW QXPHURXVGLVWDQFHVYDOXHVLQWHUPHGLDWHDVVLJQPHQWV
ZKLFKUHIHUVWKHSURWRFROWRWKHVDPHSUREOHPRIZKLFK WR FOXVWHUV QXPEHU RI SRLQWV LQ HDFK FOXVWHU
SURSRVHG E\ 9DLG\D >@ WKDW RI D KLJK FRPSXWDWLRQ LQWHUPHGLDWH FHQWHUV QXPEHU RI LWHUDWLRQV DQG WKH
FRVWIRUDODUJHGDWDVHW HQWLWLHV YDOXHV WKHPVHOYHV 7KH PRGHO RI WKH GDWD
7KH VROXWLRQ KDV D ZHDNQHVV DW WKH XSGDWHG FHQWHUV GLVWULEXWLRQ DOVR DIIHFWV WKH ZD\ WKDW SULYDF\ LV
ZKHUHWKH\FRQVLGHUWKHGLYLVLRQDVDPXOWLSOLFDWLRQE\ SUHVHUYHG
WKHLQYHUVHZKLFKGRHVQRWLPSOHPHQWFRUUHFWO\WKHN $UELWUDULO\SDUWLWLRQLQJGDWDVHWLVEHVWVXLWHGWRVHHN
PHDQVDOJRULWKP$QRWKHUSURWRFROZDVJLYHQE\6XHW D PRUH JHQHUDO VROXWLRQ %XW PRVW ZRUN LQ WKLV
DO >@ ZKHUH WKH\ LQWURGXFH VHFXUH GDWD GLVWULEXWLRQ PRGHO LV DSSOLHG WR RQO\ WZR SDUWLHV
VWDQGDUGL]DWLRQLQRUGHUWRJLYHJUHDWHUDFFXUDF\WRWKH H[FHSW WKDW LQ >@ $OO ZRUN RQ WKH YHUWLFDOO\
UHVXOW RI FOXVWHULQJ $Q LPSURYHPHQW LQ VHFXULW\ SDUWLWLRQHGGDWDVHWPRGHOLVJLYHQRQPXOWLSOHSDUWLHV
FRPSDUHGWRWKHILUVWSURWRFROLVWKDWWKHFRPSDULVRQRI EXW FRQVLGHULQJ QRW FROOXGLQJ WUXVW SDUWLHV > @
GLVWDQFHVDQGFHQWHUVFRPSXWLQJDUHGRQHE\WKHVHFXUH ZKHUH QRVHFXULW\ JXDUDQWHHV LV JLYHQ LI WKHVH SDUWLHV
VFDODU SURGXFW VHFXUH REOLYLRXV SRO\QRPLDO HYDOXDWLRQ DJUHHG7KHFRVWRISULYDF\LVPHDVXUHGUHODWLYHWRWKH
7KH,QWHUQDWLRQDO$UDE-RXUQDORI,QIRUPDWLRQ7HFKQRORJ\9RO1R0DUFK

FRPSXWLQJDQGFRPPXQLFDWLRQFRVW3URWRFROVEDVHGRQ 2XU ZRUN ZDV WR SUHSDUH DQ RYHUYLHZ RI

<DR FLUFXLW HYDOXDWLRQ >@ DUH YHU\ H[SHQVLYH DSSURDFKHV LQ SULYDF\SUHVHUYLQJ NPHDQV DOJRULWKP
FRPSDUHG WR WKRVH EDVHG RQ KRPRPRUSKLF FU\SWR :HKDYHFODVVLILHGWKHVHDSSURDFKHVDFFRUGLQJWRWKH
V\VWHPVEXWHYHQWKHFRVWRIHQFU\SWLRQLQWKHODWWHULV XVHG GLVWULEXWLRQV GDWDVHWV ZKLOH SUHVHQWLQJ WKH
QRW QHJOLJLEOH $GGLWLYH VHFUHW VKDULQJ VFKHPHV DUH ZHDNQHVVHV DQG VWUHQJWKV RI HDFK DSSURDFK ,Q
SURPLVLQJ EHFDXVH WKH\ SUHVHQW D PLQLPDO FRVW RI FRQWUDVWWR>@ZKLFKFULWLFL]HVWKHFRUUHFWQHVVDVSHFW
FRPSXWDWLRQ HYHQ LI WKHLU XVH UHTXLUHV QRQFROOXGLQJ RXU DQDO\VLV LV LQWHUHVWLQJ WR WKH SULYDF\ SUHVHUYLQJ
SDUWLHV>@+RZHYHUWKHPDMRULW\RIWKHVHZRUNVDSSO\ RQH   7KH LQWHUHVW RI RXU FRQWULEXWLRQ LV WR KLJKOLJKW
WKH<DRSURWRFRO>@DQGKRPRPRUSKLFFU\SWRV\VWHPV WKH UHDO QHHGV RI SUHVHUYLQJ SULYDF\ EDVHG RQ GDWD
7DEOH VXPPDUL]HV WKHVHGLIIHUHQWVROXWLRQVDQG WKHLU GLVWULEXWLRQGXULQJWKHH[HFXWLRQRINPHDQVDOJRULWKP
PDLQREMHFWLYHV DQGWRGHULYHWKHQHDUHVWZRUNWRVROYHWKHSUREOHP

7DEOH6XPPDU\RISULYDF\SUHVHUYLQJNPHDQVDOJRULWKPZRUNV
3DUWLHV
$XWKRUV 'LVWULEXWLRQ0RGHO 6HFXULW\7RROV 0DLQ2EMHFWLYH
1XPEHUQ
6HFXUHSHUPXWDWLRQ>@ 7KHILUVWSULYDF\SUHVHUYLQJN
9DLG\DDQG&OLIWRQ
9HUWLFDO Q! +RPRPRUSKLFHQFU\SWLRQVFKHPHV PHDQVDOJRULWKPEDVHGRQ
>@
<DRHYDOXDWLRQFLUFXLW>@ VHFXUHPXOWLSDUW\FRPSXWDWLRQ
&RPSDULQJWKHWZRSURWRFROVLQ
2EOLYLRXVSRO\QRPLDOHYDOXDWLRQ>@
-KDHWDO>@ +RUL]RQWDO  WHUPRIFRPSXWDWLRQDQG
+RPRPRUSKLFHQFU\SWLRQVFKHPHV
FRPPXQLFDWLRQFRVW
$VHFXUHSURWRFROZKLFKFDQEH
5DQGRPVKDUHV
-DJDQQDWKDQDQG XVHGRQWKHWZRGDWD
$UELWUDU\  6HFXUHVFDODUSURGXFW>@
:ULJKW>@ GLVWULEXWLRQVKRUL]RQWDODQG
<DRHYDOXDWLRQFLUFXLW
YHUWLFDO
$PXOWLSDUW\SULYDF\
9HUWLFDO 6HFXUHPXOWLSDUW\DGGLWLRQ>@
6DPHWHWDO>@ Q SUHVHUYLQJLQNPHDQV
+RUL]RQWDO 6HFXUHVXP>@
DOJRULWKP
6HFXUHVFDODUSURGXFW
6HFXUHGDWDVWDQGDUGLVDWLRQDQG
6XHWDO>@ $UELWUDU\  2EOLYLRXVSRO\QRPLDOHYDOXDWLRQ
VHFXULW\LPSURYHPHQW
6HFXUHDSSUR[LPDWLRQWHFKQLTXH>@
5HVROYLQJWKHSUREOHPRI
VHFXUHPXOWLSDUW\GLYLVLRQDQG
%XQQDQG2VWURYVN\ 3DLOOLHUFU\SWRV\VWHPV>@
$UELWUDU\  DQHZSURWRFROIRUVHFXUH
>@ 6HFXUHVFDODUSURGXFW
UDQGRPO\VHOHFWLRQRINILUVW
FHQWHUV
3DLOOLHUFU\SWRV\VWHPV
6DNXPDDQG 6FDODEOHDQGIDXOWWROHUDQW
$UELWUDU\ Q 5DQGRPVKDUHV
.RED\DVKL>@ SURWRFRO
<DRHYDOXDWLRQFLUFXLW
$QHZSURWRFROEDVHGRQ
DGGLWLYHVHFUHWVKDULQJVFKHPHV
'RJDQ\HWDO>@ 9HUWLFDO Q! $GGLWLYHVHFUHWVKDULQJVFKHPHV>@
LQVWHDGRIKRPRPRUSKLF
HQFU\SWLRQ

5HIHUHQFHV >@ &OLIWRQ & .DQWDUFLRJOX 0 9DLG\D - /LQ ;
DQG =KX 0 7RROV IRU 3ULYDF\ 3UHVHUYLQJ
>@ $JJDUZDO & DQG <X 3 $ *HQHUDO 6XUYH\ RI 'LVWULEXWHG     'DWD 0LQLQJ $&0 6,*.''
3ULYDF\3UHVHUYLQJ'DWD0LQLQJ0RGHOVDQG ([SORUDWLRQV1HZVOHWWHUYROQRSS
$OJRULWKPV LQ 3URFHHGLQJV RI 3ULYDF\ 
3UHVHUYLQJ'DWD0LQLQJDQG$OJRULWKPVERRNSS >@ 'RJDQD\ 0 3HGHUVRQ7 6D\JLQ < 6DYDV (
 DQG /HYL $ 'LVWULEXWHG 3ULYDF\ 3UHVHUYLQJ
>@ $JUDZDO 5 DQG 6ULNDQW 5 3ULYDF\3UHVHUYLQJ &OXVWHULQJ ZLWK $GGLWLYH 6HFUHW 6KDULQJ LQ
'DWD 0LQLQJ LQ 3URFHHGLQJV RI WKH $&0 3URFHHGLQJV RI WKH ,QWHUQDWLRQDO :RUNVKRS RQ
6,*02' ,QWHUQDWLRQDO &RQIHUHQFH RQ 3ULYDF\ DQG $QRQ\PLW\ LQ ,QIRUPDWLRQ 6RFLHW\
0DQDJHPHQW RI 'DWD 'DOODV 7H[DV 86$ SS 7DEOH1DWHV)UDQFHSS
 >@ 'X : DQG $WDOODK 0 3ULYDF\3UHVHUYLQJ
>@ %HUWLQR ( 'DQ / DQG :HL - $ 6XUYH\ RI 6WDWLVWLFDO $QDO\VLV LQ 3URFHHGLQJV RI WK
4XDQWLILFDWLRQ RI 3ULYDF\     3UHVHUYLQJ 'DWD $QQXDO &RPSXWHU 6HFXULW\ $SSOLFDWLRQV
0LQLQJ$OJRULWKPVLQ3URFHHGLQJVRI$GYDQFHV &RQIHUHQFH 1HZ 2UOHDQV /RXLVLDQD 86$ SS
LQ'DWDEDVH6\VWHPVSS 
>@ %XQQ3DQG2VWURYVN\56HFXUH7ZR3DUW\. >@ (O6LVL $ )DVW &U\SWRJUDSKLF 3ULYDF\
0HDQV &OXVWHULQJ LQ 3URFHHGLQJV RI WKH WK 3UHVHUYLQJ $VVRFLDWLRQ 5XOHV 0LQLQJ RQ
$&0 &RQIHUHQFH RQ &RPSXWHU DQG 'LVWULEXWHG +RPRJHQRXV 'DWDEDVH 7KH
&RPPXQLFDWLRQV 6HFXULW\ $OH[DQGULD 9LUJLQLD ,QWHUQDWLRQDO $UDE -RXUQDO RI ,QIRUPDWLRQ
86$SS 7HFKQRORJ\YROQRSS
3ULYDF\3UHVHUYLQJ.PHDQV&OXVWHULQJ$6XUYH\5HVHDUFK 


>@ (UNLQ=3LYD$.DW]HQEHLVVHU6/DJHQGLMN5 VW $&0 6\PSRVLXP RQ 7KHRU\ RI &RPSXWLQJ

6KRNUROODKL - 1HYHQ * DQG %DUQL 0 $WODQWD86$SS
3URWHFWLRQ DQG 5HWULHYDO RI (QFU\SWHG >@ 3DLOOLHU 3 3XEOLF.H\ &U\SWRV\VWHPV
0XOWLPHGLD &RQWHQW :KHQ &U\SWRJUDSK\ 0HHWV (QVHPEOHG RQ &RPSRVLWH 'HJUHH 5HVLGXRVLW\
6LJQDO 3URFHVVLQJ (85$6,3 -RXUQDO RI &ODVVHV LQ 3URFHHGLQJV RI WKH WK
,QIRUPDWLRQ 6HFXULW\ YRO  QR  SS  ,QWHUQDWLRQDO &RQIHUHQFH RQ $GYDQFHV LQ
 &U\SWRJUDSK\3UDJXH&]HFK5HSXEOLFSS
>@ *RHWKDOV%/DXU6/LSPDD+DQG0LHOONDLQHQ 
7 2Q 3ULYDWH 6FDODU 3URGXFW 3URWRFRO >@ 3HGHUVHQ 7 6DYDV ( DQG 6D\JLQ < 6HFUHW
&RPSXWDWLRQ IRU 3ULYDF\3UHVHUYLQJ 'DWD 6KDULQJ YV  (QFU\SWLRQ(QVHPEOHG 7HFKQLTXHV
0LQLQJLQ3URFHHGLQJVRI,QIRUPDWLRQ6HFXULW\ IRU 3ULYDF\3UHVHUYLQJ 'DWD 0LQLQJ LQ
DQG&U\SWRORJ\,&,6&SS 3URFHHGLQJV RI -RLQW 81(&((XURVWDW :RUN
>@ *ROGUHLFK 2 )RXQGDWLRQV RI &U\SWRJUDSK\ 6HVVLRQ RQ 6WDWLVWLFDO 'DWD &RQILGHQWLDOLW\
'UDIW RI D &KDSWHU RQ *HQHUDO    3URWRFROV WKH 0DQFKHVWHU8.SS
3UHVV 6\QGLFDWH RI WKH 8QLYHUVLW\ RI &DPEULGJH >@ 4XLQODQ - ,QWURGXFWLRQ RI 'HFLVLRQ 7UHHV
 0DFKLQH /HDUQLQJ YRO  QR  SS 
>@ *ROGUHLFK20LFDOL6DQG:LJGHUVRQ$+RZ 
WR 3OD\ DQ\ 0HQWDO *DPHD &RPSOHWHQHVV >@ 6DNXPD - DQG .RED\DVKL 6 /DUJH6FDOH .
7KHRUHPIRU3URWRFROVZLWK+RQHVW0DMRULW\LQ 0HDQV &OXVWHULQJ ZLWK 8VHU&HQWULF 3ULYDF\
3URFHHGLQJV RI WK $&0 6\PSRVLXP RI WKH 3UHVHUYDWLRQ LQ 3URFHHGLQJV RI $GYDQFHV LQ
7KHRU\RI&RPSXWLQJ1HZ<RUN86$SS .QRZOHGJH 'LVFRYHU\ DQG'DWD0LQLQJ %HUOLQ
 SS
>@ -DJDQQDWKDQ * DQG :ULJKW 5 3ULYDF\ >@ 6DPHW 6 0LUL $ DQG 2UR]FR%DUERVD /
3UHVHUYLQJ 'LVWULEXWHG .0HDQV &OXVWHULQJ RYHU 3ULYDF\ 3UHVHUYLQJ .0HDQV &OXVWHULQJ LQ
$UELWUDULO\ 3DUWLWLRQHG 'DWD LQ 3URFHHGLQJV RI 0XOWL 3DUW\ (QYLURQPHQW LQ 3URFHHGLQJV RI
WKHWK$&06,*.'',QWHUQDWLRQDO&RQIHUHQFH ,QWHUQDWLRQDO &RQIHUHQFH RQ 6HFXULW\ DQG
&KLFDJR86$SS &U\SWRJUDSK\ %DUFHORQD 6SDLQ SS 
>@ -DLQ $ 0XUW\ 0 DQG )O\QQ 3 'DWD 
&OXVWHULQJ$5HYLHZ$&0&RPSXWLQJ6XUYH\V >@ 6KDPLU $ +RZ WR 6KDUH D 6HFUHW
YROQRSS &RPPXQLFDWLRQVRIWKH$&0YROQRSS
>@ -KD 6 .UXJHU / DQG 0F'DQLHO 3 3ULYDF\ 
3UHVHUYLQJ &OXVWHULQJ LQ 3URFHHGLQJV RI >@ 6X & %DR ) =KRX - 7DNDJL 7 DQG 6DNXUDL
(XURSHDQ6\PSRVLXPRQ5HVHDUFKLQ&RPSXWHU .  3ULYDF\3UHVHUYLQJ 7ZR 3DUW\ .0HDQV
6HFXULW\SS &OXVWHULQJ 9LD 6HFXUH $SSUR[LPDWLRQ LQ
>@ .DQWDUFLRJOX 0 DQG &OLIWRQ & 3ULYDF\ 3URFHHGLQJV RI WKH VW ,QWHUQDWLRQDO
3UHVHUYLQJ 'LVWULEXWHG 0LQLQJ RI $VVRFLDWLRQ &RQIHUHQFH RQ $GYDQFHG ,QIRUPDWLRQ
5XOHV RQ +RUL]RQWDOO\ 3DUWLWLRQHG 'DWD ,((( 1HWZRUNLQJ  DQG $SSOLFDWLRQV :RUNVKRSV
7UDQVDFWLRQV RQ .QRZOHGJH DQG 'DWD 2DQWDULR&DQDGDSS
(QJLQHHULQJ -RXUQDO YRO  QR  SS  >@ 6X & %DR ) =KRX - 7DNDJL 7 DQG 6DNXUDL
 . 6HFXULW\ DQG &RUUHFWQHVV $QDO\VLV RQ
>@ .LOW](/HDQGHU*DQG0DORQH/HH-6HFXUH 3ULYDF\3UHVHUYLQJ .0HDQV &OXVWHULQJ
&RPSXWDWLRQ RI WKH 0HDQ DQG 5HODWHG 6KHPHV ,(,&( 75$16$&7,216 RQ
6WDWLVWLFV LQ 3URFHHGLQJV RI 7KHRU\ RI (OHFWURQLFV &RPPXQLFDWLRQ DQG &RPSXWHU
&U\SWRJUDK\&RQIHUHQFHSS 6FLHQFHV-RXUQDOYROQRSS
>@ .RZDOF]\N:DQG9ODVVLV11HZFDVW(0LQ 
3URFHHGLQJV RI WKH WK $QQXDO &RQIHUHQFH RQ >@ 9DLG\D - $ 6XUYH\ RI 3ULYDF\3UHVHUYLQJ
1HXUDO ,QIRUPDWLRQ 3URFHVVLQJ 6\VWHPV 0HWKRGV DFURVV 9HUWLFDOO\ 3DUWLWLRQHG 'DWD LQ
:KLVWHOHU%&&DQDGDSS 3URFHHGLQJVRI3ULYDF\3UHVHUYLQJ'DWD0LQLQJ
>@ /LQGHOO < DQG 3LQNDV % 3ULYDF\3UHVHUYLQJ DQG$OJRULWKPV%RRNSS
'DWD 0LQLQJ LQ 3URFHHGLQJV RI $GYDQFHV LQ >@ 9DLG\D - DQG  &OLIWRQ & 3ULYDF\3UHVHUYLQJ
&U\SWRJUDSK\SS .0HDQV &OXVWHULQJ 2YHU 9HUWLFDOO\ 3DUWLWLRQHG
>@ 0DF4XHHQ - 6RPH 0HWKRGV IRU &ODVVLILFDWLRQ 'DWD LQ 3URFHHGLQJV RI WKH WK $&0 6,*.''
DQG $QDO\VLV RI 0XOWLYDULDWH 2EVHUYDWLRQV LQ ,QWHUQDWLRQDO &RQIHUHQFH RQ .QRZOHGJH
3URFHHGLQJV RI WK %HUNOH\ 6\PSRVLXP 0DWK GLVFRYHU\ DQG 'DWD 0LQLQJ :DVKLQJWRQ 86$
6WDWLVWLFV DQG 3UREDELOLW\ &DOLIRUQLD 86$ SS SS
 >@ 9HU\NLRV9%HUWLQR()RYLQR,3URYHQ]D/
>@ 1DRU 0 DQG 3LQNDV % 2EOLYLRXV7UDQVIHU DQG 6D\JLQ<DQG7KHRGRULGLV<6WDWHRIWKH$UW
3RO\QRPLDO (YDOXDWLRQ LQ 3URFHHGLQJV RI WKH LQ 3ULYDF\ 3UHVHUYLQJ 'DWD 0LQLQJ ,Q $&0
7KH,QWHUQDWLRQDO$UDE-RXUQDORI,QIRUPDWLRQ7HFKQRORJ\9RO1R0DUFK

6,*02'5HFRUGYROQRSS
>@ <DR $ +RZ WR *HQHUDWH DQG ([FKDQJH
6HFUHWV LQ 3URFHHGLQJV RI WKH WK ,(((
6\PSRVLXPRQ)RXQGDWLRQVRI&RPSXWHU6FLHQFH
7RURQWR&DQDGDSS

)DWLPD0HVNLQHLVDGRFWRUDOVWXGHQW
DW WKH GHSDUWPHQW RI FRPSXWHU
VFLHQFH IDFXOW\ DW WKH 8QLYHUVLW\ RI
2UDQ DQG D PHPEHU RI LQIRUPDWLRQ
DQG LQIRUPDWLRQ WHFKQRORJ\
ODERUDWRU\RI2UDQ/,7,2DSSURYHG
LQ  6KH LV DOVR WKH HQJLQHHU RI
WKHFRPSXWHUVFLHQFHFHQWHUDW0RVWDJDQHP8QLYHULVW\

6DILD1DLW%DKORXOLVDOHFWXUHUDWWKH
&RPSXWHU 6FLHQFH 'HSDUWPHQW
6FLHQFH )DFXOW\ DW WKH 8QLYHUVLW\ RI
2UDQ (V6HQLD6KH REWDLQHG DIWHU
VHYHUDO VFLHQWLILF VWD\V LQ &1$0 RI
3DULV DQG /,5,6 /DERUDWRU\ WKH
8QLYHUVLW\ RI &ODXGH %HUQDUG 
/\RQ KHU 3K' GHJUHH DW WKH 8QLYHUVLW\ RI 2UDQ LQ
6KHLVDPHPEHURI,QIRUPDWLRQDQG,QIRUPDWLRQ
7HFKQRORJ\ /DERUDWRU\ RI2UDQ /,7,2 ZKLFK LV
DSSURYHG LQ  6LQFH  VKH KDV EHHQ OHDGLQJ D
WHDP RQ WKH7RSLF RI 'DWD (QJLQHHULQJ DQG :HE
7HFKQRORJ\+HU UHVHDUFKFRYHUV DGYDQFHG DVSHFWV RI
GDWDEDVHV ZHE WHFKQRORJ\ DQGXQVXSHUYLVHG
FODVVLILFDWLRQ+HU ZRUNV KDYH EHHQSXEOLVKHG LQ
VHYHUDOLQWHUQDWLRQDOMRXUQDOVDQGFRQIHUHQFHV