Ordinal Regression - Extreme Learning Machine Based Apple Grading Method
Ordinal Regression - Extreme Learning Machine Based Apple Grading Method
EDVHG$SSOH*UDGLQJ0HWKRG
;LQKXD4X/L\DR0D7DR6KHQ;L+DQ;XHKXD<DQ6KXKXL%L
6FKRRORI(OHFWULFDO(QJLQHHULQJ8QLYHUVLW\RI-LQDQ-LQDQ&KLQD
+,75RERW*URXS&R/WG+DUELQ&KLQD
%HLMLQJ:HLFKXDQJ\LQJWX7HFKQRORJ\&R/WG%HLMLQJ&KLQD
FVHBELVK#XMQHGXFQ
TX[LQKXD#FRP
$EVWUDFW²,Q YLHZ RI WKH IDFW WKDW WKH WUDGLWLRQDO DSSOH VSHFWURPHWHUWRGHWHFWWKHHIIHFWLYHDFLGLW\RIDSSOHVZKLFK
TXDOLW\JUDGLQJZLWKRXWPDNLQJIXOOXVHRIWKHRUGLQDOFODVVODEHO FDQPHHWWKHGHWHUPLQDWLRQRIWKHTXDOLW\RI5HG)XMLDSSOHV
LQIRUPDWLRQEHWZHHQDSSOHTXDOLW\JUDGHV,QRUGHUWRLPSURYH LQGLIIHUHQWVWRUDJHSHULRGV=KXDQZHL:DQJHWDO>@GHWHFWHG
WKHSUHGLFWLRQDFFXUDF\RIWKHQHDULQIUDUHGWHFKQLFDOJUDGLQJ WKHLQWHUQDOTXDOLW\RIDSSOHVDWWKHODWHUVWDJHRIGHYHORSPHQW
PRGHO WKLV SDSHU DSSOLHV D FRPELQDWLRQ RI RUGLQDO UHJUHVVLRQ
2022 China Automation Congress (CAC) | 978-1-6654-6533-5/22/$31.00 ©2022 IEEE | DOI: 10.1109/CAC57257.2022.10054740
EDVHGRQQHDULQIUDUHGVSHFWURVFRS\DQGSUHGLFWHGWKHVXJDU
DQG DQ H[WUHPH OHDUQLQJ PDFKLQH WR DSSOH JUDGLQJ ,Q WKLV DFLGLW\DQGZDWHUFRQWHQWRIDSSOHV6KLIDQJ:DQJHWDO>@
SDSHU<DQWDL5HG)XMLDSSOHVZHUHFODVVLILHGLQWRWKUHHFODVVHV SURSRVHGDPHWKRGRIDSSOHTXDOLW\GHWHFWLRQPRGHOWUDQVIHU
DFFRUGLQJWRWKHLUTXDOLW\DQGDSSOLHGWRWKHRUGLQDOUHJUHVVLRQ FODVVLILFDWLRQ DQG JUDGLQJ DQG RQOLQH GHWHFWLRQ V\VWHP QHDU
H[WUHPH OHDUQLQJ PDFKLQH PRGHO )LUVWO\ D QHDULQIUDUHG
LQIUDUHG VSHFWURVFRS\ ;LQOHL &DR HW DO >@ EDVHG RQ
VSHFWUDO GHWHFWRU LV XVHG WR GHWHFW WKH VSHFWUDO LQIRUPDWLRQ RI
DSSOHVDQGWKHVSHFWUDOIHDWXUHLQIRUPDWLRQLVH[WUDFWHGXVLQJ
VSHFWURPHWHU YLVLEOH OLJKW DQG GDWD UHJUHVVLRQ DQDO\VLV DQ
SULQFLSDO FRPSRQHQW DQDO\VLV DQG PDKDODQRELV GLVWDQFH H[SHULPHQWDOOLJKWSDWKWRDQDO\]HWKHVXJDUFRQWHQWRIDSSOH
PHWKRG 6HFRQGO\ WKH VROXEOH VROLG FRQWHQW RI DSSOHV ZDV 0 9DQ 'DHO HW DO >@ SURSRVHG GHQVLW\ JUDGLHQW PHWKRG
GHWHFWHG XVLQJ D VXJDU PHWHU DQG DSSOHV ZHUH FODVVLILHG LQWR FRPELQLQJ;UD\DQG'VKDSHUHFRJQLWLRQDQGPRGHOLQJIRU
FODVVHVEDVHGRQWKHVROXEOHVROLGFRQWHQWYDOXHV7KHH[WUDFWHG DSSOH TXDOLW\ JUDGLQJ <RJHVK HW DO >@ SURSRVHG D QRQ
VSHFWUDOLQIRUPDWLRQDQGWKHUDQNODEHOVRIDSSOHFODVVLILFDWLRQ GHVWUXFWLYHGHWHFWLRQWHFKQRORJ\WKHUPDOLPDJLQJWRGHWHFWWKH
ZHUHXVHGDVVDPSOHLQIRUPDWLRQLQSXWDQGWKHRUGHUHGODEHOV LQWHUQDODQGH[WHUQDOFKDUDFWHULVWLFVRIIUXLWV;XHMXQ/LHWDO
RI DSSOH FODVVLILFDWLRQ UDQNV ZHUH XVHG DV SUHGLFWLRQ UHVXOWV >@DFFRUGLQJWRWKHFODVVLILFDWLRQRIIUXLWGLDPHWHUGHIHFWDUHD
RXWSXW 7KH UHVXOWV VKRZHG WKDW WKH JUDGLQJ DFFXUDF\ RI WKH DQGFRORUWKHNHUQHOSULQFLSDOFRPSRQHQWDQDO\VLVPHWKRGWR
RUGLQDOUHJUHVVLRQH[WUHPHOHDUQLQJPDFKLQHPRGHOZDVKLJKHU UHGXFH WKH GLPHQVLRQ DQG DQ DSSOH FODVVLILFDWLRQ PHWKRG
WKDQ WKDW RI WKH WUDGLWLRQDO JUDGLQJ PRGHO DQG WKH JUDGLQJ GHFLVLRQ IXVLRQ RI GLVFULPLQDQW WUHH DQG LPSURYHG VXSSRUW
DFFXUDF\ UHDFKHG ZKLFK SURYLGHG D UHVHDUFK EDVLV IRU YHFWRU PDFKLQH ZDV SURSRVHG =H]H )DQ HW DO >@ EDVHG RQ
QRQGHVWUXFWLYHWHVWLQJDQGJUDGLQJRILQWHUQDOTXDOLW\RIDSSOHV FRQYROXWLRQQHXUDOQHWZRUNFRPELQHGZLWKGHHSOHDUQLQJDQG
WUDGLWLRQDO PHWKRGV D IUXLW GHWHFWLRQ DQG JUDGLQJ DOJRULWKP
.H\ZRUGV²DSSOH JUDGLQJ RUGLQDO UHJUHVVLRQ H[WUHPH FRPELQLQJFRORUDQGIUXLWGLDPHWHUIHDWXUHV+RZHYHUQRQH
OHDUQLQJPDFKLQHQHDULQIUDUHGVSHFWURVFRS\ RI WKH DERYH PHWKRGV PDNH XVH RI WKH RUGLQDO UHODWLRQVKLS
, ,1752'8&7,21 ZLWKLQWKHDSSOHJUDGHODEHOVWKHPVHOYHVDQGIDLOWRPDNHIXOO
XVH RI WKH VDPSOH LQIRUPDWLRQ IRU DSSOH JUDGH SUHGLFWLRQ
$SSOHSOD\VDQLPSRUWDQWUROHLQ&KLQD VIRUHLJQWUDGHRI 7KHUHIRUHWKLVVWXG\FRPELQHVRUGLQDOUHJUHVVLRQDQGH[WUHPH
DJULFXOWXUDOSURGXFWV,QUHFHQW\HDUVWKHDGYDQWDJHRI&KLQD V OHDUQLQJ PDFKLQH WR EXLOG D QHZ DSSOH JUDGLQJ SUHGLFWLRQ
DSSOH IRUHLJQ WUDGH KDV GHFOLQHG \HDU E\ \HDU 7KH H[SRUW PRGHOZKLFKILQDOO\LPSURYHVWKHDFFXUDF\RIDSSOHJUDGLQJ
PDUNHWLVFRQFHQWUDWHGWKHFRUHFRPSHWLWLYHQHVVRISURGXFWV SUHGLFWLRQ
LV SRRU DQG WKH EUDQG DGYDQWDJH LV ZHDN :LWK WKH VXGGHQ
HPHUJHQFH RI DSSOH LQGXVWU\ LQ RWKHU FRXQWULHV WKH SULFH 7KHVWUXFWXUHRIWKLVSDSHULVDVIROORZVWKHVHFRQGVHFWLRQ
DGYDQWDJHRI&KLQD VDSSOHH[SRUWZLOOEHGLIILFXOWWRVXVWDLQ LQWURGXFHVGDWDDFTXLVLWLRQDQGSUHWUHDWPHQW7KHWKLUGVHFWLRQ
,QYLHZRIWKHFXUUHQWSUREOHPVWKHPDLQUHDVRQLVWKHODFNRI ZHLQWURGXFHWKHSULQFLSOHRIWKHRUGLQDOUHJUHVVLRQH[WUHPH
DSSOHTXDOLW\JUDGLQJDQGVHOHFWLRQWHFKQRORJ\DQGHTXLSPHQW OHDUQLQJ PDFKLQH DOJRULWKP 7KH IRXUWK VHFWLRQ VKRZV WKH
WKHORZGHJUHHRIDXWRPDWLRQRISRVWKDUYHVWSURFHVVLQJDQG H[SHULPHQWDOUHVXOWVDQGFRPSDUHVWKHPZLWKWKHWUDGLWLRQDO
PRVWDSSOHVHQWHUWKHFRQVXPHUPDUNHWZLWKRXWSURFHVVLQJRU PRGHO7KHILIWKVHFWLRQLVWKHFRQFOXVLRQ
VLPSOH URXJK SURFHVVLQJ 7KH TXDOLW\ RI DSSOHV LV XQVWDEOH
ZKLFK JUHDWO\ UHGXFHV WKH PDUNHW FRPSHWLWLYHQHVV >@ 7KH ,, '$7$$&48,6,7,21$1'35(75($70(17
JUDGLQJDQGVRUWLQJWHFKQRORJ\RISRVWKDUYHVWDSSOHTXDOLW\ $ 'DWD$FTXLVLWLRQ
LVSDUWLFXODUO\ FULWLFDO7KURXJK DFFXUDWH SUHGLFWLRQRIDSSOH
1HDULQIUDUHG VSHFWURVFRS\ 1HDULQIUDUHG 6SHFWURVFRS\
FODVVLILFDWLRQ JUDGH JUDGLQJ RSWLPL]DWLRQ DQG JUDGLQJ
1,56 >@LVDGHWHFWLRQWHFKQRORJ\WKDWXVHVWKHDEVRUSWLRQ
SDFNDJLQJ &KLQD VDSSOH H[SRUW YROXPHDQGDYHUDJH H[SRUW
UHIOHFWLRQVFDWWHULQJWUDQVPLVVLRQDQGRWKHUFKDUDFWHULVWLFVRI
SULFHFDQEHLPSURYHG
QHDULQIUDUHG OLJKW RI VXEVWDQFHV WR FRQGXFW TXDQWLWDWLYH RU
$PRQJ WKH H[LVWLQJ DSSOH LQWHUQDO TXDOLW\ JUDGLQJ TXDOLWDWLYHDQDO\VLVRIWKHVDPSOHVWREHWHVWHG1,56LVQRZ
GHWHFWLRQ PHWKRGV WKH PRVW ZLGHO\ XVHG PHWKRG LV WKH RIWHQ XVHG WR GHWHUPLQH WKH VXJDU FRQWHQW RI IUXLWV 1,56
VSHFWUDO GHWHFWLRQ WHFKQRORJ\ ZKLFK XVHV WKH VSHFWUDO EHORQJVWRPROHFXODUVSHFWURVFRS\ZKLFKLVPDLQO\XVHGWR
LQIRUPDWLRQREWDLQHGIURPWKHDSSOH VDEVRUSWLRQVFDWWHULQJ GHWHFWWKH+JURXSLQWKHVXEVWDQFHFRQWDLQHGLQWKHVDPSOHWR
UHIOHFWLRQ DQG SURMHFWLRQ RI OLJKW WR FDUU\ RXW WKH EHWHVWHGVXFKDV&+2+HWF$QGILQDOO\JHWWKHLQWHUQDO
QRQGHVWUXFWLYHGHWHFWLRQRIWKHVXJDUFRQWHQWRIWKHLQWHUQDO LQIRUPDWLRQVXFKDVWKHFRPSRVLWLRQDQGPROHFXODUVWUXFWXUH
TXDOLW\RIWKHIUXLW,WKDVWKHFKDUDFWHULVWLFVRIIDVWGHWHFWLRQ RI WKH VDPSOH WR EH WHVWHG 'LIIXVH UHIOHFWLRQ LV D VSHFLDO
VSHHG VLPSOHRSHUDWLRQ KLJK DFFXUDF\ DQG QRQGHVWUXFWLYH PHWKRGZKLFKLQFOXGHVWKHFKDUDFWHULVWLFVRIWUDQVPLVVLRQDQG
%LQJ[LQ 6XQ HW DO >@ XVHG WKH QHDULQIUDUHG WUDQVPLVVLRQ UHIOHFWLRQ,WGRHVQRWQHHGDVSHFLDOOLJKWVRXUFHDQGFDQDOVR
6WDUWWKHHTXLSPHQWIRUSUHKHDWLQJ ܦܯൌ ඥሺܺ െ ܶሻ் ି ܦଵ ሺܺ െ ܶሻǡ ݅ ൌ ͳǡʹǡ ڮǡ ܰ ሺʹሻ
'LVWKHFRYDULDQFHPDWUL[RIWKHVDPSOHWREHWHVWHGDQG
7LVWKHPHDQYDOXHRIWKHVDPSOHGDWD
6FDQWKHHTXDWRULDOSRVLWLRQTXDGUDQW
UHVSHFWLYHO\ 7KHWKUHVKROGUDQJHLVREWDLQHGIURPIRUPXOD
തതതതത ߲݁ெ
ܦܯ ൌ ܦܯ ሺ͵ሻ
1HDULQIUDUHGVSHFWUDRIDSSOHVDPSOHV തതതതത
ܦܯLVWKHDYHUDJHYDOXHRIVDPSOHPDKDODQRELVGLVWDQFH
)LJ $SSOHQHDULQIUDUHGVSHFWUXPDFTXLVLWLRQSURFHVV ߲ ܦܯLVWKHVWDQGDUGGHYLDWLRQRIVDPSOHPDKDODQRELVGLVWDQFH
DQG H LV WKH SDUDPHWHU DGMXVWPHQW FRHIILFLHQW RI WKUHVKROG
% 'DWD3UHWUHDWPHQW UDQJH :KHQܦܯ െ ܦܯ തതതതത ߲݁ெ VDPSOH GDWD LV DEQRUPDO
3ULQFLSDO FRPSRQHQW DQDO\VLV 3&$ DQG PDKDODQRELV GXULQJܦܯ െ ܦܯ തതതതത ൏ ߲݁ெ LVDTXDOLILHGVDPSOH
GLVWDQFH 0' DUH PDLQO\ XVHG WR HOLPLQDWH DEQRUPDO 7KHFDOFXODWHGPDKDODQRELVGLVWDQFHWKUHVKROGLV
VDPSOHV>@ DQGWKHQXPEHURIDEQRUPDOSRLQWVLV
3ULQFLSDO FRPSRQHQW DQDO\VLV >@ LV WU\ WR FRPELQH WKH DVVKRZQLQ)LJ
RULJLQDO PDQ\ LQGLFDWRUV ZLWK FHUWDLQ UHOHYDQFH VXFK DV &
LQGLFDWRUV LQWR D QHZ VHW RI LQGHSHQGHQW FRPSUHKHQVLYH
LQGLFDWRUV WR UHSODFH WKH RULJLQDO LQGLFDWRUV 7KDW LV D IHZ
SULQFLSDOFRPSRQHQWVDUHGHULYHGIURPWKHRULJLQDOYDULDEOHV
VRWKDWWKH\UHWDLQDVPXFKLQIRUPDWLRQDVSRVVLEOHDERXWWKH
PDKDODQRELVGLVWDQFH
RULJLQDOYDULDEOHVDQGDUHQRWUHODWHGWRHDFKRWKHU
7KHPRVWFODVVLFZD\LVWRXVHWKHYDULDQFHRIܺଵ WKHILUVW
OLQHDU FRPELQDWLRQ VHOHFWHG WKDW LV WKH ILUVW FRPSUHKHQVLYH
LQGLFDWRU WRH[SUHVVWKDWLVWKHODUJHUWKHܸܽݎሺܺଵ ሻWKHPRUH
LQIRUPDWLRQ ܺଵ FRQWDLQV 7KHUHIRUH ܺଵ VHOHFWHG IURP DOO
OLQHDUFRPELQDWLRQVVKRXOGKDYHWKHODUJHVWYDULDQFHVRܺଵ LV
FDOOHG WKH ILUVW SULQFLSDO FRPSRQHQW ,I WKH ILUVW SULQFLSDO
FRPSRQHQWLVQRWHQRXJKWRUHSUHVHQWWKHLQIRUPDWLRQRIWKH
)LJ 0DKDODQRELVGLVWDQFHRIDSSOHVDPSOH
3508
$IWHU3&$0'SURFHVVLQJWKHDEQRUPDOVDPSOHVLQWKH E
GDWDDUHHOLPLQDWHG [ ω β W
ω β
,,, &216758&7,212)25',1$/5(*5(66,21(;75(0( ω/ βS
/($51,1*0$&+,1( E
ω
[ ω
β
β W
$ 2UGLQDO5HJUHVVLRQ ω/ β S
2UGLQDO UHJUHVVLRQ >@ LV D PRGHO WR VROYH WKH RUGHU
UHODWLRQVKLS EHWZHHQ FDWHJRULHV )RU H[DPSOH WKH RUGHU
͘͘͘
͘͘͘
UHODWLRQVKLSH[LVWVLQDSSOHTXDOLW\JUDGLQJ^VWJUDGHDSSOHӡ
͘͘͘
QGJUDGHDSSOHӡUGJUDGHDSSOH` ωQ E/ β/
,QDGGLWLRQWRWKHFODVVLILFDWLRQORVVWKHPRGHOVKRXOGDOVR
[Q ωQ β/ WS
ω Q/ β/S
FRQVLGHU WKHRUGHU UHODWLRQVKLS EHWZHHQGLIIHUHQW FDWHJRULHV
VRWKDWWKHORVVRIPLVMXGJPHQWFORVHUWRWKHUHDOODEHOUDQNLQJ ,QSXWOD\HU +LGGHQOD\HU 2XWSXWOD\HU
LV OHVV WKDQ WKH ORVV RI PLVMXGJPHQW IDU DZD\ IURP WKH UHDO
)LJ 6WUXFWXUHRIRUGLQDOUHJUHVVLRQH[WUHPHOHDUQLQJPDFKLQH
ODEHO)RUH[DPSOHDQDSSOHWKDWLVDFWXDOO\FODVVLILHGLVDVW
JUDGHDSSOHLVZURQJO\FODVVLILHGDVDQGJUDGHDSSOHRUDUG $VLQJOHKLGGHQOD\HUQHXUDOQHWZRUNZLWK/KLGGHQOD\HU
JUDGHDSSOH)URPWKHSHUVSHFWLYHRISUDFWLFDODSSOLFDWLRQWKH QRGHVFDQEHH[SUHVVHGDV
QGJUDGHDSSOHLVFORVHUWRWKHVWJUDGHDSSOHWKDQWKHUG
JUDGHIUXLWVRWKHLUFODVVLILFDWLRQORVVHVDUHGLIIHUHQW
,WFDQEHH[SUHVVHGDV
E /HDUQLQJ7KHUHFRGHGVDPSOHVDUHVHQWWRWKHRUGLQDO
UHJUHVVLRQH[WUHPHOHDUQLQJPDFKLQHIRUOHDUQLQJ ݃൫߱ଵ ݔଵ ܾଵ ൯ ݃ ڮ൫߱ ݔଵ ܾ ൯
F 3UHGLFWLRQ *LYHQ D QHZ VDPSOH WKH QHZ VDPSOH LV ܪൌ ڭ ڰ ڭ ሺሻ
SUHGLFWHG DFFRUGLQJ WR WKH ORVVEDVHG WKH RQH ZLWK WKH ݃൫߱ଵ ݔே ܾଵ ൯ ݃ ڮ൫߱ ݔே ܾ ൯
ேൈ
VPDOOHVW ORVVEDVHG IURP WKH UHDO WDJ LV VHOHFWHG DV WKH
்
SUHGLFWLRQWDJ ߚଵ ݐଵ ்
ߚൌ ڭ ǡ ܶൌ ڭ൩ ሺͺሻ
7KLVWLPHZHXVHDQRUGLQDOUHJUHVVLRQH[WUHPHOHDUQLQJ ்
PDFKLQHFODVVLILHU)RUHDFKVDPSOHYHFWRU[WKHRXWSXWYHFWRU ߚ ൈ ݐே ் ேൈ
WLVHQFRGHGDVSELWV ݐൌ ሺݐଵ ǡ ݐଶ ǡ ڮǡ ݐ ሻ,IWKHVDPSOHYHFWRU +LVWKHRXWSXWPDWUL[RIWKHKLGGHQOD\HUDQG7LVWKHUHDO
EHORQJVWRODEHONHQFRGHGRXWSXWYHFWRUDVW ODEHORIWKHWUDLQLQJGDWDPDWUL[
ZKHUHODEHONDQGLWVORZHURUGHUDUHHQFRGHGDV
DQGWKHUHPDLQLQJODEHOVDUHHQFRGHGDV7KHFRGLQJPDWUL[ 7KHDERYHHTXDWLRQFDQEHDEEUHYLDWHGDV
3RIWKHRUGLQDOUHJUHVVLRQH[WUHPHOHDUQLQJPDFKLQHLV ൈ ߚܪൌ ܶ ሺͻሻ
W\SH7KHQXPEHURIFRGLQJELWVORIWKHSURJUDPLVHTXDOWR
WKHUDQNSRIWKHPDWUL[7KHLWKURZUHSUHVHQWVWKHLWKUDQN 7KH NH\ WR 25(/0 LV WKDW WKH LQSXW ZHLJKW ߱ DUH
RIWKHRXWSXWFRGHYHFWRUDQGHDFKFROXPQUHSUHVHQWVWKDWDQ UDQGRPO\ DVVLJQHG UDWKHU WKDQ DGMXVWHG $IWHU WKH LQSXW
RXWSXWFRGHFRUUHVSRQGVWRDQRXWSXWQRGH ZHLJKWV߱ LVDOORFDWHGWKHRXWSXWZHLJKWߚVROYHE\XVLQJ
OHDVWVTXDUH
)RUሼሺݔ ǡ ݐ ሻሽே
ୀଵ ǡ ݔ ൌ ሾݔଵ ǡ ݔଶ ǡ ڮǡ ݔ ሿܴ߳ LVWKHLQSXW
RI DSSOH VDPSOH L FRPSRVHG RI Q VSHFWUDO FKDUDFWHULVWLF ߚ כൌ ܪା ܶ ሺͳͲሻ
SDUDPHWHUVݐ ൌ ሾݐଵ ǡ ݐଶ ǡ ڮǡ ݐ ሿLVWKHHQFRGLQJYHFWRUXVLQJ
2EWDLQHGDWWKLVWLPHߚ כWKHQRUPRILVWKHVPDOOHVWDQG
WKH SURSRVHG VLQJOH PXOWLRXWSXW HQFRGLQJ VFKHPH WKH WKH YDOXH LV XQLTXH ܪା LV WKH 0RRUH3HQURVH JHQHUDOL]HG
QXPEHURIDOOHQFRGLQJSELWVLVHTXDOWRWKHQXPEHURIDSSOH LQYHUVHRIPDWUL[ܪ
JUDGHV7KHVWUXFWXUHRI25(/0LVVKRZQLQ)LJ
3509
7KH RUGLQDO UHJUHVVLRQ FRGLQJ PDWUL[ UHSUHVHQWV WKH
FDWHJRU\LQIRUPDWLRQDVDELQDU\FRGH PDWUL[ZKLFK
WUDQVIRUPV PXOWLSOH FDWHJRU\ SUREOHPV LQWR PXOWLSOH ELQDU\
FODVVLILFDWLRQ SUREOHPV ZKHUH DQG UHSUHVHQW WZR
GLIIHUHQWFDWHJRULHVUHVSHFWLYHO\
,Q WKH RUGLQDO UHJUHVVLRQ SUREOHP WKH XVH RI RUGLQDO
UHJUHVVLRQ FRGLQJ LV GLIIHUHQW IURP FRPPRQ PXOWLSOH
FODVVLILFDWLRQ FRGLQJ 7KH FRPPRQ PXOWLSOH FDWHJRU\ FRGH
GRHVQRWVKRZWKHRUGHULQIRUPDWLRQRIWKHODEHO6SHFLILFDOO\
LWRQO\PDUNVRQHFROXPQRIWKHFDWHJRU\DVDQGWKHRWKHU
FROXPQVDUHE\GHIDXOW7KHFRGLQJVWUDWHJ\XVHGLQWKH
VLQJOHPXOWLRXWSXWRUGLQDOUHJUHVVLRQPDUNVWKHFRGLQJELWVRI
WKHFDWHJRU\DQGLWVORZHURUGHUWKDQWKHFDWHJRU\DVDQG
WKHRWKHUVDV7DNHWKHWKUHHFDWHJRULHVDVDQH[DPSOHDV
VKRZQ LQ 7$%/( ,, ,W VKRZV WKH FRPSDULVRQ EHWZHHQ
FRPPRQPXOWLSOHFODVVLILFDWLRQFRGLQJDQGRUGLQDOUHJUHVVLRQ
FRGLQJ 7KH URZ VKRZV WKH ODEHO FDWHJRU\ DQG WKH FROXPQ
)LJ &ODVVLILFDWLRQDFFXUDF\RIH[WUHPHOHDUQLQJPDFKLQH
VKRZV WKH FRGH RIWKHFRGLQJ ELW FRUUHVSRQGLQJ WR GLIIHUHQW
FDWHJRULHV
7$%/(,, &203$5,621%(7:((1&2002108/7,3/(
&/$66,),&$7,21&2',1*$1'25',1$/5(*5(66,21&2',1*
&RPPRQPXOWLSOH 2UGLQDOUHJUHVVLRQ
FODVVLILFDWLRQFRGLQJ FRGLQJ
7HVWVHWVDPSOHFDWHJRU\
/DEHO
FDWHJRU\ &RGLQJELWV &RGLQJELWV
ଵ ଶ ଷ ଵ ଶ ଷ
,9 $33/(*5$',1*(;3(5,0(172)25',1$/5(*5(66,21
(;75(0(/($51,1*0$&+,1(
7RFUHDWHDQRUGLQDOUHJUHVVLRQH[WUHPHOHDUQLQJPDFKLQH
PRGHOILUVWVHWXSWKHPRGHOQHWZRUNVWUXFWXUHSDUDPHWHUVIRU
PRGHOLQJDQGWUDLQLQJ)LQDOO\WKHWUDLQHGPRGHOZDVXVHGWR )LJ &ODVVLILFDWLRQDFFXUDF\RIRUGLQDOUHJUHVVLRQH[WUHPHOHDUQLQJ
SUHGLFW WKH TXDOLW\ FODVVLILFDWLRQ RI DSSOH FKDUDFWHULVWLF PDFKLQH
SDUDPHWHUV
,Q)LJ7KHDEVFLVVDUHSUHVHQWVWKHDSSOHVDPSOHQXPEHU
)LUVWO\VHWWKHQHXURQRIWKHKLGGHQOD\HUWRDQGWKH
RIWKHWHVWVHWWKHUHDUHVDPSOHVLQWKLVWHVWVHW7KHRUGLQDWH
SULYILWIXQFWLRQXVHVWKHGDWDLQWKHWUDLQLQJVHWWRGHWHUPLQH
UHSUHVHQWV WKH DSSOH FDWHJRU\ SUHGLFWHG E\ WKH WHVW VHW 7KH
VRPHSDUDPHWHUVRIWKHDOJRULWKPDQGWKHLQSXWZHLJKWUDQJH
EOXHFLUFOHUHSUHVHQWVWKHUHDOODEHORIDSSOHJUDGLQJDQGWKH
7KHQLQSXWWKHVSHFWUDOFKDUDFWHULVWLFSDUDPHWHUVH[WUDFWHGE\
UHGDVWHULVNUHSUHVHQWVWKHIRUHFDVWODEHORIDSSOHJUDGLQJ:H
SULQFLSDOFRPSRQHQWDQDO\VLVPDKDODQRELVGLVWDQFH&RPSXWH
FDQ VHH WKDW WKH SUHGLFWLRQ UDWH RI WKH RUGLQDO UHJUHVVLRQ
WKH KLGGHQ OD\HU QHXURQ RXWSXW PDWUL[ DQG XVH VLJPRLG
H[WUHPHOHDUQLQJPDFKLQHPRGHOLQDSSOHJUDGLQJLV
IXQFWLRQ WR REWDLQ FRQWLQXRXV RXWSXW 7KH KDUGOLP IXQFWLRQ
WKH FRLQFLGHQFH UDWH LV KLJK DQG WKH SUHGLFWLRQ DFFXUDF\ LV
UHWXUQVWKHRXWSXWYHFWRUPDWUL[7RIWKHOD\HUJLYHQWKHLQSXW
H[FHOOHQW
YHFWRUPDWUL[;RIWKHQHWZRUN7KHUHWXUQYDOXHLVZKHQWKH
HOHPHQWLQ;LVJUHDWHUWKDQRUHTXDOWR]HURRWKHUZLVHLWLV 9 &21&/86,21
3HUIRUPKLGGHQQRGHRXWSXWFDOFXODWHRXWSXWZHLJKWV3UHGLFW
WKHUDQNRIWKHWHVWVHWODEHOVDQGWKHREMHFWVQHHGWRPDWFK 7KHUHVHDUFKREMHFWRIWKLVSDSHULV<DQWDL5HG)XMLDSSOH
WKHGDWDEHLQJWHVWHG2XWSXWWKHWHVWVHWWKHSXUSRVHRIODEHO %\XVLQJQHDULQIUDUHGVSHFWURVFRS\DQGSULQFLSDOFRPSRQHQW
WRRUHOPLVWRWXUQWKHVDPSOHOHYHOODEHOVLQWRRUGHUDQGZLOO DQDO\VLVPDKDODQRELVGLVWDQFHPHWKRGIRUGDWDDFTXLVLWLRQDQG
UHWXUQWKHWUDLQLQJDQGWHVWVHWGDWD SUHSURFHVVLQJDKLHUDUFKLFDOSUHGLFWLRQPRGHOEDVHGRQDSSOH
VROXEOHVROLGFRQWHQWZDVHVWDEOLVKHG7KURXJKWKHDQDO\VLVRI
$IWHU PDQ\ VLPXODWLRQ H[SHULPHQWV WKH SUHGLFWLRQ WKHPRGHOLQJUHVXOWVLWLVFRQFOXGHGWKDW
DFFXUDF\RIDSSOHJUDGLQJPRGHORIRUGLQDOUHJUHVVLRQH[WUHPH
OHDUQLQJPDFKLQHLVEHWWHUWKDQWKDWRIDSSOHJUDGLQJPRGHORI 3&$0'FDQHIIHFWLYHO\UHPRYHDEQRUPDOVDPSOHVIURP
H[WUHPHOHDUQLQJPDFKLQH7KHSUHGLFWLRQDFFXUDF\RIDSSOH WKHFROOHFWHGQHDULQIUDUHGVSHFWUDOLQIRUPDWLRQ
JUDGLQJPRGHORIH[WUHPHOHDUQLQJPDFKLQHLVDQGWKH 8VLQJ WKH RUGLQDO UHJUHVVLRQ H[WUHPH OHDUQLQJ PDFKLQH
UHVXOW WUDFNLQJ GLDJUDP LV VKRZQ LQ )LJ 7KH SUHGLFWLRQ PRGHO WR SUHGLFW WKH DSSOH TXDOLW\ WKH RXWSXW UHVXOW LV WKH
DFFXUDF\RIDSSOHJUDGLQJPRGHORIRUGLQDOUHJUHVVLRQH[WUHPH RUGHUHG ODEHO LQIRUPDWLRQ ZKLFK FDQ EH IRXQG WR EH PRUH
OHDUQLQJPDFKLQHLVXSWR7KHUHVXOWWUDFNLQJGLDJUDP VWDEOH DQG HIILFLHQW %HFDXVH WKH LQSXW ZHLJKW PDWUL[ LV
LVVKRZQLQ)LJ UDQGRPO\JHQHUDWHGRQO\WKHQXPEHURIKLGGHQOD\HUVQHHGV
WREHLQSXWWRREWDLQDUHOLDEOHRSWLPDOVROXWLRQ,WLVSURYHGE\
3510
H[SHULPHQWVWKDWVHOHFWLQJDSSURSULDWHPHWKRGVIRUSURFHVVLQJ >@ <RJHVK$.'XEH\DQG55$URUD$&RPSDUDWLYH$SSURDFKRI
WKHRULJLQDOVSHFWUDOGDWDFDQHIIHFWLYHO\LPSURYHWKHDFFXUDF\ 6HJPHQWDWLRQ0HWKRGV8VLQJ7KHUPDO,PDJHVRI$SSOH>&@SS
RI FODVVLILFDWLRQ 7KH RUGLQDO UHJUHVVLRQ H[WUHPH OHDUQLQJ
>@ ;XHMXQ /L +RQJ &KHQJ 5HVHDUFK RQ .H\ 7HFKQRORJLHV RI $SSOH
PDFKLQHPRGHOPDNHVIXOOXVHRIWKHLQKHUHQWRUGHUOLQHVVRI *UDGLQJ'HWHFWLRQ%DVHGRQ'HFLVLRQ)XVLRQ>-@)RRGDQGPDFKLQHU\
DSSOHTXDOLW\JUDGHVDQGLPSURYHVWKHSUHGLFWLRQDFFXUDF\RI YROQRSS
DSSOHJUDGLQJ >@ =H]H)DQ4LDQ/LX-LHZHL&KDL;LDRIHQJ<DQJ+DLIDQJ/L$SSOH
)UXLW 'HWHFWLRQ DQG *UDGLQJ %DVHG RQ &RORU DQG )UXLW 'LDPHWHU
9, $&.12:/('*0(17 &KDUDFWHULVWLFV>-@&RPSXWHUHQJLQHHULQJDQGVFLHQFHYROQR
SS
7KLV ZRUN LV VXSSRUWHG E\ WKH 6KDQGRQJ 3URYLQFLDO
1DWXUDO 6FLHQFH )RXQGDWLRQ =5.) >@ -LDQZHL:DQJ)HL7DR3URJUHVVLQWKH$SSOLFDWLRQRI1HDU,QIUDUHG
6SHFWURVFRS\ LQ WKH 'HWHFWLRQ RI $JULFXOWXUDO 3URGXFWV >-@ $QKXL
=50) 1DWLRQDO .H\ 3URJUDP RI &KLQD DJURQRP\EXOOHWLQYROQRSS
$$$ DQG6KDQGRQJ.H\5 '3URJUDPXQGHU >@ %LQ &KHQ ;LDQ\RQJ =RX :HQMLQJ =KX 3&$ &RPELQHG :LWK
*UDQW-==< 0DKDODQRELV 'LVWDQFH 0HWKRGWR (OLPLQDWH 1HDU ,QIUDUHG $EQRUPDO
6DPSOHV >-@ -RXUQDO RI -LDQJVX 8QLYHUVLW\ 1$785$/ 6&,(1&(
5()(5(1&(6 (',7,21 YROQRSS
>@ <XGRQJ&DR:HL\DQ4L;LDQ/L=KHPLQ/L5HVHDUFK3URJUHVVDQG >@ 6X]KL =KDQJ ;LDRQL &KHQ 'LPHQVLRQ 5HGXFWLRQ RI 3ULQFLSDO
3URVSHFWRI $SSOH1RQGHVWUXFWLYH7HVWLQJDQG4XDOLW\&ODVVLILFDWLRQ &RPSRQHQW $QDO\VLV 'DWD %DVHG RQ 0XWXDO ,QIRUPDWLRQ 5HOLDELOLW\
7HFKQRORJ\ >-@ 6PDUW DJULFXOWXUH YRO QR SS >-@ -RXUQDO RI +XEHL 8QLYHUVLW\ IRU 1DWLRQDOLWLHV 1DWXUDO 6FLHQFH
7UDIILF 6FLHQFH DQG (QJLQHHULQJ (GLWLRQ YRO QR SS (GLWLRQ YROQRSS
>@ ;LDRMXQ :DQJ )XMXQ 3HL +RQJ\XQ /LX $ 1HDUHVW 1HLJKERU 'DWD
>@ %LQJ[LQ6XQ/L[XH.XDQJ)DQJ[X;X<DQJ6X-LQJ=KDR;XTLDR $VVRFLDWLRQ$OJRULWKP%DVHGRQ,PSURYHG0DKDODQRELV'LVWDQFH>-@
)HQJ 1HDU ,QIUDUHG 1RQGHVWUXFWLYH 'HWHFWLRQ RI $SSOH (IIHFWLYH -RXUQDO RI QDYLJDWLRQ DQG SRVLWLRQLQJ YRO QR SS
$FLGLW\>-@)RRGLQGXVWU\VFLHQFHDQGWHFKQRORJ\YROQRSS
>@ *XWLHUUH]3HGUR$QWRQLR3HUH]2UWL]0DULD6DQFKH]0RQHGHUR-HW
>@ =KXDQZHL :DQJ 4LDQ &KL :HQFKXDQ *XR &KXQMLDQJ =KDR DO2UGLQDO5HJUHVVLRQ0HWKRGV6XUYH\DQG([SHULPHQWDO6WXG\>-@
'HWHFWLRQRI$SSOH,QWHUQDO4XDOLW\LQ/DWH'HYHORSPHQW6WDJH%DVHG ,(((7UDQVDFWLRQVRQ.QRZOHGJH 'DWD(QJLQHHULQJYROQR
RQ1HDU,QIUDUHG6SHFWURVFRS\>-@-RXUQDORIDJULFXOWXUDOPDFKLQHU\ SS
YROQRSS >@ +DR\L6XQ&KXDQPHL:DQJ<LPLQJ'LQJ2SWLPL]DWLRQRI([WUHPH
>@ 6KLIDQJ:DQJ*XDQJOX&XL;LDR\XDQ)HQJ3LQJ+DQ$SSOLFDWLRQ /HDUQLQJ0DFKLQH$OJRULWKP%DVHGRQ+LGGHQ/D\HU2XWSXW0DWUL[
3URJUHVVRI1HDU,QIUDUHG6SHFWURVFRS\LQ$SSOH4XDOLW\'HWHFWLRQ>-@ >-@&RPSXWHUDSSOLFDWLRQVYROQRSS
-RXUQDORIIRRGVDIHW\DQGTXDOLW\LQVSHFWLRQYROQRSS >@ 3HLMLD /L <RQJ 6KL +XDGRQJ :DQJ /LQJIHQJ 1LX 6HTXHQWLDO
5HJUHVVLRQ 0RGHO RI .HUQHO ([WUHPH /HDUQLQJ %DVHG RQ 2UGHUHG
>@ ;LQOHL &DR 4L &KHQ ;LDQJWLQJ 'X ([SHULPHQW RI $SSOH 6XJDU &RGLQJ>-@-RXUQDORIHOHFWURQLFVDQGLQIRUPDWLRQYROQRSS
&RQWHQW 'HWHFWLRQ %DVHG RQ 9LVLEOH /LJKW 5HJUHVVLRQ $QDO\VLV >-@
0RGHUQLQIRUPDWLRQWHFKQRORJ\YROQRSS >@ 5LFFDUGL$)HUQiQGH]1DYDUUR)&DUORQL6&RVW6HQVLWLYH$GD%RRVW
>@ 0 YDQ 'DHO 3 9HUERYHQ$ =DQHOOD - 6LMEHUV % 1LFRODL $OJRULWKP IRU 2UGLQDO 5HJUHVVLRQ %DVHG RQ ([WUHPH /HDUQLQJ
&RPELQDWLRQRI6KDSHDQG;UD\,QVSHFWLRQIRU$SSOH,QWHUQDO4XDOLW\ 0DFKLQH >-@ ,((( WUDQVDFWLRQV RQ F\EHUQHWLFV YRO QR SS
&RQWURO LQ VLOLFR DQDO\VLV RI WKH PHWKRGRORJ\ EDVHG RQ ;UD\
FRPSXWHGWRPRJUDSK\>-@3RVWKDUYHVW%LRORJ\DQG7HFKQRORJ\YRO >@ :< 'HQJ 4+ =KHQJ 6 /LDQ/ &KHQ DQG ; :DQJ 2UGLQDO
SS H[WUHPHOHDUQLQJPDFKLQH>-@1HXURFRPSXWLQJYROQR±SS
±
3511