Next Word Prediction Using Deep Learning A Comparative Study
Next Word Prediction Using Deep Learning A Comparative Study
2022 12th International Conference on Cloud Computing, Data Science & Engineering (Confluence) | 978-1-6654-3701-1/22/$31.00 ©2022 IEEE | DOI: 10.1109/Confluence52989.2022.9734151
$&RPSDUDWLYH6WXG\
0LOLQG6RDP 'U6DQMHHY7KDNXU
'HSDUWPHQWRI&RPSXWHU6FLHQFHDQG(QJLQHHULQJ 'HSDUWPHQWRI&RPSXWHU6FLHQFHDQG(QJLQHHULQJ
$PLW\8QLYHUVLW\8WWDU3UDGHVK,QGLD $PLW\8QLYHUVLW\8WWDU3UDGHVK,QGLD
PLOLQGVRDP#VDPLW\HGX VWKDNXU#DPLW\HGX
$EVWUDFW 'HHS OHDUQLQJ LV D VXEFODVV RI PDFKLQH SUREOHPV WKHUHIRUH WKH GHHS OHDUQLQJ KDV DQ
OHDUQLQJLWPLPLFVWKHIXQFWLRQDOLW\RIWKHKXPDQEUDLQ LPSRUWDQW UROH WR SOD\ LQ PDFKLQH OHDUQLQJ DQG
WKHZD\LWSURFHVVHVDQGFUHDWHVSDWWHUQLQWKHIDFWVIRU DUWLILFLDO,QWHOOLJHQFH
FKRLFHPDNLQJ,WLVEDVLFDOO\DQ$,IXQFWLRQWKDWKDV 7KH QH[W ZRUG SUHGLFWLRQ RQ 0HGLXP $UWLFOHV
QHWZRUNVFDSDEOHRIOHDUQLQJXQVXSHUYLVHGGDWDWKDWLV
GDWDVHWLVDJRRGVWDUWLQJSURMHFWLQWKHILHOGRI1/3
VKDSHOHVV 7KH VXFFHHGLQJ ZRUG IRUHFDVW LVSHUIRUPHG
RQGDWDVHWFRQVLVWLQJRIWH[WV1H[W:RUG3UHGLFWLRQLV DQG GHHS OHDUQLQJ LQ WKH DUHD RI QH[W ZRUG
DQDSSOLFDWLRQRI1/31DWXUDO/DQJXDJH3URFHVVLQJ SUHGLFWLRQ
,WLVDOVRNQRZQDV/DQJXDJH0RGHOOLQJ%DVLFDOO\LWLV 1H[WZRUGSUHGLFWLRQLVDQLPSRUWDQWSDUWRIILQGLQJ
WKHSURFHVVRISUHGLFWLQJWKHQH[WZRUGLQDVHQWHQFH RUSUHGLFWLQJWKHUHYLHZVRUVHDUFKTXHU\RUVHDUFK
,WKDVPDQ\DSSOLFDWLRQVZKLFKDUHXVHGE\PRVWRIXV UHVXOWV IURP YLHZ SRLQW RI FXVWRPHUV RU ZRUNLQJ
VXFK DV DXWRFRUUHFW ZKLFK LV PRVWO\ XVHGLQ (PDLOV SHRSOHRULQWHUQHWXVHUVEDVHGRQWKHLUVHDUFKKLVWRU\
0HVVDJHVLWKDVDOVRLW¶VXVDJHLQ06:RUGRU JRRJOH W\SLQJKLVWRU\RUJOREDOO\XVHGZRUGVZLWKVSHFLILF
VHDUFK ZKHUH IRUHFDVWV WKH QH[W ZRUG EDVHG RQ RXU VHQWHQFH1H[WZRUGSUHGLFWLRQLVDWHFKQLTXHWKDWLV
VHDUFK KLVWRU\ RU WKH VHDUFK ZH GLG IRU JOREH,QWKLV
XVHGWRGHWHUPLQHRUSUHGLFWWKHQH[WZRUGVDQGWKH
ZRUN ZH KDYH VWXGLHG 1/3 GLIIHUHQW GHHS OHDUQLQJ
GDWDRYHUKHUHLVWKHPHGLXPDUWLFOHVGDWDVHW1H[W
WHFKQLTXHVVXFKDV/670%L/670DQGSHUIRUPHGD
FRPSDUDWLYH VWXG\:H IRXQG VDWLVIDFWRU\UHVXOWV LQ :RUG 3UHGFLWLRQ LV D QDWXUDO ODQJXDJH SURFHVVLQJ
%L/670DQG/670>@ WHFKQLTXH1H[WZRUGSUHGLFWLRQLVRIWHQSHUIRUPHG
RQWH[WXDOGDWDWKDWKHOSVSHRSOHWRDXWRFRPSOHWHRU
7KHDFFXUDF\UHFHLYHGXVLQJ%L/670DQG/670DUH H[SORUH RWKHU VHDUFK TXHULHV DQG RQ WKDW EDVLV
DQGUHVSHFWLYHO\ LPSURYH WKH VWDQGDUG RI TXDOLW\ RU WKH VWDQGDUG RI
.H\ZRUGV²'HHS/HDUQLQJ5HFXUUHQW1HXUDO1HWZRUN
VHUYLFHVWKDWLVJLYHQWRWKHFXVWRPHURUSHRSOHHLWKHU
/670%L/670
RQWKHZHERURQWKHSODWIRUPVRUDSSVWKDWVXSSRUW
QH[WZRUGSUHGLFWLRQWKHUHIRUHQH[WZRUGSUHGLFWLRQ
LQWRGD\
VZRUOGKDVDQLPSRUWDQWUROHWRSOD\DQGKDV
, ,1752'8&7,21 EHFRPHDQHVVHQWLDOWRRO
$UWLILFLDO 1HXUDO 1HWZRUNV DUH SDUW RI WKH GHHS
,, /,7(5$785(5(9,(95DGKLND
OHDUQLQJ WKDW DUH LQVSLUHG E\ WKH KXPDQ QHXURQV
%HFDXVHRI$11WKHUH ZHUHVLJQLILFDQWPLOHVWRQHV 6KDUPDHWDO>@XVHGGHHSOHDUQLQJPRGHOV
LQ DOO WKH ILHOGV UHVXOWLQJ LQ EULQJLQJ HYROXWLRQ WR LPSOHPHQWHGXVLQJ%L/VWPDQGOVWPWHFKQLTXH
WKRVH ILHOGV 7KHVH PLOHVWRQHV ZHUH DFKLHYHG 7KLVVWXG\IRFXVHVRQJHWWLQJDQRYHOPHWKRGIRU
EHFDXVH LWLVWKHEDFNERQHRIGHHSOHDUQLQJ WKHZRUGSUHGLFWLRQLQ+LQGL/DQJXDJH(DFKWH[W
'HHSOHDUQLQJLVDVXEVHWRIPDFKLQHOHDUQLQJDQGLW GDWDZRXOGEHFOHDQHGWKHQWKHGLFWLRQDU\RIXQLTXH
PLPLFVWKHIXQFWLRQDOLW\RIWKHKXPDQEUDLQWKHZD\ ZRUGVZRXOGEHFUHDWHGE\VSOLWWLQJWKHZRUGVLQ
LWSURFHVVHVWKHGDWDDQGFUHDWHVSDWWHUQIRUWKHXVH WKHGDWDVHWDQGILOWHUVRXWWKHXQLTXHZRUGV7KH
LQ GHFLVLRQ PDNLQJ ,W LV EDVLFDOO\ DQ $, IXQFWLRQ GDWDVHWXVHGIRUWKLVUHVHDUFKZDVGHYHORSHGE\,,7
WKDWKDVQHWZRUNVFDSDEOHRIOHDUQLQJXQVXSHUYLVHG %RPED\DWWKH,QGLDQ/DQJXDJH7HFKQRORJ\
GDWD WKDW LV XQVWUXFWXUHG RU XQODEHOOHG $UWLILFLDO FHQWHU>@7KHDFFXUDF\DFKLHYHGXVLQJERWK
QHXUDOQHWZRUNVDUHEDVLFDOO\WKHEDFNERQHRIGHHS
/670DQG%L/670LVDQG
OHDUQLQJ ZKLFK OHG WR WKH DFKLHYHPHQW RI ELJJHU
UHVSHFWLYHO\
PLOHVWRQHV LQ WKLV ILHOG RI PDFKLQH OHDUQLQJ ZKHUH
WKH\EURXJKWHYROXWLRQRQKRZWRDSSURDFKWKH =DELW +DPHHG HWDO>@ SUHVHQWV DQ HIILFLHQW GHHS
OHDUQLQJ PRGHO LQ WKHLU SDSHU ZKLFK DLPV DW WKH
FODVVLILFDWLRQRIELQDU\VHQWLPHQWVRQWKUHHGDWDVHWV
LQFOXGLQJ ,0'E 'DWDVHW WR FODVVLI\ WKH SRODULW\ RI
WKH VHQWLPHQWV WKDW DUH LQ WKH IRUP RI SHRSOHV
RSLQLRQVDWWLWXGHVDQGHPRWLRQVH[SUHVVHGLQZULWWHQ
WH[W WKLV SDSHU XVHV D ZRUG HPEHGGLQJ WHFKQLTXH
NQRZQDVJORYHYHFWRURIGLPHVQLRQV>@7KH
Authorized licensed use limited to: M/s Shanti Education Society. Downloaded on November 14,2022 at 17:00:13 UTC from IEEE Xplore. Restrictions apply.
GHHS OHDUQLQJ WHFKQLTXH XVHG KHUH LV ELGLUHFWLRQDO RIWKHFDSV%L/670WRWUDQVIRUPWKHLQVWDQFHWRKLGH
ORQJ VKRUW WHUP PHPRU\%L/670 ZLWK 5063URS YHFWRU 7KH PRGXOH WKHQ FRQVWUXFWV DQ QJUDP
RSWLPL]HU 7KH UHVXOWV ZDV WKDW %L/670 DFKLHYHG DQ PRGHO 7KH FDSVXOH PRGHO LV XVHG WR FDOFXODWH WKH
DFFXUDF\RIRQ,0'EGDWDVHW VWDWH SUREDELOLW\ RI D FHUWDLQ FDSVXOH $ KLJKHU
FRXSOLQJ FRHIILFLHQW LV DVVLJQHG LI DQ\ JLYHQ LQVWDQFH
6DLNLULQ *RJLQHQL HWDO>@ FDPH XS ZLWK DXWRPDWLF KDVDODUJH VWDWHSUREDELOLW\DPRQJRWKHUFDSVXOHV
WH[W FDWHJRUL]DWLRQ ZKLFK LV D NH\ WDVN LQ WRGD\
V 7KH RXWSXW RI FDSVXOH HQWHUV LQWR D %L/670
GLJLWDOHQYLURQPHQWIRUDQDO\VLQJRUFODVVLI\LQJWKH VWUXFWXUH WR IXVLRQ WKH GDWD IHDWXUHV 7KLV PRGHO
XVHU
V HYDOXDWLRQV DQG IHHOLQJV ZLWKRXW KXPDQ DFKLHYHGEHWWHUSHUIRUPDQFHWKDQWKH&11/670
LQWHUDFWLRQ ,W ZRXOG DVVLVW XVHUV LQ PDNLQJ EHWWHU DQG %L/670 PRGHO7KH DXWKRU XVHG *ORYH
PRYLHFKRLFHV7RPHDVXUHWKHHIIHFWLYHQHVVRIWKH (PEHGGLQJRIGLPHQVLRQ>@
PRGHOVWKHVWXG\HPSOR\VGLIIHUHQWPHWULFVVXFKDV
DFFXUDF\ SUHFLVLRQ UHFDOO 7KH DXWKRUV HPSOR\HG 0G5DNLEXO+DTXHHWDO>@SHUIRUPHGSHUIRUPDQFH
511VVXFKDV/6707ILGIDQG*58DVZHOODV DQDO\VLV RI GLIIHUHQW QHXUDO QHWZRUN RQ WKH ,0'E
:RUG9HF>@ IRU LPSURYHG ZRUG HPEHGGLQJ 'DWDVHW 7KH SHUIRUPDQFH ZDV EDVHG RQ GHHS
DSSURDFKHV 7KH HIILFLHQF\ RI WUDGLWLRQDO PDFKLQH OHDUQLQJ WHFKQLTXHV DV /670 &11 DQG D K\EULG
OHDUQLQJ DOJRULWKPV DQG GHHS OHDUQLQJ PRGHOV KDV PRGHO RI /670&11 7KH ZRUG HPEHGGLQJV WKDW
EHHQFRPSDUHGLQWKLVDUWLFOHDQGLPSURYHGPRGHOV ZDV XVHG ZDV SURYLGHG E\ .HUDV ZKLFK FRQWDLQV
RUHIILFLHQWDUFKLWHFWXUHKDVEHHQRIIHUHG XQLTXH ZRUGV 7KH UHVXOWV ZHUH /670 DQG
&11 DFKLHYHG DQ DFFXUDF\ RI DQG
2PRU )DUXN 5DNLE HWDO>@ SHUIRUPHG 1H[W ZRUG UHVSHFWLYHO\ 7KH K\EULG PRGHO DFKLHYHG DQ
3UHGLFWLRQ DQG VHQWHQFH SUHGLFWLRQ LQ %DQJOD DFFXUDF\ RI 7KH &11 RXWSHUIRUPHG WKHP
/DQJXDJH XVLQJ *58 RQ QJUDP GDWDVHW WR FUHDWH ERWK
VXFK PRGHOV 7KH ZRUN KDV EHHQ FRPSDUHG ZLWK
/670 PRGHO RQ QJUDP GDWDVHW DQG 1DwYH %D\HV 6DHHG 0LDQ 4DLVDU>@ GLG WKH VDPH ZRUN RI
ZLWK /DWHQW 6HPDQWLF DQDO\VLV 7KH GDWDVHW LV LQ SHUIRUPLQJVHQWLPHQWDQDO\VLVRQ,0'E'DWDVHWE\
%DQJOD /DQJXDJH JDWKHUHG IURP GLIIHUHQW VRXUFHV XVLQJ 511 'HHS /HDUQLQJ 7KH DQDO\VLV ZDV
DQGLVJDWKHUHGDURXQGWKRXVDQG7KHSURSRVHG SHUIRUPHG E\ XVLQJ /670 ZLWK 'RF9HF DQG
PRGHODFKLHYHGDQDFFXUDF\RIIRUJUDP DFKLHYHGDQDFFXUDF\RI
PRGHOIRUJUDPIRUWULJUDP
DQGIRUELJUDPDQGXQLJUDPPRGHOV ,,, 0(7+2'2/2*<
UHVSHFWLYHO\ $ 'DWDVHW
7KH'DWDVHWXVHGLVWKH0HGLXPDUWLFOHVGDWDVHW>@
<RXQJJL .LP HWDO>@ SDSHU RQ DQ DFWLYLW\ ZKLFKLVWKHODUJHVWGDWDVHWDYDLODEOHRQ0HGLXP
(PEHGGLQJDSSURDFKIRUQH[WDFWLYLW\SUHGLFWLRQLQ DUWLFOHV7KHGDWDVHWFRQWDLQVDUWLFOHV7KH
D PXOWLXVHU VPDUW VSDFH XVHG ZRUG HPEHGGLQJ GDWDVHWFDQEHDYDLODEOHIURP0HGLXPZHEVLWHRULW
DOJRULWKP WKDW PDSV ZRUGV WR YHFWRUV $IWHU WKH FDQEHGRZQORDGHGIURP.DJJOH>@7KHGDWDVHW
YHFWRUL]DWLRQLVSHUIRUPHGWKHVDPHLVWUDLQHGXVLQJ KDVEHHQWUDLQHGRQFDWHJRULFDOFURVVHQWURS\ORVV
/670 PRGHO WR SUHGLFW D VLQJOH YHFWRU FRRUGLQDWH DQGDGDPRSWLPL]HUZLWKDQDFWLYDWLRQIXQFWLRQVHW
IRUQH[WDFWLYLW\IURPDJURXSRISUHYLRXVO\RFFXUUHG RQVRIWPD[
DFWLYLWLHV 7KH DFFXUDF\ DFKLHYHG E\ WKLV PRGHO LV
% /RQJ6KRUW7HUP0HPRU\
-LQJ\XQ<DQJHW$O>@ZRUNHGRQQDWXUDOODQJXDJH /670LVDYHUVLRQRI511ZKLFKLVDVHTXHQWLDO
:RUG 3UHGLFWLRQ 0RGHO EDVHG RQ 0XOWL :LQGRZ QHWZRUNWKDWDOORZVLQIRUPDWLRQWREHSHUVLVWHQW,W
FRQYROXWLRQDQGUHVLGXDOQHWZRUNZKHUHWKHDXWKRUV VROYHVWKHSUREOHPRIYDQLVKLQJJUDGLHQWLQ511
SURSRVHG 0&115H0*8 PRGHO IRU QDWXUDO ZRUG %DVLFDOO\511LVXVHGIRUSHUVLVWHQWPHPRU\$V
SUHGLFWLRQV 7KH UHVXOWV ZHUH RXWSXW E\ XVLQJ WKH KXPDQVUHPHPEHUZKDWLVJRLQJWRKDSSHQIXUWKHU
DFWLYDWLRQ IXQFWLRQ 6RIWPD[ 7KH H[SHULPHQW ZDV ZKHQZDWFKLQJDYLGHRRUZKLOHUHDGLQJDERRN
SHUIRUPHG RQ 3HQQ 7UHHEDQN DQG :LNL7H[W WKH\NQRZZKDWZRXOGEHKDSSHQLQJIXUWKHU
GDWDVHWV 7KH EHVW UHVXOWV ZHUH REWDLQHG XVLQJ VLPLODUO\511VDOVRZRUNLQWKHVDPHZD\DQG
0&115H0*8 XVLQJ KLGGHQ XQLWV DQG UHPHPEHUWKHSUHYLRXVLQIRUPDWLRQWRXVHLWIRU
DFKLHYLQJDQDFFXUDF\RI SURFHVVLQJWKHFXUUHQWLQSXWWKHPDMRUGUDZEDFNRI
511LVWKDWEHFDXVHRIWKHYDQLVKLQJJUDGLHQWWKH\
<RQJIHQJ'RQJ HWDO>@ SDSHU LQWURGXFHG D FDSVXOH
QHWZRUNPRGHOQDPHGFDSVE\/670IRUVHQWLPHQW
DQDO\VLVRQ,0'EGDWDVHWDQGRWKHUGLIIHUHQWGDWD
VHWV$FRQYROXWLRQDOOD\HULVXVHGLQWKHEHJLQQLQJ
654 12th International Conference on Cloud Computing, Data Science and Engineering (Confluence 2022)
Authorized licensed use limited to: M/s Shanti Education Society. Downloaded on November 14,2022 at 17:00:13 UTC from IEEE Xplore. Restrictions apply.
FDQQRWUHPHPEHUORQJWHUPGHSHQGHQFLHVDQGVR
GRHVOVWPLVGHVLJQHGWRDYRLGWKLVSUREOHP
)LJXUH/670
$UFKLWHFWXUH>@
)URPWKHILJXUH ZHFDQVHHWKDWWKHUHDUHSDUWV
RI/670>@7KHILUVWSDUWFKRRVHVZKHWKHUWR
UHPHPEHUWKHLQIRUPDWLRQIURPSUHYLRXV
)LJXUH7KHZRUNLQJRI/6701HWZRUN>@
WLPHVWDPSRUQRW,ILQFDVHLWILQGVWKHLQIRUPDWLRQ
LUUHOHYDQWLWFDQIRUJHWWKDWLQIRUPDWLRQ7KHVHFRQG ,Q)LJXUHZHFDQREVHUYHWKHZRUNLQJRIWKH
EORFNOHDUQVIURPWKHFXUUHQWLQSXWRUEDVLFDOO\ /670/D\HU>@7KH,QSXW/D\HULVSUHVHQW
LWWULHVWROHDUQQHZWKLQJVIURPWKHFXUUHQWLQSXW IROORZHGE\WKHHPEHGGLQJOD\HU$IWHUWKH
7KHWKLUGSDUWFKRRVHVWRXSGDWHWKHLQIRUPDWLRQ HPEHGGLQJLVGRQHWKHRXWSXWSDVVHVWKURXJK
IURPFXUUHQWWLPHVWDPSDQGSDVVHVLWWRWKHQH[W /670OD\HUZKHUHWKHGHHSQHXUDOQHWZRUNWKDWLV
WLPHVWDPS7KHVHWKUHHSDUWVDUHNQRZQDVJDWHVRI /670SHUIRUPVLW¶VWDVNRIWUDLQLQJDQGILQDOO\WKH
/6707KHILUVWSDUWRIWKLVJDWHLVNQRZQ$V RXWSXWLVSDVVHGWKURXJKWKH'HQVH/D\HUKDYLQJ
IRUJHWJDWHVHFRQGSDUWDVLQSXWJDWHDQGWKHWKLUG DFWLYDWLRQIXQFWLRQDVVRIWPD[ZKLFKLVUHVSRQVLEOH
SDUWDVRXWSXWJDWH IRUJHQHUDWLQJWKHRXWSXWWKDWLVDYHFWRURIDOO
SUREDELOLWLHV
& %L/670
%L/670RUELGLUHFWLRQDO/670LVYHUVLRQRI511
DQGDUHLPSURYHGYHUVLRQRI/670,WLV
GHVLJQHGWRLPSURYHWKHPRGHO
VSHUIRUPDQFHLQ
VHTXHQFHFODVVLILFDWLRQSUREOHPV2QWKHLQSXW
VHTXHQFHLWWUDLQVWZR/670VUDWKHUWKDQRQH
/6707KHLQSXWVHTXHQFHLVXVHGIRUWKHILUVW
WUDLQLQJDQGDUHYHUVHGGXSOLFDWHRIWKHLQSXW
VHTXHQFHLVXVHGIRUWKHVHFRQG,WOHDGVWR
)LJXUH/670/D\HUV>@
TXLFNHUDQGPRUHWKRURXJKOHDUQLQJRIWKHSUREOHP
-XVWOLNH511/670DOVRKDVKLGGHQVWDWHVDV DVZHOODVSURYLGLQJQHZFRQWH[WWRWKHQHWZRUN
GHSLFWHGLQ)LJXUH>@+7LVNQRZQDVWKH 7KHSULPDU\GLIIHUHQFHEHWZHHQ%L/670DQG
KLGGHQVWDWHRISUHYLRXVWLPHVWDPSDQG+7LV /670LVWKDW/670ZLOOPDLQWDLQLQIRUPDWLRQ
NQRZQDVWKHKLGGHQVWDWHRIFXUUHQWWLPHVWDPS IURPLQSXWWKDWKDVSUHYLRXVO\JRQHWKURXJKLWV
/670DOVRKDVDFHOOVWDWHNQRZQDV&7IRU KLGGHQVWDWHZKHUHDVELGLUHFWLRQDOZLOOUXQWKH
SUHYLRXVWLPHVWDPSDQG&7IRUFXUUHQWWLPHVWDPS LQSXWVLQWZRGLUHFWLRQVRQHIURPWKHSDVWWRWKH
6KRUWWHUPPHPRU\LVNQRZQDVKLGGHQVWDWH IXWXUHDQGWKHRWKHUIURPWKHIXWXUHWRWKHSDVW,QD
ZKHUHDVORQJWHUPPHPRU\LVNQRZQDVFHOOVWDWH EDFNZDUGVUXQQLQJ/670LQIRUPDWLRQIURPWKH
IXWXUHLVRQO\SUHVHUYHGEXWE\FRPELQLQJWKHWZR
2QH/670OD\HUVDUHXVHGZLWKHDFKRIWKHP KLGGHQVWDWHVLQIRUPDWLRQIURPWKHSDVWDQGIXWXUH
KDYLQJXQLWVUHTXLUHGLQRXWSXWDQGDGHQVH PD\EHSUHVHUYHGDWDQ\SRLQWLQWLPH
OD\HURIRXWSXWXQLWZKLFKXVHVVRIWPD[DFWLYDWLRQ
IXQFWLRQ>@>@
$GDPRSWLPL]HULVXVHG>@
7KH/670OD\HULVXVHGDWDOHDUQLQJUDWHRU
JUDGLHQWGHVFHQW>@RI
12th International Conference on Cloud Computing, Data Science and Engineering (Confluence 2022) 655
Authorized licensed use limited to: M/s Shanti Education Society. Downloaded on November 14,2022 at 17:00:13 UTC from IEEE Xplore. Restrictions apply.
)LJXUHVKRZVWKH*UDSKWKDWLVSORWWHGRQWKH
EDVLVRIµ0RGHO$FFXUDF\¶DQGµ0RGHO/RVV¶
)LJXUH%L/6701HWZRUN>@
)LJXUH0RGHO$FFXUDF\DQG0RGHO/RVVIRU/670
,Q)LJXUHZHFDQVHHWKH)RUZDUGDQG%DFNZDUG
/D\HULQ%L/670WKDWPDNHWKH%L/670 7KH0RGHO$FFXUDF\JUDSKLVFUHDWHGIRUDFFXUDF\
1HWZRUN>@ YVHSRFKVZKHUHDV0RGHO/RVVLVFUHDWHGIRUORVV
7KHVDPHPHWKRGRORJ\LVDSSOLHGLQ%L/670DVLV YVHSRFK
DSSOLHGLQ/670ZLWKWKHH[FHSWLRQRIXVLQJRQH )RUWKH%L/670PRGHOZHFDQVHHIURP)LJXUH
%LGLUHFWLRQDOOD\HUVRIVDPHXQLWVL]HDV/670 LW¶VDFFXUDF\DQGORVVJUDSKWKDWLVJHQHUDWHGZKHQ
7KH'HQVH/D\HULVWKHVDPHDVLQ/670 WKHPRGHOZDVWUDLQHG
7KHQXPEHURIHSRFKVDUHIRUERWKWKHPRGHOV
GXULQJWUDLQLQJ
,9 (9$/8$7,21
7KHHYDOXDWLRQRIWKHPRGHOUHOLHVRQWKHFRQIXVLRQ
PDWUL[WKHJUDSKLWSORWVDQGWKHHYDOXDWLRQPHWULFV
WKDWDUHSUHFLVLRQUHFDOO DFFXUDF\DQG)6FRUH
7KHPRVWJHQHUDOHYDOXDWLRQPHWULFLVWKHDFFXUDF\
)LJXUH0RGHO$FFXUDF\DQG0RGHO/RVVIRU%L/670
DQGORVVJUDSK
7KH H[SHULPHQW ZDV SHUIRUPHG RQ *RRJOH &RODE )URP)LJXUHZHFDQREVHUYHWKDWWKHJUDSKLV
ZKHUH WKH 5XQWLPH (QYLURQPHQW ZDV VHW WR *38 SORWWHGIRUPRGHODFFXUDF\DQGPRGHOORVV
7KHPDFKLQHWKDWLVXVHGIRUWKHSHUIRUPLQJRIWKLV 7KH0RGHO$FFXUDF\JUDSKLVFUHDWHGIRUDFFXUDF\
H[SHULPHQWKDVVSHFLILFDWLRQV YVHSRFKVZKHUHDV0RGHO/RVVLVFUHDWHGIRUORVV
5$0*% YVHSRFK
3URFHVVRU3URFHVVRU,QWHO5 &RUH70 L8 $ 5HVXOWDQDO\VLV
&38 # *+] 0K] &RUHV
/RJLFDO3URFHVVRUV $IWHU SHUIRUPLQJ WKH H[SHULPHQWDWLRQ ZH FDQ VHH
*38$0'5DGHRQ50 IURPWDEOHWKHDQDO\VLVRIWKHUHVXOWV
95$00%
ࢀࡼࢀࡺ
IRUHDFKPRGHO
$FFXUDF\ כ
ࢀࡼࡲࡼࢀࡺࡲࡺ
)VFRUH
כ KDVORZHVWORVV
ࡾࢋࢉࢇ ࡼ࢘ࢋࢉ࢙
7KHUDWLRRIWKHWRWDOQXPEHURIFRUUHFWO\FDWHJRULVHG
FDVHVWRWKHWRWDOQXPEHURIRFFXUUHQFHVLVNQRZQDV
DFFXUDF\3UHFLVLRQLVGHILQHGDVWKHPRGHO
VDELOLW\
WRHIIHFWLYHO\GHWHUPLQHSRVLWLYHFDVHV7KHPRGHO
V
UHFDOO VKRZV XV KRZ RIWHQ LW FRUUHFWO\ SUHGLFWV
IDYRXUDEOHHYHQWV:KHQERWK3UHFLVLRQDQG5HFDOO
DUHLPSRUWDQWWKH)VFRUHFRPHVLQKDQG\,W
VWKH
VXPRIERWKHQWLWLHV
KDUPRQLFV
656 12th International Conference on Cloud Computing, Data Science and Engineering (Confluence 2022)
Authorized licensed use limited to: M/s Shanti Education Society. Downloaded on November 14,2022 at 17:00:13 UTC from IEEE Xplore. Restrictions apply.
WHOOVWKDWWDNLQJ PRUHGDWDVHWV PLJKWVROYHWKLV
SUREOHP VR WKDW WUDLQLQJ LV GRQH RQ D ODUJH
QXPEHURIGDWDVHWV
9, )8785(:25.
7KHZRUNZRXOGEHFDUULHGRXWLQWKHIXWXUHZLWK
QRZWKH IRFXVRQFDSVXOH%L/670DQGK\EULG
YHUVLRQRI&11DQG/6702WKHUDUHDRIVWXG\
ZRXOGEHWRDSSO\%(57WHFKQLTXHLQ1/3DQG
KRZWKHVHPRGHOVZRXOGEHEHKDYLQJRQQRWMXVW
RQ0HGLXPDUWLFOHVEXWRWKHUGDWDVHWVRIGLIIHUHQW
)LJXUH$QDO\VLVRIWKH0RGHOV DUHDV$OVRDODUJHGDWDVHWZRXOGEHWDNHQLQWKH
IXWXUHQRWWRMXVWRQO\SUHGLFWWKHQH[WZRUGEXW
DOVRWRSUHGLFWZKDWZRUGVZRXOGEHFRPLQJIRU
FRPSOHWLQJ WKH VHQWHQFHV DQG DXWRPDWLFDOO\
FRPSOHWLQJWKHVHDUFKTXHULHVRUVHQWHQFHV
5()(5(1&(6
>@ 56KDUPD1*RHO1$JJDUZDO3
.DXUDQG&3UDNDVK³1H[W:RUG3UHGLFWLRQ
LQ+LQGL8VLQJ'HHS/HDUQLQJ7HFKQLTXHV´LQ
,QWHUQDWLRQDO&RQIHUHQFHRQ'DWD6FLHQFH
DQG(QJLQHHULQJ,&'6(3DWQD,QGLD6HS
)LJXUH$QDO\VLVRIWKH0RGHOV SS±GRL
,&'6(
>@ $ .XQFKXNXWWDQ 3 0HKWD DQG 3
)URPWKHILJXUHDQGLWLVFOHDUO\HYLGHQWKRZ %KDWWDFKDU\\D³7KH,,7%RPED\(QJOLVK+LQGL
HDFKPRGHOSHUIRUPHGDQGWKHJUDSKLVSORWWHGE\ 3DUDOOHO &RUSXV´ DU;LY >FV@ 0D\
WDNLQJLQWRDFFRXQWµ$FFXUDF\¶µ/RVV¶µ9DOLGDWLRQ $FFHVVHG -DQ >2QOLQH@
$FFXUDF\¶DQGµ9DOLGDWLRQ/RVV¶IRUHDFKPRGHO $YDLODEOHKWWSDU[LYRUJDEV
>@ = +DPHHG DQG % *DUFLD=DSLUDLQ
% &RPSDULVRQZLWKUHODWHGZRUN 6HQWLPHQW &ODVVLILFDWLRQ 8VLQJ D 6LQJOH
/D\HUHG%L/6700RGHOLQ,((($FFHVVYRO
7KH PRGHOV RQ ZKLFK WKLV H[SHULPHQWDWLRQ LV SS GRL
SHUIRUPHG DFKLHYHG KLJKHU DFFXUDFLHV IRU ERWK $&&(66
/670DQG%L/670PRGHOVWKDQWKHVDPHPRGHOV
XVHG IRU (QJOLVK /DQJXDJH &KDQJHV LQ +\SHU >@ 7KDQDNRP6DQJQHWUD ³JORYH%GW[W´
3DUDPHWHUVZHUHGRQHWRREWDLQEHWWHUUHVXOWV7KHVH KWWSVZZZNDJJOHFRPWKDQDNRPVQJORYHE
GW[WDFFHVVHG
ZHUH WKH EHVW WXQLQJV LQ K\SHU SDUDPHWHUV WKDW
UHVXOWHGVXFKLPSUHVVLYHUHVXOWV >@ 6*RJLQHQLDQG$3LPSDOVKHQGH
³3UHGLFWLQJ,0'%0RYLH5DWLQJ8VLQJ'HHS
9 &21&/86,21 /HDUQLQJ´LQWK,QWHUQDWLRQDO
,QWKLVZRUNZHKDYHSHUIRUPHGDFRPSDUDWLYHVWXG\ &RQIHUHQFHRQ&RPPXQLFDWLRQDQG(OHFWURQLFV
DQGREWDLQHGWKHUHVXOWVDVVKRZQ LQ7DEOHDQGDOVR 6\VWHPV,&&(6&RLPEDWRUH,QGLD-XQ
WKHVDPHLVPLUURUHGLQWKH%DU&KDUWLQILJXUH7KH SS±GRL
FRQFOXVLRQLVWKDW%L/670SHUIRUPHGWKHEHVW7KH ,&&(6
UHVXOW WKDW %L/670 PRGHO SHUIRUPHG EHWWHU ZDV >@0 7DQ DQG 4 9 /H ³(IILFLHQW1HW
H[SHFWHG DV %L/670 ZDV LQWURGXFHG WR VROYH WKH 5HWKLQNLQJ 0RGHO 6FDOLQJ IRU &RQYROXWLRQDO
GUDZEDFNVWKDWRFFXUUHGLQ/670PRGHO$WWKHHQG 1HXUDO 1HWZRUNV´ DU;LY >FV VWDW@
ZH FDQ VHH WKDW ZLWK %L/670 ZH DFKLHYHG WKH 6HS $FFHVVHG -DQ >2QOLQH@
KLJKHVWDFFXUDF\DVZHOODVKDGWKHOHDVWORVV $YDLODEOHKWWSDU[LYRUJDEV
:HFDQVHHWKDWWKHUHLVKLJKRYHUILWWLQJDVLVHYLGHQW >@2)5DNLE6$NWHU0$.KDQ$.'DV
IURP WKH JUDSKV LQ ILJXUHV DQG IRU /670DQG DQG.0+DELEXOODK³%DQJOD:RUG3UHGLFWLRQ
%L/670UHVSHFWLYHO\+HQFHLWDOVR DQG 6HQWHQFH &RPSOHWLRQ 8VLQJ *58 $Q
([WHQGHG9HUVLRQRI511RQ1JUDP/DQJXDJH
0RGHO´ LQ ,QWHUQDWLRQDO &RQIHUHQFH RQ
6XVWDLQDEOH7HFKQRORJLHVIRU,QGXVWU\67,
'KDND %DQJODGHVK 'HF SS ± GRL
67,
12th International Conference on Cloud Computing, Data Science and Engineering (Confluence 2022) 657
Authorized licensed use limited to: M/s Shanti Education Society. Downloaded on November 14,2022 at 17:00:13 UTC from IEEE Xplore. Restrictions apply.
>@< 'RQJ < )X / :DQJ < &KHQ < 'RQJ >@ +XL/LX ³5DLO WUDQVLW FKDQQHO URERW
DQG-/L³$6HQWLPHQW$QDO\VLV0HWKRGRI&DSVXOH V\VWHPV´ KWWSVGRLRUJ%
1HWZRUN%DVHGRQ%L/670´,((($FFHVVYRO
SS ± GRL
$&&(66 >@ 6 6KDUPD 6 6KDUPD DQG $ $WKDL\D
³$&7,9$7,21 )81&7,216 ,1 1(85$/
>@0G5+DTXH6$NWHU/LPDDQG6=0LVKX 1(7:25.6´ ,-($67 YRO QR SS
³3HUIRUPDQFH$QDO\VLVRI'LIIHUHQW1HXUDO ± 0D\ GRL
1HWZRUNVIRU6HQWLPHQW$QDO\VLVRQ,0'E0RYLH ,-($67YL
5HYLHZV´LQUG,QWHUQDWLRQDO&RQIHUHQFHRQ
(OHFWULFDO&RPSXWHU 7HOHFRPPXQLFDWLRQ >@ $6HQLRU*+HLJROG05DQ]DWRDQG.
(QJLQHHULQJ,&(&7(5DMVKDKL%DQJODGHVK <DQJ ³$Q HPSLULFDO VWXG\ RI OHDUQLQJ UDWHV LQ
'HFSS±GRL GHHSQHXUDOQHWZRUNVIRUVSHHFKUHFRJQLWLRQ´LQ
,&(&7( ,((( ,QWHUQDWLRQDO &RQIHUHQFH RQ
$FRXVWLFV 6SHHFK DQG 6LJQDO 3URFHVVLQJ
>@ 604DLVDU³6HQWLPHQW$QDO\VLVRI,0'E 9DQFRXYHU %& &DQDGD 0D\ SS ±
0RYLH5HYLHZV8VLQJ/RQJ6KRUW7HUP GRL,&$663
0HPRU\´LQQG,QWHUQDWLRQDO&RQIHUHQFH
RQ&RPSXWHUDQG,QIRUPDWLRQ6FLHQFHV,&&,6 >@ '3.LQJPDDQG-%D³$GDP$0HWKRG
6DNDND6DXGL$UDELD2FWSS±GRL IRU 6WRFKDVWLF 2SWLPL]DWLRQ´ DU;LY
,&&,6 >FV@ -DQ $FFHVVHG -DQ
>2QOLQH@ $YDLODEOH
>@ 0HGLXP $UWLFOH 'DWDVHW KWWSDU[LYRUJDEV
KWWSVZZZNDJJOHFRPGRULDQOD]DUPHGLXP
DUWLFOHVGDWDVHW"VHOHFW PHGLXPBGDWDFVY >@ 0DWW&UXLFNVKDQN³:KDWGRHVLWPHDQE\
%LGLUHFWLRQDO /670"´
>@ DGLW\DMQ ³*/29( % ' :RUG KWWSVPRULRKFRPSGIEE DFFHVVHG
(PEHGGLQJV´
KWWSVZZZNDJJOHFRPDGLW\DMQJORYHE G
DFFHVVHG >@ < .LP - $Q 0 /HH DQG < /HH ³$Q
$FWLYLW\(PEHGGLQJ $SSURDFK IRU 1H[W
>@ - 3HQQLQJWRQ 5 6RFKHU DQG & 0DQQLQJ $FWLYLW\ 3UHGLFWLRQ LQ D 0XOWL8VHU 6PDUW
³*ORYH*OREDO9HFWRUVIRU:RUG5HSUHVHQWDWLRQ´ 6SDFH´LQ,(((,QWHUQDWLRQDO&RQIHUHQFH
LQ3URFHHGLQJVRIWKH&RQIHUHQFHRQ(PSLULFDO RQ 6PDUW &RPSXWLQJ 60$57&203 +RQJ
0HWKRGV LQ 1DWXUDO /DQJXDJH 3URFHVVLQJ .RQJ &KLQD 0D\ SS ± GRL
(01/3'RKD4DWDUSS±GRL 60$57&203
Y'
>@ -<DQJ+:DQJDQG.*XR³1DWXUDO
>@ 6+,35$ 6$;(1$ ³,QWURGXFWLRQ WR /RQJ /DQJXDJH:RUG3UHGLFWLRQ0RGHO%DVHGRQ
6KRUW 7HUP 0HPRU\ /670´ 0XOWL:LQGRZ&RQYROXWLRQDQG5HVLGXDO
KWWSVZZZDQDO\WLFVYLGK\DFRPEORJ 1HWZRUN´,((($FFHVVYROSS±
LQWURGXFWLRQWRORQJVKRUWWHUPPHPRU\OVWP GRL
DFFHVVHG $&&(66
>@ 6+,35$ 6$;(1$ ³,QWURGXFWLRQ WR /RQJ
6KRUW 7HUP 0HPRU\ /670´
KWWSVZZZDQDO\WLFVYLGK\DFRPEORJ
LQWURGXFWLRQWRORQJVKRUWWHUPPHPRU\OVWP
DFFHVVHG
658 12th International Conference on Cloud Computing, Data Science and Engineering (Confluence 2022)
Authorized licensed use limited to: M/s Shanti Education Society. Downloaded on November 14,2022 at 17:00:13 UTC from IEEE Xplore. Restrictions apply.