2021 2nd International Conference on Big Data and Informatization Education (ICBDIE)

'HVLJQRIGDWDLQWHJUDWLRQSODWIRUPIRU2&1EXVLQHVV
2021 2nd International Conference on Big Data and Informatization Education (ICBDIE) | 978-1-6654-3870-4/20/$31.00 ©2021 IEEE | DOI: 10.1109/ICBDIE52740.2021.00037

VXSSRUWV\VWHP
&KHQJER/XR
6KDQJKDL-LJXDQJ3RO\WHFKQLF&ROOHJH6KDQJKDL&KLQD
HPDLO#TTFRP

Abstract²,QRUGHUWRPHHWWKHGHYHORSPHQWRI2&1EXVLQHVV
LW LV NH\ WR HVWDEOLVK D SHUIHFW EXVLQHVV VXSSRUW V\VWHP 7KH ,, 2&1.(<&86720(5'$7$,17(*5$7('3/$7)250
GHVLJQHURI2&1HQWHUSULVHGDWDZDUHKRXVHSODWIRUPLVWKHFRUH )5$0(:25.02'(
SDUW RI WKH ZKROH VXSSRUW V\VWHP 7KLV SDSHU VWXGLHV WKH
IUDPHZRUN PRGH DQG LQWHJUDWLRQ VWUXFWXUH RI 2&1 FXVWRPHU A. Establishing a unified enterprise data model (EDM)
GDWDLQWHJUDWLRQSODWIRUPDQDO\]HVWKHIXQFWLRQVRIHDFKOD\HULQ $W SUHVHQW WKH RQOLQH GDWD RI HDFK EUDQFK DSSOLFDWLRQ
WKH ORJLF DUFKLWHFWXUH RI WKH GDWD SODWIRUP DQG DQDO\]HV WKH
V\VWHP LV VWRUHG LQ GLIIHUHQW GDWDEDVHV WKH GDWD PRGHOV DUH
IXQFWLRQ RI HDFK OD\HU LQ WKH GDWD ZDUHKRXVH DUFKLWHFWXUH 7KLV
TXLWH GLIIHUHQW WKH EXVLQHVV FRQFHSWV FXVWRPHUV SURGXFWV
SDSHU DQDO\]HV WKH GDWD LQWHJUDWLRQ SURFHVV LQ GHWDLO DQG
GHVFULEHV WKH GDWD DFTXLVLWLRQ PHWKRG GDWD H[WUDFWLRQ VWUDWHJ\
UHYHQXH W\SHV HWF  ODFN RI XQLILHG SODQQLQJ DQG LW LV YHU\
DQGGDWDORDGLQJLQGHWDLO GLIILFXOWWRVKDUHGDWD7KLVSURMHFWUHTXLUHV2&1WRUHDOL]HWKH
XQLILHG SODQQLQJ RI HQWHUSULVH LQIRUPDWLRQ DQG HVWDEOLVK D
Keywords-big customer; business support system; data XQLILHGEXVLQHVVYLHZRQWKHEDVLVRIHQWHUSULVHGDWDPRGHOVR
integrated platform; data conversion mode DVWRSURYLGHWKHEDVLVIRULQIRUPDWLRQDQDO\VLVDQGVKDULQJ

, ,1752'8&7,21 B. Establish a centralized data warehouse in the whole city

,Q UHFHQW \HDUV ZKLOH FRQVROLGDWLQJ DQG GHYHORSLQJ WKH (VWDEOLVK D FHQWUDOL]HG GDWD ZDUHKRXVH DUFKLWHFWXUH DQG
WUDGLWLRQDO EXVLQHVV 2&1 KDV OLVWHG WKH GHYHORSPHQW RI GDWD LQIUDVWUXFWXUH LQFOXGLQJ GDWD DFTXLVLWLRQ DQG ORDGLQJ V\VWHP
DFFHVV DQG ELJ FXVWRPHU XVHUV LQFOXGLQJ LPSRUWDQW XVHUV RI (7/ FHQWUDOGDWDVWRUDJHV\VWHPGDWDDFFHVVV\VWHP5HDOL]H
VWDWHRUJDQVODUJHHQWHUSULVHXVHUVDQGJURXSXVHUV DVRQHRI WKH VKDULQJ RI DOO HQWHUSULVH LQIRUPDWLRQ DPRQJ V\VWHP
WKH PDMRU VWUDWHJLF REMHFWLYHV RI 2&1 DQG KDV DFKLHYHG DSSOLFDWLRQ DQG XVHU DQG HQVXUH WKH FRQVLVWHQF\ DFFXUDF\
UHPDUNDEOHUHVXOWV,QRUGHUWRFRRSHUDWHZLWKWKHSURPRWLRQRI XQLTXHQHVVDQGWLPHOLQHVVRIGDWD
GDWD EXVLQHVV SURYLGH PRUH KXPDQ VHUYLFHV IRU DOO NLQGV RI
ELJ FXVWRPHUV ZLWK VSHFLDO LGHQWLW\ DQG UHDOL]H WKH C. Provide effective business decision-making tools
VWDQGDUGL]DWLRQ RI ELJ FXVWRPHU EXVLQHVV SURFHVV 'RQJIDQJ 7KHILHUFHFRPSHWLWLRQLQWKHPDUNHWDQGWKHFRPSOH[LW\RI
FDEOH LQWURGXFHV ELJ FXVWRPHU EXVLQHVV VXSSRUW V\VWHP DV WKH PDQDJHPHQW SURFHVV GHWHUPLQHWKDW DQ HQWHUSULVHQHHGVWR
WKH RSHUDWLRQ VXSSRUW PDQDJHPHQW WRRO RI HQWHUSULVH GDWD H[WUDFWDQGDQDO\]HWKHKLVWRULFDOGDWDRIFXVWRPHUUHODWLRQVKLS
EXVLQHVV2YHUWKHSDVWIHZ\HDUVWKHV\VWHPKDVEDVLFDOO\PHW PDUNHWLQJSURGXFWGHYHORSPHQWLQYHVWPHQWDQDO\VLVDQGRWKHU
WKH GDLO\ RSHUDWLRQ QHHGV RI NH\ FXVWRPHU EXVLQHVV UHDOL]HG DVSHFWV LQ RUGHU WR VXUYLYH DQG GHYHORS VR DV WR ILQG WKH
WKH LQIRUPDWL]DWLRQ RI DOO PDMRU EXVLQHVV OLQNV IURP EXVLQHVV SRWHQWLDO LQIRUPDWLRQ RI YDOXH IRU WKH IXUWKHU GHYHORSPHQW RI
DFFHSWDQFH ZRUN RUGHU IORZ EXVLQHVV RSHQLQJ WR EXVLQHVV WKHHQWHUSULVH8VLQJGDWDZDUHKRXVHLWFDQHIIHFWLYHO\VHJPHQW
PHDVXUHPHQW DQG EXVLQHVV VWDWLVWLFV DQG SURYLGHG XVHU WKH PDUNHW DQG DFKLHYH WKH JRDO 7R VHOO WKH PRVW VDWLVILHG
LQIRUPDWLRQ PDLQWHQDQFH SHUVRQDOL]HG VHUYLFH JXDUDQWHH DQG SURGXFWV DQG VHUYLFHV WR WKH FXVWRPHUV ZKR FDQ JHW WKH PRVW
RWKHU IXQFWLRQV 7KH V\VWHP HIIHFWLYHO\ UHGXFHV WKH PDQXDO SURILW PDUNHWLQJ SURGXFW GHYHORSPHQW LQYHVWPHQW DQDO\VLV
RSHUDWLRQZLWKWKHVSHHGRIELJFXVWRPHUEXVLQHVVRSHQLQJWR DQGRWKHUDVSHFWVLQRUGHUWRVXUYLYHDQGGHYHORSVRDVWRILQG
WKH PDUNHW DQG SURYLGHV FRUUHVSRQGLQJ VXSSRUW IRU WKH JRRG WKH SRWHQWLDO LQIRUPDWLRQ RI YDOXH IRU WKH IXUWKHU GHYHORSPHQW
RSHUDWLRQRIELJFXVWRPHUEXVLQHVV RI WKH HQWHUSULVH 8VLQJ GDWD ZDUHKRXVH LW FDQ HIIHFWLYHO\
VHJPHQW WKH PDUNHW DQG DFKLHYH WKH JRDO 7R VHOO WKH PRVW
$V WKH GHPDQG RI HQWHUSULVHV IRU GDWD DFFHVV EXVLQHVV LV VDWLVILHGSURGXFWVDQGVHUYLFHVWRWKHFXVWRPHUVZKRFDQJHWWKH
PRUH SHUVRQDOL]HG WKH VHUYLFHV ODXQFKHG E\ YDULRXV VHUYLFH PRVWSURILW
SURYLGHUVLQWKLVDUHDDOVRVKRZGLYHUVLILFDWLRQ:KHWKHULWFDQ
SURYLGH KLJKTXDOLW\ DQG GLYHUVLILHG VHUYLFHV KDV EHFRPH WKH 7KH LQWHJUDWHG GDWD ZDUHKRXVH SODWIRUP LV PDLQO\ WR
NH\WRWKHGHYHORSPHQWRI2&1 VELJFXVWRPHUEXVLQHVVLQWKH LQWHJUDWH WKH GDWD RI RWKHU GHSDUWPHQWV  GDWD ZDUHKRXVHV DQG
QH[WVWHSDQGLQWKLVGLYHUVLILHGVHUYLFHWKHVXSSRUWRIVHUYLFH RWKHU EXVLQHVV V\VWHPV WR IRUP D XQLILHG GDWD ZDUHKRXVH
V\VWHPGDWDLVWKHPRVWFULWLFDOIDFWRUIRUWKHLPSOHPHQWDWLRQRI SODWIRUP2WKHU,7V\VWHPVRIWKHHQWHUSULVHPD\EHXVHGDVWKH
WKH ZKROH V\VWHP 7KLV SDSHU VWDUWV IURP WKH DXWKRU V GDWD VRXUFH RI WKH LQWHJUDWHG GDWD ZDUHKRXVH SODWIRUP ZKLFK
HQJLQHHULQJ EDFNJURXQG DQG FRQVWUXFWV D XQLILHG HQWHUSULVH UHTXLUHV WKDW WKH LQWHJUDWHG GDWD ZDUHKRXVH SODWIRUP FDQ EH
DQDO\VLV SODWIRUP DQG SODWIRUP EDVHG RQ 2&1 HQWHUSULVH GDWD LQWHJUDWHGZLWKRWKHUV\VWHPVRIWKHHQWHUSULVH7KHLQWHJUDWLRQ
ZDUHKRXVH SODWIRUP 8QLILHG GDWD PDQDJHPHQW SODWIRUP WR )LJXUHLVDVIROORZV
DFKLHYHLQIRUPDWLRQVKDULQJHIIHFWLYHVXSSRUWDQGFUHDWHYDOXH
HIIHFWLYHVXSSRUWDQGFUHDWHYDOXH

978-1-6654-3870-4/21/$31.00 ©2021 IEEE 131

DOI 10.1109/ICBDIE52740.2021.00037
Authorized licensed use limited to: Universitas Indonesia. Downloaded on September 15,2024 at 14:38:19 UTC from IEEE Xplore. Restrictions apply.
 EXVLQHVV V\VWHPV DQG LW LV FRQYHQLHQW WR TXHU\ DQG UHWULHYH
WKHVH UHODWHG GHVFULSWLRQV ,Q RUGHU WR DFKLHYH WKH LPSRUWDQW
JXDUDQWHHRIGDWDZDUHKRXVHWRDGDSWWRIUHTXHQWFKDQJHV

,9 ,03/(0(17$7,21352&(662)'$7$,17(*5$7('
3/$7)250
(7/ OHYHO LV URXJKO\ GLYLGHG LQWR'DWD DFTXLVLWLRQ OD\HU
,QWHUIDFH ˗'DWD VWRUDJH OD\HU WHPSRUDU\ DUHD GHWDLO OD\HU
DQG VXPPDU\ OD\HU ˗'DWD DFFHVV OD\HU DSSOLFDWLRQ PDUNHW
OD\HU 
+HUH WKH GDWD ILOH LV JHQHUDWHG IURP WKH VRXUFH V\VWHP
WUDQVIHUUHG WR WKH GDWD ZDUHKRXVH LQWHUIDFH VHUYHU SURFHVVHG
RQWKHGDWDZDUHKRXVHLQWHUIDFHVHUYHUDQGWKHVHTXHQFHIORZ
 FKDUW RI WKH GDWD ZDUHKRXVH LQWHUIDFH VHUYHU WR IHHGEDFN WKH
GHWHFWHGHUURUVWRWKHEXVLQHVVVRXUFHV\VWHP,QWKLVIORZFKDUW
)LJXUH6\VWHPLQWHJUDWLRQ
LW DOVR H[SODLQV YDULRXV HUURU GHWHFWLRQ DQG HUURU UHVROXWLRQ
PHFKDQLVPV
,,, /2*,&$/$5&+,7(&785(2),17(*5$7(''$7$ 7KH FRPSOHWH ZRUNIORZ LV DV IROORZV IURP WKH GDWD ILOH
3/$7)250 H[WUDFWLRQRIWKHVRXUFHV\VWHPWRWKHGDWDUHFHLYHGE\WKHGDWD
2&1 GDWD ZDUHKRXVHSODWIRUP LVGLYLGHGLQWR IRXUOD\HUV ZDUHKRXVHWRWKHFRUUHFWILOHEHLQJSURFHVVHGDQGWRIHHGEDFN
GDWDDFTXLVLWLRQOD\HUGDWDVWRUDJHOD\HUGDWDDFFHVVOD\HUDQG WKHWUDQVPLVVLRQHUURUWRWKHVRXUFHV\VWHP
LQIRUPDWLRQ LQWHJUDWLRQ OD\HU 7KH GDWD DFTXLVLWLRQ OD\HU LV
GLYLGHGLQWRWKUHHVXEOD\HUVGDWDVRXUFHH[WUDFWLRQFOHDQLQJ A. Extract business data of source system
FRQYHUVLRQORDGLQJ
1) Generate data files of source system IROORZLQJ WKH
'DWD VRXUFH UHIHUV WR D ODUJH QXPEHU RI GDWD LQIRUPDWLRQ DFTXLVLWLRQ SROLF\ FRQYHQWLRQ WDEOH SK\VLFDO SDUWLWLRQ WDEOH
GLVWULEXWHGLQGLIIHUHQWDSSOLFDWLRQV\VWHPVVWRUHGLQGLIIHUHQW VSOLWWLQJLQGH[DQGRWKHUIDFWRUV 
SODWIRUPV DQG GLIIHUHQW GDWDEDVHV ZKLFK LV WKH PDWHULDO EDVLV 2) Generate the corresponding flag file of source data
RIGDWDZDUHKRXVH 3) Handle the errors returned by feedback SURFHVVLQJWKH
'DWD DFTXLVLWLRQ OD\HU WKH IXQFWLRQ RI GDWD DFTXLVLWLRQ HUURUV UHWXUQHG IURP IHHGEDFN IRUPDW HUURU ILOH PLVVHG
OD\HULVWRH[WUDFWGDWDIURPHDFKSURGXFWLRQV\VWHPDQGORDG WUDQVPLVVLRQGXSOLFDWHGDWDILOHHWF 
LW LQWR WKH GDWD ZDUHKRXVH V\VWHP DIWHU D VHULHV RI a) For format error file error, DGMXVW GDWD H[WUDFWLRQ
WUDQVIRUPDWLRQFOHDQLQJDQGDXGLWLQJ SURJUDP DQG SUHSDUH FRUUHVSRQGLQJ VRXUFH GDWD GDWD DQG
'DWD VWRUDJH OD\HU WKH PDLQ IXQFWLRQ LV WR VWRUH DQG ORJRILOH 
PDQDJHWKHGHWDLOHGEXVLQHVVGDWDLQWHJUDWHGIURPWKHEXVLQHVV b) For missed transmission errors, DGMXVWGDWDH[WUDFWLRQ
V\VWHP DQG HQVXUH WKH TXDOLW\ RI WKH GDWD 6WDU PRGHO SURFHGXUH VXSSOHPHQW DQG WUDQVPLW PLVVHG GDWD DQG SUHSDUH
VQRZIODNH PRGHO RU QRQ VWDQGDUGL]HG PRGHO DUH XVHG IRU FRUUHVSRQGLQJVRXUFHGDWD GDWDDQGORJRILOH 
VWUXFWXUDOGHVLJQ
c) For retransmission errors, DGMXVW WKH GDWD H[WUDFWLRQ
'DWD DFFHVV OD\HU ZKHQ XVHUV DW GLIIHUHQW OHYHOV RI DQ SURFHGXUH
HQWHUSULVH GHDO ZLWK GLIIHUHQW EXVLQHVVHV WKH\ XVXDOO\ QHHG
GLIIHUHQW LQIRUPDWLRQ DQG GLIIHUHQW ZD\V WR SURYLGH B. Transfer the source data of business system to the data
LQIRUPDWLRQ 'DWD DFFHVV QHHGV WR SURYLGH GLIIHUHQW DFFHVV warehouse interface server
PHWKRGV IRU GLIIHUHQW EXVLQHVV QHHGV ,W PDLQO\ LQFOXGHV DG 1) Normal interface data file transmission (follow
KRFTXHU\SUHGHILQHGUHSRUW2/$3DQDO\VLVGDWDPLQLQJDQG
interface specification: VHUYHU ,3 XVHU SDVVZRUG GLUHFWRU\
VRRQ
WLPH DJUHHPHQW HWF VHTXHQFH RI WUDQVPLVVLRQ ILOHV VKDOO
,QIRUPDWLRQ LQWHJUDWLRQ OD\HU D YDULHW\ RI GLIIHUHQW WRROV IROORZILUVWWUDQVPLWGDWDILOHDQGWKHQWUDQVIHUFRUUHVSRQGLQJ
DQG DSSOLFDWLRQV FRQVWLWXWH WKH GDWD DFFHVV SDUW RI GDWD VLJQILOHDIWHUGDWDILOHLVFRUUHFWO\WUDQVPLWWHG
ZDUHKRXVHZKLFKUHTXLUHVDYDULHW\RIGLIIHUHQWLQIRUPDWLRQWR 2) Transmission error handling HUURU LQFOXGHV QHWZRUN
EH HQFDSVXODWHG LQ D XQLILHG LQWHUIDFH WR DFKLHYH XQLILHG DQG LQWHUUXSWLRQHWF 
VLPSOH LQIRUPDWLRQ DFFHVV ,W LV UHTXLUHG WR EXLOG D XQLILHG
HQWUDQFH RI WKHGDWD ZDUHKRXVHSODWIRUPDQG WKH LQIRUPDWLRQ a) Check whether data files need to be retransmitted and
DFFHVV IRU GLIIHUHQW OHYHOV DQG GLIIHUHQW EXVLQHVVHV FDQ EH data files retransmitted
VZLWFKHGDQGLPSOHPHQWHGLQWKHVDPHLQWHUIDFH
C. Data warehouse interface server processes source data of
0HWDGDWDPDQDJHPHQWOD\HUPHWDGDWDLVGDWDDERXWGDWD,W business system
UHTXLUHVDFRPSOHWHGHVFULSWLRQRIWKHGDWDZDUHKRXVHSODWIRUP 1) Normal receiving interface data of business system
LWVHOI DQG UHODWHG EXVLQHVV SURFHVVHV EXVLQHVV UXOHV DQG
2) Processing interface data files

132

Authorized licensed use limited to: Universitas Indonesia. Downloaded on September 15,2024 at 14:38:19 UTC from IEEE Xplore. Restrictions apply.
 a) Data warehouse interface service program reading %XVLQHVVV\VWHPGDWDVRXUFH
time agreement VWDUW LQWHUIDFH GDWD ILOH SURFHVVLQJ SURJUDP
ZLWKLQWKHWLPHZLQGRZPHHWLQJWKHUHTXLUHPHQWV  GDWDEDVH

b) Reading interface specification initialization H[WUDFW WUDQVIRUPDWLRQ ORDG

c) Process normal interface data files ILUVWFRS\WKHGDWD

GDWDPDUW
ILOHVWRWKH VSHFLILHG GLUHFWRU\DQGWKHQ UHFRUG WKHORJRI WKH
WUDQVPLVVLRQ UHVXOWV RI WKH VRXUFH GDWD /RJ WR SUHYHQW
GXSOLFDWHGDWDILOHV  2WKHUGDWD
7HPSRUDU\
VRXUFHV
 GDWD
d) The processing format does not regulate the interface 
data file ILUVWFRS\WKHGDWDILOHWRWKHVSHFLILHGGLUHFWRU\DQG )LJXUH6LPSOHIORZFKDUWRI(7/LPSOHPHQWDWLRQSURFHVV
WKHQUHFRUGWKHORJRIWKHWUDQVPLVVLRQ/RJJLQJFDQDOHUW(7/
SURFHVVLQJ SURFHVV RI GDWD ZDUHKRXVH PHDQZKLOH SUHSDUH
HUURUPHVVDJHWRLQIRUPWKHLQWHUIDFHVHUYHURIVRXUFHV\VWHP  E. Data extraction strategy
'DWDH[WUDFWLRQPXVWEHDEOHWRIXOO\PHHWWKHQHHGVRIWKH
e) Process the data file of missed interface FRS\WKHGDWD
GDWD ZDUHKRXVH V\VWHP DQG HQVXUH WKDW LW GRHV QRW DIIHFW WKH
ILOH WR WKH VSHFLILHG GLUHFWRU\ ILUVW DQG WKHQ UHFRUG WKH ORJ SHUIRUPDQFH RI WKH EXVLQHVV V\VWHP VR WKH FRUUHVSRQGLQJ
/RJJLQJFDQDOHUW(7/SURFHVVLQJSURFHVVRIGDWDZDUHKRXVH VWUDWHJLHV VKRXOG EH IRUPXODWHG ZKHQ GDWD H[WUDFWLRQ
PHDQZKLOH SUHSDUH HUURU PHVVDJH WR LQIRUP WKH LQWHUIDFH LQFOXGLQJ H[WUDFWLRQ PHWKRG H[WUDFWLRQ WLPHH[WUDFWLRQ F\FOH
VHUYHURIVRXUFHV\VWHP  DQG VR RQ 6SHFLILF GDWD H[WUDFWLRQ VWUDWHJ\ VR WKH
f) Process the retransmission interface data file FRUUHVSRQGLQJ VWUDWHJLHV VKRXOG EH IRUPXODWHG ZKHQ GDWD
GXSOLFDWHWUDQVPLVVLRQLQWHUIDFHGDWDILOHVDUHIRXQGDQGORJLV H[WUDFWLRQ LQFOXGLQJ H[WUDFWLRQ PHWKRG H[WUDFWLRQ WLPH
UHFRUGHG /RJ WR SUHSDUH HUURU PHVVDJHV WR QRWLI\ WKH VRXUFH H[WUDFWLRQ F\FOH DQG VR RQ 7KH VSHFLILF GDWD H[WUDFWLRQ
V\VWHPLQWHUIDFHVHUYHU  VWUDWHJLHVDUHVKRZQLQ7DEOHEHORZ˖
3) The processing needs to be fed back to the business
system interface processing 7DEOHGDWDH[WUDFWLRQVWUDWHJ\
a) Prepare error messages to the specified directory. 'DWD 0DLQGDWD
&ODVVLILFDWLRQ
<RXFDQQRWLI\WKHVRXUFHV\VWHPLQWHUIDFHVHUYHULQUHDOWLPH FKDUDFWHULVWLFV FRQWHQW
7KHGDWDLV
RU WKH VRXUFH V\VWHP LQWHUIDFH VHUYHU SHULRGLFDOO\ SROOV WKH JHQHUDWHGLQDQ
PHVVDJHGLUHFWRU\ LQFUHPHQWDOZD\
$OLVWELOO
4) load source data to the temporary area of data ,16(57 ZKLFKGRHVQRW
RUGHUHWF
LQYROYHWKH
warehouse XSGDWLQJRI
'DWDRSHUDWLRQ

H[LVWLQJGDWD
D. Data acquisition 5HVRXUFH
6RXUFHGDWDFODVVLILFDWLRQ

7\SLFDO GDWD DFTXLVLWLRQ SURFHVV LQFOXGHV VRXUFH GDWD 83'$7(

8SGDWHH[LVWLQJ DOORFDWLRQ
DQDO\VLV DQG PDSSLQJ (7/ DQG GDWD DXGLW 7KH FXUUHQW GDWD GDWD LQIRUPDWLRQ
HWF
ZDUHKRXVH GDWD PDLQO\ FRPHV IURP WKH FXUUHQW EXVLQHVV
7KHQHZGDWDLV
V\VWHPV LQFOXGLQJ FRPSUHKHQVLYH DFFHSWDQFH ELOOLQJ DQG JHQHUDWHGE\
DFFRXQWLQJ V\VWHP LQWHOOLJHQW QHWZRUN FRPSUHKHQVLYH LQFUHPHQWDO &XVWRPHU
,16(57'(/(7(
VHWWOHPHQW ,& FDUG V\VWHP KXPDQ UHVRXUFH V\VWHP ILQDQFLDO 83'$7(˅
PHWKRGDQGWKH VHUYLFH
V\VWHP XQLILHG FXVWRPHU LQIRUPDWLRQ PDUNHWLQJ FKDQQHO H[LVWLQJGDWDLV UHFRUGVHWF
VXSSRUWV\VWHPELJFXVWRPHUV\VWHP XSGDWHGDWWKH
VDPHWLPH
$IWHUDQDO\]LQJWKHVRXUFHGDWDDFFRUGLQJWRWKHQHHGVRI /DUJH $OLVWELOOHWF
WKH SK\VLFDO GDWD PRGHO RI WKH GDWD ZDUHKRXVH V\VWHP WKH 5HODWLYHO\VPDOO 5HVRXUFH
'DWDYROXPH

PDQDJHPHQW
VRXUFH GDWD LV PDWFKHG ZLWK WKH GHVWLQDWLRQ GDWD WKDW LV WKH V\VWHP
VRXUFHGDWDPDSSLQJ PDQDJHPHQW
GDWDRI
,Q WHUPV RI IXQFWLRQ WKH ZKROH (7/ FRQVLVWV RI WKUHH FRQILJXUDWLRQ
SDUWV˖ SDUDPHWHU
FODVVHWF
1) Data extraction: extract the data needed by the data 
warehouse system from the data source system
2) Data conversion: convert the data obtained from the 1) Extraction method: LQFUHPHQWDOH[WUDFWLRQIXOO
data source according to the form required by the data H[WUDFWLRQHWF
warehouse 2) Extraction time: DYRLG SHDN SHULRG RI EXVLQHVV V\VWHP
3) Data loading: loading data into data warehouse DV IDU DV SRVVLEOH DQG FDQ EH SHUIRUPHG ZKHQ WKH EXVLQHVV
7KHIORZFKDUWRI(7/LPSOHPHQWDWLRQSURFHVVLVVKRZQLQ V\VWHPLVUHODWLYHO\LGOHDWQLJKW
)LJXUH˖

133

Authorized licensed use limited to: Universitas Indonesia. Downloaded on September 15,2024 at 14:38:19 UTC from IEEE Xplore. Restrictions apply.
 3) Extraction cycle: IRU GLIIHUHQW W\SHV RI GDWD VRXUFHV D $FFRUGLQJWRWKHDFWXDOVLWXDWLRQRI2&1EXVLQHVVGDWDWKH
UHDVRQDEOH H[WUDFWLRQ SHULRG VKDOO EH IRUPXODWHG FRQVLGHULQJ ORDGLQJ F\FOH VKRXOG FRPSUHKHQVLYHO\ FRQVLGHU WKH EXVLQHVV
WKHEXVLQHVVUHTXLUHPHQWVDQGV\VWHPFRVWV DQDO\VLVUHTXLUHPHQWVDQGWKHFRVWRIV\VWHPORDGLQJ'LIIHUHQW
7\SLFDO GDWD DFTXLVLWLRQ SURFHVV LQFOXGHV VRXUFH GDWD ORDGLQJF\FOHVVKRXOGEHDGRSWHGIRUGDWDRIGLIIHUHQWEXVLQHVV
DQDO\VLV DQG PDSSLQJ (7/ DQG GDWD DXGLW 7KH FXUUHQW GDWD V\VWHPV EXW WKH LQWHJULW\ RI EXVLQHVV GDWD DW WKH VDPH WLPH
ZDUHKRXVH GDWD PDLQO\ FRPHV IURP WKH FXUUHQW EXVLQHVV PXVWEHPDLQWDLQHG
V\VWHPV LQFOXGLQJ FRPSUHKHQVLYH DFFHSWDQFH ELOOLQJ DQG
DFFRXQWLQJ V\VWHP LQWHOOLJHQW QHWZRUN FRPSUHKHQVLYH 9 &21&/86,21
VHWWOHPHQW ,& FDUG V\VWHP KXPDQ UHVRXUFH V\VWHP ILQDQFLDO
:LWK WKH SURPRWLRQ VHTXHQFH DQG WLPH RI&50 V\VWHP LQ
V\VWHP XQLILHG FXVWRPHU LQIRUPDWLRQ PDUNHWLQJ FKDQQHO
WKHZKROHFLW\JUDGXDOO\SURPRWHGLQWKHVXUURXQGLQJSURYLQFHV
VXSSRUWV\VWHPELJFXVWRPHUV\VWHP˖ WKHIXQFWLRQJUDGXDOO\LPSURYHGZLWKWKHFRQWLQXRXVFKDQJHRI
1) Meet the requirements of extracting and processing GHPDQG PHW WKH IXQFWLRQDO UHTXLUHPHQWV RI V\VWHP SODQQLQJ
various data sources. 'DWD VRXUFHV LQFOXGH 2&1 DQGZDVUHFRJQL]HGE\WKHXVHUGHSDUWPHQW,WVVLJQLILFDQFHOLHV
FRUUHVSRQGLQJ EXVLQHVV V\VWHP DQG H[WHUQDO GDWD VRXUFHV RI LQ WKH GDWD FROOHFWLRQ RI DOO V\VWHPV DOOURXQG GLVSOD\
LQFOXGLQJ ILQDQFLDO DFFHSWDQFH FKDQQHO ELJ FXVWRPHU
HQWHUSULVHV ZKLFK FDQ SURYLGH PDQXDO LPSRUW IXQFWLRQV RI EXVLQHVV LQFRPH DQG RWKHU GDWD XQLILHG PDQDJHPHQW DQG
VRPH GDWD VXFK DV SURPRWLRQ LQIRUPDWLRQ DQG VRFLDO XQLILHG DQDO\VLV RI GDWD OD\LQJ D PRUH DGYDQFHG DQG SHUIHFW
LQYHVWLJDWLRQLQIRUPDWLRQ GDWD GLVSOD\ IRU WKH IXWXUH ORQJWHUP GHYHORSPHQW RI 2&1
2) Support data extraction of various system platforms and RSHUDWLRQDQGOD\LQJDVROLGIRXQGDWLRQIRUWKHPDUNHWDQDO\VLV
data types. ,W LQFOXGHV YDULRXV UHODWLRQDO GDWDEDVH V\VWHPV DQGGHFLVLRQPDNLQJRI2&1
YDULRXVILOHPHWKRGVRIVRXUFHGDWDHWF
3) Fully consider the performance requirements of data 5()(5(1&(6
source system. $FFRUGLQJ WR WKH VL]H RI WUDIILF DQG GDWD WKH >@ &KLQD 7HOHFRP >@ QR JXLGDQFH RQ WKH DSSOLFDWLRQ RI GDWD
LPSDFWRQWKHGDWDVRXUFHV\VWHPVKRXOGEHPLQLPL]HG PRGHODQGGDWDZDUHKRXVHVSHFLILFDWLRQLQ&KLQD7HOHFRP(QWHUSULVHV
>6@
F. Data loading >@ (YDQ 0DUFXV +DO VWHUQ :DQJ 4LQJTLQJ /X =X\LQJ HW DO +LJK
'DWDORDGLQJLVWRORDGWKHGDWDH[WUDFWHGDQGWUDQVIRUPHG DYDLODELOLW\V\VWHPGHVLJQ7VLQJKXD8QLYHUVLW\3UHVV-XO\
IURPWKHGDWDVRXUFHV\VWHPLQWRWKHGDWDZDUHKRXVHV\VWHP,W >@ :DQJ 6KDQ HW DO 'DWD ZDUHKRXVH WHFKQRORJ\ DQG RQOLQH DQDO\WLFDO
LV UHTXLUHG WKDW WKH GDWD ORDGLQJ WRRO PXVW KDYH HIILFLHQW SURFHVVLQJ>0@%HLMLQJ6FLHQFH3UHVV
ORDGLQJSHUIRUPDQFH >@ /XR%X&KHQ/LMXQHWDO'HVLJQLPSOHPHQWDWLRQDQGPDQDJHPHQWRI
GDWDEDVHV\VWHP>0@(OHFWURQLF,QGXVWU\3UHVV
0DLQORDGLQJWHFKQRORJ\ >@ ;LH -XQ HW DO 2UDFOH 3HUIRUPDQFH 2SWLPL]DWLRQ VFLHQFH DQG DUW >0@
7VLQJKXD8QLYHUVLW\3UHVV
1) Use the data loading tool provided by the data >@ 6WHYHQ )HXHUVWHLQ ELOO 3ULE\O 7UDQVODWHG E\ /LQ 4L DQG :$1 <X
warehouse engine manufacturer to load the data; 2UDFOH3/64/SURJUDPPLQJ>0@7VLQJKXD8QLYHUVLW\3UHVV
2) Load data through API programming provided by data >@ 'DYLG & NUHLQHV %ULDQ /DVNH\ 7UDQVODWHG E\ =KDQJ <X 2UDFOH
warehouse engine manufacturer. GDWDEDVHPDQDJHPHQW>0@&KLQD(OHFWULF3RZHU3UHVV
'DWDORDGLQJVWUDWHJ\VKRXOGFRQVLGHUWZRDVSHFWVORDGLQJ >@ :ULWWHQ E\ &DURO 0F&XOORXJK GLHWHU 7UDQVODWHG E\ &DL 7LHOLQJ :X
=KLELQHWDO2UDFOHGHYHORSHU V*XLGH>0@&KLQD+\GURSRZHU3UHVV
F\FOHDQGGDWDDSSHQGLQJVWUDWHJ\ 


134

Authorized licensed use limited to: Universitas Indonesia. Downloaded on September 15,2024 at 14:38:19 UTC from IEEE Xplore. Restrictions apply.