B1G DATA ANALYTICS AND PLATFORMs

Assiqomnl- a Roll o: 2Ie54

HBase loading technique and HBase client ApI

HeaR -Geat Tabe.
Cxate 'toblk nam >', 'Kcdurn farily >
Gien belco is aampk cherra of table naed ep 1t b0s too
clunt families:pessonal data" and "pao fession daBa"
Res ey posonal key prolessional key.
|Yeu can cecate this tabk in HBae shel as beloco:

Gett "enp", 'peasonal data', 'proksonal data'

olp: Hbase :. Tabk-emp.
0 rO(s) in )-1300 seconds.
list TABLE emp
ole : a 30003) in o0340 SKConds.
coting a table wsing Java A
You con CYate a Jabe usig ChaTable C) ethod of 8ase T5is ctxs
|blorgs to g opache. hadocp. hbas clet.
Sep l : Intantiok Hease' Adnah:
hs cass vequis confiqunation object as a pasamete.thorefose tritally
initiale cenfiqusction chss & poss tbis to HRe Adhn
Ganfiquaion fonf- 18as.Curnlquaion. Csealet);
HBse Adn odmin =ntu) HBoseAdm)nCcons);
Skepa : TabeDesoitor Cheation: bba
HTabe Desespto is a class
torging to ong apache- haducp
nome & Columns
class Tbis dass is like a containen of table
Fanlies
 tbe an
may
of
HBase-Acinln
( t
Byes
toBylesC"Table execute :()
(lo C). objectHes
can ass. etuns ton): Ta
HColunnDescoiptox Cuale hst
Admin
Descoiptos( you
in C
HeaseCorfiqualion. adrin
blao: HBaseAdasn
class. Tàbles0
melbod HBase
-
Desuiptor
tBase-Admn 0s
HTable progam list This using
ru +mabk.arsl; Ctabl:
admi.
CatTable called chjet jecl N Gbe
new mode. Java
AD HBaR = tables
Adin:
of above confqusaion
=
Caatirq -famiy to
AP)
descoipto:
toable jova metbod conf AeroinodniDsaiplC]
tabk C
-arily mdod m objects.
soiptor
LratbeD of
odtfamily
thxough
Admin the Tabe tatbles #Bose
Confiqusation
41BaseAdrin
Desciptor eneute Listing
Täble
using sts
Descapto
HTable alurn C)
in
Coxate Gyeatd a
olp:
Table
have all all HJade
fxucuakeabe a a
Cclurn oddrgtobk. Cieatrtobk & *jarac
Cemplk
u of
list
VOeaing Cnatirq Gictira
3: Ceoted 1:
n Sep Usirg teo 9ed t D
 42: you can qet the length of HTable Deuúptos [1 aay sTg
he kngtb vaiobk of HTabe Descipton lass
Compk execue atove pogpom 0s beloco :
$jova ListTabk java.
jova list ahe
cle: User
ermp
& AHe
A HBase - Desoibe
Yhis cemand uns desouplion of tabk.
descibe
hbae desoibe able rae
make chongs to on exlstg toble - UÛrg
aHey: Jbis cmd usd to nmbey of calls ofa coun
moimum
Ond, you conchange oreHators and delte a Colu
Sope
family, 3et and delete table
tomily fom a tabe vERS/ONS 5
bbase> alte -t' »NME ’ - f
humb of calls s set to 5
Pnby
en: Mimn
5
altex ernp, NAME pesonal data', VERSIONS
al egi ons itb nuo SeznQ..
updattrg
o) gions updated
th gions updaled
Donc
in 3050 SLonds.

pledtng a Calum-tam
also delee a Glorn-larriy
|Usng aeo, you can also dalele'Clumy-fmil
bbOk atHey labluname
bbasc J
e ate 'employe , delete ofes sicnal
proks
updating all gj en s with hao Schema...
olp! oh aions update
 Grstuclos
tob pool)HBase
dnopping
a programableof table
an
GveoutoSewie
kinds occess
crd: dtfeert
/oi calof
Pefore Conn,to Tlabecas existence
ard checks
eist ofthespuikjed
table. opsdiont povdes CluduCunredi
an tst
Using esouCES
th an
a Crcate
dlele eliont Deletes
daleted of can
AobeNome,
Iyou
euerds the
con eist kirds hhax- yeu I
all celel)
Tableyou it is mot Naripalatten
epeialions. LRekasesqe
Gd]
-4580 table dulbeyert Consbuctor
cmd,disoble (empdeu
eziss
>
Heae
Cliont
-APT hodeep.
Name (deteGet y
a >
disable
lep' ed
exaists(
Drop n tohetotrnp
povides (Table srciji
dcep
HBae-
to rcus) Tabe
Org-apoche-
Consutos
: C) Usng-tbis
DHTobe closeCdelete
have Veity :ads
Metb boolean
O Mrtbcds Toble tode Dvold oà
Ustayou H8ase
H ’
4
 D Chsfut! A N) 9) 6) 15)
3topy Cstaucto s dolde he Rsult
Clas GeGetCorstructooS:
l CGetC ClassGed : lyou pd bytel totk)biog-apochadp
vodHTabeDrsoipto
Delete1
putCLyoubyeC] of Cenfguoien
Nane
bye canceae on byle C putCAt ] q(Get
] make psd-in t] gtTabkNan
Jis gtName
)oc0) put 0wtay, xo) gt)
class copy pu
gBTaleDeseiptos
is
'you oeation-or ceo C) ohj
uxd can of ntkey Ipu ltsig-is, C) [elons oxcd (onfRebieves I
can T Confguation
to Creae posed.ofet, keto Rttcuns by
y tbis cetam
psbom lacal] cale C tobk
a spibed in you inslan]
get a one [>etons panx
soco nt can ls
Delet eeattn pt get
ncolekengty h» nsert of tablersone ConiqunalienC) forn
ops ofenatkn this
to gven
en -br data taedescsjptor
&ngk
key long of-bis vo
gpecifed local] t) fo into
Speahcd tobe toon taBe ['getuns
roca |
 Corstoucb :
D Delele CbyteC] oo) lCaks a Dekte cpvatn o fpecibied ccd

Lcoaks a dlek ops -oo Speifed soco &, tirneslanp)

class Result: Jhs doss is used to get a Srge doco eSul o a
Gel or a San quoy
|CorstuctoS
DResuttt) Iyu can Ceate on ermpty Result cöthb no keyvalue
paylbad j twn onull if you call oow (ellsC )
Metbods:
Dbyel] gelvalue CbyeC] fomslys byleC I qualij)
TUsd to gt lalust vession of peeih Sprafed cobrn]

[Uscd to xtieve oo tey that Cnesponds to o fem cohbichtis ASutt

Coas cseaed]
8ase- Cheade Data.
put cemnard

putC) Method of aHe Clas

abee Cnds E, puthods au used to eneaetae.
dhe
Colunn fajlies
posonal data Profeasioral data
Poo key name dasigatien Salany
erspid USA S0,000
 Usng pud cmd, you Can iat ocos in toe
put '< tobe rone , oo1!, ecl-forily: ot,ColValue
E t em1', pensenal dato: rom', Craju?
ernp?
scan emnp disphy all-thx ocos of
Heae- pdoe Data parme,neuw Vaue.
Cow, C Colwn-opily : Colurn
|put ctabe name, t al).
can updae an existirng
Üsng put cmd you
emp, hco1", peusonal : aty',(Delb?
put
olp ono) in 0-40 ecocs.
* HBase- Read Dala ad
method of HToble closs, you con
Ug qt Crd and gete
datafoom tabe in HBse
-gt <toble nae , (Duo1

HBasc -Delee Data

delek ceate nane, ocos,'ceoname , tie damb y)
y7sa/8V8395
ai >ddte.emp , C,pusonal' data: eirty',
Steps -fosr all Opnaions
Sep :Insaniaiale -the Conßiqueztien olass
Conßquaion Conf = HBascCorfigusaton caeC)
Step a'. Instantiale the HTable closs
HTGBe HTobk =rw HToble CCorf, tabeNoe;
 Sep 3: Irstortiale thx Drlele closs
col;
Delete delele-Dw Dlee CtoByte C"
Sclet-the Dalo to b dekekd
Slepy:
delele- dekkCltunn CByles, toBylrs "posoral)
Byles tobyes("name;
delete - delelefonily CByes toBuylesC" paofessional :
Step 5 lete the Dala
tabedelele Cdelatos
|Step &: clese the HTable înstae
table-elose );
S Tntroduction abat the Spank :
of
Spaak is aost custes Compuubg tkchnology t is the,eensicn
mapfedut and -focus ncinly on dalo processng, speed arnd
Cqanl aing the memoy clustex e-ttictively .
t cupponts toab processgsysem> proas) ng mutiple Hoalive
Anksithms and suppet qued progrmning- languag.
featunes of Sponk:
Sped. Srak belps to nun an api cation ntHadcep dustk; up to
loo Airnes fosten n enony- and lo-thes -faste Aoben uming
ndiskthis is possble by seducng numb of ad l totrte
oations to disk Ht t stores te intonediale prpeesina
data in ynemoy
a Sugorts mutipe bnguogs : Spa provides biül -in Ards n Jovo,
ho
Sala, pythen Jroatoae, you can conite opplcatons in dityunt langpug
 osk Comes up coidh so iqh-level opratos -fo
rtaate
quot ng
3) Advanced-Analytics:
Spask net only supoxls Map and aeduce Tt also aupporls
queies sbramng data ,11achine leaaing CM) and aghgoblhs
Spouk bot on ladoop :

Spask Sposk
Mappduce
HDFS HDES HDES

StardalOne 4lodcep .Cyaar) Hodcop vi(siM)

Jhoe ase thoee types of Spasit deloymert as

84ordalont ; t ans Spcok oceupies the plac explaürrd beloco:
en top of#DS ond
sçace 1s allbcaBed -br HDFS, apliy Hence , spak and
MapPeduce coill un sde by side to cov all spok jobs on dusten.
Hadeop tan: todcop Yon derelopnert meons, Svplfy Spauk
uns on Youn coithboul ary pe-instalation or oot acess eqiet
94 bels to ntgaBe Spaok irsto tlodoop ecosyslen on Had cop
stack. It allocos othor Componenlsto Dun bn top of Stoct
Spouk'm Magledue (sIMR):: Sponk in Mapked1uce ts used to laune
dion to starhalone deployrert, co)tb' S1mR (Os7
addilion
Srakyobin
ative aCCeSs
admimis
 M
sheamig
Apache Spa Cose
spak Cone : A Is urdelyig gunval tzecdon raine lc
oe
upon. 1t
pak plathom thal all olhes -turelionabBy ic builk
datasels in
poides înmemoy Compcing & nefesereing
trtorol etooge Systerms. that inhcáes a
Gmponanl on top of Spask Ce
Cone
Spant oo: N is a oblch provides ppent foy
absbachion alled Sthema RDD,
TR dada
<Sernj lyucluoed data
sbucustd ond
levexages sponk Cone's xt schedulig Gpasly to
Sak Sbraning: 14 mini-batches ard
ngesls data in
pobm seorrin onalies H
Distoibuled Dalasels) bnsformaliensen
|porfoum RoD CRessiliert
bose iri-batehes of dato.
Mib: CMaire Leasring tbcu)
above Spask because of distoibuled
t is a distibttd ML hamecoork Geuending to bnchmado,
anchilectuge "TL is,
meroy- based Spask (A$)
AHeratirn Kkad zuone
oT y Mih dvdlaqyes agount tes as fast as tladecp
|implrentations Spok Mlib is rinx
disk- basdveasion of Apoche Mahout
Enoghx *: Dt is adistibuled qragh-pcaing -famLuook
O

topof ank.Hpsoids
 Amutation ht can model -the Uscy- defined qraphs by Usig
pxqal absbction A] t also provides an eptinigd.
eantie Oqgvaliens orn MapPduce :
Reuse of Intemediate esufts aoross muttpk Cormptaions 1h
ovesheods due to
|mutti-slogx opplicatin yhis nuxs gubstanfiol
eplicaten, dsk slo, § ali
esi <atien, chich makes a Sylema

dala

1ealion-4 1toraltion
HDES
Dead RI
HDES M)

DaBa on
Dsk
Tuplks
Coips)
Tupks
Cen'is)
Input hen R3
edde stosoae
’Number of ead &cosile epeyalions
Inteadie Opuctions on Mapßadue :
URN uns ad boc quesies on sone subset of data Each quoy cejl)
do the task i/o en stolte Stonage, shch can demnale applicalion
f exuntion Sinse

Re sut 3

oD:
Data shasig rng dpakRDD:
.aa thaing is soo in arfduct kcause due to Replcaten,
 Hebe Data
Disk|Dalg on Pesse
times-fostenerney
y Soialization
HDES lliernt
Tírme
Ore

Honat
on| i
iens
MRI
l-thoancatDsoiibled
and
butedis &o So,, muttipk
Dishibuk
meoa tbtehe
Datasta
dlsk daldalaa of
&haing (eDD) adl
MR3
opvatioehasi
ns ng
ouite
to
shaie
a
Operaticrs.
memou
Copter
48 Usitong
1o
muttiple
to
stoble op
to "Tuples, HDAS ui loo
ditk