0 ratings0% found this document useful (0 votes) 196 views38 pagesMachine Learning Notes
Machine learning hand made notes
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content,
claim it here.
Available Formats
Download as PDF or read online on Scribd
Nechin ee Le aming
_Now-
By > RI shabh DuolvedlMachine - L emi ay
pT Ae aE eee) Cet lata [n Cxpartenn
% pruice Ie folore 0vfo me.
C Pathan yeojnition)
tow ik worry 9
ly Port ercpericnce in nok bot [Date]
vy
Pry information ebour enyiniey
RE] SIRE OF dale can be hupe
("@| J. FOr pov ek komen
bin) Gries (upon ibe
fo derive patkan from ft
Tnpub > profrem }-> Poort]
v simi Loaty
Py I
New Dale
7
SAr
Tipe of NL me
P Unsop erviSed
> Super Wo
Jabetled DalafS The data hich conten a feet V
oY an OvtbuE vaniable Hob answers a Whoa
‘Is cotttl [abetted Dota.
(untazen td pakls YL Data 4 om whe
abouk Somethiy bel Joey Not heve
yontable:
® Supeyvised 2
Lobeltal pete
inden
Nani able
payer veatoble
+ Now is @ time fey batiy
Naw Unlabetled|_s
Date
Leanniny model
Clon i fi cetion
Moder
sparyer vortebley
ico®
catepori Co ate
~
oni able
of (atest
A Conterns ¢nprrnetion
a predefined ferpetr
Fito debs train
> Predickon fey et
Vortable
era
sperpee Neviabie
Zontinvor § Nomendc |
aateble
vo :
(>)UNSLPey vised Leorniy
Pees Wea ee
v
*> complement of SuPavi sed Feoaniny
7 Theve So no feayyee Vent able involvel:
> woorls om only yalabetted fate
S Pdent fi TF some Pattrn ental Om I dole +
=> yoriably [Con fede any value SY MO ow Shin |
& A vortable yeprerenb one speeitic Chetoukaisho gf KR Joba
or fetk ort SpeeiffC Inform ation @bouk He dala under
consideration: va
Sy Numeric oF Goartikhve yoriable fee ore ten
: CAlse known ay ern
& S mecured oF counted 3
5 cakyovi
Ly | Comt be meaerey}
[rs omeric Veni 15
cat oF @baliakve veritable fexpreny afecliy oy
a Char artershiy |
ContinveoS La Cicke
voniabley Veni abley
Tole ony veloc § covatable W Con fale
blw a center aly whole nombey
Sc of vet Cie inteyen yas
_ Velue}
y
Can ve infinte)
Oovonicbley
J frrtong es in cost bE Yenkud
Toiest orden) bard on Ken values}
Ey. poov ed Wyeneqee Fool C]L Coloys
Ly am one whey vole don't depend on cay ohhen veri able.
Dependant yariabley
ly whote valve depend on other {ndapendiat variable 6
Cannot be chanfed C%INY
Srrvdwid dolaty Pyyeagal jn Strockved format=
Roline Nome
goer Rurhabh,
Rohit
Joe
“Key. MSy Teceived in chet:=> Craphicet Yepruenfetion of ater -
V — 2
Devsssnnei!s
Cy Prete cf Shdyiy Ke evaulable dol ong drawiey yoloable insi this
av information from if wink fe betp of a Sofkoore -
Eo nals ke
Ly yaniovs Gof ho ee ube
Ly pyen, KR, feat, Noted
ele.
> ffs a pear ot NL which analyses
Your dala & prity out jasiphb
bebre You epplY Your olo!
& Exployvabry Dake fnatysss Ceoay
ly Te find ovr te Palin b velabion Ship omony Ke dale yorichly.
* EDA jive somm ew about delasck ‘
Aljoxtnen
ML | Ppake pnalyyaop PDC IPhVE
marae [RR
Disyenoshic Ce bys
— Fnelyay ‘
vohy Jd i} feohob eit 5 oer we
heppen? heppenr 7} | dor
Sepa ‘ 3
Grreph
© Line Gveph
®D Bon Greph Fe
-——_ 4,
" yobs
Cn
Ted ast aes 19, >
© Ups
® Histo prem a
ene es Bett shop
2 Nove af
deatsi butt on},
orm = == loth
@ Pie chat AGN
Lor KY
S) Scatter Plo y
Bey© Box % whwker Plot:
Cy Grophicat Tepy ven fabion
vant ables»
Hon vole
of Ie Stahceal Summary of numece
WES
tor +>
ut
Ninimom — ——
Voloe
@® Time _sevion
Vp eS
poe ee?
Teese
{se0e
Tocco
Sooo :
se
Yeo 2°85 gg0y oT
ke Some pyinon Coliy + . bovne:
a ee! pasplortid & Seabounc
=> Nocriptive SHANSHO -
Jae pOnteele
counk of value fr & os
>
> Mean ;
2 Standard ee
y ctoe
2 Ninimem
> Nantimym var’
ast 2 434
D> Tyrer pevankio
ps sn catutary erly for numevicad yeriable onty-
>
wy uso of PF ‘
cy poild © pelt understendtny oUt an
Ti) guenshy Khet meaning vole
oli
Gil) -zuently aay eneOOH en
kK Slendaxd eviction jelly RA spreed from He mean oY Ov
volve oy — epected velve » me
eo yoga Coe of & nor ee Close oe
ew meget volo
te 9D an Kyh > Mosk of enor we Spend OF
mo due des crrbe C)
mean, SH, Rall ee, sok, EF) Mmm
Ly count,
% Caleut any 3D vty ponds be Nompy will Shee Jitterab Yolk
pe case
$D_usiny pendoo tae
Cy forme a Used
Sp_vsiy nempy
G& Ferme @ Use
a Fam
/ n
Fin ie wlth Be Ketp of — depsee of fread on (ae of
wv +
pp se CMO cisete pri lS, nator)
cme
G v =
R= dept of frerdemr
=> Data Explo yation
ly wh?
by They may be Gramoll &% [ovtlien os muniay Volve prerent
yn te dale whith Con Create vorony psedichon +» So
to awold fp we perform dala enproy anon-
pa
ovtties
Vv
paca
i ssity _—
pei (SSE ear aoe:
Velue
ovutliow 7 a
Bn ovttion w a daa poinl
dha ay dustin from oben
dole point:
which iy Ryker Ran Upper Limit ox
Any dae point
limik Gy a AN OUHTAY
Jower tan Lowey
Treating OVNI
oe
ae
(Deve sana Frportva) 1 [psi rrensfermetion | ==
F roy Jeeyae voriable ,
independent V Guiable
Missin vale
G Nan fetm sprestiny Otten Nunaiyy
votve
fr v
Deletion EmpuFstionYoniable transformation CVE
ve yefow lo HK pro@n of maki
4 . wy changes lo &@ Vani
in aw voey fhoak ak become more Usedel and aes
fr analtyy> & mo Jetleny proces wee)
vahy Nib e
cos
cd Qublien be almenk
Ww) whan a voi able dow nok Veprek fee ifr retion
iF Gonfacny jn He bale posible UOce-gy+
unl) To devive a new venicble from an ewknce variable
ox combininy feo vertable fo Hrensform a ventable Se
Hak Ge bewme move usetl:
‘
ake eploretion for Numenicat voatable }
Fat tp ea ee ye
one voatable cho pe woth
> corel ston ay fd
G Tray meaaute of depen
yoni ables i@ ~horo do
ehange in offer’
& wrvrelation mete fo Sere ee ee Bete
corre an yeratiea shir oS ey
Positive MK Ne : i
corr etalon corrdaticn Sie
coy ebation
v
J Random th y oot In
5 andom Chaney oath LNEreOPE
. ate
sf aveniobte | ‘no path: Aor v anieble
omer lac: olhey v aniable
Jecse cen:
@& Any Yondom Volue blw -Llo +4
ET! model [ Sate Pri T+ Cory (Medel ‘Flat eex})
USI RUMPY
comvcoef Cdalat I, datac-~1)
G op
* fa Vaniaole Should be Selected fy buildin fhe model
wht hove Aiph co yretotton C Obove acerkoin evt-oft
yebot) , Positive ey VE wth fte feogeb Vanicble:
Toye >
vari able
4 >
careporicat
vari able
oh Tle metho? of findisy ub eohe ates a catyorical vari atle
aw hevig @ ienpack en He numericot variable
—AnNov
Vv
7 Analy of vorience
Nove) ye
aloe of He feougek
hie mean je AveTaIe Vv
arrow diff event fovels or
aw ewe ov welt
G tr chews
vortable
Catey orice varicbler
9 uypu of ANoVi
ee
yaniqwe yalow of &
A-w Nove
Gq ay : . J. -woay ANOVE
ate gealy with one S zp doots Wh
in dependent variobl¢ fice or More
enn indepen nk
varichlr
@Sfllitiy of data inte train - fot
red fo Sprate tte doteser ito on tte
yeni cble
Ly Before splitting) , 48
phasis of dependent % independant
Vv
Foy dvicy Hin Loe pet Use © floc? fonekion
Jare- floc [2,0] <> pthindint
in deptn dente
a Xx =
Me nan 4
dala: tlee [%>
Now bxoun & fst
tr
fie]
“Train
G
To evaming Me
model perform ane"
a da bull an ccaihed brainy
G
S
Jo eJocae or
train opt
mole
x The Jae 08 which @ mod
DATA
daa
mamined as fo how
OY! Pine
ia franed , iF do €
Qnciter guosd= of te.
i one te mont Q
orl ir he peene sey
Jala whe a COMA ene
sacat Split dak patio = FOL 3°
oe)
Tren Tab=> Fealure Sealy
G Gcotixy te featvre yoriabley Ci Qu te in depen dont
variable) into He See Tenye
# Basically Sometime te yontaten in rnaynibde OF Tenfe
may be prank 10 dolores
[preven fe con Cr eade
LS VOtiable vothy hoy hea manitde youll hawe Prove impeut
compan fe ort whith in smatler
2 Model mighk Nok predice properly
yogpet weyhe
gecaue of
sed fo find He
iene d@cenk olyorithrs Hak ta
moy poe & org
of (acer ekro~ seyret on
cConvesfe:
+> Wiad
oct cienk
time fe
gcatiny fis problems will Overcome
alts fo Hove gimilan my nitede or
Ta nok bessd fuwoaa
oth Feakne
ly Tre variables aru SC
go. tak moutl
yariable:
fe > Linean teqrenton,
sonje
pare ot
for lot
ek NeyAboUr
for tre bacd Att
chee
Lopuatic Pa renton
lp Rewer
5 NER
by por rewie!
pecisron free
ele
o time > Random Fort,
om 2
How fo — | > pneerO
' / oh i bubton x
fs Jon ddyckion {sence Morinel Dastri bobo oh
C :
2 Min NO geatsy fle ble cou)
> Hoven abaation y Renpe 1 tor 3
stend ees | ee? gee minta) | yor >
ae mam en —ralntny | 9¢~ oy £80
man (a = By)
©Linean -Reprenion CAIGo-41)
ly Bebrme movirp, fiver Understend some to
yp Cryo mmon beams
W Build Jour firse Previttive model with meo p
; a Predivtte
ly Mean will Come ovt f& be Same fev att yous ‘
Hence Mean Cale price jn Seeme fey evan hi 7
price hevse or ower Prise i
SV peek Solt prie
Meon sett pric»
v
To improve Hes mode, foler Prades Uriag Mean .
Nowe Plot Yesiduad Plor fer bo.
(Neon soke Mean picdt Sete)
| Vv
Move scoueey Len scatter
> Mod volver Metis
¢ cattoi ing CT YOYS)
@ Mean exvor
Cy Mean of whole mole ~— bule BLE bob dk coetl Come ook
)
fo be Zero -- why becan se Some Yolue we +e
Gome HE -VE phence overall Zeyo:
Vv
To Over Come Ue howe absolve Cvror!
@® Mean Absolvkk Cyror
of @cuk jndividuat CYVOK fawn,
Wu He @bsolole valor
pointy %& Men fedee a
Ie up sae He for a He dota
Ta
Sum
mean
n
4: predicted valve
y= Auwel velvet
KR = Toket number of deta points:
ne
Mees L*¥ y-al ov l¥-F 1
P L % | Sor ly-P13
import Tatar ab sel ule— evvoy’
(NSE)
@ Meen Swarr eyiey
L, game concept, bur qr e ake penclbis for Kgher volves
n
ce~ ex was”
Ms F ¢
meen Yaw Ctvor CRNSE)
distance Gl Ke Ate’ Potaty
@ Reo
Ly aive He expected aweroye
we He prediction =
RMSE = Jase
—— Joo Acevy cate
Horo moth TF Att oy ok
1
1 TO describe ie we howe — conttpe Oink
@)=> RE
te give US fee Relative Crroy cha Te senion moda wrt
Hee gilt mean YPTUsM mode:
tg te tneen of He “Sake ria”
eg te predicted value From a 144 emron
mo det:
y=
ns
ye
y= Peprent athvat © gote —Pria”
5 Represene NACNSE OF
= No a
Pe l- gg (gird VeENPoA mo det wwe coat
eo fo evolve)
7% =
Ci ai)
ize }
Vv
REPresear
Wy MSE Of Simple mean
model:
Ree [- MsECmoded )
Ne Cmceny
“The louey Hey yelo in, te beta Gy FRE
moi Sa°
tolin zy jan Root loo he OF peifeck ‘pho dal
amet, 24 kOe La nena predithion velve pio
Y mode Udhich Ja better fan meen predichon modtl
ko an
perbeck motel
bur Ja not
OLR <|
OLR Zz lool: afoe wel
modtl we Qi fry fo welvle iW wm
oor te Han Ie meen TELYeNION Model:
KR Te Myre bw which yoor infer varie exprein He
Vaniation gt Your Keyet oF OUPUF Vavreble
R= O85 Qov of H Variable jn fe outbot
variable dy exploaned bY te in Por
Varviake
Tle higher ORY Gay Re move “a Be variation explacac/
by He in PLE vayiable YQ bance beer He modal
# AS move input variable oe added fo Re TY renin mo det
The vetve of Simple R* con no Jonper be yelled Ofon
# TR best linear TYT Mion model ww Ke On Hel ho He
omsr exvor”
ne Paneer of Lincon Tex Miva
mic > Panenctow of
[i
Yermrre where
N= pependenk variable
y= Ensen dene yarieble
me sore
Cc = Enter ope (whet point fe te Cots te Y Guy)we mets ced
tol met, cet m3, Ge
Metz,0.0
ma, oS
mr, C20
awe uf “C? Increner 5 line
Shilp vp ards bok anjle
AS Ie Volue of m iner eons
1
gt Lire dow nok chenye-
fe rate ak which I vetue of
AY ineveanes wilh Teapect- wf bo
K abso incr easey
=> Goadient_pescent
“Eh ty an Ophimigation algovithey Hale
aims fo find tha minimum value
wir respec 4 Sek
coor tn ivevatively &
of @ conver fonchon
of Parameters
by Just te hit & rick:
4 Foto wih Sheps OCcU¥s -
Folle et
Random ni tatiz akon
CS aur “Fandom valoc of “rm slope & SO
INKY Cpl
so aweil ever thiey from Sevabeh 5 voc bebe
yeloe of lope m= ov “
c= meen of Ecoqe velve”
Pa in inthicly
Fcep-2]: Genevak prediction a Lae volved
K =
ye mere”wrk ACtvet
_ ya
T= ¢ tsi-9t i
ms A | Peinks
n S MSE
co
S Cmxiee -yjyr
een sid
nN
[Ser ¥] + yPdaben of Pavamein
$ anus = Mei = Zar} oe
bur can be posit
Sia i - &f ox -ve |
v
Th Z wave, Pavametr will deer Pare
coilt, Inc y cent
Payemcta
th zs wwe,
aye
pS WE ¢
fee minime™ c
Bue
. ith Side Oo
how {fp know oo vw
os % vohet welue Sholl Be we feu for 22
Je"
Partial differen Fecborad
dm
partial derivatives ©:
Gms 2D.
am
Foe Case foneton wre MC
2% Cxmee Vi) OW)
s :
he WD 29 Fmt VO
de
ame A bon
n
bo Zee hae
[Gd areaient]
wa Cree Cod
a= &Geou J
Ge leariry Yates a congient-
on May explode B bounce ook
qoitt Felce Lot of iterehon fo
time£ yotuen=
ay HIN cost fone
fan trors fee minting -
a oc Lows ac cenctes
convex? te je. of
re ae ool
Th
{
a po
pee vios yelue oF ray Nea veloc of te] yz [Te treakeld
cost fonction j cast funeben velue *
Ss Cuseetly fo“)
\
alyoriinm Ay converteLogiste Rejrenion (Alpe -2)
bo
Classtheshiony ayo
v
A cateyori cab Eaypel Va viable
wy OSed.-
et
Po cateyorxicel yaryiable iy one which ‘epracme @
Chavacteyvishe cwDAYCH Cannot be Metasu vty av counted.
@ Tt lojzishe ageenion JAG clon iicchion algo. fea
why in Het Re bear VP TEDION” in Is Name
Ly Think Thal, Thine will ons wey Fler conus
[= Tha abel Position
1 clomification probleen,
i
Ot 10 Go go
les
2 why nok lincer rq senion here . EE one Pracnk
S Svoscphble fo te ovokie - 5 Ken Theerbold Point Gon
be
Essvey Stef bed
> Interpretation of KH melt:
@e md
Here we will be Cooy levy qowh "clo cabo gies oo
its probavilily [es tn a vente f& bbs.
eqn fey Bacar sayy eyen dh
(22 ©
Vv
te ordex fT
Wick Hiy Velve blo OF 1 Wwe ose
Logik Cm sipmell) focken:
Whe _Lepiy Fenster:
Ly ft find. wbin have a verge ble 0 64
» 18 Pective
of GAY ja PoE yak will Olway Jive Ovibue pw ob
Cyven fae 7 |
Foye
) = 1
et Tera)
[heat
> TE Crsgc) os hiph Han ovevelt fPeomey sr tobe
i
> th (mato an din Cor vo TEN vere Y Comes out bo
be orHence He .
man Beason for usin Lem “Teen ion” oh
> Prediavon Conquers probabilily vetua ble o bd
= RET Union: "
ey:
Probabi lily of Orgr —> Means he beloys fe Clen- a.
> Loss fonction
Ly fA He feens we vse Log Los fonchon
si ath For linear sep remon
5 = predicked probebilily of com 4
ie Pere ck Clem
nz Nember of obsayehon
* ppros abiliy ble o &BL
> Mille Reine = 085 CThrakell)
EF probabilly > oso , obServebon dy syepande
s
oo clon 4 / : .
otf probpabiliy Logo, he observehon dy ¥yoaded
o> won 07 Gvelefon Mebyicy 7
© Con fosien Nahin
se is used fe inkey pre te model PIEAIMIONS SYS Fernediusly
sy fk bk pen mea ;
£ makin, n> nor ol dakok hansen
boner v Cviable- “oe
> For 2X2 motrin
Ly eciema : Posikve cLouyy
Clas 6 + Neqakve cen
[presi thon eS
Positive yeqative
positive
Rol
y oboe
peqative
% Con f3iem mmatrin Seve od He boric Platform of
sepre sentation for mmosr cof Ie Clan ficahion mebrivy
e Te methio ohin derives from fe Conkesion mretyiy ones
@ necvrary
@ precaton
Hm Recah¥ Precion b Tecalt hendle He Imbelanced Jateser
elicienty +
precision = predithons freroolly posit ve
Tolet predicted Posi ve
ae oe
Tbe e
Precision »
wk ayoldiny false posikve wn more
tncove bevy folse ney chive
Bay on Use
Onential Hhan
ey:
a precision =
4x8
L Modd heviny 937: Ge only 847 prcese
predithons Achatly Positive
Reco = ae
Totel Achat positive
oS Tre
Tr+TN
From Above ey
> y x ary
yan ee
omy G6 oF Achet tye votve
were prided Oy 4ve>
es)wy Recath
whan Wwoldir else = ‘
{ding f ve 4 Priowihgyed
thay used
covey encoun fenixy fedse 4ve-
te predsigon BD ten
preurion + Recat ¥-
~ pecelt > be
mdi Oy
Bue iE we Gre pok Sore From Fvaph Cow meted) Ren
FA meres WI Sp poled bur hermoore
ue Us
meen uf preuatoo b Recott-
Fa = aaa
a
preasien —-Teeatt
v
Moa. whin precision = Re cath
2 Bor vt precisise yp Recall oF A Swre Yield Re Some
yeguik, Han KO Jo we dvstoapuish whith one a
peter
bo — —
woo vse (Lop [oe]
we ne
Cos fon of Logistic yep YeraitvnThe Smatiey fe velve of Joy fo% > He beter Ie molds
= The Faviney He Pointy from athal Probability (0 41)
Re more ty KH dow action
ey fiuc- Roe We
i
Th wa performance meerevament for clan! fi cohoa
problems ale variors thr abhol] Sin.
pve — Ayes onder Corve
Roc - Receive’ Operahy Chay acienuh-
& Higher He AUC, He betey Ke model oo dushage Ishi
bebo en =O ond ds uy
C ave Roe of ea Used interthen gibility)
K Puc - Rec worle well for bolarcd dota Seb
ave Y tye
4 Ave? RoC Ja nok Soitsble fey imbatoncd dela:
-ve > +E
(got) Hor)
Yancy
Ava = Lonit
Pac ans
FPRFPR ( Fate wwe velo) = FP
v8 arp
bl ofe4
Tee CT tve Yel) = +e Ok4
Treen
oh different try eshold
Yoon tS mettod, Cresde a plok
\ Cadecut eke fe anew
Tle higher He Ave Roc, baller Gy tte per form once
of modest:
4 Remember
puc- Kot > O-9S> here Coot d be
fie model oy the delesth
Somethin Worong
oilyDRS
| [ESSE « Rers enron }
[etewoiti cation prob]
® I
ion Tra] AT Hendle bork EPY
of prebleno~
Deus
Lineow BLoqisie ,
Repe mien 2 Make yetrickons of GoUmptions.
pettsten Fee 5 poe not male ay am umP Hens
ly Predictive model
Nop type:
© Pacametrie
® pon pavornthi¢
@ Paros eee
> Mate Srrony Gump Hons aboot He form of Ie mocpp iy fonchsn.
> very Sinpie joter pteteble-
>> Sek of Partarne fow dow not depend upon He Amount
of dala:
a ALEKS mod Hat Somrmavizer Jota loukh & Sat of ponsettos
of find se € Indapry dent of He number of frorniny exemple)
15 called Paromabric rnodalLineay ¥4°
bk parcenehic At.
Loqishe 14
® Noo patenehie kyo vim
Hy DO net make Shon Grumption§ aboot Me fox
. nm
tle reppin, fonction: af
~ “They axe free fo feern any fonchonat fren from (a
fraisiny dats
ww Now paramebic metro are food wohin You hove &
Jot of date & no prior krowfeye ont volen You
dom YOOnt wm Worry feo noch about Cheesity Jose
te XU he Fe ater:
> Dettsin Tre
o> Decisnan f Sprake fe Clos
+> Al He tye fo be one Side B atl He ~ve om He hey
sides
a
ee | Probe Jovy
zor
& Pin Wet Care - a flea Split
y
A pore node
euhibits te di ted
Ite Some ON
at decision Pree > TS fo hove pure nodw
(0 Ure fe pore no dey)
gy in whith ott ite dala point
behaviovy ov heave
= gi ablecnvt> Varios fori nelory
ABE JTF < Leaf of
Termine node *
Ud) Splibigy oA protm of dividisy @ node inte Low more
node!
A Sub node dak Gy fovthuy duvidd int
al Deicisten Mate 5
Gob noda. ( Enitiak Sob Node)
Oily Leaf Neds 5 fy node whith gow not Split fovinur-
A node which oa dovtad ints Sob asda
div) Raven Neve =
WW) this Mode: A Sub node of & pevenr node:
wi) Derhy of frees The Lente of He
ook node Hat ree
lonpar Petr from Ite
Leaf nov:-y Lojic behind OT
TyPo of DT
|
_v
Clam itication = .
¢ DT { Reqreaton 5
i 8 = fo OE
Tyee Vaviable
TAYE Vayi abe
by Cateyayi cat 4 :
CoNHAVOLS i Nate.
in ato
Ly Critevia fo be USed fe Split @ decision node
Ww Gini importy
Ww Lefer ction Jain Us iy Cabopy-
cy Gini_imporiy
Ly Et mearvres tte imporily of node:
qLte= I= gin
Gir }> Te da te propabilly, slaw weryeo om from © tal
Ly Hiphey tHe yolue ) He move coal be fte porily of
fu node: Leper He Value ;métans Liner poriy
ode:
Ly Pro pevly of Gatai_ import
@ eps fo ded ber Split -
nt)
© @e . 1 Gn
7 positcm NL
aoe only for Caleqoricad yarialte Asien
Verviable + o
YY CoOnfiavoes
D Aewey pahyms a binary split
The Prebabiliy of any 9 yendom dale Poinh
beton jing te Cho 4:
pi fey compae be}
> USE He weiprted ImPpovily gf bok gob nodes
uoetphr of © nos = number of Semplty jn fo node
Jott rumbles eh sampley jn i
Pevent Rode
Above
Bue ye
Prob Play = Ory} prob Ploy © 0°33
PYOb- NOK Plays O43 Prev: nok flay = © 63
Gr. (Sub mode) Crbove bye) = = C594 CoAT = O49
GLC) (Betow pvj-) = po Losapt Coorye y= ouy
Uoeiphted fini imporily > perform ance in chon
(8) youd + bye own = ours
Lu =Now chee for other Splik Wake pix -
fri Choose He Free ile fom GT
Gi) Enbrmation Join usiey entropy
Trbrmation Jain] 2 Th filterence blue inform ation needed fo deacribe
yu parent nove QR inforn ation outed fo deatribe HA child ve
node:
ge The mote ww Ie homozeniy of R nodes 5 fe moe sa Ke
jnfovmahion Jain «
NIG + homepenty tT
[Buc Iotneery Gece]
a
Entropy = — Py lope) ~ Pr lopehy 7 Ps Lops) ~—
‘
K Lowey enbopy means move Pere nodes & [hes move Tad rmetion
-
K% Lh Aye only orks for Cokzorical bye y aviebe:
Ly Steps fo cole MMbrory af o SHlet
ey cok: He entropy of He Pavent Node -
sy Col: Ha entropy of cack Chily node.
Wy Cot: Re WORE Wowpe Mhrory of We Split.
XS et tee woelynted ertropy of Ie CHILD ode cy Greckr Kan
Ye paronk nod?) prove se Spe.
2. Lem entropy Cov Myhey £4) jer dead to move hemog enityeee eee
~ Repyenien
Supervised leanmiry eo :
Clot fi cebion
ee eee
unsopervised [¢eniy |S cusming
SX Super vised > pevelop predidive mode berey on bom input
» ovtber datas
ok UNsuper Vise) > Croup & lokapret «dot beoed Only 09 Japur
dala
pateyns in He obseyvehen bode]
Clustering | i we ty b find
on they fear ot fount:
f Taree vavioble are wot define!
= Proper ko of cluster sy
a ia Cluster
> Ay Re das Points shouts be Similay fo cack
Oho S*
The data point from
Jiver ene possi ble-
diferent cluster Shovld be os
Hi Scene d
Dees SV Huth inwns b
a loro debt
—
fee We Ana Boas
In tomewf
APPLY cotton, lie
a)
+> WStemey Sepmentebion
> DoOcumet — clusteri ays
> Emgye SEPM enleatiqn
> Recommend ation, Enypin
% becouse Visvetisin & Predrchon
ae wr not posstblez
> Evalv akon mebics
O neva
fy fle vs how Fav He Pointy silthin a Chuste, ear
a q
\
—
a
Fle dustanee of a Point from HK Centvol? Wilkin He
Cluster Sn Called intra _Clusey dustance +
Sum of trove cluster dustenn
Klopen nevi
neste =
> wime 1,
> wih= 05
> Mu dn
Enrevtie JV &
votue , beta Ke modit a
m
GE Wie (Mag - duet)
Ket
ad nee Le longs fo hasten We
Vf wi dow bot be lon fy hoster Le
Control d Chusta:
te. of acs® Pvon inden
Ly se fm evetute 1 Coste:
Ou
oKArd
q Ny
vay
jaya cluster inter chushs
puan indes = tain Cinkes Custer dsten)
pram ( Ikra, Husker datenwy
= Tle hither # votue oF dunn inden Ke belcy
pe ester