Machine learns Crm) panied ML ; Cmrou ny = Vosupevised mL = calboost, aldabeos 1 C2 clewifeakon clusFet. Opin Recmwdals z (ogi rhc + kencan g KNN evascan | Conterd Menon 4 on « hverarchi' eh ae ; pees oye User ifenn Alf bored baneas Mae Hiecaliowalily oReduchia Gem a svM PA tone (CA SVD fru ANN "2 Exeding a Supenied ML—> 0 With, Regration —» linc ov Uincor Regraton 7 oo Mebane s Muthple polynomial Reg rasion linc or Regression Regreriion S (MLR) ¢ ion) linear Regrusion (£40) ?— when for O oO 0 feot cape | parkeqe 2LPA ee A tennfee of linter Regretsion a aoe Boks, epee 4 Cquahon of chargh Ting lena | Ye mete pe : eA Pf ndvolic of tm and ¢ NZ wd ET a es da ae ae ae | i Ax 03 (3.6) —— > Yn i { + + me SSS nn: slope = Vet. a 6-4 Ha=Xy Dat dey a t 2 tape eesons ita every ¢ eee) aa a i Eo value of fa osash” aliffecs tay 4 loteceep! = ¢ Py (aye) —> (4, 2) snr tC Pro(ayte z-B=5C=6 cei the obove line eq” ix Sumchon thot teloke % ond 4 for giver value o} x we ean find Losreappond ing Value of. sho if we itae reqreui eS ye mxt co hipltlincay regrenior ptaaXa te aetate ss ot Gece, equ ; 4) simple to Beale form welloathe dolq with linces relohonslyip at dvortoges ? 1) Nut suiloble for clolo heving Non- L aia (ysue 3) Meerive-tob otaey pert mch'cal Vadestording = , pecs din! catted he} &F fine A <2 to hee purpose tt by find hel Fitted line Code!) for lincos reg tessa thu tihece Joss tunchion Comes tn picture hows for un estimated rine hid made se = ja es — Emre) iia meets, ie gel ee nolucstond with 5 — loss ~ae tT — —=—— find th loss: Eos = ous 2 [0-8 eC EUR) (92-1 ot fe rr =) aad ry ie Ow sg = & Sf : E son fo toke squat: _jocthol postkve and expels | veluc moy nel Cance each otha wud) loss vohre ——»> High Accuracy high fou value ——» low Accuracy lee can een reve dhe mode! by dorms pphimizohian tech nsqu Called hls tepals the proce oe fee poramile cm, 0) for , min igrodive Aeycen{ths will Step down unkil (Gi diunh } global minimum by itecohve (ro Cas Ja mochine learning i fm (onj\stdm | weu- bdo "\ oJ -\er Fro | |ye b- db slope us fvgeialsh Mt crcent- b= bras. . = learning rote: if ty mognetud: af chonge thel-yey wont a inielcc during tteroh’on # porkel dlerevohive of foc function w-r-+ m MW oo. eae.Hina kerdh andih tans a | yz wx+t b ; sa t ; E (uerqnt}—Chrecr} 3 X= Indenemden} Variable Zl N= dependent Van‘able 2») | w- weight aon a bist eh seoloxe “Lose funchon OW hd ws ae Coa ehonquin 10Cs nc Rano ct - b- | b> b-K dbs { {Learning ea istuning porome metey tn on ance is olgornthen thal determine hep size ot cock etl uh ile moving word minimum of lows Funckon | ays s = a aifsish} i dpa st Dak: aha) KR. 2=0 if ; Variable: have two of mare then i ee c ich & ‘ r_MLR Wek ee Ce -dnXn th. e od | ; : M2 OX tO. Ts + Og%at tanya th + & i =n predicled value j : aoe Creoy Value - BPage — Line BRe gress a ) 0 care five main as Jon tin linear Leg recsian diwdia ae ane dot ns one aoe output) lincow VY Non lincav(x) Nokolc Selig at cient Leoture Vetorg be Murtrolh acon hy. it mean there old hy inde ee ahon amang ther it viele thos uiumphun +h 0 om good| ~ (& of too phys sueohst )h ‘collin thy |e vif (VYon'ance InAloh'on me ‘ | hake qraund 1 then feoturt donb hove the fe omd i} sp v1 ¢ or more than thot thee that | pech'cul ov fegluri hove roll coll incaby jase and need do remove if s | Gnubher method fe bv find _out corrdloh’on behaecn al} 1th - feoturu Heokmap ) = Norm Rent ple uhen afte {eniiecdea eel) plot oe graph | should follow standard namo Ldisbibuhon means —nazcicniam error sho ic} Ground en = 10) fe feoenel ae et Weep kernel deosiy ethimalion [ hele) or _Q-@ pl a Hl = | § I / 3 | \ = a \ : SA = Zo z | kde Q- & plok - | (Therchecal Quorhie ) 4 pssumphon 4|: Homoscedasti city Sor ScaHerd | pred Spe est h 6 i Jeatteec if th tenes E ie a As oe shully which toa deriroble, 0pred X (desiroble ) PITRE ick) - ow do check: Seatta plot (pred revidue)) | Pern: S| No auto couclakon of ornar. Al Fhe erro Ener hould nal. Ps Fatpcovelekon Negohve dertycorrcle ken i nh dectrable) €derirabte}- dy check ' ell «plot (raiducl ) n chart: | _Seveciky —eutichon —Lefecce linear Reloh'on High 4 Mul collincarihy wore Nei ) Normal’ ow Le Ee Vea osce dosh'u' Wegh Y vpe a land for muttinls fees Lquahvon ys fot Qi Xi t Oar 4 fang te FE 8, Xn Jet Opalical en Se 2 : a (Cenand we ee, Eh FT A ; Baas An lonverk % —> a am! x sod dete bd Hl Iss oe es a et age iia fuenvle become furtimpls polyncoral Hl Peqressi on i Ape fo + Pix+ Bin Fr _digree 8 NE Pot Pyrct Gantt p pak Now how we will bnow the pevbed value tor the degree Atnes thiy| ss Hoel) Ap iichatentzc the he tombod (ies oer odds po . f Variable giv rob ind. on'them + ausumer Vral the errors ave Ca , one At | uhtbuwed with Zero mean. and ata ees! variance any thal thee ina ma cain Chih tichan Woh. rmorthod Lite 4 ts ind pede} vonabla ‘hs I d rgb f leash tquror thousd ee ial) b [3-¢ 81-6 36 = Ge eee ee F | Fae 4g Cis fle l4o-> gel Tieca» equahion weshoutd ey ihe Te ae math. Ny 2 hIx — 6-83. TN Le! tat it. fo vw N Wee nyt o-41(H)-0-83 = 3-44 ae Eee Seas Gis 1s 22 Wee Spee At Jee DE KS : acon nor ny depedee| Yanabli stahmade! ee alr a #reoding dolo from csv — di = pd-reod- csv (‘tran csv') ah defining fhe yartobles dee AbD xe!) dofict O ae Dy): dhe!)() lap adding th cont fonk- dere 2 AL 2 $on- A < # performing regrastonond fiting mnode| Foul} = Sen ois Cy. %)-= Kt O- SS — SSS yo eaeae ; i BA > ype sh fast occurouy & Ventp ou) " gems th ca it ae “ a sil el ar aia o> ; ; mee ; au bo poi Pa GE lire mi) LZ troutd he fre Mins hich pas yy Aye 4b: hoa paint a) is ae os a Nota) Nod we have? Convey our mod ef ty choose LR anPage 4 li ea Ae ene) a= C a Soa Shere od Penal ly befor, wo L iad ey Sie _ A thy fial term rs coy a par | Re! / m= slope. Now we will coleutale ocr for beth Ine for naa with eer @ | Since linc ts possiag (9-3- 0-G-les) + . dheough both potnt (8:32 WE) (0-g)~ | pefechy dool's wh a F LLidom bit be zea | > othe cyt ¢ cong) ™ PEyornEGi nia i el 2-08 = Qs xe the nud line Sper gist model althoug PC eadlin cist ‘oa ec 9 Jvace Yorlance 14 eet a 10 os mn ee al a if we hay mvc than ont toput Bis peoelly fe) > (mittmat) aaa D (mitm.4 me) Arr te erg hap ba a } fabled tt —12- sana 9c tr. regulnja.cbtemIhe Pitdqe teqiuiiva we have seem ——————___ (eee yyee Dd {py | a | (21 | a — pore em (at Se td eine 1 SSS ae t tor fea tr tk Lowe fe just onath x ame Won_ of _Re'clq « —__ c re : be = (yt) Alen tH OR, 5 S mye + ALlwits |welt oaths +1 wal In hidge regression for Gry voluc of A ther wee o Dany | liom« volue tor Bac of tn puf feature bel tn ote LE yuu conkncusly Increane value of A_al cesta'n I panl You will ere value for some 0} cocf'ye) which Lan nol tesparton} yo hea we unknowing doing featur Sclechyn amd it sy odvortoqy o aaa bh, ing 00 1, I leond dupe feohues ore nol tmp we prec Lane ovr Ridge dHig pela mare wuodly or you intreosed, mn nee voluz Dsl he peeve ar gradually pode Zero peeliae A Goelfry' eee Vals ' fo is fn ts ee eg me) you on Rias Perit , eno. if A_increcou ovecti Hing detreoses (4) fend nets in bins 1) etn High Miomaniea eosin 2 ee overki Hing A ae=a a 5 unde filliny Over thhy : | ce dy sgh lagen F | I 1k thing 2 laws bia, (aes (aS E se ee fe te | mea L a ee | \ J i -Voriance Trodeott P I lal te torpor tort to Aree ee prediction eurore i _Chias aod Vetiance) wher ilgicera es po accuracy He ! Ln omy me Mao tho J L t | thee tc frodvoft behaeen model's obilihy do minimize bia, and Vorionce Which j, re] uel fy @) bes) snlubon for sclechin. Conlon 42 vo) us of regulenzeken Seed dh pe 4 LT ng, ae “wales o eleven uhile chaining tithing let amt model ond correc! volues . Qet Tene ry wt lf wait ee eva [a gy a Wal a, eg ela cctodl Cth lice drieral Hs ates Ee pee oo Aale foot like friloug* Bia Varina tradeoff! i| the olgerithon Ir foo Jimple (hypothat with Lincor eo") the a teary be on high bias ond low voniance ond thus: ro i Lerroe prrone - - eal tf eccov Ft foo worp lx ( heppothee wth high degree Lequekion }. then th Daath he on high Vanenc: anf [od TT F 3 atthe loHe cndsh' obe. a lot perfotod Well. Hues i ny chdeer both of. Phere condi -fne wal ad brodee} ey bias —Voronce hredeoff- eet 7 - E y f= AYN 6 ffsctl wie Cegulerts tlie ee Luis funsion (ows fun chon '= 1 fying \% r ae 4 il rmconicl hau. ford! on eshmofed volue bomibye b Vv jf we are treinike on differert models +R, 07,86 dp bnew which Paealtl perform betten and whivy ofombeus- ore beter Jou funchion py useful» P io | Clash Nelda 0 pyle br-) 1%. phis Cambinakon of. S both regulon ch'or bechnigne. a 4 Ly Reg = Z (yi- Ki) 4 ¥(lmb + Ll) a n | | peralty which vismposed on pooPiibe (Lita) lea . ny is ns L af (1s pce Cbs +c}] Nch'an ne Gar oO a & dae alee Lasso. eo RIDGE MEDEOGe = sors. gdaqe Rmry Lasso. Beton ay oe Mato dq Fo Dus an plete tee. era 1 tha a4tn hme series ier » is OE pod! berecl predithin [on — naa ra lon wef ia} esrareamnerey icra ghe weoor overat! wed L i q chou Lang tex my oloto ga a hee (ra: pl ous defluult to unde shana fo overcom tha we ee techniques cadle of Jmoothing ae a Hil= Th hoe » a lee 1 have rassfoa| doka “ 7 Mie h A Mey: wee Fe Mir9 la AN AA NY pee Ye Where Mi ~ Jemuon Me Febery ns - Morth, e Hor window wre 3 eee YAR Ea No? tet Yat and 3 Jo y Eb dol tf ala adele i pink dine they willed howe one dalepuirt . 25 window s'2< fintchos and lar! two wil! enced enue bee 2 yy NUMA OE Vere Nig! avis 6. “bs! atv {qi riety 4 ces haha seihee ( ot [ata t Vs + re leah Yat Yst vy ty: tt 4 ‘| a) 4 yl ] Mine Mit Vo A a hy fain high peels do past debe aNe of tr [Are Jeosonaliby Nerie | fied opkeum winded sire ie ind seasunclify A Nore subshrect head sFrom onigoal ola. Lb have dota 200) + 2056 7 Y M PNAS SDA espera oe ee Mvo Bev NaS Nan %4 rey mega Aseos dst Nie be Bier Min) Tes MitMnt+Ma ote > -Matmstmy iat a ir Palani sett A sith Taye} ot oo Teg i lo. : sy = feb> at tt tog +. nj e. ‘Tio a lo. mgr) Neem cose) - Nia? Yuet tase Sim,©) Simple Exponh'of 2- dirk opp Pinkie eleernte hime [Series tehere there sr no [ene no vepsa.cali ty. Doublfrpenbral >i} icvaly perforencel gos fm Jeolane dl Yol4 wreke'r model - (triple éxporh'al ) a 1S pecormed q i well wheethac is both bead ax wellar searone): by when you don} (now whither bmi series hovi rea Be seosanels fy then holt winter ts hel) ==? bronphe Cocporh'ad R= Dow Dy Dee EO Digg Draco Dao) temp at beds abd sigs #1 toy, i TTeoclouy-> (pred!) bal will be the cai uso oo pacclack ye pen mero? ctubihg Avg tbh that sbvele |. Ke — @ bub his nok good eacthod 4ince cai comes a lot throught pe summa wintey | one ther wo 1 Wwhahever trecfodays temp if otu ee foro morroD . : tdoy ro op? Eda 20} ae Te abaal ool _Averags umd Taly = bs +), hy bince then itne previous tecord Nornl wanDords\ ( Page x it reartong ¢ thus We wilt get Degas lL cbaoe tl digg tl tage te ath eo eee is aa ae ae thom tutveel dalopaial wnigblegs of cneptivial_tedace { cee gee fuonpla average a let trie aith cho Example. Day 1 2 8, £ & ££ \ Sale leaps clio Leary : abd obstish, od pes | Lao it $v a L enema lenack oot Al escats I Mes Lah Sue eet = Be" a ee me a a Fae Sikes. NOs 2\ 1-6 47 , p 2 Grom 4.. which ir nol true.to = Ling + Yao trov + (bag tTaa) +14 Ywo ‘i Hod is cdded, pease Ah Gj pb Tag Hh [ bees ~ bay] Pee yy, ee ems ai bu eae... mete fy TH ert tne, aleulale Local tye be — Dee Grit) Yeey.) Gamer ee (icra tee by) sf BE tia dlunslen Pen co tee coil solu Problem + bite Simple bxpooh'ad 2 Double Exepenh af .| és Date: / / \ | | a) Day ——! aetna ne. | dies . $e eae 4 1 Ft re ; = ee et ai Se Lcsyl t Iso ary Bs [ae Ob te = ee ep) | [iS 2395 4 4osa 46494 ~ , | f he wat Brepenh =@ | ¥ I lesan li Ya St ia e + { { | iL H 4 aa Aiea va ; aa [oy ep ot Ta Ty ot i if ee Yan +11) + ye (yx) Te 2 y, (1) +My Cr2-t) i : | ees Vib Bike eee vemos |e Fon, (ely (is-1) = obeys, piace E L ee lt Ly sth eh + Lb (4) B >t (rsponbd (a) > Ye (part 4) so = Orta set las : 2 OnSite sa | L oh as [yee Aloe fied ta] heu) ty wa =e) a opie meen Ob} 375m q 24s OS SUG BiThe? Fetia® = a 4oaE Pra c Hee) 4 Yn (3-468%= 2-396) _ bo: 1:6 92 eee 5 oe Subs O:eirl e Yo (Lu +74) + 7h] i fe esy ts: Hoty eA () : By preg ba. ee uey v Efe ame lice Ey Vetorsrryel, (4 64a — a: heez) Pe O-4 40d + 0: (1:1444) so-4i4os +o-sRger aa hy 6 BRON) OF SG ok [009 hela a Decdiskec) de Expor h'a) Arby ae ES hid 464 eh SS Ea [lied ie tapecancef.- + sbenamnd fy ae sree ar eae we_will = - oul tread os woul ws Jenson lity dim sein dota. As : Cy Mai BY Yoo ft Ly be La Loe o e ecole =pih 2 tae Ta Bina o sane by §; Sr $a $200 for 200 Months —» 16 yor ~-4 mensth for scoson |ihy = pecrodie heme of yn mMuaths lek fink fone ei job double %cp on bial pablen beach’ ; r Mis) saNpeSavMiae S000 i ene [beoe = Y (Lia + tiag) + ie (oie O- Hie Wierd Kewee Oe tibiae) Kee ala ae — Fro m(1) ttl com a dy know to ee | Lroe we subsbact sipo From Yr 0 Pan Now $706 wt com do Nooo -lroo, Ee 2 Y, (tte0- 19) + Va Cynat-Line) OS)ag || for Loo we een (cris ree $290 We Re Ace : tino = Size tne eg” @_ Srio0 =S ap hase a yy ( YagtTiaa) tl, (Yroo = Sie) PAU (Ty auanntl 7, (C Lave —bt44) i Vy, (S450 71>) SVD Coes 4] | umiaory 4able When we cam vhol rhourd be ‘ hy perp avamel app | futur jreds cs Y Louk possible local Avy 2 \ a ; ih all future _preduchoin Daly becod —_| aud: pouible neat Avg k 2 a L changed frend Paes trend ond! local auf ‘aia me a rents me onal Jensanadity. — ranBasically then o i |) aR ee Mp [Artal a a)ARMAL hy) RAIMA | AeMA | Es [Ae [wa E 1 teat debe pour be stobenery ih rocans lisa] Pee Ds wl AL, r ( Stehonory NAA (Hat cfohenent : I i - posk dota gad. nathiag cle for y peed i AL! Movin veroge | future dole is only depen 0 nal outstdus focor, i BSR 1391 as ob. a fs at rl bot, oi a( \ Pee ceri keane ina gM. erp fe ee Brees alitetb (ut {a 4-8) Bil A RD) Ye = KiMe-1 TX Ve-a tha Ve-not ete . Ata) How to select Berk posihl: model. AR1, AR eg SPA etn bard on tub dota getura hich ewer wil firm geod wil! final: tral . 2 Moving Average Hece tng eae eh ee By —Taki of Jere procuch'an, which elepiods upon Jeatang (grain or Fut) dicts nofucaf Calamoh'es. : s oti 9) Nut. ‘a ameanyes ee -£y Pa 6 pms fats HE L Mes dee tebe, | MRO) | ne TT babycrr (olen dota ai. a eT yn)— Ce bore Forecashing.. NAR Mt . frame (4 R+ ft) fl ale vi h mer _itsel == Fama = | pay a Q—> future predichon ore complile y deprnd on par: clalablli iene pus wopy o} regres ton rnocel . a > KxXt At € - ee eee j variobl. predichin > Yes oye-t+ Bh e aett) aan IFIP depend on one past post dota ae ae yes Mite ta, 4e-2 thaYe-2 + Pt & 4 I LIN aol Hells Yay here Yolrday lox fo sRwast | ARIMA Rips! srt if ie aa __Aince they ar cuba | = 2 cme for_dtotianony pt sa port Wp —% Meving Ave taf « hee future prediction ; | La 2 “i re ce AY, te ye | et iz | 7 | or due i slo + ere) £) |<. | &s ee ee eS | 1 am a0 Miidala tr ool 4 depcading on aul isp & fe COB An moving Arg (wn yaa sR : ede ; - ay + 6 Smee to Reg reat (A aaAge-| tare-at ete ma(2)> Ye* RUSTE Nek tein lab Pee aee Pte. th exactly similor do Be model only difference ts lead of preview dola hue exfenol forctors or int Jntuafed: —- ARMA (1 1) . aR Cy) a BeMn ths) 2 Ae (ie) t macy) = yp Yen +O, fey + Bo + = TE Bpee-1 29 the ib will he AR (1) = Kity a t py lenp + O. + et - aDate: / we tanec ele -o| fr there three mode, 1s _stohenary we qonna din a made} sepclol: MA {ou Med obra =e ne Bae ; eG [2 iL. aad ce 0/0 Ic nol powible par wehore 86-1 230 ARIMA doun'{ care about Be er ‘on of ARMA pela aak a 0. al MoVvIN@ avec [oe 0 EF voc dola from onginal dota follows ARmA Hhen origina) dela will mush follod Ri mf. Yn + il Zn alee?6c ex. ar Rank pelance of Even month ee pyr abe Magi A ANG) 7 ia Ne te (des) eee FY — addled bul clue fo iokecel Fiji: yh. Aidiw ads Zt a Zp yy=hy fae eB ced dala. ed th wecghlr (sf will mn © Wwdi fiat Ta oi cals reloh'ons ship peed q)_Sensehive to ow lien 4) Needs to lorge lelesern Moth Behind (oqubic Regression DS -4 -3 ° 3 By ° ° | ! \ Assume ° zz Sx + lo Ny eae Al \uctiehaan a ee pase 1 = 0, ee Se 29) i trolz= s(-8)ti0 |z- sto) Ho |z-e(e) re a Bs i ta! Eat erallo, BS Ole alts: ess ad Rea edvaltiewe st 7 Tae vine SS 17 (res! is pe e Fenty lechi ls iat lich 4 id ) o ah atas fs velue t's Henge Positive Riches — 4 ee Fos nge_negohve numhey Me ay, Mees yooh t (lerge porikve num er) es inge D. f ctor_logietic Regression Rea poe sa ierak we (es duschone ee fegression ~. + ZAM =Nored) a f e] dunchon We will ack mony caf minima ee: an a iV, 6 A rc ." ers 9 > 1 S$ ee —> i (¥) (Globe minima) () ory Cross erro p oss furch'on (6% ~) eee EB ei oT a \ eef]s=(ngL ee vy) —- oy or oo 4 Nile tol i} (jee He held ie a: Fue y A(t 1) tog ile 0 a = log —tlldince: we Pee H aon anlites “Lots funchon value E hence yshould be ec large Cham ¢ o to 1) | if ih nye eee | the = logy will be very large | a _" 01 very semast burbs Oe pene when yeh a ae When Y =o a 1 oN ae _ eee i Cree)log(iey J) ——— 4 legal isy eee War} ec fn ee — + thoutd he very. Jmal} tre oulpmak'eal | =(ipe—= y) uy) ) Bee I be uc; peuuy [avg e thts = leq (icy J woill he ao eas Loumbu or eal Sena number Cost funchi 1s nothin f : ia at ‘on a ot pbs Macon overage of [ore “| Loss Function (1) rm | a ZT ra on police Fan Siti eer —___1ai_cempored tp cost et Gi bata sing jst peralky for nuches of ay ol complete bo. A. loss furdhion ss F a ae: ey no er we Be OT ce Saga GET 3 wet lay a Meg") a cposi Fon of hypeplone a depends upon iuppof Vectors ome oeniie ny. tody ou) hyper plone but ae. doto porol can't eee yieliintanececiiela eonvert inde SD whe we com tepuale the dolapoint- he hyperplane na] cael Src als] 7 + T1o—y 2p and sepeole hy hy par plane Hy per lone fl Gnce@nat so)’ or lane rae . . dolo point in 0 _ Cs e2) teh ape and icluccal ae ws =| fs CEN, f since passing ; though ovgine } i lel porameberr oF hypaplane i sare [n W whieh trnoth'rg buf weight W => (mit) =C-1)0) | eeceeel amenos¢ of Ww Heaagencieers4 2 Cposihie ) for molrix mui hj (eaten ho of equal feszno -of rows ofee far Pr (313 4 1 eee wine [4 (eu for ee poi mel acces Bud N ee ee @ _o F A e : a ° ° ° G i | ES ieee weve wtxtb = label . i te ee +e o 3 b r aa ” vn S45 rt eK ! TA) { ~ ! margi E ad } hey | mo—e Cqucktnn of poiel gy Fh ee vel K ? voluc any ° ait hegahve Volue. aan bsg b= (ayer te equahon of peal or red fener Niece andih outtnu) volue —coula be any ce a a Wty, +b = I ©) wtp tb ==] fat COX 2X2) = 2. wt (x1 xX. ) 2D. dine both sf a (ot it ag = Hy Mw (d01= x2) > this ts nething bu TON ages ene of vector and vue -l wir +b ¥ -! ( lobel) I wtr; +b > | . LITT [ E rox (_ 2 such that | 1 7 ee = ae) wt +b <= Wiki tb» |= Mane =S——_ : —fincked ousting [AN ne con ln bry Mle—ahig, i Irwit er mm | Bal hails Lente = a eae & Oren Hey es “ae a J (we aT ek For o Numbu- of ertor Jame error -fo avoid + een ana qgattush oh thoi Tl he gid andfrain ond wsitl bed fo fest doba) | atte En SYM! General funchon ofthe Kernel is to transform the aaa sc ob do ofq 50 thot non-linear olecuston surface Com We transform | 400 Ninos equah'on th higher nereba pf cimension lilt tefurn the tany po wduct hehoeen two apes in stand ore feoture cltmenst on aoa a8 a. wee Hina a oe I ¥ Samal Type ol svar kened | D) Lineay 2 polynomctal aR | Sigeno td . —_ od’al Dans fundion, (obf) a 2ee ee OR ee 2S SE EPL GL ec | ae You fry to plot % on thin 10 Une. : ty te se 6 6 @ 16 0 1 RCs Hone of the line torteld ee ee 1 Hale wh we ood anothe feature whichis funchon ol pee yas | DESO aes — Becta te (me J _— Ls, | Ai é ae @ | ; 36 | s | a 2 a | o2 eae Spuable ¥ co i i T : or ° = ENoweetS a G4) 2 10, Te ee 0) ot il LLineou kern ef 3- Kk C211 Xo) = 7 Ra Domta keimed, tae (x. ,20) «(ou Tora tu dég fee _|] ie | 3) radl'od baie funchion. (cbf kernel) cee - | K (uis%a) = exp Cay -lni= aI") Pathe hi ae i Fywleidicfan dane k pi ie Rex ve) 2 fork Co? xi tate) e |Loss funchlon fr svN classifier et Se @ oo a 6 5 @ || © @ I Morgine Soft morging [Hue rod) fs giving zl reed occ foo f+ Soy function * for svn chossif'en "Hinge lors’ ty used cx flow action , ik ic one of thi type of lorsfunch'on Mainly used fos Mmaninnum mmargine (loss; ‘tchton nuode Oo margin Bas bere Tits 6] ) VE ifoe correct classifreohin | G7 Doe clastificahy n Ks|| wile | = i ; ae | \ = incorcectty A Corre I clansifed i nel urrong il ‘ae tel bee) for mtsclaceFicobtan ee w “ St ae Te ee oat) fcc aD > I+ | See eae a L both are brah loss value Nowy [al Fo exiveeh cewstheottag So ee pent ee (o- (1) C1) Gala) oc! oct | Ey = tia are low [oss volus #J_UKNIN = K-Nleorert Nurghbor , Boren iv cea conde ci naan el if a f et i fel SouSveqreman pmo lem see sills] Kestntien baer of-ecard Pecinhhor toa nu ualnoan smbo| ‘lx! 4 whenever nar clola will come i} nw dota ti clic He 1 hin pretichan ill elas! 4) athe ute Unt ‘SAE: Si, — In—quactab Kis odd pu eet pa hatha ls 5 lef onc) retonclinya Hane exten | easily 4 é 2 is oe Now we hove-po find nad slr) @ se added () A @ 8 6 7 (| nee : A . ; i Working gf kNN Actg onthe on 7| aay Now. bod anther dickonce value orl Hem 5, f | astendling order Lions Q oath Bb Nand iP choos the tap brains rom s0tked so = Sates a Se we | : crite oa clas oa dat poral ba. mae Is Lap 5 Lok —— | | edi tomes = ce 2) fusledine diene Tina es HL =| 1 Cove | t St h Fi II [ M.- distance: x+Y. ca his ia for cleneoeonon problem 3 } | } Now let yee for tegrasion problem. «wher vubpul ir | | cankin uous dole. €-q pmicc of house. | re this similorto classi ficch'on only AiPrence te tail skep Wher we were comidering mok frequen} class here Fyork kK number of pu pul Creorek '') we colculak thule meon , thekes He oe Limibohion } Nok opplicoble f i =f Pp. 4r_huge do ouch sina | Senithie to outhiene 1] Mh icty Balai Vole LT gy beeHeston Tree. paitliieiic ll PR gid 8]'e eYat gn [ree em PN tes BE Aid, —— ee zis safc iN Area ing pee ™ f lositicohen & Regreaiion. ———- a Bult Decision Nodes ab eock she __ Lat andes tomo BY DL Peerples ppecion Naan oO) eee il Age X30 > Ya No F | [eat pizza cil Exner {L i yor “yo 7 NNo = Unfif 7: Fit watt | ———— tumirslagy of Dt >= i | Root ede | F ll Yer eo 4 Sian SSSSRE ov or | atueal Nedel Internat Node | te [ue : a | oy oY temino| Nod ine eon) ae used for both clawiticoh'on A, Reqray ion are A intuprete I 2) No need for Normolizohon or scoling / 4) Nok sensekve qo oulli' toy.7 [Xa Et uanln bear [A> -Ouerfi oe nal changes in thy eee eh cousin _inslobilt | Ds rt wdy hig phigh — a Somme_toncep ian Sahai, fale b). Loformahon Gain Gini Leaguer Fy | lof érhopy u iah cnhopy _ 2 ow In formoh hion ¥e in : low Ramen gain: High Gini Loepum by ot ehh Lenkaak fakin do ust allay ———__= =} a al ~—_ Ips. oma hoawe -fo 1 biSS 1 | eee sea bagging and Randomfore | deeply ae = . . iA Bagging classifie, ensemble _methoo| thot Feta. aa t Wels fin ans on _rondom ves et rf the onginal alol org _ and then aggregak tha indindual ae on (ethe, — ! by Voking De areroging) tb by foim fn ol prediction as — a Ta understand bogging with Deu'sion free. Be ‘Here we will creeke mulbple Ofdsion Tree post) deciston tee ic hy per porameten tet soy ‘fo’ Ond Juppoye We [000 rows doloxt Now howto = dust bute among the lo mode: 9 i tfwe Spl ria in lo eoch model will gel only loo “rows Ai nce ih ie les da ata th wit eeate Wiel secs hl Heli | Here at poe techniques Sotsomp) ise te i 2} simal tandem sampling witha ud replace mente _ [Example ed Conlainer having & e b SS alls. 6RS w/o Ranleren | GRE Ohhh ahlite n/a pe = (ofa) Soehow _rman WwW ro - ats yous randomly are aa ps er ea “people ee -4p-anlthin tees eek a Sania features) aa fou] [on] a oT] (Yoo 4) ( Bo0%4) (Poe xu) (Beony) ‘ 1 I {imp tandam tam phing with replo cement : ainda ils time to agqregal rau by combining methed ov _ Voting . : Nlobing 1-H to predict from clan lor clas oO sDih\nets | ‘ Leo owl of 10 Dingess Z . . gpI \ = One | i J inthis Case due to mayen 4 inpu) ov be -qu cy helong to claus|| Random fora = lo In 9 : i: ; f Nee a: L : y generally %. Laren 5 regraston problem = Fa ‘ | + huyperporomebns 11) wo: of recs YD Noa of -featucer 3) No of Dalapointr ere Be sec ten Mic Ne aces \po — -aeflem gece Boosting oe 1 Adaboost badiake eee 9) Girod iis) boost as ay BX Kg boost . : 1 Adeboost- alse called a Adophre boosting is a ||_fechnvque_ ta Mothine leorning wed ax on eee a | pee model 1 model & modelZ dowus improved foun imped i cto 200 dolopuints 4000 dolopoints o how mony model need to creale thot user con decide Ife etbeots hyperporometer x [esas y Pip = Nasa (tact = RE = Ne AX | t 4 @ > no- vf Frotures Fo@ | 2 6 @ n= no-vf rows ; J | 3 £ e 36 with Folaf {2 @ndihion we ton og” } a 4 | e Soli DT for Stump. a Ss Su [el soy 224 Piece || °Ay ye No ie a : reditted ¢ Blu { Actual class Predithed : I Red Red F sl 9 blue Req —¥ Wrong predich'on } 3 Red Re | 2 Red blue => Wrong prediction | + blue blue | el 6 Red blue ——> w rong predith'on a 3 blue blue j Now lel understand my dishibukon of fou - | i earlier focus New foe updoked forws- a Wyle, seers AYA \/le ole ee ee AINE la vr — och Vig ‘NG «| eS OTs H)16 . (fz- sx Vig Vie mG ea ee Alte t TE S707 Uy Ve I Ze ly | x old: r ron D need Mnprove —> I> CHGS fotus ond tab 1, 2,6, ott Score] will & reduce (US or wi con o ed tt i $pIe 8 REL Penp rave” our ot bop 2 fay H+) Suen of _updald focus should be. _nel_qreter th ae v i | ince new « ua we !6/py 2 11 toe bey re J . | taal ie — ————— ze - pan ee do so we. divd« New focus ‘by yy and ve we sk “ >. | new updoted focus whose Jum 1+ equol at ik ie eae : ae 5 oi Hous “hich pial gel_highee sus [stl gck— “te 4 igs prio inner model and hase Peer ae = | ener ft ill -_paiaoily. 4 iaeret| model i model | Sale i Alaa At Ballad ane - 4 ¥ 4 1 wed ke fe “ia is weighty Ee weigh N. elven gall Sl an emean ie iol | Sean ughl reccivicl hana ast nod ef ____ | Ai'ince a fink = - Wes ik will repeoke one hare And oie} = f ik with er | ea ped wh Buckd range 1 4 0.0675 O- 0-067 edhe 6 oye 0-0 616 0: B1ne (big bucket) 3, J o060¢ | 0-3) 0 3¢C °i4 pe oy ore ote = 0:62 ( bry bucket) = Q 0067 Or boy— O-6etyr +l ne ou O:brar— o-gape (by buckeb) # | 0+ 0624- o-ga¢y = | 6 Cima in hig ranqe burket Aichce Fa ahton ah OF js “qeHing fous ir lt while Sampling with replacment,it \ - ergs aie we-tonsrder conthon lor reducing the fous bul how we ceu'de phic SS 2. for Im tieariog Z I ae Th reo | for ex error ¢ ic (oy. —¥ o:| Ryley os) (<] fondant i | finch) are 5 eee errs OV oa Derg 18) Ye IL ne _learmntng rate Gl coud be Fromm 0 fot) a 1 SS i kk > fog/ t= Ewer — i > fs log (9) k= Legg Jo tn ae ea oweas | predinds h heed nf 2 for 107 Errov we woud pred biply — I Ie Dindedola fnto train ond beat: Creal, weok leoime (stump) " ColewWokt error , find muhpl fcohon fartor , volue of eed ASF update the fours and undok-th: dota y-crecl« ned model - with undoted data, 5.7 repeol skep Zand 4 number of dhs repeotolvon equl 6: to numba. p= models. Combine models -for Vokeg. 4(Cre) fourier Booctin fn fel understond with People | _Groclient Booenng | of regresion problem whichis —— A 66M _ Wmparc cl ast “cont eoyspundes feseeig) capa Jalon (heA) zi | 46 sa 3 S | 0D + 4 |= e116 c & Lz |1 4 6 = | Ro Sa a) — ve will treale 4g todven| Bowkrg Modd of 2 bare ee) prensa [rie ERR Cmeor) (07) Cot) owpul of Fink model ie my will olwayr Le een of low pud_o« forgel culumn of eee — Hue wre hovethig 4p —» pred 1 | Bee csea i leny td plate ee ict § 3 etae [ope ep -o-g SO og eh Wo | 6 es Li sitet pa eS 188 1-225 [oo || 9 ¢ Hog bo ha 08 (08) Onde Se 3 2s ais ln Plain A sic | Sc ee In order fo tay He error dane bry ‘Nh to Ma we will — ‘ tolwdok oss funch'on of My —~ = pe I > Psedo-residu — a Now we will train mode © which ti DT for whith ~ > fopul will be some (ig, Ggpa) bu pod} will be 4 pedo turduef .end not Jo} ary , Ppi aes ms ae _[neesence: = Here we ort -eleing to medilido fetus | thal how mistake or error tr model | doings _ | Dectiton Tree hee I model 2 Beet payer [ Cpa #4 g [aa es [[eluee haw would i predict if 1 would hare & Bm of soley two bosed mode). pudithen + m+ ms | deb coltutole fori studen| 4 ( qo, «) | 2 ee + (ot 8) { Sully Ce hak 1218, | Stedent 2 (100, #) 2 Ase t (-o-8) 7 Agog = studen} 3 = gfitidink 4 = ¢ | studete = 3. are atl équl adualtacqel_toluma-deas— cf acl bul will nob Hae ome te tal doko. thol'y why ae We odd leorning rele- preduch op = mi ot Ly Xm Gener ¥ (1 2 0-] Now tfudlenl 4 > Oe t Co-l)(-tt) = bet (- 0-18) Sh, coe| Now Pe wit cal culolg mene 9. tr which we shoud bog ~ the performance eee 2. 401 thal ogour we oil S Colcutok psedo reridual - : meee | Niedo= resid : oduaf ~ predicted by mt ep = a — Cm; oT km) ps | > 3-( 49 t+ (o-1¥(-18)) Ciel | = 3-(4eto-(s)) 2 3=C4ro-1e) | Senet hate, (6.05, Aor seuden o/s | 4c’ and if witl be ped : ee th tec om_cleovly ohuccve ofter @ach shift of modf o 2 Now we will creake mode! 3 whichis oqarn OT. Whore taput col Will be \q amd _¢qpa hut targch will prede ve tdusnf 2: mod 3 combintly prechict the -misfoker of mocef 4 —__ and _mode| 2 Model 3 Now well find predichon 3. —ee. | de talewbate Sete | Now y--pe edvdbon hy Gam Dee eee mi tottms. +olxma x Gey Ha) = het o-1(-) mn eae : | |: macy | r ; \ I Adaboost > ArP- ole HI Penk Peni eeemee Ge ce between Ado boosh Nie Gredienb Roost eee o (SU Now (fic eos | { Gradionl Boost [Hee we use diraiulon ctump: » In GBM max eilanat| | Cot whe rdpth 14 =) (efinode vould ba borg © mor [eof nede could _| | _g fo 42 Lhe mode] a (ms M2 =~ mo) Here we Ure learning paoritized based on their} pake_tuacept which te —_— art focal the sued els — | Jame weights wy twime FasGrodiel Booting fpr claseifreoker problem $= ~fovonte Gler Lave Mov'ad lik € popes to Age yu mn Blue — yes pug gree a —— No 4y blue No- - ye NG Red. ee No No 8h green Yes — — No be et a uhen wie use giackical Honil for clauificobion the sinha predichan for evuy individual is th. log (odd + Log Coda) for torget 3 tog (_reaple Love the movio) 7 oo (Regt dor F love fae moview) tt log (4) = o-L (waded yolu) His ts inihval apredichon el Fad Tike wil doquebee Qe, terion the cancel wop do use “fhe lag_ Cod) far clan'fcokion iat_converbs} oo —fr_o_probebilihy.omd “we clot} wilt, logue dunthn, e@ legtodd) 7 7 J telesteddd 20d (2ound ef pg te ry” vol) a ply loving Moxie) . og mera * Now classifying euuyone_in-fraining “dobose fh someone tho [ove powiew t3_pretty Teme becouse tus of people do pol oul mone.