P2IM 22

Problet

TrainTng ,
est .

TrarnTng Sex , Test set .

,
TratnTng Testsef .

Problem 2
Softman functron mulfTple ClassifrcafTon ontput layer .

Soffmax functTon O , Class 1 .

Elass .
SoffmaxfuntTon Cross entropy IOSs
-

mulyiple lass

1 oss funlTon .

problems
X
* saoldle PoTnt :
SGP gradent gradrent Update .
,

momenfum

[
gradrent
,

gradrent , gradcent .
.

SGD .
, IDCal Opfima , Sadlle Pornt global m
, .

Problem 4

rddanlnyerl
hrdden
iayer : werght barameter . It 9 f = 3 on

bias : 3tβ t =

2 3 X3 :
9 3 X 5 Ik

bias : 3 3 5

problemb
la) w =
YxtkY , x =
µ 4 v y :
u

"
Jnw (y -kppu
-
=
+ ( pKt )
[
]=
'
2
t
utm ] ut ]
-← - u 'v +
ax
=
+

" .
0 +

" * …

-
ur )
7

=
-
= +
(b ) w =
xEy x
=

eucosu y
=
eusinv

awauax X = eWEOSNX
=
- X

ax -
t
- 2 xf eusTnvt 2 g:
euCoSNtzeucosN t eu sinortzensinn

=
2
2e v COSzv t 2 ezusTnv =
4e
2

x=
eucosv uay =
eusinv

=
y

= +
o
.
-
00
= *
+ + = X 2 encosw .
eusinv =
O

u
: sTnv N

Zvay =

eucos ~
<

problemo 6

~ ) gradrent :
2 xp

= xtioy
Zyf :
4=⑧
2

-
()
"
[ " '

8
 Problemn ,
backpropagatron

a 3

-
coln 1 Xalgef
a8 a . ows 4
a
1
1 ow O 1 1 2
wocon f a4 bi =

1 O
@3 O O w8 wis 1
aq w 2
an d 2

w
1 1
Iwo
oarwg w"
1
2 4 14
4 , wlo

( sontayantaswra
= a

.
Ei

"
'

a .
=
E .
a aowsta wo
(
= w , ta wa Z a .
9 .
an -
+ . . "

Z" G
awot
t. -
. w" " i m .

"

"
. umtn . . .

. fwsotwnwowe . ) I)
stepo seftangs & feed forward

(
.

focFx rate ) a , 4 t"

. " (. )
o
Y
2
= .
o
Llearhing =
=

C ( la ~ t ) 4 Caz - tz ) .
) ( H9= =-
. . . w

.fanp w 1. )
- tz )
7 )
-
( t . zt ( Z
mu .
2

=
~
Stel sa
.

,
=
avil . wn .

-saz = azt = 3

II )I ) ( 111 )
" .
, t,
.
0rCa
K
stp - , i 8 x )
Xwn Et t . )
En
2

..
a

a -
-0 X
44
… + *

=
jwnOZ XA
BC
-
= a3 X (E β -

e , ) 21.

= 0 Has
-

() ( )
.
1 =

.
; .
ZziCa
ZwkOE WX =

-
2
=
ay
xLZRti ) .
2
FO
-
:

aayzy
. z

wbOc =

zvwX - -
asX ( Zi . t . 3

.I 1
=

aoas
2c

H =

a5
X
-
=
2
E5 ×
22
=

44
ac

azzc
zz a
acaan
Jznac
X 3* .
t ) -L
=

Zz 0

ZwiJcXz÷ AZ
aab
( =
ZW4
=

2
-
~

44
.

&8
2 .
=
2 w . X
6 AZ
=

step4
6
=
-

4 = 1
↑
aan
-

~ 2E 6
G8 6
2
zn

. .,
t

.." . .
.
.
. .

…
.
"

sHep
wsoc
3

" "
= - rcaz =

0
.
-
wsk '

. ".
. .
step ,
)
)
==
-

" -
( . . . .
.
.

)
=
0

.)
, " .

) .I
" 00
. . .
. 0
acawga
sc "
- =
-
X -
=
O
Jzs
awg
. . 44 .
.

- acaw Xzzyzas hzasJc

. az
~=
ay 2Z 3
44
-
K =
2 =
9 Z
=
5

. . [ 100
w= .
(. .
. . . .
( . . " =

)
- . . 0 ) . 98