Scribd
Upload
15 views25 pages

9 Workbook Deep

The document contains a series of exercises focused on applying Linear transformations followed by ReLU activation functions. Each exercise presents a different configuration of weights and biases, along with corresponding inputs and outputs. The exercises are designed to help users practice and understand the mechanics of deep learning models.

Uploaded by

Johan Tchassem
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
15 views25 pages

9 Workbook Deep

The document contains a series of exercises focused on applying Linear transformations followed by ReLU activation functions. Each exercise presents a different configuration of weights and biases, along with corresponding inputs and outputs. The exercises are designed to help users practice and understand the mechanics of deep learning models.

Uploaded by

Johan Tchassem
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 25

Deep

Exercise 1
Linear + ReLU
2 X1 X1
W b
1 0 A1 A1
2 0 B1 B1

AI by Hand ✍© 2024 Tom Yeh 2 4


Deep
Exercise 2
Linear + ReLU
2 X1 X1
W b
1 0 2 A1 A1
2 0 4 B1 B1
0 1 C1 C1

0 2 D1 D1

AI by Hand ✍© 2024 Tom Yeh 1 2


Deep
Exercise 3
Linear + ReLU
2 X1 X1
W b
1 0 2 A1 A1
2 0 4 B1 B1
0 1 1 C1 C1

0 2 2 D1 D1

-1 0 E1 E1

2 5 F1 F1

AI by Hand ✍© 2024 Tom Yeh 0 5


Deep
Exercise 4
Linear + ReLU
2 X1 X1
W b
1 0 2 A1 A1
2 0 4 B1 B1
0 1 1 C1 C1

0 2 2 D1 D1

-1 0 0 E1 E1

2 5 5 F1 F1

1 1 G1 G1

1 1 H1 H1

AI by Hand ✍© 2024 Tom Yeh 6 7


Deep
Exercise 5
Linear + ReLU
3 X1 X1
W b
1 0 A1 A1
2 0 B1 B1
0 1 ? C1 C1

0 2 ? D1 D1

-1 0 ? E1 E1

2 5 ? F1 F1

1 1 ? G1 G1

1 1 ? H1 H1

AI by Hand ✍© 2024 Tom Yeh 3 6


Deep
Exercise 6
Linear + ReLU
3 X1 X1
W b
1 0 3 A1 A1
2 0 6 B1 B1
0 1 C1 C1

0 2 D1 D1

-1 0 ? E1 E1

2 5 ? F1 F1

1 1 ? G1 G1

1 1 ? H1 H1

AI by Hand ✍© 2024 Tom Yeh 1 2


Deep
Exercise 7
Linear + ReLU
3 X1 X1
W b
1 0 3 A1 A1
2 0 6 B1 B1
0 1 1 C1 C1

0 2 2 D1 D1

-1 0 E1 E1

2 5 F1 F1

1 1 ? G1 G1

1 1 ? H1 H1

AI by Hand ✍© 2024 Tom Yeh 0 5


Deep
Exercise 8
Linear + ReLU
3 X1 X1
W b
1 0 3 A1 A1
2 0 6 B1 B1
0 1 1 C1 C1

0 2 2 D1 D1

-1 0 0 E1 E1

2 5 5 F1 F1

1 1 G1 G1

1 1 H1 H1

AI by Hand ✍© 2024 Tom Yeh 6 7


Deep
Exercise 9
Linear + ReLU
2 X1
X1 X2
W b 3 X2
0 1 0 A1
A1 A2
1 1 0 A2

AI by Hand ✍© 2024 Tom Yeh 3 5


Deep
Exercise 10
Linear + ReLU
2 X1
X1 X2
W b 3 X2
0 1 0 3 A1 A1 A2
1 1 0 5 A2
1 -1 0 B1
B1 B2
1 0 1 B2

AI by Hand ✍© 2024 Tom Yeh 0 4


Deep
Exercise 11
Linear + ReLU
2 X1
X1 X2
W b 3 X2
0 1 0 3 A1
A1 A2
1 1 0 5 A2
1 -1 0 0 B1
B1 B2
1 0 1 4 B2
1 1 0 C1
C1 C2
1 0 -1 C2

AI by Hand ✍© 2024 Tom Yeh 4 0


Deep
Exercise 12
Linear + ReLU
2 X1
X1 X2
W b 3 X2
0 1 0 3 A1
A1 A2
1 1 0 5 A2
1 -1 0 0 B1
B1 B2
1 0 1 4 B2
1 1 0 4 C1
C1 C2
1 0 -1 0 C2
0 1 1 D1
D1 D2
1 -1 0 D2

AI by Hand ✍© 2024 Tom Yeh 1 4


Deep
Exercise 13
Linear + ReLU
2 X1
X1 X2
W b 3 X2
0 1 0 3 A1
A1 A2
1 1 0 5 A2
1 -1 0 0 B1
B1 B2
1 0 1 4 B2
1 1 0 4 C1
C1 C2
1 0 -1 0 C2
0 1 1 1 D1
D1 D2
1 -1 0 4 D2
1 0 2 E1
E1 E2
1 1 2 E2

AI by Hand ✍© 2024 Tom Yeh 3 7


Deep
Exercise 14
Linear + ReLU
2 X1
X1 X2
W b 3 X2
0 1 0 3 A1
A1 A2
1 1 0 5 A2
1 -1 0 0 B1
B1 B2
1 0 1 4 B2
1 1 0 4 C1
C1 C2
1 0 -1 0 C2
0 1 1 1 D1
D1 D2
1 -1 0 4 D2
1 0 2 3 E1
E1 E2
1 1 2 7 E2
0 1 1 F1
F1 F2
1 0 1 F2

AI by Hand ✍© 2024 Tom Yeh 8 4


Deep
Exercise 15
Linear + ReLU
3 X1
X1 X2
W b 1 X2
0 1 0 A1
A1 A2
1 1 0 4 A2
1 -1 0 B1
B1 B2
1 0 1 2 B2
1 1 0 ? C1
C1 C2
1 0 -1 ? C2
0 1 1 ? D1
D1 D2
1 -1 0 ? D2
1 0 2 ? E1
E1 E2
1 1 2 ? E2
0 1 1 ? F1
F1 F2
1 0 1 ? F2

AI by Hand ✍© 2024 Tom Yeh 1 0


Deep
Exercise 16
Linear + ReLU
3 X1
X1 X2
W b 1 X2
0 1 0 1 A1
A1 A2
1 1 0 4 A2
1 -1 0 0 B1
B1 B2
1 0 1 2 B2
1 1 0 2 C1
C1 C2
1 0 -1 C2
0 1 1 1 D1
D1 D2
1 -1 0 D2
1 0 2 ? E1
E1 E2
1 1 2 ? E2
0 1 1 ? F1
F1 F2
1 0 1 ? F2

AI by Hand ✍© 2024 Tom Yeh 0 2


Deep
Exercise 17
Linear + ReLU
3 X1
X1 X2
W b 1 X2
0 1 0 1 A1
A1 A2
1 1 0 4 A2
1 -1 0 0 B1
B1 B2
1 0 1 2 B2
1 1 0 2 C1
C1 C2
1 0 -1 0 C2
0 1 1 1 D1
D1 D2
1 -1 0 2 D2
1 0 2 3 E1
E1 E2
1 1 2 E2
0 1 1 F1
F1 F2
1 0 1 4 F2

AI by Hand ✍© 2024 Tom Yeh 5 6


Deep
Exercise 18
3 X1
Linear + ReLU 1 X2 X1 X2 X3

W b 2 X3
0 1 1 0 A1
0 0 1 3 A2 A1 A2 A3
1 1 0 0 4 A3

AI by Hand ✍© 2024 Tom Yeh 3 5


Deep
Exercise 19
3 X1
Linear + ReLU 1 X2 X1 X2 X3

W b 2 X3
0 1 1 0 3 A1
0 0 1 3 5 A2 A1 A2 A3
1 1 0 0 4 A3
1 0 1 0 7 B1
0 1 0 -1 B2 B1 B2 B3
-1 0 1 0 B3

AI by Hand ✍© 2024 Tom Yeh 4 1


Deep
Exercise 20
3 X1
Linear + ReLU 1 X2 X1 X2 X3

W b 2 X3
0 1 1 0 3 A1
0 0 1 3 5 A2 A1 A2 A3
1 1 0 0 4 A3
1 0 1 0 7 B1
0 1 0 -1 4 B2 B1 B2 B3
-1 0 1 0 1 B3
0 0 1 0 C1
0 1 0 0 4 C2 C1 C2 C3
1 0 0 0 C3

AI by Hand ✍© 2024 Tom Yeh 1 7


Deep
Exercise 21
3 X1
Linear + ReLU 1 X2 X1 X2 X3

W b 2 X3
0 1 1 0 3 A1
0 0 1 3 5 A2 A1 A2 A3
1 1 0 0 4 A3
1 0 1 0 7 B1
0 1 0 -1 4 B2 B1 B2 B3
-1 0 1 0 1 B3
0 0 1 0 1 C1
0 1 0 0 4 C2 C1 C2 C3
1 0 0 0 7 C3
1 1 0 0 D1
0 1 1 0 D2 D1 D2 D3
1 0 1 0 8 D3
AI by Hand ✍© 2024 Tom Yeh 5 11
Deep
Exercise 22
2 X1
Linear + ReLU 0 X2 X1 X2 X3

W b 1 X3
0 1 1 0 1 A1
0 0 1 3 A2 A1 A2 A3
1 1 0 0 A3
1 0 1 0 ? B1
0 1 0 -1 ? B2 B1 B2 B3
-1 0 1 0 ? B3
0 0 1 0 ? C1
0 1 0 0 ? C2 C1 C2 C3
1 0 0 0 ? C3
1 1 0 0 ? D1
0 1 1 0 ? D2 D1 D2 D3
1 0 1 0 ? D3
AI by Hand ✍© 2024 Tom Yeh 4 2
Deep
Exercise 23
2 X1
Linear + ReLU 0 X2 X1 X2 X3

W b 1 X3
0 1 1 0 1 A1
0 0 1 3 4 A2 A1 A2 A3
1 1 0 0 2 A3
1 0 1 0 B1
0 1 0 -1 B2 B1 B2 B3
-1 0 1 0 1 B3
0 0 1 0 ? C1
0 1 0 0 ? C2 C1 C2 C3
1 0 0 0 ? C3
1 1 0 0 ? D1
0 1 1 0 ? D2 D1 D2 D3
1 0 1 0 ? D3
AI by Hand ✍© 2024 Tom Yeh 3 3
Deep
Exercise 24
2 X1
Linear + ReLU 0 X2 X1 X2 X3

W b 1 X3
0 1 1 0 1 A1
0 0 1 3 4 A2 A1 A2 A3
1 1 0 0 2 A3
1 0 1 0 3 B1
0 1 0 -1 3 B2 B1 B2 B3
-1 0 1 0 1 B3
0 0 1 0 C1
0 1 0 0 3 C2 C1 C2 C3
1 0 0 0 C3
1 1 0 0 ? D1
0 1 1 0 ? D2 D1 D2 D3
1 0 1 0 ? D3
AI by Hand ✍© 2024 Tom Yeh 1 3
Deep
Exercise 25
2 X1
Linear + ReLU 0 X2 X1 X2 X3

W b 1 X3
0 1 1 0 1 A1
0 0 1 3 4 A2 A1 A2 A3
1 1 0 0 2 A3
1 0 1 0 3 B1
0 1 0 -1 3 B2 B1 B2 B3
-1 0 1 0 1 B3
0 0 1 0 1 C1
0 1 0 0 3 C2 C1 C2 C3
1 0 0 0 3 C3
1 1 0 0 4 D1
0 1 1 0 D2 D1 D2 D3
1 0 1 0 D3
AI by Hand ✍© 2024 Tom Yeh 6 4

You might also like