Scribd
Upload
6 views25 pages

10 Workbook Wide

The document contains a series of exercises related to linear functions and the ReLU activation function, presented in a structured format. Each exercise builds on previous ones, introducing additional variables and complexity. The exercises are designed to enhance understanding of neural network operations and their mathematical foundations.

Uploaded by

Johan Tchassem
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
6 views25 pages

10 Workbook Wide

The document contains a series of exercises related to linear functions and the ReLU activation function, presented in a structured format. Each exercise builds on previous ones, introducing additional variables and complexity. The exercises are designed to enhance understanding of neural network operations and their mathematical foundations.

Uploaded by

Johan Tchassem
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 25

Wide

Exercise 1
2 X1
1 0 Y1

X1

Y1

AI by Hand ✍© 2024 Tom Yeh 2


Wide
Exercise 2 2 X1
1 X2 +
1 1 0 Y1

X1 X2
+

Y1

AI by Hand ✍© 2024 Tom Yeh 3


Wide
Exercise 3 2 X1
1 X2
1 1 0 3 Y1
1 -1 1 Y2 +

X1 X2

Y1 Y
+
2

AI by Hand ✍© 2024 Tom Yeh 2


Wide
Exercise 4 2 X1
1 X2
1 1 0 3 Y1
1 -1 1 2 Y2
-1 0 3 Y3 +

X1 X2

Y1 Y2 Y
+
3

AI by Hand ✍© 2024 Tom Yeh 1


Wide
Exercise 5 2 X1
1 X2
3 X3 +
1 1 0 0 3 Y1
1 -1 0 1 2 Y2
-1 0 1 3 Y3

X1 X2 X3
+

Y1 Y2 Y3

AI by Hand ✍© 2024 Tom Yeh 4


Wide
Exercise 6 2 X1
1 X2
3 X3
1 X4 +

1 1 0 1 0 4 Y1
1 -1 0 0 1 2 Y2
-1 0 1 0 3 Y3

X1 X2 X3 X4
+

Y1 Y2 Y3

AI by Hand ✍© 2024 Tom Yeh 4


Wide
Exercise 7 2 X1
1 X2
3 X3
1 X4
2 X5 +
1 1 0 1 0 0 4 Y1
1 -1 0 0 0 1 2 Y2
-1 0 1 0 1 3 Y3

X1 X2 X3 X4 X
+
5

Y1 Y2 Y3

AI by Hand ✍© 2024 Tom Yeh 6


Wide
Exercise 8 2 X1
1 X2
3 X3
1 X4
2 X5
1 X6 +
1 1 0 1 0 0 0 4 Y1
1 -1 0 0 0 0 1 2 Y2
-1 0 1 0 1 -1 3 Y3

X1 X2 X3 X4 X5 X
+
6

Y1 Y2 Y3

AI by Hand ✍© 2024 Tom Yeh 5


Wide
Exercise 9 2 X1
1 X2
3 X3
1 X4
2 X5
1 X6
1 X7 +
1 1 0 1 0 0 0 0 4 Y1
1 -1 0 0 0 0 2 0 Y2
-1 0 1 0 1 -1 0 1 5 Y3

X1 X2 X3 X4 X5 X6 X7
+

Y1 Y2 Y3

AI by Hand ✍© 2024 Tom Yeh 4


Wide
Exercise 10 2 X1
1 X2
3 X3
1 X4
2 X5
1 X6
1 X7
1 X8 +

1 1 0 1 0 0 0 0 0 4 Y1
1 -1 0 0 0 0 2 -1 0 Y2
-1 0 1 0 1 -1 0 0 1 5 Y3
X1 X2 X3 X4 X5 X6 X7 X
+ 8

Y1 Y2 Y3

AI by Hand ✍© 2024 Tom Yeh 3


Wide
Exercise 11
2 X1
1 1 H1
1 2 Y1

X1

H1

Y1

AI by Hand ✍© 2024 Tom Yeh 3 5


Wide
Exercise 12
2 X1
1 1 3 H1
1 0 H2 +
1 1 2 Y1

X1

H1 H
+
2

Y1

AI by Hand ✍© 2024 Tom Yeh 2 7


Wide
Exercise 13
2 X1
1 1 3 H1
1 0 2 H2
1 -1 H3 +
1 1 0 2 Y1

X1

H1 H2 H
+
3

Y1

AI by Hand ✍© 2024 Tom Yeh 1 7


Wide
Exercise 14
2 X1
1 1 3 H1
1 0 2 H2
1 -1 1 H3
1 -2 H4 +
1 1 0 2 2 Y1

X1

H1 H2 H3 H
+
4

Y1

AI by Hand ✍© 2024 Tom Yeh 0 7


Wide
Exercise 15
2 X1
1 1 3 H1
1 0 2 H2
1 -1 1 H3
1 -2 0 H4
0 -1 0 H5 +
-1 3 H6 +
1 1 0 2 0 1 2 Y1

X1

H1 H2 H3 H4
+
H H
+
5 6

Y1

AI by Hand ✍© 2024 Tom Yeh 1 8


Wide
Exercise 16
2 X1
1 1 3 H1
1 0 2 H2
1 -1 1 H3
1 -2 0 H4
0 -1 0 H5
-1 3 1 H6
2 0 4 H7 +
3 0 H8 +

1 1 0 2 0 1 0 -1 2 Y1

X1

H1 H2 H3 H4 H5 H6
+
H H
+
7 8

Y1

AI by Hand ✍© 2024 Tom Yeh 6 2


Wide
Exercise 17 2 X1
1 X2 +
1 0 1 3 H1
1 0 0 2 H2
1 0 -1 1 H3
1 1 -2 1 H4
0 0 -1 0 H5
-1 1 3 2 H6
2 1 0 5 H7
3 1 0 H8

1 1 0 2 0 1 0 -1 2 Y1

X1 X2 +
H1 H2 H3 H4 H5 H6 H7 H8

Y1

AI by Hand ✍© 2024 Tom Yeh 7 1


Wide
Exercise 18 2 X1 X1
Linear + ReLU

1 0 A1
A1 A2
1 1 A2

AI by Hand ✍© 2024 Tom Yeh 2 3


Wide
Exercise 19 2 X1 X1
Linear + ReLU

1 0 2 A1
A1 A2
1 1 3 A2
1 -1 0 B1
1 1 0 5 B2 B1 B2 B3
1 0 1 B3

AI by Hand ✍© 2024 Tom Yeh 1 3


Wide
Exercise 20 2 X1 X1
Linear + ReLU

1 0 2 A1
A1 A2
1 1 3 A2
1 -1 0 1 B1
1 1 0 5 B2 B1 B2 B3
1 0 1 3 B3
1 0 -1 0 0 C1
0 1 -1 0 2 C2 C1 C2 C3 C4
1 1 0 0 C3
0 1 0 -1 C4

AI by Hand ✍© 2024 Tom Yeh 2 4


Wide
Exercise 21 2 X1 X1
Linear + ReLU

1 0 2 A1
A1 A2
1 1 3 A2
1 -1 0 1 B1
1 1 0 5 B2 B1 B2 B3
1 0 1 3 B3
1 0 -1 0 0 C1
0 1 -1 0 2 C2
C1 C2 C3 C4
1 1 0 0 6 C3
0 1 0 -1 4 C4
1 0 0 1 0 4 D1
0 -2 0 0 5 1 D2
0 -1 0 1 0 2 D3 D1 D2 D3 D4 D5

1 1 1 0 0 D4
0 0 1 1 1 D5
AI by Hand ✍© 2024 Tom Yeh 8 11
Wide
Exercise 22 2 X1
1 X2
3 X3 X1 X2 X3 X4 X5
0 X4
-1 X5
Linear + ReLU

1 0 0 0 -1 0 3 A1
0 1 1 0 0 0 4 A2 A1 A2 A3 A4
0 0 1 1 1 0 A3
0 0 0 0 2 1 A4

AI by Hand ✍© 2024 Tom Yeh 2 0


Wide
Exercise 23 2 X1
1 X2
3 X3 X1 X2 X3 X4 X5
0 X4
-1 X5
Linear + ReLU

1 0 0 0 -1 0 3 A1
0 1 1 0 0 0 4 A2 A1 A2 A3 A4
0 0 1 1 1 0 2 A3
0 0 0 0 2 1 0 A4
1 0 0 -1 0 3 B1
0 1 -1 0 0 B2 B1 B2 B3

1 0 0 0 -2 B3

AI by Hand ✍© 2024 Tom Yeh 2 1


Wide
Exercise 24 2 X1
1 X2
3 X3 X1 X2 X3 X4 X5
0 X4
-1 X5
Linear + ReLU

1 0 0 0 -1 0 3 A1
0 1 1 0 0 0 4 A2 A1 A2 A3 A4
0 0 1 1 1 0 2 A3
0 0 0 0 2 1 0 A4
1 0 0 -1 0 3 B1
0 1 -1 0 0 2 B2 B1 B2 B3

1 0 0 0 -2 1 B3
1 0 -1 0 C1 C1 C2
1 1 0 1 C2

AI by Hand ✍© 2024 Tom Yeh 2 6


Wide
Exercise 25 2 X1
1 X2
3 X3 X1 X2 X3 X4 X5
0 X4
-1 X5
Linear + ReLU

1 0 0 0 -1 0 3 A1
0 1 1 0 0 0 4 A2 A1 A2 A3 A4
0 0 1 1 1 0 2 A3
0 0 0 0 2 1 0 A4
1 0 0 -1 0 3 B1
0 1 -1 0 0 2 B2 B1 B2 B3

1 0 0 0 -2 1 B3
1 0 -1 0 2 C1 C1 C2
1 1 0 1 6 C2
-1 1 1 D1 D1

AI by Hand ✍© 2024 Tom Yeh 5

You might also like