Scribd
Upload
21 views36 pages

Neural Network

Uploaded by

Tuan Anh Tran
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
21 views36 pages

Neural Network

Uploaded by

Tuan Anh Tran
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 36

Neural Network

Tuan Nguyen - AI4E


Machine Learning
Linear regression
Logistic regression
Logistic regression
Logistic regression
How?
1. Define the problem
2. Visualize the data
3. Choose the model
4. Define loss function
5. Minimize loss function
6. Use the model to predict new data.
XOR problem
How to solve XOR problem
A XOR B = (NOT(A AND B) AND (A OR B))
AND
NOT AND
AND NOT AND
OR
XOR
A XOR B = (NOT(A AND B) AND (A OR B))
Neural network inspiration
Neural network
Notation
Feedforward
Feedforward
Feedforward
Dataset
Matrix presentation
Matrix presentation
Matrix presentation
Matrix presentation
Why non-linear activation?

Suppose we use
linear activation
function, what is the
output?
Sigmoid
Tanh
Relu

y = max(x, 0)
Leaky ReLU
Training set/Validation set/Test set
Softmax function
One-hot encoding
Cross-entropy loss

Similar to binary_crossentropy
Backpropagation
Q&A
The end

You might also like