Scribd
Upload
13 views

neural_net

Uploaded by

Alaa Awaysa
Copyright
© © All Rights Reserved
Available Formats
Download as PDF, TXT or read online on Scribd
13 views

neural_net

Uploaded by

Alaa Awaysa
Copyright
© © All Rights Reserved
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 23

Neural Networks:

Representation
Model
representation I
Machine Learning
Neuron in the brain

2
Andrew Ng
Neurons in the brain

[Credit: US National Institutes of Health, National Institute on Aging] Andrew Ng


Neuron model: Logistic unit

Sigmoid (logistic) activation function.

Andrew Ng
Neural Network

Layer 1 Layer 2 Layer 3


Andrew Ng
Neural Network
“activation” of unit in layer
matrix of weights controlling
function mapping from layer to
layer

If network has units in layer , units in layer , then


will be of dimension .
Andrew Ng
Neural Networks:
Representation
Model
representation II
Machine Learning
Forward propagation: Vectorized implementation

Add .

8
Andrew Ng
Neural Network learning its own features

Layer 1 Layer 2 Layer 3

Andrew Ng
Other network architectures

Layer 1 Layer 2 Layer 3 Layer 4

Andrew Ng
Neural Networks:
Representation
Examples and
intuitions I
Machine Learning
Non-linear classification example: XOR/XNOR
, are binary (0 or 1).

x2
x2

x1

x1

12
Andrew Ng
Simple example: AND 1.0

0 0
0 1
1 0
1 1

Andrew Ng
Example: OR function

-10

20 0 0
20 0 1
1 0
1 1

Andrew Ng
Neural Networks:
Representation
Examples and
intuitions II
Machine Learning
Negation:

0
1

16
Andrew Ng
Putting it together:

-30 10 -10

20 -20 20

20 -20 20

0 0
0 1
1 0
1 1

Andrew Ng
Neural Network intuition

Layer 1 Layer 2 Layer 3 Layer 4

Andrew Ng
Handwritten digit classification

[Courtesy of Yann LeCun] Andrew Ng


Handwritten digit classification

[Courtesy of Yann LeCun] Andrew Ng


Neural Networks:
Representation
Multi-class
classification
Machine Learning

Andrew Ng
Multiple output units: One-vs-all.

Pedestrian Car Motorcycle Truck

Want , , , etc.
when pedestrian when car when motorcycle 22
Andrew Ng
Multiple output units: One-vs-all.

Want , , , etc.
when pedestrian when car when motorcycle
Training set:

one of , , ,
pedestrian car motorcycle truck
Andrew Ng

You might also like