Scribd
Upload
64 views3 pages

Week 2 Sol

Uploaded by

Netaji Gandi
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
64 views3 pages

Week 2 Sol

Uploaded by

Netaji Gandi
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 3

DEEP LEARNING WEEK 2

1
1. What is the range of the sigmoid function σ(x) = 1+e−x ?

(a) (−1, 1)
(b) (0, 1)
(c) (−∞, ∞)
(d) (0, ∞)
Answer: (b)
Solution: The sigmoid function is commonly used to map any input value to a value between
0 and 1, which makes it a popular choice for modeling probability in neural networks.
2. What happens to the output of the sigmoid function as |x| very small?

(a) The output approaches 0.5


(b) The output approaches 1.
(c) The output oscillates between 0 and 1.
(d) The output becomes undefined.

Answer: (a)
Solution: As |x| becomes very small,(that is when x approaches 0) sigmoid function
approaches 0.5
3. Which of the following theorem states that a neural network with a single hidden layer
containing a finite number of neurons can approximate any continuous function?

(a) Bayes’ theorem


(b) Central limit theorem
(c) Fourier’s theorem
(d) Universal approximation theorem

Answer: d) Solution: The universal approximation theorem states that a neural network
with a single hidden layer containing a finite number of neurons can approximate any
continuous function on a compact input domain.
4. We have a function that we want to approximate using 150 rectangles (towers). How many
neurons are required to construct the required network?

a)301
b)451
c)150
d)500

Answer: a)
Solution: To approximate one rectangle we need 2 neurons. Hence to create 150 towers we
will need 300 neurons. One extra neuron is required for aggregation

1
5. A neural network has two hidden layers with 5 neurons in each layer, and an output layer
with 3 neurons, and an input layer with 2 neurons. How many weights are there in total?
(Dont assume any bias terms in the network)
Answer: 50
Solution: No of weights are given by 5 ∗ 2 + 5 ∗ 5 + 5 ∗ 3 = 50
6. What is the derivative of the ReLU activation function with respect to its input at 0?
a) 0
b) 1
c) −1
d) Not differentiable
Answer: d) Not differentiable
Solution: The derivative of ReLU is 0 when its input is negative and 1 when its input is
positive. However, at the point where its input is 0, the derivative is undefined, as the
function is not differentiable at that point. Therefore, the correct answer is d) Not
differentiable.
7. Consider a function f (x) = x3 − 3x2 + 2. What is the updated value of x after 3rd iteration
of the gradient descent update, if the learning rate is 0.1 and the initial value of x is 4?
Answer: 1.9
solution: Gradient of the function is 3x(x − 2) The value of x after the first update is x -
0.1(3x(x-2))=4-2.4=1.6 The value of x after the second update is x -
0.1(3x(x-2))=1.6+0.192=1.79 The value of x after the third update is x - 0.1(3x(x-2))= 1.79
+ 0.112=1.90
8. Which of the following statements is true about the representation power of a multilayer
network of sigmoid neurons?
(a) A multilayer network of sigmoid neurons can represent any Boolean function.
(b) A multilayer network of sigmoid neurons can represent any continuous function.
(c) A multilayer network of sigmoid neurons can represent any function.
(d) A multilayer network of sigmoid neurons can represent any linear function.
Answer: (b)
Solution: A multilayer network of sigmoid neurons with a sufficient number of hidden units
can approximate any continuous function arbitrarily well. However, it may not be able to
represent certain functions, such as those that require discontinuities, or those that require a
high degree of precision with a limited number of hidden units.
9. How many boolean functions can be designed for 3 inputs?

a)65,536
b)8
c)256
d)64

2
Answer: c)
3
Solution: No.of boolean functions are given by 22 = 256.
10. How many neurons do you need in the hidden layer of a perceptron to learn any boolean
function with 6 inputs? (Only one hidden layer is allowed)

a)16
b)64
c)16
d)32

Answer: b)
Solution: No of neurons needed to represent all boolean functions of n inputs in the
perceptron is 2n .

You might also like