Scribd
Upload
2 views4 pages

lab_program_4

The document outlines the implementation of an Artificial Neural Network using the Backpropagation algorithm, detailing the structure and training process. It includes a sample dataset for training, normalization of inputs, and the Python code for the network's forward and backward propagation. The output demonstrates the predicted results against actual values after training.

Uploaded by

sudakaran612
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as DOCX, PDF, TXT or read online on Scribd
2 views4 pages

lab_program_4

The document outlines the implementation of an Artificial Neural Network using the Backpropagation algorithm, detailing the structure and training process. It includes a sample dataset for training, normalization of inputs, and the Python code for the network's forward and backward propagation. The output demonstrates the predicted results against actual values after training.

Uploaded by

sudakaran612
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as DOCX, PDF, TXT or read online on Scribd
You are on page 1/ 4

Machine Learning Laboratory 15CSL76

4. Build an Artificial Neural Network by implementing the Backpropagation algorithm and


test the same using appropriate data sets.

BACKPROPAGATION Algorithm

BACKPROPAGATION (training_example, ƞ, nin, nout, nhidden )


Each training example is a pair of the form 𝑡→ ), where ( 𝑥→ ) is the vector of

input values, (𝑡→ ) and is the vector of target network output values.
(𝑥⃗→, network

ƞ is the learning rate (e.g., .05). ni, is the number of network inputs, nhidden the number
of units in the hidden layer, and nout the number of output units.
The input from unit i into unit j is denoted xji, and the weight from unit i to unit j is
denoted wji

 Create a feed-forward network with ni inputs, nhidden hidden units, and nout output
units.
 Initialize all network weights to small random numbers
 Until the termination condition is met, Do

 For each 𝑡→ ), in training examples, Do


(𝑥⃗→,

1. Input the instance 𝑥⃗→, to the network and compute the output ou of
Propagate the input forward through the network:

every unit u in the network.

Propagate the errors backward through the network:

1 Deepak D, Assistant Professor, Dept. of CS&E, Canara Engineering College, Mangaluru


Machine Learning Laboratory 15CSL76

Training Examples:

Expected % in
Example Sleep Study
Exams
1 2 9 92
2 1 5 86
3 3 6 89

Normalize the input


Expected %
Example Sleep Study
in Exams
1 2/3 = 0.66666667 9/9 = 1 0.92
2 1/3 = 0.33333333 5/9 = 0.55555556 0.86
3 3/3 = 1 6/9 = 0.66666667 0.89

Program:

import numpy as np
X = np.array(([2, 9], [1, 5], [3, 6]), dtype=float)
y = np.array(([92], [86], [89]), dtype=float)
X = X/np.amax(X,axis=0) # maximum of X array longitudinally
y = y/100

#Sigmoid Function
def sigmoid (x):
return 1/(1 + np.exp(-x))

#Derivative of Sigmoid Function


def derivatives_sigmoid(x):
return x * (1 - x)

#Variable initialization
epoch=5000 #Setting training iterations
lr=0.1 #Setting learning rate
inputlayer_neurons = 2 #number of features in data set
hiddenlayer_neurons = 3 #number of hidden layers neurons
output_neurons = 1 #number of neurons at output layer

2 Deepak D, Assistant Professor, Dept. of CS&E, Canara Engineering College, Mangaluru


Machine Learning Laboratory 15CSL76

#weight and bias initialization


wh=np.random.uniform(size=(inputlayer_neurons,hiddenlayer_neur
ons))
bh=np.random.uniform(size=(1,hiddenlayer_neurons))
wout=np.random.uniform(size=(hiddenlayer_neurons,output_neuron
s))
bout=np.random.uniform(size=(1,output_neurons))

#draws a random range of numbers uniformly of dim x*y


for i in range(epoch):

#Forward Propogation
hinp1=np.dot(X,wh)
hinp=hinp1 + bh
hlayer_act = sigmoid(hinp)
outinp1=np.dot(hlayer_act,wout)
outinp= outinp1+ bout
output = sigmoid(outinp)

#Backpropagation
EO = y-output
outgrad = derivatives_sigmoid(output)
d_output = EO* outgrad
EH = d_output.dot(wout.T)

#how much hidden layer wts contributed to error


hiddengrad = derivatives_sigmoid(hlayer_act)
d_hiddenlayer = EH * hiddengrad

# dotproduct of nextlayererror and currentlayerop


wout += hlayer_act.T.dot(d_output) *lr
wh += X.T.dot(d_hiddenlayer) *lr

print("Input: \n" + str(X))


print("Actual Output: \n" + str(y))
print("Predicted Output: \n" ,output)

3 Deepak D, Assistant Professor, Dept. of CS&E, Canara Engineering College, Mangaluru


Machine Learning Laboratory 15CSL76

Output:

Input:
[[0.66666667 1. ]
[0.33333333 0.55555556]
[1. 0.66666667]]

Actual Output:
[[0.92]
[0.86]
[0.89]]

Predicted Output:
[[0.89726759]
[0.87196896]
[0.9000671]]

4 Deepak D, Assistant Professor, Dept. of CS&E, Canara Engineering College, Mangaluru

You might also like