Anfis (Adaptive Network Fuzzy Inference System) : G.Anuradha
Anfis (Adaptive Network Fuzzy Inference System) : G.Anuradha
Has no parameters
Adaptive Networks Architecture
and Learning
Superset of all feedforward NN with supervised
learning capability
Has nodes and directional links connecting
different nodes
Part or all the nodes are adaptive(each output of
these nodes depends on parameters pertaining
to this node) and learning rule specifies how
these parameters should be changed to
minimize a error measure
Learning rule
The basic learning rule is gradient descent
and chain rule
Because of the problem of slowness and
being trapped in local minima a hybrid
learning rule is proposed
This learning rule comes in two modes
Batch learning
Pattern learning
Architecture and basic learning
An adaptive network is a multi-layer
feedforward network in which each node
performs a particular function on the
incoming signals
The nature and the choice of the node
function depends on the overall input-
output function
No weights are associated with links and
the links just indicate the flow
Architecture and basic learning
Contd
To achieve desired i/p-o/p mapping the
parameters are updated according to
training data and gradient-based learning
procedure
Gradient based learning procedure
Given adaptive network has L layers
k-th layer has #k nodes
(k,i)- ith node in the kth layer
Node function- ith node in the k-layer
Node output depends on its incoming signals and its parameter set
and a,b,c etc. are parameters pertaining to this node
Learning paradigms for Adaptive
networks
Batch learning:-Update action takes place
only after the whole training data set has
been presented(After an epoch)
On-line learning:-parameters are updated
immediately after each input-output pair
has been presented.
Hybrid Learning Rule-Batch-Off line
learning rule
Combines gradient method and least
square estimator to identify parameters
If there exists a function H such that the composite function HoF is linear in some
of the elements of S, then these elements can be identified by the least square
Method.
Using least square estimator we have