Train Adaptive Neuro-Fuzzy Inference

Systems
This example shows how to create, train, and test Sugeno-type fuzzy
systems using the Neuro-Fuzzy Designer. For more information on:
 Neuro-adaptive fuzzy systems, see Neuro-Adaptive Learning and ANFIS.
 Training neuro-adaptive fuzzy systems at the command line, see anfis.
Load Training Data
Training and validating systems using the Neuro-Fuzzy Designer app requires data. Import the
training data (fuzex1trnData) and validation data (fuzex1chkData) to the MATLAB® workspace.

Load the training data set from the workspace. In the Load data section,
select Training and worksp.
Click Load Data. In the Load from workspace dialog box, enter the variable
name fuzex1trnData.

Click OK. The Neuro-Fuzzy Designer displays the training data in the plot as a set of circles.

Load the checking data from the MATLAB workspace into the Neuro-Fuzzy Designer. In
the Load data section, select Checking.

Load the checking data in the same manner as the training data, specifying the variable
name fuzex1chkData. The Neuro-Fuzzy Designer displays the checking data using plus signs
superimposed on the training data.
 To clear a specific data set from the app, in the Load data area, select the data Type, and
click Clear Data.

Generate or Load FIS Structure

Before you start the FIS training, you must specify an initial FIS model structure. To specify the
model structure, you perform one of the following tasks:

 Load a previously saved single-output Sugeno-type FIS object from a file or the MATLAB
workspace.
 Generate the initial FIS model using grid partitioning.
 Generate the initial FIS model using subtractive clustering.
For this example, generate the initial FIS using grid partitioning. In the Neuro-Fuzzy Designer,
in the Generate FIS section, select Grid partition.

Click Generate FIS.

In the Add Membership Functions dialog box:

 In the Input section, in Number of MFs, specify the number of input membership functions. For
this example, use 4 membership functions for all input variables.
 In MF Type, select gbellmf as the input membership function type.
 In the Output section, in MF Type, select linear as the output membership function type.

Interactively Specify FIS Structure

Alternatively, you can interactively specify your own FIS structure with specified membership
functions and rules. The system you define must be a Sugeno system with the following
properties:

 Single output
 Weighted average defuzzification
 First or zeroth order system; that is, all output membership functions must be the same type,
either 'linear' or 'constant'.
 No rule sharing. Different rules cannot use the same output membership function; that is, the
number of output membership functions must equal the number of rules.
 Unity weight for each rule.
 No custom membership functions or defuzzification methods.
To define the:
 Membership functions for each variable, in the Neuro-Fuzzy Designer,
select Edit > Membership Functions. Then, in the Membership Function Editor window, define
the membership functions.
 Rules, in the Neuro-Fuzzy Designer, select Edit > Rules. Then, in the Rule Editor window,
define the rules.
These tools are the same as those used by the Fuzzy Logic Designer app. For more information,
see Build Fuzzy Systems Using Fuzzy Logic Designer.

View FIS Structure

After you load or generate the FIS, you can view the model structure. To do so, in the Neuro-
Fuzzy Designer, click Structure.

The branches in this graph are color coded. Color coding of branches characterize the rules and
indicate whether or not AND, NOT, or OR are used in the rules. The input is represented by the
left-most node and the output by the right-most node. The node represents a normalization factor
for the rules. To view information about the structure, click on each node.

Also, to view the FIS:

 Membership functions, in the Neuro-Fuzzy Designer, select Edit > Membership Functions.
 Rules, in the Neuro-Fuzzy Designer, select Edit > Rules.
Train FIS
After loading the training data and generating the initial FIS structure, you can train your FIS. To
do so, in the Neuro-Fuzzy Designer, in the Train FIS section, specify the following parameters:

 Optim. Method — Optimization method. For this example, select the hybrid method, which
uses a combination of backpropagation and least-squares regression to tune the FIS parameters.
 Epochs — Number of training epochs. For this example, specify 40 epochs.
 Error Tolerance — Error tolerance stopping condition. For this example, specify a value of 0,
which indicates that the training will stop when the number of training epochs is reached.
To train the FIS, click Train Now.

The app trains the FIS and plots the training error (as stars) and checking error (as dots) for each
training epoch.

The checking error decreases up to a certain point in the training, and then it increases. This
increase occurs at the point where the training starts overfitting the training data. The app selects
the FIS associated with this overfitting point as the trained ANFIS model.
Validate Trained FIS
After the FIS is trained, validate the model using a Testing or Checking data set that differs
from the training data. For this example, use the previously loaded checking data.

To test your FIS against the checking data, in the Test FIS section, select Checking data. Then,
click Test Now.

The app plots the output values of the testing data set (using blue +'s) and the output of the
trained FIS for the corresponding testing data input values (using red *'s). The FIS output values
correlate well with the expected output.

Importance of Checking Data

It is important to have checking data that fully represents the features of the data the FIS is
intended to model. If your checking data is significantly different from your training data and
does not cover the same data features to model as the training data, then the training results will
be poor.

For example, load new training and checking data into the Neuro-Fuzzy Designer. This data has
significantly different training and checking sets.
 1. At the MATLAB command line, load the training and checking data.
2. load fuzex2trnData.dat
load fuzex2chkData.dat
3. Clear the previously loaded training and checking data. In the Load data section, select
each data type, click Clear Data.
4. Load the training data (fuzex2trnData) and checking data (fuzex2chkData), as you did
previously.

Generate a FIS structure and train the FIS as you did previously, except now select 60 training
epochs.
In this case, the checking error is large, with the minimum occurring in the first epoch. Since the
app chooses the trained FIS parameters associated with the minimum checking error, the trained
FIS does not sufficiently capture the features of this data set. It is important to know the features
of your data set well when you select your training and checking data. When you do not know
the features of your data, you can analyze the checking error plots to see whether or not the
checking data performed sufficiently well with the trained model.

In this example, the checking error is sufficiently large to indicate that either you need to select
more data for training or modify your membership function choices (both the number of
membership functions and the type). Otherwise, if you think the training data sufficiently
captures the features you are trying to represent, the system can be retrained without the
checking data.

To verify the poor training results, test the trained FIS model against the checking data.
As expected, there are significant differences between the checking data output values and the
FIS output.