Amity School of Engineering and Technology

MODULE IV
Expert System and Learning
B.Tech.(CSE), VII
Artificial Intelligence (CSE 401)
Introduction of Expert System and it’s Architecture
 Content of Module IV

• Expert System: Need • Justification for expert systems •

Knowledge Acquisition • Case studies: MYCIN, R1.
• Learning: Concept of learning • learning automation • Learning
by inductions
• Handling Uncertainties: Non-monotonic reasoning •
Probabilistic reasoning • Use of certainty factors • Fuzzy logic

2
 What is an expert system?

“An expert system is a computer system that

emulates, or acts in all respects, with the decision-
making capabilities of a human expert.”

Professor Edward Feigenbaum

Stanford University

3
 Learning outcomes

• Students will be able to know about

– Expert System and its need.
– Characteristics, Capabilities and Components of Expert Systems.
– Advantages and Limitations of Expert Systems.
– Applications of Expert Systems.

4
 Amity School of Engineering and Technology

Expert Systems (ES)

 An expert system is a computer program that is designed to solve complex problems
and to provide decision-making ability like a human expert.
 It performs this by extracting knowledge from its knowledge base using the
reasoning and inference rules according to the user queries.
• Expert systems aimed to capture specialist human expertise
which was in short supply. Eg..,
– Medical expertise
– Computer configuration expertise.
– Expertise for oil exploration.

• Aim was to develop systems capturing this expertise, so the

knowledge could be deployed where experts were unavailable.

• Expert system (ES) are knowledge intensive programs that solve

problems in a domain that requires considerable amount of
technical expertise.

6
An Expert System (ES) is a computer-based system (mainly
software) that uses knowledge and facts, and apply an appropriate
reasoning technique (inferencing) to solve problems in a given
field (domain) that normally require the services of human
experts.

7
 Amity School of Engineering and Technology

Need of Expert Systems

An expert system is a computer program
that is designed to solve complex
problems and to provide decision-
making ability like a human expert.
One expert system may contain knowledge
from more than one human experts thus
making the solutions more efficient.

It decreases the cost of consulting

an expert for various domains such as
medical diagnosis.
 Need & Justification for expert
systems- cognitive problems
• Expert systems are suitable for knowledge intensive problems
that are typically solved by human experts.

• Because expert systems depend on human knowledge, if

human experts are unable to solve a given problem, no
successful expert system can be developed to solve the
problem either.

• When the demand for human expertise surpasses the

availability of experts, an expert system may be the tool for
handling the situation.

• The justification of using an expert system for a selected

problem depends on the primary goal of the organization and
the types of alternatives available. 9
10
 Expert System (ES) Architecture
• Below is the basic architecture of any expert system
– the interface is largely unimportant, what we need to concentrate
on is the inference engine and the knowledge base (KB) including
the form(s) of representation and the specific knowledge included

The explanation
subsystem and
case-specific data
are optional

The knowledge
base editor is only
included if non
KBEs will be
editing the KB
 Amity School of Engineering and Technology

The 3-C’s of Expert Systems

Characteristics

Expert System Capabilities

Components
 Amity School of Engineering and Technology

The 3-C’s of Expert Systems

They have high-performance

levels

They are easy to understand

Characteristics
of ES
They are completely reliable

They are highly responsive

 Amity School of Engineering and Technology

The 3-C’s of Expert Systems

Assistance in human decision making

Demonstrations and instructions
Diagnosis
Deriving solutions
Suggestions for alternative solutions to
Capabilities a problem
of ES Justification of conclusions
Interpreting inputs and providing
relevant outputs

Predicting results
 Amity School of Engineering and Technology

The 3-C’s of Expert Systems

Knowledge Base

Inference Engine

Knowledge acquisition and

Components of ES
learning module

User Interface

Explanation module
Characteristics of Expert System

16
17
Basic Concept of ES

18
19
Designing Expert System

20
Component of Expert System

21
1. Knowledge Base

22
Knowledge Base

23
Using the Knowledge Base

24
Reasoning Engine

25
 Rule based system architecture
• The most common form of architecture used in expert and other types of
knowledge based system is the production system, also called the rule-based
system.

• This type of system uses knowledge encoded in the form of production rules,
that
is, if ….then rules.

• Each rule represents a small chunk of knowledge relating to the given domain
of expertise.

• A number of related rules collectively may correspond to a chain of

inferences which lead from some initially known facts to some useful
conclusions.

• When the known facts support the conditions in the rule’s left side, the
conclusion or action part of the rule is then accepted as known.
26
 Rule based system architecture
• Inference in the production systems is accomplished by a process of
chaining through the rules recursively, either in a forward or backward
direction, until a conclusion is reached or until failure occurs.

• The selection of rules used in the chaining process is determined by

matching current facts against the domain knowledge or variables in rules
and choosing among a candidate set of rules the ones that meet some given
criteria, such as specificity.

• The inference process is typically carried out in an interactive mode with

the user providing input parameters needed to complete the rule chaining
process.

27
Rule based system architecture

28
Forward chaining is data
driven
Backward chaining is goal
Explanation

30
User interface

31
 Expert System Components And
Human Interfaces
• Expert systems have a number of major system components
and interface with individuals who interact with the system in
various roles.

32
 CONTROL SYSTEM with Failure Detection and
Reconfiguration

Executive control
Aircraft
Controlle Dynamic
r s

ESTIMATO
R SENSOR
MEASUREMEN
TS

Reconfiguration
control signals

RECONFIGURATI Failure Failure Failure

ON Model Diagnosi Detectio
Estimation s n
 Real-Time
Implementation of
Rule-Based Control
System.

Handelman and Stengel 1989

• High level control logic
• High level reconfiguration logic
True/False signal is propagated
bottom up
2. User Interface

38
3. Inference Engine

39
4. Explanation facility

40
5. Knowledge Acquisition facility

41
 6. External interface

This provides the communication link between the ES and the external
environment.

42
Knowledge Acquisition

43
Knowledge Acquisition

44
 Amity School of Engineering and Technology

Knowledge Acquisition

Knowledge acquisition is the

process of extracting, structuring and
organizing knowledge from one
source, usually human experts, so it
can be used in software such as an
ES.
 Amity School of Engineering and Technology

Knowledge Acquisition
 Amity School of Engineering and Technology

Knowledge Acquisition Difficulties

 Amity School of Engineering and Technology

Knowledge Acquisition Methods

 Amity School of Engineering and Technology

Knowledge Acquisition Methods

 Amity School of Engineering and Technology

Knowledge Acquisition Methods

 Amity School of Engineering and Technology

Knowledge Acquisition Methods

 Amity School of Engineering and Technology

Knowledge Acquisition Methods

 Amity School of Engineering and Technology

Knowledge Acquisition Methods

 Amity School of Engineering and Technology

Knowledge Acquisition Methods

 Amity School of Engineering and Technology

Knowledge Acquisition

Interactive Knowledge Acquisition

 Amity School of Engineering and Technology

Concept of Learning

Learning is the process of acquiring new understanding,

knowledge, behaviors, skills, values, attitudes, and preferences.
Learning is one of the fundamental building blocks of artificial
intelligence (AI) solutions. From a conceptual
standpoint, learning is a process that improves the knowledge of
an AI program by making observations about its environment.
 Various learning mechanisms
• Simple storing of computed information or
rote learning,
• any computer programs ie., database systems
can be said to learn in this sense although most
people would not call such simple storage
learning.
• Another way we learn if through taking advice
from others.
– Advice taking is similar to rote learning, but high-
level advice may not be in a form simple enough
for a program to use directly in problem solving
57
 Various learning mechanisms
• People also learn through their own problem-
solving experience.
• Learning from examples : we often learn to
classify things in the world without being
given explicit rules.
• Learning from examples usually involves a
teacher whohelps us classify things by
correcting us when we arewrong

58
 Amity School of Engineering and Technology

Automation Learning

The application of technology, programs, robotics or processes

to achieve outcomes with minimal human input.
 Amity School of Engineering and Technology

Concept of Learning
 Inductive Learning Algorithm (ILA)

• Inductive Learning Algorithm (ILA) is an

iterative and inductive machine learning
algorithm which is used for generating a set of
a classification rule, which produces rules of
the form “IF-THEN”, for a set of examples,
producing rules at each iteration and
appending to the set of rules.

61
 Basic Idea
• There are basically two methods for
knowledge extraction
– from domain experts
– With machine learning.
• Collecting knowledge form expert has issues
like
– Huge in amount
– Often biased for reliable
– Difficult to fetch desired information
62
 Deductive learning
• Deductive learning is a method of ML in which a model is
built using a series of logical principles and steps.
• In DL, the model is specifically designed to adhere to a set of
guidelines and processes in order to produce predictions based
on brand-new, unexplored data.
• In rule-based systems, expert systems, and knowledge-based
systems, where the rules and processes are clearly set by
domain experts, deductive learning is frequently utilized.
• The model is trained to adhere to the guidelines and processes
in order to derive judgments or predictions from the input
data.

63
• Deductive learning begins with a set of rules
and processes and utilizes these rules to
generate predictions on incoming data, in
contrast to inductive learning, which learns
from particular examples. Making a model that
can precisely adhere to a set of guidelines and
processes in order to generate predictions is
the aim of deductive learning.

64
• So we move towards the machine learning
approach for this work.
– to replicate the experts logic in the form of
algorithms but this work is very tedious, time
taking and expensive.
– So we move towards the inductive algorithms
which itself generate the strategy for performing a
task and need not instruct separately at each step.

65
 Inductive learning
• An technique of machine learning called
inductive learning trains a model to generate
predictions based on examples or observations.
• During inductive learning, the model picks up
knowledge from particular examples or
instances and generalizes it such that it can
predict outcomes for brand-new data.

66
• When using inductive learning, a rule or
method is not explicitly programmed into the
model.
• Instead, the model is trained to spot trends and
connections in the input data and then utilize
this knowledge to predict outcomes from fresh
data.
• Making a model that can precisely anticipate
the result of subsequent instances is the aim of
inductive learning. 67
 Example no. Place type weather location decision

I) hilly winter kullu Yes

II ) mountain windy Mumbai No

III ) mountain windy Shimla Yes

IV ) beach windy Mumbai No

V) beach warm goa Yes

VI ) beach windy goa No

VII ) beach warm Shimla Yes

68
 THE ILA ALGORITHM:
General requirements for the algorithm:-

1.list the examples in the form of a table ‘T’ where

each row corresponds to an example and each
column contains an attribute value.
2.create a set of m training examples, each
example composed of k attributes and a class
attribute with n possible decisions.
3.create a rule set, R, having the initial value false.

69
• Step 1: divide the table ‘T’ containing m
examples into n sub-tables (t1, t2,…..tn). One
table for each possible value of the class
attribute. (repeat steps 2-8 for each sub-table)

70
 s.no place type weather location decision

1 hilly winter kullu Yes

2 mountain windy Shimla Yes

3 beach warm goa Yes

4 beach warm Shimla Yes

71
 s.no place type weather location decision

5 mountain windy Mumbai No

6 beach windy Mumbai No

7 beach windy goa No

72
• Step 2: Initialize the attribute combination count ‘ j ‘ = 1.
• Step 3: For the sub-table on which work is going on, divide the attribute
list into distinct combinations, each combination with ‘j ‘ distinct
attributes.
• Step 4: For each combination of attributes, count the number of
occurrences of attribute values that appear under the same combination of
attributes in unmarked rows of the sub-table under consideration, and at
the same time, not appears under the same combination of attributes of
other sub-tables. Call the first combination with the maximum number of
occurrences the max-combination ‘ MAX’.

73
• Step 5: If ‘MAX’ = = null , increase ‘ j ‘ by 1 and go to Step
3.
• Step 6: Mark all rows of the sub-table where working, in
which the values of ‘MAX’ appear, as classified.
• Step 7: Add a rule (IF attribute = “XYZ” –> THEN decision is
YES/ NO) to R whose left-hand side will have attribute names
of the ‘MAX’ with their values separated by AND, and its
right-hand side contains the decision attribute value associated
with the sub-table.
• Step 8: If all rows are marked as classified, then move on to
process another sub-table and go to Step 2. else, go to Step 4.
If no sub-tables are available, exit with the set of rules
obtained till then.
74
step (2-8) at iteration 1 row 3 & 4 column weather is selected
and row 3 & 4 are marked. the rule is added to R IF weather is
warm then a decision is yes.
at iteration 2 row 1 column place type is selected and row 1 is
marked. the rule is added to R IF place type is hilly then the
decision is yes.
at iteration 3 row 2 column location is selected and row 2 is
marked. the rule is added to R IF location is Shimla then the
decision is yes.
at iteration 4 row 5&6 column location is selected and row 5&6
are marked. the rule is added to R IF location is Mumbai then a
decision is no.
at iteration 5 row 7 column place type & the weather is selected
and row 7 is marked. rule is added to R IF place type is beach
75
AND weather is windy then the decision is
 finally we get the rule set :- Rule Set
• Rule 1: IF the weather is warm THEN the decision is yes.
• Rule 2: IF place type is hilly THEN the decision is yes.
• Rule 3: IF location is Shimla THEN the decision is yes.
• Rule 4: IF location is Mumbai THEN the decision is no.
• Rule 5: IF place type is beach AND the weather is windy
THEN the decision is no.

76
 Amity School of Engineering and Technology

Advantages of ES

These systems are highly reproducible.

They can be used for risky places where the human presence is
not safe.

Error possibilities are less if the Knowledge Base (KB) contains

correct knowledge.
The performance of these systems remains steady as it is not
affected by emotions, tension, or fatigue.

They provide a very high speed to respond to a particular query.

 Amity School of Engineering and Technology

Limitations of AI
The response of the expert system may get wrong if the knowledge base
contains the wrong information.

Like a human being, it cannot produce a creative output for different scenarios.

For each domain, we require a specific ES, which is one of the big limitations.

The performance of these systems remains steady as it is not affected by

emotions, tension, or fatigue.

It cannot learn from itself and hence requires manual updates.

Its maintenance and development costs are very high.

Knowledge acquisition for designing is much difficult.

 Amity School of Engineering and Technology

Applications of ES

In Designing and Manufacturing Domain.

In Knowledge Domain

In Finance Domain

In Diagnosis and Troubleshooting of devices

Planning and Scheduling

Process Monitoring and Control

Thank You

80