Knowledge Representation
Knowledge Representation
&
PREDICATE LOGIC
• To solve complex problems, we need:
1. Large amount of knowledge
2. Mechanism for representation and manipulation
of existing knowledge to create new solution.
Knowledge Representation
– Facts: Things we want to represent. Truth in
some relevant world.
– Representation of facts.
Representation and Mapping
reasoning
programs
Internal
Facts
Representations
English English
understanding generation
English
Representations
Representation and Mapping
forward backward
representation representation
mapping mapping
Internal Internal
representations representations
of initial facts operation of final facts
of program
Intelligent agents should have capacity for:
hastail(Spot)
Spot has a tail
1
1
Good Knowledge representation should exhibit:
1. Representational adequacy-
Ability to represent all kinds of knowledge that are needed in the domain.
2. Inferential adequacy-
Ability to manipulate representational structures such that new
knowledge can be derived/inferred from the old.
3. Inferential efficiency-
Ability to incorporate additional information into an existing knowledge
base that can be used to focus the attention of inference mechanisms
in the most promising direction.
4. Acquisitional efficiency-
Ability to easily acquire new information
Approaches to KR
1. Simple relational knowledge:
• Provides very weak inferential capabilities.
• May serve as the input to powerful inference engines.
Player Height Weight handed
Peter 6-0 180 right
Ajay 5-10 170 left
John 6-2 215 left
Vickey 6-3 205 right
10
Approaches to KR
Inheritable knowledge:
• Objects are organized into classes and classes are
organized in a generalization hierarchy.
• Inheritance is a powerful form of inference, but not
adequate.
• Ex. Property inheritance inference mechanism.
isa handed
Adult male Person Right
instance
Inferential knowledge:
• Facts represented in a logical form, which facilitates
reasoning.
• An inference engine is required.
Procedural knowledge:
• Representation of “how to make it” rather than “what
it is”.
• May have inferential efficiency, but no inferential
adequacy and acquisitional efficiency.
• Ex. Writing LISP programs
16
Issues in KR
1. Important Attributes: Isa and instance attributes.
2. Relationships among attributes: inverses, existence in a Isa
hierarchy, single-valued attributes, techniques for reasoning
about values.
3.Choosing the Granularity: High-level facts may not be adequate
for inference. Low-level primitives may require a lot of storage.
• Ex: “john spotted sue”
[representation: spotted(agent(john),object(sue))]
Q1: “who spotted sue?” Ans1: “john”.
Q2: “Did john see sue?” Ans2: NO ANSWER!!!!
• Add detailed fact: spotted(x,y)-->saw(x,y) then Ans2:
“Yes”.
17
• 4.Representing Set of Objects:
• 5. finding the right structure as needed.:
18
Propositional logic
• Statements used in mathematics.
• Proposition :is a declarative sentence whose value is
either true or false.
Examples:
• “The sky is blue.” [Atomic Proposition]
• “The sky is blue and the plants are green.”
[Molecular/Complex Proposition]
• “Today is a rainy day” [Atomic
Proposition]
• “Today is Sunday” [Atomic Proposition]
• “ 2*2=4” [Atomic Proposition]
19
Terminologies in propositional algebra:
Statement: sentence that can be true/false.
Properties of statement:
Satisfyability: a sentence is satisfyable if there is
an
interpretation for which it is true.
Eg.”we wear woollen cloths”
21
22
INFERENCE RULES IN PROPOSITIONAL
LOGIC
1. Idempotent rule:
P ˄ P ==> P
P ˅ P ==> P
2. Commutative rule:
P ˄ Q ==> Q ˄ P
P ˅ Q ==> Q ˅ P
3.Associative rule:
P ˄ (Q ˄ R) ==> (P ˄ Q) ˄ R
P ˅ (Q ˅ R) ==> (P ˅ Q) ˅
R 23
4. Distributive Rule:
P ˅ (Q ˄ R) ==> (P ˅ Q) ˄ (P ˅
R) P ˄ (Q ˅ R) ==> (P ˄ Q) ˅ (P
˄ R)
5. De-Morgan’s Rule:
(ךP ˅ Q) ==> ךP ˄
ךQ ( ךP ˄ Q) ==> ךP ˅
ךQ
6. Implication elimination:
P Q => ךP ˅ Q 24
7. Bidirectional Implication elimination:
( P Q ) ==> ( P Q ) ˄ (Q P)
8. Contrapositive rule:
P Q => ךP ךQ
9. Double Negation rule:
ך (ךP) => P
10. Absorption Rule:
P ˅ ( P ˄ Q) => P
P ˄ ( P ˅ Q) => P
25
11.Fundamental identities:
P ˄ ךp => F [contradiction]
P ˅ ךP [Tautology]
=> T
P ˅ T => P
P ˅ F => P
P ˅ ךT => P
P ˄ F => F
P ˄ T => P
26
12. Modus Ponens:
If P is true and PQ then we can infer Q is also true.
P
PQ
Hence, Q
Hence, ךQ 24
14. Chain rule:
If pq and qr then pr
18. OR introduction:
Given P and Q are true then we can deduce P and
Q separately:
P P ˅ Q
Q P ˅ Q
29
• Example:
“I will get wet if it rains and I go out of the house”
(S ˄ R) W
30
Using Propositional Logic
e.g. ( P ˅ Q ˅ R ) ˄ (P ˅ Q ) ˄ (P ˅ R ) ˄ P It
33
2. Disjunctive normal form (DNF):
e.g. ( P ˄ Q ˄ R ) ˅ (P ˄ Q ) ˅
(P ˄ R ) ˅ P
34
Procedure to convert a statement to CNF
1. Eliminate implications and biconditionals using formulas:
• ( P Q ) ==> ( P Q ) ˄ (Q P)
• P Q => ךP ˅ Q
3. Use distributive and other laws & equivalent formulas to obtain Normal
forms.
35
Conversion to CNF example
Q. Convert into CNF :
( ( PQ )R ) Solution:
CNF
36
Resolution in propositional logic
Proof by Refutation / contradiction.
• Used for theorem proving / rule of inference.
37
• How it works?
• E.g. “ If it is Hot then it is Humid. If it is humid then it will rain.
It is hot.” prove that “ it will rain.”
• Solution:
• Let us denote these statements with propositions H,O and R:
– H: “ It is humid”.
– O: “ It is Hot”. And R: “It will rain”.
• [ ךR ] [ ךH ˅ R]
ךH [ ךO ˅
H]
ךO O
Using Prepositional
Logic:
• Theorem proving is decidable BUT
40
Predicate Logic – Definition
43
Representing simple facts (Preposition)
“SOCRATES IS A MAN”
SOCRATESMAN ---------1
“PLATO IS A MAN”
PLATOMAN ---------2
46
Using Predicate Logic
47
Quantifier
• The variable of predicates is quantified by quantifiers. There are two
types of quantifier in predicate logic − Universal Quantifier and
Existential Quantifier
48
Universal Quantifier example
53
6. “All Pompeians were Romans”
x: Pompeian(x) Roman(x)
54
Some more examples
• “all indoor games are easy”
x: indoor_game( x) easy(x)
55
• “god hheellpps those who helps
tthheemmsseellvveess”
x: helps( god, helps(x , x))
56
Computable functions and predicates
• “ Marcus was born in 40 A.D”
Born( Marcus, 40)
• Algorithm steps :-
x: P x: P
x: p x: P
P P
5. Eliminate (Skolemization).
x: P(x) P(c) Skolem constant
6. Drop .
x: P(x) P(x)
60
7. Convert the formula into a conjunction of disjuncts.
(P Q) R (P R) (Q R)
61
• Example of conversion:
x: [ Roman (x) ( Pompeian( x) hate ( x,
Caesar))]
After step 1: i.e. elimination of and the above stmt
becomes:
63
• Example to demostrate step 4: Move all quantifiers to the left
without changing their relative order.
•
• x: [ [y: animal (y) loves( x , y) ] [ z: loves( z,
x)] ]
64
• Example to demostrate step 5: skolemization ( i.e. elimination
of quantifier )
• Ex. 2:
y: x: leads ( y , x )
Here value of y that satisfies ‘leads’ depends on particular
value of x hence above stmt can be written as:
Wherex: leads
f(x) ( f(x) , x )
is skolem 57
function.
• Example to demonstrate step 6: dropping prefix
66
• Example to demostrate step 7: Convert the formula into a
conjunction of disjuncts.(CNF)
caesar) ) P Q R
• P (Q R ) ( P Q ) (P R )
• E.g.
Hate( marcus , X) Hate (marcus , caesar)
caesar/ X
e.g. 2.
69
Unification:
UNIFY(p, q) = unifier where SUBST(, p) = SUBST(, q)
70
Resolution
To prove a statement (i.e., show that it is valid), resolution
attempts to show that the negation of the statement produces
a contradiction with the known statements (i.e., that it is
unsatisfiable).
Resolution algorithm
• It is used as inference mechanism.
• Pre-processing steps:
1. Convert the given English sentence into predicate sentence.
2. Not all of these sentences will be in clausal form (CNF).
If any sentence is not in clausal form then convert it into clausal form.
3. Give these sentences (clauses) as an input to resolution
algorithm.
Q(x) R(x)
ii. If resolvant contains empty clause then contradiction has been found.
G(x) G(x)
E [ EMPTY CLAUSE] 63
iii. If step ii. Results in empty clause , it means our
assumption is wrong
and the original clause (to be proved) has to be
true.
74
Example
1. Marcus was a man.
2. Marcus was a Pompeian.
3. All Pompeians were Romans.
4. Caesar was a ruler.
5. All Pompeians were either loyal to Caesar or hated him.
6. Every one is loyal to someone.
7. People only try to assassinate rulers they are not loyal
to.
8. Marcus tried to assassinate Caesar.
75
1. “Marcus was a man”
man(marcus)
1
77
• “Every one is loyal to someone”
=> x3: y1: loyalto(x3, y1).
78
7. “People only try to assassinate rulers they are not loyal to.”
tryassassinate(marcus , caesar)
x2 / marcus
pompeian (x1)
roman(x1)
(3)
x1 / marcus
(2)
pompeian (marcus)
pompeian (marcus) loyalto (marcus,
caesar)
loyalto (marcus, 71
caesar)
loyalto (marcus,
(7) caesar)
x4/ marcus
f(x4)/ caesar
(8)
tryassassinate( marcus ,
caesar )
man( marcus)
(1) ruler( caesar )
man( marcu
s)
ruler( caesar ) 72
ruler( caesar )
(4)
ruler( caesar )
E
• Since we get an empty clause i.e. contradiction our assumption
that hate(marcus, caesar) is false
hence
hate(marcus, caesar) must be true.
83
EXAMPLE 2
• Consider the following paragraph:
“ anything anyone eats is called food. Milka likes all kind of
food. Bread is a food. Mango is a food. Alka eats pizza. Alka
eats everything milka eats.”
84
• Solution:
1. “ anything anyone eats is called food.”
x: y: eats(x , y) food(y)
x: y: eats(x , y) food(y)
eats(x , y) food(y)
(1)
2. “Milka likes all kind of food”
y1: food(y1) like(milka , y1)
y1: food(y1) like( milka , y1)
food(y1) like( milka , y1) (2)
3. “Bread is a food”
food(bread) (3)
4. “Mango is a food”
food( mango) (4)
75
5. “Alka eats Pizza”
eats( alka, pizza) (5)
76
like(milka , (2)
pizza) food(y1) like( milka ,
y1)
pizza/
y1
food(pizza)
(1)
eats(x , y) pizza/
food(y) y
eats(x ,
(5) pizza)
eats( alka,
pizza) alka/
x
E 77
Since like(milka , pizza) is contradiction like(milka , is
Question to be answered : 2. “ what
food Alka eats ?” eats( alka, ??)
there exist something which Alka eats we have to find the value of
x
• Therefore we conclude :
answer is
“pizza”
89
Example 3:
"All people who are not poor and are smart are happy. Those
people who' read are not stupid. John can read, is wealthy.
Happy people have exciting lives. Can anyone be found with an
exciting life?"
EXAMPLE 3 Cont…
These predicate calculus expressions for the happy
life problem are transformed into the following
clauses:
Resolution prove for the "exciting life" problem
Using Predicate Logic
93
94