DMML Unit 3
DMML Unit 3
Suppose you
wish to implement a home security system that recognizes who is
entering your house.
1. FIND-S Algorithm
2. Candidate Elimination
Algorithm
Concept Learning
• A Formal Definition for Concept Learning:
5
3
h0 = <0, 0, 0, 0, 0, 0>
H3=H2
H0 = <0, 0, 0, 0, 0>
H1 = <Japan, Honda, Blue, 1980, Economy> = h2
H3 = <Japan, ?, Blue, ?, Economy> = h4
H5 = <Japan, ?, ?, ?, Economy>
H6 = <Japan, ?, ?, ?, Economy> = h7
Algorithm:
For each training example d, do:
If d is positive example
Remove from G any hypothesis h inconsistent with d
For each hypothesis s in S not consistent with d:
Remove s from S
Add to S all minimal generalizations of s consistent with d and having a
generalization in G
Remove from S any hypothesis with a more specific h in S
If d is negative example
Remove from S any hypothesis h inconsistent with d
For each hypothesis g in G not consistent with d:
Remove g from G
Add to G all minimal specializations of g consistent with d and having a
specialization in S
Remove from G any hypothesis having a more general hypothesis in G
Example Citations Size InLibrary Price Editions Buy
G4 ={<Many, ????>}
G3 ={<Many, ????>, <??? Expensive ?>}
G2 ={<Many, ????>, <?,Big, ???>, <??? Expensive ?> <????Many>}
G1={<Many, ????>, <?,Big, ???>, <? Medium???> <??? Expensive ?> <????Many> <????Few>}
G0={<?,?,?,?,?>} Shrink –ve instance
S0 = {<0,0,0,0,0>} +ve
S2 = S1 = {<Japan, Honda, Blue, 1980, Economy>}
S4 = S3 = {<Japan, ?,Blue, ?, Economy >}
S5 = {<Japan, ? ?,?Economy>}
G7 = {}
G6 = G5 = {<Japan, ???, Economy>}
G4 = {<??Blue??> <Japan, ??? Economy> }
G3 = {<?? Blue ??> <???? Economy>}
G2 = {<?, Honda, ???>, <?? Blue ? ?, <??? 1980 ?><???? Economy> }
G1 = G0 = {<?????>} -ve
S0 = {<0,0,0,0,0,>} +ve
S2 = S1={<Round, Triangle, Round, Purple, Yes>}
S4 = S3 = {<?,Triangle, Round, ?, Yes>}
S5 = <?, ?, Round, ?, Yes>
81