Scribd
Upload
73 views

Machine Learning - Version Space - Problem 1

1. The document describes a version space learning problem to learn the concept of a "Japanese Economy Car" based on examples with features of origin, manufacturer, color, decade, and type. 2. It initializes with a positive example to define the specific version S, and a general version G, then refines G and S with each subsequent positive and negative example, generalizing S and specializing G. 3. After considering all 5 examples, G and S converge to a single concept of (Japan, ?, ?, ?, Economy), correctly identifying the target concept of a "Japanese Economy Car".

Uploaded by

WiseUtopian
Copyright
© © All Rights Reserved
Available Formats
Download as PDF, TXT or read online on Scribd
73 views

Machine Learning - Version Space - Problem 1

1. The document describes a version space learning problem to learn the concept of a "Japanese Economy Car" based on examples with features of origin, manufacturer, color, decade, and type. 2. It initializes with a positive example to define the specific version S, and a general version G, then refines G and S with each subsequent positive and negative example, generalizing S and specializing G. 3. After considering all 5 examples, G and S converge to a single concept of (Japan, ?, ?, ?, Economy), correctly identifying the target concept of a "Japanese Economy Car".

Uploaded by

WiseUtopian
Copyright
© © All Rights Reserved
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 4

Version Space Problem 1

Reference: E. Rich, K. Knight, "Artificial Intelligence", McGraw Hill, Second Edition.


http://www.cc.gatech.edu/classes/cs3361_97_winter/learning.txt

Problem 1:

Learning the concept of "Japanese Economy Car"

Features: ( Country of Origin, Manufacturer, Color, Decade, Type )

Origin Manufacturer Color Decade Type Example Type


Japan Honda Blue 1980 Economy Positive
Japan Toyota Green 1970 Sports Negative
Japan Toyota Blue 1990 Economy Positive
USA Chrysler Red 1980 Economy Negative
Japan Honda White 1980 Economy Positive

Solution:

1. Positive Example: (Japan, Honda, Blue, 1980, Economy)

Initialize G to a singleton set that includes everything. G = { (?, ?, ?, ?, ?) }


Initialize S to a singleton set that includes the first positive example. S = { (Japan, Honda, Blue, 1980, Economy) }

These models represent the most general and the most specific heuristics one might learn.
The actual heuristic to be learned, "Japanese Economy Car", probably lies between them somewhere within the version space.

2. Negative Example: (Japan, Toyota, Green, 1970, Sports)

Specialize G to exclude the negative example.


G= { (?, Honda, ?, ?, ?),
(?, ?, Blue, ?, ?),
(?, ?, ?, 1980, ?),
(?, ?, ?, ?, Economy) }
{ (Japan, Honda, Blue, 1980, Economy)
S=
}

Refinement occurs by generalizing S or specializing G, until the heuristic hopefully converges to one that works well.

3. Positive Example: (Japan, Toyota, Blue, 1990, Economy)

Prune G to exclude descriptions inconsistent with the positive example.


Generalize S to include the positive example.

{ (?, ?, Blue, ?, ?),


G=
(?, ?, ?, ?, Economy) }
S= { (Japan, ?, Blue, ?, Economy) }

4. Negative Example: (USA, Chrysler, Red, 1980, Economy)


Specialize G to exclude the negative example (but stay consistent with S)

{ (?, ?, Blue, ?, ?),


G=
(Japan, ?, ?, ?, Economy) }
S= { (Japan, ?, Blue, ?, Economy) }

5. Positive Example: (Japan, Honda, White, 1980, Economy)

Prune G to exclude descriptions inconsistent with positive example.


Generalize S to include positive example.

G = { (Japan, ?, ?, ?, Economy) }
S = { (Japan, ?, ?, ?, Economy) }
G and S are singleton sets and S = G.
Converged.
No more data, so algorithm stops.

You might also like