Introduction to Artificial

Intelligence

UFE – AIF321
Spring semester
Lecture 1 – Overview

01/27/2021 Introduction to2024.01.25

Data Mining, 2nd Edition 1
Tan, Steinbach, Karpatne, Kumar
Information
About course:

○ Lecture & Seminar: Thursday 17:00 ~ 19:40

○ Lecture:
■ Basic theories of Machine Learning (ML) Algorithms
■ Exercises
○ Seminar:
■ Introduction to Python
■ Application of ML algorithms to real-life case

01/27/2021 Introduction to Data Mining, 2nd Edition 2

Tan, Steinbach, Karpatne, Kumar
Section 1: Introduction

01/27/2021 Introduction to Data Mining, 2nd Edition 3

Tan, Steinbach, Karpatne, Kumar
What is Artificial Intelligence?

01/27/2021 Introduction to Data Mining, 2nd Edition 4

Tan, Steinbach, Karpatne, Kumar
 Fields

01/27/2021 Introduction to Data Mining, 2nd Edition 5

Tan, Steinbach, Karpatne, Kumar
01/27/2021 Introduction to Data Mining, 2nd Edition 6
Tan, Steinbach, Karpatne, Kumar
Skill sets and tools

Open Data Science Conference 2023

01/27/2021 Introduction to Data Mining, 2nd Edition 7
Tan, Steinbach, Karpatne, Kumar
Classification of AI

01/27/2021 Introduction to Data Mining, 2nd Edition 8

Tan, Steinbach, Karpatne, Kumar
Classification of ML

01/27/2021 Introduction to Data Mining, 2nd Edition 9

Tan, Steinbach, Karpatne, Kumar
ML Algorithms

01/27/2021 Introduction to Data Mining, 2nd Edition 10

Tan, Steinbach, Karpatne, Kumar
Reference
Stanford online course:
https://online.stanford.edu/courses/stats216-introduction-statistical-learning

01/27/2021 Introduction to Data Mining, 2nd Edition 11

Tan, Steinbach, Karpatne, Kumar
01/27/2021 Introduction to Data Mining, 2nd Edition 12
Tan, Steinbach, Karpatne, Kumar
Section 2: Data

01/27/2021 Introduction to Data Mining, 2nd Edition 13

Tan, Steinbach, Karpatne, Kumar
Outline

● Attributes and Objects

● Types of Data

● Data Quality

● Data Preprocessing

01/27/2021 Introduction to Data Mining, 2nd Edition 14

Tan, Steinbach, Karpatne, Kumar
What is Data?

● Collection of data objects Attributes

and their attributes
● An attribute is a property or
characteristic of an object
– Examples: eye color of a
person, temperature, etc.
– Attribute is also known as

Objects
variable, field, characteristic,
dimension, or feature
● A collection of attributes
describe an object
– Object is also known as
record, point, case, sample,
entity, or instance
Attribute Values

● Attribute values are numbers or symbols

assigned to an attribute for a particular object

● Distinction between attributes and attribute values

– Same attribute can be mapped to different attribute
values
◆ Example: height can be measured in feet or meters

– Different attributes can be mapped to the same set of

values
◆ Example: Attribute values for ID and age are integers
– But properties of attribute can be different than the
properties of the values used to represent the
attribute Introduction to Data Mining, 2nd Edition
01/27/2021 16
Tan, Steinbach, Karpatne, Kumar
 Measurement of Length
● The way you measure an attribute may not match the
attributes properties.

This scale This scale

preserves preserves
only the the ordering
ordering and additvity
property of properties of
length. length.
 Types of Attributes

● There are different types of attributes

– Nominal
◆ Examples: ID numbers, eye color, zip codes
– Ordinal
◆ Examples: rankings (e.g., taste of potato chips on a
scale from 1-10), grades, height {tall, medium, short}
– Interval
◆ Examples: calendar dates, temperatures in Celsius or
Fahrenheit.
– Ratio
◆ Examples: temperature in Kelvin, length, counts,
elapsed time (e.g., time to run a race)
01/27/2021 Introduction to Data Mining, 2nd Edition 18
Tan, Steinbach, Karpatne, Kumar
Properties of Attribute Values

● The type of an attribute depends on which of the

following properties/operations it possesses:
– Distinctness: = ≠
– Order: < >
– Differences are + -
meaningful :
– Ratios are * /
meaningful
– Nominal attribute: distinctness
– Ordinal attribute: distinctness & order
– Interval attribute: distinctness, order & meaningful
differences
– Ratio attribute: all 4 properties/operations

01/27/2021 Introduction to Data Mining, 2nd Edition 19

Tan, Steinbach, Karpatne, Kumar
Difference Between Ratio and Interval

● Is it physically meaningful to say that a

temperature of 10 ° is twice that of 5° on
– the Celsius scale?
– the Fahrenheit scale?
– the Kelvin scale?

● Consider measuring the height above average

– If Bill’s height is three inches above average and
Bob’s height is six inches above average, then would
we say that Bob is twice as tall as Bill?
– Is this situation analogous to that of temperature?

01/27/2021 Introduction to Data Mining, 2nd Edition 20

Tan, Steinbach, Karpatne, Kumar
This categorization of attributes is due to S. S. Stevens
This categorization of attributes is due to S. S. Stevens
Discrete and Continuous Attributes

● Discrete Attribute
– Has only a finite or countably infinite set of values
– Examples: zip codes, counts, or the set of words in a
collection of documents
– Often represented as integer variables.
– Note: binary attributes are a special case of discrete
attributes
● Continuous Attribute
– Has real numbers as attribute values
– Examples: temperature, height, or weight.
– Practically, real values can only be measured and
represented using a finite number of digits.
– Continuous attributes are typically represented as
floating-point variables.
01/27/2021 Introduction to Data Mining, 2nd Edition 23
Tan, Steinbach, Karpatne, Kumar
Critiques of the attribute categorization

● Real data is approximate and noisy

– This can complicate recognition of the proper attribute type
– Treating one attribute type as another may be approximately
correct

01/27/2021 Introduction to Data Mining, 2nd Edition 24

Tan, Steinbach, Karpatne, Kumar
Key Messages for Attribute Types

● The types of operations you choose should be

“meaningful” for the type of data you have
– Distinctness, order, meaningful intervals, and meaningful
ratios are only four (among many possible) properties of
data

– The data type you see – often numbers or strings – may

not capture all the properties or may suggest properties
that are not present

– Analysis may depend on these other properties of the data

◆ Many statistical analyses depend only on the distribution

– In the end, what is meaningful can be specific to domain

01/27/2021 Introduction to Data Mining, 2nd Edition 25

Tan, Steinbach, Karpatne, Kumar
Important Characteristics of Data

– Dimensionality (number of attributes)

◆ High dimensional data brings a number of challenges

– Sparsity
◆ Only presence counts

– Resolution
◆ Patterns depend on the scale

– Size
◆ Type of analysis may depend on size of data

01/27/2021 Introduction to Data Mining, 2nd Edition 26

Tan, Steinbach, Karpatne, Kumar
Types of data sets
● Record
– Data Matrix
– Document Data
– Transaction Data
● Graph
– World Wide Web
– Molecular Structures
● Ordered
– Spatial Data
– Temporal Data
– Sequential Data
– Genetic Sequence Data

01/27/2021 Introduction to Data Mining, 2nd Edition 27

Tan, Steinbach, Karpatne, Kumar
Record Data

● Data that consists of a collection of records, each

of which consists of a fixed set of attributes

01/27/2021 Introduction to Data Mining, 2nd Edition 28

Tan, Steinbach, Karpatne, Kumar
Data Matrix

● If data objects have the same fixed set of numeric

attributes, then the data objects can be thought of as
points in a multi-dimensional space, where each
dimension represents a distinct attribute

● Such a data set can be represented by an m by n matrix,

where there are m rows, one for each object, and n
columns, one for each attribute

01/27/2021 Introduction to Data Mining, 2nd Edition 29

Tan, Steinbach, Karpatne, Kumar
Document Data

● Each document becomes a ‘term’ vector

– Each term is a component (attribute) of the vector
– The value of each component is the number of times
the corresponding term occurs in the document.

01/27/2021 Introduction to Data Mining, 2nd Edition 30

Tan, Steinbach, Karpatne, Kumar
Transaction Data

● A special type of data, where

– Each transaction involves a set of items.
– For example, consider a grocery store. The set of products
purchased by a customer during one shopping trip constitute a
transaction, while the individual products that were purchased
are the items.
– Can represent transaction data as record data

01/27/2021 Introduction to Data Mining, 2nd Edition 31

Tan, Steinbach, Karpatne, Kumar
 Graph Data

● Examples: Generic graph, a molecule, and webpages

Benzene Molecule: C6H6

01/27/2021 Introduction to Data Mining, 2nd Edition 32
Tan, Steinbach, Karpatne, Kumar
Ordered Data

● Sequences of transactions
Items/Events

An element of
the sequence
01/27/2021 Introduction to Data Mining, 2nd Edition 33
Tan, Steinbach, Karpatne, Kumar
Ordered Data

● Genomic sequence data

01/27/2021 Introduction to Data Mining, 2nd Edition 34

Tan, Steinbach, Karpatne, Kumar
Ordered Data

● Spatio-Temporal Data

Average Monthly
Temperature of
land and ocean

01/27/2021 Introduction to Data Mining, 2nd Edition 35

Tan, Steinbach, Karpatne, Kumar
Data Quality

● Poor data quality negatively affects many data processing

efforts

● Data mining example: a classification model for detecting

people who are loan risks is built using poor data
– Some credit-worthy candidates are denied loans
– More loans are given to individuals that default

01/27/2021 Introduction to Data Mining, 2nd Edition 36

Tan, Steinbach, Karpatne, Kumar
Data Quality …

● What kinds of data quality problems?

● How can we detect problems with the data?
● What can we do about these problems?

● Examples of data quality problems:

– Noise and outliers
– Wrong data
– Fake data
– Missing values
– Duplicate data
01/27/2021 Introduction to Data Mining, 2nd Edition 37
Tan, Steinbach, Karpatne, Kumar
Noise

● For objects, noise is an extraneous object

● For attributes, noise refers to modification of original values
– Examples: distortion of a person’s voice when talking on a poor phone
and “snow” on television screen
– The figures below show two sine waves of the same magnitude and
different frequencies, the waves combined, and the two sine waves with
random noise
◆ The magnitude and shape of the original signal is distorted

01/27/2021 Introduction to Data Mining, 2nd Edition 38

Tan, Steinbach, Karpatne, Kumar
Outliers

● Outliers are data objects with characteristics that

are considerably different than most of the other
data objects in the data set
– Case 1: Outliers are
noise that interferes
with data analysis

– Case 2: Outliers are

the goal of our analysis
◆ Credit card fraud
◆ Intrusion detection

● Causes?
01/27/2021 Introduction to Data Mining, 2nd Edition 39
Tan, Steinbach, Karpatne, Kumar
Missing Values

● Reasons for missing values

– Information is not collected
(e.g., people decline to give their age and weight)
– Attributes may not be applicable to all cases
(e.g., annual income is not applicable to children)

● Handling missing values

– Eliminate data objects or variables
– Estimate missing values
◆ Example: time series of temperature
◆ Example: census results
– Ignore the missing value during analysis

01/27/2021 Introduction to Data Mining, 2nd Edition 40

Tan, Steinbach, Karpatne, Kumar
Duplicate Data

● Data set may include data objects that are

duplicates, or almost duplicates of one another
– Major issue when merging data from heterogeneous
sources

● Examples:
– Same person with multiple email addresses

● Data cleaning
– Process of dealing with duplicate data issues

● When should duplicate data not be removed?

01/27/2021 Introduction to Data Mining, 2nd Edition 41
Tan, Steinbach, Karpatne, Kumar
Selecting the Right Proximity Measure

● Choice of the right proximity measure depends on the domain

● What is the correct choice of proximity measure for the
following situations?
– Comparing documents using the frequencies of words
◆ Documents are considered similar if the word frequencies are similar

– Comparing the temperature in Celsius of two locations

◆ Two locations are considered similar if the temperatures are similar in
magnitude

– Comparing two time series of temperature measured in Celsius

◆ Two time series are considered similar if their “shape” is similar, i.e., they vary
in the same way over time, achieving minimums and maximums at similar
times, etc.

01/27/2021 Introduction to Data Mining, 2nd Edition 42

Tan, Steinbach, Karpatne, Kumar