Knowledge Discovery in

Databases
We Are Data Rich but
Information Poor

Databases are too big

Data Mining can help

discover knowledge

Terrorbytes
Principles of Knowledge Discovery in Data
What Is Our Need?

Extract interesting knowledge

(rules, regularities, patterns, constraints) from
data in large collections.

Knowledge

Data

Principles of Knowledge Discovery in Data

Data Collected

• Business transactions
• Scientific data (biology, physics, etc.)
• Medical and personal data
• Surveillance video and pictures
• Satellite sensing
• Games

Principles of Knowledge Discovery in Data

Data Collected (Con’t)

• Digital media
• CAD and Software engineering
• Virtual worlds
• Text reports and memos
• The World Wide Web

Principles of Knowledge Discovery in Data

What is Knowledge Discovery?
• Process of discovering valuable information from a collection of data,
or it is the process of converting raw data into useful information
• An activity that produces knowledge by discovering it or deriving it
from existing information
• Refers to overall process of discovering useful knowledge from data,
and data mining refers to a particular step in this process
Why do we need knowledge discovery
process?
• This is information age, day to day creates new data.
• Data overload creates various problems to us to search proper
information.
• Helps us to find accurate information
• There is an urgent need for a new generation of computational
theories and tools to assist humans in extracting useful information
from rapid growing volumes of digital data.
What kinds of data can be processed?
• Database
• Data warehouse
• Transactional data
• Other kinds of data- time related data, sequence data, data streams,
spatial data (maps), multimedia data, graph and networked data, Web
What is Knowledge Discovery in Databases
(KDD)
• It refers to the broad procedure of discovering knowledge in data and
emphasizes the high-level applications of specific Data Mining techniques.
• It is a field of interest to researchers in various fields, including artificial
intelligence, machine learning, pattern recognition, databases, statistics,
knowledge acquisition for expert systems, and data visualization.
•The main objective of the KDD process is to extract information from
data in the context of large databases. It does this by using Data Mining
algorithms to identify what is deemed knowledge.
•The Knowledge Discovery in Databases is considered as a programmed,
exploratory analysis and modeling of vast data repositories.
What is Knowledge Discovery in Databases
(KDD)
•KDD is the organized procedure of recognizing valid, useful, and
understandable patterns from huge and complex data sets.

•Data Mining is the root of the KDD procedure, including the inferring of
algorithms that investigate the data, develop the model, and find previously
unknown patterns.

•The model is used for extracting the knowledge from the data, analyze
the data, and predict the data.
The Challenge (Humans aren’t particularly well suited to finding
patterns in data Computers, on the other hand…)
510201889052120015394581990000000014198812294488219960816210000001010001000000011000031111100000
000010031302000000000000002020010000000000000000000000000000434388888888424243424333012202022200
001010010000000441000000001100000000000000000100000100000000000000000000000000000000000000000000
000001998102751020189606012002126940968000000159019980903379811998091731001000001000100000001100
003200020000001000000012399000000000000200222200313100312000000000000000042438888888888424342423
321212122220000001011000000244100000000010020000000000000000000010000000000000000000000000000000
000000000000000000199812305102018970203200018626929200000047091998021356971199802273100000100100
010000000001101100000020000100000000021011000100000000000100000000000010001100000001110033888822
223311323343330000001100000111010011001020001000000001000000001000000000000000000000000000000000
000000000000000000000000000000019981221510201899093020052008986730000019410199901127598119990126
310010001010001000000000111110111112201010000011123001001000000102100022000000000020000000000000
111334388884342424243424233000000111100000101100100002441000000000100200000001001010000000100000
000000000000000000000000000000000000000000001999052551020189912272009354051583000001448419970527
179711997061031000000101100100000001000003111201200001001001012000111100100001101001200000000000
100000000001010132438888888888224242433100000001002100001110010011230100000010000020001000000000
011000010000000010000010000000000000000100000000000000000199811175102018991227200935405158300000
144841997052717972199806163100000010110010000000110100311111121000100000202210012220220020221222
201000000000000000001010011003243434321324221424242330021002100001111011000001122310011000001000
00010000000000110000100000000100000100000000000000000000000000000000001998122351020190001
Context
• Where you stand on Data Mining depends on where you sit:
• A business user will be interested in efficiency and results, validity
may not be as important.
• A researcher clearly will be interested in a different type of results,
and validity will be important.
• A computer scientist may be interested in introducing new algorithms
or computational approaches and achieving improved results or more
efficient processing.
 KDD: A Definition
KDD is the automatic extraction of non-obvious,
hidden knowledge from large volumes of data.

106-1012 bytes: What is the knowledge?

we never see the whole Then run Data
How to represent
data set, so will put it in Mining algorithms
and use it?
the memory of computers

9
Data, Information, Knowledge
We often see data as a string of bits, or numbers and
symbols, or “objects” which we collect daily.

Information is data stripped of redundancy, and reduced

to the minimum necessary to characterize the data.

Knowledge is integrated information, including facts and

their relations, which have been perceived, discovered,
or learned as our “mental pictures”.
Knowledge can be considered data at
a high level of abstraction and generalization.

10
The KDD Process
• The knowledge discovery process (illustrates in the given figure) is
iterative and interactive, comprises of nine steps.

• The process is iterative at each stage, implying that moving back to the
previous actions might be required.
• The process has many imaginative aspects in the sense that one can’t
present one formula or make a complete scientific categorization for the
correct decisions for each step and application type.

• Thus, it is needed to understand the process and the different

requirements and possibilities in each stage.
The KDD Process
•The process begins with determining the KDD objectives and ends with
the implementation of the discovered knowledge.
•At that point, the loop is closed, and the Active Data Mining starts.
Subsequently, changes would need to be made in the application domain.
For example, offering various features to cell phone users in order to reduce
churn. This closes the loop, and the impacts are then measured on the new
data repositories, and the KDD process again.
The KDD
Process
KDD Steps can be Merged
Data cleaning + data integration = data pre-processing
Data selection + data transformation = data consolidation

KDD Is an Iterative Process

Principles of Knowledge Discovery in Data

The KDD Process
1. Building up an understanding of the application domain
•This is the initial preliminary step.
•It develops the scene for understanding what should be done with the
various decisions like transformation, algorithms, representation, etc.
•The individuals who are in charge of a KDD venture need to understand and
characterize the objectives of the end-user and the environment in which
the knowledge discovery process will occur ( involves relevant prior
knowledge).
The KDD Process
2. Choosing and creating a data set on which discovery will be
performed
•Once defined the objectives, the data that will be utilized for the knowledge
discovery process should be determined. This incorporates discovering what
data is accessible, obtaining important data, and afterward integrating all
the data for knowledge discovery onto one set involves the qualities that will
be considered for the process. This process is important because of Data
Mining learns and discovers from the accessible data. This is the evidence
base for building the models.
The KDD Process
2. Choosing and creating a data set on which discovery will be
performed
•If some significant attributes are missing, at that point, then the entire
study may be unsuccessful from this respect, the more attributes are
considered. On the other hand, to organize, collect, and operate
advanced data repositories is expensive, and there is an arrangement
with the opportunity for best understanding the phenomena. This
arrangement refers to an aspect where the interactive and iterative
aspect of the KDD is taking place. This begins with the best available
data sets and later expands and observes the impact in terms of
knowledge discovery and modeling.
The KDD Process
3. Preprocessing and cleansing
•In this step, data reliability is improved. It incorporates data clearing, for
example, Handling the missing quantities and removal of noise or outliers. It
might include complex statistical techniques or use a Data Mining algorithm
in this context. For example, when one suspects that a specific attribute of
lacking reliability or has many missing data, at this point, this attribute could
turn into the objective of the Data Mining supervised algorithm.
•A prediction model for these attributes will be created, and after that,
missing data can be predicted. The expansion to which one pays attention to
this level relies upon numerous factors.
The KDD Process
4. Data Transformation
•In this stage, the creation of appropriate data for Data Mining is prepared and
developed. Techniques here incorporate dimension reduction( for example,
feature selection and extraction and record sampling), also attribute
transformation(for example, discretization of numerical attributes and
functional transformation). This step can be essential for the success of the
entire KDD project, and it is typically very project-specific.
•For example, studying the impact of advertising accumulation. However, if we
do not utilize the right transformation at the starting, then we may acquire an
amazing effect that insights to us about the transformation required in the next
iteration. Thus, the KDD process follows upon itself and prompts an
understanding of the transformation required.
The KDD Process
5. Data Mining (Extract Patterns or Models)
•We are now prepared to decide on which kind of Data Mining to use, for
example, classification, regression, clustering, etc. This mainly relies on the KDD
objectives, and also on the previous steps. There are two significant objectives in
Data Mining, the first one is a prediction, and the second one is the description.
•Prediction is usually referred to as supervised Data Mining, while descriptive
Data Mining incorporates the unsupervised and visualization aspects of Data
Mining. Most Data Mining techniques depend on inductive learning, where a
model is built explicitly or implicitly by generalizing from an adequate number of
preparing models. The fundamental assumption of the inductive approach is
that the prepared model applies to future cases. The technique also takes into
account the level of meta-learning for the specific set of accessible data.
The KDD Process
•6. Selecting the Data Mining algorithm
•Having the technique, we now decide on the strategies. This stage
incorporates choosing a particular technique to be used for searching
patterns that include multiple inducers.
•For each system of meta-learning, there are several possibilities of how it
can be succeeded. Meta-learning focuses on clarifying what causes a Data
Mining algorithm to be fruitful or not in a specific issue. Thus, this
methodology attempts to understand the situation under which a Data
Mining algorithm is most suitable. Each algorithm has parameters and
strategies of leaning, such as ten folds cross-validation or another division
for training and testing.
The KDD Process
•7. Utilizing the Data Mining algorithm
•At last, the implementation of the Data Mining algorithm is reached.
•In this stage, we may need to utilize the algorithm several times until a
satisfying outcome is obtained. For example, by turning the algorithms
control parameters, such as the minimum number of instances in a single
leaf of a decision tree.
The KDD Process
•8. Evaluation
•In this step, we assess and interpret the mined patterns, rules, and reliability
to the objective characterized in the first step. Here we consider the
preprocessing steps as for their impact on the Data Mining algorithm results.
•For example, including a feature in step 4, and repeat from there. This step
focuses on the comprehensibility and utility of the induced model. In this
step, the identified knowledge is also recorded for further use. The last step
is the use, and overall feedback and discovery results acquire by Data
Mining.
The KDD Process
9. Using the discovered knowledge
•Now, we are prepared to include the knowledge into another system for further
activity. The knowledge becomes effective in the sense that we may make
changes to the system and measure the impacts.
•The accomplishment of this step decides the effectiveness of the whole KDD
process. There are numerous challenges in this step, such as losing the
"laboratory conditions" under which we have worked.
•For example, the knowledge was discovered from a certain static depiction, it is
usually a set of data, but now the data becomes dynamic. Data structures may
change certain quantities that become unavailable, and the data domain might
be modified, such as an attribute that may have a value that was not expected
previously.