Data Mining
Data Mining References
Jiawei Han and Micheline Kamber, Data Mining: Concepts and
Techniques, Morgan Kaufmann Publishers, Elsevier, 3 rd Edition,
2012.
Margaret H. Dunham, Data Mining: Introduction and Advanced
Topics, Pearson Education, 2006.
Pang-Ning Tan, Michael Steinbach and Vipin Kumar, Introduction to
Data Mining , Pearson Education, 2006.
Richard O. Duda, Peter E. Hart and David G. Stork , Pattern
Classification, Wiley Publication, 2nd Edition, 2000.
Ian H. Witten, Eibe Frank and Mark A. Hall, Data Mining Practical
Machine Learning Tools and Techniques, Morgan Kaufmann
Publishers, Elsevier, 3rd Edition, 2011.
IEEE Transactions
Knowledge and Data Engineering
ACM Transactions
Information Systems
Database Systems
Internet Technology
2
Data Mining Objectives
Data Mining or
Knowledge Discovery from Data
OBJECTIVES
Understanding basic data mining concepts &
techniques:
uncovering interesting data patterns, hidden in large data
sets
Development of data mining tools:
scalable and efficient
Evolution of Sciences
Before 1600, empirical science
1600-1950s, theoretical science
Each discipline has grown a theoretical component. Theoretical models often
motivate experiments and generalize our understanding.
1950s-1990s, computational science
Over the last 50 years, most disciplines have grown a third, computational
branch (e.g. empirical, theoretical, and computational ecology, or physics, or
linguistics.)
Computational Science traditionally meant simulation. It grew out of our
inability to find closed-form solutions for complex mathematical models.
1990-now, data science
The flood of data from new scientific instruments and simulations
The ability to economically store and manage petabytes of data online
The Internet and computing Grid that makes all these archives universally
accessible
Scientific info. management, acquisition, organization, query, and
visualization tasks scale almost linearly with data volumes. Data mining is a
major new challenge!
Evolution of Database
Technology
1960s:
data creation & collection
IMS
electronic mode
hierarchical database system by IBM
network DBMS
1970s:
relational data model
relational DBMS implementation
1980s:
RDBMS
advanced data models
extended-relational, OO, deductive, etc.
application-oriented DBMS
spatial, scientific, engineering, etc.
5
Evolution of Database
Technology
1990s:
Data mining
Data warehousing
Multimedia databases
Web databases
2000s:
Stream data management and mining
Data mining and its applications
Web technology
XML
data integration
social networks
global information systems
DM Evolution
Data Mining Importance
The Explosive Growth of Data:
Terabytes (240 bytes)
Petabytes
Exabytes
Zitabytes
Drowning in DATA, but STARVING for KNOWLEDGE !
Data Tombs to Golden Nuggets
PLATO
Greek philosopher and mathematician
Necessity is the Mother of Invention
Data Mining automated analysis of massive data sets
8
Data Mining Definition
Data mining definition:
Extraction or mining of interesting (non-trivial, implicit, previously
unknown and potentially useful) patterns or knowledge from large
amounts of data stored in databases, data warehouses, or other
information repositories
Alternative names
knowledge discovery (mining) in databases (KDD)
knowledge extraction
data/pattern analysis
data archeology
data dredging
information harvesting
business intelligence etc.
9
Knowledge Discovery (KDD) Process
Data mining
Pattern Evaluation
core of knowledge discovery process (identify true interesting patterns representing knowledge)
Pattern
Data Mining
(intelligent methods applied to extract patterns)
Task-relevant Data
Transformation
(summary, aggregation etc.)
Selection
(retrieve relevant data)
Data Warehouse
Data Cleaning
(remove noise and inconsistent data)
Data Integration
(combine multiple data sources)
Databases
10
Data Mining TOOLS
EXPLORE !!!!!!!!!!!!!!
R TOOL
PYTHON TOOL
WEKA TOOL
SPSS TOOL
ORANGE TOOL
CLEMENTINE TOOL
And many more.
References: DM Papers
11
Data Mining and Business
Intelligence
Increasing potential
to support
business decisions
Decisio
n
Making
Data Presentation
Visualization Techniques
End User
Business
Analyst
Data Mining
Information Discovery
Data
Analyst
Data Exploration
Statistical Summary, Querying, and Reporting
Data Preprocessing/Integration, Data Warehouses
Data Sources
Paper, Files, Web documents, Scientific experiments, Database Systems
DBA
12
Data Mining: Confluence of Multiple
Disciplines
Database
Technology
Machine
Learning
Pattern
Recognition
Statistics
Data Mining
Algorithm
Visualization
Other
Disciplines
13
Why Not Traditional Data
Analysis?
Tremendous amount of data
High-dimensionality of data
Algorithms must be highly scalable to handle such as terabytes of data
Micro-array may have tens of thousands of dimensions
High complexity of data
Data streams and sensor data
Time-series data, temporal data, sequence data
Structure data, graphs, social networks and multi-linked data
Heterogeneous databases and legacy databases
Spatial, spatiotemporal, multimedia, text and Web data
Software programs, scientific simulations
New and sophisticated applications
14
Data Mining: Classification Schemes
General functionality
Descriptive data mining
Predictive data mining
Different views lead to different classifications
Data view: Kinds of data to be mined
Knowledge view: Kinds of knowledge to be
discovered
Method view: Kinds of techniques utilized
Application view: Kinds of applications adapted
15
Multi-Dimensional View of Data
Mining
Data to be mined
Knowledge to be mined
Characterization, discrimination, association,
clustering, trend/deviation, outlier analysis, etc.
Multiple/integrated functions and mining at multiple levels
classification,
Techniques utilized
Relational, data warehouse, transactional, stream, objectoriented/relational, active, spatial, time-series, text, multimedia, heterogeneous, legacy, WWW
Database-oriented, data warehouse (OLAP), machine learning,
statistics, visualization, etc.
Applications adapted
Retail, telecommunication, banking, fraud analysis, bio-data
mining, stock market analysis, text mining, Web mining, etc.
16
Data Warehousing
consolidation of data from several databases which are in turn
maintained by individual business units along with historical and
summary information
Roll-up
17
Multi-Tiered Architecture
other
sources
Operational
DBs
Metadata
Extract
Transform
Load
Refresh
Monitor
&
Integrator
Data
Warehouse
OLAP Server
Serve
Analysis
Query
Reports
Data mining
Data Marts
Data Sources
Data Storage
OLAP Engine Front-End Tools
18
Data Mining Research
Publications
Tayal, D. K., Jain, A., Arora, S. , Agarwal, S., Gupta, T. and Tyagi, N., Crime
Detection and Criminal Identification in India Using Data Mining Techniques,
Artificial Intelligence & Society (AIS), SPRINGER, vol. 30, no. 1, pp. 117-127,
Feb 2015. [Indexed: Scopus, Google Scholar, EDSCO, ACM Digital Library,
DBLP]
Jain, A. Yadav, D., and Tayal, D. K., NER for Hindi Language Using Association
Rules, International Conference on Data Mining and Intelligent Computing
(ICDMIC 2014), IGDTUW Delhi, India, IEEE, 5th-6th Sept 2014. [Indexed: Scopus]
19
