Dataware House Concepts
Dataware House Concepts
S t
o
ce
ss
e ss ns
in tio n t
s e
Bu lica g e m
p p n a
A a
M
In
g y
fo
lo ure
rm
o
n ct
ati
y h
c tru
e
on
g T ras
olo f
ch n In
Te
Typical Business Uses of the Data Warehouse
Target Profitability
Advertising Analysis
campaigns Market Basket
Management
Reporting Analysis
DSSs,Report writers,
Inventory System
Excel, databases, etc.
Budgeting
Order System
Analysis
Procurement
System Sales Forecasting
Accounting
System
Data Feeds
Schematic of Enterprise Data Warehouse Architecture
Order System
Enterprise
DW/ODS
Procurement
System
Carefully
Carefully selected
selected set
set of
of
measures
measures derived
derived from
from
strategies,
strategies, goals
goals and
and
objectives
objectives that
that represents
represents aa
tool
tool to
to communicating
communicating
Customer
Customer Financial
Financial
strategic
strategic direction
direction to
to the
the Measures
Measures Measures
Measures
organization
organization for
for motivating
motivating
¾% Sales of New Products ¾Market Share
change.
change.
¾Customers Acquired ¾ROI and ROA
¾Customer Satisfaction ¾Revenue Growth
Internal
Internal Innovatio
Innovatio
These
These form
form the
the basis
basis to
to plan,
plan, Process
Process n
n&&
budget,
budget, structure
structure the
the Measures
Measures Learning
Learning
organization
organization and
and to
to control
control Measures
Measures
results.
results.
¾Product Time to Market ¾New Product Introduction
¾Unit Manufacturing Cost ¾Management Skills
¾Days Supply to inventory ¾Employee Turnover
What’s Different About Data Warehousing?
Performance Measurement
5
What Are the Differences?
OLTP DW
Data Entry Data Query
Bulk data oriented
Transaction Oriented
Spiked, uneven use
Consistent use patterns patterns
Data retrievals are Queries are unpredictable,
lookups of single they change continuously
records Data retrievals are
Users deal with one summary and sorts of
record at a time millions of records
Performance is critical Performance is relaxed
(sec/min)
Reporting is generally
Reporting is primary
table lists
activity (on line, presented
in small chunks)
What Are the Differences?
Data organization and integration
OLTP DW
OLTP DW
Quiet Database
Twinkling Database
What Are the Differences?
Usage Examples
OLTP DW
Metadata
Business Information
Technology
Data
Warehouse
Business Architecture
Data Architecture
PLANNING MANAGING
Technology Architecture
Management Infrastructure
Data Warehousing Methodology
DataData
Warehouse Developm
Warehousing ent Life Cycle
Methodology
Analysis Design Construction Implementation
J
User Documentation
K
Training
N
Data Trans-
formation
D System
Process Design
Definitions S
O Data Transformation
Presentation Systems Construction
System
Design
T
A E P Presentation W X
Project Data Data System Construction System Post-
Start-up Definition Design Implementation Implementation
and Review
C Project Close
Knowledge
Management U
B Environment F Q System and Integration Testing
Data Assessment Technology Technology
Warehousing Definition Design
Project
Abstract
G
Change Integration
I
Prototyping
L
Acceptance Testing
M
Transition Support and Migration
H R V
Analysis Design Construction
Checkpoint Checkpoint Checkpoint
Technology infrastructure
Business Architecture
Data Architecture
PLANNING MANAGING
Technology Architecture
Management Infrastructure
The Strategic DW Business Plan – Covers Five Major
Areas
Business
DW Strategic Strategy •• Strategic
Strategic Vision
Vision
Vision ••Tactical
Tactical Vision
Vision
Processes and Metrics •• Scope,priorities,
Scope,priorities,
&
& sequences
sequences
costs
costs
Data Technology Organization
DW Tactical •• Risks
Risks
Vision
Incremental Implementation Plans
Strategic
Strategic DW
DW Plan
Plan
DW
DW Tactical
Tactical Plan
Plan
Implementation
Implementation Plan(s)
Plan(s)
Project and Organizational Risks
Areas of
Success Business Information Technology People
Areas of Risk Readiness Readiness Readiness Readiness
ÉÉ Are
Arethe
thebusiness
businessneeds
needsofofDW
DWclearly
clearlyunderstood
understood
Business Readiness and supported?
and supported?
Executive ÉÉ Do
Dothe
thesponsors
sponsorstheir
theirrole?
role?Are
Arethey
theywilling
willingto
to
exercise it? Do they understand DW development
exercise it? Do they understand DW development
Commitment requirements
requirementsand andgaps?
gaps?
Selling Internally ÉÉ Does
Does the organizationsupport
the organization supportDW DWmethodology
methodologyand and
approach? Do they understand their responsibilities?
approach? Do they understand their responsibilities?
Project Scope
ÉÉ Will
Willthe
theprocesses
processesandandinfrastructure
infrastructureof ofthe
thebusiness
business
DW Skills & support the DW environment? Is the organization
support the DW environment? Is the organization
willing
willingtotomake
makethethenecessary
necessarychanges?
changes?
Experience
ÉÉ Is
Isthe
thetechnical
technicalinfrastructure
infrastructurerobust
robustenough
enoughto to
Project Bundling support DW evolution?
support DW evolution?
End User Education
Technology
Ongoing Support
The DW Tactical Plan
•• Data
Data Plan
Plan
DW Strategic Business
Strategy •• Technology
Technology plan
plan
Vision −− Technology
Technology
traits
traits
Processes and Metrics
•• Organization
Organization
plan
plan
Candidate DW Applications
Strategic DW Plan
DW Tactical Plan
Implementation Plan(s)
The Technology Plan:Hardware and Software
net181 net180
net134
net148
T1
delmar
1 Create an overview of
PWS_H&H
192K
256K
network
256K
10 Mbps
192.168.16
2 Identify “bottlenecks” T1
Cin_s5 T1
security protocols
32K
T1
T1 T1
DDC
KDC
Internet Internet
Kdc_e0
ddc
Strategic DW Plan
DW Tactical Plan
Implementation Plan(s)
The Incremental Development Plan(s)
••Detailed
Detailed project
project plan
plan
Business
Business
DW Strategy
Strategy ••Logical
Logical Dimensional
Dimensional
Strategic Data
Data Model
Model for
for first
first
DW
DW application
application
Processes and Metrics
Vision •• Install
Install DW
DW technical
technical
architecture
architecture
Candidate DW Applications •• Physical
Physical design
design and
and
construction
construction of
of the
the
Data Technology database
database
DW Organization
••Manage
Manage change
change
Tactical integration
integration within
within
Strategic DW Plan the
Vision Strategic DW Plan
Incremental Implementation Plans the organization
organization
DW
DW Tactical
Tactical Plan
Plan
Implementation
Implementation
Plan(s)
Plan(s)
Why this Emphasis on the Strategic Planning ?
Differences Between Transactional and Data Warehousing Systems
Business Architecture
Data Architecture
PLANNING MANAGING
Technology Architecture
Management Infrastructure
What Does Data Warehousing Offer:
The Value Proposition
Business IT Community
Community
Data management
Quality and design
Decision Quality Data sharing
Replication control
Data security
Leverage legacy
Opportunity
systems investments
Discovery
Enables data
integration
Productivity
Improvements
Summary of Steps
Defining the DW Strategic and Tactical Plan
{ Adjust to reality
(management checkpoints)
Time
Data
Data Warehousing
Warehousing Evolutionary
Evolutionary Cycle
Cycle
Data Warehouse Project Topics
Project types
Staffing the project team
Post-implementation
functions
Data Warehouse Project Types
Phase 0 Phase 1 Phase 0*
• Feasibility Study/High Level Analysis
• Data Warehouse Architecture Definition
• Possible System Integration/PW Reseller
Opportunities
• Defines the blueprint and road map for data
warehousing at client
EFFORT DURATION
Executive
Technical
Project
Leader Sponsor
Manager Client
Technical/IT
Sponsor
Staffing The Data Warehouse Project
Business Roles ( not positions )
Executive
Executive Steering
Steering
Committee
Committee
Client
Client Executive
Executive Project
Project Partner
Partner
Sponsor
Sponsor
Technical/IT
Technical/IT Sponsor
Sponsor
Project
Project Leader
Leader
Technical
Technical Leader
Leader
Change
Change Integration
Integration Data
Data Modeler
Modeler Data
Data Transfer
Transfer and
and Front-End
Front-End
Analyst
Analyst Replication
Replication Specialist
Specialist Developer(s)
Developer(s)
Business
Business Database
Database Source
Source Data
Data Analyst
Analyst
Requirement
Requirement Analyst
Analyst Administrator
Administrator
Quality
Quality Assurance
Assurance Database
Database Designer
Designer // Metadata
Metadata Analyst
Analyst
Analyst
Analyst Technical
Technical Architect
Architect
Staffing The Data Warehouse Project
People Issues ( Client and IBM )
Use the value chain as a guide to identify the information needed to analyze
performance measures that support strategies.
Breakdown of Expense
Budgeting
value chain into Merchant Financial Planning
and
key Sub-processes Analyses and
Forecasting
Control
• Productivity Improvements
• Leverage legacy systems
investments
Enables data integration
OLTP Data Modeling–How many paths are there
between customer and product?
OLTP
Data Structure or Schema
• Drives out all data redundancy
-- Improves performance
• Drives data into many discrete entities
• Tables are symmetrical
-- Can’t tell most important, largest, which hold measures,
which are static descriptors
• Lots of connection paths between tables
-- Prefers to use tables individually or in pairs
• Too complex for users to understand
DW Modeling – How many paths are there between
customer and product?
DW
Data Structure or Schema
• Corporate strategy
• Impacted processes
• Candidate DW applications
• Associated performance measures
• Data sets, availability, quality
• Target audience--
number, location, skills, analysis
needs Continuously sort knowledge
Listen!
User Interviews
Answer database design questions
and give clues to priorities and risks
Identify processes, activities, and job
responsibilities.
Identify performance measures and descriptive
characteristics of measures.
Determine level of detail and history.
Identify users and assess usage requirements.
Define and quantify needs and benefits.
DBA Interviews