Data Warehousing AND MANAGEMENT

_____________________________________
AISPRE 7
Instructor: Ms. Dan Lara Almira Lusoc
Data Warehousing Concepts

A data warehouse is a database designed to enable business intelligence activities

• Help users understand and enhance their organization’s performance.

• Designed for query and analysis rather than for transaction processing.
• Contains historical data derived from transaction data. But can include
data from other sources.
• Data warehouses separate analysis workload from transaction workload
and enable an organization to consolidate data from several sources
 •Maintaining historical
Data records
•Analyzing the data to
Warehousing gain a better
understanding of the
helps in business and to improve
the business
ETL, OLTP, ELT, ODS
 Crucial process in data warehousing that
involves collecting data from different
extraction, transformation, and loading (ETL)
sources, transforming it into a structured
format and loading it into a data
warehouse for analysis

online transaction processing (OLTP) systems Designed to handle a large number of short, fast and
realtime transactions. These systems ensure data
integrity, speed and concurrency making them ideal
for application where frequent transactions occur,
such as banking,retail and airline bookings.
extract, load, transformation (ELT) Modern approach to data integration where raw data is first
loaded into a data warehouse before applying transformations.
ELT is commonly used in cloudbased data warehouses like
SNOWFLAKE. BIGQUERY, and AMAZON REDSHIFT,which have
powerful processing capabilities for large datasets.
Is a centralized database that integrates data from multiple sources
operation data store (ODS) to provide real-time or near-real-time operational reporting. Acts as
a bridge between OLTP and data warehouses helping organizations
make quick, data-driven decisions.
TWO OTHER
IMPORTANT
TERMS
 serves the same role as a data warehouse, but it is
intentionally limited in scope. It provides focused,
subject-specific data for faster queries and decision-
making. The advantage of a data mart versus a data
warehouse is that it can be created much faster due to
its limited coverage but also create problems with
inconsistency.
DATA MART
• DEPENDENT DATA MART
• INDEPENDENT DATA MART
• HYBRID DATA MART
 Is a type of database designed to integrate data from
multiple sources, providing a unified, up-to-date view
Operational data of operational information. It is primarily used for real-
time or near-real-time reporting and supports day-
stores today operations and decision-making processes. It is
cleaned and validated, but it is not historically deep
A common way of introducing
data warehousing is to refer
to the characteristics of a
data warehouse as set forth 1st Qtr 2nd Qtr 3rd Qtr 4th Qtr

by William Inmon:
 Subject Data warehouses must put data
Data warehouses are designed to Integrated from disparate sources into a
help you analyze data Oriented
consistent format.

Nonvolatile means that, Time A data warehouse's focus on

Nonvolatile change over time is what is
once entered into the data Variant
meant by the term time
warehouse, data should not
variant. This is very much in
change.
contrast to online transaction
processing (OLTP) systems
Contrasting OLTP and Data Warehousing Environments
 DATA WAREHOUSES OLTP

designed to accommodate ad hoc queries and data support only predefined operations.
WORKLOAD Your applications might be specifically
analysis and perform well for a wide variety of
possible query and analytical operations tuned or designed to support only these
operations.

A data warehouse is updated on a regular End users routinely issue individual data
basis by the ETL process (run nightly or DATA modification statements to the database. The
MODIFICAT OLTP database is always up to date, and
weekly) using bulk data modification IONS
techniques. reflects the current state of each business
transaction.

Data warehouses often use

denormalized or partially OLTP systems often use fully normalized
Schema
denormalized schemas (such as a schemas to optimize update/insert/delete
design
star schema) to optimize query performance, and to guarantee data
and analytical performance. consistency.
1
2
 DATA WAREHOUSES OLTP

A typical OLTP operation accesses

A typical data warehouse query scans thousands or only a handful of records. For example,
Typical
millions of rows. For example, "Find the total sales "Retrieve the current order for this
operations
for all customers last month." customer."

Data warehouses usually store many OLTP systems usually store data from only a
months or years of data. This is to few weeks or months. The OLTP system
Historical
support historical analysis and reporting. stores only historical data as needed to
data
successfully meet the requirements of the
current transaction.
Data Warehouse Architecture: Basic
Data Warehouse Architecture: with a Staging Area
Data Warehouse Architecture: with a Staging Area and Data Marts
 You can extract information from the masses of data
stored in a data warehouse by analyzing the data.
The Oracle Database provides several ways to

Extracting analyze data:

• A wide array of statistical functions,
Information including descriptive statistics, hypothesis
testing, correlations analysis, test for
from a Data distribution fit, cross tabs with Chi-square
statistics, and analysis of variance (ANOVA);
Warehouse these functions are described in the Oracle
Database SQL Language Reference.
• OLAP
• Data Mining
 Oracle Database offers the industry's first and only
embedded OLAP server. Oracle OLAP provides native
multidimensional storage and speed-of-thought
response times when analyzing data across multiple
dimensions. The database provides rich support for
analytics such as time series calculations, forecasting,
advanced aggregation with additive and non-additive
operators, and allocation operators. These capabilities
make the Oracle database a complete analytical
platform, capable of supporting the entire spectrum of
OLAP business intelligence and advanced analytical
applications.
Oracle OLAP uses a multidimensional data model to
perform complex statistical, mathematical, and
financial analysis of historical data in real time. Oracle
OLAP is fully integrated in the database, so that you
can use standard SQL administrative, querying, and
reporting tools.
THANK YOU!