0% found this document useful (0 votes)
20 views

AdvancedCompression 11gR2-1

Oracle Database compression feature

Uploaded by

oracle@DBA
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
0% found this document useful (0 votes)
20 views

AdvancedCompression 11gR2-1

Oracle Database compression feature

Uploaded by

oracle@DBA
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 41

<Insert Picture Here>

Advanced Compression with


Oracle Database 11g Release 2
Agenda

• Data Growth Challenges


• Advanced Compression Feature Overview
• Relational Data Compression
• Unstructured Data Compression
• Backup Data Compression
• Network Transport Data Compression

• Questions and Answers

2
Challenges

• Explosion in Data Volumes


• Government Regulations (Sarbanes-Oxley, etc)
• User Generated Content (Web 2.0)
• Application Consolidation

• IT Managers Must Support Larger Volumes of Data


with Limited Technology Budgets
• Need to optimize storage consumption
• Also maintain acceptable application performance

• Intelligent and Efficient Compression Technology can


Help Address These Challenges

3
Oracle Advanced Compression Option

• SecureFiles • Data Pump Data


Compression • Data Guard Redo
• OLTP Table Deduplication
Transport
Compression • SecureFiles • RMAN Fast Backup Compression
Compression Compression

Unstructured
Relational Data Backup Data Network Data
Data
Compression Compression Compression
Compression

• Reduces resource requirements and costs


• Storage System
• Network Bandwidth
• Memory Usage

4
Oracle Advanced Compression Option

• SecureFiles • Data Pump Data


Compression • Data Guard Redo
• OLTP Table Deduplication
Transport
Compression • SecureFiles • RMAN Fast Backup Compression
Compression Compression

Relational Data Unstructured Data Backup Data Network Data


Compression Compression Compression Compression

• Reduces resource requirements and costs


• Storage System
• Network Bandwidth
• Memory Usage

5
Table Compression

• Introduced in Oracle Database 9i Release 2


• Compression during bulk load operations (Direct Load, CTAS)
• Data modified using conventional DML not compressed
• Optimized compression algorithm for relational data
• Improved performance for queries accessing large
amounts of data
• Fewer I/Os
• Buffer Cache efficiency
• Data is compressed at the database block level
• Compression enabled at either the table or partition level
• Completely transparent to applications

6
OLTP Table Compression

• Oracle Database 11g extends table compression for


OLTP data
• Support for conventional DML Operations (INSERT, UPDATE)
• New algorithm significantly reduces write overhead
• Batched compression minimizes impact for OLTP transactions
• No impact on reads
• Reads may actually see improved performance due to fewer I/
Os and enhanced memory efficiency

7
OLTP Table Compression Process

Empty Initially Compressed Partially Compressed


Uncompressed Block Compressed Block
Block Block Block

Legend

Header Data Uncompressed Data

Free Space Compressed Data

8
Block-Level Batch Compression

• Patent pending algorithm minimizes performance overhead and


maximizes compression
• Individual INSERTs and UPDATEs do not cause recompression
• Compression cost is amortized over several DML operations
• Block-level (Local) compression keeps up with frequent data
changes in OLTP environments
• Competitors use static, fixed size dictionary table thereby
compromising compression benefits

9
OLTP Table Compression

Initially Uncompressed
Employee Table
Block
ID FIRST_NAME LAST_NAME Header
1 John Doe
1•John•Doe 2•Jane•
2 Jane Doe
Doe 3•John•Smith 4•
3 John Smith Jane • Doe
4 Jane Doe Free Space

INSERT INTO EMPLOYEE


VALUES (5, ‘Jack’, ‘Smith’);
COMMIT;

10
OLTP Table Compression

Employee Table Compressed


Block Block
ID FIRST_NAME LAST_NAME Header
John=|Doe=|Jane=|Smith=
1 John Doe
1•• 2•• 3••
1•John•Doe 4•
2•Jane•
2 Jane Doe •Doe
 5•Jack•
3•John•Smith 4•
3 John Smith Jane • Doe
Free Space
4 Jane Doe Free Space

5 Jack Smith

Local
Symbol Table

11
Table Compression Syntax

OLTP Table Compression Syntax:


CREATE TABLE emp (
emp_id NUMBER
, first_name VARCHAR2(128)
, last_name VARCHAR2(128)
) COMPRESS FOR OLTP;

Direct Load Compression Syntax (default):


CREATE TABLE emp (
emp_id NUMBER
, first_name VARCHAR2(128)
, last_name VARCHAR2(128)
) COMPRESS [BASIC];

12
Table Compression Advisor
Estimate Potential Storage Savings
• Available in 11g Release 2
• Available on OTN *
• Supports Oracle Database 9i Release 2 through 11g Release 1
• Shows projected compression ratio for uncompressed tables
• Reports actual compression ratio for compressed tables (11g Only)

* http://www.oracle.com/technology/products/database/compression/compression-advisor.html

13
Monitoring Table Compression
• View: DBA_TABLES, columns:
• COMPRESSION ( ENABLED / DISABLED )
• COMPRESS_FOR ( FOR ALL OPERATIONS / DIRECT LOAD ONLY )

14
<Insert Picture Here>

Table Compression Results

15
Oracle’s Internal E-Business Suite DB
• Overall database storage savings: 3x
• Table compression 4x
• Index compression 2x
• LOB compression 2.3x
• 95 TB of Total Storage Savings!
• Primary, standby, test, dev, and backup
• Payroll, Order-2-Cash, AP/AR batch flows, Self-Service
flows run without regression, Queries involving full table
scans show speedup

16
Oracle’s Internal Beehive Email DB

• Average Compression Ratio: 2x


• Oracle Database 11g Release 1
• Exadata Storage Servers
• Storage savings add up with standby, mirroring, flash recovery area
• Phase I in production
• Email for 28K employees
• 195 TB of storage savings with SecureFiles Compression
• Phase II, Dec 2009
• Migrate all 90K employees on this email server
• 581TB estimated storage savings with SecureFiles Compression
• Performance improved by caching more data due to compression -
reducing I/O latencies

17
SAP R/3, BW, Leading Global Company

• Compression on SAP databases


at leading global company
• Oracle Database 11g Release 2
• SAP R/3 DB
• 4.67TB Uncompressed
• 1.93 TB Compressed
• 2.4x compression ratio
• SAP BW DB
• 1.38 TB Uncompressed
• .53 TB Compressed
• 2.6x compression ratio
• Leverage 11g compression for
Tables, Indexes and LOB data

18
Real Networks

• Rhapsody Digital Music Subscription Service

• Compression results using 11g Release 1


• Average Compression Ratio: 2.8x
• Highest compression ratio: 8x
• Total Savings: 3.5TB

19
CERN

• Oracle Database 11g Release 2

• Average Compression Ratio: 2x


• Highest Compression Ratio 6x

• Scientific application supporting particle research

20
Oracle Advanced Compression Option

• SecureFiles • Data Pump Data


Compression • Data Guard Redo
• OLTP Table Deduplication
Transport
Compression • SecureFiles • RMAN Fast Backup Compression
Compression Compression

Unstructured
Relational Data Backup Data Network Data
Data
Compression Compression Compression
Compression

• Reduces resource requirements and costs


• Storage System
• Network Bandwidth
• Memory Usage

21
Introduction to SecureFiles

• Next-generation high performance LOB


• Superset of LOB interfaces allows easy migration from LOBs
• Transparent deduplication, compression, and encryption
• Leverage the security, reliability, and scalability of database

• Enables consolidation of file data with associated relational data


• Single security model
• Single view of data
• Single management of data
• Scalable to any level using SMP scale-up or grid scale-out

22
SecureFiles Deduplication

Secure Hash

• Enables storage of a single physical image for duplicate data


• Significantly reduces space consumption
• Dramatically improves writes and copy operations
• No adverse impact on read operations
• May actually improve read performance for cache data
• Duplicate detection happens within a table, partition or sub-partition
• Specially useful for content management, email applications and
data archival applications

23
SecureFiles Compression
• Significant storage savings for unstructured data
• Three levels of compression (LOW/[MEDIUM]/ HIGH ) provide desired
ratios
• 2-3x compression for typical files (combination of doc, pdf, xml)
• Compression Level LOW (NEW in 11.2)
• Compression algorithm optimized for high performance
• 3x less CPU utilization than default SecureFiles Compression
• Maintains 80% compression of default SecureFiles Compression

• Allows for random reads and writes to Compressed SecureFile data


• Can be specified at a partition level
• Automatically detects if SecureFile data is compressible
• Independent of table or index compression

24
SecureFiles Compression Syntax
Compression Syntax
CREATE TABLE t1 (a CLOB)
LOB(a) STORE AS SECUREFILE (
COMPRESS
CACHE
);

Deduplication Syntax
CREATE TABLE t1 (a CLOB)
LOB(a) STORE AS SECUREFILE (
DEDUPLICATE
CACHE
);

25
Oracle Advanced Compression Option

• SecureFiles • Data Pump Data


Compression • Data Guard Redo
• OLTP Table Deduplication
Transport
Compression • SecureFiles • RMAN Fast Backup Compression
Compression Compression

Relational Data Unstructured Data Backup Data Network Data


Compression Compression Compression Compression

• Reduces resource requirements and costs


• Storage System
• Network Bandwidth
• Memory Usage

26
Data Pump Compression

• Metadata compression available since Oracle Database 10g


• Oracle Database 11g extends compression to table data during
exports
• No need to decompress before import
• COMPRESSION={ALL | DATA_ONLY | [METADATA_ONLY] | NONE}
• Single step compression of both data and metadata
• Compressed data directly hits disk resulting in reduced disk space
requirements
• Internal tests reduced dump file size up to 75%
• Application transparent
• Complete Data Pump functionality available on compressed files

27
Advanced Compression
New in Oracle Database 11g Release 2
• RMAN Backup Compression
• Compression Level LOW (New in 11.2)
• Fastest compression algorithm
• Best suited when backup is constrained by CPU
• Compression Level MEDIUM (New in 11.1)
• Balance between CPU usage and compression ratio
• Formerly Fast RMAN Backup Compression
• 11.1 syntax supported in 11.2
• Compression LEVEL HIGH (New in 11.2)
• Best compression ratio and highest CPU utilization
• Best suited when backup is constrained by network or I/O

28
Backup Compression Syntax

Data Pump Syntax


PROMPT> expdp hr DIRECTORY=dpump_dir1
DUMPFILE=hr_comp.dmp COMPRESSION=ALL

FAST RMAN Backup Compression Configuration


RMAN> configure compression algorithm 'MEDIUM';

RMAN Backup Compression Syntax


RMAN> BACKUP AS COMPRESSED BACKUPSET DATABASE
PLUS ARCHIVELOG;

29
<Insert Picture Here>

RMAN Compression Results

30
RMAN Compression Overview

• Data from Oracle’s implementation of Oracle Applications


• 3.5 GB Database
• Oracle Enterprise Linux
• Oracle Database 11g Release 1
• Test 1: Slow I/O (16 MB/s)
• 11g RMAN without Compression
• 10g RMAN with Compression
• 11g RMAN with MEDIUM Compression
• Test 2: Fast I/O (200 MB/s)
• 11g RMAN without Compression
• 10g RMAN with Compression
• 11g RMAN with MEDIUM Compression

31
Backup Compression Results

Backup Size Comparison

Compression
reduced backup
size by 6x
GB

32
Backup Compression
Backup Speed Comparison
Slow I/O (Tape)
11g Compression
is almost 2.5x
faster than 10g
Time (Seconds)

Compression

33
Backup Compression
Backup Speed Comparison
Fast I/O (Disk)
11g Compression
is almost 2.5x
faster than 10g
Time (Seconds)

Compression

34
Oracle Advanced Compression Option

• SecureFiles • Data Pump Data


Compression • Data Guard Redo
• OLTP Table Deduplication
Transport
Compression • SecureFiles • RMAN Fast Backup Compression
Compression Compression

Relational Data Unstructured Data Backup Data Network Data


Compression Compression Compression Compression

• Reduces resource requirements and costs


• Storage System
• Network Bandwidth
• Memory Usage

35
Network Compression
Data Guard Redo Transport Services
• Compress network traffic between primary and standby databases
• Lower bandwidth networks (<100Mbps)
• 15-35% less time required to transmit 1 GB of data
• Bandwidth consumption reduced up to 35%
• High bandwidth networks (>100 Mbps)
• Compression will not reduce transmission time
• But will reduce bandwidth consumption up to 35%
• Syntax:
LOG_ARCHIVE_DEST_3='SERVICE=denver SYNC
COMPRESSION=ENABLE|[DISABLE]'
• Ref. MetaLink 729551.1 Redo Transport Compression in a Data
Guard Environment

36
Redo Transport Compression

2X Compression !
5X Compression !

• More efficient bandwidth utilization, up to 5x compression ratio


• Compression did not impact throughput or response time

Validation performed by CTC in collaboration with Oracle Japan Grid Center


http://www.ctc-g.co.jp/en/

37
Summary

• Comprehensive data compression capabilities for all


types of data
• Structured, Unstructured, Backup, Network
• Reduces storage consumption by 2 to 4 times
• Improves read performance
• Enhances memory, buffer cache utilization
• Complete application transparency
• Benefits diverse application workloads

38
For More Information

search.oracle.com
advanced compression

Or

OTN: http://www.oracle.com/technology/products/database/compression/index.html

39
40
41

You might also like