DS8000 - Training
DS8000 - Training
Architecture
aspects of the DS8000 series architecture
Cooling plenum
disk enclosure pair
Fan
sense
card
Primary
power
supply
eServer p5 570
Primary
power
supply
eServer p5 570
Primary
power
supply
Battery
Backup unit
Battery
Backup unit
I/O
Enclosure 1
I/O
enclosure 0
I/O
I/O
enclosure
2
Enclosure 3
Battery
Backup unit
Battery
backup unit
Battery
Backup unit
Cooling plenum
disk enclosure pair
disk enclosure pair
Primary
power
supply
Battery
Backup unit
Fan
sense
card
Cooling plenum
I/O
I/O
Enclosure 5 enclosure 4
I/O
I/O
Enclosure 7 enclosure 6
Primary
power
supply
DS8000 Architecture
SAN fabric
host adapter
N-way
SMP
host adapter
RIO-G
Complex 0
Volatile
memory
Volatile
memory
Persistent memory
Persistent memory
N-way
SMP
Complex 1
device adapter
Front storage
enclosure with
16 DDMs
RIO-G
device adapter
Rear storage
enclosure with
16 DDMs
Virtualisation
virtualization concepts as they apply to the DS8000
IBM TotalStorage
RIO-G
I/O
Memory
Processor
I/O
LIC
LIC
Memory
Memory
Processor
RIO-G
I/O
I/O
LIC
Memory
Processor
Processor
LPAR
Hypervisor
takes part of
takes part of
takes part of
I/O
Memor
y
Processor
RIOG
I/O
Memor
y
Processor
Physical Layer
I/O
Enclosure
H H D H HADA
A A A A
RIO-G
I/O
Enclosure
H H D HAH D
A A A
A A
Server0
Switched loop
1
Switche
s
Switched loop
2
Server1
Array Site
Array
Site
Switc
h
Loop 1
Loop 2
Creation of an Array
Array
Site
Creation of
an array
Data
Data
Data
Data
Data
Data
Parit
y
Spare
D1
D7
D13
...
D2
D8
D14
...
D3
D9
D15
...
D4
D10
D16
...
D5
D11
...
D6
D17
...
D12
D18
...
RAID
Array
Spar
e
Forming a Rank
Data
Data
Data
Data
Data
Data
Parity
Spare
RAID
Array
D1
D7
D13
...
D2
D8
D14
...
D3
D9
D15
...
D4
D10
D16
...
D5
D11
...
D6
D17
...
D12
D18
...
Creation of
a Rank
....
....
1GB
1GB
1GB
1GB
....
....
....
....
....
....
FB Rank
of 1GB
extents
Extent Pools
Extent Pool CKD0
1113
Cyl.
CKD
1113
Cyl.
CKD
1113
Cyl.
CKD
1113
Cyl.
CKD
1113
Cyl.
CKD
1113
Cyl.
CKD
1113
Cyl.
CKD
1113
Cyl.
CKD
Server0
1113
Cyl.
CKD
1113
Cyl.
CKD
1113
Cyl.
CKD
1GB
FB
1GB
FB
1GB
FB
1GB
FB
1GB
FB
1GB
FB
1GB
FB
1GB
FB
1GB
FB
1GB
FB
1GB
FB
1GB
FB
1GB
FB
1GB
FB
1GB
FB
1GB
FB
1GB
FB
1GB
FB
Server1
For performance
and ease of
management
create 1 Extent
Pool per Rank
Creation of an FB LUN
Extent Pool FBprod
Rank-a
1 GB
1 GB
1 GB
3 GB LUN
Rank-b
used
1 GB
free
used
Logical
3 GB LUN
1 GB
free
1 GB
free
Allocate a 3 GB LUN
1 GB
1 GB
1 GB
1 GB
used
2.9 GB LUN
created
3 GB LUN
Rank-b
used
1 GB
used
used
1 GB
used
100 MB unused
Logical Volumes
LSS X'17'
DB2
LSS automatically
created when
creating FB LUN
LSS X'18'
DB2-test
WWPN2
WWPN3
Host attachment:
AIXprod2
WWPN6
WWPN7
Host att:
Prog
WWPN8
Volume group:
docs
WWPN4
Virtualisation Hierarchy
Array
Site
RAID
Array
Data
Data
Data
Data
Data
Data
Parity
Spare
Rank
Type FB
Extent
Pool
1 GB1FB
GB1FB
GB FB
GB1FB
GB FB
1 GB1FB
Server0
1 GB1FB
GB1FB
GB FB
Logical
Volume
Performance Considerations
early performance considerations regarding the DS8000 series
IBM TotalStorage
Exten
t
Rank
2
1GB
Extent pool 1
Extent pool 2
Extent
Extent
Pool Pool 5
2 GB LUN 1
Rank 5
2GB LUN 2
Rank 6
Extent
1GB
Extent pool 3
2GB LUN 3
Rank 7
Rank 3
Extent pool 4
2GB LUN 4
Rank 4
LV stripped across 4 LUNs
Rank 8
8GB LUN
L3
Memory
RIO-G
Module
L1,2
Memory
Processor
Processo
r
L1,2
Memory
Processor
Processo
r
Server0
RIO-G Module
L1,2
Memory
L1,2
Memor
y
RIO-G Module
Memory
L3
Memory
Server1
POWER5 2-way SMP
DAs
Rank
Extent
pool0
Extent
pool2
Extent
pool4
Extent
pool1
11
10
12
Extent
pool6
Extent
pool8
Extent
pool10
Extent
pool7
Extent
pool3
Extent
pool9
IBM TotalStorage
Copyright IBM Corporation 2005.
2001. All rights reserved.
Extent
pool5
Extent
pool11
Implementation Tasks
IBM TotalStorage
Physical Installation
Hardware install - IBM CE
User Mangement
DS CLI
Must use CLI code shipped with DS code
Runs on all OS
Start DS CLI
dscli -cfg "C:\Program Files\IBM\dscli\profile\FOXDS8300_2.profile"
WWPN
State Type
topo
portgrp
===============================================================
I0000 50050763040000D0 Online Fibre Channel-SW SCSI-FCP 0
I0001 50050763040040D0 Online Fibre Channel-SW SCSI-FCP 0
I0002 50050763040080D0 Online Fibre Channel-SW SCSI-FCP 0
I0003 500507630400C0D0 Online Fibre Channel-SW SCSI-FCP 0
I0030 50050763040300D0 Online Fibre Channel-SW SCSI-FCP 0
I0031 50050763040340D0 Online Fibre Channel-SW SCSI-FCP 0
I0032 50050763040380D0 Online Fibre Channel-SW SCSI-FCP 0
I0033 500507630403C0D0 Online Fibre Channel-SW SCSI-FCP 0
I0100 50050763040800D0 Online Fibre Channel-SW SCSI-FCP 0
I0101 50050763040840D0 Online Fibre Channel-SW SCSI-FCP 0
I0102 50050763040880D0 Online Fibre Channel-SW SCSI-FCP 0
I0103 500507630408C0D0 Online Fibre Channel-SW SCSI-FCP 0
I0130 50050763040B00D0 Online Fibre Channel-SW SCSI-FCP 0
I0131 50050763040B40D0 Online Fibre Channel-SW SCSI-FCP 0
I0132 50050763040B80D0 Online Fibre Channel-SW SCSI-FCP 0
I0133 50050763040BC0D0 Online Fibre Channel-SW SCSI-FCP 0
I0200 50050763041000D0 Online Fibre Channel-SW SCSI-FCP 0
I0201 50050763041040D0 Online Fibre Channel-SW SCSI-FCP 0
.
.
IBM TotalStorage
#
#
Config
#---------------------------------------------------------------------------------------------------------#
#
#
#---------------------------------------------------------------------------------------------------------#
IO Port definitions
Command
list IOports
setioport
lsioport
#
#
EE
#
#---------------------------------------------------------------------------------------------------------#
setioport -dev IBM.2107-75AZRY1 -topology scsi-fcp I0000 I0001 I0002 I0003 I0030 I0031 I0032 I0033
setioport -dev IBM.2107-75AZRY1 -topology scsi-fcp I0100 I0101 I0102 I0103 I0130 I0131 I0132 I0133
setioport -dev IBM.2107-75AZRY1 -topology scsi-fcp I0200 I0201 I0202 I0203 I0230 I0231 I0232 I0233
setioport -dev IBM.2107-75AZRY1 -topology scsi-fcp I0300 I0301 I0302 I0303 I0330 I0331 I0332 I0333
setioport -dev IBM.2107-75AZRY1 -topology scsi-fcp I0430 I0431 I0432 I0433
setioport -dev IBM.2107-75AZRY1 -topology scsi-fcp I0500 I0501 I0502 I0503
setioport -dev IBM.2107-75AZRY1 -topology scsi-fcp I0630 I0631 I0632 I0633
setioport -dev IBM.2107-75AZRY1 -topology scsi-fcp I0700 I0701 I0702 I0703
Logical Configuration
1
Create arrays
Create ranks
Create Arrays
RAID5 or RAID10
Recommendation
Array
===========================================
S1
146.0 Assigned A0
S2
146.0 Assigned A1
S3
146.0 Assigned A2
S4
146.0 Assigned A3
S5
146.0 Assigned A4
S6
146.0 Assigned A5
S7
146.0 Assigned A6
S8
146.0 Assigned A7
S9
146.0 Assigned A8
S10
146.0 Assigned A9
S11
S12
S13
S14
S15
.
.
.
S48
==================================================================
A0
R0 2
146.0
A1
R1 2
146.0
A2
R2 2
146.0
A3
R3 2
146.0
A4
R4 2
146.0
A5
R5 2
146.0
A6
R6 2
146.0
A7
R7 2
146.0
A8
R8 0
146.0
A9
R9 0
146.0
R10 0
146.0
R11 0
146.0
R12 0
146.0
R13 0
146.0
R14 0
146.0
R15 0
146.0
R16 6
146.0
.
.
.
A47 Assigned Normal 5 (7+P) S48
R47 7
146.0
Create Ranks
Format CKD or FB
Recommendation
0 Normal Normal
A0
5 P0
fb
R1
1 Normal Normal
A1
5 P1
fb
R2
0 Normal Normal
A2
5 P2
fb
R3
1 Normal Normal
A3
5 P3
fb
R4
0 Normal Normal
A4
5 P4
fb
R5
1 Normal Normal
A5
5 P5
fb
R6
0 Normal Normal
A6
5 P6
fb
R7
1 Normal Normal
A7
5 P7
fb
R8
0 Normal Normal
A8
5 P8
fb
R9
1 Normal Normal
A9
5 P9
fb
R10
0 Normal Normal
A10
5 P10
fb
R11
1 Normal Normal
A11
5 P11
fb
R12
0 Normal Normal
A12
5 P12
fb
R13
1 Normal Normal
A13
5 P13
fb
R14
0 Normal Normal
A14
5 P14
fb
R15
1 Normal Normal
A15
5 P15
fb
R16
0 Normal Normal
A16
5 P16
fb
1 Normal Normal
A47
5 P47
fb
.
.
R47
FB - 1 GB (binary)
Recommendations
Only put Ranks of same speed and capacity in same Extent Pool
For performance create Extent Pools of a single rank only
0 below
303
61
303
14
FB_1 P1 fb
1 below
439
43
439
10
FB_2 P2 fb
0 below
167
78
167
12
FB_3 P3 fb
1 below
133
82
133
11
FB_4 P4 fb
0 below
229
74
229
12
FB_5 P5 fb
1 below
161
82
161
12
FB_6 P6 fb
0 below
297
67
297
10
FB_7 P7 fb
1 below
59
93
59
FB_8 P8 fb
0 below
439
43
439
10
FB_9 P9 fb
1 below
303
61
303
14
14
FB_10 P10 fb
0 below
133
FB_11 P11 fb
1 below
99
87
99
12
FB_12 P12 fb
0 below
93
89
93
13
FB_13 P13 fb
1 below
229
74
229
12
FB_14 P14 fb
0 below
263
71
263
11
FB_15 P15 fb
1 below
263
71
263
11
FB_16 P16 fb
0 below
303
61
303
14
82
133
11
Address Groups
Addresses are grouped into Address Groups of 4096
addresses
dscli> lsaddressgrp
Date/Time: 15 February 2006 10:22:15 GMT IBM DSCLI Version: 5.1.0.236 DS: IBM.2107-75AZRY1
ID stgtype basevolnum Vols LSSs confgvols
=========================================
0 fb
0000
4096 16
189
1 fb
1000
4096 16
189
2 fb
2000
4096 16
186
Volume addressing
Recommendations
Create FB Volumes
Logical Volumes formed of increments of extents
Minimum 1 extent
Maximum FB is 2TB
#
# 7+p Large Ranks we want 36.5GB (decimal) vols = 34 extents
#
#
#
#LSS 00
mkfbvol -dev IBM.2107-75AZRY1 -extpool P0 -cap 34 -name P0_#h 0000-000D
#
#LSS 01
mkfbvol -dev IBM.2107-75AZRY1 -extpool P1 -cap 34 -name P1_#h 0100-0107
#
#LSS 02
mkfbvol -dev IBM.2107-75AZRY1 -extpool P2 -cap 68 -name P2_#h 0200-0205
mkfbvol -dev IBM.2107-75AZRY1 -extpool P2 -cap 34 -name P2_#h 0206-0208
ID accstate datastate configstate deviceMTM datatype extpool cap (2^30B) cap (10^9B) cap (blocks)
========================================================================================================
===
P0_0000 0000 Online Normal
Normal
2107-900 FB 512 P0
34.0
71303168
Normal
2107-900 FB 512 P0
34.0
71303168
Normal
2107-900 FB 512 P0
34.0
71303168
Normal
2107-900 FB 512 P0
34.0
71303168
Normal
2107-900 FB 512 P0
34.0
71303168
Normal
2107-900 FB 512 P0
34.0
71303168
Normal
2107-900 FB 512 P0
34.0
71303168
Normal
2107-900 FB 512 P0
34.0
71303168
Normal
2107-900 FB 512 P0
34.0
71303168
Normal
2107-900 FB 512 P0
34.0
71303168
Normal
2107-900 FB 512 P0
34.0
71303168
Normal
2107-900 FB 512 P0
34.0
71303168
Normal
2107-900 FB 512 P0
34.0
71303168
Normal
2107-900 FB 512 P0
34.0
71303168
Any Host Port (or Host Group) can only access one Volume
Group
Clustering support
Recommendations
ID Type
=======================================
fprdb01_vg
V0 SCSI Mask
fprdb02_vg
V1 SCSI Mask
fprdb03_vg
V2 SCSI Mask
fprdb04_vg
V3 SCSI Mask
fprdb05_vg
V4 SCSI Mask
fprdb06_vg
V5 SCSI Mask
fprdb07_vg
V6 SCSI Mask
fprdb08_vg
V7 SCSI Mask
fprdb09_vg
V8 SCSI Mask
fprdb10_vg
All CKD
fprdb11_vg
V9 SCSI Mask
V10 FICON/ESCON All
V11 SCSI Mask
fpapp01_vg
fpapp02_vg
fpapp03_vg
fpapp04_vg
fsrdb01_vg
fsrdb02_vg
fsrdb03_vg
fsrdb04_vg
Recommendations
Group all host connections from a single host into a Host Group
ID WWPN
HostType Profile
============================================================================
fprdb06_p1 0000 10000000C94F16F4 -
5 V5
all
5 V5
all
6 V5
all
5 V5
all
7 V6
all
7 V6
all
7 V6
all
7 V6
all
Copy Service
Duplication of Data
You can create back up data with little or no disruption to your
application
Allow you to create immediate copy of production data
Mission Critical Application
Supports
Open Systems
Z Series
Advantage
Disaster Recovery
Faster restore
Data Migration
Data Duplication
Mirror Functions
Metro Mirror
Global Mirror
Thank You
IBM TotalStorage
Copyright IBM Corporation 2005.
2001. All rights reserved.