Virtual Users Group-SVC 4-23-2009
Virtual Users Group-SVC 4-23-2009
IBM Systems
Agenda
Todays Storage Challenges SVC Architecture SVC Migration SVC Copy Services Space-Efficient VDisks
VDisk Mirroring
Proprietary, non-interoperable
No common storage
management interface
HDS Drivers
HDS Drivers
RDAC Drivers
Flashcopy ?
Free capacity
DS8K
Remote Copy ?
HDS
010101010101010101 Data Migration 010010101101001000
DS5000
DS8K Specialist
3
Virtualizes IBM and non-IBM storage (over 175 systems from EMC, Dell, HP, HDS, NetApp, Sun, Pillar, & STK)
VD 1 VD 2 VD 3
VD 4
VD 5
VD 6
Virtual disks
Low Cost
MD 6 MD 7 LUN 1 MD 8 LUN 2 LUN 3
Managed disks
LUN 1 LUN 2
LUN 3
LUN 4
VD 7
SCSI LUNs
IBM
EMC
LUN 4
SVC - Clustering
Designed to be a redundant, modular, scalable, solution
The pool of managed disks is controlled by a cluster of managed nodes (up to 4 pairs, scaling higher in the future)
Storage Network
Virtual Disks Virtual Disks Virtual Disks
VDisk I/Os are owned by a pair of nodes and host writes are mirrored between those nodes
Virtual Disks
Node
Node
Node
Node
Node
Node
Node
Node
Managed Disks
Each node is an xSeries eServer with 8GB of cache providing a total of 16GB of Read/Write cache per node pair
A B C
I/O Group A I/O Group B
MDG1
MDG3
C
MDG2
SVC Hardware
Base Offering
Dual Storage Engine Clustered System
- Up To Four Engine Pairs Supported
SVC Performance
Cache
8GB per node cache means that many reads are handled by SVC directly All writes are cached, means write to same block is handled by SVC directly without destage
SAN
Striping
Striping spreads I/O workload across many disks, even across disk controllers
Can greatly reduce hot spots as I/O from different applications are spread across multiple disks
2009 2008 IBM Corporation
Host I/O
GUI/CLI
SCSI initiator
Fabric 1
Fabric 2
SCSI target
SVC
SCSI initiator
DS Family EMC
SCSI target
10
V2
Alternative node
UPS1
UPS2
3
RED1 200 GB RED2 200 GB RED3 200 GB
11
V2
UPS1
SVC node1
UPS2
Cache
3
RED1 200 GB RED2 200 GB RED3 200 GB
12
A1 A2 V1 1 A2
1 A1
Fabric 1
ID 21
ID 22
1 2 11 21 14 24 D1 E1
Preferred paths
ID 11
1 2 13 23 12 22 D2 E2
Fabric 2
ID 12
Alternate paths
21 2 2 23 24
SVC2
I/O Group
A1 A2 V2 1 A2
1 A1
Fabric 1
ID 21
ID 22
1 2 11 21 14 24 D1 E1
Alternate paths
ID 11
1 2 13 23 12 22 D2 E2
Fabric 2
ID 12
11 1 2 13 1 4
SVC1
21 22 23 24
V2
SVC2
Alternate node
14
I/O Group
GUI/CLI
SCSI initiator
Fabric 1
Fabric 2
SCSI target
SVC
SCSI initiator
DS Family EMC
SCSI target
15
No need for Powerpath, RDAC or SDD to talk to disk controllers Otherwise degraded mode on controller and/or MDisks
All SVC nodes must see same set of LUNs from disk controller
All SVC ports zoned to controller ports must see same set of LUNs
16
Doesnt load balance I/Os to a specific LUN over multiple ports on the disk controller For example:
Six fibre ports on DS8K zoned with 4 node SVC cluster Sixteen 8 packs in DS8K each configured as one big LUN SVC discovers 16 LUNs/MDisks as MDisk 1-16 SVC cluster accesses MDisks 1,7 and 13 via DS8K port 1 SVC cluster accesses MDisks 2,8 and 14 via DS8K port 2 SVC cluster accesses MDisks 3,9 and 15 via DS8K port 3 SVC cluster accesses MDisks 4,10 and16 via DS8K port 4 SVC cluster accesses MDisks 5 and11 via DS8K port 5 SVC cluster accesses MDisks 6 and 12 via DS8K port 6
17
Server 1
Server 2
A B
Best Practice
SAN Fabric A
HOST ZONING
Create a SVC/Host zone for each server that receives storage from the SVC cluster. Example:
Zone Server 1 port A (RED) with all SVC node port 1's. Zone Server 1 port B (BLUE) with all SVC node port 2's. Zone Server 2 port A (RED) with all SVC node port 3's. Zone Server 2 port B (BLUE) with all SVC node port 4's. *** NOTE *** SVC supports a maximum of 256 host objects per I/O group thus a maximum of 1024 per cluster. The above host zoning results in each server being seen by every I/O group and the default host object creation behavior results in each host object counting as one towards this 256 maximum. To create more then 256 host objects in the cluster you must zone a host to a subset of the I/O groups, you must assign the host object at host creation time to that same subset of I/O groups and then you must assign that hosts VDisks to one of those I/O groups in that same subset.
SVC Cluster
MDisk Group 1 / DS5K_1 VDisk 1 Cntrl A Channels 2 and 4 Channels 1 and 3 VDisk 2
STORAGE ZONING
Create a SVC/Storage zone for each storage subsystem virtualized by the SVC cluster. Example:
Zone DS5K_1 controller A and B daughter card channel ports 1 and 3 with all SVC node ports 1 and 3 in the RED fabric. Zone DS5K_1 controller A and B daughter card channel ports 2 and 4 with all SVC node ports 2 and 4 in the BLUE fabric.
MDisk10 / Array10
MDisk11 / Array11
MDisk12 / Array12
MDisk13 / Array13
MDisk1 / Array1
MDisk2 / Array2
MDisk3 / Array3
MDisk4 / Array4
MDisk5 / Array5
MDisk6 / Array6
MDisk7 / Array7
MDisk8 / Array8
MDisk9 / Array9
18
Storage Network
Virtual LUNs Virtual LUNs Virtual LUNs Virtual LUNs Virtual LUNs Virtual LUNs VISC VISC VISC VISC VISC VISC VISC VISC VISC VISC VISC VISC
Storage Network
Virtual LUNs Virtual LUNs VISC VISC VISC VISC
Managed Disks
Managed Disks
19
LUN 1
LUN 2
LUN 3
LUN 4
LUN 1
LUN 2
LUN 3
LUN 4
LUN 1
LUN 2
LUN 3
LUN 4
LUN 1
LUN 2
LUN 3
DS8K
EMC
XIV
HDS
20
LUN 4
Target volume may be to one or more disk subsystems, different than the source
Two SVC clusters connected to each other over a fibre channel fabric 10km Fibre distance supported with LW SFPs Extended distance support using FC "Extenders/Routers/DWDM" hardware One-to-one volume relationship Source and Target virtual disk must be the same size Suspend/Resume support Failover/Failback support Consistency Group support Up to 256 groups Invoked via Web User Interface, CLI or scripts Licensed independently of base virtualization software and FlashCopy License includes both sync and async replication capability Support for Intra-cluster remote copy allows for testing within one cluster
21
Data Migration
Storage Network
Virtual LUNs Virtual LUNs Virtual LUNs Virtual LUNs Virtual LUNs Virtual LUNs VISC VISC VISC VISC VISC VISC VISC VISC VISC VISC VISC VISC
Storage Network
Virtual LUNs Virtual LUNs VISC VISC VISC VISC
Managed Disks
Managed Disks
22
LUN 1
LUN 2
LUN 3
LUN 4
LUN 1
LUN 2
LUN 3
LUN 4
LUN 1
LUN 2
LUN 3
LUN 4
LUN 1
LUN 2
LUN 3
DS8K
EMC
XIV
HDS
LUN 4
LUN 1
LUN 2
LUN 3
LUN 1
LUN 2
LUN 3
LUN 4
LUN 1
LUN 2
LUN 3
DS8K
EMC
LUN 4
XIV
LUN 4
24
Target volume may be to one or more disk subsystems, different than the source
Data Migration
Storage Network
Virtual LUNs Virtual LUNs Virtual LUNs Virtual LUNs Virtual LUNs Virtual LUNs VISC VISC VISC VISC VISC VISC VISC VISC VISC VISC VISC VISC
Storage Network
Virtual LUNs Virtual LUNs VISC VISC VISC VISC
Managed Disks
Managed Disks
26
BlockBlock virtualization virtualization
Map existing LUNs to SVC using Image mode Reassign Image mode VDisks from SVC to host Restart applications No data movement required Arrays now managed as a virtualized pool Data moved, striped, rebalanced Application servers unaware of physical changes Evolve rest of the SAN in the same manner At already planned downtime
SAN
27
Extent 5c Extent 5d
Extent 5e Extent 5f Extent 5g
Partial extent
ImageMode_MDG
BLUDATA 16 GB
28
Extent 5c 1c Extent 1d
Extent 1e Extent 1f Extent 1g
Partial extent
BlueData_MDG
BLUDATA2 4 GB BLUDATA1
4 GB Extent 1a Extent 2a Extent 5c 3a Extent 4a Extent 1b Extent 2b Extent 3b Extent 4b
Migrate extents
Migrate
BLUDATA3 4 GB
Virtualized
BLUDATA 16 GB
BLUDATA4 4 GB
Striped VDisk
29
Extent 5c 1c Extent 1d
Extent 1e Extent 1f Extent 1g
Partial extent
BlueData_MDG
BLUDATA2 4 GB BLUDATA1
4 GB Extent 1a Extent 2a Extent 5c 3a Extent 4a Extent 1b Extent 2b Extent 3b Extent 4b
Migrate extents
Migrate
BLUDATA3 4 GB
Virtualized
BLUDATA 16 GB
BLUDATA4 4 GB
Striped VDisk
30
Migrate extents
Server1
Application Access
Virtual Disk
MDiskGroupB MDiskGroupA
MDisks
R5
R5
R5
R5
R5
R5
Migrate VDisk
SCSI LUNs
R5 LUN R1 LUN R5 LUN R5 LUN R5 LUN R5 LUN
RAID Controller
RAID Controller
73 GB Drives
31
300 GB Drives
2009 2008 IBM Corporation
Migrate extents
Server1
Application Access
Virtual Disk
MDiskGroupB MDiskGroupA
MDisks
R5
R5
R5
R5
R5
R5
Migrate VDisk
SCSI LUNs
R5 LUN R1 LUN R5 LUN R5 LUN R5 LUN R5 LUN
Decommission
RAID Controller
RAID Controller
Storage SubsystemA
32
Storage SubsystemB
2009 2008 IBM Corporation
Migrate extents
Virtual Disk
Extent 2a Extent 2b
Extent 2c
Extent 3a Extent 3b
Extent 3c
Extent 1d Extent 1e
Extent 1f
Extent 2d
Extent 2e
Extent 3d Extent 3e
Extent 3f
Remove Redeploy
Extent 2f
Extent 1g
Extent 2g
Extent 3g
Managed Disks
33
SCSI Front-end Remote Copy Cache FlashCopy VDM SEV Virtualization SCSI Back-end
2009 IBM Corporation
Virtual Capacity defines how large the VDisk appears to the host
A directory maps the virtual address space to the real address space
Implemented as a B-Tree and stored on backend disk Directory and User data share the Real Capacity
Space-Efficient VDisk
Host Server Virtual Capacity Directory Real Capacity Managed Disk Group Controller
35
Virtual LBA 0
Allocation Unit for Real Capacity is called Grain Size: 32 KB, 64 KB, 128
KB or 256 KB. When writing to grain unused space formatted with zeros
User must provision more storage to expand the Real Capacity to get
the VDisk back online
SVC helps you to avoid exhausting the Real Capacity allowing for alerts
to be sent to admins to provide space or by increasing Real Capacity automatically
Virtual Capacity 2GB Used Capacity 600MB Real Capacity 1GB Warning Capacity 800MB
38
Minimal impact to VDisk availability if one set of MDisks (a disk array) goes offline
Automatic incremental resync
SAN
MDisk copy 2
Migrate from space-efficient to fully-allocated VDisk Migrate from image/striped/sequential mode to a sequential VDisk Can control copy rate of migration and even suspend/cancel migration
Same controls as FlashCopy Default copy rate setting is 50 which is 2MB/s
40
VMware SRM
Sun Solaris
Linux
SGI
IBM BladeCenter
1024 Hosts
New
New
iSCSI to hosts Via Cisco IPS
New New
Point-in-time Copy Full volume, Copy on write 256 targets, Incremental, Cascaded Space-Efficient
Entry Edition software
SAN
New
New
IBM ESS, FAStT IBM DS
DS3K/4K DS5000 DS6000 DS8000
New
IBM IBM XIV N series
New
HP Hitachi EMC Sun NetApp MA, EMA Lightning CLARiiON StorageTek FAS MSA, EVA 4400 Thunder Symmetrix TagmaStore XP 24000/20000 AMS, WMS, USP
NEC Fujitsu Pillar Bull iStorage Eternus Axiom StoreWay 300, 500
For the most current, and more detailed, information please visit ibm.com/storage/svc and click on Interoperability.
41
Performance
Buy nodes if you need performance Buy disk if you need capacity
Simplified
Virtual-to-physical Mapping
heterogeneous environment
LUN 3
SCSI LUNs
Non-disruptive
LUN 4
Copy services between dissimilar storage systems Eliminates Copy Services licenses on each disk subsystems
VD 5
IBM
SDD
42
VD 7
EMC
Reference Materials
Websites for marketing and support information
http://www.ibm.com/storage/software/virtualization
http://www.ibm.com/storage/support/2145
Publications
http://www.ibm.com/shop/publications/order Planning Guide GA32-0551
Redbooks
http://www.ibm.com/redbooks
Search on SAN Volume Controller
43
Disclaimers
Copyright 2006 by International Business Machines Corporation. No part of this document may be reproduced or transmitted in any form without written permission from IBM Corporation. Product data has been reviewed for accuracy as of the date of initial publication. Product data is subject to change without notice. This information
could include technical inaccuracies or typographical errors. IBM may make improvements and/or changes in the product(s) and/or programs(s) at any time without notice.
Unless otherwise note, the performance data contained herein was obtained in a controlled, isolated environment. Actual results that may be
obtained in other operating environments may vary significantly. While IBM has reviewed each item for accuracy in a specific situation, there is no guarantee that the same or similar results will be obtained elsewhere. Other data may have been obtained from publicly available documents or sources. In such cases, IBM has endeavored to provide comparable measurements for systems being compared.
References in this document to IBM products, programs, or services does not imply that IBM intends to make such products, programs or services
available in all countries in which IBM operates or does business. Any reference to an IBM Program Product in this document is not intended to state or imply that only that program product may be used. Any functionally equivalent program, that does not infringe IBMs intellectually property rights, may be used instead. It is the users responsibility to evaluate and verify the operation of any non -IBM product, program or service.
The information provided in this document is distributed "AS IS" without any warranty, either express or implied. IBM EXPRESSLY DISCLAIMS
any warranties of merchantability, fitness for a particular purpose OR NONINFRINGEMENT. IBM shall have no responsibility to update this information. IBM products are warranted according to the terms and conditions of the agreements ( e.g., IBM Customer Agreement, Statement of Limited Warranty, International Program License Agreement, etc.) under which they are provided. IBM is not responsible for the performance or interoperability of any non-IBM products discussed herein.
Information concerning non-IBM products was obtained from the suppliers of those products, their published announcements or other publicly
available sources. IBM has not tested those products in connection with this publication and cannot confirm the accuracy of performance, compatibility or any other claims related to non-IBM products. Questions on the capabilities of non-IBM products should be addressed to the suppliers of those products. Inquiries regarding patent or copyright licenses should be made, in writing, to: IBM Director of Licensing IBM Corporation North Castle Drive Armonk, NY 10504-1785 U.S.A. 45
The provision of the information contained herein is not intended to, and does not, grant any right or license under any IBM patents or copyrights.
Trademarks
The following terms are trademarks or registered trademarks of the IBM Corporation in either the United States, other countries or both.
IBM, S/390, ES/3090, ES/9000, AS/400, RS/6000, MVS/ESA, OS/390, VM/ESA, VSE, TPF, OS/2, OS/400,
AIX,, FlashCopy, z/VM, z/OS, POWER5, POWER5+, DB2, Universal Database
DFSMS/MVS, DFSMS/VM, , DFSMSdfp, DFSMSdss, DFSMShsm, DFSMSrmm, BladeCenter, FICON, ESCON, TotalStorage, Enterprise Storage Server, iSeries, pSeries, xSeries, zSeries, System z,
System z9, System i, System i5, System p, System p5, System x, System Storage Java and all Java-based trademarks are trademarks of Sun Microsystems, Inc. in the United States, other countries, or both. Microsoft, Windows, Windows NT, and the Windows logo are trademarks of Microsoft Corporation in the United States, other countries, or both. Intel, Intel logo, Intel Inside, Intel Inside logo, Intel Centrino, Intel Centrino logo, Celeron, Intel Xeon, Intel SpeedStep, Itanium, and Pentium are trademarks or registered trademarks of Intel Corporation or its subsidiaries in the United States and other countries. UNIX is a registered trademark of The Open Group in the United States and other countries. Linux is a registered trademark of Linus Torvalds in the United States, other countries, or both. Other company, product, or service names may be trademarks or service marks of others.
46