New - ZFs
New - ZFs
To connect one or more disk shelves, use the diagrams in the Oracle ZFS Storage Appliance
Cabling Guide, Release OS8.8.x.
When connecting SAS cables to two Oracle Storage Drive Enclosure DE3-12C disk shelves,
cable tabs should be oriented downward toward the port's SAS logo for the top I/O Module
(IOM A). For the bottom I/O Module (IOM B), cable tabs should be oriented upward toward
the port's SAS logo.
Note:
Contact Oracle Service if you want to move a disk shelf between Oracle ZFS
Storage Appliance systems. Certain limitations exist when importing storage pools,
and can cause problems if not done properly by Oracle Service personnel.
12-17
Chapter 12
Disk Shelf Hardware Overview
Up to four write-optimized log SSDs are supported per disk shelf. Log devices should
be populated in order of slots 20, 21, 22, and 23.
External Read Cache Devices - Read cache devices, installed in Oracle Storage
Drive Enclosure DE3-24 disk shelves, are external to the controller and referred to as
external second level adaptive replacement cache (EL2ARC). When a cluster takeover
occurs, read cache remains persistent and sharable between controllers, enabling
read performance to be sustained. For slot configuration details and minimum software
requirements, see Disk Shelf Configurations.
12-18
Chapter 12
Disk Shelf Hardware Overview
Up to four write-optimized log SSDs are supported per disk shelf. Log devices should be
populated in order of slots 20, 21, 22, and 23.
External Read Cache Devices - Read cache devices, installed in Oracle Storage Drive
Enclosure DE3-24 disk shelves, are external to the controller and referred to as external
second level adaptive replacement cache (EL2ARC). When a cluster takeover occurs, read
cache remains persistent and sharable between controllers, enabling read performance to be
sustained. For slot configuration details and minimum software requirements, see Disk Shelf
Configurations.
12-19
Chapter 12
Disk Shelf Hardware Overview
12-20
Chapter 12
Disk Shelf Hardware Overview
1 Power supply filler panel, slot 4 2 I/O Module 1 3 I/O Module filler panel
4 Power supply with fan module 5 Power supply filler panel, slot 2 6 I/O Module filler panel
2
7 I/O Module 0 8 Power supply with fan module
1
Note:
It is especially important that power supplies and their filler panels are in the correct
slots.
12-21
Chapter 12
Disk Shelf Hardware Overview
The Oracle Storage Drive Enclosure DE3-24C and Oracle Storage Drive Enclosure
DE3-24P disk shelves use the same I/O Module.
The Oracle Storage Drive Enclosure DE3-24C and Oracle Storage Drive Enclosure
DE3-24P disk shelves use the same power supply.
12-22
Chapter 12
Disk Shelf Hardware Overview
Up to four write-optimized log SSDs are supported per disk shelf. Log devices should be
populated in order of slots 20, 21, 22, and 23.
External Read Cache Devices - Read cache devices, installed in Oracle Storage Drive
Enclosure DE2-24P disk shelves, are external to the controller and referred to as external
second level adaptive replacement cache (EL2ARC). When a cluster takeover occurs, read
cache remains persistent and sharable between controllers, enabling read performance to be
sustained. For slot configuration details and minimum software requirements, see Disk Shelf
Configurations.
12-23
Chapter 12
Disk Shelf Hardware Overview
Up to four write-optimized log SSDs are supported per disk shelf. Log devices should
be populated in order of slots 20, 21, 22, and 23.
External Read Cache Devices - Read cache devices, installed in Oracle Storage
Drive Enclosure DE2-24C disk shelves, are external to the controller and referred to as
external second level adaptive replacement cache (EL2ARC). When a cluster takeover
occurs, read cache remains persistent and sharable between controllers, enabling
read performance to be sustained. For slot configuration details and minimum software
requirements, see Disk Shelf Configurations.
12-24
Chapter 12
Disk Shelf Hardware Overview
1 Power supply filler panel, slot 0 2 Power supply with fan module 3 Power supply with fan module
1 2
12-25
Chapter 12
Disk Shelf Hardware Overview
4 Power supply filler panel, slot 3 5 I/O Module filler panel 6 I/O Module 0
7 I/O Module filler panel 8 I/O Module 1
Note:
It is especially important that power supplies and their filler panels are in the
correct slots.
The Oracle Storage Drive Enclosure DE2-24C and Oracle Storage Drive Enclosure
DE2-24P disk shelves use the same I/O Module.
12-26
Chapter 12
Disk Shelf Hardware Overview
The Oracle Storage Drive Enclosure DE2-24C and Oracle Storage Drive Enclosure DE2-24P
disk shelves use the same power supply.
12-27
Chapter 12
Disk Shelf Hardware Overview
Up to two write-optimized log SSDs are supported per disk shelf. Log devices can be
populated in slots 10 and 11.
External Read Cache Devices - Read cache devices, installed in Oracle Storage
Drive Enclosure DE3-12C disk shelves, are external to the controller and referred to as
external second level adaptive replacement cache (EL2ARC). When a cluster takeover
occurs, read cache remains persistent and sharable between controllers, enabling
read performance to be sustained. For slot configuration details and minimum software
requirements, see Disk Shelf Configurations.
Oracle Storage Drive Enclosure DE3-12C Status Indicators (Front View)
12-28
Chapter 12
Disk Shelf Hardware Overview
12-29
Chapter 12
Disk Shelf Hardware Overview
12-30
Chapter 12
Disk Shelf Hardware Overview
1 Locate button and indicator 2 System fault indicator 3 System power indicator
4 Disk ready to be removed 5 Disk fault indicator 6 Disk activity indicator
indicator
7 Over temperature warning 8 SIM board fault indicator 9 Power supply fault indicator
indicator
1 Power supply modules with built-in fans. Power 2 Removable SAS Interface Module (SIM) Boards.
supply 0 is on the left and power supply 1 is on the SIM 0 is on the left, and SIM 1 is on the right.
right.
12-31
Chapter 12
Disk Shelf Hardware Overview
1 Cooling fan status indicator 2 AC power status indicator 3 DC power status indicator
4 Power supply status 5 Power on/off switch 6 Power cord tie wrap
indicator
7 Universal power input 8 Right ejection arm and
connector captive screw latch
12-32
Chapter 12
Disk Shelf Hardware Overview
Table 12-1 Oracle Storage Drive Enclosure DE3-24P/Oracle Storage Drive Enclosure DE2-24P
Disk Shelf Configurations
Table 12-2 Oracle Storage Drive Enclosure DE3-24P All-Flash Disk Shelf Configurations
12-33
Chapter 12
Disk Shelf Hardware Overview
Table 12-3 Oracle Storage Drive Enclosure DE3-24C/Oracle Storage Drive Enclosure DE2-24C
Disk Shelf Configurations
Table 12-4 Oracle Storage Drive Enclosure DE3-12C Disk Shelf Configurations
12-34
Chapter 12
Disk Shelf Hardware Overview
Controllers cannot simultaneously use 2x4 port SAS-2 HBAs and 4x4 port SAS-2 HBAs. As
of software release OS8.7.0, 4x4 port SAS-3 HBAs and 4x4 port SAS-2 HBAs can be used
together in the same system. Sun Disk Shelves are not supported in any system that includes
a SAS-3 HBA, or a combination of SAS-3 and SAS-2 HBAs.
The following table shows the maximum number of HBAs per controller, and the maximum
number of disk shelves supported per controller configuration. Both standalone and clustered
controllers support the same maximum number of disk shelves.
12-35
Chapter 12
Disk Shelf Hardware Overview
Controller Max. Shelves Max. 2x4 Max. 4x4 Max. 4x4 Guidelines
Port Port Port
SAS-2 SAS-2 SAS-3
HBA HBA HBA
Oracle ZFS 48 (1152 NA NA 4 Disk shelves can include 24x HDD/SSD, or
Storage ZS9-2 drives, combine 20x HDD/SSD plus 4x write-
high-end model including filler optimized and/or read-optimized flash
panels) accelerators (SSDs). Total number of chains
is eight. Any combination of disk-only and
write- or read-optimized shelves may be
combined within the chain in any order.
When employing Oracle Storage Drive
Enclosure DE3-12C disk shelves, twoOracle
Storage Drive Enclosure DE3-12C disk
shelves are the equivalent of one Oracle
Storage Drive Enclosure DEx-24 disk shelf.
Thus, the maximum shelves is 96, which is
still 1152 drives. The Oracle Storage Drive
Enclosure DE3-12C disk shelf can include
12x HDD, or combine 10x HDD plus 2x
write-optimized and/or read-optimized flash
accelerators (SSDs). Total number of chains
is still eight.
When combining Oracle Storage Drive
Enclosure DE3-12C and Oracle Storage
Drive Enclosure DE3-24 disk shelves, the
maximum allowed number of drives,
including filler panels, is 1152 drives.
Oracle ZFS 24 (576 drives, NA NA 2 Disk shelves can include 24x HDD/SSD, or
Storage ZS9-2 including filler combine 20x HDD/SSD plus 4x write-
mid-range panels) optimized and/or read-optimized flash
model accelerators (SSDs). Total number of chains
is four. Any combination of disk-only and
write- or read-optimized shelves may be
combined within the chain in any order.
When employing Oracle Storage Drive
Enclosure DE3-12C disk shelves, two Oracle
Storage Drive Enclosure DE3-12C disk
shelves are the equivalent of one Oracle
Storage Drive Enclosure DEx-24 disk shelf.
Thus, the maximum shelves is 48, which is
still 576 drives. The Oracle Storage Drive
Enclosure DE3-12C disk shelf can include
12x HDD, or combine 10x HDD plus 2x
write-optimized and/or read-optimized flash
accelerators (SSDs). Total number of chains
is still four.
When combining Oracle Storage Drive
Enclosure DE3-12C and Oracle Storage
Drive Enclosure DE3-24 disk shelves, the
maximum allowed number of drives,
including filler panels, is 576 drives.
12-36
Chapter 12
Disk Shelf Hardware Overview
Controller Max. Shelves Max. 2x4 Max. 4x4 Max. 4x4 Guidelines
Port Port Port
SAS-2 SAS-2 SAS-3
HBA HBA HBA
Oracle ZFS 48 NA NA 4 Disk shelves can include 24x HDD/SSD, or
Storage ZS7-2 combine 20x HDD/SSD plus 4x write-
high-end model optimized and/or read-optimized flash
accelerators (SSDs). Total number of chains
is eight. Any combination of disk-only and
write- or read-optimized shelves may be
combined within the chain in any order.
Oracle ZFS 24 NA NA 2 Disk shelves can include 24x HDD/SSD, or
Storage ZS7-2 combine 20x HDD/SSD plus 4x write-
mid-range optimized and/or read-optimized flash
model accelerators (SSDs). Total number of chains
is four. Any combination of disk-only and
write- or read-optimized shelves may be
combined within the chain in any order.
Oracle ZFS 48 NA 4 4 Disk shelves can include 24x HDD/SSD, or
Storage ZS5-4 combine 20x HDD/SSD plus 4x write-
optimized and/or read-optimized flash
accelerators (SSDs). Total number of chains
is eight. Any combination of disk-only and
write- or read-optimized shelves may be
combined within the chain in any order.
Oracle ZFS 16 NA 2 2 Disk shelves can include 24x HDD/SSD, or
Storage ZS5-2 combine 20x HDD/SSD plus 4x write-
optimized and/or read-optimized flash
accelerators (SSDs). Total number of chains
is four. Any combination of disk-only and
write- or read-optimized shelves may be
combined within the chain in any order.
Oracle ZFS 36 NA 4 4 Disk shelves can include 24x HDD/SSD, or
Storage ZS4-4 combine 20x HDD/SSD plus 4x write-
optimized and/or read-optimized flash
accelerators (SSDs). Total number of chains
is eight. Any combination of disk-only and
write-optimized shelves can be combined
within the chain in any order.
Oracle ZFS 36 NA 4 NA Disk shelves can include 24x HDD, or
Storage ZS3-4 combine 20x HDD plus 4x write-optimized
flash accelerators (SSDs). Total number of
chains is eight. Any combination of disk-only
and write-optimized shelves can be
combined within the chain in any order. You
can also connect mixed disk shelf types
(DE2 and legacy Sun Disk Shelves) to the
same controllers, but each chain must
contain only the same disk shelf type.
Directly connecting different disk shelf types
is not supported.
12-37
Chapter 12
Disk Shelf Hardware Overview
Controller Max. Shelves Max. 2x4 Max. 4x4 Max. 4x4 Guidelines
Port Port Port
SAS-2 SAS-2 SAS-3
HBA HBA HBA
Oracle ZFS 16 NA 2 2 Disk shelves can include 24x HDD, or
Storage ZS3-2 combine 20x HDD plus 4x write-optimized
flash accelerators (SSDs). Total number of
chains is four. Any combination of disk-only
and write-optimized shelves can be
combined within the chain in any order. You
can also connect mixed disk shelf types
(DE2 and legacy Sun Disk Shelves) to the
same controllers, but each chain must
contain only the same disk shelf type.
Directly connecting different disk shelf types
is not supported.
Sun ZFS 36 6 6 NA Disk shelves can include 24x HDD, or
Storage 7420 combine 20x HDD plus 4x write-optimized
flash accelerators (SSDs). Total number of
chains is six with 2X4 port SAS-2 HBAs, and
12 with 4X4 port SAS-2 HBAs. Any
combination of disk-only and write-optimized
shelves can be combined within the chain in
any order. You can also connect mixed disk
shelf types (DE2 and legacy Sun Disk
Shelves) to the same controllers, but each
chain must contain only the same disk shelf
type. Directly connecting different disk shelf
types is not supported.
Sun ZFS 6 1 1 NA Any combination of disk-only and write-
Storage 7320 optimized shelves may be combined within
the chain in any order. The cabling
configurations are unchanged. You can also
connect mixed disk shelf types (DE2 and
legacy Sun Disk Shelves) to the same
controllers, but each chain must contain only
the same disk shelf type. Directly connecting
different disk shelf types is not supported.
Sun ZFS 2 1 NA NA Write-optimized SSDs are not supported in
Storage 7120 the expansion storage for the 7120. The disk
shelves must be fully populated with 24
HDDs. You can also connect mixed disk
shelf types (DE2 and legacy Sun Disk
Shelves) to the same controllers.
12-38
Chapter 12
Disk Shelf Hardware Overview
target devices, up to 1024. You can daisy-chain SAS-2 disks to as many as 36 disk shelves
for certain systems, for a total of 864 disks. The SAS-2 HBA has 2x4 (8 PHYs) or 4x4 port
(16 PHYs) with each supporting 6 Gbit/s (SAS-2) devices. For more information about the
SAS-2 HBA, see the hardware overview for your controller.
For supported disk shelf configurations, see Disk Shelf Configurations.
SAS-3: The SAS-3 (Serial Attached SCSI 3.0) host bus adapter (HBA) increases speed to 12
Gbit/s and is capable of supporting up to 4095 devices. You can daisy-chain SAS-3 disks to
as many as 48 disk shelves for certain systems, for a total of 1152 disks. The SAS-3 HBA is a
low-profile, 4x4 port (16 PHYs), with each port supporting 12 Gbit/s (SAS-3) devices. For
more information about the SAS-3 HBA, see the hardware overview for your controller.
For supported disk shelf configurations, see Disk Shelf Configurations.
12-39
13
Viewing System Disks Status
The system disks section shows the status of the system disks and their current usage. The
BUI displays this with a pie-chart, and the CLI as a text list. For example:
Disks:
Note:
The DISK column is not required by the BUI.
13-1