SUPPORT OPERATIONS – TPM MANAGEMENT

NetApp ASE-1 Hardware Maintenance and

Troubleshooting
Version Number: Version 1.0
Course Number: STRSW-ED-ILT-TPM-ASE-1
December 2008
 This page is intentionally left blank.

0-2 NetApp Protection Software Administration: Welcome

© 2008 NetApp. This material is intended for training use only. Not authorized for reproduction purposes.
TABLE OF CONTENTS
INTRODUCTION .......................................................................................................................................... 1
MODULE 1: NETAPP STORAGE PRODUCT LINE ............................................................................1-1
MODULE 2: NET2 TOOL ..........................................................................................................................2-1
MODULE 3: PHYSICAL CONNECTIVITY ...........................................................................................3-1
MODULE 4: PARTS IDENTIFICATION AND REPLACEMENT.......................................................4-1
MODULE 5: FC LOOP ID AND CABLE TYPES ...................................................................................5-1
MODULE 6: DISK REPLACEMENT AND TROUBLESHOOTING...................................................6-1
MODULE 7: SYSTEMS CABLING ..........................................................................................................7-1
MODULE 8: A/A CONFIGURATION FAILOVER AND TROUBLESHOOTING ............................8-1
MODULE 9: PHYSICAL INSPECTION..................................................................................................9-1
MODULE 10: RULES OF ENGAGEMENT AND PHONE MENU ....................................................10-1
APPENDIX A. NETAPP PHONE MENU................................................................................................ A-1
APPENDIX B. TERMINLOGY AND ACRONYMS .............................................................................. B-1
APPENDIX C. NETAPP HARDWARE SELECTIONAL ..................................................................... C-1

0-3 NetApp Protection Software Administration: Welcome

© 2008 NetApp. This material is intended for training use only. Not authorized for reproduction purposes.
ATTENTION
The information contained in this guide is intended for training use only. This guide contains information
and activities that, while beneficial for the purposes of training in a closed, non-production environment,
can result in downtime or other severe consequences and therefore are not intended as a reference guide.
This guide is not a technical reference and should not, under any circumstances, be used in production
environments. To obtain reference materials, please refer to the NetApp product documentation located
at www.now.com for product information.

COPYRIGHT
© 2008 NetApp. All rights reserved. Printed in the U.S.A. Specifications subject to change without notice.
No part of this book covered by copyright may be reproduced in any form or by any means—graphic,
electronic, or mechanical, including photocopying, recording, taping, or storage in an electronic retrieval
system—without prior written permission of the copyright owner.
NetApp reserves the right to change any products described herein at any time and without notice.
NetApp assumes no responsibility or liability arising from the use of products or materials described
herein, except as expressly agreed to in writing by NetApp. The use or purchase of this product or
materials does not convey a license under any patent rights, trademark rights, or any other intellectual property
rights of NetApp.
The product described in this manual may be protected by one or more U.S. patents, foreign patents,
or pending applications.

RESTRICTED RIGHTS LEGEND

Use, duplication, or disclosure by the government is subject to restrictions as set forth in subparagraph
(c)(1)(ii) of the Rights in Technical Data and Computer Software clause at DFARS 252.277-7103
(October 1988) and FAR 52-227-19 (June 1987).

TRADEMARK INFORMATION
NetApp, the NetApp logo, and Go further, faster, FAServer, NearStore, NetCache, WAFL, DataFabric,
FilerView, SecureShare, SnapManager, SnapMirror, SnapRestore, SnapVault, Spinnaker Networks,
the Spinnaker Networks logo, SpinAccess, SpinCluster, SpinFS, SpinHA, SpinMove, SpinServer, and SpinStor
are registered trademarks of Network Appliance, Inc. in the United States and other countries. Network
Appliance, Data ONTAP, ApplianceWatch, BareMetal, Center-to-Edge, ContentDirector, gFiler, MultiStore,
SecureAdmin, Smart SAN, SnapCache, SnapDrive, SnapMover, Snapshot, vFiler, Web Filer, SpinAV,
SpinManager, SpinMirror, and SpinShot are trademarks of NetApp, Inc. in the United States and/or other
countries.
Apple is a registered trademark and QuickTime is a trademark of Apple Computer, Inc. in the United States
and/or other countries.
Microsoft is a registered trademark and Windows Media is a trademark of Microsoft Corporation in the United
States and/or other countries.
RealAudio, RealNetworks, RealPlayer, RealSystem, RealText, and RealVideo are registered trademarks and
RealMedia, RealProxy, and SureStream are trademarks of RealNetworks, Inc. in the United States and/or
other countries.
All other brands or products are trademarks or registered trademarks of their respective holders and should be
treated as such.
NetApp is a licensee of the CompactFlash and CF Logo trademarks.

0-4 NetApp Protection Software Administration: Welcome

© 2008 NetApp. This material is intended for training use only. Not authorized for reproduction purposes.
 Welcome to the NetApp
Hardware Maintenance
and Troubleshooting
Course

Authorized Support Engineer Level 1

(ASE-1)

Logistics and Safety

Schedule (start time, breaks, lunch, close)

Telephones and messages

Food and drinks

Introductions

Electrical safety

© 2008 NetApp. All rights reserved. 2

© 2008 NetApp. All rights reserved. Page 1

 Introduction

State
– Name
– Company
– How long have you been working with NetApp
products
– Estimated number of dispatches you have taken
– Any challenges you’ve had

Instructor introduction

© 2008 NetApp. All rights reserved. 3

Objectives

At the end of this course, you will be able to:

Identify NetApp appliances and storage shelves

Understand and use the Net2 tool

Connect to the console port, view console messages,
and run Data ONTAP® commands

Identify defective hardware, remove and replace parts

Identify FC loop ID and cable types

Cable and troubleshoot a stand-alone system and
storage systems in an active-active configuration

Explain the process to complete a physical inspection

Describe the rules of engagement

© 2008 NetApp. All rights reserved. 4

© 2008 NetApp. All rights reserved. Page 2

 Course Agenda

Day 1
Introduction

Module 1: NetApp storage product line

Module 2: Net2 tool

Module 3: Physical connectivity

Module 4: Parts identification and replacement

Module 5: FC loop ID and cables type

Module 6: Disk replacement and troubleshooting

Day 2
Module 7: Systems cabling

Module 8: Active-active configuration failover and
troubleshooting

Module 9: Physical inspection process

Module 10: Rules of engagement and phone menu

© 2008 NetApp. All rights reserved. 5

Information Sources

NetApp ASE Training Curriculum

http://now.netapp.com/NOW/cgi-bin/SP/main

Use the NOW site for technical documentation
and knowledgebase solutions
http://NOW.NetApp.com

NetApp University site
http://www.netapp.com/us/services/university/univ
ersity.html

© 2008 NetApp. All rights reserved. 6

© 2008 NetApp. All rights reserved. Page 3

 NetApp Storage
Product Line

ASE-1 Hardware Maintenance and

Troubleshooting

Objectives

At the end of this module, you will be able to:

Describe NetApp product line and systems
storage capacity

Differentiate FAS®, S Family®, V-Series®,
FlexCache® SA-Series®, NearStore® and NetApp
VTL appliances

Identify which storage systems are compatible with
various disk shelves

© 2008 NetApp. All rights reserved. 2

© 2008 NetApp. All rights reserved. Page 1

 NetApp Storage Product Line

Enterprise storage
– FAS models, S Family, and FlexCache Storage
Acceleration or SA appliances

Virtualized storage
– V-Series

Near-line storage
– NearStore R200
– NetApp Virtual Tape Library (VTL)

© 2008 NetApp. All rights reserved. 3

S Family and FAS Models

FAS3140A - 420TB / 420 disks
FAS3170A - 840TB / 840 disks

FAS2020A - 68TB / 68 disks FAS60x0

FAS2050A - 104TB / 104 disks

FAS250 - 4TB / 14 disks

FAS270A - 16TB / 56 disks FAS31x0

FAS30x0
12TB / 12 disks
FAS20x0
6TB / 8 disks FAS6030A - 840TB / 840 disks
FAS2x0 FAS6040A - 840TB / 840 disks
FAS6070A - 1008 TB / 1008 disks
FAS6080A - 1176TB / 1176 disks
S550
S300 FAS3020A - 84TB / 168 disks
FAS3040A - 336TB / 336 disks
FAS3050A - 168TB / 336 disks
FAS3070A - 504TB / 504 disks

These numbers are based on Data ONTAP 7.2.5. Visit the NOW
site for the latest information and other OS release capacities.

© 2008 NetApp. All rights reserved. 4

© 2008 NetApp. All rights reserved. Page 2

 FlexCache SA-Series
1176TB / 1176 disks

SA600
504TB / 504 disks

104TB / 104 disks SA300 Based on the FAS6080 platform

SA200 Based on the FAS3070 platform

Based on the FAS2070 platform

These numbers are based on Data ONTAP 7.2.5. Visit the NOW
site for the latest information and other OS release capacities.

© 2008 NetApp. All rights reserved. 5

V-Series

420TB / 420 LUNs

V6080

V6040
336TB / 336 LUNs
V3170
84TB / 168 LUNs
V3140
1176TB / 1176 LUNs
16TB / 56 LUNs V3040
840TB / 840 LUNs
V3020

804TB / 840 LUNs

GF270

These numbers are based on Data ONTAP 7.2.5.

Visit the NOW site for the latest information
and other OS release capacities.

© 2008 NetApp. All rights reserved. 6

© 2008 NetApp. All rights reserved. Page 3

 NearStore Appliances and NetApp VTL
VTL1400

VTL700

VTL300

672TB / 672 SATA disks

Based on the FAS3000 platform
R200

336TB / 336 SATA disks

Upgradeable to VTL1400
Based on the FAS3000 platform

70TB / 70 SATA disks

Upgradeable to VTL700
Based on the FAS3000 platform

168TB / 336 SATA disks These numbers are based on DOT 7.2.5 and VTL OS v5.6.
Based on the F900 platform Visit the NOW site for the latest information and other OS
release capacities.

© 2008 NetApp. All rights reserved. 7

Legacy FAS Models and NearStore

R100/R150

F825A - 6TB / 168 disks

F880A - 12TB / 224 disks

F820A - 6TB / 112 disks

F840A - 12TB / 168 disks F9x0

F720A - 1TB / 56 disks

F825/F880
F740A - 2TB / 112 disks
F760A - 6TB / 168 disks
R100 - 12TB / 84 disks
F820/F840
R150 - 24TB / 168 disks

F7x0 F920A - 14TB / 168 disks

F940A - 28TB / 336 disks
F960A - 56TB / 672 disks
F980A - 100TB / 672 disks

© 2008 NetApp. All rights reserved. 8

© 2008 NetApp. All rights reserved. Page 4

 Legacy NetCache® Appliance
C6200 - 2.4TB
C6300 - 4TB

C2300 - 864GB
C3300 - 2TB C6200
C6300
C3100 - 504GB
C6100 - 2.4TB
C2300
C3300
C2100 - 504GB
External shelves only
C1100 - 9GB C3100 Based on F900 platform
C1105 - 72GB C6100
C1200 - 216GB
C1300 - 300GB C3300 supports external shelves
Based on FAS3000 platform
C2100
External FC9 shelves
Based on F800 platform
C1x00
Internal disks only

Internal disks only If the disk exists in an external shelf to the NetCache,
follow normal disk swapping procedures. If the disk is
internal to the unit, CALL NGS

© 2008 NetApp. All rights reserved. 9

Storage Shelves
R100 - 1.6TB / 12 SCSI ATA disks
R150 - 3.8TB / 12 SCSI ATA disks

FC9 - 504GB / 7 disks DS14 Family

R100/R150 shelf
FC7 - 63GB / 7 disks
FC8 - 126GB / 7 disks

FC9

DS14 - 14TB / 14 FC disks

DS14Mk2 - 14TB / 14 FC disks
FC7/FC8 DS14Mk4 - 14TB / 14 FC disks
DS14Mk2-AT - 14TB / 14 SATA disks

© 2008 NetApp. All rights reserved. 10

© 2008 NetApp. All rights reserved. Page 5

 Storage System and Shelf Compatibility

© 2008 NetApp. All rights reserved. 11

Module Review

The NetApp VTL appliances are based on the
FAS3000 platform (true or false?)
– True

What is the maximum number of disks in a S550
system?
– 12 disks

What is the maximum storage capacity of the
DS14Mk2-AT shelf?
– 14TB

Which storage shelves are compatible with the
FAS20X0 appliance?
– DS14, DS14Mk2 FC, DS14Mk4 FC, and DS14Mk2-AT

Which storage shelf is compatible with the R200
appliance?
– DS14Mk2-AT

© 2008 NetApp. All rights reserved. 12

© 2008 NetApp. All rights reserved. Page 6

 Net2 Tool

ASE-1 Hardware Maintenance and

Troubleshooting

Objectives

At the end of this module, you will be able to:

Explain the purpose of the Net2 tool

Install and update the Net2 tool

Navigate through the Net2 tool

Locate and use job aids and action plans

© 2008 NetApp. All rights reserved. 2

© 2008 NetApp. All rights reserved. Page 1

 Net2 Overview

The NetApp Electronic TPM Toolkit or Net2 is

designed to support NetApp Service Partners
– Provides model specific procedures for FRU
removal and replacement activities
– Maintains a concise library of current service
action plans and job aids

Can operate in standalone mode and supports
automated updates

Captures user feedback

Net2 is supported only on Windows platforms

© 2008 NetApp. All rights reserved. 3

Installing Net2

To download and install the Net2 tool, click on

the following link:
http://net2tpm.com/net2/v2.0/download/setup.exe

Click on Save

© 2008 NetApp. All rights reserved.

© 2008 NetApp. All rights reserved. Page 2

 Installing Net2 (cont’d)

The Net2 Setup Wizard displays

The installation is a simple process, just follow the
prompts

Click on Next Click on I Agree

© 2008 NetApp. All rights reserved. 5

Installing Net2 (cont’d)

Click on Next Click on Install

© 2008 NetApp. All rights reserved. 6

© 2008 NetApp. All rights reserved. Page 3

 Installing Net2 (cont’d)

The Net2 setup completes by installing the software

and the documents library in the specified
installation path

Click on Finish

© 2008 NetApp. All rights reserved. 7

Net2 Automated Updates

Updates contain
– New and updated action plans
– New tool versions

Update steps
1. Connect to the Internet and start Net2
2. The Net2 update program launches and
downloads new files and documents
3. Once complete, the Net2 application will launch

© 2008 NetApp. All rights reserved.

© 2008 NetApp. All rights reserved. Page 4

 Starting Net2

When the tool is launched, the Welcome to Net2
screen displays the current version of the tool

If this is a break-fix event to which you have been
dispatched (as opposed to a site inspection), enter the
device serial number that is noted on the dispatch

Select
BreakFix
Event

© 2008 NetApp. All rights reserved. 9

Net2 Available Actions

If the serial number is available in the tool, the

next window will list the available actions for
that type of device

Enter the system

Select an
serial number and
action and click
press Enter
on Next

© 2008 NetApp. All rights reserved.

© 2008 NetApp. All rights reserved. Page 5

 Net2 Action Plans

In this example, the action to perform is to

replace a chassis fan

After conforming your selection, the action plan
will either display in a flash viewer or a PDF file

Select an
activity and
click on Next

Click on OK

© 2008 NetApp. All rights reserved. 11

Action Plans Example

© 2008 NetApp. All rights reserved. 12

© 2008 NetApp. All rights reserved. Page 6

 Net2 Navigation - Unknown Serial Number

If you don’t know or do not have the correct

system serial number, you can locate an action
plan by product model family

© 2008 NetApp. All rights reserved. 13

Net2 Navigation Using Platform Model

On the equipment selection screen, select the type of

equipment (equipment family) you need to service

After selecting the model, the steps are the same as
those where the serial number was known/valid

Select a Select a
product and model
click Next

© 2008 NetApp. All rights reserved. 14

© 2008 NetApp. All rights reserved. Page 7

 Module Review

What is the function of the Net2 tool?

– Provides model specific action plans and job aids for
FRU removal and replacement activities

On which platform can you install the Net2 tool?
– Microsoft® Windows®

Which two types of dispatch can you select in the
Welcome to Net2 window?
– Break/Fix Event
– Physical-On-Site-Inspection

Where can you view the current version of the Net2
tool you had installed?
– On the Welcome to Net2 window

© 2008 NetApp. All rights reserved. 15

© 2008 NetApp. All rights reserved. Page 8

 Physical
Connectivity

ASE-1 Hardware Maintenance and

Troubleshooting

Objectives

At the end of this module, you will be able to:

List the methods to access NetApp appliances

Connect to a storage system using supported
cables and appropriate settings

Explain how to access the storage system using
the serial console port

Explain how to access the storage system using
the management port (RLM)

Troubleshoot the storage system using the RLM

© 2008 NetApp. All rights reserved. 2

© 2008 NetApp. All rights reserved. Page 1

 Access Methods to NetApp Appliances

You can directly access a storage system from a

console attached by a cable to the system's serial port

You can also use the preinstalled Ethernet port to
access the system from any client by using:
– A Telnet session (port 23)
– A Remote Shell or RSH connection
– A Web browser and the FilerView® interface

Requires the Java® Client to be installed to run commands
at the CLI
– A secure shell client application (port 22)

SSH®, OpenSSH®, SecureCRT® 5.2.4, or PuTTy® v.60+

SSH is required to connect the RLM

© 2008 NetApp. All rights reserved. 3

Equipment Required when Dispatch

Anti-static strap and mat

Small assortment of tools
including a pen flash light

Laptop with Ethernet and
serial port connectivity

Cable to connect your laptop
to the NetApp appliance

Serial-Telnet program for
accessing NetApp equipment

© 2008 NetApp. All rights reserved. 4

© 2008 NetApp. All rights reserved. Page 2

 Connecting the Laptop to the Appliance

S300, S550, FAS900 series, and
legacy storage systems have a
DB9 console port

FAS200, FAS2000, FAS3000,
FAS3100 and FAS6000 series
have an RJ45 console port
– When using a DB9-DB9 serial DB9F-DB9F NetApp null
cable, you need a DB9-RJ45 modem cable P/N 112-00111,
adapter 112-01603 or 133-01700

Cisco switch, IBM Shark®, SGI
Origin®, and EMC Clariion® serial
cables will work but require a DB9-RJ45 adapter
DB9-RJ45 adapter NetApp P/N 112-00006/00054

It is recommended that you bring

your own cables
© 2008 NetApp. All rights reserved.

Remote LAN Module Overview

Provides remote command access through SSH to

diagnose error conditions, even if the storage
system has failed
– View console messages and system events
– Initiate a core dump
– Reset or power-cycle the storage system
– Reboot the storage system
– Send system-down notification

The RLM card is supported by the NetApp VTL,

SA-Series, V-Series, FAS3000, FAS3100, and
FAS6000 series

© 2008 NetApp. All rights reserved. 6

© 2008 NetApp. All rights reserved. Page 3

 Accessing the Appliance and the RLM

Local Storage System Remote

Admin Host RLM’s IP: xx.xx.xx.xx Admin Host

COM1 Serial Console

Data ONTAP CLI

LAN Ethernet RLM CLI (SSH)

Network

Serial Port Settings

Direct access through the serial console

– Use the Data ONTAP CLI to administer the
storage system

Remote access through an Ethernet
connection using SSH
– Use the RLM CLI to monitor and troubleshoot
the storage system

© 2008 NetApp. All rights reserved.

Login to the RLM System Console

1. From a UNIX® or Windows® administration

host, connect to the RLM console (SSH
required)
2. At the login prompt, enter the naroot user
account and the associated password
3. To access the system console, enter the
following command:
RLM NetApp> system console
4. Enter the login parameters for the root
account or for alternative administrative user
account
© 2008 NetApp. All rights reserved.

© 2008 NetApp. All rights reserved. Page 4

 Troubleshooting the Appliance with the RLM

Issue You want to… RLM’s CLI Commands

The system is not Access the storage system console system console
responding properly

An AutoSupport® Display what has occurred at the system log

message reports that a system console
hardware component
failed or the system has Display all events, starting with events log
panicked and is down more recent

The system is hanging Dump the system core and reboot system core
the system

The system firmware is Boot using the backup copy of the system reset backup
corrupted system firmware

© 2008 NetApp. All rights reserved. 9

Data ONTAP RLM Commands

Data ONTAP Commands Description

rlm help Displays the list of rlm commands available with

the current release of Data ONTAP.

rlm reboot Reboots the RLM and causes the RLM to perform
a self-test. Any console connection through the
RLM is lost.

rlm setup Initiates the interactive RLM setup program.

rlm status Displays the current status of the RLM.

rlm test autosupport Sends a test e-mail to all recipients specified with
the autosupport.to option.

rlm update Updates the RLM firmware.

© 2008 NetApp. All rights reserved. 10

© 2008 NetApp. All rights reserved. Page 5

 Module Review

The console port on NetApp appliances can be

either a DB9 or RJ45 connector (true or false?)
– True

Which parity value do you have to set to establish
a serial connection?
– None

What is required to access the RLM?
– An SSH-enabled IP-based emulator

Which account would you enter to access the RLM
with administrator privileges?
– naroot

© 2008 NetApp. All rights reserved. 11

© 2008 NetApp. All rights reserved. Page 6

 Parts Identification
and Replacement

ASE-1 Hardware Maintenance and

Troubleshooting

Objectives

At the end of this module, you will be able to:

Differentiate NetApp appliances

List the storage systems FRUs, hot swappable
components, and connectivity ports

List the NetCache appliances FRUs and hot
swappable components

List the storage shelves replaceable components

Identify, remove and replace parts

© 2008 NetApp. All rights reserved. 2

© 2008 NetApp. All rights reserved. Page 1

 Systems Differentiation

Product families often use the same chassis

and motherboard and looks similar from the
exterior

Differentiation between systems within the
families
– Number of CPUs and CPU speed
– System memory
– NVRAM size
– Number of PCI slots

© 2008 NetApp. All rights reserved. 3

Systems Differentiation (cont’d)

Integrated systems refer to two

nodes (heads) and disks installed
FAS270A integrated system
in the same enclosure
– E.g. FAS270A

FAS2020A and FAS2050A are
also integrated system,
FAS2020A integrated system
supporting dual nodes with disks
installed in the system enclosure

The FAS3100 series is a modular
system with two nodes installed
in one enclosure sharing power,
FAS3100 series modular system without internal disks

© 2008 NetApp. All rights reserved.

© 2008 NetApp. All rights reserved. Page 2

 Replaceable Parts

Storage appliances and disk shelves have

redundant components to ensure high
availability

Storage appliance hot swappable components
– Fans
– Power supplies

Storage shelf hot swappable components
– Disks
– Power supplies and fans
– Shelf module if the shelf is multi-pathed

© 2008 NetApp. All rights reserved. 5

S300 FRUs

Hot swappable components

– Disks and disk carriers

Cold swappable components
– LCM module
– Power module
– CPU module
– Backplane module
– Chassis

© 2008 NetApp. All rights reserved. 6

© 2008 NetApp. All rights reserved. Page 3

 S300 Front View

LCM
module

4U
Disk carrier

8 integrated SATA disk drives

© 2008 NetApp. All rights reserved. 7

S300 Rear View

CompactFlash card 4x GbE Cu Console port

Controller
SCSI card module

Power supply
module

© 2008 NetApp. All rights reserved. 8

© 2008 NetApp. All rights reserved. Page 4

 S300 Accessing Internal Components

To access internal
components:
– Unlock the key
lock located on the
side of the unit
– Press the two
release buttons to
release the top
cover
– Remove the cover

© 2008 NetApp. All rights reserved. 9

S300 Accessing Disks and LCM Module

The Drives Locked

tag shows that the
disks cannot be
accessed

To access the disks
and the LCM module:
1. Pull upwards the disk
lock
2. Remove the disk lock

© 2008 NetApp. All rights reserved. 10

© 2008 NetApp. All rights reserved. Page 5

 S550 FRUs

Hot swappable components

– Disks
– Power supplies

Cold swappable components
– Fan assembly
– RTC battery
– NVRAM card and battery
– SCSI and FCP cards
– CompactFlash card

© 2008 NetApp. All rights reserved. 11

S550 Front View

12 integrated SATA disk drives

2U

Identification LED
Power LED
PSU-1 Status indicator
Power button Network e0a
Identification button PSU-2
Network e0b

© 2008 NetApp. All rights reserved. 12

© 2008 NetApp. All rights reserved. Page 6

 S550 Rear View
PSU-1 Thumbscrew Optional SCSI port PSU-2

Console port Not used

2x GbE Cu ports: NVRAM card:

Both green: the port
Green: status is
has power and a link is normal
established
Yellow: a fault has

One green: the port has been detected
power, but no link is
established e0a

e0b

© 2008 NetApp. All rights reserved. 13

F700, F800, NetCache and NearStore

Hot swappable components

– Fans
– Power Supplies
F700, C700
Cold swappable components
– Motherboard
– Memory DIMMs
– PCI cards
F820/F840, – Floppy drive (when applicable)
C3100, C6100
– CompactFlash in F825 and F880
– LCD module

Components installed on the
motherboard are not hot swappable
F825/F880, R100

© 2008 NetApp. All rights reserved. 14

© 2008 NetApp. All rights reserved. Page 7

 F700 Components
Fans 3-4

Front w/o bezel

Fans 1-2 Fans 5-6

LCD

Floppy drive

Rear
System serial
number

SCSI
differential

PSU-1 PSU-2

© 2008 NetApp. All rights reserved.

F800 Components
Fans 3-4

Front w/o bezel

Fans 1-2 Fans 5-6

LCD

Floppy drive or
CompactFlash
(F825 and F880)
Rear
System serial
number

PSU-1 PSU-2

© 2008 NetApp. All rights reserved.

© 2008 NetApp. All rights reserved. Page 8

 F900, NetCache and NearStore

Hot swappable components

– Fans
– Power Supplies

Cold swappable components
– Motherboard
F900, C6200/C6300 – Memory DIMMs
– NVRAM DIMMs
– CompactFlash
– RTC battery
– PCI/RCM/NVRAM5-6 cards
– LCD module
R150/R200

Components installed on the
motherboard are not hot swappable
© 2008 NetApp. All rights reserved. 17

F900 Components Fan-2

Front w/o bezel

Fan-3
6U
Fan-1

LCD
CompactFlash

Rear

PSU-1 PSU-2
System serial number
(facing up on flange)

© 2008 NetApp. All rights reserved. 18

© 2008 NetApp. All rights reserved. Page 9

 FAS200 Series

Hot swappable components

– Disk drives (disk ownership must be
assigned for FAS270A)
– Power supplies/fan assemblies
FAS250, FAS270,
FAS270A – CPU module (FAS270A only)

Cold swappable components
– CPU module (FAS250, FAS270)
– Memory DIMMs
– NVRAM DIMMs and battery
– CompactFlash

Front bezel identifies the system as an
integrated appliance (CPU within a
shelf)
© 2008 NetApp. All rights reserved. 19

FAS200 Components
DS14Mk2 integrated (1Gbps only)

3U
Front

CPU Module A

Rear
FAS270A

PSU-1 CPU Module B PSU-2

2 fans per PSU 2 fans per PSU

© 2008 NetApp. All rights reserved. 20

© 2008 NetApp. All rights reserved. Page 10

 FAS200 CPU Modules

FAS250 and FAS270 supports one CPU module in slot B

FAS270A supports 1 CPU module in slot A and one CPU
module in slot B

The system serial number is on the CPU module

FAS250 FAS270 FAS270A

Not terminate switch, no support No terminate switch, support 1 Small FC AL terminal switch,
for external shelves external shelf supports 1 external shelf per CPU
module

Blank filler in slot A Blank filler in slot A

© 2008 NetApp. All rights reserved. 21

FAS200 Connectivity
FAS250 CPU Module FAS270 1st generation CPU Module

FC (Cu) 2x GbE Cu Console port FC (Op) FC (Cu) Terminate 2x GbE Console port
for tape or for tape for shelf
host
switch Cu
or host expansion

FAS270 2nd generation

CPU Module
Optical SFP
connectors
Terminate switch

© 2008 NetApp. All rights reserved. 22

© 2008 NetApp. All rights reserved. Page 11

 FAS200 CompactFlash

When replacing the CPU module, move the
CompactFlash card from the old node to the new one
– The CF card holds the kernel, diagnostics, and
system firmware
– The replacement CPU module holds a blank CF
card

After replacing a CPU module on a FAS270A, disks
must be reassigned from the old system id to the
new one

CPU
Module

© 2008 NetApp. All rights reserved. 23

FAS2000 Series

Hot swappable components

– Disk drives
– Power supplies/fan assemblies
FAS2020
– Processor controller module or
PCM (FAS2020A, FAS2050A)

Cold swappable components
– PCM (FAS2020, FAS2050)
– Memory DIMMs
– NVRAM battery
– CompactFlash
FAS2050 – PCI cards

© 2008 NetApp. All rights reserved. 24

© 2008 NetApp. All rights reserved. Page 12

 FAS2020 Components
12 SAS disks
Drive bay numbering left to right System LEDs
Front w/o bezel

0 1 2 3 Power

4 5 6 7 Fault

PCM A
8 9 10 11
PCM B

Rear PCM A (active-active configuration)

2U

PSU-1 PCM B (single controller) PSU-2

© 2008 NetApp. All rights reserved. 25

FAS2020 Connectivity and Labels

WWN System serial number MAC ID

2x FC 4Gb SFP ports Console port 2x GbE

Hot swap touch point Remote System fault LED

Management
On-board BMC

© 2008 NetApp. All rights reserved. 26

© 2008 NetApp. All rights reserved. Page 13

 FAS2050 Components
20 SAS disks System LEDs
Front w/o bezel

4U

HDD filler plate: drive bays 20-23 are not used

Drive bay numbering

left to right PCM A (active-active configuration)

Rear

PSU-1 PSU-2

PCM B (single controller)

© 2008 NetApp. All rights reserved. 27

FAS2050 Connectivity and Labels

Hot swap touch point System serial number PCIe expansion slot

2-minutes warning label!

NMI Console
2x FC 4Gb SFP ports port Remote 2x GbE
button Management
On-board BMC

© 2008 NetApp. All rights reserved. 28

© 2008 NetApp. All rights reserved. Page 14

 FAS3000, SA-Series, NetCache, and VTL

Hot swappable components

– Fans
– Power supplies
– LCD module
FAS3000, C2300\C3300
VTL300/VTL700/VTL1400

Cold swappable components
– Motherboard assembly
– Memory DIMMs/Riser
– NVRAM5/NVRAM6 card
– RTC battery
– CompactFlash
– PCI and RLM cards

© 2008 NetApp. All rights reserved. 29

FAS3000 Components
Fan-1 Fan-2
Front w/o bezel

System
3U
serial
number

LCD module
Rear

Motherboard
assembly

PSU-1 PSU-2

© 2008 NetApp. All rights reserved. 30

© 2008 NetApp. All rights reserved. Page 15

 FAS3000 Connectivity
NVRAM5/NVRAM6 Cluster Interconnect Combination Card:
Top left slot if not clustered Top right slot if clustered

4x PCI
slots

Console 2x FC 2x GbE 2x GbE 2x FC

Port 0a,0b e0a,e0b e0c,e0d 0c,0d

Remote Management

© 2008 NetApp. All rights reserved. 31

FAS3100 Series

Hot swappable components

– Fans
– Power supplies
– Controller module (active-active
configuration only)
FAS3100

Cold swappable components
– Controller module (stand alone
system)
– Memory DIMMs/Riser
– NVRAM7 DIMM and battery
– RTC battery
– CompactFlash
– PCI and RLM cards

© 2008 NetApp. All rights reserved. 32

© 2008 NetApp. All rights reserved. Page 16

 FAS3100 Series Front View w/o Bezel

Two separate cooling compartments for the two controllers

Each controller has three fans
Fan fault LEDs Cam handle with tab release

Fan-A1 Fan-A2 Fan-A3

Controller A
fans

6U
Fan-B1 Fan-B2 Fan-B3
Controller B
fans

System LEDs

© 2008 NetApp. All rights reserved. 33

FAS3100 Series Rear View

Controller Module A (single controller configuration)

4 PCIe
PSU-1 adapter
slots

4 PCIe
adapter
PSU-2 slots

Controller Module B (active-active configuration only)

© 2008 NetApp. All rights reserved. 34

© 2008 NetApp. All rights reserved. Page 17

 FAS3100 Series Labels

MAC WWN
System serial
number

© 2008 NetApp. All rights reserved. 35

FAS3100 Series Connectivity

Two RJ-45 10/100/1000 NMI switch System fault LED

GbE ports

Console port RLM port Two FC 1/2/4Gb

9600 HBAs dual ports
8/N/1 Serial

© 2008 NetApp. All rights reserved. 36

© 2008 NetApp. All rights reserved. Page 18

 FAS6000 Series

Hot swappable components
– Fans
– Power supplies

Cold swappable components
– Motherboard tray
– Fibre Channel tray
– Memory DIMMs
FAS6000 Series
– NVRAM DIMMs
– NVRAM6 card and battery
– RTC battery
– CompactFlash, PCI, and RLM cards
– LCD module

Components installed on the
motherboard tray are not hot
swappable

© 2008 NetApp. All rights reserved. 37

FAS6000 Series Front View w/o Bezel

LCD module Fan-2

Fan-1

6U

Fan-3

Fan-4 Fan-5
Even with system power off, LED will keep blinking to identify the failed component

© 2008 NetApp. All rights reserved. 38

© 2008 NetApp. All rights reserved. Page 19

 FAS6000 Series Rear View

System serial number NVRAM6 Motherboard tray PCI slots 0-9

PSU-1 PSU-2
6x GbE e0a…e0f

RLM Console
port

Fibre Channel tray 8x SFP ports 0a….0h

© 2008 NetApp. All rights reserved. 39

NetCache C1100/C1105

C1100 C1105
Floppy drive 1
Max. Internal disk 1x 9GB SCSI 1x 18GB, or 36GB, or 72GB
SCSI
Processor 1x Intel Celeron 433MHz
System memory 256MB 512MB
Console 1x DB9 serial port (rear)
Diagnostic port 1x DB9 port (under the bezel)
Ethernet build-in ports 2x 10/100BaseT
PCI slot 0
FRUs No replaceable components. The entire system is a FRU.

© 2008 NetApp. All rights reserved. 40

© 2008 NetApp. All rights reserved. Page 20

 C1100/C1105 Components

Front w/o bezel Floppy drive Diagnostic port

System serial number

(facing up on flange)

Rear Keyboard and mouse (unused)

1U

Power supply 2x 10/100BaseT Console port External SCSI port (unused)

© 2008 NetApp. All rights reserved. 41

NetCache C1200/C1300

C1200 C1300
Max. Internal disk 3x 36GB or 72GB SCSI 3x 100GB SATA
Processor 1x 1.26GHz Pentium III 1x 2.93GHz Intel Celeron D
System memory 512MB 1GB
Compact Flash 32MB 256MB
Console 1x RJ45 serial port 1x DB9 serial port
Build-in Ethernet ports 1x 10/100BaseT 2x GbE
PCI slot 1x full height (CompactFlash) + 1x No add-on PCI slot/card
low profile (optional GbE PCI slot
copper/fiber)
Hot-swappable FRUs None
FRUs Disk, power supply, chassis (x5) fans Disk, power supply, PCI fan, CPU
block, memory DIMMs, PCI and fan, memory DIMMs,
CompactFlash cards CompactFlash

© 2008 NetApp. All rights reserved. 42

© 2008 NetApp. All rights reserved. Page 21

 C1300 Components

Front w/o bezel

Rear

1U

© 2008 NetApp. All rights reserved. 43

NetCache C2100 FRUs

Hot-swappable components
– Power supplies (one at a time)
– Disks

disk swap command required for
each disk removal and insertion

Cold swappable components
C2100 – Fan assemblies

Chassis fans (x3) block

CPU heatsink fan

Power supply fan
– Motherboard
– Optional GbE cards (fiber/copper)
– NVRAM4 card
– Memory DIMMs
– CompactFlash (256MB)

© 2008 NetApp. All rights reserved. 44

© 2008 NetApp. All rights reserved. Page 22

 C2100 Components

7x SCSI disk drives (36GB or 72GB) Display panel

Front w/o bezel

2U

3x PCI full height expansion slots 3x PCI low profile expansion slots

Rear

System serial
2x 10/100baseT ports RJ45 Console port number PSU-1 PSU-2

© 2008 NetApp. All rights reserved. 45

DS14 Family Storage Shelves FRUs

Hot swappable components

– Disks (one at a time)
– Power supplies (2 fans in each)
– ESH module if multi-pathed or in
an A/A configuration

Cold swappable components
– More than one disk drive at a time

© 2008 NetApp. All rights reserved. 46

© 2008 NetApp. All rights reserved. Page 23

 DS14 Family Models

DS14 DS14Mk2 DS14Mk4 DS14Mk2-AT

Max. Disks 14x FC 14x FC 14x FC 14x SATA
Longer shelf than FC
version
Interface LRC, ESH, ESH2 LRC, ESH, ESH2, ESH2, ESH4 AT-FC, AT-FC2, AT-
module ESH4 FCX
Interface 1Gbps FC 2Gbps FC 4Gbps FC 2Gbps FC
type
Switch No switch (1Gb only) 1-2Gb 1-2-4Gb No switch (2Gb only)
FRUs Disks, power supplies, shelf module

© 2008 NetApp. All rights reserved. 47

DS14 Family Front View

2U

14 disk drives

Name stencil and shelf type (FC shown)

Power LED

Fault LED

Loop A Activity

Loop B Activity

System LED

Shelf ID

© 2008 NetApp. All rights reserved. 48

© 2008 NetApp. All rights reserved. Page 24

 DS14 Family Rear View

PSU-1 with 2 fans Module A (LRC shown) PSU-2 with 2 fans

Power LEDs Module B (LRC shown) Power LEDs

© 2008 NetApp. All rights reserved.

DS14 Family Shelf ID and Switches

Mk1: 1Gbps loop speed only (no switch)

Shelf ID
selector Mute switch

Mk2: 1-2Gbps switch

Shelf ID
selector

Mute switch

1-2Gb switch

© 2008 NetApp. All rights reserved. 50

© 2008 NetApp. All rights reserved. Page 25

 FC7/8/9 Legacy Storage Shelves FRUs

Hot swappable components

– Disks (one at a time)
– Fans
– Power supplies
FC7 and FC8

Cold swappable components
– LRC module
– EDM module (FC7 and FC8)
– VEM module (FC9)
– More than one disk drive at a
FC9 time

© 2008 NetApp. All rights reserved.

FC7/FC8 Components

Front

2U

PSU-1 PSU-2 7x FC disks

LRC module A

Rear

EMD module

Fan-1 LRC module B Fan-2

© 2008 NetApp. All rights reserved. 52

© 2008 NetApp. All rights reserved. Page 26

 FC9 Components
Front

2U

PSU-1 PSU-2 7x FC disks

LRC module A VEM module LRC module B

Rear

Fan-1 Fan-2 Fan-3

© 2008 NetApp. All rights reserved. 53

R100/R150 Legacy Storage Shelves FRUs

Hot swappable components

– Disks

disk swap command required
for each disk removal and
insertion
R100/R150 – Power supplies
LVD SCSI driven,
active backplane, – Fans
12 ATA disks

Cold swappable components
– AT-FC module
– More than one disk at a time

© 2008 NetApp. All rights reserved. 54

© 2008 NetApp. All rights reserved. Page 27

 R100/R150 Shelf Components

Front

12x ATA disks

Shelf ID fixed at 0 3U
No daisy chained

PSU-1 PSU-2
Fan-1 Fan-2

Rear

SCSI LVD
connector

AT-FC
module

© 2008 NetApp. All rights reserved. 55

Module Review

On a FAS200 series appliance, where is the system

serial number located?
– On the CPU module

How long do you have to re-assemble a controller
module on FAS2050A appliances?
– 2 minutes

On a FAS6000 appliance, which components are hot
swappable?
– The power supplies and the fans

Which components of a FC7, FC8, and FC9 shelves
can be hot-swapped?
– The fans, the power supplies, and the disk drives (one at
a time)

© 2008 NetApp. All rights reserved.

© 2008 NetApp. All rights reserved. Page 28

 ASE-1 Exercise
Parts Identification
and Replacement

© 2008 NetApp. All rights reserved. 57

Objectives

At the end of this exercise, you will be able to:

Connect to a FAS storage system

Initiate a console session

Log on and view console messages

Analyze system console and LCD messages

Identify, remove, and replace a power supply in a
storage system

Identify, remove, and replace a power supply in a
DS14 family disk shelf

© 2008 NetApp. All rights reserved. 58

© 2008 NetApp. All rights reserved. Page 29

 FC Loop ID and
Cables Type

ASE-1 Hardware Maintenance and

Troubleshooting

Objectives

At the end of this module, you will be able to:

Identify a loop ID from the FC HBA card and slot
location

Describe shelf ID, disk bay numbering and disk ID

Distinguish between the various storage shelf
modules and cable connector types

Perform proper head-to-shelf and shelf-to-shelf
cabling and shelf termination

© 2008 NetApp. All rights reserved. 2

© 2008 NetApp. All rights reserved. Page 1

 Fibre Channel HA Loop ID

<HA.ID> is a combination of FC loop_id and SCSI

device_id represented as:

loop_id.device_id
– loop_id refers to the FC host adapter number
– device_id refers to the loop or SCSI ID number
of the disk

Example 3a.18

Loop ID Device ID

© 2008 NetApp. All rights reserved. 3

Loop ID Example

In this example, loop_id is 3a

– It is the host adapter location Port a
PCI slot 3, port a PCI slot 3

Port 1 (top) = a

Port 2 (bottom) = b

Example, FAS3000 series: 3a

PCI 1 PCI 3

PCI 2 PCI 4

© 2008 NetApp. All rights reserved. 4

© 2008 NetApp. All rights reserved. Page 2

 Shelf ID Numbering

Each disk shelf within a FC-

AL loop requires a unique
ID, beginning typically with
shelf ID 1
– The remaining shelf IDs
should be set in ascending
order (2, 3, 4, etc.)
– Sequential numbering is not
required

The shelf ID LED should match the label!

For FC7,8,9 shelves, compare switch setting on rear to sticker number.

© 2008 NetApp. All rights reserved. 5

Disk Bay Numbering

Bays are numbered from right to left starting at

0 in all shelves with vertically mounted disks
– FC7/8/9, DS14 family, and R100/R150 ATA
shelves

Bays are numbered from left to right starting at
0 in the integrated systems, such as the
FAS2000 series, with horizontally mounted
disks

© 2008 NetApp. All rights reserved.

© 2008 NetApp. All rights reserved. Page 3

 Disk Bay Numbering (cont’d)

On the S300 appliance,

bays are numbered from
the bottom right to the left
starting at 0 7 6

– Disks are mounted 5 4

horizontally 3 2

1 0

On the S550 appliance,
bays are numbered from left
top to bottom, starting at 0
– Disks are mounted
horizontally
– Decal on top cover shows
disks position

© 2008 NetApp. All rights reserved.

Disk Drive ID Numbering

Disks are numbered in all

storage shelves and
integrated storage systems
– Use the sysconfig –r or
vol status –r commands
to display the disk ID

Methods to identify disk ID:
– Use the Disk Replacement
Action Plan (Net2 tool) The Cheat sheet on the front of the DS14 family
shelves provides all valid disk IDs along with
– Use the cheat sheet if LEDs used for troubleshooting
available

© 2008 NetApp. All rights reserved. 8

© 2008 NetApp. All rights reserved. Page 4

 Disk Drive ID Numbering (cont’d)

On storage shelves with SAS disk drives, use the Data

ONTAP sasadmin shelf command to display a
logical view of the disks layout
– E.g. FAS2000 series integrated system

© 2008 NetApp. All rights reserved. 9

Disk Drive ID Numbering (cont’d)

You can compute the disk ID # based on the

shelf ID # and the disk bay #:
– FC7, FC8, and FC9

Disk ID # = (shelf # x 8) + bay #

Example: shelf 2, bay 6 = disk ID 22
– DS14 Family

Disk ID # = (shelf # x 16) + bay #

Example: shelf 2, bay 6 = disk ID 38

© 2008 NetApp. All rights reserved.

© 2008 NetApp. All rights reserved. Page 5

 DS14 Family Disk Layout

Shelf ID range 1 to 7 Example Disk #

– Any other ID 0, 8, 9 defaults to 7

Drive bays 0 and 1 must be Shelf 5, Bay 10 90
populated with disks to support Shelf 1, Bay 3 19
SES

Loop ID for shelf 1 starts at 16 Shelf 2, Bay 13 ?
45

© 2008 NetApp. All rights reserved. 11

FC7/8/9 Disk Layout

P P 6 5 4 3 2 1 0 P P 6 5 4 3 2 1 0
S S S S

Example Disk #

Shelf ID range from 0 to 7
Shelf 4, Bay 6 38

Drive bays 3 and 4 must be
populated with disks to Shelf 1, Bay 2 10
support SES 0c.53 Shelf 6,?Bay 5;
FC Loop originates on

Loop ID for shelf 0 starts at 0 motherboard port 0c

© 2008 NetApp. All rights reserved. 12

© 2008 NetApp. All rights reserved. Page 6

 R100/R150 Disk Layout

SCSI ID’s 4, 5, and 6 are for Example Disk #

ASICs on the backplane to
convert the SCSI protocol to Shelf 0, Bay 2 2
ATA for the disks Shelf 0, Bay 11 15
– Each ASIC controls 4 drives
7b.8 ?
Shelf 0, Bay 4;

SCSI ID 7 is assigned to the FC Loop originates at
host adapter PCI slot 7 port b

© 2008 NetApp. All rights reserved. 13

Storage Shelf Interface Module

Storage shelves support three distinct types of

interface module
– Loop Resiliency Circuit or LRC
– Electronically Switched Hub or ESH
– SATA conversion module or AT-FC

Each interface module has specific connectors
that require proper cables for establishing
head-to-shelf and shelf-to-shelf links

© 2008 NetApp. All rights reserved. 14

© 2008 NetApp. All rights reserved. Page 7

 Head to Shelf Cables

LC to LC (P/N: X6524-R6)
SC to LC

Optical SFP module or GBIC

BNL: 2Gb P/N X6529A
SC to SC BNV: 4Gb P/N X6539-R6-C

© 2008 NetApp. All rights reserved.

Shelf to Shelf Cables

HSSDC2 to HSSDC2 SFP to SFP

P/N: X6526A P/N: X6530-R6
ESH>EHS and AT-FC>AT-FC ESH2>ESH2, ESH4>ESH4
AT-FC2>AT-FC2 and AT-FCX>AT-FCX

HSSDC2 to SFP DB9 to DB9

P/N: X6531-R6 P/N: 112-01838, 02115
ESH>ESH2 and ESH>ESH4 LRC modules

© 2008 NetApp. All rights reserved. 16

© 2008 NetApp. All rights reserved. Page 8

 LRC and ESH Overview

LRC: classic arbitrated loop ESH: loop of switched hubs

LRC LRC ESH ESH

d1 d7 d8 d14

d2 d6 d9 d13
d1 d2 d3 d4 d5 d6 d7 d14 d13 d12 d11 d10 d9 d8
d3 d5 d10 d12

d4 d11

To next shelf To next shelf

Disks directly connected to loop; it is

possible for one failing device to take Disks point to point connected to
the whole loop down. LRC is also ESH; no one drive can take down the
subject to a flakey drive hanging the entire loop.
FCAL loop!

© 2008 NetApp. All rights reserved. 17

Shelf Modules Support Matrix

LRC and ESH module types are used in storage shelves
supporting FC disks

AT-FC modules are used in storage shelves supporting SATA
disks

Module FC7/8/9 DS14 DS14Mk2 DS14Mk4 DS14Mk2-AT R100/R150

LRC



ESH



ESH2




ESH4


AT-FC


AT-FC2


AT-FCX

© 2008 NetApp. All rights reserved.

© 2008 NetApp. All rights reserved. Page 9

 Shelf Modules Mixing Rules

Only one type of I/O module can exist within a

single shelf

You cannot mix LRC and ESH on the same loop

ESH2/ESH4 mixed with ESH
– The loop operates at 2Gbps if all shelves are
DS14Mk2-FC/DS14Mk4-FC with the loop speed set
to 2Gbps, otherwise the loop will operate at 1Gbps

AT-FC, AT-FC2, and AT-FCX modules can be
mixed in the same loop but the storage system
must also support the modules

© 2008 NetApp. All rights reserved. 19

LRC Identification and Connections

SC optical input on the 1st shelf for connection to
storage system

LRC module does not
have name plate

Limited to maximum
56 drives per loop
– Max. 8x FC7/8/9 or
DB9 to DB9 copper cable for LRC to LRC connection
max. 4x DS14 or
DS14Mk2

1Gbps Fibre Channel
interface only

Terminate switch

© 2008 NetApp. All rights reserved. 20

© 2008 NetApp. All rights reserved. Page 10

 ESH Identification and Connections

LC optical input on the 1st shelf for connection to

1Gbps Fibre Channel storage system
interface only
ESH module P/N: X5506A

Limited to maximum 84
drives per loop
– Max. 6x DS14 or
DS14Mk2

P/N X5506A: IN port is LC HSSDC2 to HSSDC2 copper cable for ESH to ESH
optical on the 1st shelf to connection

connect to the head ESH module P/N: X5505A

P/N X5505A: IN and OUT
ports are HSSDC2 copper
for ESH to ESH connection

Terminate switch

© 2008 NetApp. All rights reserved. 21

ESH2 Identification and Connections

IN/OUT ports SFP connectors. IN uses optical 2Gb

1-2Gbps Fibre Channel GBIC (P/N: X6529A) to connect to the head
interface ESH2 module P/N: X5511A

Auto-terminates

Limited to maximum 84
drives per loop (6 shelves x
14 disks)

All connectors are SFP SFP to SFP cable for ESH2 to ESH2 connection

– Require optical GBIC module

– GBICs are not shipped with ESH2 module P/N: X5511A

ESH2 module replacement

part; use the GBICs from old
module and insert them in
the new one
Grey IN/OUT ports plate for latest ESH2 version

© 2008 NetApp. All rights reserved. 22

© 2008 NetApp. All rights reserved. Page 11

 ESH4 Identification and Connections

1-2-4 Gbps Fibre Channel interface

Backward compatible
– Supports 1Gbps and 2Gbps operations

Auto-terminates

IN and OUT ports use SFP connectors
Activity LEDs Fault LED Speed LEDs

ESH4 module P/N: X5512A-R5

IN/OUT SFP
connectors use Serial
optical 4Gb GBIC service
(P/N X6529-R6-C) port

© 2008 NetApp. All rights reserved. 23

AT-FC Identification and Connections

Operates at 2Gbps

Limited to max. 84 disks per loop (6
shelves x 14 disks) AT-FC (P/N X5611A shown)

AT-FC
– P/N X5611A: IN port is LC optical; use to
connect the 1st shelf to the head
– P/N X5610A: IN and OUT ports are
AT-FC2 (P/N X5613A)
HSSDC2 copper for AT-FC to AT-FC
connection

AT-FC2 and AT-FCX both use SFP
optical connectors
AT-FCX (P/N X5612A-R5)
– Require GBIC module (not shipped with
module replacement part)

AT-FCX supports multipathing

AT-FCX (latest version)

© 2008 NetApp. All rights reserved. 24

© 2008 NetApp. All rights reserved. Page 12

 Module Review

In the Fibre Channel HA loop ID <HA.ID>,

what HA and ID refer to?
– HA refers to the FC host adapter number
– ID refers to the SCSI ID number of the disk

Which appliances have disk drives mounted
horizontally?
– S300, S550, and FAS2000 series

Which two commands can you use to display
disks information?
– sysconfig -r
– vol status -r
© 2008 NetApp. All rights reserved.

Module Review (cont’d)

Which command would you use to display a pictorial

representation of storage shelves with SAS disks?
– sasadmin shelf

In a DS14 family shelf, disk SCSI ID for shelf 1 starts
at ___
– 16

In the FC7/8/9 storage shelves, shelf ID range from 0
to 7 (true or false?)
– True

In a R100/150 ATA shelf, which SCSI ID are not used
for disks?
– SCSI ID’s 4, 5, 6, and 7

© 2008 NetApp. All rights reserved.

© 2008 NetApp. All rights reserved. Page 13

 Module Review (cont’d)

What are the three types of interface modules

supported by NetApp storage shelves?
– LRC, ESH, and AT-FC

LRC storage shelf modules support
multipathing (true or false?)
– False

When ESH, ESH2, and ESH4 modules are mixed,
the loop operates at 4Gbps (true or false?)
– False

Which shelf modules have IN and OUT ports
with SFP connectors only?
– ESH2 , ESH4, AT-FC2, and AT-FCX
© 2008 NetApp. All rights reserved. 27

© 2008 NetApp. All rights reserved. Page 14

 Disk Replacement
and Troubleshooting

ASE-1 Hardware Maintenance and

Troubleshooting

Objectives

At the end of this module, you will be able to:

Identify disk types and interpret disk LEDs

Differentiate between hardware and software disk
ownership

Use Data ONTAP commands to display disk
information and assign ownership

Remove and replace a disk

Troubleshoot disk failure

© 2008 NetApp. All rights reserved. 2

© 2008 NetApp. All rights reserved. Page 1

 Supported Disks Types

Disk types supported depend on the storage system

model, the disk shelf type, and the I/O modules
installed in the storage shelf

All FAS systems support mixed ATA and FC shelves
on separate loops

FC Disk ATA/SATA Disk SAS Disk

Capacities 72/144/300/450GB 250/500/750GB, and 1TB 144/300GB

Shelf type DS14, DS14Mk2, DS14Mk2-AT, R100/R150 Internal disks on

DS14Mk4 storage shelves FAS2000 series

Platform FAS200, FAS900, S300 and S550 Internal disks on

FAS3000, FAS3100, R200 and NetApp VTL FAS2000 series
and FAS6000 FAS models that support the
DS14Mk2-AT shelf and AT-
FC/AT-FCX modules

© 2008 NetApp. All rights reserved.

Disk Canister Identification

DS14 (FC) R200 (ATA) R100/R150 (ATA)

Gray Black Black

Activity LED (green)

Fault LED (amber)

FC disk white label = 10k rpm

FC disk grey label = 15k rpm

Disk capacity = 144GB Disk capacity = 274GB

Disk type “F” = Fibre Disk type “A” = ATA

© 2008 NetApp. All rights reserved. 4

© 2008 NetApp. All rights reserved. Page 2

 DS14 Mk1 and Mk2 Disk Canister

The DS14Mk1 disk canister cannot plug into the

DS14Mk2 shelf
DS14 (Mk1) canister ~1/8” narrow slot

Mk2 canister ~1/4” wide slot or universal drive carrier backwards compatible to DS14

© 2008 NetApp. All rights reserved. 5

DS14 Family Shelves Disk LEDs

Disk operating as expected

– Amber Fault LED off (left)
– Green Activity LED blinking (right)

Disk failed by the system
– Solid amber Fault LED (left)
– Solid green Activity LED (right)

Use the Data ONTAP led_on <HA.id> or
blink_on <HA.ID> (priv set advanced)
commands to turn on the fault LED on the disk
specified
– If specifying an adjacent disks, manually turn off

© 2008 NetApp. All rights reserved.

© 2008 NetApp. All rights reserved. Page 3

 R100/R150 ATA Shelves Disk LEDs

Disk operating as expected

– Amber Fault LED off or solid (left)
– Green Activity LED blinking (right)

Disk failed by the system
– Solid amber Fault LED (left)
– Green Activity LED off (right)

© 2008 NetApp. All rights reserved. 7

Disk Ownership

Hardware-based disk ownership

– Membership is determined by the slot position of the
HBA (or onboard port) and which shelf module port
the HBA is connected to

Software-based disk ownership or SDO
– Membership is determined by the storage system
– Configured manually

Based on the disk ID and the system ID

Ownership information is stored on the disk
– Uses persistent reservation to lock disk

© 2008 NetApp. All rights reserved. 8

© 2008 NetApp. All rights reserved. Page 4

 Disk Ownership Types Support Matrix
Hardware-based Software-based
S Family

FAS250

FAS270

FAS900 Series


FAS2000 Series

FAS3020


FAS3040

FAS3050


FAS3070

FAS3100 Series

FAS6000 Series

R200

V Series

GX Systems

© 2008 NetApp. All rights reserved. 9

Determine Disk Ownership Type

When the system uses hardware-based disk

ownership, the last line of the storage show
command output is: SANOWN not enabled

If the disk show command is available, then
software disk ownership in enabled

© 2008 NetApp. All rights reserved. 10

© 2008 NetApp. All rights reserved. Page 5

 Software-Based Disk Ownership

Un-owned or un-assigned disks (new disk,

spare disk, and data disk) are not used by the
system

You need to assign disk when:
– You add disks or disk shelves
– You configure a new storage system and disk
auto assignment is disabled

© 2008 NetApp. All rights reserved. 11

Disk Auto assignment

Assigns un-owned disks to the same system and

pool as all other disks on their loop or stack
– Enabled by default on all appliances that support
only software-based disk ownership

Can be invoke at the command line
disk assign auto

To disable disk auto assignment
options disk.auto_assign off

© 2008 NetApp. All rights reserved. 12

© 2008 NetApp. All rights reserved. Page 6

 Assigning Ownership

disk assign diskname -f -p pool -o ownername -s sysid

To assign disk ID 16 to pool 0, on the local system

systemA, issue the command:
systemA> disk assign 0b.16

To un-assign disk ID 16, use the command:
systemA> disk assign 0b.16 –s unowned –f

In a data migration scenario, you can assign the
disk to another system, by using the command:
systemA> disk assign 0b.16 systemB –f

© 2008 NetApp. All rights reserved. 13

Displaying Ownership

disk show -o hostname -s sysid [-n|-v|-a]

Displays information for disks:
– with matching owner name
– with matching system id – verbose listing of all disks
– not owned by any system – owned by any system

excl4> disk show

DISK OWNER POOL SERIAL NUMBER
---------- ---------------- ----- -------------
0b.16 excl3 (84165664) Pool0 41201783
0b.17 excl3 (84165664) Pool0 41225446
0b.18 excl4 (84165672) Pool0 41225345
0b.27 excl4 (84165672) Pool0 41206389
0b.28 excl3 (84165664) Pool0 41221818
0b.29 excl4 (84165672) Pool0 41225998
NOTE: 8 disks are currently unowned.

© 2008 NetApp. All rights reserved.

© 2008 NetApp. All rights reserved. Page 7

 Reassigning Ownership

disk reassign -n <new_ownername> -d <new_sysid>

Privilege level: advanced

Used on head swap or NVRAM swap
– Ownership of disks is based on the system ID and the
system ID is obtained from NVRAM serial number
– After replacing the head or the NVRAM, the system ID
is changed and ownership must be corrected
– Disks must be reassigned to the new system ID or
new owner hostname

Typical usage
disk reassign –n <new_ownername>

Optionally
disk reassign –d <new_sysid>

© 2008 NetApp. All rights reserved. 15

Displaying Disk Information

Use this command… To display information about…

aggr/vol status Volumes or aggregates list as “reconstructing”; if so, call NGS.
aggr/vol status –f Failed disk(s). If not listed, use aggr (vol) status –r or
fcadmin device_map to locate the failed disk.
aggr/vol status –r All recognized disks: data, parity, spare, failed, and partner disks.

aggr/vol status –s Hot spare disks available in the storage system.

disk show –n Un-owned disks when software disk ownership is in use.

fcadmin device_map Missing (XX) and bypassed (BYP) disks on FC driven shelves.

sasadmin shelf Logical view of the SAS shelf.

The disk ID, shelf, bay, serial number, vendor, model, and
storage show disk
revision level of all disks.
The system serial number and the inventory of the appliance by
sysconfig –v | -a
slot number. Slot 0 is the motherboard.

© 2008 NetApp. All rights reserved. 16

© 2008 NetApp. All rights reserved. Page 8

 Useful Command: vol status

No reconstructs taking place (view Status column)
FAS3070> vol status
Volume State Status Options
vol0 online raid_dp, flex root
vfiler1_root online raid_dp, flex
flexvol online raid_dp, flex
tradvol online raid4, trad

Reconstruction process on volume ‘tradvol’

FAS3070> vol status
Volume State Status Options
vol0 online raid_dp, flex root
ler1_root online raid_dp, flex
flexvol online raid_dp, flex
tradvol online raid4, trad
reconstruct

© 2008 NetApp. All rights reserved.

Useful Command: fcadmin device_map

Lists all SCSI IDs detected for each FC HA loop number on the
first line and then displays them in bay order by shelf number

Displays disk that has either been “bypassed” (BYP) by a shelf
module or has “disappeared” (XX), not responding, from the
system
FAS3070> fcadmin device_map
Loop Map for channel 0a:
Translated Map: Port Count 14
7 125 124 123 121 122 119 117 116 112 115 114 113 120
Shelf mapping:
Shelf 7: 125 124 123 122 121 120 119 BYP 117 116 115 114 113 112
Cannot complete operation on channel 0b; link is DOWN
Loop Map for channel 0c:
Translated Map: Port Count 16
7 110 111 112 113 114 115 116 117 118 119 120 121 123 124 125
Shelf mapping:
Shelf 7: 125 124 123 (XX) 121 120 119 118 117 116 115 114 113 112
Target SES devices on this loop:
Shelf 7: 110 111
Cannot complete operation on channel 0d; link is DOWN

© 2008 NetApp. All rights reserved.

© 2008 NetApp. All rights reserved. Page 9

 Disk Hot Swap Recommendations
Verify the packing slip for the replacement disk is for your dispatch by checking
DO that the order number matches the NetApp case number.
Verify proper node serial number by physical inspection.
DO
For DS14 family shelf: verify the Fault (Amber/Red) LED is ON solid and the

Green Activity LED in ON solid. For a R100/R150 shelf: green is OFF; neither
should blink.

If the Fault LED is NOT lit on the disk for the shelf & bay # in your dispatch,

 make sure you are on the proper FC HA loop. Ask customer to turn on the LED,
or on drives on either side. If you turn LEDs on other disks, they must be
manually turned off (led_off <HA.ID>). Call NGS.
Verify the shelf and bay number of the faulted disk is the same one as listed in
DO your dispatch notes. If not, use the disk replacement laminate to corroborate the
shelf and bay number. Call NGS if you have questions and if different or multiple
failed drives are listed.
Verify NO RAID reconstructs are running before replacing a disk. Look at LCD
DO panel or use the vol status command. No volumes should display
“reconstruct”ing in the “status” column; if so, call NGS.
Check the disk shelf type you are swapping a disk in. If it is a 12-drives shelf
DO labeled R100/R150, special procedures are required.
DO Verify the replacement disk is detected as a “spare” disk and there is no “disk
firmware update required” message displayed.
© 2008 NetApp. All rights reserved.

Disk Hot Swap Recommendations (cont’d)

DO NOT Replace a disk if multiple disks have fault LEDs ON. Call NGS.

DO NOT Ever re-insert a disk that was just pulled out; this may crash the
appliance.
Insert the replacement disk too quickly; DOT needs to recognize
DO NOT the drive removal first. Wait for the console messages that the
drive has been removed or 60 seconds if no message is
displayed.
DO NOT Replace a disk if a raid reconstruction if going on as seen as a
“%” cycling on the LCD panel.

DO NOT Pull out a disk inside a NetCache (Cxxx) appliance without

calling NetApp for the proper disk swap procedure.

DO NOT Pull out a disk in the R100/R150 ATA shelf without issuing the
disk swap command for each disk removal and each disk
insertion.

© 2008 NetApp. All rights reserved.

© 2008 NetApp. All rights reserved. Page 10

 Module Review

You cannot mix ATA and FC shelves on the

same loop (true or false?)
– True

What type of disk supports 1TB capacity?
– ATA/SATA disk

How could you visually differentiate a FC disk
from an ATA or SATA disk?
– FC disks have a gray canister whereas
ATA/SATA disks have a black canister
– The disk type is indicated on the disk label: F =
Fibre and A = ATA

© 2008 NetApp. All rights reserved. 21

Module Review (cont’d)

In a DS14Mk2 FC shelf, a disk with a blinking

green Activity LED, is a failed disk (true or false?)
– False

In a R100/150 ATA shelf, a disk with a green
Activity LED off, is a failed disk (true or false?)
– True

Which commands would you use to turn on the
fault LED on a disk?
– led_on <HA.id>
– blink_on <HA. id>

© 2008 NetApp. All rights reserved.

© 2008 NetApp. All rights reserved. Page 11

 Module Review (cont’d)

Which commands would you use to determine

the disk ownership type used by the system?
– storage show
– disk show

Software disk ownership is based on the ___
__ and the ___ __.
– The disk ID and the system ID

© 2008 NetApp. All rights reserved.

Module Review (cont’d)

When software disk ownership is used, which

un-owned disks are not used by the system?
– New disks, spare disks and data disks

If software disk ownership is used, when do
you have to reassign disk ownership?
– When replacing the NVRAM or the head

© 2008 NetApp. All rights reserved.

© 2008 NetApp. All rights reserved. Page 12

 ASE-1 Exercise
Disk Replacement and
Troubleshooting

© 2008 NetApp. All rights reserved. 25

Objectives

At the end of this exercise, you will be able to:

Identify shelf ID, bay number, and disk ID number

Troubleshoot disk failure by observing the disk
LEDs, console messages and LCD messages
when applicable

Remove and replace a disk in a DS14 family
storage shelf

© 2008 NetApp. All rights reserved. 26

© 2008 NetApp. All rights reserved. Page 13

 Systems Cabling

ASE-1 Hardware Maintenance and

Troubleshooting

Objectives

At the end of this module, you will be able to:

List the redundant and hot swappable components
in integrated and modular systems

Cable a stand-alone storage system with Multipath

Explain the active-active configuration technology
and list the solution’s hardware components

Cable storage systems in an active-active
configuration

List the advantage of the Multipath-HA option in an
active-active configuration

© 2008 NetApp. All rights reserved. 2

© 2008 NetApp. All rights reserved. Page 1

 Redundant and Hot Swappable Components

Integrated systems
– Controller modules (FAS270A,
FAS2020A/FAS2050A)
– Power supplies/fan assemblies
– Disks (disk ownership must be assigned for
FAS270A, FAS2020A/FAS2050A)

Modular systems
– Power supplies and fans

Storage shelves
– Power supplies, fans, and disks (one at a time)
– Shelf module (multipath cabling only)
© 2008 NetApp. All rights reserved. 3

Multipath Cabling

Multipath cabling or dual paths enables you to

create a primary path and a secondary path
from a single storage system to a disk loop
– If the primary path to the disks becomes
unavailable, the secondary path is automatically
used for accessing disks

Requirements
– Data ONTAP 6.2 and later
– Two shelf modules supporting multipath on each
storage shelf

© 2008 NetApp. All rights reserved.

© 2008 NetApp. All rights reserved. Page 2

 Cabling a Stand-alone System with Multipath

Each shelf is driven with 2

FC loops for FC path
redundancy
– FC HA ports 0a and 0b are
paired
– Ports 0c and 0d are also
paired

Cable each shelf using 0a
or 0b with 0c or 0d
– There is no preference
using onboard FC HBAs
Cabling a stand-alone FAS3000
with Multipath

© 2008 NetApp. All rights reserved.

Active/Active Configuration Overview

NetApp A/A configuration protects

Cluster
Interconnect against appliance failure, providing
transparent “automatic” failover

A/A configuration offers
– High Availability using a single
appliance to provide all data
services of the failed appliance
Cluster – Data is consistent using mirrored
Interconnect
NVRAMs through the Cluster
X Interconnect (CI)
– Disk shelves are shared and
should never be powered off
unless being replaced

© 2008 NetApp. All rights reserved. 6

© 2008 NetApp. All rights reserved. Page 3

 A/A Configuration Hardware Components

An A/A configuration requires two nodes to be

connected by either:
– Point-to-point cabling using a cluster
interconnect card
– The backplane in integrated systems such as in
a FAS270A

The FC-AL controllers from each node are
dual attached to a set of storage shelves

When SyncMirror® is not used, storage shelves
are shared, looped to each node using the A
and B shelf modules

© 2008 NetApp. All rights reserved. 7

Cluster Internet Card Support Matrix

CI Card Description Platform

Servernet® Dual parallel copper interconnect F700 series

Troika® Single SC optical interconnect F800 series

JNI InfiniBand® Dual LC optical interconnect FAS900 series

NVRAM5/CI combo Dual copper InfiniBand interconnect FAS900 and FAS3000

series
NVRAM6/CI combo Dual copper InfiniBand interconnect FAS3070 and FAS6000
series
NVRAM7 Cross connected to the partner FAS3100 series (build-
node via a backplane in, not an FRU)

© 2008 NetApp. All rights reserved. 8

© 2008 NetApp. All rights reserved. Page 4

 A/A Configuration Single Path Cabling

Connect both cluster

interconnect cables without
Shelf ID 1
crossing them between node A
Cluster interconnects and node B
– P1 to P1 and P2 to P2

Any FC HA port can be cabled
in any configuration
– Each node owns the disks at the
disk level, not at the shelf level

Cabling the 0a ports from both
nodes to the same shelf is not a
legal configuration without
Shelf ID 1 software disk ownership
enabled
FAS3000 A/A configuration single
path cabling with SDO enabled

© 2008 NetApp. All rights reserved.

Displaying A/A Single Path Storage Configuration

SystemA> storage show disk –p SystemB> storage show disk -p
PRIMARY PORT SECONDARY PORT SHELF BAY PRIMARY PORT SECONDARY PORT SHELF BAY
0a.16 A 1 0 0a.16 B 1 0
0a.17 A 1 1 0a.17 B 1 1
0a.18 A No redundant path 1 2 0a.18 B No redundant path 1 2
0a.19 A 1 3 0a.19 B 1 3
0a.20 A 1 4 0a.20 B 1 4
0a.21 A 1 5 0a.21 B 1 5
0a.22 A 1 6 0a.22 B 1 6
0a.23 A 1 7 0a.23 B 1 7
0a.24 A Port 0a, loop A = 1 8 0a.24 B
Port 0a, loop B = 1 8
0a.25
0a.26
A
A
primary path to 1
1
9
10
0a.25 B failover path to 1 9
0a.26 B 1 10
0a.27 A local shelf ID 1 1 11 0a.27 B partner shelf ID 1 1 11
0a.28 A 1 12 0a.28 B 1 12
0a.29 A 1 13 0a.29 B 1 13
0c.16 B 1 0 0c.16 A 1 0
0c.17 A 1 1
0c.17 B 1 1
0c.18 A 1 2
0c.18 B 1 2
0c.19 A 1 3
0c.19 B 1 3
0c.20 A 1 4
0c.20 B 1 4
0c.21 B Port 0c, loop B = 1 5
0c.21
0c.22
A
A
Port 0c, loop A = 1
1
5
6
0c.22 B 1 6
0c.23 B
failover path to 1 7
0c.23 A primary path to 1 7
0c.24 A 1 8
0c.24 B partner shelf ID 1 1 8
0c.25 A
local shelf ID 1 1 9
0c.25 B 1 9
0c.26 A 1 10
0c.26 B 1 10
0c.27 A 1 11
0c.27 B 1 11
0c.28 A 1 12
0c.28 B 1 12
0c.29 A 1 13
0c.29 B 1 13
© 2008 NetApp. All rights reserved. 10

© 2008 NetApp. All rights reserved. Page 5

 Disadvantages of A/A Single Path Cabling

HBA/Port Secondary
failure path failure

Controller-to-
Failed
shelf cable
takeover!
failure
Cluster
Failover! Error
Shelf module cascading
failure shelf
module
Shelf-to-shelf
cable failure
Downtime!
Primary path Primary path
Failover path Failover path

© 2008 NetApp. All rights reserved. 11

The Multipath-HA Option

Prevents failover from storage issues

– When a storage failure blocks a storage path
(e.g. shelf module failure), the redundant
primary path ensures path availability

Ensures successful takeovers
– When a storage failure blocks a secondary path
during failover, the redundant secondary path
ensures path availability

© 2008 NetApp. All rights reserved. 12

© 2008 NetApp. All rights reserved. Page 6

 Multipath-HA Requirements

Both nodes must be using software-based disk

ownership and have two Fibre Channel ports for each
loop

DS14Mk2 FC or DS14Mk4 FC with ESH2 or ESH4
modules

DS14Mk2 AT with RoHS-compliant AT-FCX modules

Data ONTAP 7.1.1 or 7.2.1 or later

Supported platforms
– FAS900, FAS2000, FAS3000, FAS3100, and FAS6000
series
– V3000 and V6000 series
– FlexCache SA200 and SA300

© 2008 NetApp. All rights reserved. 13

Benefits of the Multipath-HA Option

HBA/Port Secondary
failure path failure

Controller-to- Redundant
shelf cable path is used!
Redundant failure
path is
used! Shelf module Error
failure cascading
shelf
Shelf-to-shelf module
cable failure
Redundant
path is used!

Redundant primary path Redundant primary path

Redundant secondary path Redundant secondary path

© 2008 NetApp. All rights reserved. 14

© 2008 NetApp. All rights reserved. Page 7

 Example: FAS3000 Multipath-HA Cabling
A B 1. Connect Cluster
Interconnect cables

2. Connect inter-shelf
cables (out to in)

3. Connect primary
path from the storage
system to the first
shelves using 0a and
0c

4. Connect failover
path from the storage
system to the first
shelves

5. Connect the
redundant primary
path from the storage
systems

6. Connect the
redundant failover
path from the storage
systems

© 2008 NetApp. All rights reserved.

Multipath-HA vs Single Path Cabling

What is the difference
A B between Multipath-HA
and single path A/A
cabling?

How would you

recognize if a system is
cabled for Multipath-
HA?

In Multipath-HA, there
are FC “return paths”
coming from the last
shelf “out” ports:
• A-0b and B-0d shown
in purple
• A-0d and B-0c shown
in green
In single path cabling,
there is no return path.

With Multipath-HA a
failed shelf module does
not cause a failover!
Both nodes can talk to
the disks thru one shelf
module, reducing
failovers.

© 2008 NetApp. All rights reserved.

© 2008 NetApp. All rights reserved. Page 8

 Loop Failure in Multipath-HA Cabling
A B
Node A owns the disks
in shelf loop A.
Disks in that shelf are
accessed using FC 0a.

The FC optical cable

from node A, port 0a to
shelf module A is
disconnect.

The FC path from node

A to the shelf module A
is open. Normally this
would cause a cluster
failover.

Do you see that node

A’s disks are also
accessible thru FC 0d
on the B loop?

Using the B loop, both

nodes can access their
disks. Node A uses FC
0d, node B uses FC 0b

© 2008 NetApp. All rights reserved. 17

Displaying Multipath-HA Storage Configuration

SystemA> storage show disk -p SystemB> storage show disk -p
PRIMARY PORT SECONDARY PORT SHELF BAY PRIMARY PORT SECONDARY PORT SHELF BAY
0d.16 B 0a.16 A 1 0 0a.16 B 0d.16 A 1 0
0a.17 A 0d.17 B
Port 0a,1 loop 1 0d.17 A 0a.17 B
Port 0a,1
loop 1
0a.18 A 0d.18 B A = primary
1 2 0d.18 A 0a.18 B B = failover
1 2
0d.19 B 0a.19 A path to 1local 3 0a.19 B 0d.19 A path 1to 3
0a.20 A 0d.20 B shelf
1 4 0a.20 B 0d.20 A partner1shelf 4
0a.21 A 0d.21 B 1 5 0d.21 A 0a.21 B 1 5
0d.22 B 0a.22 A
Port 0d,1 loop6 0a.22 B 0d.22 A Port 0d,1 loop 6
0d.23 B 0a.23 A B =1 7 0d.23 A 0a.23 B A =1 7
0a.24 A 0d.24 B redundant
1 8 0a.24 B 0d.24 A redundant
1 8
0a.25 A 0d.25 B primary1path 9 0d.25 A 0a.25 B failover1path 9
0d.26 B 0a.26 A 1 10 0a.26 B 0d.26 A 1 10
0a.27 A 0d.27 B 1 11 0a.27 B 0d.27 A 1 11
0a.28 A 0d.28 B 1 12 0d.28 A 0a.28 B 1 12
0a.29 A 0d.29 B 1 0a.29 B 0d.29 A 1 13
Port 0c, loop B13 Port 0b, loop B
0c.16 B 0b.16 A 1 0 0b.16 B 0c.16 A 1 0
= failover path 0b.17 B 0c.17 A = redundant
1 1
0c.17 B 0b.17 A 1 1
0c.18 B 0b.18 A to partner’s
1 2 0b.18 B 0c.18 A primary path1 to 2
0c.19 B 0b.19 A shelf1 3 0b.19 B 0c.19 A 1
local shelf 3
0b.20 A 0c.20 B 1 4 0c.20 A 0b.20 B 1 4
Port 0b, loop A 0b.21 B 0c.21 A Port 0c, loop
1 A5
0b.21 A 0c.21 B 1 5
0b.22 A 0c.22 B = redundant
1 6 0b.22 B 0c.22 A = primary path 6
1
0c.23 B 0b.23 A failover 1path 7 0b.23 B 0c.23 A to local 1shelf 7
0c.24 B 0b.24 A 1 8 0c.24 A 0b.24 B 1 8
0c.25 B 0b.25 A 1 9 0c.25 A 0b.25 B 1 9
0c.26 B 0b.26 A 1 10 0b.26 B 0c.26 A 1 10
0c.27 B 0b.27 A 1 11 0b.27 B 0c.27 A 1 11
0b.28 A 0c.28 B 1 12 0b.28 B 0c.28 A 1 12
0b.29 A 0c.29 B 1 13 0b.29 B 0c.29 A 1 13
© 2008 NetApp. All rights reserved. 18

© 2008 NetApp. All rights reserved. Page 9

 Module Review

Which components are hot swappable in a stand alone
system?
– The head?
– No
– The motherboard?
– No
– PCI card(s)?
– No
– NVRAM card?
– No

Which components are redundant in integrated
systems in an A/A configuration?
– Controller modules, power supplies/fan assemblies, and
disks

© 2008 NetApp. All rights reserved.

Module Review (cont’d)

In an A/A configuration with single path cabling, which

of the following events will provoke a cluster failover?
– HBA/port failure?
– Yes
– Controller-to-shelf cable failure?
– Yes
– Storage shelf module failure?
– Yes
– Shelf-to-shelf cable failure?
– Yes
– Cluster interconnect cable failure?
– No

© 2008 NetApp. All rights reserved.

© 2008 NetApp. All rights reserved. Page 10

 Module Review (cont’d)

Multipath-HA requires both nodes to use software

disk ownership (true or false?)
– True

Which shelf modules support Multipath-HA?
– ESH2, ESH4, and AT-FCX

In a Multipath-HA configuration, a shelf module
failure causes a cluster failover (true or false?)
– False

How would you recognize if a system is cabled
with Multipath-HA?
– In Multipath-HA, there are FC “return paths” coming
from the last shelf “out” ports
© 2008 NetApp. All rights reserved.

© 2008 NetApp. All rights reserved. Page 11

 Active-Active
Configuration Failover
and Troubleshooting

ASE-1 Hardware Maintenance and

Troubleshooting

Objectives

At the end of this module, you will be able to:

Explain what an active-active configuration does
during normal operation

Explain when a takeover occurs and what it does

Explain when and how to perform a giveback

Identify an active-active configuration status

Manage cluster failover with the cf command

Interpret LCD messages and console prompts

© 2008 NetApp. All rights reserved. 2

© 2008 NetApp. All rights reserved. Page 1

 A/A Configuration Normal Operation

Each node in an A/A configuration operates as an

independent file server
– Each node has it’s own identity, disks, volumes and IP
address

Nodes log their write transactions to both the local and
remote NVRAM using the cluster interconnect

Disk ownership
– When hardware disk ownership is used, all disks in a
shelf are owned by one node or the other
– When software disk ownership is used, disk ownership is
based on the disk ID and the system ID

© 2008 NetApp. All rights reserved. 3

When Takeover Occurs?

When cluster failover or cf is enabled, the

following will cause a takeover:
– Head failure
– halt command
– Powering off a node
– Failed reboot after a panic
– Data ONTAP hangs
– Fiber Channel failure

Multipath-HA prevents this from happening

© 2008 NetApp. All rights reserved. 4

© 2008 NetApp. All rights reserved. Page 2

 When Automatic Takeover is Disabled?

Cluster failover or cf is disabled

The system reboots

An Ethernet link fail, unless special options are set

The cluster interconnect is disconnected, unless
special options are set
– Both nodes are up and servicing clients requests
– After interconnect is reestablished, the nodes
resynchronize their NVRAM logs

A node fails and its storage is also not accessible

© 2008 NetApp. All rights reserved. 5

What Happens During Takeover

The node taking over:

– Assumes the identity of the failed node
– Accesses the failed node’s disks and serves its
data to clients

Existing CIFS sessions are terminated
– A graceful shutdown of the CIFS sessions is not
possible

Some data loss could occur for CIFS users

© 2008 NetApp. All rights reserved. 6

© 2008 NetApp. All rights reserved. Page 3

 When and How Giveback Occurs?

When the problem that triggered the takeover is

solved, to return to normal operation, a giveback must
be performed
– Initiated manually by operator only
– cf giveback is executed from the node that took over
– The node that took over releases the partner node,
which reboots and resumes normal operation

When an enterprise application, such as SQL or email
messaging, is running, giveback must be performed
while the application is in hot backup mode

© 2008 NetApp. All rights reserved. 7

Disabling and Enabling Takeover

Use the cf disable command to disable takeover if you

are doing maintenance that typically causes a takeover
NodeA> cf disable
NodeA> Tue May 24 17:14:06 GMT [NodeA>cf.misc.operatorDisable:warning]:
Cluster monitor: operator initiated disabling of cluster
Tuesday May 24 17:14:06 GMT [NodeA:cf.fsm.takeoverByPartnerDisabled:notice]:
Cluster monitor: takeover of NodeA by NodeB disabled (cluster takeover disabled)

Issue the cf enable command to re-enable takeover after

you finished maintenance
NodeA> cf enable
NodeA> Tue May 24 17:09:49 GMT [NodeA: cf.misc.operatorEnable: warning]:
Cluster monitor: operator initiated enabling of cluster
Tue May 24 17:09:50 GMT [NodeA: cf.fsm.takeoverByPartnerEnabled:notice]: Cluster
monitor: takeover of NodeA by NodeB enabled
Tue May 24 17:09:51 GMT [NodeA: cf.fsm.takeoverOfPartnerEnabled:notice]:
Cluster monitor: takeover of NodeB enabled

© 2008 NetApp. All rights reserved. 8

© 2008 NetApp. All rights reserved. Page 4

 A/A Configuration Mailbox Disks

Mailbox disks keep track of cluster state and are

checked every 3~5 secs

If one node stops functioning, the surviving node uses
the information on the mailbox disks to perform the
takeover
– If the mailbox disks is not available, cluster failover fails

NodeA*> cf monitor all

cf: Current monitor status (24 May 2008
08:07:58):
…
mailbox disks:
Disk 0b.48 is a local mailbox disk
Disk 0b.34 is a partner mailbox disk

© 2008 NetApp. All rights reserved.

Displaying A/A Configuration Status

Use the cf status command to determine

whether the controller failover feature is enabled
and whether the other node is up
NodeA> cf status
Cluster enabled, NodeB is up.

Data ONTAP can disable failover if a software or
hardware problem exists that prevents a
successful takeover
– The message returned from the cf status
command describes the reason why failover is
disabled

© 2008 NetApp. All rights reserved. 10

© 2008 NetApp. All rights reserved. Page 5

 Performing a Takeover

Use cf takeover command to take over

services of the partner
NodeA> cf takeover
cf: takeover initiated by operator
Tue May 24 17:25:51 GMT [NodeA (takeover):
Cluster Notification message posted to NetApp:
From NodeB (REBOOT (CLUSTER TAKEOVER)WARNING
Tue May 24 17:26:00 GMT [NodeB/NodeA: monitor.globalStatus:CRITICAL]:
NodeA has taken over this node.
NetApp: Cluster Notification from NodeA (CLUSTER TAKEOVER COMPLETE
MANUAL
NodeA(takeover)>

The system prompt has changed

© 2008 NetApp. All rights reserved. 11

Performing a Giveback

Use cf giveback command to giveback service to

original node

In a CIFS environment, cf giveback is destructive
and should be scheduled by customer working with
NGS
NodeA(takeover)> cf giveback
NodeA(takeover)> Tue May 24 17:32:43 GMT
[NodeA(takeover): cf.misc.operatorGiveback:info]:
Cluster monitor: giveback initiated by operator
-- CIFS partner server is shutting down...
Tue May 24 17:33:04 GMT [NodeA cf.fsm.takeoverByPartnerEnabled:notice]:
Cluster monitor:
NodeA>

The system prompt is back to normal

© 2008 NetApp. All rights reserved. 12

© 2008 NetApp. All rights reserved. Page 6

 Determine if Nodes Are Clustered

Are shelf modules A and B in storage shelf ID 1
cabled to two different nodes?

For integrated systems, is there a controller
module in both A and B module slots?

View the cf status command output and the
LCD panel (when applicable)
– When cf is enabled, the LCD panel toggles it’s own
hostname, OPS, and the partner hostname
preceded by an asterisk as illustrated in this
example:
SystemA *SystemB Total OPS/second
0 0 0

© 2008 NetApp. All rights reserved. 13

Interpreting LCD Messages

LCP displays… Meaning

SystemA *SystemB Total OPS/second The node SystemA is up and

0 0 0 cluster failover is disabled.
cf disabled! cf disabled! cf disabled!

SystemA *SystemB Total OPS/second The node SystemA is up and

0 0 0 has taking over its partner
cf takeover! cf takeover! cf takeover! SystemB.

Waiting for user Or Waiting for MB The node is ready for servicing
input giveback and is waiting for giveback.

HALTED The node is halted. It can be

powered down and serviced
when instructed.

© 2008 NetApp. All rights reserved. 14

© 2008 NetApp. All rights reserved. Page 7

 Interpreting Console Prompts

To determine the state of a node that does not have a LCD panel,
attach you laptop to the console port and hit <enter> to view what
the console response is

Console prompt is… Meaning

Data ONTAP (SystemA) The node is up and online.
Login:
Data ONTAP (SystemA) The node is up and online.
Password:
Waiting for giveback The node was taken over by its partner. The node is
ready for servicing and is waiting for giveback.
CFE> For the FAS3020, FAS3050, and the FAS200 series, the
firmware prompt is <CFE>. This prompt indicates that
the system is halted and ready for maintenance.
LOADER> For the FAS2000 series, the firmware prompt is
<LOADER>. This prompt indicates that the system is
halted and ready for maintenance.

© 2008 NetApp. All rights reserved. 15

Potential Dispatch Issue

You are dispatched to repair a node that was

taken over by its partner
– The dispatch was created for the system serial
number 1234567
– On that system, LCD displays takeover mode

Failed node
– System serial number is 7654321
– LCD displays waiting for giveback

Dispatch system serial number is of the
surviving node, not the failed node

© 2008 NetApp. All rights reserved. 16

© 2008 NetApp. All rights reserved. Page 8

 Module Review

When cluster failover is enabled, which events will

provoke a takeover?
– Head failure?
– Yes
– halt command?
– Yes
– Powering off a node?
– Yes
– Fiber Channel failure with Multipath-HA?
– No

When a system reboots, it is automatically taking over
by its partner (true or false?)
– False
© 2008 NetApp. All rights reserved. 17

Module Review (cont’d)

How would you determine if a system is part of an A/A

configuration?
– Check if shelf modules A and B in storage shelf ID 1 are
cabled to two different nodes
– For integrated systems, verify if there is a controller
module in both A and B module slots
– Use the cf status command and view the LCD panel

Which command would you use to determine whether
cluster failover is enabled and whether the other node
is up?
– cf status

© 2008 NetApp. All rights reserved.

© 2008 NetApp. All rights reserved. Page 9

 Module Review (cont’d)

Giveback is automatic (true or false)?

– False

A node that is part of an active-active configuration has
failed and is now repaired. What Data ONTAP
command would you issue to return the node to normal
status?
– cf giveback from the partner node that took over

What is the impact of the cf giveback command?
– It may affect certain applications running under CIFS

In an A/A configuration with Multipath-HA, you must
shutdown the node cabled to the shelf module to be
replaced (true or false?)
– False
© 2008 NetApp. All rights reserved.

Module Review (cont’d)

What is the condition of a node when its LCD

displays the following messages:

– The node is up and is part of an A/A configuration.

The node has taking over its partner.

© 2008 NetApp. All rights reserved. 20

© 2008 NetApp. All rights reserved. Page 10

 Module Review (cont’d)

What is the condition of a node when its LCD

displays the following messages:

– The node is part of an A/A configuration and was

taken over by its partner. The node is ready for
servicing and is waiting for giveback.

© 2008 NetApp. All rights reserved. 21

ASE-1 Exercise
A/A Configuration Cabling
and Cluster Failover

© 2008 NetApp. All rights reserved. 22

© 2008 NetApp. All rights reserved. Page 11

 Objectives

At the end of this exercise, you will be able to:

Cable a stand-alone system and systems in an
A/A configuration

Cable multiple paths

Identify partner nodes from the LCD and console
messages

Determine the status of the cluster

Use the cf command to perform takeover and
giveback operations

© 2008 NetApp. All rights reserved. 23

© 2008 NetApp. All rights reserved. Page 12

 Physical Inspection

ASE-1 Hardware Maintenance and

Troubleshooting

Objectives

At the end of this module, you will be able to:

Describe what a physical inspection is

Explain how to access the site inspection form

Perform the physical inspection

Explain how to complete and submit the site
inspection form

© 2008 NetApp. All rights reserved. 2

© 2008 NetApp. All rights reserved. Page 1

 Overview

SupportEdge Premium Service Contracts

– Customer is entitled to a Storage Availability
Audit (SAA) performed on a quarterly basis
– It includes a physical inspection of the
equipment at the site

Tasks assignment
– The physical inspection audit is performed by
TPM NetApp ASE or PSE
– The audit report is compiled and delivered by
PSE

© 2008 NetApp. All rights reserved.

Physical Inspection Process

1. Log on to the NOW site now.netapp.com

2. Click on the link NetApp ASE Corner
– Enter the NetApp case number and hit the Go!
button
3. Click on the link Site Inspection Form
– A checklist form displays showing the system serial
number(s) to be inspected
4. Click on the Export to CSV File link to export the
form
– Resize the columns
– Print the form to take it with you on site

© 2008 NetApp. All rights reserved.

© 2008 NetApp. All rights reserved. Page 2

 Physical Inspection Process (cont’d)
6. You have 5 days to provide NGS with the date that you
have set up with the customer to perform the site
inspection
– The inspection must be completed by the end of the current
month
7. Go to customer site
– Perform the inspection for each listed system serial number,
fill in in the inspection form and any notes
8. If there are scheduling problems or for any other issues, call
NGS
9. To complete the dispatch, again login to the NOW site
– Input the inspection results into the online inspection form by
clicking the radio buttons, adding any applicable notes and
clicking the completed or 1-time decline radio button
– To complete the site inspection dispatch, you must save your
information to the case by clicking the Submit Form button

© 2008 NetApp. All rights reserved.

Accessing the Site Inspection Form

Login to
the NOW site

© 2008 NetApp. All rights reserved. 6

© 2008 NetApp. All rights reserved. Page 3

 Accessing the Site Inspection Form (cont’d)

Click on
NetApp ASE Corner
link (for Partners)

© 2008 NetApp. All rights reserved. 7

Accessing the Form by Case Number

1. Enter the case

number supplied in
the dispatch and
click Go!

2. Click on Site
Inspection Form

Company name blacked out

© 2008 NetApp. All rights reserved. 8

© 2008 NetApp. All rights reserved. Page 4

 Accessing the Form by Case Number (cont’d)

The inspection form

displays.
At the top of the form are
notes for the NetApp
ASE

© 2008 NetApp. All rights reserved. 9

Exporting the CSV File

This is the top half of the inspection form. It lists the serial
number(s) which needs inspection. May have to scroll
right to view all of them

Click on this link to get a

CSV export of the form to
print and take with you

Pink color indicates inspection required,

green color inspection is completed,
white color 1-time decline

© 2008 NetApp. All rights reserved. 10

© 2008 NetApp. All rights reserved. Page 5

 Exporting the CSV File (cont’d)

The Export will

Company name blacked out
launch your
default
spreadsheet.
Notice the
columns are too
narrow to read the
questions.
Expand your
columns to make
it readable

© 2008 NetApp. All rights reserved. 11

CSV File Columns Expanded

Company name blacked out

Print this out to
take with you to
the customer site
to fill out

© 2008 NetApp. All rights reserved. 12

© 2008 NetApp. All rights reserved. Page 6

 Inspection Statuses

Complete Inspection
– Select this when the inspection is completed
– After completing the other radio buttons and entering
your notes, make sure you click the Complete Inspection
radio button and then hit the Submit Form button to save
your changes

1-time decline
– Select this if the customer declines the inspection this
quarter
– Include the reason the customer has declined the
inspection in the notes section
– Check the 1-time Decline radio button and then hit the
Submit Form button to save your changes

© 2008 NetApp. All rights reserved. 13

Completion of the Site Inspection Form

1. Answer all the

Yes/No questions

2. Set the inspection status. If the

customer doesn’t want a system inspected,
select 1-time Decline and include reason in
the notes section

3. Fill in any notes

4. You must click on Submit Form

to SAVE your entries

© 2008 NetApp. All rights reserved. 14

© 2008 NetApp. All rights reserved. Page 7

 Physical Inspection Checklist
Inspection Observations Action to take if the answer is “NO”
Are the disk shelves properly mounted on rails? Enter in notes section; PSE will investigate.
Do all shelf labels match the shelf ID switch/LED? Enter in notes section; PSE will investigate.
Are all disks and power supplies properly seated? Do not seat. Enter in notes section and alert customer.
Are all head unit fans spinning normally? Contact NGS, while on site.
Are the (appliance) fans free of dust? Enter in notes section; vacuum or point out to
customer.
Are all power supply fault lights off? Contact NGS while on site.
Are all power supply LEDs proper? Contact NGS while on site.
Are all power cords securely fastened? Enter in notes section; PSE will investigate.
Is the system properly grounded? Enter in notes section; PSE will investigate.
Are FCAL terminator(s) attached to all open If FCAL terminators are missing, enter in notes
“initiator” ports on a SAN storage system? (not section; PSE will investigate.
required FCP target ports)
Does the system meet proper power Enter in notes section; PSE will investigate.
requirements? No power supplies are sharing the
same power strip?
Does the system have a spares kit? Ask the customer. Enter in notes section.

© 2008 NetApp. All rights reserved.

Are the Storage Shelves Properly Mounted?

Check for 4 screws per shelf

If screws are missing:

• Enter in the notes section
• PSE will investigate further

© 2008 NetApp. All rights reserved. 16

© 2008 NetApp. All rights reserved. Page 8

 Examples of Shelf Rails and Brackets

2 post Telco shelf wing

supports

4 post head and shelf

supports (older style)

EACH disk shelf and storage head should

have it’s own dedicated set of support rails.
If missing:
• Enter in the notes section
• PSE will investigate further

© 2008 NetApp. All rights reserved. 17

Do all Shelf Labels Match the Shelf ID Switch/LED?

The Shelf ID LED should match the label!

For FC7,8,9 shelves, compare switch
setting on rear to sticker number

If label# does not match LED#:

• PEEL IT OFF
• Enter in the notes section
• PSE will investigate further

© 2008 NetApp. All rights reserved. 18

© 2008 NetApp. All rights reserved. Page 9

 Are all Disk and Power Supplies Properly Seated?

These disks are properly seated

These three disks are NOT

properly seated.
This is a lab system, this is not
typical of a customer system

If any disks are not seated:

• DO NOT reseat; they may be unseated for a reason
• Enter in the notes section
• PSE will investigate further

© 2008 NetApp. All rights reserved. 19

Are all Disk and Power Supplies Properly Seated?

(cont’d)

Do NOT touch the power supply

lever on the back of the system.
Observation only!

On the older models, the power

supplies are located next to the If the power supplies are not seated:
disks in the front of the system. • DO NOT reseat; they may be
They are indicated by a Green, unseated for a reason
Gold or Blue bar which would • Enter in the notes section
designate the version of shelf • PSE will investigate further
FC9, FC8 or FC7

© 2008 NetApp. All rights reserved. 20

© 2008 NetApp. All rights reserved. Page 10

 Are all Head and Shelf Fans Spinning Normally?

You want to have all slots filled with a drive or a empty face plate to
preserve proper air flow through the drives and shelf

© 2008 NetApp. All rights reserved. 21

Are the System Fans Free of Dust?

You cannot tell if there is dust on

the fans, because they are
spinning. To check for dust,
remove the bezel from the
FRONT of the system. In this
picture, you can see the dust that
has accumulated on the grill.

If heavy dust is found:

• Vacuum if available or peel off
with hand OR
• Alert customer
NetApp bezels just pull off by pulling from • Enter in the notes section
both sides • PSE will investigate further

© 2008 NetApp. All rights reserved.

© 2008 NetApp. All rights reserved. Page 11

 Are All Power Supply LEDs Proper?

You should observe that

there are lights ON on
the power supply

If all LEDs are off:

• Call NetApp Global Support
• Enter in the notes section

© 2008 NetApp. All rights reserved. 23

Are All Power Cords Securely Fastened?

The power cord is securely

fastened if the clip is in place

Here, the clip is NOT in place.

If cords are not secure:

• DO NOT secure them until you
discuss with the customer as they
may want to perform this task off
hours.
• If the customer approves, go to the
next slide for instructions on
securing the clip.
• If they cannot be secured, make a
note in the inspection form

© 2008 NetApp. All rights reserved. 24

© 2008 NetApp. All rights reserved. Page 12

 Is the System Properly Grounded?

If the system is installed in a NetApp rack, then proper grounding is done with
screws installed in the back of the shelf and head into the cabinet.

These are the grounding screws in the

back of the shelf installed in a NetApp
rack. Observe that the screws are
securely in place.

If grounding screws
are missing:
• Alert customer
• Make a note in the
inspection form
• PSE will
investigate further

© 2008 NetApp. All rights reserved. 25

Is the System Properly Grounded? (cont’d)

These are the grounding straps

going between the shelves.
Observe that they are securely in
place.

If equipment is mounted in a
NetApp cabinet, no external
grounds are required. External
grounds are necessary in customer
cabinets only.
The FAS3000 & FAS6000 series
do not require any external grounds

If grounding straps are missing:

• Enter in notes
• PSE will investigate further

© 2008 NetApp. All rights reserved. 26

© 2008 NetApp. All rights reserved. Page 13

 Is the FCAL Loopback Terminator Properly Attached?

The FCAL loopback connector is not required on cards labeled FCP Target HBAs.
These are used to connect to SAN switches and do not drive disk shelves.

This is a picture of the FCP target.

HBA initiator cards do not have a
sticker.

The FCAL loopback terminator is not

required on this FCP target card.

FC HA cards look similar to Ethernet

cards. Notice FC HA’s have Fibre
Channel stamped on them.

© 2008 NetApp. All rights reserved. 27

Is the FCAL Loopback Terminator Properly Attached?

(cont’d)
If there are SAN switches, Brocade, Cisco, or McData, attached to the head, the
loopback terminator plug is required on FC HBA Initiator cards which storage
shelves and optical tapes.
Notice the FCAL loopback terminator is missing from the FC
HBA Initiator card port B; the green led is not on.

FC initiator HA cards do not have any label on the

them like FCP target cards shown on the previous slide

Here, the FCAL loopback

terminator is correctly in place.
Notice the green led is on

Missing FCAL loopback terminators

from FC initiator cards cause delays
in the system reboot process:
• Enter in notes section
• NetApp PSE will investigate

© 2008 NetApp. All rights reserved.

© 2008 NetApp. All rights reserved. Page 14

 Does the System Meet the Power Requirements?

There is one power cord for

each of the two power
supplies.
Each power cord is required
to be plugged into a separate
circuit.
Follow the cables to verify
the power cords are plugged
into different power strips.

If power is not on separate

circuits:
• Enter in notes
• PSE will investigate further

© 2008 NetApp. All rights reserved. 29

Does the System Have a Spares Kit?

The reason you need to ask the customer if

the system has a spares kit is because the
motherboard in the spares kit can become out
of date (firmware)

Spares kits are optional, not all customer’s
purchased them

© 2008 NetApp. All rights reserved.

© 2008 NetApp. All rights reserved. Page 15

 Documentation and References

View the Physical

Inspection Process
reference document in
the Net2 tool

The Physical
Inspection Process
and the Photos
Essay are also
available at:
http://now.netapp.com/N
OW/cgi-bin/SP/main

© 2008 NetApp. All rights reserved. 31

Module Review

To which NetApp web site do you have to log

on to access the site inspection form?
– http://now.netapp.com

You have to enter the system serial number to
access to the site inspection form (true or
false?)
– False; you have to enter the NetApp case
number

Which action would you perform to launch the
site inspection spreadsheet?
– On the System Inspection Form page, click on
Export to CSV File

© 2008 NetApp. All rights reserved.

© 2008 NetApp. All rights reserved. Page 16

 Module Review (cont’d)

Which inspection status would you select if the

customer declines the inspection this quarter?
– 1-time decline

After completion of the site inspection form,
which final action would you perform to
validate and save your entries?
– You have to click on Submit Form

Where can you find up-to-date information
about the physical inspection process?
– In the Net2 tool

© 2008 NetApp. All rights reserved.

© 2008 NetApp. All rights reserved. Page 17

 Rules of Engagement
and Phone Menu

ASE-1 Hardware Maintenance and

Troubleshooting

Objectives

At the end of this module, you will be able to:

Explain the NetApp process for dispatching TPM
partners

Identify when to contact NGS and the customer

Use the NetApp phone menu system for TPM
engineers

Define when to contact your regional NetApp
Partner Development Manager (PDM)

© 2008 NetApp. All rights reserved. 2

© 2008 NetApp. All rights reserved. Page 1

 Process for Dispatching TPM Partners

TSE creates FSO notification

Customer opened TSE identifies CSR processes
FSO and forwards sent to
a service request problem as HW FSO and FRU
to CSR TPM partner
for a problem failure part dispatch
for processing SLA Starts

FRU part TPM partner

dispatched to acknowledges
customer location receipt of FSO

TPM engineer TPM engineer TPM engineer

FSO reports service TPM engineer and FRU arrive at dispatched to
closed completion replaces FRU customer location customer location
Time Recorded ATA Recorded ETA Recorded

TSE - Technical Support Engineer FRU - Field Replaceable Unit

FSO - Field Support Order SLA - Service Level of Agreement
CSR - Customer Support Representative ETA - Estimated Time of Arrival ATA - Actual Time of Arrival

© 2008 NetApp. All rights reserved.

NGS Rules of Engagement

• You must read the dispatch notes for important Information, like deferred arrival or site access. If the
dispatch is missing details or you need assistance call NGS.

• Parts are travelling in parallel. Meet the SLA, or deferred time set by NGS or the customer. Call NGS for
updated part delivery information if not in your dispatch. Be on time for Deferred Arrivals as it may be a
“scheduled system down maintenance window”. Get there 15 minutes early.

• You have to call customer and then NetApp within 60 minutes of dispatch to provide an ETA. Even if it’s a
deferred response, call customer to acknowledge that you have the dispatch.

• There is no B2B data transfer between our call centers. Any issues with site access, parts, customer contact
or invalid phone number, call NGS (if an international #, call NGS to bridge the call).

• You have to report potential missed SLA. Ask NGS for guidance.

• For all dispatches, when you get on site, you must acknowledge your ATA.

• Have your job aids and cell phone with you.

• Follow the action plan in the Net2 tool. Use the S/N lookup feature to point too the correct model type.
• Attach your laptop to the console port and capture the console output to a text file, by case number and
save it for 30 days in case it is needed for a postmortem or upload to NetApp.

• Return parts: seal box, affix the pre-paid ARS shipping label and drop at customer’s shipping location.

• You must notify NetApp with the dispatch completion acknowledgement to close out the case.

• Report any issue (especially customer requested deferrals) to NGS so the case is updated.

© 2008 NetApp. All rights reserved. 4

© 2008 NetApp. All rights reserved. Page 2

 NGS Geographical Phone Numbers

EMEA
00.888.44.NETAPP
00.888.44.638277

AMERICAS APAC
888.4.NETAPP +800.800.80.800
888.463.8277

© 2008 NetApp. All rights reserved.

Phone Menu System for TPM Engineers

Main Menu Phone Key Selection Description

Thank you for calling Network Appliance. We appreciate the opportunity to assist you.

5 If you are a member of the NetApp Partner Network

Partners Menu Phone Key Selection Description Acronym

1 If you are a Third Party Maintainer TPM

TPM Menu Phone Key Selection Description Acronym

Enter FSO number followed by a #

1 If you have a technical issue TSE

2 To update FSO with dispatch request acknowledgement (*) ACCEPT
3 To provide engineer name and Estimated Time of Arrival (*) ETA

4 To provide information about a potential missed SLA ETAMISS

5 To update a case with and Actual Time of Arrival (*) ATA
6 To update a case with dispatch completion acknowledgement (*) CLOSE
7 To speak directly with a Customer Support Representative CSR

* To go to previous Menu

(*) The call is routed to an "auto update" function where the case information is automatically updated.

© 2008 NetApp. All rights reserved. 6

© 2008 NetApp. All rights reserved. Page 3

 Phone Menu System for TPM (cont’d)

Acronym Shortcut # Description When

TPM engineer onsite has a technical issue and want to speak to

TSE 51#1 a NetApp Technical Support Engineer (TSE)
Option

When a TPM partner dispatch center receives a dispatch request

ACCEPT 51#2 sent by NetApp, TPM dispatching center is supposed to Option
acknowledge the reception of the dispatch

TPM dispatch center reports the estimated time of arrival the

ETA 51#3 engineer is arriving onsite, also allowed via email if setup
Always

TPM engineer is not making it for the previous communicated

ETAMISS 51#4 ETA and has to report a ETA miss
Option

ATA 51#5 TPM engineer reports his time of arrival at the customer site Always

CLOSE 51#6 TPM engineer reports close time when leaving the customer site Always

TPM engineers or TPM dispatch center wants to talk to a

CSR 51#7 Customer Support Representative (CSR) to report a problem
Option

© 2008 NetApp. All rights reserved. 7

Partner Development Managers

EMEA

UK: [email protected]

DE: [email protected]

FR: [email protected]

AMERICAS

East: [email protected]

Central: [email protected]

West: [email protected]

Federal: [email protected]

APAC

[email protected]

Neil.Chow@netappcom

© 2008 NetApp. All rights reserved.

© 2008 NetApp. All rights reserved. Page 4

 When to Contact your Regional PDM

Long hold time on phone

– Provide NetApp case#, date, time and where in the
menu process you were on hold and if someone
was on the phone holding with you

You need to be put on an access list

You need a site inventory map to determine where
the equipment is installed in the data center

Customer makes a request to you regarding when
to arrive on site for maintenance services or when
you should not be dispatched

Support issues with NGS

© 2008 NetApp. All rights reserved.

Module Review

When dispatched to end-user, you are required to call

NetApp upon arrival on-site (true or false?)
– True

When dispatched, it is necessary to notify NetApp of
end-user requested deferrals (true or false?)
– True

You are required to return NetApp parts (true or false?)
– True

When dispatched to end-user, it is required to call
NetApp for dispatch closure prior to departure (true or
false?)
– True

© 2008 NetApp. All rights reserved.

© 2008 NetApp. All rights reserved. Page 5

 Training Survey
Thank you!

ASE-1 Hardware Maintenance and

Troubleshooting

Training Survey

Please register to the ASE forum and provide

to NetApp your feedback about this training.

http://ase-training.eu/forum/index.php

© 2008 NetApp. All rights reserved. 2

© 2008 NetApp. All rights reserved. Page 1

 NetApp Phone Menu System for TPM engineers

888.4.NETAPP (888.463.8277) - US and Canada

00.800.44.NETAPP (00.800.44.638277) - EMEA
+800.800.80.800 - APAC
Main menu Phone Key Selection Description
Thank you for calling Network Appliance. We appreciate the
opportunity to assist you
1 For Technical Support and Parts Requests
2 To purchase NetApp Products
3 For information about NetApp University or enroll in a class
4 For information about our NOW selfservice web site
5 If you are a member of the NetApp Partner Network
* To repeat this menu, press the * key

Partners Menu Phone Key Selection Description Acronym

1 If you are a Third Party Maintainer TPM
2 For NetApp Authorized Support partners ASP
3 If you are an OEM partner OEM
4 If you are a Contracted Delivery Partner CDP
5 For Logistics partners LOG
6 If you are an Authorized Professional Support Partner APSP
9 To dial an extention number
* To go to previous Menu

TPM Menu Phone Key Selection Description Acronym

Enter FSO number followed by a #
1 If you have a technical issue TSE
2 To update FSO with dispatch request acknowlegedement ACCEPT
3 To provide engineer name and Estimated Time of Arrival ETA
4 To provide information about a potential missed SLA ETAMISS
5 To update a case with and Actual Time of Arrival ATA
6 To update a case with dispatch completion acknowledgement CLOSE
7 To speak directly with a Customer Support Representative CSR
* To go to previous Menu

Acronym Shortcut # Description When

TPM engineer onsite has a technical issue and want to speak to a
TSE 51#1 Option
NetApp Technical Support Engineer

When a TPM partner dispatch center receives a dispatch request

ACCEPT 51#2 sent by NetApp, TPM dispatching center is supposed to acknowledge Option
the reception of the dispatch

TPM dispatch center reports the estimated time of arrival the

ETA 51#3 Always
engineer is arriving onsite, also allowed via email if setup

TPM engineer is not making it for the previous communicated ETA

ETAMISS 51#4 Option
and has to report a ETA miss

ATA 51#5 TPM engineer reports his time of arrival at the customer site Always

CLOSE 51#6 TPM engineer reports close time when leaving the customer site Always

If TPM engineers or TPM dispatch center wants to talk to CSR to

CSR 51#7 Option
report a problem
NetApp Internal – © 2008, NetApp – All rights reserved

SUPPORT OPERATIONS - TPM MANAGEMENT

Hardware Maintenance and Troubleshooting

NETAPP TERMINOLOGY AND ACRONYMS
A/A, Active-Active A pair of storage systems connected such that one can serve its
partner’s data if the partner fails
ATA Advanced Technology Attachment
BMC Onboard Management Controller (FAS2000 remote management)
CF Card Compact Flash card
CFO Clustered Failover Option
CIFS Common Internet File System (Microsoft® Windows®)
Cu Copper (connector)
DOT, Data ONTAP® Open Network Technology for Appliance Products
EMD Enclose Data Manager (storage shelves FC7 and FC8)
ESH Electronically Switched Hub (used in FC DS14 family storage
shelves)
FAS Fabric Attached Storage
FC, FCP Fiber Channel, Fiber Channel Protocol
FRU Field Replaceable Unit
GbE Gigabit Ethernet
HBA, HA Host Bus Adapter, Host Adapter
HA High Availability
Head, Node, System NetApp Storage Controller, or appliance
HSSDC High-Speed Serial Data Connector
iSCSI Internet Small Computer Systems Interface
LCD Liquid Crystal Display
LED Light Emitting Diode
LRC Loop Resiliency Circuit
LUN Logical Unit Number

Hardware Maintenance and Troubleshooting 1-

 NetApp Internal – © 2008, NetApp – All rights reserved

Net2 NetApp Electronic TPM Toolkit

NetCache® NetApps’ legacy Web Proxy servers
NFS Network File System (UNIX®)
NOW NetApp On the Web
NVRAM Non-Volatile Memory
Op Optical (connector)
PCM Processor Controller Module (FAS2000)
PS, PSU Power Supply Unit
PWR Power
RLM Remote LAN Module (FAS3000, FAS3100, and FAS6000 series)
RMC Remote Management Card (FAS900 series)
RPM Revolutions Per Minute
SAN Storage Attached Network
SAS Serial-attached SCSI (internal disk drives in the FAS2000 series)
SATA Serial ATA
SDO, SANOWN Software Based Disk Ownership
SFE S Family Edition
SFP Small Form-factor Pluggable (shelf module FC connector type)
VEM Versatile Environment Monitor (storage shelf FC9)
VTL Virtual Tape Library

- Hardware Maintenance and Troubleshooting

2
 NetApp Hardware Universe – RC-0032-0708 – Side A – 07-22-2008

Fabric-Attached Storage (FAS)

Model FAS6080 FAS6040 FAS3170 FAS3140 FAS3070 FAS3040 FAS3020 FAS2050 FAS2020 FAS270 FAS250

Front View

System Capacity
Raw Maximum1 1,176TB 840TB 840TB 420TB 504TB 336TB 84TB 104TB 68TB 16TB 4TB
Aggregate/Vol
Maximum Size2 16TB 16TB 16TB 16TB 16TB 16TB 16TB 16TB 8TB 8TB 2TB
Max Back-End
FC Loops 14 10 10 6 8 6 4 2 2 1 -
Max Expansion
Disk Shelves 84 60 60 30 36 24 12 6 4 3 -

FC 1,176 840 840 420 504 336 168 84 (external) 56 (external) 56 (14 int + 42 ext) 14 (internal)
Max Drive
Quantity

SAS - - - - - - - 20 (internal) 12 (internal) - -

SATA 1,176 840 840 420 504 336 168 4 104 (20 int + 84 ext) 68 (12 int + 56 ext) 28 (external) -

Height 12U / 6U 12U / 6U 6U / 6U 6U / 6U 6U / 3U 6U / 3U 6U / 3U 4U / 4U 2U / 2U 3U / 3U - / 3U

(HA/Single)
HA Pair/Single Controller
Environmental

Weight 242 lb. (109.6 kg) 242 lb. (109.6 kg) 122 lb. (55.3 kg) 122 lb. (55.3 kg) 150 lb. (68 kg) 150 lb. (68 kg) 150 lb. (68 kg) 110 lb. (50 kg) 60 lb. (27.2 kg) 77 lb. (35 kg) 77 lb. (35 kg)
(HA/Single) 121 lb. (54.8 kg) 121 lb. (54.8 kg) 95 lb. (43.1 kg) 95 lb. (43.1 kg) 75 lb. (34 kg) 75 lb. (34 kg) 75 lb. (34 kg) with drives with drives with drives with drives

AC Power 100-120V 11.2A 100-120V 10.8A 100-120V 8.1A 100-120V 5.9A 100-120V 7.4A 100-120V 6.8A 100-120V 4.8A 100-120V 5.7A 100-120V 4.1A 100-120V 4A 100-120V 4A
(HA only) 200-240V 5.8A 200-240V 5.6A 200-240V 4A 200-240V 2.9A 200-240V 4.2A 200-240V 3.8A 200-240V 2.8A 200-240V 2.9A 200-240V 2.2A 200-240V 2A 200-240V 2A

Thermal3 3,740 BTU/hr 3,624 BTU/hr 2,761 BTU/hr 2,026 BTU/hr 2,466 BTU/hr 2,304 BTU/hr 1,610 BTU/hr 2,247 BTU/hr 1,587 BTU/hr
1,279 BTU/hr 1,178 BTU/hr
(HA/Single) 1,870 BTU/hr 1,812 BTU/hr 1,602 BTU/hr 1,272 BTU/hr 1,233 BTU/hr 1,152 BTU/hr 805 BTU/hr 1,988 BTU/hr 1,298 BTU/hr

Processor 8/4 4/2 4/2 2/1 4/2 4/2 2/1 2/1 2/1 2/1 1
(HA/Single) 64-bit dual-core 64-bit 64-bit dual-core 64-bit dual-core 64-bit dual-core 64-bit 32-bit 32-bit 32-bit 64-bit 64-bit

RAM 64GB / 32GB 32GB / 16GB 32GB / 16GB 8GB / 4GB 16GB / 8GB 8GB / 4GB 4GB / 2GB 4GB / 2GB 2GB / 1GB 2GB / 1GB 512MB
(HA/Single)
Platform Specifications
HA Pair/Single Controller

NVRAM 4GB / 2GB 1GB / 512MB 512MB / 256MB 256MB / 128MB 256MB / 128MB 64MB
(HA/Single) 4GB / 2GB 1GB / 512MB 1GB / 512MB 1GB / 512MB 1GB / 512MB
onboard onboard NVMEM NVMEM NVMEM NVMEM

PCI Slots 10 / 5 (PCIe) 10 / 5 (PCIe)

(HA/Single) 8 / 4 (PCIe) 8 / 4 (PCIe) 6 / 3 (PCIe) 6 / 3 (PCIe) 6 / 3 (PCI-X) 2 / 1 (PCIe) - - -
6 / 3 (PCI-X) 6 / 3 (PCI-X)

Ethernet 12 / 6 12 / 6 4/2 4/2 8/4 8/4 8/4 4/2 4/2 4/2 2

(HA/Single) GbE RJ45 GbE RJ45 GbE RJ45 GbE RJ45 GbE RJ45 GbE RJ45 GbE RJ45 GbE RJ45 GbE RJ45 GbE RJ45 GbE RJ45

FC Ports 16 / 8 16 / 8 8/4 8/4 8/4 8/4 8/4 4/2 4/2 4/2 1

(HA/Single) 4Gb SFP6 4Gb SFP6 4Gb SFP6 4Gb SFP6 4Gb SFP6 4Gb SFP6 2Gb SFP7 4Gb SFP6 4Gb SFP6 2Gb SFP7 2Gb SFP7

Data ONTAP® 7.2.1 7.2.1

(Min Release) 7.2.4 7.2.4 7.2.5 7.2.5 7.0.1 7.2.2L1 7.2.2L1 6.5 6.4.3
10.0.2 10.0.2

Please recycle after use. Feedback and questions can be sent to [email protected].
 NetApp Hardware Universe – RC-0032-0708 – Side B – 07-22-2008

NetApp S Family NetApp SA Systems

Model S550 S300 SA600 SA300 SA200 Terms and Abbreviations
Front View BTU – British Thermal Unit SAS – Serial-attached SCSI
Cu – Copper Connector SATA – Serial ATA
FAS – Fabric-Attached Storage SFE – S Family Edition
System Capacity FC – Fibre Channel SFP – Small Form-Factor Pluggable
Raw Maximum1 12TB 6TB 1,176TB 504TB 104TB
GbE – Gibabit Ethernet VAC – Volts Alternating Current
Aggregate/Vol HA – High Availability
Maximum Size2 12TB 6TB 16TB 16TB 16TB NVRAM – Non-Volatile RAM
Op – Optical Connector
Max Back-End
- - 14 8 2 PSU – Power Supply Unit
FC Loops

Max Expansion
Disk Shelves - - 84 36 6

FC - - 1,176 504 84 (external)

Max Drive
Quantity

SAS - - - - 20 (internal)
Notes
SATA 12 (internal) 8 (internal) 1,176 504 104 (20 int + 84 ext)
1
System capacity is calculated using base 10 arithmetic (i.e. 1TB=1,000,000,000,000 bytes) and
Height 5 is derived based on the type, size, and number of drives.
(HA/Single) - / 2U - / 4U 12U / 6U 6U / 3U 4U / 4U 2
Maximum volume/aggregate size is calculated using base 2 arithmetic (1TB = 240 bytes).
HA Pair/Single Controller
Environmental

3
The thermal dissipation values shown are based on typical system values at 100-120V input
Weight 52 lb. (35.8 kg) 41.88 lb. (19 kg) 242 lb. (109.6 kg) 150 lb. (68 kg) 110 lb. (50 kg) voltage. Please refer to the Site Requirements Guide on the NOW site for worst-case thermal
(HA/Single) with drives with drives 121 lb. (54.8 kg) 75 lb. (34 kg) with drives dissipation values.
4
Available with all drive types = 500GB. The maximum number of 750GB disk drives is 112. The
AC Power 100-120V 9A 100-120V 6A 100-120V 11.2A 100-120V 7.4A 100-120V 5.7A maximum number of 1TB disk drives is 84.
5
(HA only) 200-240V 4.5A 200-240V 3A 200-240V 5.8A 200-240V 4.2A 200-240V 2.9A A single NetApp S300 system is roughly 8.8" (22mm) wide and only occupies half of a standard
19" rack horizontally. It is possible to rack two S300 systems side by side in a standard 19" rack.
6
Thermal3 3,740 BTU/hr 2,466 BTU/hr 2,247 BTU/hr Autosensing ports: 1, 2, 4Gb.
(HA/Single) 1,706 BTU/hr 1,706 BTU/hr 7
Autosensing ports: 1, 2Gb.
1,870 BTU/hr 1,233 BTU/hr 1,988 BTU/hr

Processor 1 8/4 4/2 2/1

(HA/Single) 1
32-bit 64-bit dual-core 64-bit dual-core 32-bit

RAM 2GB 1GB 64GB / 32GB 16GB / 8GB 4GB / 2GB

(HA/Single)
Platform Specifications

© 2008 NetApp. All rights reserved. Specifications are subject to change without notice. NetApp,
HA Pair/Single Controller

NVRAM 128MB 512MB / 256MB the NetApp logo, Go further, faster, and Data ONTAP, are trademarks or registered trademarks
(HA/Single) 256MB 4GB / 2GB 1GB / 512MB
NVMEM NVMEM of NetApp, Inc. in the United States and/or other countries. All other brands or products are
trademarks or registered trademarks of their respective holders and should be treated as such.
PCI Slots 10 / 5 (PCIe) RC-0032-0708
(HA/Single) 2 (PCI-X) - 6 / 3 (PCIe) 2 / 1 (PCIe)
6 / 3 (PCI-X)
This document is subject to change without notice. Be sure to cross-reference the NOW System
Ethernet 2 4 12 / 6 8/4 4/2 Configuration Guide at http://now.netapp.com for the most current information. NetApp
(HA/Single) GbE RJ45 GbE RJ45 GbE RJ45 GbE RJ45 GbE RJ45 employees and partners can check the NetApp 1Stop site at http://www.netapp1stop.com for
updates. NetApp customers should check with their account teams for updates.
FC Ports 16 / 8 8/4 4/2
- -
(HA/Single) 4Gb SFP6 4Gb SFP6 4Gb SFP6 This document is chartered under the NetApp Systems Engineering Program Office.
®
Data ONTAP
(Min Release) 7.2.1 SFE 7.2.1 SFE 7.2.5 7.2.5 7.2.5

Please recycle after use. Feedback and questions can be sent to [email protected].
 NetApp Hardware Universe – RC-0033-0708 – Side A – 07-22-2008

V-Series Storage Virtualization

Model V6080 V6070 V6040 V6030 V3170 V3140 V3070 V3040 V3020

Front View

System Capacity
Raw Maximum1 1,176TB 1,008TB 840TB 840TB 840TB 420TB 504TB 336TB 168TB
Max Number
of LUNs 1,176 1,008 840 840 840 420 504 336 168
V-Series Supported Arrays

EMC CLARiiON
EMC Symmetrix
Fujitsu ETERNUS
Hitachi TagmaStore USP
Hitachi Lightning
Hitachi Thunder
HP StorageWorks
IBM TotalStorage
3Par InServ

Note: Please check the NOW™ site for the latest V-Series support matrix.

Height
(HA/Single) 12U / 6U 12U / 6U 12U / 6U 12U / 6U 6U / 6U 6U / 6U 6U / 3U 6U / 3U 6U / 3U
HA Pair/Single Controller
Environmental

Weight 242 lb. (109.6 kg) 242 lb. (109.6 kg) 242 lb. (109.6 kg) 242 lb. (109.6 kg) 122 lb. (55.3 kg) 122 lb. (55.3 kg) 150 lb. (68 kg) 150 lb. (68 kg) 150 lb. (68 kg)
(HA/Single) 121 lb. (54.8 kg) 121 lb. (54.8 kg) 121 lb. (54.8 kg) 121 lb. (54.8 kg) 95 lb. (43.1 kg) 95 lb. (43.1 kg) 75 lb. (34 kg) 75 lb. (34 kg) 75 lb. (34 kg)

AC Power 100-120V 11.1A 100-120V 22A 100-120V 22A 100-120V 22A 100-120V 8.1A 100-120V 5.9A 100-120V 7.4A 100-120V 6.8A 100-120V 4.8A
(HA Pair) 200-240V 5.8A 200-240V 10A 200-240V 10A 200-240V 10A 200-240V 4A 200-240V 2.9A 200-240V 4.2A 200-240V 3.8A 200-240V 2.8A

Thermal2 3,740 BTU/hr 3,740 BTU/hr 3,624 BTU/hr 3,624 BTU/hr 2,761 BTU/hr 2,026 BTU/hr 2,466 BTU/hr 2,304 BTU/hr 1,610 BTU/hr
(HA/Single) 1,870 BTU/hr 1,870 BTU/hr 1,812 BTU/hr 1,812 BTU/hr 1,602 BTU/hr 1,272 BTU/hr 1,233 BTU/hr 1,152 BTU/hr 805 BTU/hr

Processor 8/4 8/4 4/2 4/2 4/2 2/1 4/2 4/2 2/1
(HA/Single) 64-bit dual-core 64-bit 64-bit 64-bit 64-bit dual-core 64-bit dual-core 64-bit dual-core 64-bit 32-bit

RAM
64GB / 32GB 64GB / 32GB 32GB / 16GB 32GB / 16GB 32GB / 16GB 8GB / 4GB 16GB / 8GB 8GB / 4GB 4GB / 2GB
Platform Specifications

(HA/Single)
HA Pair/Single Controller

NVRAM 4GB / 2GB 1GB / 512MB

(HA/Single) 4GB / 2GB 4GB / 2GB 1GB / 512MB 1GB / 512MB 1GB / 512MB 1GB / 512MB 1GB / 512MB
Onboard Onboard

PCI Slots 10 / 5 (PCIe) 10 / 5 (PCIe) 10 / 5 (PCIe) 10 / 5 (PCIe)

(HA/Single) 8 / 4 (PCIe) 8 / 4 (PCIe) 6 / 3 (PCIe) 6 / 3 (PCIe) 6 / 3 (PCI-X)
6 / 3 (PCI-X) 6 / 3 (PCI-X) 6 / 3 (PCI-X) 6 / 3 (PCI-X)

Ethernet 12 / 6 12 / 6 12 / 6 12 / 6 4/2 4/2 8/4 8/4 8/4

(HA/Single) GbE RJ45 GbE RJ45 GbE RJ45 GbE RJ45 GbE RJ45 GbE RJ45 GbE RJ45 GbE RJ45 GbE RJ45

FC Ports 16 / 8 16 / 8 16 / 8 16 / 8 8/4 8/4 8/4 8/4 8/4

(HA/Single) 4Gb SFP3 2Gb SFP4 4Gb SFP3 2Gb SFP4 4Gb SFP3 4Gb SFP3 4Gb SFP3 4Gb SFP3 2Gb SFP4

Data ONTAP®
(Min Release) 7.2.4 7.2 7.2.4 7.2 7.2.5 7.2.5 7.2.2 7.2.2 7.0.2

Please recycle after use. Feedback and questions can be sent to [email protected].
 NetApp Hardware Universe – RC-0033-0708 – Side B – 07-22-2008

NearStore VTL

Model VTL1400 VTL700 VTL300 Backend Tape Drive Support

Front View
Supported Vendors: HP, IBM, Quantum, Sony, STK
System Capacity Raw
Maximum5
672TB 336TB 70TB Please check the NOW™ site for a complete list of supported vendors and models.

Max Usable Capacity 550TB 275TB 55TB

2:1 Compression 1,100TB 550TB 110TB Backend Tape Library Support
Max Sustained Write 2,500MB/sec 1,250MB/sec 800MB/sec
2:1 Compression 2,300MB/sec 1,150MB/sec 650MB/sec

Max Sustained Read 1,600MB/sec 800MB/sec 500MB/sec Supported Vendors: ADIC, IBM, Quantum, STK, Overland, SpectraLogic, HP
2:1 Compression 1,400MB/sec 700MB/sec 475MB/sec

Max Number of
Virtual Tapes
20,000 10,000 10,000 Please check the NOW™ site for a complete list of supported vendors and models.
Max Number of
3,000 1,500 1,500
Virtual Drives
Max Number of
512 256 256
Virtual Libraries

Max SATA
672 336 70
Drives

Height 6U 3U 3U VTL700 Front VTL700 Rear

Environmental

Weight 150 lb. (68 kg) 75 lb. (34 kg) 75 lb. (34 kg) Notes
1
100-120V 3.7A 100-120V 3.7A 100-120V 3.7A System capacity is calculated using base 10 arithmetic (i.e. 1TB=1,000,000,000,000 bytes) and is derived based on the type,
AC Power size, and number of drives.
200-240V 2.1A 200-240V 2.1A 200-240V 2.1A 2
The thermal dissipation values shown are based on typical system values at 100-120V input voltage. Please refer to the Site
Requirements Guide on the NOW site for worst-case thermal dissipation values.
Thermal3 2,466 BTU/hr 1,233 BTU/hr 1,233 BTU/hr 3
Autosensing ports: 1, 2, 4Gb.
4
Autosensing ports: 1, 2Gb.
5
4 2 2 Max performance and capacity are calculated using base 10 arithmetic (i.e. 1TB=1,000,000,000,000 bytes).
Processor
64-bit dual-core 64-bit dual-core 64-bit dual-core
Platform Specifications

RAM 16GB 8GB 8GB

Terms and Abbreviations © 2008 NetApp. All rights reserved. Specifications are subject to change without
notice. NetApp, the NetApp logo, Go further, faster, Data ONTAP, NearStore,
and NOW are trademarks or registered trademarks of NetApp, Inc. in the United
PCI Slots 4 (PCIe) 2 (PCIe) 3 (PCIe) BTU – British Thermal Unit SFP – Small Form-Factor Pluggable States and/or other countries. All other brands or products are trademarks or
Cu – Copper Connector VAC – Volts Alternating Current registered trademarks of their respective holders and should be treated as such.
FC – Fibre Channel VTL – Virtual Tape Library RC-0033-0708
8 4 4 GbE – Gibabit Ethernet
Ethernet This document is subject to change without notice. Be sure to cross-reference
GbE RJ45 GbE RJ45 GbE RJ45 HA – High Availability
the NOW System Configuration Guide at http://now.netapp.com for the most
NVRAM – Non-Volatile RAM current information. NetApp employees and partners can check the NetApp
8 4 4 LUN – Logical Unit Number 1Stop site at http://www.netapp1stop.com for updates. NetApp customers
FC Ports
4Gb SFP3 4Gb SFP3 4Gb SFP3 Op – Optical Connector should check with their account teams for updates.

This document is chartered under the NetApp Systems Engineering Program

VTL O/S 5.0 5.0 5.0 Office.
(Min Release)

Please recycle after use. Feedback and questions can be sent to [email protected].
 NetApp Hardware Universe – RC-0034-0808 – Side A – 08-07-2008
Adapter Cards
Data ONTAP VTL O/S NearStore® VTL Fabric-Attached Storage
Part Number Media (min release) (min release) 300 700 1400 2050 3020 3040 3070 3140 3170 6040 6080
X1128A-R6 Op - LC 7.2 -
FCP TARGET Dual Port 4Gb
X1130A-R6 Op - LC 7.3 -
FCP TARGET Quad Port 4Gb
X2053A-R6 Op - LC
7.2
5.0
10.1
PCIe

DISK/TAPE Dual Port 4Gb

X2054A-R6 Op - LC 7.2.2 -
DISK/TAPE Quad Port 4Gb
FIBRE CHANNEL

X2054B-R6 Op - LC 7.2.3 5.2

DISK/TAPE Quad Port 4Gb
X2055A-R6 Op - LC
7.2
5.0
DISK Dual Port 4Gb 10.0.1

X1028B-R6 Op - LC 7.1.0.1 -
FCP TARGET Dual Port 4Gb
X2050A-R5 Op - LC 6.3 4.0
DISK Dual Port 2Gb
PCI-X

X2050B-R5 Op - LC 6.5.1 -
DISK Dual Port 2Gb
X2051A-R5 Op - LC
6.3
4.1
TAPE Dual Port 2Gb 10.0

X2052A-R5 Op - LC
7.2.1
-
DISK/TAPE Quad Port 4Gb 10.0.3

Please refer to the NOW™ System Configuration Guide for proper platform and expansion slot assignment information.

Data ONTAP VTL O/S NearStore® VTL Fabric-Attached Storage

Part Number Media (min release) (min release) 300 700 1400 2050 3020 3040 3070 3140 3170 6040 6080
X1006A-R5 Cu – RJ45 7.2.1 -
TOE Quad Port GbE
X1008A-R6 7.2.3
Op - LC
10.3
-
TOE Dual Port 10GbE
X1010A-R6 Cu – CX4 10.0.3 -
TOE Dual Port 10GbE
X1038A-R6 Op - LC 7.2 -
PCIe

NIC Dual Port GbE

X1039A-R6 7.2
Cu – RJ45
10.0.1
-
NIC Dual Port GbE
X1049A-R6 7.2.1
Cu – RJ45
10.0.1
-
NIC Quad Port GbE
X1129A-R5
ETHERNET

Cu – RJ45 7.2.1 -
iSCSI Dual Port GbE
X1136A-R5 Op - LC 7.2.1 -
iSCSI Dual Port GbE
X1005A-R5 7.2
Op - LC
10.0.1
-
TOE Single Port 10GbE
X1007A-R5 Cu – RJ45 7.2 -
TOE Quad Port GbE
X1029B-R5 Cu – RJ45 7.2 -
iSCSI Dual Port
PCI-X

X1035B-R5 Op - LC 6.4.4 -
NIC Dual Port GbE
X1036B-R5 Op - LC 7.1.1 -
iSCSI Dual Port
X1037C-R6 6.3.1
Cu – RJ45
10.0
-
NIC Dual Port GbE
X1047B-R6 7.2.1
Cu – RJ45
10.0.1
-
NIC Quad Port GbE

Please refer to the NOW™ System Configuration Guide for proper platform and expansion slot assignment information.

Please recycle after use. Feedback and questions can be sent to [email protected].
 NetApp Hardware Universe – RC-0034-0808 – Side B – 08-07-2008
Adapter Cards
Data ONTAP VTL O/S NearStore® VTL Fabric-Attached Storage
Part Number Media (min release) (min release) 300 700 1400 2050 3020 3040 3070 3140 3170 6040 6080
X2028A-R6 Cu - 68p
PCIe

7.2 -
TAPE Dual SCSI-LVD/SE VHDCI
SCSI

PCI-X

X2027B-R5 Cu - 68p
7.0.5 4.1
TAPE Dual SCSI-LVD/SE VHDCI

Please refer to the NOW™ System Configuration Guide for proper platform and expansion slot assignment information.

Data ONTAP VTL O/S NearStore® VTL Fabric-Attached Storage

Part Number Media (min release) (min release) 300 700 1400 2050 3020 3040 3070 3140 3170 6040 6080
X1124A-R6 Op - LC 7.2.2 -
SnapMirror®/Fibre Channel 4Gb
X1300A-R5 - - 5.0
Hardware Compression NIC
X1926A-R6 Op - LC 7.2.3 -
MetroCluster FC-VI 4Gb
PCIe

X1936A-R5 - 7.3 -
Performance Acceleration Module
OTHER

X3147-R5 Cu – IB4X
7.2
-
NVRAM6 512MB 10.0.2

X3148-R5 Cu – IB4X
7.2
-
NVRAM6 2GB 10.0.1

X1024-R5 Op - LC 6.5 -
SnapMirror®/Fibre Channel 2Gb
PCI-X

X1922A-R5 Op - LC 6.4.1 -
MetroCluster FC-VI 2Gb
X3145A-R5 Cu – IB4X
6.5.3
4.0
NVRAM5 512MB 10.0

Please refer to the NOW™ System Configuration Guide for proper platform and expansion slot assignment information.

Terms and Abbreviations © 2008 NetApp. All rights reserved. Specifications are subject to change without notice. NetApp, the
NetApp logo, Go further, faster, Data ONTAP, NearStore, NOW, and SnapMirror are trademarks or
registered trademarks of NetApp, Inc. in the United States and/or other countries. All other brands or
products are trademarks or registered trademarks of their respective holders and should be treated as
Cu – Copper Connector NIC – Network Interface Card such. RC-0034-0808
FC – Fibre Channel NVRAM – Non-Volatile RAM This document is subject to change without notice. Be sure to cross-reference the NOW System
FCP – Fibre Channel Protocol Op – Optical (connector) Configuration Guide at http://now.netapp.com for the most current information. NetApp employees
GbE – Gibabit Ethernet TOE – TCP Offload Engine and partners can check the NetApp 1Stop site at http://www.netapp1stop.com for updates. NetApp
customers should check with their account teams for updates.
IB4X – InfiniBand 4X VTL – Virtual Tape Library
LC – Lucent Connector This document is chartered under the NetApp Systems Engineering Program Office.

Please recycle after use. Feedback and questions can be sent to [email protected].
 NetApp Hardware Universe – RC-0035-0808 – Side A – 08-22-2008
Disk Drives
Data ONTAP VTL O/S
Interface (Gb/Sec) DS14 Model
Capacity Part No. RPM EOA/EOS (min release) (min release) 1 2 4 mk1 mk2 mk4
12.2006
72GB X272A 10K 6.2 -
12.2011
12.2006 6.3.3
72GB X272B-R5 10K -
12.2011 10.0.1
12.2006
72GB X273A 15K 6.3.3 -
12.2011
12.2006 6.4.5
72GB X273B-R5 15K -
12.2011 10.0.1

144GB X236A 10K - 6.2 -

FIBRE CHANNEL

300GB FC
05.2008 10K RPM
144GB X274A 10K 6.2 -
06.2013
05.2008 6.3.3
144GB X274B-R5 10K -
06.2013 10.0
06.2007 6.4.5
144GB X275A-R5 15K -
N/A 10.0.1
7.2.1
144GB X278A-R5 15K - -
10.0.2
05.2008 6.4.5
300GB X276A-R5 10K -
06.2013 10.0
7.2.1
300GB X279A-R5 15K - -
10.0.2
7.0.7
450GB X291A-R5 15K - - 300GB FC
10.0.4
15K RPM

300GB SAS (FAS2020 & FAS2050) 1TB SATA (FAS2020 & FAS2050)

Data ONTAP VTL O/S Interface (Gb/Sec) Storage System

Capacity Part No. RPM EOA/EOS (min release) (min release) 1.5 3 6 FAS 20x0 VTL
144GB X286A-R5 15K - 7.2.2 -
SAS

300GB X287A-R5 15K - 7.2.2 -

08.2005
250GB X262A 7.2K 7.0.1 -
08.2010
05.2008 7.0.6
250GB X262B-R5 7.2K -
06.2013 10.0
05.2008
250GB X280B-R5 7.2K 7.2.4 -
06.2013
08.2005
320GB X266A 5.4K 6.5 -
08.2010
1TB SATA
11.2006
320GB X266B-R5 7.2K 6.5.1 4.0
12.2011
SATA

7.0.1
500GB X267A-R5 7.2K - 4.1
10.0

500GB X282B-R5 7.2K - 7.2.1 -

7.0.7
750GB X268A-R5 7.2K - 5.6
10.0.2

750GB X283B-R5 7.2K - 7.2.4 -

7.2.3
1000GB X269A-R5 7.2K - 5.6
10.0.3

1000GB X298A-R5 7.2K - 7.2.4 - 750GB

SATA

Please recycle after use. Feedback and questions can be sent to [email protected].
 NetApp Hardware Universe – RC-0035-0808 – Side B – 08-22-2008
Shelf Enclosures
Data ONTAP VTL O/S
Model Part Number Weight Disk Rack Power (Amps @100-120V) Thermal (BTU/hr) EOA/EOS (min release) (min release)
X500 (shelf with AC PSU) Empty
50.06 lb. (23 kg) 02.2005
DS14mk1 X501 (shelf without PSUs)
With Drives
14 3U N/A N/A 6.0.2 -
X511 (110/220VAC PSU only)
02.2010
77 lb. (35 kg)

X550-R5 (shelf with AC PSUs) Empty 10K RPM 15K RPM 10K RPM 15K RPM
50.06 lb. (23 kg) 72GB: 3.43A 72GB: 3.63A 72GB: 1,167 72GB: 1,234 05.2008 6.4.1
DS14mk2 X551-R5 (shelf without PSUs)
With Drives
14 3U 144GB: 3.43A 144GB: 3.75A 144GB: 1,167 144GB: 1,272 -
X511A-R5 (110/220VAC PSU only)
06.2013 10.0
77 lb. (35 kg) 300GB: 3.89A 300GB: 4.32A 300GB: 1,320 300GB: 1,470

X553A-R5 (shelf w/AC PSUs) Empty 10K RPM 15K RPM 10K RPM 15K RPM
50.06 lb. (23 kg) 72GB: 3.01A 72GB: 3.65A 72GB: 1,020 72GB: 1,238 7.2.1
DS14mk4 X553A-DC-R5 (shelf w/DC PSUs)
With Drives 14 3U 144GB: 3.36A 144GB: 3.45A 144GB: 1,140 144GB: 1,174 - -
X511A-R5 (110/220VAC PSU only)
10.0.1
77 lb. (35 kg) 300GB: 3.78A 300GB: 4.27A 300GB: 1,287 300GB: 1,452

X562-R5 (shelf without PSUs) 250GB: 2.72A 250GB: 923

Empty
X511A-R5 (110/220VAC PSU only) 320GB: 3.12A 320GB: 1,058
6.5
50.06 lb. (23 kg)
DS14mk2 AT DSX-7.0TB-QS-R5 (500GB drives) With Drives 14 3U 500GB: 2.90A 500GB: 1,095 - 4.0
750GB: 3.22A 750GB: 1,050 10.0
DSX-10.5TB-QS-R5 (750GB drives) 77 lb. (35 kg) 1000GB: 3.10A 1000GB: 1,050
DSX-14.0TB-QS-R5 (1TB drives)

72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F

DS14mk2 AT Shelf Front and Rear View DS14mk4 FC Shelf Front and Rear View

17.6 in. (44.7 cm) 17.6 in. (44.7 cm)

X2

X2

X2

X2
5.25 in.
1

1
(13.3 cm)

Depth: 22 in. (55.2 cm) Depth: 20 in. (50.8 cm)

Shelf Interface Modules

Data ONTAP VTL O/S DS14 Shelf Model Interface (Gb/Sec)
Module Platforms Part Number Interface EOA/EOS (min release) (min release) mk1 mk2 mk4 mk2AT 1 2 4
X5501A Cu: DB9 IN: DB9 / SC 03.2006
LRC FAS X5502A Op: SC OUT: DB9
- -
04.2011

X5505A Cu: HSSDC2 IN: HSSDC2 / LC 05.2005

ESH FAS X5506A Op: LC OUT: HSSDC2
6.2 - ESH4 Module
06.2010

IN: SFP 05.2008 6.5.1

ESH2 FAS X5511A-R5
OUT: SFP
-
06.2013 10.0

IN: SFP 7.2.1

ESH4 FAS X5512A-R5
OUT: SFP
- -
10.0.1

ESH2 Module
NearStore X5610A Cu: HSSDC2 IN: HSSDC2 / LC 06.2006
AT-FC X5611A Op: LC OUT: HSSDC2
6.5 -
R150/200 06.2011

NearStore IN: SFP 06.2006

AT-FC2 X5613A
OUT: SFP
6.5.1 -
R150/200 06.2011

IN: SFP 7.0.1

AT-FCX FAS, VTL X5612A-R5
OUT: SFP
- 4.0
10.0
AT-FCX Module

Terms and Abbreviations © 2008 NetApp. All rights reserved. Specifications are subject to change without notice. NetApp, the
NetApp logo, Go further, faster, Data ONTAP, NearStore, and NOW are trademarks or registered
BTU – British Thermal Unit LC – Lucent Connector trademarks of NetApp, Inc. in the United States and/or other countries. All other brands or products
Cu – Copper Connector LRC – Loop Resiliency Circuit are trademarks or registered trademarks of their respective holders and should be treated as such.
EOA – End of Availability Op – Optical (connector) RC-0035-0808

EOS – End of Support SAS – Serial-attached SCSI This document is subject to change without notice. Be sure to cross-reference the NOW System
ESH – Electronically Switched Hub SATA – Serial ATA Configuration Guide at http://now.netapp.com for the most current information. NetApp employees
FAS – Fabric-Attached Storage RPM – Revolutions Per Minute and partners can check the NetApp 1Stop site at http://www.netapp1stop.com for updates. NetApp
customers should check with their account teams for updates.
HSSDC – High-Speed Serial Data VTL – Virtual Tape Library
Connector This document is chartered under the NetApp Systems Engineering Program Office.

Please recycle after use. Feedback and questions can be sent to [email protected].
 NetApp Hardware Universe – RC-0036-0708 – Side A – 07-22-2008
System Cabinet

42U System Cabinet Cabinet Closed Cabinet Open

Dimensions Weight Clearance 42 42

U42 42 42

41
Cabinet Closed 41
U41 41 41

Height 78.7 in. (200 cm) Rail Load Capacity 125 lb. (56.7 kg) Front/Rear 30 in. (76.3 cm) 40
72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F
40
U40 40
72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F
40

U39
Depth 37.4 in. (95 cm) Empty Weight 275 lb. (124.7 kg) Side (Optional) 24 in. (61 cm)
39 39 39 39

38 38
U38 38 38

Width 23.6 in. (60 cm) Loaded Weight 1500 lb. (680 kg) Top 12 in. (30 cm) 37
72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F
37
U37 37
72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F
37

36 36
U36 36 36

Rack Space 73.5 in. (186.7 cm) 35 35

U35 35 35

34
72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F
34
U34 34
72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F
34

System Cabinet Configurations 33 33

U33 33 33

32 32
U32 32 32

31 31
U31 31 31

Configuration 20-Amp Single-Phase PDU 30-Amp Single-Phase 2x PDU 30-Amp Single-Phase 4x PDU 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F

30 30
U30 30 30

29 29
U29 29 29

20A (derated to 16A in U.S.) 30A (derated to 24A in U.S.) 30A (derated to 24A in U.S.)
Power Requirement U28
200-240V AC, 50/60Hz x 4 200-240V AC, 50/60Hz x 2 200-240V AC, 50/60Hz x 4
28 28 28 28
72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F

27 27
U27 27 27

Power Distribution Units (PDU) 4x (mounted two per side) 2x (mounted one unit per side) 4x (mounted two per side) 26 26
U26 26 26

25 25
U25 25 25

Power Inlet (U.S.) IEC320-C20 x 4 (Power cords hard-wired to PDU) (Power cords hard-wired to PDU) 24 24
U24 24 24

23 23
U23 23 23

Power Inlet (Intl) IEC320-C20 x 4 (Power cords hard-wired to PDU) (Power cords hard-wired to PDU) 22 22
U22 22 22

Power Outlets (per PDU) IEC320-C13 x 8 IEC320-C13 x 16 IEC320-C13 x 8 21 21

U21 21 21

20 20
U20 20 20

Base Cabinet (U.S.) X871A-R6 (20A PDU x 4) X8730A-R6 (30A PDU x 2) X8730B-R6 (30A PDU x 4) 19 19
U19 19 19

18 18
U18 18 18

Base Cabinet (Intl) (same as U.S.) X8731A (30A PDU x 2) X8731B (30A PDU x 4)
17 17
U17 17 17
Part Numbers

PDU Only (U.S.) X8711-R6 (20A PDU x 1) X8712A-R6 (30A PDU x 1) X8712B-R6 (30A PDU x 1) 16 16
U16 16 16

15 15
U15 15 15

PDU Only (Intl) (same as U.S.) X8713A-R6 (30A PDU x 1) X8713B-R6 (30A PDU x 1) 14 14
U14 14 14

13 13
U13 13 13

Power Cord (U.S.) X875A-R6 (NEMA L6-20 x 4) (NEMA L6-30 hard-wired to PDU) (NEMA L6-30 hard-wired to PDU)
72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F

12 12
U12 12 12

Power Cord (Intl) X875B-R6 (IEC309-16A x 4) (IEC309-30A hard-wired to PDU) (IEC309-30A hard-wired to PDU) 11 11
U11 11 11

10
72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F
10
U10 10
72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F
10

Power Cord (Aus/NZ) X875C-R6 (AS/NZS3123-20 x 4) - - 9 9

U09 9 9

8 8
U08 8 8

Input Current Actual (Amps) 17.1 per PDU 25.5 per PDU 17.2 per PDU
7
72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F
7
U07 7
72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F
7

Input Power Actual (Watts) 3,373 total per PDU 5,460 total per PDU 3,373 total per PDU 6 6
U06 6 6

5 5
U05 5 5

Thermal Dissipation (BTU/hr) 11,510 per PDU 18,629 per PDU 11,510 per PDU 4
72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F
4
U04 4
72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F
4

3 3
U03 3 3

Because there are two PDUs per side, 30A PDU uses two 8-outlet strips daisy- Because there are two PDUs per side,
2 2
U02 2 2

instead of one, the capacity is double chained with hard-wired input cables. instead of one, the capacity is double
Notes the amount, although the PDUs must be the amount, although the PDUs must be 1
72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F
1
U01 1
72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F
1

connected to separate 20A branch connected to separate 30A branch

circuits. circuits.

Power Distribution
NEMA IEC320
L6-20 16A AZ/NZS3123-20 IEC320-C13 (female) to IEC320-C14 (male)
IEC320
27 in. Power Cable X800-42U-R6
C13
1.02 in.
25.9 mm 48 in. Power Cable X1558A-R6
1.56 in.
39.6 mm 1.87 in. System Cabinet Kits and Parts
IEC320 47.5 mm
C14 IEC320 Rail Kit X877-R6 1U Blank Panel X8776-R6
1.06 in. NEMA
26.9 mm L6-30 30A
Bolt-Down Kit X878-R6 3U Blank Panel X8777-R6

3.07 in. Interconnect Kit X879-R6

78 mm
IEC320
C19 1.22 in.
Universal 4-Post Rack Mount Kit X5515A-R6
1.22 in. 3.1 cm.
1.84 in. 2.42 in.
31 mm
46.7 mm 61.5 mm

Please recycle after use. Feedback and questions can be sent to [email protected].
 NetApp Hardware Universe – RC-0036-0708 – Side B – 07-22-2008
Common Cables
HA Pair Interconnect Cables and Connectors Fibre Channel Cables and Connectors Optical Cables and Connectors

Infiniband 4X (IB4X) MTP SFP SFP LC SC ST

Cable Transceiver

IB4X-MTP
Converter 0.49 in.
(12.5 mm)
0.53 in. 0.53 in. 0.53 in.
(13.7 mm) (13.7 mm) (13.7 mm) 0.46 in. 0.91 in. 0.39 in.
HSSDC2 DB9 11.8 mm 23 mm 9.8 mm
0.98 in. 0.98 in. Part No. Begin End Length Quantity
(24.9 mm) (24.9 mm)
Part No. Begin End Length Quantity X6510A-R6 SC SC 5m 1
X1943A-R6 InfiniBand 4X InfiniBand 4X .5m 2 0.54 in. 1.25 in. X6511A-R6 SC SC 30m 1
X1940A-R6 InfiniBand 4X InfiniBand 4X 2m 2 (13.8 mm) (31.8 mm)
X6524-R6 2 x LC 2 x LC 2m 1
X1941A-R6 InfiniBand 4X InfiniBand 4X 5m 2 Part No. Begin End Length Quantity X6553-R6 LC LC 2m 1
X1942A-R6 InfiniBand 4X InfiniBand 4X 10m 2
X6529-R6 SFP LC (Op) Transceiver (2Gb) 1
X1949A-R5 InfiniBand 4X MTP Cu-Op converter 1 X6536-R6 LC LC 5m 1
X6539-R6 SFP LC (Op) Transceiver (4Gb) 1
X1945A-R6 MTP MTP 5m 1 X6554-R6 LC LC 15m 1
X6530-R6 SFP SFP .5m (4/2/1Gb) 1
X1946A-R6 MTP MTP 30m 1 X6537-R6 LC LC 30m 1
X6532-R6 SFP SFP 3m (2/1Gb only) 1
X1951A-R6 MTP SC (Op) 30m 1
X6523-R6 2 x LC 2 x SC 2m 1
X1952A-R6 MTP ST (Op) 30m 1 X6556-R6 SFP SFP 5m (4/2/1Gb Op) 1
X6538-R6 SFP DB9 3m 1 X6547-R6 LC SC 5m 1
X1953A-R6 MTP LC (Op) 30m 1
X1954A-R6 MTP FC (Op) 30m 1 X6531-R6 SFP HSSDC2 .5m 1 X6546-R6 LC SC 30m 1
X1955A-R6 MTP MT-RJ (Op) 30m 1 X6533-R6 SFP HSSDC2 3m 1

HA Pair Notes SCSI Cables and Connectors Console Cables and Connectors

HA pair configuration means two controllers - both actively serving data - are connected for automatic HD-68 VHDCI DB9 RJ45
failover protection. The following interconnect options are applicable to HA pair configurations using
NVRAM5 and NVRAM6 adapters:

.5m to 10m – Copper InfiniBand interconnect cables (standard)

NetApp part: X1943A-R6 (.5m), X1940A-R6 (2m), X1941A-R6 (5m), or X1942A-R6 (10m)

5m to 30m – Optical interconnect using MTP ribbon cables (supplier NetApp) 1.25 in. 0.49 in.
NetApp part: X1949A-R6 (Cu-to-Op converter) (31.8 mm) (12.7 mm)
NetApp part: X1945A-R6 (5m) or X1946-R6 (30m) 2.6 in. 1.65 in.
(66 mm) (42 mm) Part No. Begin End Length Quantity
30m to 300m – Optical interconnect using MTP ribbon cables (suppliers NetApp and Fujikura)
NetApp part: X1949A-R6 (Cu-to-Op converter)
Part No. Begin End Length Quantity X881-R6 DB9 RJ45 M Dongle 1
Fujikura part: CBPE4-497-XXX, where XXX designates length in meters
Example: 300 meter MTP 50/125 Plenum Cable 500Mhz/KM is CBPE4-497-300 X6513-R6 HD-68 VHDCI 2m 1
300m to 500m – Optical interconnect using MTP ribbon cables (suppliers NetApp and Fujikura)
NetApp part: X1949A-R6 (Cu-to-Op converter)
Fujikura part: CBPE4-507-XXX, where XXX designates length in meters
Example: 500 meter MTP 50/125 Plenum Cable 2000Mhz/KM is CBPE4-507-500

NOTE: In order to achieve the maximum 500 meter distance between controllers in a HA pair, the
interconnect cable must be a direct point-to-point connection with no intermediate device between them
(such as patch panel).

HA configurations that must go through a patch panel can use the following part numbers in conjunction
with the X1949A-R6 Cu-to-Op converters:

X1951A-R6 - SC termination
X1952A-R6 - ST termination
X1953A-R6 - LC termination
X1954A-R6 - FC (Op) termination
X1955A-R6 - MT-RJ termination

Terms and Abbreviations © 2008 NetApp. All rights reserved. Specifications are subject to change without notice. NetApp, the NetApp logo, Go further,
faster, and Data ONTAP, are trademarks or registered trademarks of NetApp, Inc. in the United States and/or other countries. All
BTU – British Thermal Unit MTP – Mechanical Transfer Pull-Off other brands or products are trademarks or registered trademarks of their respective holders and should be treated as such.
Cu – Copper Connector MT-RJ – Mechanical Transfer Registered Jack RC-0036-0708
FC – Fibre Channel Op – Optical Connector
FC (Op) – Ferrule Connector PDU – Power Distribution Unit This document is subject to change without notice. Be sure to cross-reference the NOW System Configuration Guide at http://
now.netapp.com for the most current information. NetApp employees and partners can check the NetApp 1Stop site at http://
HSSDC – High-Speed Serial Data Connector SC – Subscriber Connector
www.netapp1stop.com for updates. NetApp customers should check with their account teams for updates.
IB – InfiniBand SFP – Small Form-Factor Pluggable
IB4X – InfiniBand 4X ST – Straight Tip Connector This document is chartered under the NetApp Systems Engineering Program Office.
LC – Lucent Connector VHDCI – Very High Density Cable Interconnect

Please recycle after use. Feedback and questions can be sent to [email protected].
 Requires SP1 or higher

Proprietary and Confidential. Restricted to NetApp employees and Channel Partners, each of whom is under NDA obligations.
This document may not be shared with customers without prior written permission from NetApp.
This document is subject to change without notice. Check for updates. Be sure to cross-reference the NOW System Configuration Guide. © Copyright 2007 Network Appliance Inc. All rights reserved.
Min/Max/Grow

Proprietary and Confidential. Restricted to NetApp employees and Channel Partners, each of whom is under NDA obligations.
This document may not be shared with customers without prior written permission from NetApp.
This document is subject to change without notice. Check for updates. Be sure to cross-reference the NOW System Configuration Guide. © Copyright 2007 Network Appliance Inc. All rights reserved.