Isilon ® SolVe Generator

Solution for Validating your engagement

Topic
NL400
Selections
NL400 - Select CTO Node Activity: Replace Drive

Generated: August 27, 2022 6:49 PM GMT

REPORT PROBLEMS

If you find any errors in this procedure or have comments regarding this application, send email to
[email protected]

Copyright © 2022 Dell Inc. or its subsidiaries. All Rights Reserved. Dell Technologies, Dell, EMC, Dell
EMC and other trademarks are trademarks of Dell Inc. or its subsidiaries. Other trademarks may be
trademarks of their respective owners.

The information in this publication is provided “as is.” Dell Inc. makes no representations or warranties of
any kind with respect to the information in this publication, and specifically disclaims implied warranties of
merchantability or fitness for a particular purpose.

Use, copying, and distribution of any software described in this publication requires an applicable
software license.

This document may contain certain words that are not consistent with Dell's current language guidelines.
Dell plans to update the document over subsequent future releases to revise these words accordingly.

This document may contain language from third party content that is not under Dell's control and is not
consistent with Dell's current guidelines for Dell's own content. When such third party content is updated
by the relevant third parties, this document will be revised accordingly.

Publication Date: August, 2022

Dell Technologies Confidential Information version: 5.0.0.21

Page 1 of 20
 Contents
Preliminary Activity Tasks .......................................................................................................3
Read, understand, and perform these tasks.................................................................................................3

General Information for Removing and Installing FRUs..........................................................4

Avoiding Electrostatic Discharge (ESD) damage..........................................................................................4
Emergency procedures (without an ESD kit)...........................................................................................4
Removing, installing, or storing FRUs .....................................................................................................5
NL400 Drive Replacement Guide ...........................................................................................6

Dell Technologies Confidential Information version: 5.0.0.21

Page 2 of 20
Preliminary Activity Tasks
This section may contain tasks that you must complete before performing this procedure.

Read, understand, and perform these tasks

1. Table 1 lists tasks, cautions, warnings, notes, and/or knowledgebase (KB) solutions that you need to
be aware of before performing this activity. Read, understand, and when necessary perform any
tasks contained in this table and any tasks contained in any associated knowledgebase solution.

Table 1 List of cautions, warnings, notes, and/or KB solutions related to this activity

2. This is a link to the top trending service topics. These topics may or not be related to this activity.
This is merely a proactive attempt to make you aware of any KB articles that may be associated with
this product.

Note: There may not be any top trending service topics for this product at any given time.

Isilon - PowerScale Top Service Topics

Dell Technologies Confidential Information version: 5.0.0.21

Page 3 of 20
General Information for Removing and Installing FRUs
This section describes precautions you must take and general procedures you must follow when
removing, installing, or storing field-replaceable units (FRUs). The procedures in this section apply to FRU
handling during hardware upgrades as well as during general replacement.
FRUs are designed to be powered up at all times. This means you can accomplish FRU replacements
and most hardware upgrades while the cabinet is powered up. To maintain proper airflow for cooling and
to ensure EMI compliance, make sure all front bezels, filler panels, and filler modules are reinstalled after
the FRU replacement or hardware upgrade is completed.

Avoiding Electrostatic Discharge (ESD) damage

When replacing or installing FRUs, you can inadvertently damage the sensitive electronic circuits in the
equipment by simply touching them. Electrostatic charge that has accumulated on your body discharges
through the circuits. If the air in the work area is very dry, running a humidifier in the work area helps
decrease the risk of ESD damage. You must use the following procedures to prevent damage to the
equipment, so read the following instructions carefully.
• Provide enough room to work on the equipment. Clear the work site of any unnecessary materials or
materials that naturally build up electrostatic charge, such as foam packaging, foam cups, cellophane
wrappers, and similar items.
• Do not remove replacement or upgrade FRUs from their antistatic packaging until you are ready to
install them.
• Gather the ESD kit and all other materials you will need before you service a component. Once
servicing begins, you should avoid moving away from the work site; otherwise, you may build up an
electrostatic charge.
• Use the ESD kit when handling any FRU.
If an emergency arises and the ESD kit is not available, follow the procedures in the section
Emergency procedures (without an ESD kit).
• Use the ESD wristband that is supplied with your system.
To use it, attach the clip of the ESD wristband (strap) to any bare (unpainted) metal on the cabinet
enclosure; then secure the wristband around your wrist with the metal button against your skin.

Emergency procedures (without an ESD kit)

In an emergency, when an ESD kit is not available, use the following procedures to reduce the possibility
of an electrostatic discharge by ensuring that your body and the subassembly are at the same
electrostatic potential.

IMPORTANT: These procedures are not a substitute for the use of an ESD kit. You should follow them
only in the event of an emergency.

• Before touching any FRU, touch a bare (unpainted) metal surface of the enclosure.
• Before removing any FRU from its antistatic bag, place one hand firmly on a bare metal surface of the
enclosure, and at the same time, pick up the FRU while it is still sealed in the antistatic bag. Once you
have done this, do not move around the room or contact other furnishings, personnel, or surfaces
until you have installed the FRU.
• When you remove a FRU from the antistatic bag, avoid touching any electronic components and
circuits on it.

Dell Technologies Confidential Information version: 5.0.0.21

Page 4 of 20
 • If you must move around the room or touch other surfaces before installing a FRU, first place the
FRU back in the antistatic bag. When you are ready again to install the FRU, repeat these
procedures.

Removing, installing, or storing FRUs

Use the following precautions when you remove, handle, or store FRUs:
• Do not remove a FRU from the cabinet until you have the replacement available.
• Handle a FRU only when wearing a properly attached ESD wristband:
Attach the clip of the ESD wristband to the ESD bracket or to a bare metal portion of the FRU’s
enclosure.
Secure the wristband around your wrist with the metal button against your skin.
• Handle a FRU gently. A sudden jar, drop, or violent vibration can permanently damage some FRUs.
• The weight of some FRUs is not evenly distributed. To prevent personal injury or equipment damage
when removing, installing, or handling theses FRUs, use both hands and provide extra support at the
heavy end of the FRU.
• Never use excessive force to remove or install a FRU.
• Store a FRU in the antistatic bag and the specially designed shipping container in which you received
it. Use this special shipping container when you need to return the FRU.
• If you need to store a FRU for a short time, make sure the temperature of the location where you
store the FRU is within the limits specified by the FRU’s Technical Specifications.
• Disk modules are sensitive to the extreme temperatures sometimes encountered during shipping. We
recommend that you leave a new disk module in its shipping container and allow it to acclimate to the
installation site’s ambient temperature for at least four hours before operating the new module in the
system.
• When removing a disk module, pull the module part way out of the slot; then wait 30 seconds for the
drive to spin down before removing it.
• When installing multiple disks in a powered-up system, wait at least 6 seconds before sliding the
second and each subsequent disk into the system.
• Place a disk module on a soft, antistatic surface, such as an industry-standard antistatic foam pad or
the container used to ship the module. Never place a disk module directly on a hard surface.

Dell Technologies Confidential Information version: 5.0.0.21

Page 5 of 20
NL400 Drive Replacement Guide

Note: The next section is an existing PDF document that is inserted into this procedure. You may see
two sets of page numbers because the existing PDF has its own page numbering. Page x of y on the
bottom will be the page number of the entire procedure.

Dell Technologies Confidential Information version: 5.0.0.21

Page 6 of 20
Isilon NL400

Replace a drive
Rev. M
August 2020

• Replacing a drive.........................................................................................................................................................................................................2
• Drive types...................................................................................................................................................................................................................2
• Confirm SSD compatibility.........................................................................................................................................................................................2
• Gather logs.................................................................................................................................................................................................................. 2
• Install a drive support package..................................................................................................................................................................................3
• Download a Field Replacement Unit (FRU) package.............................................................................................................................................3
• Smartfail the drive...................................................................................................................................................................................................... 3
• Install the drive replacement..................................................................................................................................................................................... 4
• Install the FRU package and run scripts.................................................................................................................................................................. 7
• Update drive firmware............................................................................................................................................................................................... 9
• Verify a drive firmware update................................................................................................................................................................................ 10
• Remove drive support package installation file..................................................................................................................................................... 10
• Gather logs..................................................................................................................................................................................................................11
• Returning a failed part to Isilon.................................................................................................................................................................................11
• Update the install database...................................................................................................................................................................................... 11
• Where to go for support........................................................................................................................................................................................... 11

Regulatory Model: 994-0018-01

Page 7 of 20
Replacing a drive
You can replace a failed drive in the field.
CAUTION: Perform this procedure on only one node at a time. Performing maintenance on multiple nodes in parallel may lower
the protection level of the cluster, put data at risk, and lead to the interruption of client workflows.

Working with clusters in SmartLock compliance mode

Clusters running in SmartLock compliance mode require a sudo prefix to run root commands.
If a cluster is running in SmartLock compliance mode, root access is disabled on the cluster. Because of this, you can run some commands
only through the sudo program. Prefixing a command with sudo enables you to run commands that require root access. For example, if
you do not have root access, the following command fails:

isi drivefirmware status

However, if you are on the sudoers list, the following command succeeds:

sudo isi drivefirmware status

Compliance mode commands that require changes beyond the sudo prefix are noted in the procedure steps.
For more information on the sudo program and compliance mode commands, see the OneFS CLI Administration Guide.

Drive types
This procedure applies to all drive types.
You can follow this procedure with self-encrypting drives (SEDs), hard disk drives (HDDs), or solid state drives (SSDs).

Confirm SSD compatibility

If you are installing a new solid state drive (SSD) into a cluster, you must confirm that the drive you have onsite is compatible with the
cluster.

About this task

See the Isilon Supportability and Compatibility Guide to determine whether the drive you have is compatible with the cluster.

Gather logs
Before you begin any maintenance on a cluster, gather cluster logs.

About this task

You must collect cluster logs before all maintenance procedures. Cluster logs provide snapshots of the cluster, which you can review to
make sure that maintenance is successful.

Steps
1. Open a secure shell (SSH) connection to any node in the cluster and log in.
2. Gather cluster logs by running the following command:
isi_gather_info

Page 8 of 20
Install a drive support package
Before you install a new drive, download and install the drive support package. The drive support package updates drive configuration
information on the node, and contains the latest firmware versions for Isilon qualified drives.

About this task

The drive support package is only supported by clusters running OneFS 7.1.1 or later. If your cluster is running an earlier version of OneFS,
you can skip this step.

Steps
1. Go to the EMC Support page that lists all the available versions of the drive support package.
2. Click the latest version of the drive support package and download the file.
NOTE: See the Considerations for installing the latest drive support package section in order to select the appropriate
variant of the package. If you are unable to download the package, contact EMC Isilon Technical Support for assistance.

3. Open a secure shell (SSH) connection to any node in the cluster and log in.
4. Create or check for the availability of the directory structure /ifs/data/Isilon_Support/dsp.
5. Copy the downloaded file to the dsp directory through SCP, FTP, SMB, NFS, or any other supported data-access protocols.
6. Unpack the drive support package by running the following command:
tar -zxvf Drive_Support_<version>.tgz
7. Install the package by running the following command:
isi_dsp_install Drive_Support_<version>.tar
NOTE: You must run the isi_dsp_install command to install the dirve support package. Do not use the isi pkg
command.

Download a Field Replacement Unit (FRU) package

Before you replace a component in a configure-to-order (CTO) node, obtain a Field Replacement Unit (FRU) package from the EMC FTP
site. The FRU package updates the CTO and as-built information on the node, then forwards the updated information to Isilon Technical
Support.

About this task

Steps
1. Download the latest FRU package from ftp://ftp.emc.com/outgoing/Fru_Package/.
2. Note the name of the FRU package. You will use the name for other commands.
Package names follow this convention:
IsiFru_Package_ <date-time-stamp> .tgz
For example: IsiFru_Package_201507072125.tgz

3. Place the FRU package on the cluster through a network drop, or by asking someone at the cluster site to place the package for you.
If neither of these options is available to you, contact Isilon Technical Support for assistance.

Smartfail the drive

Before removing a drive from a node, you should make sure the drive has been smartfailed.

Steps
1. Open a secure shell (SSH) connection to the node that contains the drive you want to remove. Type the command:
ssh <cluster-name>-<node-number>

Page 9 of 20
2. Confirm the node number and bay number of the drive you want to remove. Depending on your version of OneFS, type one of the
following commands:

OneFS 8.0 or later isi devices drive list

Earlier than OneFS isi devices
8.0

NOTE: Note the node number and bay number of the drive you want to remove. If the drive you need to remove has already
been smartfailed automatically, you can skip the next step. A smartfailed drive will display a status of REPLACE or, if the
node was restarted after the smartfail, a status of EMPTY. A smartfailed SED drive might display a status of ERASE. This
status also indicates the node is ready to be replaced.

3. Using the node number and bay number of the drive, smartfail the drive by typing one of the following commands:

OneFS 8.0 or later isi devices drive smartfail <bay-number> --node-lnn <node-number>
Earlier than OneFS isi devices -a smartfail -d <node-number>:bay<bay-number>
8.0

If the drive does not respond to the smartfail command, do not remove it from the node. Contact Isilon Technical Support.

4. Confirm that the drive was smartfailed by repeating step two.

CAUTION: Do not replace the drive until you have confirmed that the smartfail process is complete.

Install the drive replacement

Remove the failed drive and install the replacement drive.

Access the drives

You can access drives by removing the panels that cover the drive bays.

Steps
1. To access drives at the front of the node, remove the front panel.

Page 10 of 20
 There is a release button on each side of the front panel. To remove the panel, press in the panel release buttons while pulling the
panel away from the node.

2. To access drives at the back of the node, remove the rear EMI shield.
There is a vertical handle at each end of the shield. To remove the shield, press the handles toward the center of the shield while
pulling away from the node.

Page 11 of 20
 1

Remove the failed drive

Drives are secured in the node. You must release the locking handle before removing a drive.

Steps
To remove a drive, pull the locking handle on the drive toward you.
The drive will release from the node.

Install the new drive

You install a drive in a node by inserting it into an empty drive bay.

Steps
1. With the locking handle on the drive open, insert the drive into the empty drive bay by sliding the drive along the bay rails until it stops.

Page 12 of 20
 Do not force the drive into the drive bay. Forcing the drive into the drive bay could damage both the drive and the drive bay.
2. Hold the drive in place and gently push the locking handle down against the end of the drive to secure, or seat, the drive in the node.
Drives that are not fully seated will not be recognized when the node is started, and a red light will appear above the drive. To avoid
this problem, run your finger across all the installed drives to ensure that they are all seated evenly.
3. Connect the drive to the node using the node number and bay number where you just inserted the drive. Depending on your version of
OneFS, run one of the following commands:

OneFS 8.1 or later OneFS will automatically add the drive. If ARR (Automatic Replacement Recognition) has been disabled, add
the drive with the OneFS 8.0 command.
OneFS 8.0 isi devices drive add <bay-number> --node-lnn <node-number>
Earlier than OneFS isi devices -a add -d <node-number>:<bay-number>
8.0

The add command connects the drive to the node.

If the add command fails, make sure that the drive is formatted by running one of the following commands:

OneFS 8.0 or later isi devices format <bay-number> --node-lnn <node-number>

Earlier than OneFS isi devices -a format -d <node-number>:<bay-number>
8.0

The format command introduces the drive to the cluster.

If the drive does not respond to either of these commands, do not remove the drive from the node. Contact Isilon Technical Support.

4. After the new drive has been installed, replace the front panel on the node by aligning the panel with the front of the node and
pressing the panel until it clicks onto the node.
If you replaced a drive in the rear of the node, replace the EMI shield.

Install the FRU package and run scripts

Update the configure-to-order (CTO) and as-built information on the node by installing a FRU package.
NOTE: If your cluster is running in SmartLock compliance mode with OneFS 7.0.2.10 or later, 7.0.1.4 or later, or 7.1.1.0 or later
you will need to enter the provided compliance mode commands to run the FRU scripts. If your cluster is running in compliance
mode but is not running one of these versions, you will need to upgrade your OneFS version to support the compliance mode
commands. Contact Isilon Technical Support.

Install the FRU package on the node

Unpack and install the FRU package on the node.

Steps
1. Place the FRU package on the node.
2. Unpack the FRU package by running the following command:
tar -zxvf IsiFru_Package_<date-time-stamp>.tgz

3. Type cd to change to the directory containing the FRU tar.

4. Install the package. Depending on your version of OneFS, run one of the following commands:

OneFS 8.0 or later isi upgrade patches install IsiFru_Package_<date-time-stamp>.tar --rolling=false

Earlier than OneFS isi pkg install IsiFru_Package_<date-time-stamp>.tar
8.0

As the package installs, the following message appears:

Preparing to install the package...
Checking the package for installation...
Installing the package

Page 13 of 20
 Committing the installation...
Package is committed.

Run the update script

After the FRU package is installed on the node, run the update script.

Steps
1. Move to the FRU package location by running the following command:
cd /var/crash/cto/fruPackages/IsiFru_Package_<date-time-stamp>

2. Perform the update script by running the following command:

./isi_fru_update_cluster
The system displays confirmation of the following items:
• CTO capability
• Current node hardware configuration

Run the ABR script

Run the As Built Record (ABR) script to report the updated hardware to Isilon Technical Support.

Steps
1. Verify installation of the updated hardware by running the following command:
./isi_cto_update --abr
The update is verified and a series of status messages confirm the node configuration, and if an FTP connection is available, an
updated ABR is sent to Isilon Technical Support.
2. If an external connection is not available, manually collect and deliver to Isilon Technical Support the updated ABR.
3. If the cluster is running in SmartLock compliance mode, verify installation of the updated hardware by running the following command:
sudo /usr/bin/isi_hwtools/isi_cto_update --abr --filepath .
NOTE: You must include the period at the end of the command.

Sending an ABR to Isilon with no connectivity

If no external connectivity is available, the As Built Record on a Configure to Order (CTO) node cannot be automatically delivered to Isilon
Technical Support.
If external connectivity is available, the ABR is automatically generated and delivered to Isilon Technical Support. If there is no external
connectivity available, you must generate and copy the ABR from the node, and then send the ABR to Isilon Technical Support through an
alternate connection.

Generate an ABR
You can manually send an As Built Record (ABR) by copying an XML file from the node and emailing the file to Isilon Technical Support.
You need network access to the node, or you can request that the customer provide the file to you.

Steps
1. Generate an ABR by running the following command:
isi_make_abr

The command generates a temporary file named asbuilt_ <serial-number>_<date-time-stamp> .xml.

2. Identify the full name of the ABR file by running the following command:
isi_inventory_tool --display --itemType asbuilt | grep asbuiltFileName=
The system output contains information about the ABR file.

Page 14 of 20
3. Place the ABR file where you can copy it by running the following command:
isi_inventory_tool --display --itemType asbuilt > /ifs/asbuilt_ <serial-number>_<date-time-
stamp> .xml

4. Copy the generated asbuilt_ <serial-number>_<date-time-stamp> .xml file.

5. If an FTP connection is not available, contact Isilon Technical Support for an alternate delivery method.

Remove the FRU package from the node

After all scripts are run, remove the FRU package from the node.

Steps
1. Change out of the FRU package directory by running the following command:
cd /
2. Delete the FRU package from the node. Depending on your version of OneFS, run one of the following commands:

OneFS 8.0 or later isi upgrade patches uninstall IsiFru_Package_ <date-time-stamp>

Earlier than OneFS isi pkg delete IsiFru_Package_ <date-time-stamp>
8.0

Update drive firmware

After you install a new drive in a node, update drive firmware.

About this task

This procedure explains how to update drive firmware on clusters running OneFS 7.1.1 or later. If your cluster is running an earlier version
of OneFS, you must download and install the latest drive firmware package. For more information, see the latest drive firmware package
release notes available on https://support.emc.com/.

NOTE: Do not restart or power off nodes while drive firmware is being updated on the cluster.

Steps
1. Open a secure shell (SSH) connection to any node in the cluster and log in.
2. Depending on your version of OneFS, run one of the following commands to update the drive firmware for your cluster:

OneFS 8.0 or later To update the drive firmware for your entire cluster, run the following command:
isi devices drive firmware update start all --node-lnn all
To update the drive firmware for a specific node only, run the following command:
isi devices drive firmware update start all --node-lnn <node-number>

OneFS 7.1.1 - For OneFS versions between 7.1.1 - 8.0 you will need to run the following command on each node that
OneFS 8.0 requires drive firmware:
isi devices -a fwupdate

CAUTION: You must wait for one node to finish updating before you initiate an update on the next node. To confirm that a
node has finished updating, run the following command:

isi devices -d <node-number>

A drive that is still updating will display a status of FWUPDATE.

Updating the drive firmware of a single drive takes approximately 15 seconds, depending on the drive model. OneFS updates drives
sequentially.

Page 15 of 20
Verify a drive firmware update
After you update the drive firmware in a node, confirm that the firmware is updated properly and that the affected drives are operating
correctly.

Steps
1. Ensure that no drive firmware updates are currently in progress by running one of the following commands:

OneFS 8.0 or later isi devices drive firmware update list

Earlier than OneFS isi devices

8.0

If a drive is currently being updated, [FW_UPDATE] appears in the status column.

2. Verify that all drives have been updated by running the following command:

OneFS 8.0 or later isi devices drive firmware list

Earlier than OneFS isi drivefirmware status

8.0

If all drives have been updated, the Desired FW column is empty.

3. Verify that all affected drives are operating in a healthy state by running the following command:

OneFS 8.0 or later isi devices drive list --node-lnn all

Earlier than OneFS isi devices

8.0

If a drive is operating in a healthy state, [HEALTHY] appears in the status column.

Remove drive support package installation file

Remove the installation file to make sure there is no chance of installing the incorrect drive support package (DSP) in the future.

Prerequisites
Update the drive firmware in a node and confirm that the firmware is updated properly and that the affected drives are operating
correctly.

About this task

Steps
1. Change to the directory where the installation file resides.
cd /ifs/data/ Isilon_Support/dsp
2. Remove the installation file.
rm Drive_Support_<version>.tar

10

Page 16 of 20
Gather logs
After you complete maintenance on a cluster, gather cluster logs.

About this task

You must collect cluster logs after all maintenance. Cluster logs provide snapshots of the cluster that you can review to make sure that
maintenance is successful.

Steps
Gather cluster logs by typing the command:
isi_gather_info

Returning a failed part to Isilon

Return the failed part to Isilon Technical Support.

Steps
1. Contact Isilon Technical Support to notify them that you are returning a failed part.
2. Package the failed part in the packaging materials provided with the replacement part.
3. Attach the return label that was included with the replacement part.
4. For the RMA number, write the support case number provided by Isilon Technical Support.
5. Ship the failed part to the address specified on the return label.

Update the install database

After all work is complete, update the install database.

Steps
1. Browse to the EMC Product Registration and Install base Maintenance service portal, at: http://emc.force.com/createPSCcase.
2. Select the Product Registration and Install Base Maintenance option.
3. To open the form, select the IB Status Change option.
4. Complete the form with the applicable information.
5. To submit the form, click Submit.

Where to go for support

Contact EMC Isilon Technical Support for any questions about EMC Isilon products.

Online Support Live Chat

Create a Service Request

Telephone Support United States: 1-800-SVC-4EMC (800-782-4362)

Canada: 800-543-4782
Worldwide: +1-508-497-7901
For local phone numbers for a specific country, see EMC Customer Support Centers.

Help with Online Support For questions specific to EMC Online Support registration or access, email [email protected].

Isilon Info Hubs For the list of Isilon info hubs, see the Isilon Info Hubs page on the EMC Isilon Community Network. Isilon info
hubs organize Isilon documentation, videos, blogs, and user-contributed content into topic areas, making it
easy to find content about subjects that interest you.

11

Page 17 of 20
Support for IsilonSD Edge
If you are running a free version of IsilonSD Edge, community support is available through the EMC Isilon Community Network. However, if
you have purchased one or more licenses of IsilonSD Edge, you can contact EMC Isilon Technical Support for assistance, provided you
have a valid support contract for the product.

12

Page 18 of 20
Notes, cautions, and warnings

NOTE: A NOTE indicates important information that helps you make better use of your product.

CAUTION: A CAUTION indicates either potential damage to hardware or loss of data and tells you how to avoid the problem.

WARNING: A WARNING indicates a potential for property damage, personal injury, or death.

© 2017 - 2020 Dell Inc. or its subsidiaries. All rights reserved. Dell, EMC, and other trademarks are trademarks of Dell Inc. or its subsidiaries. Other
trademarks may be trademarks of their respective owners.

Page 19 of 20
Dell Technologies Confidential Information version: 5.0.0.21

Page 20 of 20