VPLEX - VPLEX Installation and Upgrade Procedures-Upgrade GeoSynchrony
VPLEX - VPLEX Installation and Upgrade Procedures-Upgrade GeoSynchrony
Topic
VPLEX Installation and Upgrade Procedures
Selections
Upgrade Procedures: Upgrade GeoSynchrony
Upgrade GeoSynchrony Procedures for each release: 6.2 and Patches
Select an upgrade procedure: Upgrade procedure
REPORT PROBLEMS
If you find any errors in this procedure or have comments regarding this application, send email to
[email protected]
Dell, EMC, Dell EMC and other trademarks are trademarks of Dell Inc. or its subsidiaries. Other
trademarks may be the property of their respective owners.
Dell Technologies Confidential Information- for internal use only version: 2.9.0.87
Page 1 of 36
Contents
Preliminary Activity Tasks .......................................................................................................3
A SolVe Engine approval is required for this activity ....................................................................................3
Read, understand, and perform these tasks.................................................................................................3
Dell Technologies Confidential Information- for internal use only version: 2.9.0.87
Page 2 of 36
Preliminary Activity Tasks
This section may contain tasks that you must complete before performing this procedure.
• EMPLOYEES: Please review the latest VPLEX SolVe Engine Change Control Process on the
VPLEX Wiki Change Control page to properly prepare and submit the SolVe Engine activity (Location:
https://dellservices.lightning.force.com/lightning/r/Lightning_Knowledge__kav/ka06P000000TRZIQA4/
view )
• PARTNERS: Please review the Knowledgebase Article: https://support.emc.com/kb/303768
• The SolVe Engine activity must be submitted at least 10 business days prior to the scheduled
upgrade/NDU date and must include
• The exact GeoSynchrony release version that you are upgrading from
• The exact GeoSynchrony release version that you are upgrading to
• A PuTTY log file from the cluster involved in the upgrade (maximum of 2) containing the info outlined
in the VPLEX Change Control Process document, attached to each SolVe task
• A file containing customer SAN switch details, named ‘Switch_data.txt’, which only contains the
make/model/OS version of each switch where the VPLEX is connected into the customer’s SAN
• Each cluster MUST have a separate upgrade SR and the .tar file from the output of the ‘collect-
diagnostics -–noextended’ command must be attached to the respective upgrade SR, NOT the SolVe
Engine.
2. Once approved, record the SolVe Engine activity ID here for future reference:
______________________________________________________________________________
Table 2 List of cautions, warnings, notes, and/or KB solutions related to this activity
• If you find an error in any VPLEX product procedure, that was generated via SolVe Desktop or SolVe
Online,you should report the issue to the SolVe Team using the feedback address located in the KBA
335501 as well surrounding the reporting of any issues,errors confusion in a VPLEX procedure
Dell Technologies Confidential Information- for internal use only version: 2.9.0.87
Page 3 of 36
4. This is a link to the top trending service topics. These topics may or not be related to this activity.
This is merely a proactive attempt to make you aware of any KB articles that may be associated with
this product.
Note: There may not be any top trending service topics for this product at any given time.
Dell Technologies Confidential Information- for internal use only version: 2.9.0.87
Page 4 of 36
Dell Technologies Confidential Information- for internal use only version: 2.9.0.87
Page 5 of 36
NDU_to_Geosynchrony_R6.2_Family Upgrade
Note: The next section is an existing PDF document that is inserted into this procedure. You may see
two sets of page numbers because the existing PDF has its own page numbering. Page x of y on the
bottom will be the page number of the entire procedure.
Dell Technologies Confidential Information- for internal use only version: 2.9.0.87
Page 6 of 36
VPLEX GeoSynchrony
NDU Procedure
6.2 and Patches
January 2022
Page 7 of 36
Notes, cautions, and warnings
NOTE: A NOTE indicates important information that helps you make better use of your product.
CAUTION: A CAUTION indicates either potential damage to hardware or loss of data and tells you how to avoid
the problem.
WARNING: A WARNING indicates a potential for property damage, personal injury, or death.
© 2016 - 2022 Dell Inc. or its subsidiaries. All rights reserved. Dell, EMC, and other trademarks are trademarks of Dell Inc. or its subsidiaries.
Other trademarks may be trademarks of their respective owners.
Page 8 of 36
Contents
Contents 3
Page 9 of 36
1
VPLEX NDU to GeoSynchrony Releases 6.2
Family
This document describes how to upgrade (NDU) GeoSynchrony to VPLEX 6.2 Family without disruptions.
Topics:
• GeoSynchrony Upgrade
• Run the firmware upgrade pre-checks and health-check
• Read the Release Notes
• Log in with the VPLEX CLI
• Verify NDU Readiness
• Upgrade management servers
• Disable Call Home
• Upgrade the management server in cluster 1
• Upgrade the management server in cluster 2
• Re-run NDU pre-check
• Enable Call Home
• Upgrade the firmware on VPLEX Local or Metro systems
• Verify the upgrade
• Complete the upgrade
• Exit the virtual terminal session
• Appendix A: Workflow details of the I/O forwarding phase options
• Appendix B: Version information
• NDU Worksheet
GeoSynchrony Upgrade
● Before beginning any upgrade of GeoSynchrony, read the associated Release Notes. They contain a list of fixed issues as
well as specific information such as the version number, location of files to be downloaded, upgrade paths and verification
details that are required for this upgrade. While reading the Release Notes, use the Worksheet found at the end of
this document to record the values you need for upgrading the system.
● If you are new to upgrading VPLEX, read the NDU Overview before starting an NDU. The overview describes the activities
that occur during NDU and the minimum configuration in which NDU should be run.
NOTE: NDU Overview and NDU Troubleshooting documents are available for download at SolVe.
● Failure to understand the NDU process or what constitutes a High Availability (HA) configuration can result in DU.
● This procedure requires VPLEX to be in a configured state. Specifically, the metavolume must be configured. To upgrade an
unconfigured system (a system without a metavolume), refer to the VPLEX Configuration Guide.
NOTE: This version of GeoSynchrony is a stand-alone upgrade. For example, you can upgrade from version 6.0 or later
directly to this version (including from patch releases).
The following figure provides an overview of the NDU process.
Page 10 of 36
Figure 1. NDU Process
NOTE: Before upgrading the GeoSynchrony version to 6.2, obtain an appropriate license file for your clusters. Install the
license after the upgrade. To obtain the proper license key file for installation, visit the Dell EMC Software Licensing Central
Website with the License Authorization Code (LAC) associated with your acquisition. VPLEX Product Guide and VPLEX
Administration Guide provide you additional details on licensing in VPLEX.
NDU considerations
To direct upgrade to version 6.2 or its patches, you must be running at least GeoSynchrony release 5.5.x or later.
To upgrade to 6.2 and patches, all VPLEX running on pre-5.5.x need one or more step upgrades. For more details, see the
Upgrading Geosynchrony section in the Release Notes 6.2 and Patches.
NOTE: Perform VS6 upgrades from MMCS-A. When you run a Management Server NDU on MMCS-A the software on
MMCS-B is upgraded as well.
For the Metro-IP systems, the following IP WAN firewall ports need to be opened before the NDU:
● TCP 61482-61484
● TCP 32768-61000
CAUTION:
Failure to open the above firewall ports will cause the NDU to fail and rollback.
Any legacy UDP ports that are opened for older VPLEX software versions can be closed after the NDU.
NOTE: In VPLEX GeoSynchrony release 5.4.1 and later, the VPLEX: call-home filename shows NOSERIALNUM instead
of the Top Level Assembly (TLA) of the local directors, which identifies the cluster where the call home event message
originates. This leads to the creation of automated SYR/CLM cases (29.AAA1.58). To resolve this issue, after an upgrade to
5.4.x and before and after an upgrade from 5.4.x to a later version, follow the procedure described in the KnowledgeBase
article 462461.
When FCIP gateways are used between the VPLEX clusters on the Metro FC VS2 and VS6 systems that run the GeoSynchrony
version 6.x, high distributed-device write latency might occur during the high distributed-device write bandwidth (MB/s)
scenario. The VS2 systems on GeoSynchrony 5.x version, which use FCIP gateways, must continue to use the 5.x version until
further notice. For more information, refer to the Knowledge Base article 527524.
If the hosts that run Red Hat Enterprise Linux (RHEL) or SUSE Linux Enterprise Server (SLES) do not have the latest version
of the Dell EMC PowerPath software (with the supported kernel version) configured on them, it might take more time for the
hosts to scan the paths and bring them alive. This issue might cause data unavailability (DU) during the GeoSynchrony upgrade.
For more information, see the Knowledge Base article 529059.
Page 11 of 36
Using the copy and paste feature at the command prompt
This document provides extensive examples of the required commands to perform this upgrade as well as to check system
status and configure options.
While it may be tempting to copy commands directly from the document and paste them into the command line, take care when
doing so.
In some browsers, the output from this document is interpreted incorrectly, causing an error in the command line. For example,
some single dashes (-) before flags are interpreted at the command prompt as dots (.). Some double dashes (--) are
interpreted as single dashes (-). If you must copy and paste a command from the document to the command line, check the
syntax of the command against the command in the document before entering the command.
Table 1. Options for the prompt display during the I/O forwarding phase
Argument Description Prompt
--io-fwd-ask-for-confirmation After an initial wait period of 6 minutes, Continue: NDU continues even when
always the status of host initiator logins is there are missing initiator logins. Make
checked and the details are displayed. sure that the customer is aware that
You are prompted with the options at missing logins can cause DU.
this point. You can continue to type
Rollback: NDU rolls back and DU is
Refresh as needed, before the I/O
avoided. The customer can check the
forwarding phase times out.
host, resolve the issue that led to the
Choose this option if you have hosts missing initiator logins, and rerun the
that require manual scanning for the NDU.
paths to be visible. Assistance from
Refresh: Get the new list of initiators.
the customer is required to verify that
initiator paths on the hosts are alive. If If all the initiators are logged in, VPLEX
the path is unavailable, resolve the issue displays the prompts to move forward.
within the timeout period that you have
specified.
--io-fwd-ask-for-confirmation Assistance from the customer is required Continue: NDU continues even when
on-missing-logins to determine whether any missing there are missing initiator logins. Make
initiators are from critical hosts. If paths sure that the customer is aware that
are unavailable from critical hosts, the missing logins can cause DU.
customer must resolve the issue before
Rollback-: NDU rolls back and DU is
continuing with the NDU.
avoided. The customer can check the
After an initial wait period of 6 host, resolve the issue that led to the
minutes, the status of the host initiator missing initiator logins, and rerun the
logins are checked. If all the initiator NDU.
logins are detected, the NDU continues
automatically (without displaying any Refresh-: Get the new list of initiators.
prompt). If there are missing host After all the initiators are logged in, NDU
initiator logins, they are displayed, and continues without displaying any prompt.
you are prompted with the options.
You can continue to type Refresh as
needed, before the I/O forwarding phase
timeout expires.
Page 12 of 36
Table 1. Options for the prompt display during the I/O forwarding phase (continued)
Argument Description Prompt
--io-fwd-ask-for-confirmation No interaction is required or the This option does not create any prompt.
never customer is not available to check the After an initial wait period of 6 minutes,
host connectivity. NDU waits for all the host initiator logins are checked.
the initiators to log back in within If all initiator logins are detected, the
the specified timeout period. Resolve NDU continues automatically (without
any issues within this period. If VPLEX displaying any prompt). If there are
identifies any missing logins after the missing initiator logins, they are checked
timeout period, NDU is rolled back. again every 10 seconds automatically,
until the I/O forwarding phase times
NOTE: The default IO forwarding
out. At this point, the NDU rolls back
phase timeout is 180 minutes. It automatically (without displaying any
is important to check whether this prompt). If missing initiator logins are
value must be modified according to not detected within the timeout period,
the environment requirements of the the NDU continues.
customers and weighed against the
risks.
To understand the detailed workflow of these options, see Appendix: Workflow details of the I/O forwarding phase options.
Page 13 of 36
● Back-end connectivity checks validate the high availability of the back-end connectivity and ensure enough redundancy to
avoid service disruption in case of failures of cabling, ports, and fabric during NDU. These checks ensure the following:
○ For active-active arrays, four paths are required for each LUN to each director. For active-passive arrays, the
requirement is four active and four passive paths for each LUN to each director for a total of eight paths.
○ There are at least two unique initiators and two unique targets in the set of paths to a LUN from each director.
● Front-end connectivity on minimal configurations does not meet high-availability requirements. Errors may be encountered
during the pre-check.
● NDU pre-checks may or may not pass for systems with partial back-end visibility, depending on the extent of the visibility
across all directors in the system. Lack of visibility may result in a firmware upgrade that fails and rolls back to the current
version.
● High latency on the management network does not meet high-availability requirements. Errors may be encountered during
the pre-check. If so, the latency on the management network should be brought beneath the 2-second threshold.
● If the NDU pre-check detects a problem in the configuration do NOT try to skip the associated pre-checks during the
firmware upgrade. Correct the system configuration error, and follow the recommended configuration according to best
practices before continuing further.
a. This does not include the 180 minutes, which is the default timeout period of the I/O forwarding phase. You can set this
timeout period to a minimum of 6 minutes and a maximum of 12 hours. Controlling the I/O forwarding phase timeout
provides you additional information on the I/O forwarding phase timeout.
b. This does not include the 180 minutes, which is the default timeout period of the I/O forwarding phase. You can set this
timeout period to a minimum of 6 minutes and a maximum of 12 hours. Controlling the I/O forwarding phase timeout
provides you additional information on the I/O forwarding phase timeout.
Page 14 of 36
Assess readiness for write-same feature
Before upgrade, ensure that the arrays are configured to handle the write-same feature.
For AMS 25xx and HUS 110/150 arrays, refer to the Configuring Arrays procedure in the SolVe Desktop generator for steps to
set these arrays to support the write-same feature. For all other arrays, follow the documentation that is provided by the array
vendor to enable the write-same feature for VPLEX.
Connect PuTTY
Connect to the management server using PuTTY
Use either of the following methods to connect to the management server:
● A service laptop that is connected to the service port on the management server.
● PuTTY or SSH on any computer able to connect to the public IP address of the management server.
NOTE: Verify that SSH or PuTTY is set to version 2.
1. Start PuTTY.
2. Connect with the username service.
For VPLEX Metro systems, start two connections (one to each management server).
In this example, PuTTy is configured to use SSH version 2:
Page 15 of 36
Start a new virtual terminal session
To preserve the session from an SSH session loss, start a new virtual terminal session:
screen -S session_name
Where session_name is the name of the session, as displayed in the following example:
NOTE: This virtual terminal session is deleted after the Management Server restarts as part of NDU process. To continue
with NDU after the Management Server restarts, start a new session. To manage your sessions, use these commands:
● screen ls - To view all the running sessions.
● screen -dR session_name - To recover a session at any point .
It is recommended to use a virtual terminal session when a longer timeout period is set for the I/O forwarding phase. Controlling
the I/O forwarding phase timeout provides you additional information on setting the I/O forwarding phase timeout.
service@ManagementServer:~> vplexcli
Trying ::1...
Connected to localhost.
Escape character is '^]'.
2. VPlexcli At the VPlexcli prompt, type the health-check --full command to verify that all values display OK.
4. VPlexcli At the VPlexcli prompt, type the ndu pre-check command to ensure that the system is healthy and ready for
NDU.
Warning:
During the NDU process, multiple directors will be offline for a
portion of the time. This is non-disruptive but is dependent on
a host-based multipathing solution being installed, configured,
and operating on all connected hosts.
Warning:
Page 16 of 36
Please run the "health-check --full" command to verify that the VPLEX
hardware is healthy.
Analyzing system configuration: .DONE
===========================================================================
Performing NDU pre-checks
===========================================================================
Verify NDU is not in progress.. OK
Verify director communication status.. OK
Verify management network redundancy.. OK
.
.
.
Verify cluster witness state.. OK
==========================================================================
==========================================================================
No problems found during NDU pre-check.
==========================================================================
The output for 'ndu pre-check' has been captured
in /var/log/VPlex/cli/capture/ndu-pre-check-session.txt
VPlexcli:/>
service@vplexname:~> vplexcli
Trying 127.0.0.1...
Connected to localhost.
Escape character is '^]'.
Page 17 of 36
Enter User Name: service
Password:
creating logfile:/var/log/VPlex/cli/session.
log_service_localhost_T01234_20110525063015
VPlexcli:/>
VPlexcli:/ version
What Version Info
-------------------- --------------- ----
Product Version version -
SMSv2 D30.60.0.3.0 -
Mgmt Server Base D30.0.0.112 -
Mgmt Server Software D30.60.0.3 -
b. The value that is displayed in the GeoSynchrony version field reflects the version that you are upgrading from. Record
this product version number in the NDU Worksheet. You need this information later in the procedure.
c. See the Dell EMC VPLEX Release Notes to verify that the product version is one of the versions that are listed in the
Upgrade Paths section.
d. For VPLEX Metro systems, log in to the VPlexcli on the management server on cluster 2 and verify that the
GeoSynchrony versions of cluster 1 and cluster 2 match.
2. Verify Cluster Witness (for Metro only).
a. VPlexcli At the VPlexcli prompt (on either cluster), type the following command to check if Cluster Witness is
configured:
ll /cluster-witness/
If VPLEX Witness is not configured, the output of the ll command displays No context found for '/cluster-
witness/.
VPlexcli:/ ll/cluster-witness/
ls: No context found for '/cluster-witness/'
a. VPlexcli At the VPlexcli prompt, type the following to check if any RecoverPoint clusters are configured:
ll /recoverpoint/rpa-clusters
Page 18 of 36
If a RecoverPoint cluster is not configured, the output shows no RecoverPoint clusters:
VPlexcli:/> ll recoverpoint/rpa-clusters/
/recoverpoint/rpa-clusters:
For minimal configurations, the No Dual Paths column indicates that high-availability requirements are not met. If a
metavolume and metavolume backup are not present, the system is not fully configured. Consult the VPLEX Configuration
Guide for the steps to complete the install and configuration. Do not continue if a metavolume and metavolume backup are
not present.
NOTE: Resolve all issues before continuing to the next step. Consult the NDU Troubleshooting procedure in the SolVe
Desktop or contact Dell EMC Customer Support.
The next steps vary depending on the number of clusters in the system:
● For single-cluster systems, skip to Upgrade management servers.
● For VPLEX Metro, continue to the next section and verify connectivity between clusters.
VPlexcli:/> cd notifications/call-home/
Page 19 of 36
2. Type the following command to check the value of enabled attribute.
VPlexcli:/notifications/call-home> ls
Attributes:
Name Value
------- -----
enabled true
Contexts:
snmp-traps
If the enabled property value is false, do not perform the next step.
Note whether call home was enabled or disabled. Later in the procedure, you need this information to determine whether to
enable call home again.
If this command worked, an ls of the context shows that the enabled state of the call home is false .
1. VPlexcli At the VPlexcli prompt on cluster 1, type the exit command to exit VPlexcli:
VPlexcli:/> exit
Connection closed by foreign host.
service@ManagementServer:~>
2. At the management server prompt, type the following command to change the current directory to /tmp/
VPlexInstallPackages, as in this example:
service@ManagementServer:~> cd /tmp/VPlexInstallPackages
service@ManagementServer:/tmp/VPlexInstallPackages>
NOTE: The management server upgrade must be run from the /tmp/VPlexInstallPackages directory.
3. Copy the management server package for the new GeoSynchrony release from the site that is documented in the Release
Notes (and recorded in the NDU Worksheet) to the /tmp/VPlexInstallPackages directory on the management server.
NOTE: Do not upload the director firmware tar files at this step. The management server install process removes all files
from the /tmp/VPlexInstallPackages directory.
For example:
Where:
● username is the username on the server where the management server package has to be copied from.
● ip_address is the IP address of the server where the management server package has to be copied from.
4. At the management server prompt, type ls tar-file-name to confirm that the packages are present:
Page 20 of 36
service@ManagementServer:/tmp/VPlexInstallPackages> ls VPlex-version-management-server-
package.tar
VPlex-version-management-server-package.tar
5. Retrieve the management server software package SHA-256 checksum value from the site that is documented in Release
Notes (recorded in the NDU Worksheet).
6. Type the following command to run VPlex-MS-installer to install the new management server package:
VPlex-MS-installer -v VPlex-version-management-server-package.tar
NOTE: The management server upgrade may restart the management server.
NOTE: Contact Dell EMC Customer Support if this command fails with an error.
7. Type the password for the service account, if prompted. A series of messages is displayed (The following example is from
the version 6.2. The management service package to be used must reflect the version to which the system is upgraded to,
for example, VPlex-6.2.x.xx.xx.xx- management-server-package.tar).
service@dualenginelocal:/tmp/VPlexInstallPackages> VPlex-MS-installer -v
VPlex-6.2.0.00.00.32-management-server-package.tar
Verify that the management server version is the same on both MMCSs.
ok
Checking whether the upgrade path is supported
Enter the service account password:
ok
Upgrade peer MMCS before local MMCS. Transfer /tmp/VPlexInstallPackages to peer MMCS.
ok
8. VPlexcli In the VPlexcli, type the version command to confirm that the versions of the installed management server
package match the versions in the output:
For GeoSynchrony 6.2:
VPlexcli:/> version
What Version Info
------------------------------- -------------- ----------------------------------
Product Version 6.2.0.00.00.32 -
SMSv2 162.0.0.324.0 -
Mgmt Server Base 162.0.0.240 -
Mgmt Server Software 162.0.0.422 -
Cluster Witness Server Software 162.0.0.422 Built against
GeoSynchrony version - 162.0.0.422
During management server upgrade and NDU, output of the version command displays the message: Version
mismatch (or NDU) Version on one or more directors does not match mgmt server or an NDU
is in progress. This message is expected and can be ignored.
Page 21 of 36
9. If you are upgrading a VPLEX Local system, note that local upgrades only require an upgrade of the management server in
cluster 1. After completing this task, continue directly to Enable Call Home.
Upgrade of the management server on cluster 1 is complete.
VPlexcli:/> exit
Connection closed by foreign host.
service@ManagementServer:~>
2. At the management server prompt, type the following command to change the current directory to /tmp/
VPlexInstallPackages, as in this example:
service@ManagementServer:~> cd /tmp/VPlexInstallPackages
service@ManagementServer:/tmp/VPlexInstallPackages>
NOTE: The management server upgrade must be run from the /tmp/VPlexInstallPackages directory.
3. Copy the management server package for the new GeoSynchrony release from the site that is documented in the Release
Notes (and recorded in the NDU Worksheet) to the /tmp/VPlexInstallPackages directory on the management server.
NOTE: Do not upload the director firmware tar files at this step. The management server install process removes all files
from the /tmp/VPlexInstallPackages directory.
For example:
Where:
● username is the username on the server where management server package has to be copied from.
○ ip_address is the IP address of the server where management server package has to be copied from.
4. At the management server prompt, type ls tar-file-name to confirm that the packages are present:
service@ManagementServer:/tmp/VPlexInstallPackages> ls VPlex-version-management-server-
package.tar
VPlex-version-management-server-package.tar
5. Retrieve the management server software package SHA-256 checksum value from the site that is documented in Release
Notes (recorded in the NDU Worksheet).
6. Type the following command to run VPlex-MS-installer to install the new management server package:
VPlex-MS-installer -v VPlex-version-management-server-package.tar
NOTE: The management server upgrade may restart the management server.
Page 22 of 36
NOTE: Contact Dell EMC Customer Support if this command fails with an error.
7. Type the password for the service account, if prompted. A series of messages is displayed (The following example is from
the version 6.2. The management service package to be used must reflect the version to which the system is upgraded to,
for example, VPlex-6.2.x.xx.xx.xx- management-server-package.tar).
service@dualenginelocal:/tmp/VPlexInstallPackages> VPlex-MS-installer -v
VPlex-6.2.0.00.00.32-management-server-package.tar
Verify that the management server version is the same on both MMCSs.
ok
Checking whether the upgrade path is supported
Enter the service account password:
ok
Upgrade peer MMCS before local MMCS. Transfer /tmp/VPlexInstallPackages to peer MMCS.
ok
8. VPlexcli In the VPlexcli, type the version command to confirm that the versions of the installed management server
package match the versions in the output:
For GeoSynchrony 6.2:
VPlexcli:/> version
What Version Info
------------------------------- -------------- ----------------------------------
Product Version 6.2.0.00.00.32 -
SMSv2 162.0.0.324.0 -
Mgmt Server Base 162.0.0.240 -
Mgmt Server Software 162.0.0.422 -
Cluster Witness Server Software 162.0.0.422 Built against
GeoSynchrony version - 162.0.0.422
During management server upgrade and NDU, output of the version command displays the message: Version
mismatch (or NDU) Version on one or more directors does not match mgmt server or an NDU
is in progress. This message is expected and can be ignored.
9. If you are upgrading a VPLEX Local system, note that local upgrades only require an upgrade of the management server in
cluster 1. After completing this task, continue directly to Enable Call Home.
Upgrade of the management server on cluster 2 is complete.
VPlexcli:/>cd /notifications/call-home
VPlexcli:/notifications/call-home> set enabled true
Page 23 of 36
2. Verify Call Home has been enabled by typing the ls command.
If Call Home is enabled, the following output should appear.
Attributes:
Name Value
---- -----
enabled true
Perform the following to upgrade firmware on VPLEX Local and Metro systems.
1. Login to the management server on cluster-1.
2. Copy the director firmware package from the site that is documented in the Release Notes (and recorded in the NDU
Worksheet) to the /tmp/VPlexInstallPackages directory on the management server.
3. At the management server prompt, type ls *director* to confirm that the package is present.
service@ManagementServer:->cd /tmp/VPlexInstallPackages/
service@ManagementServer:/tmp/VPlexInstallPackages> ls *director*
VPlex-version-director-firmware-package.tar
4. Retrieve the director firmware software package SHA-256 checksum value from the site that is documented in the Release
Notes (that should be recorded in the NDU Worksheet).
5. Verify that the SHA-256 checksum of the director firmware package on the management server matches that retrieved in
the NDU Worksheet by typing the following.
If the checksum does not match, remove the corrupted director firmware package and return to step 4.
6. VPlexcli Login to the VPlexcli with the username service and associated password.
7. VPlexcli At the VPlexcli prompt (on cluster 1), type the following command:
● always - Choose this option if you have hosts that require manual scanning for the paths to be visible. Assistance from
the customer is required to verify that initiator paths on the hosts are alive. If the path is unavailable, resolve the issue
within the timeout period that you have specified. The prompts for this options are:
○ Continue: NDU continues even when there are missing initiator logins. Make sure that the customer is aware that
missing logins can cause DU.
Page 24 of 36
○ Rollback: NDU rolls back and DU is avoided. The customer can check the host, resolve the issue that led to the
missing initiator logins, and rerun the NDU.
○ Refresh: Get the new list of initiators. If all the initiators are logged in, VPLEX displays the prompts to move
forward.
● on-missing-logins - Assistance from the customer is required to determine whether any missing initiators are from
critical hosts. If paths are unavailable from critical hosts, the customer will need to resolve the issue before continuing
with the NDU. The prompts for this options are:
○ Continue: NDU continues even when there are missing initiator logins. Make sure that the customer is aware that
missing logins can cause DU.
○ Rollback: NDU rolls back and DU is avoided. The customer can check the host, resolve the issue that led to the
missing initiator logins, and rerun the NDU.
○ Refresh: Get the new list of initiators. After all the initiators are logged in, NDU continues without displaying any
prompt.
● never - No interaction is required or the customer is not available to check the host connectivity. NDU waits for all the
initiators to log back in within the specified timeout period. Resolve any issues within this period. If VPLEX identifies any
missing logins after the timeout period, NDU is rolled back. It is important to check whether this value must be modified
according to the environment requirements of the customers and weighed against the risks.
For more information on these options, see Options for the prompt display during the IO forwarding phase.
time is the period after which the I/O forward phase times out. In the I/O forward phase, the I/Os that are serviced to the
first set of directors are forwarded to the second set of directors. The hosts are expected to connect back to the first set of
directors during this period. By default, this phase lasts for 180 minutes. You can set this timeout period to a minimum of 6
minutes and a maximum of 12 hours. To specify a time, type one of the following letters after the time in numerals:
● s for seconds
● m for minutes
● h for hours
● d for days
Controlling the I/O forwarding phase timeout provides you additional information on the options.
- path is the complete path to the director software package.
.
The following is an example:
To accept the risks and continue with the specified io-fwd-timeout enter 'CONTINUE'.
Otherwise enter 'EXIT' to exit now
and start over: CONTINUE
Initializing VPLEX NDU state: ......DONE
================================================================================
[Tue Jul 10 08:37:34 2018] Preparing for NDU
================================================================================
8. When the upgrade completes, the NDU Finished Successfully message appears. If you do not see this message,
consult the Troubleshooting section or contact Dell EMC Customer Support.
Page 25 of 36
Verify the upgrade
Perform the following tasks to verify the upgrade was successful.
1. VPlexcli At the VPlexcli prompt, type the version -a --verbose command to display version information.
To view the output of this command in various versions, see Appendix B: Version information.
2. Verify that the product version is the version you are upgrading to, and the product component versions are as shown in the
example version output.
NOTE: If you are installing a patch release, see "Version Numbers of Components in a Patch Release" for the specific
version numbers you should see displayed in this output.
3. Verify that the OS version on all directors matches the OS version that is listed in the Release Notes.
4. Verify that the SSD Firmware Version Number on all directors meets the specification that is defined in the following
table. If the Version Number is lower than the specification, reference "Upgrade SSD Firmware" in the NDU Overview and
Background document, available on the SolVe Desktop.
5. Verify the state of Call Home. It is especially important to ensure that Call Home is enabled at the end of an upgrade.
cd /notifications/call-home
ls
Attributes:
Name Value
---- -----
enabled true
If the value shown is Enabled false, type the set enabled true command.
Page 26 of 36
The following example shows a rebuild in progress:
Global rebuilds:
device rebuild type rebuilder director rebuilt/total percent throughput ETA
--------------- ------------ ------------------ ------------- ------- ----------
---------
cx4_dr1_0 logging s1_3b201eb7_spa 384M/2G 18.75% 16.7M/s
8s
cx4_dr1_1 logging s1_3b301eb7_spb 384M/2G 18.75% 11.2M/s
13s
cx4_dr1_3 logging s1_3b301eb7_spb 288M/2G 14.06% 10.8M/s
0.3min
cx4_dr1_4 logging s1_3b201eb7_spa 160M/2G 7.81% 17.8M/s
23s
dr1_x_wins logging s1_3b201eb7_spa 160M/10G 1.56% 14.8M/s
3.15min
Local rebuilds:
No active local rebuilds.
Wait until all rebuilds complete and output from the command appears as follows:
Global rebuilds:
No active global rebuilds.
Local rebuilds:
No active local rebuilds
Page 27 of 36
NOTE: This version of GeoSynchrony supports Role-based Access. Refer to the section "Role-based Access Control
and NDU" in the Dell EMC VPLEX Security Configuration Guide for information about how security policies affect shell
access.
9. Login to the web GUI and verify that the login credentials are working and that the GUI is populated appropriately.
10. (For the VS2 systems) If you are upgrading from a release before Release 5.5 SP1, enable the thin-aware feature on storage
volumes that support Thin Provisioning.
For information on which arrays support Thin Provisioning on VPLEX, see the Simple Support Matrix for VPLEX on Dell EMC
Support Online.
Use the virtual-volume set-thin-enabled true --virtual-volumes virtual-volumes command to enable
thin aware features. VPLEX recognizes the volumes as thin-capable during discovery. By default, they are not set to
thin-enabled. See the VPLEX Administration Guide for details of provisioning and configuring Thin Aware storage volumes.
11. Install an appropriate license for your configuration. Refer to the VPLEX Administration Guide for more information on
installing the license file.
Steps to fix the port-stats-monitor script for post 6.2 through 6.2
Patch 3
This section covers the steps to replace the corrupted script that is installed during the NDU.
NOTE: Do not use this section for 6.2 P4 and later. After upgrading to 6.2 P4, see the section STEPS TO REMOVE THE
TWO LINES ADDED IN THE WORKAROUND ONE ABOVE in the KBA 000157798 to run the script.
VPLEX that is running GeoSynchrony 6.2.x, the port monitoring script is already installed and enabled by default, yet it has been
discovered that there is a memory leak with the current python implementation portion of the script.
Workaround for 6.2.x port monitor script leak issue:
1. Download a copy of the script port_stats_monitor located on the Dell Support site under VPLEX Series > Drivers
and Downloads.
2. Uncompress the .zip file. There are three files, the script and two .json files: port-stats-moitor.py, vs2_config.json,
vs6_config.json.
3. Upload the new version of the script port_stats_monitor.py to the management server folder /opt/emc/VPlex/
jython<tab>/LibExt
Page 28 of 36
NOTE: /opt/emc/VPlex/jython<tab>/, <tab> it means that press the Tab key after typing jython to auto enter the
correct jython folder name.
Sample of directory string after tabbing for jython folder on the VPLEX the script is being loaded onto:
service@ManagementServer:~> cd /opt/emc/VPlex/jython2.7b4/LibExt
service@ManagementServer:/opt/emc/VPlex/jython2.7b4/LibExt>
Example:
VPlexcli:/> port-monitor status
Status: running with the following parameters:
Emails: None
SMTP: None
Local-only: False
Threshold config: None
Directors: director-1-1-B, director-2-1-A, director-1-1-A,
director-2-1-B, director-1-2-A, director-2-2-A, director-1-2-B,
director-2-2-B
NOTE: To configure the port monitoring script to send email, or if thresholds are required to be adjusted, the field
has to work with the customer to do it. The steps for doing it are available in the Dell EMC VPLEX Geosynchrony
Administration Guide 6.2 under Performance and Monitoring.
service@ManagementServer:~> exit
Page 29 of 36
The following illustrates explains the workflow when the --io-fwd-ask-for-confirmation on-missing-logins
option is selected:
Page 30 of 36
The following illustrates explains the workflow when the --io-fwd-ask-for-confirmation never option is selected:
Page 31 of 36
Appendix B: Version information
The version details of VPLEX 6.2 family are as follows:
GeoSynchrony 6.2 on VS2:
What: SMSv2
Version: 162.0.0.324.0
Build time: January 16, 2020 at 10:48:12AM GMT
Build machine: 1330c0e64ccb
Build OS: Linux version 3.13.0-96-generic on amd64
Build compiler: 1.8.0_222
Page 32 of 36
Build source: /export/local1/jenkins/clone_legacy/ui
What: NSFW
Version: 162.0.0.422.0
What: ZPEM
Version: 162.0.0.422.0-0
What: ECOM
Version: 162.0.0.232.0-0
What: ZECL
Version: 162.0.0.422.0-0
What: SMSv2
Version: 162.0.0.324.0
Build time: January 16, 2020 at 10:48:12AM GMT
Build machine: 1330c0e64ccb
Build OS: Linux version 3.13.0-96-generic on amd64
Build compiler: 1.8.0_222
Build source: /export/local1/jenkins/clone_legacy/ui
Page 33 of 36
What: NSFW
Version: 162.0.0.422.0
What: ZPEM
Version: 162.0.0.422.0-0
What: ECOM
Version: 162.0.0.232.0-0
What: ZECL
Version: 162.0.0.422.0-0
NDU Worksheet
Before beginning your NDU, use this worksheet to record information that you will need during the NDU.
Description Contents
Collect NDU information from the Release Notes and from the NDU Procedure.
From the Release Notes
Upgrade to software version from the Release Notes
(version)
Location of the management server package for the new
GeoSynchrony release (VPlex-version-management-
serverpackage.tar)
Page 34 of 36
Description Contents
Service account password
Starting GeoSynchrony version on cluster 1
Does cluster 1 version match cluster 2 version? Yes / No
Will the customer or the storage administrator be available to Yes/No
verify the I/O paths or manually scan the I/O paths on the
hosts during the I/O forwarding phase of the NDU?
Is your VPLEX instance connected to non-production hosts? Yes/No
If your VPLEX instance is connected to non-production hosts, Yes/No/NA
do you have the list of initiators on them?
VPLEX Witness information:
VPLEX Witness server configured (Metro only)? Yes / No
VPLEX Witness public IP address?
For configurations containing a RecoverPoint splitter:
RecoverPoint splitter configured? Yes / No
RPA Host IP address of splitter
Page 35 of 36
Dell Technologies Confidential Information- for internal use only version: 2.9.0.87
Page 36 of 36