Requirements
Requirements
Requirements
Element Software
NetApp
December 08, 2023
Networking
The network setup for a SolidFire system consists of switch and port requirements. The
implementation of these depends on your system.
1
Best Practice: You should implement the following best practices when configuring Ethernet switches for
cluster traffic:
• For non-storage traffic in the cluster, deploy a pair of 1GbE switches to provide high availability and load
sharing.
• On the storage network switches, deploy switches in pairs and configure and utilize jumbo frames (an
MTU size of 9216 bytes). This ensures a successful installation and eliminates storage network errors
due to fragmented packets.
Element deployment requires at least two network segments, one for each of the following types of traffic:
• Management
• Storage/Data
Depending on the NetApp H-Series storage node models and the planned cabling configuration, you can
physically separate these networks using separate switches or logically separate them using VLANs. For most
deployments, however, you need to logically separate these networks using VLANs.
Storage nodes need to be able to communicate before, during, and after deployment.
If you are implementing separate management networks for storage nodes, ensure that these management
networks have network routes between them. These networks must have gateways assigned, and there must
be a route between the gateways. Ensure that each new node has a gateway assigned to facilitate
communication between nodes and management networks.
• All switch ports connected to NetApp H-Series storage nodes must be configured as spanning tree edge
ports.
◦ On Cisco switches, depending on the switch model, software version and port type, you can do this
with one of the following commands:
▪ spanning-tree port type edge
▪ spanning-tree port type edge trunk
▪ spanning-tree portfast
▪ spanning-tree portfast trunk
◦ On Mellanox switches, you can do this with the spanning-tree port type edge command.
• The switches handling storage traffic must support speeds of at least 10GbE per port (up to 25GbE per
port is supported).
• The switches handling management traffic must support speeds of at least 1GbE per port.
• You must configure jumbo frames on the switch ports handling storage traffic. Hosts must be able to send
9000 byte packets end-to-end for a successful installation.
• Round-trip network latency between all storage nodes should not exceed 2ms.
Some nodes provide additional out-of-band management capabilities via a dedicated management port.
NetApp H300S, H500S, and H700S nodes also allow for IPMI access via Port A. As a best practice, you
should ease remote management by configuring out-of-band management for all nodes in your environment.
2
For more information
• NetApp HCI network and switch requirements
• SolidFire and Element Software Documentation
• NetApp Element Plug-in for vCenter Server
Enable ICMP between the management node, nodes running Element software, and cluster
MVIP.
Management node Storage node MIP 442 UI and API access to storage node
and Element software upgrades
3
Source Destination Port Description
Management node Storage cluster MVIP 442 UI and API access to storage node
and Element software upgrades
Management node Storage cluster MVIP 443 UI and API access to storage node
and Element software upgrades
Management node Storage node BMC/IPMI 623 UDP RMCP port. This is required to
manage IPMI-enabled systems.
Management node Witness Node 9442 Per-node configuration API service
Management node vCenter Server 9443 vCenter Plug-in registration. The port
can be closed after registration is
complete.
Storage node BMC/IPMI Management node 623 UDP RMCP port. This is required to
manage IPMI-enabled systems.
Storage node MIP DNS servers 53 TCP/UDP DNS lookup
Storage node MIP Management node 162 UDP (Optional) SNMP traps
Storage node MIP SNMP server 162 UDP (Optional) SNMP traps
Storage node MIP LDAP server 389 TCP/UDP (Optional) LDAP lookup
Storage node MIP Management node 443 Element storage firmware upgrades
4
Source Destination Port Description
Storage node MIP Remote storage cluster 443 Remote replication cluster pairing
MVIP communication
Storage node MIP Remote storage node MIP 443 Remote replication cluster pairing
communication
10514
TCP/UDP
10514
TCP/UDP
Storage node MIP Remote storage node MIP 2181 Intercluster communication for
remote replication
Storage node SIP Remote storage node SIP 2181 Intercluster communication for
remote replication
Storage node SIP Remote storage node SIP 4000 through Remote replication node-to-node
4020 data transfer
System administrator PC Storage node MIP 442 HTTPS UI and API access to storage
node
System administrator PC Storage cluster MVIP 443 HTTPS UI and API access to storage
cluster
5
Source Destination Port Description
System administrator PC Storage node baseboard 443 HTTPS UI and API access to node
management controller remote control
(BMC)/Intelligent Platform
Management Interface
(IPMI) H410 and H600
series
System administrator PC Storage node MIP 443 HTTPS storage cluster creation,
post-deployment UI access to
storage cluster
System administrator PC Storage node BMC/IPMI 623 UDP Remote Management Control
H410 and H600 series Protocol port. This is required to
manage IPMI-enabled systems.
vCenter Server Storage cluster MVIP 443 vCenter Plug-in API access
vCenter Server Storage cluster MVIP 8444 vCenter VASA provider access
(VVols only)
vCenter Server Management node 9443 vCenter Plug-in registration. The port
can be closed after registration is
complete.
6
Copyright information
Copyright © 2023 NetApp, Inc. All Rights Reserved. Printed in the U.S. No part of this document covered by
copyright may be reproduced in any form or by any means—graphic, electronic, or mechanical, including
photocopying, recording, taping, or storage in an electronic retrieval system—without prior written permission
of the copyright owner.
Software derived from copyrighted NetApp material is subject to the following license and disclaimer:
THIS SOFTWARE IS PROVIDED BY NETAPP “AS IS” AND WITHOUT ANY EXPRESS OR IMPLIED
WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY
AND FITNESS FOR A PARTICULAR PURPOSE, WHICH ARE HEREBY DISCLAIMED. IN NO EVENT SHALL
NETAPP BE LIABLE FOR ANY DIRECT, INDIRECT, INCIDENTAL, SPECIAL, EXEMPLARY, OR
CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT LIMITED TO, PROCUREMENT OF SUBSTITUTE
GOODS OR SERVICES; LOSS OF USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER
CAUSED AND ON ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT
(INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE OF THIS
SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE.
NetApp reserves the right to change any products described herein at any time, and without notice. NetApp
assumes no responsibility or liability arising from the use of products described herein, except as expressly
agreed to in writing by NetApp. The use or purchase of this product does not convey a license under any
patent rights, trademark rights, or any other intellectual property rights of NetApp.
The product described in this manual may be protected by one or more U.S. patents, foreign patents, or
pending applications.
LIMITED RIGHTS LEGEND: Use, duplication, or disclosure by the government is subject to restrictions as set
forth in subparagraph (b)(3) of the Rights in Technical Data -Noncommercial Items at DFARS 252.227-7013
(FEB 2014) and FAR 52.227-19 (DEC 2007).
Data contained herein pertains to a commercial product and/or commercial service (as defined in FAR 2.101)
and is proprietary to NetApp, Inc. All NetApp technical data and computer software provided under this
Agreement is commercial in nature and developed solely at private expense. The U.S. Government has a non-
exclusive, non-transferrable, nonsublicensable, worldwide, limited irrevocable license to use the Data only in
connection with and in support of the U.S. Government contract under which the Data was delivered. Except
as provided herein, the Data may not be used, disclosed, reproduced, modified, performed, or displayed
without the prior written approval of NetApp, Inc. United States Government license rights for the Department
of Defense are limited to those rights identified in DFARS clause 252.227-7015(b) (FEB 2014).
Trademark information
NETAPP, the NETAPP logo, and the marks listed at http://www.netapp.com/TM are trademarks of NetApp, Inc.
Other company and product names may be trademarks of their respective owners.