InfiniScale® IV 8-Port QSFP 40Gb/s InfiniBand

Switch User Manual

P/N:MIS5022Q-1BFR, MIS5022Q-1BRR
Rev 1.2

www.mellanox.com
Rev 1.2

NOTE:
THIS HARDWARE, SOFTWARE OR TEST SUITE PRODUCT (“PRODUCT(S)”) AND ITS RELATED DOCUMENTATION ARE
PROVIDED BY MELLANOX TECHNOLOGIES “AS-IS” WITH ALL FAULTS OF ANY KIND AND SOLELY FOR THE PURPOSE
OF AIDING THE CUSTOMER IN TESTING APPLICATIONS THAT USE THE PRODUCTS IN DESIGNATED SOLUTIONS. THE
CUSTOMER'S MANUFACTURING TEST ENVIRONMENT HAS NOT MET THE STANDARDS SET BY MELLANOX
TECHNOLOGIES TO FULLY QUALIFY THE PRODUCTO(S) AND/OR THE SYSTEM USING IT. THEREFORE, MELLANOX
TECHNOLOGIES CANNOT AND DOES NOT GUARANTEE OR WARRANT THAT THE PRODUCTS WILL OPERATE WITH THE
HIGHEST QUALITY. ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED
WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT ARE
DISCLAIMED. IN NO EVENT SHALL MELLANOX BE LIABLE TO CUSTOMER OR ANY THIRD PARTIES FOR ANY DIRECT,
INDIRECT, SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES OF ANY KIND (INCLUDING, BUT NOT LIMITED TO,
PAYMENT FOR PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE, DATA, OR PROFITS; OR BUSINESS
INTERRUPTION) HOWEVER CAUSED AND ON ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY,
OR TORT (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY FROM THE USE OF THE PRODUCT(S) AND
RELATED DOCUMENTATION EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE.

Mellanox Technologies Mellanox Technologies, Ltd.

350 Oakmead Parkway Suite 100 PO Box 586 Hermon Building
Sunnyvale, CA 94085 Yokneam 20692
U.S.A. Israel
www.mellanox.com Tel: +972-4-909-7200
Tel: (408) 970-3400 Fax: +972-4-959-3245
Fax: (408) 970-3403

© Copyright 2011. Mellanox Technologies. All rights reserved.

Mellanox, BridgeX, ConnectX, Virtual Protocol Interconnect, InfiniBlast, InfiniBridge, InfiniHost, InfiniRISC, InfiniScale, and InfiniPCI
are registered trademarks of Mellanox Technologies, Ltd. CORE-Direct, FabricIT, and PhyX are trademarks of Mellanox Technologies, Ltd.
All other trademarks are property of their respective owners.
All other marks and names mentioned herein may be trademarks of their respective companies.

QDR InfiniBand Switch Platform User Manual

Document Number: 3373

2 Mellanox Technologies
QDR InfiniBand Switch Platform User Manual Rev 1.2

Contents
Contents 3
List of Figures 5
List of Tables 6
Revision History 7
About this Manual 8
Intended Audience 8
Related Documentation 8
Conventions 8
Mellanox Part Numbering Legend 9
Chapter 1 Overview 10
1.1 Serial Number and Product Version Information 10
Chapter 2 Installation Safety Warnings 11
Chapter 3 Externally Managed Switches 14
Chapter 4 Hardware Basic Operation and Installation 15
4.1 Switch Platform Hardware Overview 15
4.1.1 LED Assignments 15
4.2 Air Flow 18
4.3 QSFP Cable Power Budget Classification 18
4.4 Interfaces 19
4.4.1 Port Connector Interfaces 19
4.5 Management and FW Updating Interfaces 19
4.5.1 RJ-45 Connector (I2C) 19
Chapter 5 Installation 21
5.1 Package Contents 21
5.2 Installing the Switch in the Rack 22
5.2.1 Table Top Installation 22
5.2.2 Installation Procedure for a Single Switch Center-of-Rack Installation 23
5.2.3 Installation Procedure for a Side by Side Installation 24
5.2.4 Grounding the Switch 27
5.2.5 Power Connections and Initial Power On 27
5.2.6 InfiniBand Cable Installation 27
5.3 Disassembly of the Switch from the Rack 28
5.3.1 Disassembly Procedure — Single Switch Centered Installation 28
5.3.2 Disassembly Procedure — Side by Side Installation 29
5.4 Disposal 29
5.5 Updating Firmware 29
5.5.1 Current Firmware Revision 29
5.5.2 How to Get Mellanox Firmware Tools (MFT) 34
5.5.3 Open SM 35
Chapter 6 Troubleshooting 36
Appendix A Specification 38
A.1 EMC Certification Statements 39
A.2 VCCI Statements (Japan) 42
A.3 MIC Certification (Korea) 42
Appendix B QSFP Interface 43
Appendix C RJ45 I2C Interface 45

Mellanox Technologies 3
Rev 1.2

Appendix D Replacement Parts Ordering Numbers 46

Appendix E Avertissements de sécurité d’installation (French) 47
Appendix F Installation - Sicherheitshinweise (German) 49
Appendix G Advertencias de seguridad para la instalación (Spanish) 51
Appendix H Special Regulations Regarding Finland, Sweden, Denmark, and Norway 54

4 Mellanox Technologies
QDR InfiniBand Switch Platform User Manual Rev 1.2

List of Figures
Figure 1: Generic Product label 10
Figure 2: Switch System Front Panel 15
Figure 3: Status LEDs 16
Figure 4: Port Numbering 19
Figure 5: Top and Bottom Ports 19
Figure 6: RJ45 I2C Connector 20
Figure 7: Placing the Bumpers 22
Figure 8: Installation Kit for a Single Centered Installation 23
Figure 9: Connect the Mounting Brackets 24
Figure 10: Installation Kit Parts for a Side by Side Installation 25
Figure 11: Screw on the Switch Mounted Rails 25
Figure 12: Caged Nut Placement 26
Figure 13: Front Panel Orientation 26
Figure 14: Top and Bottom Ports 28
Figure 15: MTUSB-1 with Cables 33
Figure 16: I2C Cable Connected to IS5022 34
Figure 17: QSFP Male and Female Connections 44

Mellanox Technologies 5
Rev 1.2

List of Tables
Table 1: Revision History Table 7
Table 2: Reference Documents 8
Table 3: Switch Status LED Configurations 16
Table 4: Fan LED Configurations 17
Table 5: Bad Port LED Configurations 17
Table 6: Connector Physical and Logical Link Indications 18
Table 7: Installation Kit Options 21
Table 8: IS5022 Specification Data 38
Table 9: Switch Certification Status 39
Table 10: InfiniBand QSFP Connector Pinout 43
Table 11: Replacement Parts Ordering Numbers 46

6 Mellanox Technologies
QDR InfiniBand Switch Platform User Manual Rev 1.2

Revision History

Table 1 - Revision History Table

Date Revision Description

Mar. 2011 Rev 1.2 Added note and figure to blank panel installtion step.
Made changes to the installation process for the two switch frame.

Feb. 2011 Rev 1.1 Removed UID LED support

Jan. 2011 Rev 1.0 Initial Release

Mellanox Technologies 7
Rev 1.2

About this Manual

This manual describes the installation and basic use of the Mellanox IS5022 switch, which is
based on the InfiniScale® IV InfiniBand switch device.

Intended Audience
This manual is intended for users and system administrators responsible for installing and setting
up the switch platforms listed above.

The manual assumes familiarity with the InfiniBand® Architecture Specification.

Related Documentation

Additional Documentation available from Mellanox:

Table 2 - Reference Documents

Switch Firmware and See

Firmware Update http://www.mellanox.com > Support > Download Firmware Tools
Tools Note that the Switch System described in this manual is based on Mellanox
Technologies’ InfiniScale® IV switch device.
Mellanox OFED See
Stack for Linux http://www.mellanox.com > Support > InfiniBand Software and Drivers
User’s Manual Click “Mellanox OpenFabrics Enterprise Distribution for Linux
(MLNX_OFED)”
Select the Linux User’s Manual
The embedded OS and tools on the CPU in the management module is a
subset of the Mellanox OFED stack.
Mellanox Firmware The MFT (Mellanox Firmware Tools) package is a set of firmware tools.
Tools (MFT) The manual supplied with this package provides an overview of the firm-
User’s Manual ware its installation and replacement. The MFT can be downloaded with its
Document # 2329 documentation at:
http://www.mellanox.com > Support > Download Firmware Tools

Conventions

Throughout this manual, the name IS5022 and the term switch are used to describe the 8-port
QSFP 40Gb/s InfiniBand Switch unless explicitly indicated otherwise.

8 Mellanox Technologies
QDR InfiniBand Switch Platform User Manual Rev 1.2

This symbol indicates information that is helpful to the user.

BEWARE! This symbol indicates a situation that can potentially cause personal injury
or damage to hardware or software.

Mellanox Part Numbering Legend

Place Field Decoder

M Mellanox Technologies
IS System Type InfiniScale Switch
50 Model Family
FF Form factor 22 = 8 Ports

- Separator
# Power supplies 1 = 1 power supply
M Depth of the Unit B = short depth
Y Air Flow direc- R= Connector side to rear side airflow
tion F= Rear side to connector side airflow
R RoHS R=RoHS6

Mellanox Technologies 9
Rev 1.2 Overview

1 Overview
This User Manual provides an overview of the InfiniBand switch product, an 8-port switch capa-
ble of up to 640Gb/s of non-blocking switching capacity. Based on the fourth generation InfiniS-
cale IV InfiniBand switch device. The platform delivers industry leading bandwidth, latency, and
scalability in a half width 1U form factor. The platform can be tiered to build larger multi stage
networks in a variety of topologies such as Fat-Tree, Mesh, 3D Torus etc. All port configurations
are covered in this manual which include switches for QSFP InfiniBand ports.

Mellanox IS5022 switch systems are an ideal choice for smaller departmental or back-end cluster-
ing uses with high-performance needs, such as storage, data base and GPGPU clusters. Networks
built with IS5022 systems can carry converged traffic with the combination of assured bandwidth
and granular quality of service. IS5022 systems provide up to 40Gb/s full bidirectional bandwidth
per port.

The switch platform comes pre-installed with all necessary firmware and is configured for stan-
dard operation within an InfiniBand fabric. This switch requires an InfiniBand compliant Subnet
Manager running from one of the hosts or another managed switch. All that is required for normal
operation is to follow the usual precautions for installation and to connect the switch to the HCAs
or other switches within the fabric. Once connected, the Subnet Management software automati-
cally configures and begins utilizing the switch.

It is recommended that the Mellanox OpenFabrics software package be installed on all nodes con-
nected to the IS5022. The software package provides a subnet manager and network management
tools as well as connectivity software for servers and storage, and is available on the Mellanox
web site. See Chapter 3 for more information.

Basic installation and hardware maintenance is covered in “Hardware Basic Operation and Instal-
lation” on page 15.

1.1 Serial Number and Product Version Information

The Serial number and GUID for the switch are found on the front panel below the Mellanox logo.
The serial number and product version information are found on the label seen in the figure below.

Figure 1: Generic Product label

Also on this label is the GUID identifier for the switch.

10 Mellanox Technologies
QDR InfiniBand Switch Platform User Manual Rev 1.2

2 Installation Safety Warnings

Warnings in French can be found on page 47. Warnings in German can be found on page 49.
Warnings in Spanish can be found on page 51.
1. Installation Instructions

Read all installation instructions before connecting the equipment to the power
source.

2. Bodily Injury Due to Weight

Use enough people to safely lift this product.

<40 lbs 40 - 70 lbs 70 - 121 lbs >121 lbs

<18 kgs 18 - 32 kgs 32 - 55 kgs >55 kgs

3. Over-temperature

This equipment should not be operated in an area with an ambient temperature

exceeding the maximum recommended: 45°C (113°F). Moreover, to guarantee
proper air flow, allow at least 8cm (3 inches) of clearance around the ventilation
openings.

4. Stacking the Chassis

The chassis should not be stacked on any other equipment. If the chassis falls, it
can cause bodily injury and equipment damage.

5. During Lightning - Electrical Hazard

During periods of lightning activity, do not work on the equipment or connect or

disconnect cables.

Mellanox Technologies 11
Rev 1.2 Installation Safety Warnings

6. Copper InfiniBand Cable Connecting/Disconnecting

Copper InfiniBand cables are heavy and not flexible, as such they should be
carefully attached to or detached from the connectors. Refer to the cable manu-
facturer for special warnings/instructions.

7. Rack Mounting and Servicing

When this product is mounted or serviced in a rack, special precautions must be

taken to ensure that the system remains stable. In general you should fill the
rack with equipment starting from the bottom to the top.

8. Equipment Installation

This equipment should be installed, replaced, and/or serviced only by trained

and qualified personnel.

9. Equipment Disposal

Disposal of this equipment should be in accordance to all national laws and reg-
ulations.

10. Local and National Electrical Codes

This equipment should be installed in compliance with local and national elec-
trical codes.

11. UL Listed and CSA Certified Power Supply Cord

For North American power connection, select a power supply cord that is UL Listed
and CSA Certified, 3 - conductor, [16 AWG], terminated with a molded plug rated at
125 V, [13 A], with a minimum length of 1.5m [six feet] but no longer than 4.5m.
For European connection, select a power supply cord that is internationally
harmonized and marked “<HAR>”, 3 - conductor, minimum 1.0 mm 2 wire,
rated at 300 V, with a PVC insulated jacket. The cord must have a molded plug
rated at 250 V, 10 A.

12 Mellanox Technologies
QDR InfiniBand Switch Platform User Manual Rev 1.2

12. Add GND connection information

Before connecting this device to the power line, the protective earth terminal screws of
this device must be connected to the protective earth in the building installation.
(GND Connection Information):
The building installation shall provide a means for connection to protective earth; and
the equipment shall to be connected to that means permanently by a service person.
A SERVICE PERSON shall check whether or not the socket - outlet from which the
equipment is to be powered provides a connection to the building protective earth. If
not, the SERVICE PERSON shall arrange for the installation of a PROTECTIVE
EARTHING CONDUCTOR from the separate protective earthing terminal to the pro-
tective earth wire in the building. The equipment shall be installed in area where equi-
potential bonding exists (such as a telecommunication centre or a dedicated computer
room)

13. Installation codes

This device must be installed according to the latest version of the country national
electrical codes. For North America, equipment must be installed in accordance to the
applicable requirements in the US National Electrical Code and the Canadian Electri-
cal Code.

14. WEEE Directive

According to the WEEE Directive 2002/96/EC, all waste electrical and elec-
tronic equipment (EEE) should be collected separately and not disposed of with
regular household waste.
Dispose of this product and all of its parts in a responsible and environmentally
friendly way.

Mellanox Technologies 13
Rev 1.2 Externally Managed Switches

3 Externally Managed Switches

Externally managed (unmanaged) switches are plug and play out of the box. All switches come
with the latest firmware (FW) burned on the Flash. Updating the FW on externally managed
switches can be performed in-band only. When new FW is available, an email notification is sent
to registered users with the link to the Mellanox FW download site. The download site has the
Mellanox FW tool package and full instructions for updating FW.

Externally managed switches must be managed by management software installed on a node or on

another managed switch that can be anywhere in the fabric. This can be OpenSM, Mellanox
FabricIT™ EFM, Mellanox UFM, or a third party Subnet Manager.

14 Mellanox Technologies
QDR InfiniBand Switch Platform User Manual Rev 1.2

4 Hardware Basic Operation and Installation

4.1 Switch Platform Hardware Overview

Figure 2 shows the front view of the switch. The figure shows port configurations for the switch
systems, I2C connector, and various status LEDs. Externally Managed switches come with an I2C
RJ45 connector.

Figure 2: Switch System Front Panel

All InfiniBand connectivity is via the connector side panel. All connectors can support active
cables.

4.1.1 LED Assignments

4.1.1.1 System Status Indicators

The System Status Indicators are located on the left side of the front (connector side) panel. The
system status indicators should display as follows:

When the switch is plugged in, within three seconds:

• the Status LED should light up green.

• The Fan LED should light up green.

• The Bad Port LED should be off.

• The Unit ID LED UID should be off.

Mellanox Technologies 15
Rev 1.2 Hardware Basic Operation and Installation

Figure 3: Status LEDs

If the Status LED shows red after 30 seconds unplug the switch and call your Mellanox
representative for assistance.

If the Fan LED shows red unplug the switch and call your Mellanox representative for
assistance.

If the switch shuts down due to over temperature, unplug the switch, wait 5 minutes
and replug in the switch. For more information See “Troubleshooting” on page 36.

4.1.1.2 Status LED

The Status indicator is located on the left side of the front panel (connector side) of the unit. The
following status conditions are possible:

Table 3 - Switch Status LED Configurations

LED Description

Off No power to the switch

Switch is running
Solid Green
All OK

There is a problem with power output from

Red the power supply, or there is a thermal shut
down.

16 Mellanox Technologies
QDR InfiniBand Switch Platform User Manual Rev 1.2

4.1.1.3 Fan Indicators

The Fan indicator is located on the left side of the front panel (connector side) of the unit. The fol-
lowing fan status conditions are possible:

Table 4 - Fan LED Configurations

LED Configuration FAN LED

Off There is no power to the fans.

Green OK – The fans are running.

Red Error – fans are not operating properly. Replace the switch.

Fans must be operating while the power supply is plugged in.

If the switch shuts down due to over temperature, unplug the switch, wait 5 minutes
and replug in the switch. For more information See “Troubleshooting” on page 36.

4.1.1.4 Bad Port LED

The Bad Port indicator is located on the left side of the front panel (connector side) of the unit. The
following Bad Port conditions are possible:

Table 5 - Bad Port LED Configurations

LED Configuration Description

Off OK – All ports are up and running.

Flashing Orange Error –One or possibly more ports has just received a symbol error.

This LED shows symbol errors. Possible causes for this are:
• bad cable
• bad connection
• bad connector

This LED lights up when one or more ports is receiving a symbol error. The LED immediately
goes off until the next symbol error is received.

Mellanox Technologies 17
Rev 1.2 Hardware Basic Operation and Installation

4.1.1.5 UID LED Switch Identifier

The UID LED is a debug feature that will become available to customers in the near future. For
details please contact Mellanox Technologies support.

4.1.1.6 Port Connector LED

Above the ports are two LEDs one for the upper port and one for the lower port . The fol-
lowing table shows the port status according to the LED indication.

Table 6 - Connector Physical and Logical Link Indications

LED Description

Off No link

Orange Physical Link up

Solid Green Logical Link up

Flashing Green Data activity

flashing speed ≈ data transfer speed

Flashing Orange A problem with the Physical Link

This LED when flashing orange shows port physical errors. Possible causes for this are:
• bad cable
• bad connection
• bad connector
• bad cage

4.2 Air Flow

These switches can come with two air flow patterns. The two patterns are
• Rear side inlet to connector side outlet
• Connector side inlet to rear side outlet

The air flow is specified in the product model number. See “Mellanox Part Numbering Legend” on
page 9.

4.3 QSFP Cable Power Budget Classification

All IS5022 QSFP switches are designed for active cables with a max power per module of 2.0W.
This is power level 2 according to the QSFP Public Specification.

18 Mellanox Technologies
QDR InfiniBand Switch Platform User Manual Rev 1.2

4.4 Interfaces
4.4.1 Port Connector Interfaces

The Connector side of the switch has 8 QSFP ports. These are placed in two rows, 4 ports to a row.
The ports are labelled as shown in Figure 4. The bottom row ports are flipped from the top row.
See Figure 5.

Figure 4: Port Numbering

1 3 5 7

2 4 6 8

Figure 5: Top and Bottom Ports

4.5 Management and FW Updating Interfaces

This switch is externally managed. There is no CPU in this switch for management purposes. The
switch can be managed through any fabric management software such as Open SM Mellanox
UFM, or Mellanox FabricIT Enterprise Fabric Manager (EFM).

There is one interface to connect to the switch. It is an I2C RJ45 interface labelled “I2C”. Use this
connector to update firmware (as a last resort) and for advanced debug.

Update FW inband only.

4.5.1 RJ-45 Connector (I2C)

There is an “I2C”interface on the front panel.

Mellanox Technologies 19
Rev 1.2 Hardware Basic Operation and Installation

Figure 6: RJ45 I2C Connector

All firmware updates should be done in-band using Mellanox Firmware Management Tools.

The I2C connector is available only on externally managed switches and is used to update firm-
ware should in-band firmware update not work. You will need to order an MTUSB-1 USB to I2C
adapter to make use of the I2C interface. The I2C connection provides access to Flash. This is for
Advanced users and FAEs only.

The externally managed switches are Plug and Play and all firmware updates should be
done in-band. The I2C connection should only be used if the FW image was corrupted
to the point that the regular FW tools cannot successfully reburn the correct image.

Warning: Any red status LED is cause for concern and must be dealt with imme-
diately.
It can take up to 30 seconds to boot up, during which time the status LED may
indicate red.

20 Mellanox Technologies
QDR InfiniBand Switch Platform User Manual Rev 1.2

5 Installation
There are three possible installation kits for the MIS5022 switch. Make sure that you have the
installation kit that works with your rack. Installation kits are not included with the switch and
should be ordered separately.

Table 7 - Installation Kit Options

OPN Description For Rack Depths

MIS000811 Centered single switch installation kit 400mm – 800mm

MIS000830 Side by side installation kit with long rail slides 650mm – 800mm

MIS000831 Side by side installation kit with short rail slides 400mm – 650mm

5.1 Package Contents

The package includes:

• 1 switch
• 1 installation kit
• 1 box containing 1 power cord Type B 6ft US 125V 10A chord
• 1 installation guide
• 1 parts list

Before you install your new switch, unpack the system and check to make sure that all the parts
have been sent, check this against the parts list. Check the parts for visible damage that may have
occurred during shipping.

If anything is damaged or missing, contact your customer representative immediately.

The rack mounting holes conform to the IEA-310 standard for 19-inch racks. Guarantee
proper ventilation, by leaving 8cm (3”) of space to the front and rear of the switch. This
will ensure proper air flow through the chassis. This is crucial for maintaining good air-
flow at ambient temperature. In particular, route cables such that they do not impede the
air into or out of the chassis.

Mellanox Technologies 21
Rev 1.2 Installation

5.2 Installing the Switch in the Rack

This installation kit can only be used to install this switch.

Tools and Parts

Tools required and customer supplied parts

• Phillips Screwdrivers #1 and #2 • Grounding screw
• ESD Strap • Grounding wire sufficient to reach a valid ground
• ESD mat

The following procedure can be done by one person.

5.2.1 Table Top Installation

1. Peel and stick the four rubber bumpers into the bottom of the switch. Place them in the round
circles.

Figure 7: Placing the Bumpers

Bottom of the switch

2. Place on a flat surface. Make sure the switch is sits solid on the surface.
3. Connect the power cord.

22 Mellanox Technologies
QDR InfiniBand Switch Platform User Manual Rev 1.2

4. Connect the data transfer cables.

5.2.2 Installation Procedure for a Single Switch Center-of-Rack Installation

Installation kit parts for a single switch center-of-rack installation:

• 2 front mounting brackets • 8 flat head screws
• 4 M6 bolts • 4 caged nuts for the rack vertical supports
1. Place the ESD mat on the floor where you will be working and put on the ESD strap. Make
sure the ESD strap is touching your skin and that the other end is connected to a verified
ground.
2. Screw the two front brackets to the front side of the switch using 4 flat head screws for each
bracket.

Figure 8: Installation Kit for a Single Centered Installation

Mellanox Technologies 23
Rev 1.2 Installation

Figure 9: Connect the Mounting Brackets

3. Place four caged nuts into the rack at the U level you want to install the switch.
4. While supporting the switch catch and tighten the four bolts into the caged nuts.
5. Ground the switch.
6. Plug in the power cord.
7. You can start connecting all of the cables to the switch.

5.2.3 Installation Procedure for a Side by Side Installation

Installation kit parts for a side by side installation:

• 1 Two switch metal frame • Two Rail Slides
• 4 switch mounted rails • 8 pairs of caged nuts and bolts
• 24 flat head screws • 1 blank cover

The Installation kits come with enough switch mounted rails and flat head screws to install two
switches.

24 Mellanox Technologies
QDR InfiniBand Switch Platform User Manual Rev 1.2

Figure 10: Installation Kit Parts for a Side by Side Installation

1. Place the ESD mat on the floor where you will be working and put on the ESD strap. Make
sure the ESD strap is touching your skin and that the other end is connected to a verified
ground.
2. Screw the two switch mounted rails to the switch using six flat head screws per rail.

Figure 11: Screw on the Switch Mounted Rails

Mellanox Technologies 25
Rev 1.2 Installation

3. Place eight caged nuts into the rack at the level you want to mount the switch. Four go on the
Leaf side and four go on the rear side.

Figure 12: Caged Nut Placement

Leaf side

Rear side

4. Install the two switch frame into the rack. This frame goes on the leaf side of the rack. Do not
tighten the screws into the caged nuts.
5. Slide the rail slides into the frame and screw the bolts into the rack caged nuts on the rear
side of the rack. Do not tighten the screws into the caged nuts.
6. Slide the switch into the frame, and screw in the capture bolts into the frame.
7. Tighten the capture nuts.
8. Install the blank into the frame opposite the switch, or install a second switch.

The front panel is not symetrical. The large radius always goes ot the center of the
frame.

Figure 13: Front Panel Orientation

Large radius Small radius

Small radius

26 Mellanox Technologies
QDR InfiniBand Switch Platform User Manual Rev 1.2

9. Tighten the capture nuts.

10. Tighten all eight screws for the caged nuts to 9.2 Nm or 81.5 pound inches.
11. Ground the switch.
12. Plug in the power cord.
13. You can start connecting all of the cables to the switch.

5.2.4 Grounding the Switch

Check to determine if your local or national electrical codes require an external ground to all IT
components. If so, connect a ground wire to one of the casing screws and connect the other end to
a valid ground. If you choose to not use the ground screw, make sure that the rack is properly
grounded and that there is a valid ground connection between the chassis of the switch and the
rack. Test the ground using an Ohm meter.

Some national and/or local codes may require IT components to be bonded and exter-
nally grounded (not including the power cord ground). You must follow all national and
local codes when installing this equipment.

5.2.5 Power Connections and Initial Power On

The power cord is included in the installation kit.

Caution: The switch platform will automatically power on when AC power is applied.
There is no power switch.

Caution: After inserting a power cable and confirming the green system status LED
light is on; make sure that the Fan Status indicator shows green.
If the fan status indicator is not green then unplug the power connection and call your
supplier.

5.2.6 InfiniBand Cable Installation

All cables can be inserted or removed with the unit powered on. To insert a cable, press the con-
nector into the port receptacle until the connector is firmly seated. The orange LED indicator cor-
responding to each QSFP port will light when the physical connection is established (that is, when
the unit is powered on and a cable is plugged into the port with the other end of the connector
plugged into a functioning port). After plugging in a cable, lock the connector using the latching

Mellanox Technologies 27
Rev 1.2 Installation

mechanism particular to the cable vendor. When a logical connection is made the green light will
come on. When data is being transferred the light will blink green.

Cables in the bottom row should be inserted up side down in relation to the how the
cables are inserted in the top row.

Figure 14: Top and Bottom Ports

To remove, disengage the locks and slowly pull the connector away from the port receptacle. The
LED indicator will turn off when the cable is unseated.

Care should be taken not to impede the air exhaust flow through the ventilation holes next to the
InfiniBand ports. Cable lengths should be used which allow for routing horizontally around to the
side of the chassis before bending upward or downward in the rack.

5.3 Disassembly of the Switch from the Rack

5.3.1 Disassembly Procedure — Single Switch Centered Installation

To disassemble the switch from the rack:

1. Unplug and remove all connectors.
2. Unplug the power cord.
3. Remove the ground wire.
4. Remove the four M6 screws holding the switch to the rack. Support the switch while remov-
ing the screws, or the switch may fall out of the rack.
5. Loosen the two thumbscrews holding the switch in place.
6. Slide the switch out of the rack.

This switch needs to be supported when it is being disassembled.

7. Remove the rails.

8. Remove the caged nuts.

28 Mellanox Technologies
QDR InfiniBand Switch Platform User Manual Rev 1.2

5.3.2 Disassembly Procedure — Side by Side Installation

To disassemble the switch from the rack:

1. Unplug and remove all connectors.
2. Unplug the power cord.
3. Remove the ground wire.
4. Unscrew the 2 center bolts from the connector side of switch.
5. Slide the switch from the rack.
6. Remove the rail slides rails from the rack.
7. Remove the 10 caged nuts.

5.4 Disposal

According to the WEEE Directive 2002/96/EC, all waste electrical and elec-
tronic equipment (EEE) should be collected separately and not disposed of with
regular household waste.
Dispose of this product and all of its parts in a responsible and environmentally
friendly way.

For proper disassembly instructions see the Mellanox website.

5.5 Updating Firmware

When you buy the switch, it comes with the latest firmware burned on the board. All firmware
updates should be done in-band. Go to the Mellanox Website and confirm that the firmware is the
latest. If not reburn the latest firmware from the download site. New firmware versions will be
posted on the Mellanox firmware download page:
http://www.mellanox.com => Support > Download Center.

You will need the Mellanox Firmware Tools package to update firmware for this switch. It can also
be downloaded from:
http://www.mellanox.com. => Support > InfiniBand Software and Drivers.

You will also need to download and unzip the firmware binary image. This is provided in the Mel-
lanox Web site at: http://www.mellanox.com => Support > Download Center and go to the InfiniS-
cale IV Switch systems. Click in the Table for the firmware image that you need.

5.5.1 Current Firmware Revision

The user can query for the currently loaded firmware revision by using the command:

ibstat

Mellanox Technologies 29
Rev 1.2 Installation

(part of mft package). Other tools like flint can also be useful.

5.5.1.1 Instructions for Reprogramming Over the InfiniBand Network

To update an InfiniScale IV switch device having a specific GUID (for example,

0x00000006660abcd0) or LID, the following are the recommended steps to update the device
firmware.
1. Make sure all subnet ports are in the active state. One way to check this is to run opensm, the
Subnet Manager.

[root@mymach]> /etc/init.d/opensmd start

opensm start [ OK ]
2. Make sure the local ports are active by running ‘ibv_devinfo’.
3. Obtain the device LID. There are two ways to do that:
I. Using the “mst ib add” command:
The “mst ib add” runs the ibdiagnet tool to discover the InfiniBand fabric and then lists the discovered IB nodes as
an mst device under /dev/mst/ directory. These devices can be used for access by other MFT tools.

[root@mymach]> mst ib add

-I- Running ibdiagnet to discover the fabric ...

Loading IBDIAGNET from: /usr/local/lib/ibdiagnet1.2

-W- Topology file is not specified.

Reports regarding cluster links will use direct routes.

Loading IBDM from: /usr/local/lib/ibdm1.2

-I- Using port 1 as the local port.

-I- Discovering ... 3 nodes (2 Switches & 1 CA-s) discovered.

-I---------------------------------------------------

-I- Bad Guids/LIDs Info

-I---------------------------------------------------

-I- skip option set. no report will be issued

-I---------------------------------------------------

-I- Links With Logical State = INIT

-I---------------------------------------------------

-I- skip option set. no report will be issued

-I---------------------------------------------------

30 Mellanox Technologies
QDR InfiniBand Switch Platform User Manual Rev 1.2

-I- PM Counters Info

-I---------------------------------------------------

-I- skip option set. no report will be issued

-I---------------------------------------------------

-I- Fabric Partitions Report (see ibdiagnet.pkey for a full hosts list)

-I---------------------------------------------------

-I- skip option set. no report will be issued

-I---------------------------------------------------

-I- IPoIB Subnets Check

-I---------------------------------------------------32

-I- skip option set. no report will be issued

-I---------------------------------------------------

-I- Bad Links Info

-I---------------------------------------------------

-I- No bad link were found

----------------------------------------------------------------

-I- Stages Status Report:

STAGE Errors Warnings

Bad GUIDs/LIDs Check 0 0

Link State Active Check 0 0

Performance Counters Report 0 0

Partitions Check 0 0

IPoIB Subnets Check 0 0

Please see /tmp/ibdiagnet.log for complete log

----------------------------------------------------------------

-I- Done. Run time was 1 seconds.

-I- Added 3 in-band devices

Mellanox Technologies 31
Rev 1.2 Installation

[root@mymach]>

To list the discovered mst inband devices run “mst status”.

[root@mymach]> mst status

MST modules:

------------

MST PCI module loaded

MST PCI configuration module loaded

...

Inband devices:

-------------------

/dev/mst/CA_MT25418_sw005_HCA-1_lid-0x0001

/dev/mst/SW_MT47396_lid-0x0011

/dev/mst/SW_MT48438_lid-0x0003

[root@mymach]>

II. Using the ibnetdiscover tool:

Run:

[root@mymach]# ibnetdiscover | grep 00000006660abcd0 | grep -w Switch

Switch 24 "S-00000006660abcd0" "MT47396 Infiniscale-III Mellanox Technologies"

base port 0 lid 17 lmc 0

Note: The resulting LID is given as a decimal number.

4. Run mlxburn with the LID retrieved in step #3 above to perform the In-Band burning opera-
tion.

Burn the InfiniScale IV switch:

[root@mymach]> mlxburn -d /dev/mst/SW_MT48438_lid-0x0003 -fw ./fw-IS4.mlx -qq

-I- Querying device ...

32 Mellanox Technologies
QDR InfiniBand Switch Platform User Manual Rev 1.2

-I- Using auto detected configuration file: ./Q-1UNC_A1.ini (PSID =

MT_0C20110003)

-I- Generating image ...

*** WARNING *** Running quick query - Skipping full image integrity checks.

Current FW version on flash: 7.0.135

New FW version: 7.0.138

Burning second FW image without signatures - OK

Restoring second signature - OK

-I- Image burn completed successfully.

5.5.1.2 Reprogramming the Switch Through The I2C Port

This interface is for Debug and Troubleshooting only. This interface is for FAEs and advanced users
only.

The I2C connector should only be used when the firmware cannot be updated in-band.

Use the MTUSB-1 adapter (available from Mellanox) to reprogram the switch firmware using a
server or PC running MFT.

Figure 15: MTUSB-1 with Cables

The MTUSB adapter comes with three cables, but has only two connections for cables. One cable
is an I2C cable with DB9 female connectors on both ends. One cable is a I2C cable with DB9

Mellanox Technologies 33
Rev 1.2 Installation

female connector to RJ45 male. Use the cable that matches your switch. The other is a USB cable
with one type A host connection to be connected to the server or PC and a type B connection to be
connected to the MTUSB adapter.

Figure 16: I2C Cable Connected to IS5022

IS5022
8

With the switch connected to a computer through the MTUSB, it is now possible to reprogram the
SPI Flash memory.

5.5.1.3 Instructions for Reprogramming Through the I2C Port:

1. Make sure that:
•the MTUSB I2C cable is connected to the switch and USB cable is connected to a computer
•MFT is running on the computer
•"mtusb-1" mst device appears in "mst status"
2. Set the switch I2C switch to allow access by running:

> mlxi2c -d /dev/mst/mtusb-1 -s IS5023 p /IS4

3. Run the burn command:

flint -d /dev/mst/mtusb-1 -i ./fw-IS4-rel-7_0_142-Q_A1.bin -qq b

4. Power cycle the switch, by unplugging and re-plugging the power cord, to load the new firm-
ware.

5.5.2 How to Get Mellanox Firmware Tools (MFT)

Mellanox Firmware Tools (MFT) and documentation are available for download via
http://www.mellanox.com > Support > Download Firmware Tools.

The MFT kit includes:

• mlxburn
• flint
• spark
• IBspark
• debug utilities

See “Related Documentation” on page 8.

34 Mellanox Technologies
QDR InfiniBand Switch Platform User Manual Rev 1.2

5.5.3 Open SM

To manage the Mellanox switch system using OFED, download Mellanox Open Fabrics from
http://www.mellanox.com > Support > InfiniBand Software and Drivers.

Be sure to read and follow all of the instructions regarding the installation and use of these tools.

Mellanox Technologies 35
Rev 1.2 Troubleshooting

6 Troubleshooting
As soon as a switch is plugged in, continuously monitor the status light. Make sure that it turns
green within 30 seconds of booting up.

Status LED and Fan LED

If the Fan LED is red make sure that the ambient temperature is within the range specified in the
Specification section of the Appendix.

If any of the LEDs are red after 30 seconds, unplug the switch and call your Mellanox representa-
tive.

Power supply unit:

1. Check that the power cable has a voltage within the range of 100 - 240 volts AC.

If the status LED is red.

2. Remove and reinstall the power cable.

The green power LED for the fans does not come on:
.

Caution: Do not run the switch if the System Status LED for the Fans is red or
off!

The connector LED for the InfiniBand connector does not come on:
1. Check that both ends of the cable are connected.
2. Check that the locks on the ends are secured.
3. Make sure that the latest FW version is installed on both the HCA cards and the switch.
4. If media adapters are used, check that the all connections are good, tight, and secure.

The connector LED is flashing orange:

1. Check that the Subnet Manager has been started.
2. Check the cable is connected properly at borh ends.
3. Check the the cable is good.
4. Check that the connections are good(no cable weight on the connector, no twists in the cable
at the connector...).
5. Check the port connectors at both ends.

The switch is off:

1. Unplug the switch.
2. Wait 5 minutes.
3. Plug in the switch.

36 Mellanox Technologies
QDR InfiniBand Switch Platform User Manual Rev 1.2

4. If the switch does not come on, check the power supply.
5. If the switch comes on, Use the management software to determine the cause of the shut-
down.
6. Check the temperature of the switch.
7. Check the ambient air temperature to make sure it is not too high.
8. Check the Fan status.

The switch is not working and unresponsive:

1. Unplug the switch.
2. Wait 5 minutes.
3. Plug in the switch.
4. If the switch does not come on, check the power supplies.
5. If the switch comes on, use the management software to determine the cause of the shut-
down.

Mellanox Technologies 37
Rev 1.2

Appendix A: Specification

Table 8 - IS5022 Specification Data

Physical Power and Environmental

Size: 1.73” (1U) H x 7.9” W x 9.8” D Input Voltage: 100-240 VAC 50-60Hz
44mm X 200mm X 250mm Power Con-
Weight: 1.92kg 4.23 lbs sumption Typ:
Mounting: 19” Rack mount 8 port QDR
Passive Cables 46W
Active Cables 66W
SerDes Speeds 10, 20, 40 Gb/s per port

Connectors and Power Con-

Cabling: QSFP Cable sumption Max:
8 port QDR
Optical Cable Passive Cables 55W
Max Length: Active Cables 75W

Port Types: QSFP QSFP Max

Power per port
for active cables: 2.0W

Temperature: 0 to 45 Celsius
Humidity: 10% - 90% non-condensing

Protocol Support Regulatory Compliance

38 Mellanox Technologies
QDR InfiniBand Switch Platform User Manual Rev 1.2

Table 8 - IS5022 Specification Data

Physical Power and Environmental

InfiniBand: Auto-Negotiation of (40Gb/s, 20Gb/s, Safety: US/Canada: cTUVus

10Gb/s) EU: IEC60950
QoS: 8 InfiniBand Virtual Lanes for all International: CB
ports
Management: EMC (Emis- USA: FCC, Class A
Baseboard, Performance, and Device sions): Canada: ICES, Class A
management Agents for full Infini- EU: EN55022, Class A
Band In-Band Management EU: EN55024, Class A
EU: EN61000-3-2, Class A
EU: EN61000-3-3, Class A
Japan: VCCI, Class A

Environmental: EU: IEC 60068-2-64: Ran-

dom Vibration
EU: IEC 60068-2-29:
Shocks, Type I / II
EU: IEC 60068-2-32: Fall
Test
RoHS R-6

Acoustic: ISO 7779

ETS 300 753
Sound power 70.5 dB(A) or 7.1 Bel
level:

Reliability, Availability and Serviceability

Scalability and Performance
Features

Switching Perfor- Simultaneous wire-speed any port to

mance: any port
48K Unicast Addresses Max. per Sub-
Addressing: net
16K Multicast Addresses per Subnet
Switching Capacity 640Gb/s

A.1 EMC Certification Statements

Table 9 lists the approved certification status per switch in different regions of the world.
Table 9 - Switch Certification Status

FCC EN ICES
VCCI
Switch P/N Class Class Class cTUVus CB
(Japan)
(USA) (Europe) (Canada)

IS5022Q-1BRR YES YES YES YES

IS5022Q-1BFR YES YES YES YES

Mellanox Technologies 39
Rev 1.2

Table 9 - Switch Certification Status

FCC EN ICES
VCCI
Switch P/N Class Class Class cTUVus CB
(Japan)
(USA) (Europe) (Canada)

IS5022Q-1BFR YES YES YES YES

IS5022Q-1BRR YES YES YES YES

IS5022Q-1BFC YES YES YES YES

IS5022Q-1BRC YES YES YES YES

A.1.1 FCC Statements (USA)

Class A Statements:

§ 15.19(a)(4)

This device complies with Part 15 of the FCC Rules.

Operation is subject to the following two conditions:

1. This device may not cause harmful interference, and
2. This device must accept any interference received, including interference that may cause
undesired operation.

§ 15.21

Statement

Warning! Changes or modifications to this equipment not expressly approved by the party
responsible for compliance (Mellanox Technologies) could void the user's authority to operate
the equipment.

§15.105(a)

Statement

NOTE: This equipment has been tested and found to comply with the limits for a Class A digital
device, pursuant to Part 15 of the FCC Rules. These limits are designed to provide reasonable
protection against harmful interference when the equipment is operated in a commercial envi-
ronment. This equipment generates, uses, and can radiate radio frequency energy and, if not
installed and used in accordance with the instruction manual, may cause harmful interference
to radio communications. Operation of this equipment in a residential area is likely to cause

40 Mellanox Technologies
QDR InfiniBand Switch Platform User Manual Rev 1.2

harmful interference in which case the user will be required to correct the interference at his
own expense.

Statement

§ 15.21

Statement

Warning! Changes or modifications to this equipment not expressly approved by the party
responsible for compliance (Mellanox Technologies) could void the user's authority to operate
the equipment.

§15.105

Statement

NOTE: This equipment has been tested and found to comply with the limits for a Class B dig-
ital device, pursuant to part 15 of the FCC Rules. These limits are designed to provide reason-
able protection against harmful interference in a residential installation. This equipment
generates, uses and can radiate radio frequency energy and, if not installed and used in accor-
dance with the instructions, may cause harmful interference to radio communications. However,
there is no guarantee that interference will not occur in a particular installation. If this equip-
ment does cause harmful interference to radio or television reception, which can be determined
by turning the equipment off and on, the user is encouraged to try to correct the interference
by one or more of the following measures:

• Reorient or relocate the receiving antenna.

• Increase the separation between the equipment and receiver.
• Connect the equipment into an outlet on a circuit different from that to which the receiver is
connected.

Consult the dealer or an experienced radio/TV technician for help.

A.1.2 EN Statements (Europe)

EN55022 Class A Statement:

Warning

This is a class A product. In a domestic environment this product

may cause radio interference in which case the user may be

A.1.3 ICES Statements (Canada)

Class A Statement

“This Class A digital apparatus complies with Canadian ICES-003.

Cet appareil numérique de la classe A est conforme à la norme NMB-003 du Canada.”

Class B Statement

Mellanox Technologies 41
Rev 1.2

A.2 VCCI Statements (Japan)

Class A Statement:

(Translation - "This is a Class A product based on the standard of the Voluntary Control Council
for Interference by Information Technology Equipment (VCCI). If this equipment is used in a
domestic environment, radio interference may occur, in which case the user may be required to
take corrective actions.")

A.3 MIC Certification (Korea)

Korea's "Regulation for Certification of Information and Communication Equipment," requires
EMC testing and certification for many electronic products. Korean EMC certifications are issued
by Radio Research Laboratory (RRL), which is organized under the Ministry of Information and
Communications (MIC). EMC testing includes electromagnetic emissions (EMI) and susceptibil-
ity (EMS). Certified equipment is labeled with the MIC mark and certification number.

Translation:

Class A Device This device is registered for EMC requirements for industrial use. The seller or
buyer should be aware of this. If this type was sold or purchased by mistake, it should be
replaced with a residential-use type.

42 Mellanox Technologies
QDR InfiniBand Switch Platform User Manual Rev 1.2

Appendix B: QSFP Interface

20 19
GND GND
21 Rx1n 18 Table 10 - InfiniBand QSFP Connector Pinout
Rx2n
22 Rx2p Rx1p 17
23 16 Connector
GND GND Connector
24 15
Pin Signal Description
Rx4n Rx3n
Pin Name
Number
25 14
Rx4p Rx3p
13
1 GND Ground
26
GND GND
2 Tx2n Transmitter Inverted Data Input
27 12
ModPrsL SDA
11
3 Tx2p Transmitter Non-Inverted Data Input
28
IntL SCL
29 10
4 GND Ground
VccTx Vcc Rx
30 9
5 Tx4n Transmitter Inverted Data Input
Vcc1 ResetL
8
6 Tx4p Transmitter Non-Inverted Data Input
31 LPMode ModSelL
32 7 7 GND Ground
GND GND
33 6 8 ModSelL Module Select
Tx3p Tx4p
34 Tx3n Tx4n
5 9 ResetL Module Reset
35 GND 4 10 Vcc Rx +3.3 V Power supply receiver
GND
36 3
Tx1p Tx2p 11 SCL 2-wire serial interface clock
37 2
Tx1n Tx2n
38 1
12 SDA 2-wire serial interface data
GND GND
13 GND Ground
14 Rx3p Receiver Non-Inverted Data Output
15 Rx3n Receiver Inverted Data Output
16 GND Ground
17 Rx1p Receiver Non-Inverted Data Output
18 Rx1n Receiver Inverted Data Output
19 GND Ground
20 GND Ground
21 Rx2n Receiver Inverted Data Output 3
22 Rx2p Receiver Non-Inverted Data Output 3
23 GND Ground
24 Rx4n Receiver Inverted Data Output 3
25 Rx4p Receiver Non-Inverted Data Output 3
26 GND Ground
27 ModPrsL Module Present
28 IntL Interrupt
29 Vcc Tx +3.3 V Power supply transmitter
30 Vcc 1 +3.3 V Power Supply
31 LPMode Low Power Mode
32 GND Ground
33 Tx3p Transmitter Non-Inverted Data Input
34 Tx3n Transmitter Inverted Data Input
35 GND Ground
36 Tx1p Transmitter Non-Inverted Data Input
37 Tx1n Transmitter Inverted Data Input
38 GND Ground

Mellanox Technologies 43
 GND 3 8 1
GND 19
GND
TX1n 3 7 2
20 GND
TX2n RX1n
18
TX1p 3 6 21 RX2n
3 TX2p RX1p
17
GND 3 5 22 RX2p
GND
4
GND
16
Figure 17: QSFP Male and Female Connections

TX3n 3 4 23 GND
5 TX4n RX3n
15
TX3p 3 3 6
24 RX4n
TX4p RX3p
25 RX4p 14
GND 3 2 7
GND
13
8.50

26 GND GND
LPMode 3 1 8
ModSelL SDA
27 ModPrsL 12
Vcc1 30 9 ResetL SCL
11
18.35

VccTx 29 28 IntL
18.35

0
1 VccRx 1 VccRx
IntL 28 11 29 VccTx 0
SCL
9 ResetL
Top

Top
ModPrsL 27 12 30 Vcc1
SDA ModSelL
8

8.50
GND 26 31 LPMode
View into Rear of

13 GND GND
7
Connector

View into Front of Cage

32 GND
RX4p 25 14
RX3p TX4p
6
RX4n 24 15
33 TX3p
RX3n
5 TX4n
GND 23
34 TX3n

Mellanox Technologies
16
GND
4
GND
RX2p 22
35 GND
17
RX1p 3 TX2p
RX2n 21
36 TX1p
18
RX1n 2
TX2n
GND 20
37 TX1n
19
GND GND
38 GND 1
Rev 1.2

44
QDR InfiniBand Switch Platform User Manual Rev 1.2

Appendix C: RJ45 I2C Interface

The RJ45 I2C interface uses the EIA 568A standard wiring color coding.
Looking into the Socket

I 2C
J34

TXD+
TXD- Pin 1
RJ45_SDA
RXD+
GND
GND
GND
GND
GND
RXD-
GND
GND
RJ45_SCL
GND
GND
GND
Pin 8

Looking into the Socket

Mellanox Technologies 45
Rev 1.2

Appendix D: Replacement Parts Ordering Numbers

Table 11 - Replacement Parts Ordering Numbers

Part Description OPN

Centered single switch installation kit MIS000811

Side by side installation kit with long rail slides MIS000830

supports 19” racks with depth of 630mm-800mm

Side by side installation kit with short rail slides MIS000831

supports 19” racks with depth of 400mm-550mm

RS232 Cable DB9 to DB9 Harness HAR000040

RS232 Cable RJ45 to DB9 Harness HAR000028

I2C DB9 or RJ45 to USB Adapter MTUSB-1

Power cord Type C13-C14 ACC000251

250V 10A 1.5M

Power cord Type C13-C14 ACC000242

250V 15A 2M RIGHT ANGLE

Power cord Type B for USA, Canada, Mexico, Taiwan Type B 6ft US 125V 10A ACC000204
chord

Power cord Type B for USA, Canada, Mexico, Taiwan ACC000241

125V15A 4M USA UL (Type B) RIGHT ANGLE

Power cord Type H for Israel ACC000205

Power cord Type E/F for Sweden, France, Germany, Netherlands, Russia ACC000207

Power cord Type G for UK ACC000208

Power cord Type D for India ACC000209

Power cord Type I for China ACC000210

Power cord Type J for Switzerland ACC000211

Power cord Type B for Japan, ACC000212

Power cord Type I for Australia ACC000213

46 Mellanox Technologies
QDR InfiniBand Switch Platform User Manual Rev 1.2

Appendix E: Avertissements de sécurité d’installation

(French)
1. Instructions d’installation

Lisez toutes les instructions d’installation avant de brancher le matériel à la

source d’alimentation électrique.

2. Température excessive

Ce matériel ne doit pas fonctionner dans une zone avec une température ambi-
ante dépassant le maximum recommandé de 45°C (113°F). Un flux d’air de
200LFM à cette température ambiante maximale est nécessaire. En outre, pour
garantir un bon écoulement de l’air, laissez au moins 8 cm (3 pouces) d’espace
libre autour des ouvertures de ventilation.
3. Empilage du châssis

Le châssis ne doit pas être empilé sur un autre matériel. Si le châssis tombe, il
peut provoquer des blessures corporelles et des dégradations de biens.

4. Orages – dangers électriques

Pendant un orage, il ne faut pas utiliser le matériel et il ne faut pas brancher ou

débrancher les câbles.

5. Branchement/débranchement des câbles InfiniBand en cuivre

Les câbles InfiniBand en cuivre sont lourds et ne sont pas flexibles, il faut donc
faire très attention en les branchant et en les débranchant des connecteurs.
Consultez le fabricant des câbles pour connaître les mises en garde et les
instructions spéciales.

6. Montage et entretien sur baie

Lorsque ce produit est monté ou entretenu sur baie, il faut prendre des précaut-
ions spéciales pour s’assurer que le système reste stable. En général, il faut
remplir la baie avec du matériel de bas en haut.

7. Installation du matériel

Ce matériel ne doit être installé, remplacé ou entretenu que par du personnel

formé et qualifié.

Mellanox Technologies 47
Rev 1.2

8. Elimination du matériel
L’élimination de ce matériel doit s’effectuer dans le respect de toutes les législ-
ations et réglementations nationales en vigueur.

9. Codes électriques locaux et nationaux

Ce matériel doit être installé dans le respect des codes électriques locaux et
nationaux.

10. Cordons électriques CA homologués UL

Pour les prises électriques en Amérique du Nord, choisissez un cordon élect-

rique homologué UL et certifié CSA
à 3 conducteurs, [18 AWG], terminé par une fiche moulée, d’une tension nom-
inale de 125 V, [15 A], avec une longueur minimale de 1,5 m [6 pieds] et d’une
longueur maximale de 4,5 m [18 pieds]
Pour les prises électriques en Europe, choisissez un cordon électrique harmon-
isé internationalement et marqué "<HAR>",
à 3 conducteurs, d’un diamètre de fil minimum de 0,75 mm2, d’une tension
nominale de 300 V, avec une gaine isolée en PVC. Le cordon doit avoir une
fiche moulée d’une tension nominale de 250 V et d’une intensité nominale de
10 A.

48 Mellanox Technologies
QDR InfiniBand Switch Platform User Manual Rev 1.2

Appendix F: Installation - Sicherheitshinweise (German)

1. Installationsanleitungen

Lesen Sie alle Installationsanleitungen, bevor Sie das Gerät an die Stromver-
sorgung anschließen.

2. Übertemperatur

Dieses Gerät sollte nicht in einem Bereich mit einer Umgebungstemperatur

über der maximal empfohlenen Temperatur von 45°C (113°F) betrieben
werden. Es ist ein Luftstrom von 200 LFM bei maximaler Umgebungstemper-
atur erforderlich. Außerdem sollten mindestens 8 cm (3 in.) Freiraum um die
Belüftungsöffnungen sein, um einen einwandfreien Luftstrom zu gewährleist-
en.

3. Stapeln des Chassis

Das Chassis sollte nicht auf andere Geräte gestapelt werden. Wenn das Chassis
herunterfällt, kann es zu Verletzungen und Beschädigungen an Geräten führen.

4. Bei Gewitter - Elektrische Gefahr

Arbeiten Sie während eines Gewitters und Blitzschlag nicht am Gerät,

schließen Sie keine Kabel an oder ab.

5. Anschließen/Trennen von InfiniBand-Kupferkabel

InfiniBand-Kupferkabel sind schwer und nicht flexible. Deshalb müssen sie

vorsichtig an die Anschlüsse angebracht bzw. davon getrennt werden. Lesen
Sie die speziellen Warnungen und Anleitungen des Kabelherstellers.

6. Rack-Montage und Wartung

Wenn dieses Produkt in einem Rack montiert oder gewartet wird, sind beson-
dere Vorsichtsmaßnahmen zu ergreifen, um die Stabilität des Systems zu
gewährleisten. Im Allgemeinen sollten Sie das Gestell von unten nach oben
mit Geräten füllen.

7. Geräteinstallation
Diese Gerät sollte nur von geschultem und qualifiziertem Personal installiert,
ausgetauscht oder gewartet werden.

Mellanox Technologies 49
Rev 1.2

8. Geräteentsorgung
Die Entsorgung dieses Geräts sollte unter Beachtung aller nationalen Gesetze
Bestimmungen erfolgen.

9. Regionale und nationale elektrische Bestimmungen

Dieses Gerät sollte unter Beachtung der regionalen und nationalen elektrischen
Bestimmungen installiert werden.

50 Mellanox Technologies
QDR InfiniBand Switch Platform User Manual Rev 1.2

Appendix G: Advertencias de seguridad para la insta-

lación (Spanish)
1. Instrucciones de instalación

Antes de conectar el equipo a la fuente de alimentación, leer todas las

instrucciones de instalación.

2. Sobrecalentamiento

No se debe utilizar el equipo en un área con una temperatura ambiente

superior a la máxima recomendada: 45°C. Además, para garantizar una
circulación de aire adecuada, se debe dejar como mínimo un espacio de 8
cm (3 pulgadas) alrededor de las aberturas de ventilación.

3. Apilamiento del chasis

Los chasis no se deben apilar sobre otros equipos. La caída del chasis
podría causar lesiones corporales, así como daños al equipo.

4. Cuando hay rayos: peligro de descarga eléctrica

No utilizar el equipo ni conectar o desconectar cables durante períodos

de actividad de rayos.

5. Conexión y desconexión del cable Copper InfiniBand

Dado que los cables de cobre InfiniBand son pesados y no son flexibles,
su conexión a los conectores y su desconexión se deben efectuar con
mucho cuidado. Para ver advertencias o instrucciones especiales, consul-
tar al fabricante del cable.

6. Montaje y mantenimiento de bastidores

Al instalar o realizar el mantenimiento de este aparato en un bastidor, es

preciso adoptar precauciones especiales para garantizar que el sistema se
mantenga estable. En general, en un bastidor, los equipos se deben insta-
lar comenzando desde abajo hacia arriba.

7. Instalación de equipos

La instalación, el reemplazo y el mantenimiento de este equipo estarán a

cargo únicamente de personal capacitado y competente.

Mellanox Technologies 51
Rev 1.2

8. Asegurar confinamientos adecuados

El fabricante del producto final o el usuario final deberán suministrar

un confinamiento adecuado para componentes eléctricos y mecánicos y contra
incendio.

9. Eliminación de equipos

La eliminación definitiva de este equipo se debe efectuar conforme a todas las

leyes y reglamentaciones nacionales.

10. Códigos eléctricos locales y nacionales

Este equipo se debe instalar conforme a los códigos eléctricos locales y nacio-
nales.

11. Cable de alimentación homologado por UL y con certificación CSA

En conexiones de América del Norte, seleccionar un cable de alimentación
homologado por UL y con certificación CSA de tres conductores, [16 AWG],
terminado en un enchufe moldeado con capuchón de 125 voltios nominal, [13
A], con una longitud mínima de 1,5 metros, pero no más de 4,5 metros.
En conexiones europeas, seleccionar un cable de alimentación armonizado
internacionalmente y marcado "<HAR>", de tres conductores, hilo de 1,0 mm2
como mínimo, 300 voltios nominal, con cobertura protectora aislante de PVC.
El cable debe tener un enchufe moldeado con capuchón de 250 voltios nomi-
nal, 10 A.

12. Añadir conexión a tierra

Antes de conectar el dispositivo a la línea de alimentación, los tornillos del

terminal de la puesta a tierra de protección del dispositivo se deben conectar a
la puesta a tierra de protección de la instalación del edificio.
(Información de conexión a tierra):
La instalación del edificio deberá prover un medio para la conexión con la
puesta a tierra de protección y un técnico de servicio deberá conectar
permanentemente el equipo a dicho medio de conexión.
Un TÉCNICO DE SERVICIO comprobará si la toma eléctrica de la que se
suministrará corriente al equipo provee una conexión con la puesta a tierra de
protección del edificio. De no ser así, el TÉCNICO DE SERVICIO se encarga-
rá de instalar un CONDUCTOR DE CONEXIÓN A TIERRA DE PROTEC-
CIÓN, del terminal de puesta a tierra de protección separado al conductor de
tierra de protección del edificio. El equipo se instalará en un área donde haya
conexión equipotencial, como por ejemplo, un centro de telecomunicaciones o
una sala de computadoras dedicada.

52 Mellanox Technologies
QDR InfiniBand Switch Platform User Manual Rev 1.2

13. Códigos de instalación

Este dispositivo se debe instalar conforme a la versión más reciente de los cód-
igos eléctricos nacionales del país en cuestión. En América del Norte, el equipo
se debe instalar de acuerdo con las disposiciones vigentes del Código Eléctrico
Nacional de los EE.UU. y del Código Eléctrico de Canadá.

14. Directiva sobre RAEE

Conforme a la Directiva 2002/96/CE sobre RAEE, todos los residuos de

equipos eléctricos y electrónicos (EEE) se deben recolectar por separado y no
se deben eliminar junto con residuos domésticos.
Al deshacerse de este producto y de todas sus partes, hágalo de una manera res-
ponsable y respetuosa con el medio ambiente.

Mellanox Technologies 53
Rev 1.2

Appendix H: Special Regulations Regarding Finland, Swe-

den, Denmark, and Norway
Denmark- This unit is class I and must be connected with an AC cord compliant with all national
electrical codes in Denmark. The AC cord shall have an integral ground wire, and can only be
plugged into a fully grounded outlet.

Do not connect this unit to any outlet that is not fully grounded!

• Finland -

“Laite on liitettävä suojamaadoituskoskettimilla varustettuun pistora-

siaan”

• Norway -
“Apparatet må tilkoples jordet stikkontakt”
Unit is intended for connection to IT power systems for Norway only.

• Sweden -

“Apparaten skall anslutas till jordat uttag.”

54 Mellanox Technologies