0% found this document useful (0 votes)
305 views170 pages

FusionServer V7 Server GPU Card Operation Guide 08

Uploaded by

serge.osmos
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
0% found this document useful (0 votes)
305 views170 pages

FusionServer V7 Server GPU Card Operation Guide 08

Uploaded by

serge.osmos
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 170

FusionServer Server GPU Card

Operation Guide

Issue 08
Date 2024-07-04

xFusion Digital Technologies Co., Ltd.


Copyright © xFusion Digital Technologies Co., Ltd. 2024. All rights reserved.
No part of this document may be reproduced or transmitted in any form or by any means without prior written
consent of xFusion Digital Technologies Co., Ltd.

Trademarks and Permissions


and other xFusion trademarks are trademarks of xFusion Digital Technologies Co., Ltd.
All other trademarks and trade names mentioned in this document are the property of their respective
holders.

Notice
In this document, "xFusion" is used to refer to "xFusion Digital Technologies Co., Ltd." for concise description
and easy understanding, which does not mean that "xFusion" may have any other meaning. Any "xFusion"
mentioned or described hereof may not be understood as any meaning other than "xFusion Digital
Technologies Co., Ltd.", and xFusion Digital Technologies Co., Ltd. shall not bear any liability resulting from
the use of "xFusion".

The purchased products, services and features are stipulated by the contract made between xFusion and
the customer. All or part of the products, services and features described in this document may not be within
the purchase scope or the usage scope. Unless otherwise specified in the contract, all statements,
information, and recommendations in this document are provided "AS IS" without warranties, guarantees or
representations of any kind, either express or implied.

The information in this document is subject to change without notice. Every effort has been made in the
preparation of this document to ensure accuracy of the contents, but all statements, information, and
recommendations in this document do not constitute a warranty of any kind, express or implied.

xFusion Digital Technologies Co., Ltd.


Address: 9th Floor, Building 1, Zensun Boya Square, Longzihu Wisdom Island
Zhengdong New District 450046
Zhengzhou, Henan Province
People's Republic of China

Website: https://www.xfusion.com

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. i


FusionServer Server GPU Card
Operation Guide About This Document

About This Document

Purpose
This document describes how to configure a graphics processing unit (GPU) on
servers and provides solutions to frequently asked questions (FAQs).

Intended Audience
This document is intended for:

● Technical support engineers


● Maintenance engineers

The server maintenance personnel must have adequate knowledge about the server
products and service skills to avoid injury to human body or damage to devices
during maintenance.

Symbol Conventions
The symbols that may be found in this document are defined as follows.

Symbol Description

Indicates a hazard with a high level of risk which, if not avoided,


will result in death or serious injury.

Indicates a hazard with a medium level of risk which, if not


avoided, could result in death or serious injury.

Indicates a hazard with a low level of risk which, if not avoided,


could result in minor or moderate injury.

Indicates a potentially hazardous situation which, Indicates a


potentially hazardous situation which, if not avoided, could result
in equipment damage, data loss, performance deterioration, or
unanticipated results.
NOTICE is used to address practices not related to personal
injury.

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. ii


FusionServer Server GPU Card
Operation Guide About This Document

Symbol Description

Supplements the important information in the main text.


NOTE is used to address information not related to personal
injury, equipment damage, and environment deterioration.

Change History
Issue Release Date Description

08 2024-07-04 Added A.1.8 The GPU Temperature


Exception Alarm Is Displayed on the
BMC.

07 2024-02-29 ● Added parameters of L40, L40S, H100


PCIe, and H800 PCIe:
2.2 GPU Card.
● Added G5500 V7 compatible GPU card
configuration rules:
3.3.1 GPU Server GPU Configuration
Rule.

06 2023-11-02 Added the GPU card, riser card, and


server information for 2488H V7, 5885H
V6, 5885H V7, G5500 V6 and G5500 V7.

05 2023-09-27 Added:
● 2.3.3 Mapping Between Riser Cards
and V7 Rack Servers.
● 2.4.3 V7 Rack Servers Riser Card
Power Cable.
● 3.2.1.3 V7 Rack Server GPU
Configuration Rule.
Updated:
● 2.3.2 Mapping Between Riser Cards
and V6 Rack Servers.
● 3.2.1.2 V6 Rack Server GPU
Configuration Rule.
● 3.2.2 Rack Server GPU Card Cable
Connection Method.

04 2023-07-03 Added the GPU card, riser card, and


server information for 2288H V5, 2288H
V6, 5885H V6, G5500 and G5500 V6.

03 2023-02-17 Updated 3.2.1.2 V6 Rack Server GPU


Configuration Rule.

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. iii


FusionServer Server GPU Card
Operation Guide About This Document

Issue Release Date Description

02 2022-10-21 Added the GPU card, riser card, and


server information.

01 2022-01-12 This issue is the first official release.

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. iv


FusionServer Server GPU Card
Operation Guide Contents

Contents

About This Document.........................................................................................................ii


1 Overview........................................................................................................................... 1
2 Knowing Devices............................................................................................................. 2
2.1 Server.......................................................................................................................................................... 2
2.2 GPU Card.................................................................................................................................................... 2
2.3 Riser Card..................................................................................................................................................10
2.3.1 Mapping Between Riser Cards and V5 Rack Servers............................................................................ 10
2.3.2 Mapping Between Riser Cards and V6 Rack Servers............................................................................ 25
2.3.3 Mapping Between Riser Cards and V7 Rack Servers............................................................................ 57
2.4 Riser Card Power Cable............................................................................................................................ 74
2.4.1 V5 Rack Servers Riser Card Power Cable............................................................................................. 74
2.4.2 V6 Rack Servers Riser Card Power Cable............................................................................................. 75
2.4.3 V7 Rack Servers Riser Card Power Cable............................................................................................. 78

3 Installing a GPU Card.................................................................................................... 81


3.1 GPU Card Uninstallation Process..............................................................................................................81
3.2 Installing a GPU Card on a Rack Server................................................................................................... 82
3.2.1 Rack Server GPU Configuration Rule.....................................................................................................82
3.2.1.1 V5 Rack Server GPU Configuration Rule............................................................................................ 82
3.2.1.2 V6 Rack Server GPU Configuration Rule............................................................................................ 93
3.2.1.3 V7 Rack Server GPU Configuration Rule.......................................................................................... 106
3.2.2 Rack Server GPU Card Cable Connection Method.............................................................................. 117
3.3 Installing a GPU Card on a GPU Server..................................................................................................121
3.3.1 GPU Server GPU Configuration Rule................................................................................................... 122
3.3.2 GPU Server GPU Card Cable Connection Method.............................................................................. 139

4 Configuring a GPU Card..............................................................................................143


4.1 Installing the GPU Card Driver.................................................................................................................143
4.1.1 Obtaining the Driver Package...............................................................................................................143
4.1.2 Installing and Uninstalling Drivers in Linux........................................................................................... 146
4.1.2.1 Disabling the Nouveau Driver in Linux...............................................................................................146
4.1.2.2 Installing and Uninstalling .run Drivers in Linux................................................................................. 147
4.1.2.3 Installing and Uninstalling .prm Drivers in Linux................................................................................ 150
4.1.3 Installing and Uninstalling Drivers in Windows..................................................................................... 151

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. v


FusionServer Server GPU Card
Operation Guide Contents

A Appendix...................................................................................................................... 157
A.1 FAQ......................................................................................................................................................... 157
A.1.1 GUI Cannot Be Displayed After the GPU Card Is Inserted After the OS Is Installed........................... 157
A.1.2 GUI Cannot Be Displayed After the GPU Driver Is Installed................................................................ 157
A.1.3 Driver Fails to Be Installed Because the GCC Is Not Installed.............................................................158
A.1.4 How to Disable the Nouveau Driver for Different Linux Systems......................................................... 158
A.1.5 Failed to Detect the Kernel Source.......................................................................................................159
A.1.6 Compatibility Between Drivers and GPUs/OSs.................................................................................... 159
A.1.7 Insufficient MMIOH Resources on the OS with Tesla A100 40 GB Configured....................................160
A.1.8 The GPU Temperature Exception Alarm Is Displayed on the BMC......................................................161
A.2 Getting Help.............................................................................................................................................162
A.2.1 Collecting Fault Information..................................................................................................................162
A.2.2 Preparing for Debugging...................................................................................................................... 162
A.2.3 Using Product Documentation..............................................................................................................162
A.2.4 Technical Support.................................................................................................................................162

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. vi


FusionServer Server GPU Card
Operation Guide 1 Overview

1 Overview

This document describes how to install a GPU card on servers, provides precautions
for installing the GPU card, and provides solutions to common problems.
To install a GPU card, perform the following steps:

Step 1 Identify the server model and GPU card model.


Step 2 Check the compatibility between the server and the GPU card.
Check whether the server supports the GPU card.
Step 3 Check the precautions for installing a GPU card.
● GPU card dimensions and number of occupied PCIe slots
● GPU card power consumption
● Part number of the fan module required for installing a GPU card
● Part number of the riser card or ejector lever required for installing a GPU card
● Specifications of the power cable delivered with the GPU card
● Part number of the power cable required for the independent power supply of the
GPU card and power cable connection mode of the GPU card
● BIOS parameters to be set
● System memory capacity supported by the GPU card
● Whether the GPU card occupies I/O resources
Step 4 Install the GPU card and its driver.

----End

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 1


FusionServer Server GPU Card
Operation Guide 2 Knowing Devices

2 Knowing Devices

2.1 Server
2.2 GPU Card
2.3 Riser Card
2.4 Riser Card Power Cable

2.1 Server
Determine the server model based on the silkscreen on the front panel of the server.

2.2 GPU Card


Table 2-1 lists the GPU card models and parameters commonly used on servers.
GPU cards of different models must be installed on riser cards and connected to
power cables.

For details about common riser cards and power cables used on servers, see 2.3
Riser Card and 2.4.1 V5 Rack Servers Riser Card Power Cable.

Table 2-1 GPU card models and parameters

Serie Tesla
s

Featu T4 P4 V100 V100 V100 P100 P100 V100 V100


re 32G s 32G 16G 16G 12G 32G 16G
SXM2 SXM2

Chip TU10 GP10 GV10 GV10 GV10 GP10 GP10 GV10 GV10
Name 4 4 0 0 0 0 0 0 0

GPU 16 8 GB 32 32 16 16 12 32 16
Mem GB GDD GB GB GB GB GB GB GB
ory GDD R5 HBM HBM HBM2 HBM HBM HBM HBM
R6 2 2 2 2 2 2

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 2


FusionServer Server GPU Card
Operation Guide 2 Knowing Devices

Serie Tesla
s

GPU 256 256 4096 4096 4096 4096 4096 4096 4096
Mem bit bit bit bit bit bit bit bit bit
ory
Bit
Width

GPU 320 192 900 900 900 732 549 900 900
Mem GBps GBps GBps GBps GBps GBps GBps GBps GBps
ory
Band
width

NVLin / / / / / / / 6 6
k NVLin NVLin
ks 50 ks 50
Gbps Gbps

CUD 2560 2560 5120 5120 5120 3584 3584 5120 5120
A
Core

Tenso 320 / 640 640 640 / / 640 640


r
Core

RT 40 / / / / / / / /
Core

Powe 70 W 75 W 250 250 250 250 250 300 300


r W W W W W W W
Cons
umpti
on

Dimw HHHL HHHL FHFL FHFL FHFL FHFL FHFL SXM SXM
naons dual- dual- dual- dual- dual- moudl moudl
width width width width width e e

GPU N N N N N N N N N
Card
Port
(DP/
HDMI
)

ECC Y Y Y Y Y Y Y Y Y

Open / / / / / / / / /
GL

Vulka / / / / / / / / /
n

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 3


FusionServer Server GPU Card
Operation Guide 2 Knowing Devices

Serie Tesla
s

Shad / / / / / / / / /
er
Model

Direct / / / / / / / / /
X

CUD Y Y Y Y Y Y Y Y Y
A

Direct Y Y Y Y Y Y Y Y Y
Comp
ute

Open Y Y Y Y Y Y Y Y Y
CL

Table 2-2 GPU card models and parameters


Seri Tesla
es

Feat P100 P100 A100 A100 A100 A800 A40 P40 M60 M10
ure 16G 12G 40G 40G 80G 80G
SXM SXM SXM PCIe PCIe PCIe
2 2 4

Chip GP1 GP1 GA1 GA1 GA1 GA GA1 GP1 GM2 GM1
Nam 00 00 00 00 00 100 02 02 04*2 07*4
e

GPU 16 12 40 40 80 80G 48 24 16 32
Mem GB GB GB GB GB B GB GB GB GB
ory HBM HBM HBM HBM HBM HBM DDR GDD GDD GDD
2 2 2 2 2e 2e 6 R5 R5 R5

GPU 4096 4096 5120 5120 5120 5120 384 384 256 128
Mem bit bit bit bit bit -bit bit bit bit bit
ory
Bit
Widt
h

GPU 732 732 1555 1555 1935 1.94 696 347 160 83
Mem GBp GBp GBp GBp GBp TB/s GBp GBp GBp GBp
ory s s s s s s s s s
Band
width

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 4


FusionServer Server GPU Card
Operation Guide 2 Knowing Devices

Seri Tesla
es

NVLi 4 4 12 12 12 8 112 / / /
nk NVLi NVLi NVLi NVLi NVLi NVLi GB/s
nks nks nks nks nks nks
40 40 50 50 50 50G
Gbps Gbps Gbps Gbps Gbps bps

CUD 3584 3584 6900 6900 6912 6912 1075 3840 4096 2560
A 2
Core

Tens / / 432 432 432 432 336 / / /


or
Core

RT / / / / / / 84 / / /
Core

Pow 300 300 400 250 300 300 300 250 300 225
er W W W W W W W W W W
Cons
umpt
ion

Dime SXM SXM SXM FHF FHF FHF FHF FHF FHF FHF
nsion mou mou mou L L L L L L L
s dle dle dle dual- dual- dual- dual- dual- dual- dual-
width width width width width width width

GPU N N N N N N N N N N
Card
Port
(DP/
HDM
I)

ECC Y Y Y Y Y Y Y Y Y Y

Ope / / / / / / Y / Y Y
nGL

Vulk / / / / / / Y / Y Y
an

Shad / / / / / / Y / Y Y
er
Mod
el

Direc / / / / / / Y / Y Y
tX

CUD Y Y Y Y Y Y Y Y Y Y
A

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 5


FusionServer Server GPU Card
Operation Guide 2 Knowing Devices

Seri Tesla
es

Direc Y Y Y Y Y Y / Y / /
tCom
pute

Ope Y Y Y Y Y Y Y Y / /
nCL

Table 2-3 GPU card models and parameters


Seri Tesla RTX
es

Fea A16 A2 A30 A10 L40 L40 L2 L2 H10 H80 A40 A60
ture S 0 0 0 00 00
PCI PCI
e e

Chi GA GA GA GA / / / / GH GH GA GA
p 107 107 100 102 100 100 104 102
Na
me

GP 16 16 24 24 48G 48G 48 24 80G 80G 16 48


U GB GB G G B B GB GB B B GB G
Me x4 GD HB DD GD GD GD GD HB HB GD DD
mor DD DR M2 R6 DR DR DR DR M2 M2 DR R6
y R6 6 6 6 6 6 e e 6

GP 128 128 307 384 384 384 38 192 512 512 256 384
U bit bits 2 bit bits -bits -bits 4- - 0- 0- bit bits
Me x4 bits bits bits bits
mor
y
Bit
Wid
th

GP 231 200 933 600 864 864 86 300 2TB 2TB 448 768
U .9 GB/ .1 .2 GB/ GB/ 4G GB/ /s /s GB/ .0
Me GB/ s GB/ GB/ s s B/s s s GB/
mor s x4 s s s
y
Ban
dwi
dth

NV / / 200 / / / / / 600 400 112 112


Link GB/ GB/ GB/ GB/ GB/
s s s s s

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 6


FusionServer Server GPU Card
Operation Guide 2 Knowing Devices

Seri Tesla RTX


es

CU 256 128 358 921 181 181 117 588 145 145 614 107
DA 0 x4 0 4 6 76 76 76 8 92 92 4 52
Cor
e

Ten 256 40 224 288 568 568 36 184 456 456 192 336
sor 0 x4 8
Cor
e

RT 20* 10 96 72 142 142 92 46 / / 48 84


Cor 4
e

Po 250 40- 165 150 300 350 35 72 350 350 140 300
wer W 60 W W W W 0W W W W W W
Con W
sum
ptio
n

Dim FH HH FH FH FH FH FH HH FH FH FH FH
ensi FL HL FL FL FL FL FL HL FL FL FL FL
ons dual dual dual dual dual du sin dual dual dual dual
- - -slot - - al- gle- - - -slot -
widt widt widt widt wid widt widt widt widt
h h h h th h h h h

GP N / N N 4x 4x 4x / N N N N
U DP DP DP
Car
d
Port
(DP
/
HD
MI)

EC Y Y Y Y Y Y Y Y Y Y Y Y
C

Ope Y / / Y Y Y Y Y N N Y Y
nGL

Vulk Y / / Y Y Y Y Y N N Y Y
an

Sha Y / / Y Y Y Y Y N N Y Y
der
Mo
del

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 7


FusionServer Server GPU Card
Operation Guide 2 Knowing Devices

Seri Tesla RTX


es

Dire Y / N Y Y Y Y Y N N Y Y
ctX

CU Y / Y Y Y Y Y Y Y Y Y Y
DA

Dire / / / / / / / / N N Y /
ctC
om
put
e

Ope Y / Y Y Y Y Y Y Y N Y Y
nCL

Table 2-4 GPU card models and parameters


Serie Quadro
s

Featu RTX6 RTX6 RTX5 P600 P500 P400 P200 P600 P400
re 000 000 000 0 0 0 0
Active Passi
Cooli ve
ng Cooli
ng

Chip TU10 TU10 TU10 GP10 GP10 GP10 GP10 GP10 GP10
Name 2 2 4 2 4 4 6 7 7

GPU 24GB 24GB 16GB 24GB 16GB 8GB 5GB 2GB 2GB
Mem GDD GDD GDD GDD GDD GDD GDD GDD GDD
ory R6 R6 R6 R5 R5 R5 R5 R5 R5

GPU 384 384 256 384 256 256 160 128 64 bit
Mem bit bit bit bit bit bit bit bit
ory
Bit
Width

GPU 672 672 448 432 288 243 140 64 32


Mem GBps GBps GBps GBps GBps GBps GBps GBps GBps
ory
Band
width

NVLin / / / / / / / / /
k

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 8


FusionServer Server GPU Card
Operation Guide 2 Knowing Devices

Serie Quadro
s

CUD 4608 4608 3072 3840 2560 1792 1024 354 256
A
Core

Tenso 576 576 384 / / / / / /


r
Core

RT 72 72 48 / / / / / /
Core

Powe 295 250 265 250 180 105 75 W 40 W 30 W


r W W W W W W
Cons
umpti
on

Dime FHFL FHFL FHFL FHFL FHFL FHFL FHFL HHHL HHHL
nsion dual- dual- dual- dual- dual- dual- dual-
s width width width width width width slot

GPU VL+4 N VL+4 DVI-D DVI-D 4x 4x 4x 4x


Card x DP x DP +4 x +4 x DP DP mDP mDP
Port DP DP
(DP/
HDMI
)

ECC Y Y Y Y Y N N N N

Open Y Y Y Y Y Y Y Y Y
GL

Vulka Y Y Y Y Y Y Y Y Y
n

Shad Y Y Y Y Y Y Y Y Y
er
Model

Direct Y Y Y Y Y Y Y Y Y
X

CUD Y Y Y Y Y Y Y Y Y
A

Direct Y Y Y Y Y Y Y Y Y
Comp
ute

Open Y Y Y Y Y Y Y Y Y
CL

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 9


FusionServer Server GPU Card
Operation Guide 2 Knowing Devices

NO TE

In the table, Y indicates that the feature is supported, N indicates that the feature is not
supported, and / indicates that the feature is not involved.

2.3 Riser Card

2.3.1 Mapping Between Riser Cards and V5 Rack Servers


Different servers support different riser cards. For details, see Table 2-5.

Table 2-5 Mapping between riser cards and V5servers

Riser Slot PCIe Slot and Signal Support Delivered Riser


Card No. Specifications ed Power Card
Part Server Cable Figure
No. Model

02311 Slot 1 Physical 16x full- 2288H 04150606 x See


TWQ slot height full- V5 1 Figure
dimension length 04150627-0 2-1.
s (FHFL) 01 x 1
PCIe 16x
signal
specificati
ons

Slot 2 Physical 16x full-


slot height half-
dimension length
s (FHHL)

PCIe 8x
signal
specificati
ons

02311 Slot 1 Physical 16x FHFL 2288H None See


XAH slot V5 Figure
dimension 2-2.
s

PCIe 16x
signal
specificati
ons

Slot 4 Physical 16x FHHL


slot
dimension
s

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 10


FusionServer Server GPU Card
Operation Guide 2 Knowing Devices

Riser Slot PCIe Slot and Signal Support Delivered Riser


Card No. Specifications ed Power Card
Part Server Cable Figure
No. Model

PCIe 8x
signal
specificati
ons

02311 Slot 7 Physical 16x half- 2288H None See


VLP slot height half- V5 Figure
dimension length 2-3.
s (HHHL)

PCIe 16x
signal
specificati
ons

02311 Slot 7 Physical 16x HHHL 2288H None See


TWT slot V5 Figure
dimension 2-4.
s

PCIe 8x
signal
specificati
ons

Slot 8 Physical 8x HHHL 2288H None


slot V5
dimension
s

PCIe 8x
signal
specificati
ons

02312 Slot 1 Physical 16x HHHL 2288H None See


LSP slot V5 Figure
dimension 2-5.
s

PCIe 16x
signal
specificati
ons

Slot 3 Physical 16x HHHL


slot
dimension
s

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 11


FusionServer Server GPU Card
Operation Guide 2 Knowing Devices

Riser Slot PCIe Slot and Signal Support Delivered Riser


Card No. Specifications ed Power Card
Part Server Cable Figure
No. Model

PCIe 8x
signal
specificati
ons

02312 Slot 1 Physical 16x HHHL 2288H None See


FJB slot V5 Figure
dimension 2-6.
s

PCIe 8x
signal
specificati
ons

Slot 2 Physical 16x HHHL


slot
dimension
s

PCIe 8x
signal
specificati
ons

Slot 3 Physical 16x HHHL


slot
dimension
s

PCIe 8x
signal
specificati
ons

02580 Slot 1 Physical 16x HHHL 2288H None See


025 slot V5 Figure
dimension 2-7.
s

PCIe 8x
signal
specificati
ons

Slot 3 Physical 16x HHHL


slot
dimension
s

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 12


FusionServer Server GPU Card
Operation Guide 2 Knowing Devices

Riser Slot PCIe Slot and Signal Support Delivered Riser


Card No. Specifications ed Power Card
Part Server Cable Figure
No. Model

PCIe 8x
signal
specificati
ons

02311 Slot 1 Physical 16x HHHL 1288H None See


XAG slot V5 Figure
dimension 2-8.
s

PCIe 16x
signal
specificati
ons

02311 Slot 2 Physical 16x HHHL 1288H None See


TWF slot V5 Figure
dimension 2-9.
s

PCIe 16x
signal
specificati
onsPCIe
signal
specificati
ons

Slot 3 Physical 16x FHHL


slot
dimension
s

PCIe 8x
signal
specificati
ons

02312 Slot 1 Physical 16x HHHL 5288 V5 None See


FJB slot Figure
dimension 2-6.
s

PCIe 8x
signal
specificati
ons

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 13


FusionServer Server GPU Card
Operation Guide 2 Knowing Devices

Riser Slot PCIe Slot and Signal Support Delivered Riser


Card No. Specifications ed Power Card
Part Server Cable Figure
No. Model

Slot 2 Physical 16x HHHL


slot
dimension
s

PCIe 8x
signal
specificati
onsPCIe
signal
specificati
ons

Slot 3 Physical 16x HHHL


slot
dimension
s

PCIe 8x
signal
specificati
ons

02311 Slot 1 Physical 16x FHHL 2488H None See


YHH slot V5 Figure
dimension 2-10.
s

PCIe 16x
signal
specificati
ons

Slot 2 Physical 8x FHHL


slot
dimension
s

PCIe 8x
signal
specificati
ons

02311 Slot 1 Physical 16x full- 2488H None See


YHJ slot height 3/4- V5 Figure
dimension length 2-11.
s

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 14


FusionServer Server GPU Card
Operation Guide 2 Knowing Devices

Riser Slot PCIe Slot and Signal Support Delivered Riser


Card No. Specifications ed Power Card
Part Server Cable Figure
No. Model

PCIe 16x
signal
specificati
ons

Slot 2 Physical 8x FHHL


slot
dimension
s

PCIe 8x
signal
specificati
ons

02311 Slot 4 Physical 16x FHHL 2488 V5 None See


WGF slot Figure
dimension 2-12.
s

PCIe 16x
signal
specificati
ons

02312 Slot 1 Physical 8x FHFL 5885H None See


BAG slot V5 Figure
dimension 2-13.
s

PCIe 4x
signal
specificati
ons

Slot 2 Physical 16x FHFL


slot
dimension
s

PCIe 16x
signal
specificati
ons

Slot 3 Physical 8x FHFL


slot
dimension
s

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 15


FusionServer Server GPU Card
Operation Guide 2 Knowing Devices

Riser Slot PCIe Slot and Signal Support Delivered Riser


Card No. Specifications ed Power Card
Part Server Cable Figure
No. Model

PCIe 4x
signal
specificati
ons

Slot 4 Physical 16x FHFL


slot
dimension
s

PCIe 16x
signal
specificati
onsPCIe
signal
specificati
ons

Slot 5 Physical 8x FHHL


slot
dimension
s

PCIe 8x
signal
specificati
ons

Slot 6 Physical 8x FHHL


slot
dimension
s

PCIe 8x
signal
specificati
ons

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 16


FusionServer Server GPU Card
Operation Guide 2 Knowing Devices

Figure 2-1 Riser card (02311TWQ)

Figure 2-2 Riser card (02311XAH)

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 17


FusionServer Server GPU Card
Operation Guide 2 Knowing Devices

Figure 2-3 Riser card (02311VLP)

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 18


FusionServer Server GPU Card
Operation Guide 2 Knowing Devices

Figure 2-4 Riser card (02311TWT)

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 19


FusionServer Server GPU Card
Operation Guide 2 Knowing Devices

Figure 2-5 Riser card (02312LSP)

Figure 2-6 Riser Card (02312FJB)

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 20


FusionServer Server GPU Card
Operation Guide 2 Knowing Devices

Figure 2-7 Riser Card (02580025)

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 21


FusionServer Server GPU Card
Operation Guide 2 Knowing Devices

Figure 2-8 Riser card (02311XAG)

Figure 2-9 Riser card (02311TWF)

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 22


FusionServer Server GPU Card
Operation Guide 2 Knowing Devices

Figure 2-10 Riser card (02311YHH)

Figure 2-11 Riser card (02311YHJ)

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 23


FusionServer Server GPU Card
Operation Guide 2 Knowing Devices

Figure 2-12 Riser card (02311WGF)

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 24


FusionServer Server GPU Card
Operation Guide 2 Knowing Devices

Figure 2-13 Riser card (02312BAG)

2.3.2 Mapping Between Riser Cards and V6 Rack Servers


Different servers support different riser cards. For details, see Table 2-6.

Table 2-6 Mapping between riser cards and V6 servers


Riser Slot No. PCIe Slot and Supporte Delivere Riser
Card Signal d Server d Power Card
Part No. Specifications Model Cable Figure

02580119 Slot 1 Physical Not 2288H None See


slot supporte V6-32DI Figure
dimensio d MM 2-14.
ns general-
purpose
PCIe Not chassis
signal supporte
specificat d
ions

Slot 2 Physical 16x half-


slot height
dimensio half-
ns length
(HHHL)

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 25


FusionServer Server GPU Card
Operation Guide 2 Knowing Devices

Riser Slot No. PCIe Slot and Supporte Delivere Riser


Card Signal d Server d Power Card
Part No. Specifications Model Cable Figure

PCIe 16X
signal
specificat
ions

Slot 3 Physical 16x


slot HHHL
dimensio
ns

PCIe 16X
signal
specificat
ions

Slot 4 Physical Not


slot supporte
dimensio d
ns

PCIe Not
signal supporte
specificat d
ions

Slot 5 Physical 16x


slot HHHL
dimensio
ns

PCIe 16X
signal
specificat
ions

Slot 6 Physical 16x


slot HHHL
dimensio
ns

PCIe 16X
signal
specificat
ions

0258012 Slot 1 Physical 16x 2288H None See


0 slot HHHL V6-32DI Figure
dimensio MM 2-15.
ns general-
purpose
chassis

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 26


FusionServer Server GPU Card
Operation Guide 2 Knowing Devices

Riser Slot No. PCIe Slot and Supporte Delivere Riser


Card Signal d Server d Power Card
Part No. Specifications Model Cable Figure

PCIe 16X
signal
specificat
ions

Slot 2 Physical 16x


slot HHHL
dimensio
ns

PCIe 8X
signal
specificat
ions

Slot 3 Physical 16x


slot HHHL
dimensio
ns

PCIe 8X
signal
specificat
ions

Slot 4 Physical 16x


slot HHHL
dimensio
ns

PCIe 16X
signal
specificat
ions

Slot 5 Physical 16x


slot HHHL
dimensio
ns

PCIe 8X
signal
specificat
ions

Slot 6 Physical 16x


slot HHHL
dimensio
ns

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 27


FusionServer Server GPU Card
Operation Guide 2 Knowing Devices

Riser Slot No. PCIe Slot and Supporte Delivere Riser


Card Signal d Server d Power Card
Part No. Specifications Model Cable Figure

PCIe 8X
signal
specificat
ions

0258015 Slot 7 Physical Not 2288H None See


7 slot supporte V6-32DI Figure
dimensio d MM 2-16.
ns general-
purpose
PCIe Not chassis
signal supporte
specificat d
ions

Slot 8 Physical 16x full-


slot height
dimensio half-
ns length
(FHHL)

PCIe 16X
signal
specificat
ions

0258015 Slot 7 Physical 16X 2288H None See


6 slot FHHL V6-32DI Figure
dimensio MM 2-17.
ns general-
purpose
PCIe 8X chassis
signal
specificat
ions

Slot 8 Physical 16X


slot FHHL
dimensio
ns

PCIe 8X
signal
specificat
ions

0258Y02 Slot 1 Physical 16x full- 2288H 0415276 See


4 slot height V6-32DI 4x1 Figure
dimensio full- MM 0415276 2-18.
ns length general- 6x1
(FHFL)

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 28


FusionServer Server GPU Card
Operation Guide 2 Knowing Devices

Riser Slot No. PCIe Slot and Supporte Delivere Riser


Card Signal d Server d Power Card
Part No. Specifications Model Cable Figure

PCIe 16X purpose 0415Y00


signal chassis 1x1
specificat
ions

Slot 2 Physical 16X


slot FHFL
dimensio
ns

PCIe 16X
signal
specificat
ions

Slot 3 Physical Not


slot supporte
dimensio d
ns

PCIe Not
signal supporte
specificat d
ions

Slot 4 Physical 16X


slot FHFL
dimensio
ns

PCIe 16X
signal
specificat
ions

Slot 5 Physical 16X


slot FHFL
dimensio
ns

PCIe 16X
signal
specificat
ions

Slot 6 Physical Not


slot supporte
dimensio d
ns

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 29


FusionServer Server GPU Card
Operation Guide 2 Knowing Devices

Riser Slot No. PCIe Slot and Supporte Delivere Riser


Card Signal d Server d Power Card
Part No. Specifications Model Cable Figure

PCIe Not
signal supporte
specificat d
ions

0258Y00 Slot 1 Physical 16X 2288H 0415Y00 See


2 slot FHFL V6-32DI 1x1 Figure
dimensio MM 0415276 2-19.
ns general- 4x1
purpose
PCIe 16X chassis
signal
specificat
ions

Slot 2 Physical 16X


slot FHFL
dimensio
ns

PCIe 8X
signal
specificat
ions

Slot 3 Physical 16X


slot FHHL
dimensio
ns

PCIe 8X
signal
specificat
ions

Slot 4 Physical 16X


slot FHFL
dimensio
ns

PCIe 16X
signal
specificat
ions

Slot 5 Physical 16X


slot FHFL
dimensio
ns

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 30


FusionServer Server GPU Card
Operation Guide 2 Knowing Devices

Riser Slot No. PCIe Slot and Supporte Delivere Riser


Card Signal d Server d Power Card
Part No. Specifications Model Cable Figure

PCIe 8X
signal
specificat
ions

Slot 6 Physical 16X


slot FHHL
dimensio
ns

PCIe 8X
signal
specificat
ions

0258012 Slot 1 Physical Not 2288H 0415276 See


1 slot supporte V6-32DI 4x1 Figure
dimensio d MM 0415276 2-20.
ns general- 6x1
purpose
PCIe Not chassis 0415Y00
signal supporte 1x1
specificat d
ions

Slot 2 Physical 16X


slot FHFL
dimensio dual-slot
ns

PCIe 16X
signal
specificat
ions

Slot 3 Physical 16X


slot FHHL
dimensio
ns

PCIe 16X
signal
specificat
ions

Slot 4 Physical Not


slot supporte
dimensio d
ns

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 31


FusionServer Server GPU Card
Operation Guide 2 Knowing Devices

Riser Slot No. PCIe Slot and Supporte Delivere Riser


Card Signal d Server d Power Card
Part No. Specifications Model Cable Figure

PCIe Not
signal supporte
specificat d
ions

Slot 5 Physical 16X


slot FHFL
dimensio dual-slot
ns

PCIe 16X
signal
specificat
ions

Slot 6 Physical 16X


slot FHHL
dimensio
ns

PCIe 16X
signal
specificat
ions

0258017 Slot 2 Physical 16X 2288H 0415276 See


6 slot FHFL V6-32DI 4x1 Figure
dimensio dual-slot MM 0415276 2-21.
ns general- 6x1
purpose
PCIe 16X chassis 0415Y00
signal 1x1
specificat
ions

Slot 3 Physical 16X


slot FHFL
dimensio dual-slot
ns

PCIe 16X
signal
specificat
ions

Slot 5 Physical 16X


slot FHFL
dimensio dual-slot
ns

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 32


FusionServer Server GPU Card
Operation Guide 2 Knowing Devices

Riser Slot No. PCIe Slot and Supporte Delivere Riser


Card Signal d Server d Power Card
Part No. Specifications Model Cable Figure

PCIe 16X
signal
specificat
ions

Slot 6 Physical 16X


slot FHFL
dimensio dual-slot
ns

PCIe 16X
signal
specificat
ions

03034CR Slot 1 Physical Not 2288H 0415276 See


K slot supporte V6-32DI 6x4 Figure
+03034C dimensio d MM 4- 2-22 and
UW ns GPU Figure
chassis 2-24.
PCIe Not
signal supporte
specificat d
ions

Slot 2 Physical 16X


slot FHFL
dimensio dual-slot
ns

PCIe 16X
signal
specificat
ions

Slot 3 Physical 16X


slot FHFL
dimensio dual-slot
ns

PCIe 16X
signal
specificat
ions

Slot 4 Physical Not


slot supporte
dimensio d
ns

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 33


FusionServer Server GPU Card
Operation Guide 2 Knowing Devices

Riser Slot No. PCIe Slot and Supporte Delivere Riser


Card Signal d Server d Power Card
Part No. Specifications Model Cable Figure

PCIe Not
signal supporte
specificat d
ions

03034CR Slot 5 Physical Not 2288H 0415219 See


M slot supporte V6-32DI 4x4 Figure
+03034C dimensio d MM 4- 2-23 and
UW ns GPU Figure
chassis 2-24
PCIe Not
signal supporte
specificat d
ions

Slot 6 Physical 16X


slot FHFL
dimensio dual-slot
ns

PCIe 16X
signal
specificat
ions

Slot 7 Physical 16X


slot FHFL
dimensio dual-slot
ns

PCIe 16X
signal
specificat
ions

Slot 8 Physical Not


slot supporte
dimensio d
ns

PCIe Not
signal supporte
specificat d
ions

0258018 Slot 1 Physical 16X 2288H None See


6 slot FHHL V6-32DI Figure
dimensio MM 11 2-25.
ns standard
card
chassis

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 34


FusionServer Server GPU Card
Operation Guide 2 Knowing Devices

Riser Slot No. PCIe Slot and Supporte Delivere Riser


Card Signal d Server d Power Card
Part No. Specifications Model Cable Figure

PCIe 8X
signal
specificat
ions

Slot 2 Physical 16X


slot FHHL
dimensio
ns

PCIe 8X
signal
specificat
ions

Slot 3 Physical 16X


slot FHHL
dimensio
ns

PCIe 8X
signal
specificat
ions

Slot 4 Physical 16x


slot HHHL
dimensio
ns

PCIe 8X
signal
specificat
ions

Slot 5 Physical 16x


slot HHHL
dimensio
ns

PCIe 8X
signal
specificat
ions

Slot 6 Physical 16x


slot HHHL
dimensio
ns

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 35


FusionServer Server GPU Card
Operation Guide 2 Knowing Devices

Riser Slot No. PCIe Slot and Supporte Delivere Riser


Card Signal d Server d Power Card
Part No. Specifications Model Cable Figure

PCIe 8X
signal
specificat
ions

0258020 Slot 7 Physical 16x 2288H None See


6 slot HHHL V6-32DI Figure
dimensio MM 11 2-26.
ns standard
card
PCIe 16X chassis
signal
specificat
ions

Slot 8 Physical 16x


slot HHHL
dimensio
ns

PCIe 8X
signal
specificat
ions

Slot 9 Physical 16x


slot HHHL
dimensio
ns

PCIe 8X
signal
specificat
ions

0258015 Slot 10 Physical 16X 2288H None See


6 slot FHHL V6-32DI Figure
dimensio MM 11 2-17.
ns standard
card
PCIe 8X chassis
signal
specificat
ions

Slot 11 Physical 16X


slot FHHL
dimensio
ns

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 36


FusionServer Server GPU Card
Operation Guide 2 Knowing Devices

Riser Slot No. PCIe Slot and Supporte Delivere Riser


Card Signal d Server d Power Card
Part No. Specifications Model Cable Figure

PCIe 8X
signal
specificat
ions

02580119 Slot 1 Physical Not 5288 V6 None See


slot supporte Figure
dimensio d 2-14.
ns

PCIe Not
signal supporte
specificat d
ions

Slot 2 Physical 16x


slot HHHL
dimensio
ns

PCIe 16X
signal
specificat
ions

Slot 3 Physical 16x


slot HHHL
dimensio
ns

PCIe 16X
signal
specificat
ions

Slot 4 Physical Not


slot supporte
dimensio d
ns

PCIe Not
signal supporte
specificat d
ions

Slot 5 Physical 16x


slot HHHL
dimensio
ns

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 37


FusionServer Server GPU Card
Operation Guide 2 Knowing Devices

Riser Slot No. PCIe Slot and Supporte Delivere Riser


Card Signal d Server d Power Card
Part No. Specifications Model Cable Figure

PCIe 16X
signal
specificat
ions

Slot 6 Physical 16x


slot HHHL
dimensio
ns

PCIe 16X
signal
specificat
ions

0258012 Slot 1 Physical 16x 5288 V6 None See


0 slot HHHL Figure
dimensio 2-15.
ns

PCIe 16X
signal
specificat
ions

Slot 2 Physical 16x


slot HHHL
dimensio
ns

PCIe 8X
signal
specificat
ions

Slot 3 Physical 16x


slot HHHL
dimensio
ns

PCIe 8X
signal
specificat
ions

Slot 4 Physical 16x


slot HHHL
dimensio
ns

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 38


FusionServer Server GPU Card
Operation Guide 2 Knowing Devices

Riser Slot No. PCIe Slot and Supporte Delivere Riser


Card Signal d Server d Power Card
Part No. Specifications Model Cable Figure

PCIe 16X
signal
specificat
ions

Slot 5 Physical 16x


slot HHHL
dimensio
ns

PCIe 8X
signal
specificat
ions

Slot 6 Physical 16x


slot HHHL
dimensio
ns

PCIe 8X
signal
specificat
ions

0258015 Slot 7 Physical Not 5288 V6 None See


7 slot supporte Figure
dimensio d 2-16.
ns

PCIe Not
signal supporte
specificat d
ions

Slot 8 Physical 16X


slot FHHL
dimensio
ns

PCIe 16X
signal
specificat
ions

0258015 Slot 7 Physical 16X 5288 V6 None See


6 slot FHHL Figure
dimensio 2-17.
ns

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 39


FusionServer Server GPU Card
Operation Guide 2 Knowing Devices

Riser Slot No. PCIe Slot and Supporte Delivere Riser


Card Signal d Server d Power Card
Part No. Specifications Model Cable Figure

PCIe 8X
signal
specificat
ions

Slot 8 Physical 16X


slot FHHL
dimensio
ns

PCIe 8X
signal
specificat
ions

0258012 Slot 1 Physical 16X 1288H V6 None See


6 slot FHHL Figure
dimensio 2-27.
ns

PCIe 16X
signal
specificat
ions

Slot 2 Physical 16x


slot HHHL
dimensio
ns

PCIe 16X
signal
specificat
ions

0258012 Slot 3 Physical 16x 1288H V6 None See


5 slot HHHL Figure
dimensio 2-28.
ns

PCIe 16X
signal
specificat
ions

02313DM Slot 1 Physical 16X 2488H V6 None See


K slot FHHL Figure
dimensio 2-29.
ns

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 40


FusionServer Server GPU Card
Operation Guide 2 Knowing Devices

Riser Slot No. PCIe Slot and Supporte Delivere Riser


Card Signal d Server d Power Card
Part No. Specifications Model Cable Figure

PCIe 8X
signal
specificat
ions

Slot 2 Physical 16X


slot FHHL
dimensio
ns

PCIe 16X
signal
specificat
ions

Slot 3 Physical 16X


slot FHHL
dimensio
ns

PCIe 16X
signal
specificat
ions

02313DM Slot 7 Physical 16X 2488H V6 None See


M slot FHHL Figure
dimensio 2-30.
ns

PCIe 8X
signal
specificat
ions

Slot 8 Physical 16X


slot FHHL
dimensio
ns

PCIe 16X
signal
specificat
ions

Slot 9 Physical 16X


slot FHHL
dimensio
ns

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 41


FusionServer Server GPU Card
Operation Guide 2 Knowing Devices

Riser Slot No. PCIe Slot and Supporte Delivere Riser


Card Signal d Server d Power Card
Part No. Specifications Model Cable Figure

PCIe 16X
signal
specificat
ions

02313DM Slot 1 Physical 16X 2488H V6 None See


B slot FHHL Figure
dimensio 2-31.
ns

PCIe 8X
signal
specificat
ions

Slot 2 Physical 16X


slot FHHL
dimensio
ns

PCIe 16X
signal
specificat
ions

Slot 7 Physical 16X


slot FHHL
dimensio
ns

PCIe 8X
signal
specificat
ions

Slot 8 Physical 16X


slot FHHL
dimensio
ns

PCIe 16X
signal
specificat
ions

02313DL Slot 1 Physical 16X 2488H V6 None See


R slot FHFL Figure
dimensio 2-32.
ns

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 42


FusionServer Server GPU Card
Operation Guide 2 Knowing Devices

Riser Slot No. PCIe Slot and Supporte Delivere Riser


Card Signal d Server d Power Card
Part No. Specifications Model Cable Figure

PCIe 8X
signal
specificat
ions

Slot 2 Physical 16X


slot FHFL
dimensio
ns

PCIe 16X
signal
specificat
ions

Slot 7 Physical 16X


slot FHFL
dimensio
ns

PCIe 8X
signal
specificat
ions

Slot 8 Physical 16X


slot FHFL
dimensio
ns

PCIe 16X
signal
specificat
ions

0231Y79 Slot11 Physical 16X 5885H V6 0415375 See


8 slot FHFL 8-001 x 2 Figure
dimensio dual-slot 2-33
ns

PCIe 16X
signal
specificat
ions

Slot13 Physical 16X


slot FHFL
dimensio dual-slot
ns

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 43


FusionServer Server GPU Card
Operation Guide 2 Knowing Devices

Riser Slot No. PCIe Slot and Supporte Delivere Riser


Card Signal d Server d Power Card
Part No. Specifications Model Cable Figure

PCIe 16X
signal
specificat
ions

0231Y87 Slot15 Physical 16X 5885H V6 0415375 See


4 slot FHFL 8x2 Figure
dimensio dual-slot 2-34
ns

PCIe 16X
signal
specificat
ions

Slot17 Physical 16X


slot FHFL
dimensio dual-slot
ns

PCIe 16X
signal
specificat
ions

Figure 2-14 Riser card (02580119)

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 44


FusionServer Server GPU Card
Operation Guide 2 Knowing Devices

Figure 2-15 Riser card (02580120)

Figure 2-16 Riser card (02580157)

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 45


FusionServer Server GPU Card
Operation Guide 2 Knowing Devices

Figure 2-17 Riser card (02580156)

Figure 2-18 Riser card (0258Y024)

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 46


FusionServer Server GPU Card
Operation Guide 2 Knowing Devices

Figure 2-19 Riser card (0258Y002)

Figure 2-20 Riser card (02580121)

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 47


FusionServer Server GPU Card
Operation Guide 2 Knowing Devices

Figure 2-21 Riser card (02580176)

Figure 2-22 Riser card (03034CRK)

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 48


FusionServer Server GPU Card
Operation Guide 2 Knowing Devices

Figure 2-23 Riser card (03034CRM)

Figure 2-24 Riser card (03034CUW)

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 49


FusionServer Server GPU Card
Operation Guide 2 Knowing Devices

Figure 2-25 Riser card (02580186)

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 50


FusionServer Server GPU Card
Operation Guide 2 Knowing Devices

Figure 2-26 Riser card (02580206)

Figure 2-27 Riser card (02580126)

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 51


FusionServer Server GPU Card
Operation Guide 2 Knowing Devices

Figure 2-28 Riser card (02580125)

Figure 2-29 Riser card (02313DMK)

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 52


FusionServer Server GPU Card
Operation Guide 2 Knowing Devices

Figure 2-30 Riser card (02313DMM)

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 53


FusionServer Server GPU Card
Operation Guide 2 Knowing Devices

Figure 2-31 Riser card (02313DMB)

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 54


FusionServer Server GPU Card
Operation Guide 2 Knowing Devices

Figure 2-32 Riser card (02313DLR)

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 55


FusionServer Server GPU Card
Operation Guide 2 Knowing Devices

Figure 2-33 Riser card (0231Y798)

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 56


FusionServer Server GPU Card
Operation Guide 2 Knowing Devices

Figure 2-34 Riser card (0231Y874)

2.3.3 Mapping Between Riser Cards and V7 Rack Servers


Different servers support different riser cards. For details, see Table 2-7.

Table 2-7 Mapping between riser cards and V7 servers


Riser Slot No. PCIe Slot and Supporte Delivere Riser
Card Signal d Server d Power Card
Part No. Specifications Model Cable Figure

0258Y01 Slot3 Physical 16x half- 1288H None See


8 slot height V7 Figure
dimensio half- 2-35.
ns length
(HHHL)

PCIe 16X
signal
specificat
ions

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 57


FusionServer Server GPU Card
Operation Guide 2 Knowing Devices

Riser Slot No. PCIe Slot and Supporte Delivere Riser


Card Signal d Server d Power Card
Part No. Specifications Model Cable Figure

0258Y01 Slot1 Physical 16x full- 1288H None See


9 slot height V7 Figure
dimensio half- 2-36.
ns length
(FHHL)

PCIe 16X
signal
specificat
ions

Slot2 Physical 16x


slot HHHL
dimensio
ns

PCIe 16X
signal
specificat
ions

0258Y03 Slot2 Physical 16x full- 2288H None See


0 slot height V7 Figure
dimensio full- general- 2-37.
ns length purpose
(FHFL) chassis

PCIe 16X
signal
specificat
ions

Slot3 Physical 16x full-


slot height
dimensio half-
ns length
(FHHL)

PCIe 16X
signal
specificat
ions

Slot5 Physical 16x full-


slot height
dimensio full-
ns length
(FHFL)

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 58


FusionServer Server GPU Card
Operation Guide 2 Knowing Devices

Riser Slot No. PCIe Slot and Supporte Delivere Riser


Card Signal d Server d Power Card
Part No. Specifications Model Cable Figure

PCIe 16X
signal
specificat
ions

Slot6 Physical 16x full-


slot height
dimensio half-
ns length
(FHHL)

PCIe 16X
signal
specificat
ions

0258Y19 Slot1 Physical 16x full- 2288H None See


3 slot height V7 Figure
dimensio full- general- 2-38.
ns length purpose
(FHFL) chassis

PCIe 16X
signal
specificat
ions

Slot2 Physical 16x full-


slot height
dimensio full-
ns length
(FHFL)

PCIe 16X
signal
specificat
ions

Slot4 Physical 16x full-


slot height
dimensio full-
ns length
(FHFL)

PCIe 16X
signal
specificat
ions

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 59


FusionServer Server GPU Card
Operation Guide 2 Knowing Devices

Riser Slot No. PCIe Slot and Supporte Delivere Riser


Card Signal d Server d Power Card
Part No. Specifications Model Cable Figure

Slot5 Physical 16x full-


slot height
dimensio full-
ns length
(FHFL)

PCIe 16X
signal
specificat
ions

0258Y07 Slot1 Physical 16x full- 2288H 0415375 See


8+0258Y slot height V7 4- 8x2 Figure
079 dimensio full- GPU 0415Y01 2-46 and
ns length chassis 7-001 x 2 Figure
(FHFL) 2-47.
PCIe 16X
signal
specificat
ions

Slot4 Physical 16x full-


slot height
dimensio full-
ns length
(FHFL)

PCIe 16X
signal
specificat
ions

Slot7 Physical 16x full-


slot height
dimensio full-
ns length
(FHFL)

PCIe 16X
signal
specificat
ions

Slot9 Physical 16x full-


slot height
dimensio full-
ns length
(FHFL)

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 60


FusionServer Server GPU Card
Operation Guide 2 Knowing Devices

Riser Slot No. PCIe Slot and Supporte Delivere Riser


Card Signal d Server d Power Card
Part No. Specifications Model Cable Figure

PCIe 16X
signal
specificat
ions

0258Y15 Slot1 Physical 16x full- 2488H None See


4 slot height V7 Figure
dimensio half- 2-39.
ns length
(FHHL)

PCIe 16X
signal
specificat
ions

Slot2 Physical 16x full-


slot height
dimensio half-
ns length
(FHHL)

PCIe 16X
signal
specificat
ions

0258Y15 Slot7 Physical 16x full- 2488H None See


5 slot height V7 Figure
dimensio half- 2-40.
ns length
(FHHL)

PCIe 16X
signal
specificat
ions

Slot8 Physical 16x full-


slot height
dimensio half-
ns length
(FHHL)

PCIe 16X
signal
specificat
ions

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 61


FusionServer Server GPU Card
Operation Guide 2 Knowing Devices

Riser Slot No. PCIe Slot and Supporte Delivere Riser


Card Signal d Server d Power Card
Part No. Specifications Model Cable Figure

0258Y06 Slot10 Physical 16x full- 5885H 0415214 See


3 slot height V7 2-015 x 1 Figure
dimensio full- 2-41.
ns length
(FHFL)

PCIe 16X
signal
specificat
ions

Slot11 Physical 16x full-


slot height
dimensio full-
ns length
(FHFL)

PCIe 16X
signal
specificat
ions

Slot12 Physical 16x full-


slot height
dimensio full-
ns length
(FHFL)

PCIe 16X
signal
specificat
ions

Slot13 Physical 16x full-


slot height
dimensio full-
ns length
(FHFL)

PCIe 16X
signal
specificat
ions

0258Y06 Slot14 Physical 16x full- 5885H 0415270 See


4 slot height V7 4-001 x 1 Figure
dimensio full- 2-42.
ns length
(FHFL)

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 62


FusionServer Server GPU Card
Operation Guide 2 Knowing Devices

Riser Slot No. PCIe Slot and Supporte Delivere Riser


Card Signal d Server d Power Card
Part No. Specifications Model Cable Figure

PCIe 16X
signal
specificat
ions

Slot15 Physical 16x full-


slot height
dimensio full-
ns length
(FHFL)

PCIe 16X
signal
specificat
ions

Slot16 Physical 16x full-


slot height
dimensio full-
ns length
(FHFL)

PCIe 16X
signal
specificat
ions

Slot17 Physical 16x full-


slot height
dimensio full-
ns length
(FHFL)

PCIe 16X
signal
specificat
ions

0258Y06 Slot18 Physical 16x full- 5885H 0415214 See


5 slot height V7 2-003 x 1 Figure
dimensio full- 2-43.
ns length
(FHFL)

PCIe 16X
signal
specificat
ions

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 63


FusionServer Server GPU Card
Operation Guide 2 Knowing Devices

Riser Slot No. PCIe Slot and Supporte Delivere Riser


Card Signal d Server d Power Card
Part No. Specifications Model Cable Figure

Slot19 Physical 16x full-


slot height
dimensio full-
ns length
(FHFL)

PCIe 16X
signal
specificat
ions

Slot20 Physical 16x full-


slot height
dimensio full-
ns length
(FHFL)

PCIe 16X
signal
specificat
ions

Slot21 Physical 16x full-


slot height
dimensio full-
ns length
(FHFL)

PCIe 16X
signal
specificat
ions

0258Y06 Slot11 Physical 16x full- 5885H 0415214 See


6 slot height V7 2-015 x 1 Figure
dimensio full- 2-44.
ns length
(FHFL)

PCIe 16X
signal
specificat
ions

Slot13 Physical 16x full-


slot height
dimensio full-
ns length
(FHFL)

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 64


FusionServer Server GPU Card
Operation Guide 2 Knowing Devices

Riser Slot No. PCIe Slot and Supporte Delivere Riser


Card Signal d Server d Power Card
Part No. Specifications Model Cable Figure

PCIe 16X
signal
specificat
ions

0258Y06 Slot19 Physical 16x full- 5885H 0415214 See


7 slot height V7 2-003 x 1 Figure
dimensio full- 2-45.
ns length
(FHFL)

PCIe 16X
signal
specificat
ions

Slot21 Physical 16x full-


slot height
dimensio full-
ns length
(FHFL)

PCIe 16X
signal
specificat
ions

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 65


FusionServer Server GPU Card
Operation Guide 2 Knowing Devices

Figure 2-35 0258Y018

Figure 2-36 0258Y019

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 66


FusionServer Server GPU Card
Operation Guide 2 Knowing Devices

Figure 2-37 0258Y030

Figure 2-38 0258Y193

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 67


FusionServer Server GPU Card
Operation Guide 2 Knowing Devices

Figure 2-39 0258Y154

Figure 2-40 0258Y155

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 68


FusionServer Server GPU Card
Operation Guide 2 Knowing Devices

Figure 2-41 0258Y063

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 69


FusionServer Server GPU Card
Operation Guide 2 Knowing Devices

Figure 2-42 0258Y064

Figure 2-43 0258Y065

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 70


FusionServer Server GPU Card
Operation Guide 2 Knowing Devices

Figure 2-44 0258Y066

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 71


FusionServer Server GPU Card
Operation Guide 2 Knowing Devices

Figure 2-45 0258Y067

Figure 2-46 0258Y078

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 72


FusionServer Server GPU Card
Operation Guide 2 Knowing Devices

Figure 2-47 0258Y079

Figure 2-48 0258Y232

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 73


FusionServer Server GPU Card
Operation Guide 2 Knowing Devices

2.4 Riser Card Power Cable

2.4.1 V5 Rack Servers Riser Card Power Cable


Different types of riser cards can be configured with independent power cables to
support the normal running of high-power components. For details about the power
cables supported by riser cards, see Table 2-8.

Table 2-8 Riser card power cables

Riser Card Cable Supported Figure


Power Cable Specifications Riser Card
Part No. Part No.

04150606 6-pin to 8-pin 02311TWQ -

04150627-001 8-pin to 8-pin 02311TWQ, See Figure 2-49.


02311XAH

04150627 8-pin to 8-pin 02312BAG, See Figure 2-50.


02311XAH

04150627-002 8-pin to 8-pin 02312BAG See Figure 2-51.

Figure 2-49 Riser card power cable (04150627-001)

Figure 2-50 Riser card power cable (04150627)

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 74


FusionServer Server GPU Card
Operation Guide 2 Knowing Devices

Figure 2-51 Riser card power cable (04150627-002)

2.4.2 V6 Rack Servers Riser Card Power Cable


Different types of riser cards can be configured with independent power cables to
support the normal running of high-power components. For details about the power
cables supported by riser cards, see Table 2-9.

Table 2-9 Riser card power cables


Riser Card Cable Supported Figure
Power Cable Specifications Riser Card
Part No. Part No.

04152764 6-pin to 8-pin 0258Y024, See Figure 2-52.


0258Y002,
02580121,
02580176

04152766 8-pin to 8-pin 03034CRK See Figure 2-53.


+03034CUW,
02580121,
0258Y024,
02580176

0415Y001 8-pin to 8-pin 0258Y024, See Figure 2-54.


0258Y002,
02580121,
02580176

04152194 8-pin to 8-pin 03034CRM -


6-pin to 8-pin +03034CUW

04153758-001 12-pin to 12-pin 0231Y798 See Figure 2-55.

04153758 12-pin to 12-pin 0231Y874 See Figure 2-55.

0415Y191 14-pin to 16-pin 02580121 -

0415Y203 20-pin to 16-pin 02580121 -

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 75


FusionServer Server GPU Card
Operation Guide 2 Knowing Devices

Figure 2-52 Riser card power cable (04152764)

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 76


FusionServer Server GPU Card
Operation Guide 2 Knowing Devices

Figure 2-53 Riser card power cable (04152766)

Figure 2-54 Riser card power cable (0415Y001)

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 77


FusionServer Server GPU Card
Operation Guide 2 Knowing Devices

Figure 2-55 Riser card power cable (04153758-001 or 04153758)

2.4.3 V7 Rack Servers Riser Card Power Cable


Different types of riser cards can be configured with independent power cables to
support the normal running of high-power components. For details about the power
cables supported by riser cards, see Table 2-10.

Table 2-10 Riser card power cables


Riser Card Cable Supported Riser Figure
Power Cable Specification Card Part No.
Part No. s

04152142-015 20pin to 20pin 0258Y066, 0258Y063 See Figure 2-56.

04152142-003 20pin to 20pin 0258Y067, 0258Y065 See Figure 2-57.

04152704-001 20pin to 14pin 0258Y064 See Figure 2-58.

04153758 12pin to 12pin 0258Y078+0258Y079 -

0415Y017-00 12pin to 12pin 0258Y078+0258Y079 -


1

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 78


FusionServer Server GPU Card
Operation Guide 2 Knowing Devices

Figure 2-56 Riser card power cable (04152142-015)

Figure 2-57 Riser card power cable (04152142-003)

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 79


FusionServer Server GPU Card
Operation Guide 2 Knowing Devices

Figure 2-58 Riser card power cable (04152704-001)

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 80


FusionServer Server GPU Card
Operation Guide 3 Installing a GPU Card

3 Installing a GPU Card

3.1 GPU Card Uninstallation Process


3.2 Installing a GPU Card on a Rack Server
3.3 Installing a GPU Card on a GPU Server

3.1 GPU Card Uninstallation Process


The compatibility between the server and the GPU card is continuously updated. To
ensure the accuracy, you are advised to use the Compatibility List to check the
component compatibility to determine whether the server is compatible with the GPU
card.

NO TICE

● Before installing a GPU card, ensure that the server has been shut down and the
external power cables have been disconnected.
● A GPU card is expensive. Incorrect power cable connection may damage the
server or GPU card.

To install a GPU on a server, perform the following steps:

Step 1 Check the server model and GPU card model. For details, see 2 Knowing Devices.
Step 2 Use the Compatibility List to check the compatibility between the server and the
GPU card, and check the configuration rules of the GPU card and the corresponding
server model.
Pay attention to the following:
● Part number of the required riser card or ejector lever.
● Number and part number of required power cables for GPU cards
● Part number of the required fan
● Maximum number of GPUs supported by a server
● BIOS parameters to be set (For details, see the BIOS parameter reference
document of the corresponding server model.)

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 81


FusionServer Server GPU Card
Operation Guide 3 Installing a GPU Card

● Supported system memory capacity


● Whether resources are required (For details, see Compatibility List.)
● GPU card power cable connection method
Step 3 Install the GPU card. For details, see "Installing a PCIe Card" and "Installing a PCIe
Card on the Riser Card" in the user guide or maintenance guide of the server you
use.
Step 4 Power on the server.
Step 5 (Optional) To use the GPU card in the OS, you need to install the corresponding GPU
card driver. For details, see 4.1 Installing the GPU Card Driver.

----End

3.2 Installing a GPU Card on a Rack Server


To install GPU cards on rack servers, follow the GPU card configuration rules. For
details, see 3.2.1 Rack Server GPU Configuration Rule. Some GPUs have high
power consumption. Therefore, GPU power cables are required to supply power to
the GPU separately. For details about how to connect a GPU power cable, see 3.2.2
Rack Server GPU Card Cable Connection Method.

3.2.1 Rack Server GPU Configuration Rule

3.2.1.1 V5 Rack Server GPU Configuration Rule


For details about GPU configuration rules for V5 rack servers, see Table 3-1.

Table 3-1 V5 rack server GPU configuration rules


GP GP Serv Riser GPU Fan Maxi Suppo Maxi GPU
U U er Card Power Par mum rted mum Card
Par Mo Mod Part Cable t Num Install Mem Cable
t del el No. Part No. No. ber ation ory Conne
No. and of Slot Capa ction
Quantity GPU city Metho
Card d
s

025 Tes 2288 02311T 0415062 - 2 Slot 1 Unlim Metho


700 la H V5 WQ 7-001 x 2 or 4 ited d 5:
44 A1 Use an
00 8-pin
(one-
to-two)
power
cable.

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 82


FusionServer Server GPU Card
Operation Guide 3 Installing a GPU Card

GP GP Serv Riser GPU Fan Maxi Suppo Maxi GPU


U U er Card Power Par mum rted mum Card
Par Mo Mod Part Cable t Num Install Mem Cable
t del el No. Part No. No. ber ation ory Conne
No. and of Slot Capa ction
Quantity GPU city Metho
Card d
s

023 NV 2288 02311T 0415062 - 2 Slot 1 Unlim Metho


1Y9 IDI H V5 WQ 7-001 x 2 or 4 ited d 5:
80 A- Use an
Tes 8-pin
la (one-
A8 to-two)
00 power
cable.

023 Tes 2288 02311T 0415062 - 2 Slot 1 Unlim Metho


12 la H V5 WQ 7-001 x 2 or 4 ited d 5:
GK V1 Use an
C 00 8-pin
(one-
to-two)
power
cable.

023 Tes 2288 02311T 0415062 - 2 Slot 1 Unlim Metho


12 la H V5 WQ 7-001 x 2 or 4 ited d 5:
CLJ V1 Use an
00 8-pin
16 (one-
G to-two)
power
cable.

023 Tes 2288 02311T 0415062 - 2 Slot 1 Unlim Metho


12 la H V5 WQ 7-001 x 2 or 4 ited d 5:
CL P4 Use an
N 0 8-pin
(one-
to-two)
power
cable.

023 Tes 2288 02311T 0415062 - 2 Slot 1 1024 Metho


12B la H V5 WQ 7-001 x 2 or 4 GB d 5:
KF M6 Use an
0 8-pin
(one-
to-two)
power
cable.

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 83


FusionServer Server GPU Card
Operation Guide 3 Installing a GPU Card

GP GP Serv Riser GPU Fan Maxi Suppo Maxi GPU


U U er Card Power Par mum rted mum Card
Par Mo Mod Part Cable t Num Install Mem Cable
t del el No. Part No. No. ber ation ory Conne
No. and of Slot Capa ction
Quantity GPU city Metho
Card d
s

023 Tes 2288 02311T 0415062 - 2 Slot 1 1024 Metho


12A la H V5 WQ 7-001 x 1 or 4 GB d 4:
RV M1 Use an
0 8-pin
power
cable.

023 Tes 2288 02311X - - 3 Slot 1, Unlim Metho


12J la H V5 AH 4, or 7 ited d 1: No
EV P4 02311V power
LP cable
is
used.

023 Tes 2288 02311T - - 7 Slot 1, Unlim Metho


12J la H V5 WR 2, 3, 4, ited d 1: No
EV P4 02311T 5, 6, or power
WT 7 cable
is
used.

023 Tes 2288 02311X - - 3 Slot 1, Unlim Metho


12L la H V5 AH 4, or 7 ited d 1: No
SB T4 02311V power
LP cable
is
used.

023 Tes 2288 02312F - - 7 Slot 1, Unlim Metho


12L la H V5 JB 2, 3, 4, ited d 1: No
SB T4 02311T 5, 6, or power
WT 7 cable
is
used.

- Qu 2288 02311X - - 2 - 1024 Metho


adr H V5 AH GB d 1: No
o power
M2 cable
00 is
0 used.

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 84


FusionServer Server GPU Card
Operation Guide 3 Installing a GPU Card

GP GP Serv Riser GPU Fan Maxi Suppo Maxi GPU


U U er Card Power Par mum rted mum Card
Par Mo Mod Part Cable t Num Install Mem Cable
t del el No. Part No. No. ber ation ory Conne
No. and of Slot Capa ction
Quantity GPU city Metho
Card d
s

023 Tes 2288 02311T 0415062 - 2 Slot 1 Unlim Metho


1Y2 la H V5 WQ 7-001 x 2 or 4 ited d 5:
79 A1 Use an
00 8-pin
80 (one-
G to-two)
power
cable.

- Qu 2288 - 0415062 - 2 - 1024 Metho


adr H V5 7-001 x 1 GB d 4:
o Use an
M6 8-pin
00 power
0-2 cable.
4G
B

023 Tes 2288 02311T 0415062 - 2 Slot 1 Unlim Metho


1Y2 la H V5 WQ 7-001 x 2 or 4 ited d 5:
81 A4 Use an
0 8-pin
(one-
to-two)
power
cable.

025 Qu 2288 02311T 0415060 - 2 - Unlim Metho


700 adr H V5 WQ 6x1 ited d 5:
34 o 0415062 Use an
RT 7x1 8-pin
X6 (one-
00 to-two)
0 power
cable.

023 Tes 2288 02311T 0415062 - 2 Slot 1 Unlim Metho


1Y2 la H V5 WQ 7-001 x 2 or 4 ited d 5:
82 A1 Use an
6 8-pin
(one-
to-two)
power
cable.

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 85


FusionServer Server GPU Card
Operation Guide 3 Installing a GPU Card

GP GP Serv Riser GPU Fan Maxi Suppo Maxi GPU


U U er Card Power Par mum rted mum Card
Par Mo Mod Part Cable t Num Install Mem Cable
t del el No. Part No. No. ber ation ory Conne
No. and of Slot Capa ction
Quantity GPU city Metho
Card d
s

063 Tes 2288 02312F - - 8 Slot1, Unlim Metho


2Y0 la H V5 JB (IO1 2, 3, 4, ited d 1: No
12- A2 IO2) 5, 6, 7 power
001 02311T or 8 cable
WT is
used.
02311V
LP
(IO3)

063 Ra 2288 02311X - - 3 Slot1, Unlim Metho


201 de H V5 AH 4, or 7 ited d 1: No
40 on 02311V power
Pro LP cable
WX is
51 used.
00

023 Tes 2288 02311T 0415062 - 2 Slot 1 Unlim Metho


12A la H V5 WQ 7-001 x 2 or 4 ited d 5:
RX P1 Use an
00 8-pin
PC (one-
Ie- to-two)
12 power
GB cable.

023 Tes 2288 02311T 0415062 - 2 Slot 1 Unlim Metho


12A la H V5 WQ 7-001 x 2 or 4 ited d 5:
RW P1 Use an
00 8-pin
PC (one-
Ie- to-two)
16 power
GB cable.

023 Qu 2288 02311T 0415062 - 2 Slot 1 Unlim Metho


12 adr H V5 WQ 7-001 x 1 or 4 ited d 4:
DH o Use an
X P6 8-pin
00 power
0 cable.

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 86


FusionServer Server GPU Card
Operation Guide 3 Installing a GPU Card

GP GP Serv Riser GPU Fan Maxi Suppo Maxi GPU


U U er Card Power Par mum rted mum Card
Par Mo Mod Part Cable t Num Install Mem Cable
t del el No. Part No. No. ber ation ory Conne
No. and of Slot Capa ction
Quantity GPU city Metho
Card d
s

025 NV 2288 02311T 0415060 - 2 Slot 1 Unlim Metho


700 IDI H V5 WQ 6x1 or 4 ited d 2:
11 A- 0415062 Use a
Qu 7x1 6-pin
adr power
o cable
RT and an
X5 8-pin
00 power
0 cable.

063 Qu 2288 02311X - - 3 Slot 1 Unlim Metho


201 adr H V5 AH or 4 ited d 1: No
36 o power
P2 cable
00 is
0 used.

023 Tes 2288 02311X 0415062 - 2 Slot 1 Unlim Metho


12 la H V5 AH 7x1 or 4 ited d 4:
GM V1 Use an
M 00 8-pin
FH power
HL cable.

023 Tes 2288 02311T 0415062 - 2 Slot 1 Unlim Metho


1Y2 la H V5 WQ 7-001 x 2 or 4 ited d 5:
80 A3 Use an
0 8-pin
(one-
to-two)
power
cable.

023 Tes 2288 02311T 0415062 - 2 Slot 1 Unlim Metho


13 la H V5 WQ 7-001 x 2 or 4 ited d 5:
GF V1 Use an
S 00s 8-pin
32 (one-
G to-two)
power
cable.

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 87


FusionServer Server GPU Card
Operation Guide 3 Installing a GPU Card

GP GP Serv Riser GPU Fan Maxi Suppo Maxi GPU


U U er Card Power Par mum rted mum Card
Par Mo Mod Part Cable t Num Install Mem Cable
t del el No. Part No. No. ber ation ory Conne
No. and of Slot Capa ction
Quantity GPU city Metho
Card d
s

023 Qu 2288 02311T 0415062 - 2 Slot 1 Unlim Metho


12E adr H V5 WQ 7-001 x 1 or 4 ited d 4:
XE o Use an
P5 8-pin
00 power
0 cable.

023 Qu 2288 02311T 0415060 - 2 Slot 1 Unlim Metho


12 adr H V5 WQ 6x1 or 4 ited d3:Use
DH o a6-
R P4 pinpo
00 werca
0 ble.

063 Qu 2288 02311X - - 3 Slot 1 Unlim Metho


201 adr H V5 AH or 4 ited d 1: No
33 o power
P4 cable
00 is
used.

023 Tes 2288 02311X 0415062 - 2 Slot 1 Unlim Metho


1Y2 la H V5 AH 7-001 x 1 or 4 ited d4:Use
83 A1 an8-
0 pinpo
werca
ble.

063 Qu 2288 02311X - - 3 Slot1 Unlim Metho


201 adr H V5 AH or 4 ited d 1: No
50 o power
P6 cable
20 is
used.

063 Qu 2288 02311V - - 3 Slot7 Unlim Metho


201 adr H V5 LP ited d 1: No
50 o power
P6 cable
20 is
used.

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 88


FusionServer Server GPU Card
Operation Guide 3 Installing a GPU Card

GP GP Serv Riser GPU Fan Maxi Suppo Maxi GPU


U U er Card Power Par mum rted mum Card
Par Mo Mod Part Cable t Num Install Mem Cable
t del el No. Part No. No. ber ation ory Conne
No. and of Slot Capa ction
Quantity GPU city Metho
Card d
s

023 Tes 1288 02311X - - 2 Slot 1 Unlim Metho


12J la H V5 AG or 2 ited d 1: No
EV P4 power
cable
is
used.

023 Tes 1288 02311T - - 1 Slot 2 Unlim Metho


12J la H V5 WF ited d 1: No
EV P4 power
cable
is
used.

023 Tes 1288 02311X - - 1 Slot 1 Unlim Metho


12L la H V5 AG ited d 1: No
SB T4 power
cable
is
used.

023 Tes 5288 02312F - - 6 Slot 1, Unlim Metho


12J la V5 JB 2, 3, 4, ited d 1: No
EV P4 5, or 6 power
cable
is
used.

023 Tes 5288 02312F - - 6 Slot 1, Unlim Metho


12L la V5 JB 2, 3, 4, ited d 1: No
SB T4 5, or 6 power
cable
is
used.

023 Tes 2488 02311 - - 2 Slot 1 Unlim Metho


12J la V5 WGF or 4 ited d 1: No
EV P4 power
cable
is
used.

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 89


FusionServer Server GPU Card
Operation Guide 3 Installing a GPU Card

GP GP Serv Riser GPU Fan Maxi Suppo Maxi GPU


U U er Card Power Par mum rted mum Card
Par Mo Mod Part Cable t Num Install Mem Cable
t del el No. Part No. No. ber ation ory Conne
No. and of Slot Capa ction
Quantity GPU city Metho
Card d
s

023 Tes 2488 02311 - - 2 Slot 1 Unlim Metho


12L la V5 WGF or 4 ited d 1: No
SB T4 power
cable
is
used.

063 Qu 2488 02311 - - 1 Slot 4 Unlim Metho


201 adr V5 WGF ited d 1: No
33 o power
P4 cable
00 is
used.

023 Tes 2488 02311Y - - 3 Slot 1, Unlim Metho


12J la H V5 HH 5, or 10 ited d 1: No
EV P4 02311Y power
HJ cable
is
used.

023 Tes 2488 02311Y - - 3 Slot 1, Unlim Metho


12L la H V5 HH 5, or 10 ited d 1: No
SB T4 02311Y power
HJ cable
is
used.

063 Qu 2488 02311Y - - 1 Slot 1 Unlim Metho


201 adr H V5 HH ited d 1: No
33 o 02311Y power
P4 HJ cable
00 is
used.

063 Qu 2488 02311Y - - 1 Slot 1 Unlim Metho


201 adr H V5 HH ited d 1: No
50 o 02311Y power
P6 HJ cable
20 is
used.

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 90


FusionServer Server GPU Card
Operation Guide 3 Installing a GPU Card

GP GP Serv Riser GPU Fan Maxi Suppo Maxi GPU


U U er Card Power Par mum rted mum Card
Par Mo Mod Part Cable t Num Install Mem Cable
t del el No. Part No. No. ber ation ory Conne
No. and of Slot Capa ction
Quantity GPU city Metho
Card d
s

023 Tes 5885 02312B - - 4 Slot 2, Unlim Metho


12L la H V5 AG 4, 9, or ited d 1: No
SB T4 14 power
cable
is
used.

023 Tes 5885 02312B - - 4 Slot 2, Unlim Metho


12J la H V5 AG 4, 9, or ited d 1: No
EV P4 14 power
cable
is
used.

063 Qu 5885 02312B - - 4 Slot 2, Unlim Metho


201 adr H V5 AG 4, 9, or ited d 1: No
33 o 14 power
P4 cable
00 is
used.

023 Tes 5885 02312B 0415062 - 2 Slot 2 Unlim Metho


12B la H V5 AG 7-002 x 2 or 4 ited d 5:
XJ P4 Use an
0 8-pin
(one-
to-two)
power
cable.

023 Tes 5885 02312B 0415062 - 2 Slot 2 Unlim Metho


12E la H V5 AG 7-002 x 2 or 4 ited d 5:
EY V1 Use an
00 8-pin
(one-
to-two)
power
cable.

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 91


FusionServer Server GPU Card
Operation Guide 3 Installing a GPU Card

GP GP Serv Riser GPU Fan Maxi Suppo Maxi GPU


U U er Card Power Par mum rted mum Card
Par Mo Mod Part Cable t Num Install Mem Cable
t del el No. Part No. No. ber ation ory Conne
No. and of Slot Capa ction
Quantity GPU city Metho
Card d
s

023 Tes 5885 02312B 0415062 - 2 Slot 2 Unlim Metho


12J la H V5 AG 7-002 x 2 or 4 ited d 5:
GM V1 Use an
00 8-pin
(one-
to-two)
power
cable.

023 Tes 5885 02312B 0415062 - 2 Slot 2 1024 Metho


12 la H V5 AG 7x1 or 4 GB d 4:
CK M1 Use an
F 0 8-pin
power
cable.

023 Tes 5885 02312B 0415062 - 2 Slot 2 1024 Metho


12 la H V5 AG 7-002 x 2 or 4 GB d 5:
CK M6 Use an
G 0 8-pin
(one-
to-two)
power
cable.

023 Tes 5885 02312B 0415062 - 2 Slot 2 Unlim Metho


12 la H V5 AG 7-002 x 2 or 4 ited d 5:
CK P1 Use an
J 00 8-pin
PC (one-
Ie- to-two)
16 power
GB cable.

025 Qu 5885 02312B 0415062 - 2 Slot 2 Unlim Metho


700 adr H V5 AG 7-002 x 2 or 4 ited d 5:
66 o Use an
RT 8-pin
X6 (one-
00 to-two)
0 power
cable.

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 92


FusionServer Server GPU Card
Operation Guide 3 Installing a GPU Card

3.2.1.2 V6 Rack Server GPU Configuration Rule


For details about GPU configuration rules for V6 rack servers, see Table 3-2.

Table 3-2 V6 rack server GPU configuration rules


GP GPU Ser Riser GPU Fan Ma Suppo Maxi GPU
U Mode ver Card Power Part xi rted mum Card
Part l Mod Part Cable No. mu Install Mem Cable
No. el No. Part No. m ation ory Conne
and Nu Slot Capa ction
Quantity mb city Metho
er d
of
GP
U
Ca
rds

023 Tesla 128 02580 - - 3 Slot1, Unlimi Metho


12L T4 8H 125 2, or 3 ted d 1:
SB V6 02580 No
126 power
cable
is
used.

023 Tesla 228 - - 0231 4 Slot2, Serve Metho


12L T4 8H 1VS 3, 4, or r with d 1:
SB V6- F 7 8x No
16D (Built- 2.5" power
IMM in) drives cable
: 2048 is
GB; used.
Serve
r with
12 x
3.5"/2
5x
2.5"
drives
: 1024
GB

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 93


FusionServer Server GPU Card
Operation Guide 3 Installing a GPU Card

GP GPU Ser Riser GPU Fan Ma Suppo Maxi GPU


U Mode ver Card Power Part xi rted mum Card
Part l Mod Part Cable No. mu Install Mem Cable
No. el No. Part No. m ation ory Conne
and Nu Slot Capa ction
Quantity mb city Metho
er d
of
GP
U
Ca
rds

063 Tesla 228 - - 0231 4 Slot2/ Serve Metho


2Y0 A2 8H 1VS Slot3/ r with d 1:
12-0 V6- F Slot4/ 8x No
01 16D Slot7(B 2.5" power
IMM uilt-in) drives cable
: 2048 is
GB; used.
Serve
r with
12 x
3.5"/2
5x
2.5"
drives
: 1024
GB

063 Tesla 228 02580 - - 8 Slot1, Unlimi Metho


2Y0 A2 8H 119 2, 3, 4, ted d 1:
12-0 V6- 02580 5, 6, 7, No
01 32D 120 or 8 power
IMM cable
02580 is
157 used.
02580
156

023 Tesla 228 02580 - - 8 Slot1, Unlimi Metho


12L T4 8H 119 2, 3, 4, ted d 1:
SB V6- 02580 5, 6, 7, No
32D 120 or 8 power
IMM cable
02580 is
157 used.
02580
156

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 94


FusionServer Server GPU Card
Operation Guide 3 Installing a GPU Card

GP GPU Ser Riser GPU Fan Ma Suppo Maxi GPU


U Mode ver Card Power Part xi rted mum Card
Part l Mod Part Cable No. mu Install Mem Cable
No. el No. Part No. m ation ory Conne
and Nu Slot Capa ction
Quantity mb city Metho
er d
of
GP
U
Ca
rds

023 Tesla 228 0258Y 0415Y00 - 4 Slot1, Unlimi Metho


1Y0 A10 8H 002 1x1 2, 4, or ted d 4:
55 V6- 0258Y 5 Use
32D 024 an 8-
IMM pin
power
cable.

023 RTX 228 0258Y 0415276 - 4 Slot1, Unlimi Metho


1Y1 A400 8H 024 4x1 2, 4, or ted d 4:
11 0 V6- 5 Use
32D an 8-
IMM pin
power
cable.

023 Tesla 228 02580 0415276 - 2 Slot2 Unlimi Metho


13N A100 8H 121 6x1 or 5 ted d 4:
FQ 40G V6- Use
32D an 8-
IMM pin
power
cable.

023 Tesla 228 02580 0415276 - 2 Slot2 Unlimi Metho


1Y0 A100 8H 121 6x1 or 5 ted d 4:
52 80G V6- Use
32D an 8-
IMM pin
power
cable.

023 NVID 228 02580 0415276 - 2 Slot2 Unlimi Metho


1Y9 IA- 8H 121 6x1 or 5 ted d 4:
81 Tesla V6- Use
A800 32D an 8-
IMM pin
power
cable.

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 95


FusionServer Server GPU Card
Operation Guide 3 Installing a GPU Card

GP GPU Ser Riser GPU Fan Ma Suppo Maxi GPU


U Mode ver Card Power Part xi rted mum Card
Part l Mod Part Cable No. mu Install Mem Cable
No. el No. Part No. m ation ory Conne
and Nu Slot Capa ction
Quantity mb city Metho
er d
of
GP
U
Ca
rds

023 Tesla 228 02580 0415276 - 2 Slot2 Unlimi Metho


13N V100 8H 121 6x1 or 5 ted d 4:
FP 32G V6- Use
32D an 8-
IMM pin
power
cable.

023 Tesla 228 02580 0415276 - 2 Slot2 Unlimi Metho


13P V100 8H 121 6x1 or 5 ted d 4:
NG s V6- Use
32G 32D an 8-
IMM pin
power
cable.

023 Tesla 228 02580 0415276 - 2 Slot2 Unlimi Metho


1Y0 A40 8H 121 6x1 or 5 ted d 4:
54 V6- Use
32D an 8-
IMM pin
power
cable.

023 Tesla 228 02580 0415276 - 2 Slot2 Unlimi Metho


1Y0 A30 8H 121 6x1 or 5 ted d 4:
53 V6- Use
32D an 8-
IMM pin
power
cable.

023 Tesla 228 02580 0415276 - 2 Slot2 Unlimi Metho


1Y3 A16 8H 121 6x1 or 5 ted d 4:
09 V6- Use
32D an 8-
IMM pin
power
cable.

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 96


FusionServer Server GPU Card
Operation Guide 3 Installing a GPU Card

GP GPU Ser Riser GPU Fan Ma Suppo Maxi GPU


U Mode ver Card Power Part xi rted mum Card
Part l Mod Part Cable No. mu Install Mem Cable
No. el No. Part No. m ation ory Conne
and Nu Slot Capa ction
Quantity mb city Metho
er d
of
GP
U
Ca
rds

023 RTX 228 02580 0415276 - 2 Slot2 Unlimi Metho


1Y1 A600 8H 121 6x1 or 5 ted d 4:
12 0 V6- Use
32D an 8-
IMM pin
power
cable.

025 Vasta 228 02580 - 0231 1 Slot5 65536 Metho


7Y0 i- 8H 176 1VS MB x d 1:
64 VA1V V6- F 2 No
-16G 32D power
IMM cable
is
used.

025 Vasta 228 02580 - 0231 1 Slot5 65536 Metho


7Y0 i- 8H 176 1VS MB x d 1:
65 VA1A V6- F 2 No
-16G 32D power
IMM cable
is
used.

025 Vasta 228 02580 - 0231 1 Slot5 65536 Metho


7Y0 i- 8H 176 1VS MB x d 1:
63 VA1- V6- F 2 No
16G 32D power
IMM cable
is
used.

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 97


FusionServer Server GPU Card
Operation Guide 3 Installing a GPU Card

GP GPU Ser Riser GPU Fan Ma Suppo Maxi GPU


U Mode ver Card Power Part xi rted mum Card
Part l Mod Part Cable No. mu Install Mem Cable
No. el No. Part No. m ation ory Conne
and Nu Slot Capa ction
Quantity mb city Metho
er d
of
GP
U
Ca
rds

025 Tesla 228 02580 0415Y19 0231 2 Slot2 Unlimi Metho


7Y4 L20 8H 121 1x1 YBB or 5 ted d 9:
34 V6- 0415Y20 E Cablin
32D 3x1 g of
IMM the
GPU
cards
on the
2288H
V6-32
DIMM.

063 NETI 228 02580 - - 8 Slot1, Unlimi Metho


202 NT 8H 119 2, 3, 4, ted d 1:
13 Quad V6- 02580 5, 6, 7, No
raT2 32D 120 or 8 power
A IMM cable
02580 is
157 used.
02580
156

063 DaoC 228 02580 - - 8 Slot1, Unlimi Metho


2Y0 loud 8H 119 2, 3, 4, ted d 1:
65 DAVP V6- 02580 5, 6, 7, No
1 32D 120 or 8 power
IMM cable
02580 is
157 used.
02580
156

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 98


FusionServer Server GPU Card
Operation Guide 3 Installing a GPU Card

GP GPU Ser Riser GPU Fan Ma Suppo Maxi GPU


U Mode ver Card Power Part xi rted mum Card
Part l Mod Part Cable No. mu Install Mem Cable
No. el No. Part No. m ation ory Conne
and Nu Slot Capa ction
Quantity mb city Metho
er d
of
GP
U
Ca
rds

025 NVID 228 02580 - - 8 Slot1, Unlimi Metho


7Y1 IA L4 8H 119 2, 3, 4, ted d 1:
60 V6- 02580 5, 6, 7, No
32D 120 or 8 power
IMM cable
02580 is
157 used.
02580
156

025 Quad 228 03034 0415219 - 4 Slot2, Unlimi Metho


700 ro 8H CRK 4x1 3, 6, or ted d 6:
67 RTX6 V6- +0303 7 Cablin
000 32D 4CUW g of
(Only IMM 03034 the
for 4 4- CRM GPU
GPU) GP +0303 cards
U 4CUW on the
cha 2288H
ssis V6-32
DIMM
4x
GPU
chassi
s.

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 99


FusionServer Server GPU Card
Operation Guide 3 Installing a GPU Card

GP GPU Ser Riser GPU Fan Ma Suppo Maxi GPU


U Mode ver Card Power Part xi rted mum Card
Part l Mod Part Cable No. mu Install Mem Cable
No. el No. Part No. m ation ory Conne
and Nu Slot Capa ction
Quantity mb city Metho
er d
of
GP
U
Ca
rds

023 Tesla 228 03034 0415276 - 4 Slot2, Unlimi Metho


13P A100 8H CRK 6x1 3, 6, or ted d 6:
CY 40G V6- +0303 7 Cablin
(Only 32D 4CUW g of
for 4 IMM 03034 the
GPU) 4- CRM GPU
GP +0303 cards
U 4CUW on the
cha 2288H
ssis V6-32
DIMM
4x
GPU
chassi
s.

023 Tesla 228 03034 0415276 - 4 Slot2, Unlimi Metho


1Y0 A100 8H CRK 6x1 3, 6, or ted d 6:
50 80G V6- +0303 7 Cablin
(Only 32D 4CUW g of
for 4 IMM 03034 the
GPU) 4- CRM GPU
GP +0303 cards
U 4CUW on the
cha 2288H
ssis V6-32
DIMM
4x
GPU
chassi
s.

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 100


FusionServer Server GPU Card
Operation Guide 3 Installing a GPU Card

GP GPU Ser Riser GPU Fan Ma Suppo Maxi GPU


U Mode ver Card Power Part xi rted mum Card
Part l Mod Part Cable No. mu Install Mem Cable
No. el No. Part No. m ation ory Conne
and Nu Slot Capa ction
Quantity mb city Metho
er d
of
GP
U
Ca
rds

023 Tesla 228 03034 0415276 - 4 Slot2, Unlimi Metho


13P V100 8H CRK 6x1 3, 6, or ted d 6:
NF 32G V6- +0303 7 Cablin
(Only 32D 4CUW g of
for 4 IMM 03034 the
GPU) 4- CRM GPU
GP +0303 cards
U 4CUW on the
cha 2288H
ssis V6-32
DIMM
4x
GPU
chassi
s.

023 Tesla 228 03034 0415276 - 4 Slot2, Unlimi Metho


13P V100 8H CRK 6x1 3, 6, or ted d 6:
NG s V6- +0303 7 Cablin
32G 32D 4CUW g of
(Only IMM 03034 the
for 4 4- CRM GPU
GPU) GP +0303 cards
U 4CUW on the
cha 2288H
ssis V6-32
DIMM
4x
GPU
chassi
s.

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 101


FusionServer Server GPU Card
Operation Guide 3 Installing a GPU Card

GP GPU Ser Riser GPU Fan Ma Suppo Maxi GPU


U Mode ver Card Power Part xi rted mum Card
Part l Mod Part Cable No. mu Install Mem Cable
No. el No. Part No. m ation ory Conne
and Nu Slot Capa ction
Quantity mb city Metho
er d
of
GP
U
Ca
rds

023 Tesla 228 03034 0415276 - 4 Slot2, Unlimi Metho


1Y1 A30 8H CRK 6x1 3, 6, or ted d 6:
30 (Only V6- +0303 7 Cablin
for 4 32D 4CUW g of
GPU) IMM 03034 the
4- CRM GPU
GP +0303 cards
U 4CUW on the
cha 2288H
ssis V6-32
DIMM
4x
GPU
chassi
s.

023 NVID 228 03034 0415276 - 4 Slot2, Unlimi Metho


1Y9 IA- 8H CRK 6x1 3, 6, or ted d 6:
82 Tesla V6- +0303 7 Cablin
A800 32D 4CUW g of
(Only IMM 03034 the
for 4 4- CRM GPU
GPU) GP +0303 cards
U 4CUW on the
cha 2288H
ssis V6-32
DIMM
4x
GPU
chassi
s.

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 102


FusionServer Server GPU Card
Operation Guide 3 Installing a GPU Card

GP GPU Ser Riser GPU Fan Ma Suppo Maxi GPU


U Mode ver Card Power Part xi rted mum Card
Part l Mod Part Cable No. mu Install Mem Cable
No. el No. Part No. m ation ory Conne
and Nu Slot Capa ction
Quantity mb city Metho
er d
of
GP
U
Ca
rds

025 Nvidi 228 03034 0415276 0231 4 Slot2, 16384 Metho


7Y0 a 8H CRK 6x1 3DP 3, 6, or MB x d 6:
39 Tesla V6- +0303 L 7 8 Cablin
A40 32D 4CUW g of
(only IMM 03034 the
for 4 4- CRM GPU
GPU) GP +0303 cards
U 4CUW on the
cha 2288H
ssis V6-32
DIMM
4x
GPU
chassi
s.

063 Tesla 228 02580 - - 11 Slot1, Unlimi Metho


2Y0 A2 8H 186 2, 3, 4, ted d 1:
12-0 V6- 02580 5, 6, 7, No
01 32D 206 8, 9, power
IMM 10, or cable
11 02580 11 is
stan 156 used.
dard
card
cha
ssis

023 Tesla 228 02580 - - 11 Slot1, Unlimi Metho


12L T4 8H 186 2, 3, 4, ted d 1:
SB V6- 02580 5, 6, 7, No
32D 206 8, 9, power
IMM 10, or cable
11 02580 11 is
stan 156 used.
dard
card
cha
ssis

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 103


FusionServer Server GPU Card
Operation Guide 3 Installing a GPU Card

GP GPU Ser Riser GPU Fan Ma Suppo Maxi GPU


U Mode ver Card Power Part xi rted mum Card
Part l Mod Part Cable No. mu Install Mem Cable
No. el No. Part No. m ation ory Conne
and Nu Slot Capa ction
Quantity mb city Metho
er d
of
GP
U
Ca
rds

023 Tesla 528 02580 - - 8 Slot1, Unlimi Metho


12L T4 8 V6 119 2, 3, 4, ted d 1:
SB 02580 5, 6, 7, No
120 or 8 power
cable
02580 is
157 used.
02580
156

023 Tesla 248 02313 0415276 0231 2 Slot2 Unlimi Metho


13F V100 8H DLR 6x1 3DK or 8 ted d 4:
DG 32G V6 X Use
an 8-
pin
power
cable.

023 Tesla 248 02313 - 0231 4 Slot2, Unlimi Metho


12L T4 8H DMK 3DK 3, 8, or ted d 1:
SB V6 02313 X 9 No
DMM power
cable
02313 is
DMB used.

025 NVID 248 02313 - 0231 4 Slot2, Unlimi Metho


7Y1 IA L4 8H DMK 3DK 3, 8, or ted d 1:
60 V6 02313 X 9 No
DMM power
cable
02313 is
DMB used.

063 Tesla 588 0231Y 0415276 0231 4 Slot11, Unlimi Metho


2Y0 A800 5H 798 6x1 Y88 13, 15, ted d 4:
27 V6 0231Y 8 or 17 Use
874 an 8-
pin
power
cable.

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 104


FusionServer Server GPU Card
Operation Guide 3 Installing a GPU Card

GP GPU Ser Riser GPU Fan Ma Suppo Maxi GPU


U Mode ver Card Power Part xi rted mum Card
Part l Mod Part Cable No. mu Install Mem Cable
No. el No. Part No. m ation ory Conne
and Nu Slot Capa ction
Quantity mb city Metho
er d
of
GP
U
Ca
rds

063 Tesla 588 0231Y 0415276 0231 4 Slot11, Unlimi Metho


201 V100 5H 798 6x1 Y88 13, 15, ted d 4:
30 PCIe- V6 0231Y 8 or 17 Use
32GB 874 an 8-
pin
power
cable.

063 Tesla 588 0231Y 0415276 0231 4 Slot11, Unlimi Metho


201 V100 5H 798 6x1 Y88 13, 15, ted d 4:
65 s V6 0231Y 8 or 17 Use
32G 874 an 8-
pin
power
cable.

025 Tesla 588 0231Y 0415276 0231 4 Slot11, Unlimi Metho


7Y0 A800 5H 798 6x1 Y88 13, 15, ted d 4:
16 V6 0231Y 8 or 17 Use
874 an 8-
pin
power
cable.

023 Tesla 588 0231Y - 0231 7 Slot1, Unlimi Metho


12L T4 5H 798 Y88 7, 8, ted d 1:
SB V6 0231Y 8 11, 13, No
874 15, or power
17 cable
is
used.

063 Tesla 588 0231Y - 0231 7 Slot1, Unlimi Metho


201 T4 5H 798 Y88 7, 8, ted d 1:
47 V6 0231Y 8 11, 13, No
874 15, or power
17 cable
is
used.

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 105


FusionServer Server GPU Card
Operation Guide 3 Installing a GPU Card

3.2.1.3 V7 Rack Server GPU Configuration Rule


For details about GPU configuration rules for V7 rack servers, see Table 3-3.

Table 3-3 V7 rack server GPU configuration rules


GPU GPU Serve Riser GPU Fan Maxi Supp Maxi GPU
Part Mode r Card Powe Part mum orted mum Card
No. l Mode Part r No. Num Instal Mem Cable
l No. Cable ber lation ory Conn
Part of Slot Capa ectio
No. GPU city n
and Card Meth
Quan s od
tity

0632 Tesla 1288 0258 - 0231 3 Slot1/ Unlim Meth


Y012- A2 H V7 Y018 Y193 Slot2/ ited od 1:
001 0258 0231 Slot3 No
Y019 Y194 powe
r
cable
is
used.

0632 Tesla 2288 - - 02311 7 Slot2/ Serve Meth


Y012- A2 V7 VSF Slot3/ r with od 1:
001 Slot4/ 8x No
Slot7 2.5" powe
drives r
: cable
2048 is
GB; used.
Serve
r with
12 x
3.5"/2
5x
2.5"
drives
:
1024
GB

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 106


FusionServer Server GPU Card
Operation Guide 3 Installing a GPU Card

GPU GPU Serve Riser GPU Fan Maxi Supp Maxi GPU
Part Mode r Card Powe Part mum orted mum Card
No. l Mode Part r No. Num Instal Mem Cable
l No. Cable ber lation ory Conn
Part of Slot Capa ectio
No. GPU city n
and Card Meth
Quan s od
tity

0257 Tesla 2288 0258 0415 0231 4 Slot1/ Unlim Meth


Y050 A100 H V7 Y078 3776x Y192 Slot4/ ited od 6:
80G +025 1 Slot7/ Cabli
(Only 8Y07 Slot9 ng of
for 4 9 the
GPU) GPU
cards
on
the
2288
H
V6-32
DIMM
or
2288
H V7
4x
GPU
chas
sis.

0257 Tesla 2288 0258 0415 0231 4 Slot1/ Unlim Meth


Y054 A40 H V7 Y078 3776x Y192 Slot4/ ited od 6:
(Only +025 1 Slot7/ Cabli
for 4 8Y07 Slot9 ng of
GPU) 9 the
GPU
cards
on
the
2288
H
V6-32
DIMM
or
2288
H V7
4x
GPU
chas
sis.

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 107


FusionServer Server GPU Card
Operation Guide 3 Installing a GPU Card

GPU GPU Serve Riser GPU Fan Maxi Supp Maxi GPU
Part Mode r Card Powe Part mum orted mum Card
No. l Mode Part r No. Num Instal Mem Cable
l No. Cable ber lation ory Conn
Part of Slot Capa ectio
No. GPU city n
and Card Meth
Quan s od
tity

0257 Tesla 2288 0258 0415 0231 4 Slot1/ Unlim Meth


Y053 A30 H V7 Y078 3776x Y192 Slot4/ ited od 6:
(Only +025 1 Slot7/ Cabli
for 4 8Y07 Slot9 ng of
GPU) 9 the
GPU
cards
on
the
2288
H
V6-32
DIMM
or
2288
H V7
4x
GPU
chas
sis.

0257 Tesla 2288 0258 0415 0231 4 Slot1/ Unlim Meth


Y052 A16 H V7 Y078 3776x Y192 Slot4/ ited od 6:
(Only +025 1 Slot7/ Cabli
for 4 8Y07 Slot9 ng of
GPU) 9 the
GPU
cards
on
the
2288
H
V6-32
DIMM
or
2288
H V7
4x
GPU
chas
sis.

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 108


FusionServer Server GPU Card
Operation Guide 3 Installing a GPU Card

GPU GPU Serve Riser GPU Fan Maxi Supp Maxi GPU
Part Mode r Card Powe Part mum orted mum Card
No. l Mode Part r No. Num Instal Mem Cable
l No. Cable ber lation ory Conn
Part of Slot Capa ectio
No. GPU city n
and Card Meth
Quan s od
tity

0257 Tesla 2288 0258 0415 0231 4 Slot1/ Unlim Meth


Y051 A800 H V7 Y078 3776x Y192 Slot4/ ited od 6:
80G +025 1 Slot7/ Cabli
(Only 8Y07 Slot9 ng of
for 4 9 the
GPU) GPU
cards
on
the
2288
H
V6-32
DIMM
or
2288
H V7
4x
GPU
chas
sis.

0257 Tesla 2288 0258 0415 0231 4 Slot1/ Unlim Meth


Y049 A100 H V7 Y078 3776x Y192 Slot4/ ited od 6:
40G +025 1 Slot7/ Cabli
(Only 8Y07 Slot9 ng of
for 4 9 the
GPU) GPU
cards
on
the
2288
H
V6-32
DIMM
or
2288
H V7
4x
GPU
chas
sis.

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 109


FusionServer Server GPU Card
Operation Guide 3 Installing a GPU Card

GPU GPU Serve Riser GPU Fan Maxi Supp Maxi GPU
Part Mode r Card Powe Part mum orted mum Card
No. l Mode Part r No. Num Instal Mem Cable
l No. Cable ber lation ory Conn
Part of Slot Capa ectio
No. GPU city n
and Card Meth
Quan s od
tity

0257 Tesla 2288 0258 0415 0231 2 Slot2/ Unlim Meth


Y060 A40 H V7 Y030 3776x Y192 Slot5 ited od 7:
1 Cabli
ng of
the
GPU
cards
on
the
2288
H V7.

0257 Tesla 2288 0258 0415 0231 2 Slot2/ Unlim Meth


Y055 A100 H V7 Y030 3776x Y192 Slot5 ited od 7:
40G 1 Cabli
ng of
the
GPU
cards
on
the
2288
H V7.

0257 Tesla 2288 0258 0415 0231 2 Slot2/ Unlim Meth


Y056 A100 H V7 Y030 3776x Y192 Slot5 ited od 7:
80G 1 Cabli
ng of
the
GPU
cards
on
the
2288
H V7.

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 110


FusionServer Server GPU Card
Operation Guide 3 Installing a GPU Card

GPU GPU Serve Riser GPU Fan Maxi Supp Maxi GPU
Part Mode r Card Powe Part mum orted mum Card
No. l Mode Part r No. Num Instal Mem Cable
l No. Cable ber lation ory Conn
Part of Slot Capa ectio
No. GPU city n
and Card Meth
Quan s od
tity

0257 Tesla 2288 0258 0415 0231 2 Slot2/ Unlim Meth


Y057 A800 H V7 Y030 3776x Y192 Slot5 ited od 7:
80G 1 Cabli
ng of
the
GPU
cards
on
the
2288
H V7.

0257 Tesla 2288 0258 0415 0231 2 Slot2/ Unlim Meth


Y059 A30 H V7 Y030 3776x Y192 Slot5 ited od 7:
1 Cabli
ng of
the
GPU
cards
on
the
2288
H V7.

0257 Tesla 2288 0258 0415 0231 2 Slot2/ Unlim Meth


Y058 A16 H V7 Y030 3776x Y192 Slot5 ited od 7:
1 Cabli
ng of
the
GPU
cards
on
the
2288
H V7.

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 111


FusionServer Server GPU Card
Operation Guide 3 Installing a GPU Card

GPU GPU Serve Riser GPU Fan Maxi Supp Maxi GPU
Part Mode r Card Powe Part mum orted mum Card
No. l Mode Part r No. Num Instal Mem Cable
l No. Cable ber lation ory Conn
Part of Slot Capa ectio
No. GPU city n
and Card Meth
Quan s od
tity

0257 Tesla 2288 0258 0415 0231 2 Slot2/ Unlim Meth


Y129 A10 H V7 Y193 Y021 Y192 Slot5 ited od 7:
x1 Cabli
ng of
the
GPU
cards
on
the
2288
H V7.

0257 Tesla 2288 0258 0415 0231 2 Slot2/ Unlim Meth


Y130 A10 H V7 Y193 Y075 Y192 Slot5 ited od 7:
x1 Cabli
ng of
the
GPU
cards
on
the
2288
H V7.

0632 Tesla 2288 - - 0231 2 Slot1 Unlim Meth


Y012- A2 H V7 Y192 ~Slot ited od 1:
001 10 No
powe
r
cable
is
used.

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 112


FusionServer Server GPU Card
Operation Guide 3 Installing a GPU Card

GPU GPU Serve Riser GPU Fan Maxi Supp Maxi GPU
Part Mode r Card Powe Part mum orted mum Card
No. l Mode Part r No. Num Instal Mem Cable
l No. Cable ber lation ory Conn
Part of Slot Capa ectio
No. GPU city n
and Card Meth
Quan s od
tity

0257 Tesla 2288 0258 0415 0231 2 Slot2/ Unlim Meth


Y374 L20 H V7 Y030 Y125 Y192 Slot5 ited od 7:
x1 Cabli
ng of
the
GPU
cards
on
the
2288
H V7.

0257 Tesla 2288 - - 0231 6 Slot1 Unlim Meth


Y307 L4 H V7 Y192 ~Slot ited od 1:
10 No
powe
r
cable
is
used.

0257 Tesla 2288 0258 0415 0231 2 Slot2/ Unlim Meth


Y282 H800 H V7 Y030 Y125 Y192 Slot5 ited od 7:
x1 Cabli
ng of
the
GPU
cards
on
the
2288
H V7.

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 113


FusionServer Server GPU Card
Operation Guide 3 Installing a GPU Card

GPU GPU Serve Riser GPU Fan Maxi Supp Maxi GPU
Part Mode r Card Powe Part mum orted mum Card
No. l Mode Part r No. Num Instal Mem Cable
l No. Cable ber lation ory Conn
Part of Slot Capa ectio
No. GPU city n
and Card Meth
Quan s od
tity

0257 Tesla 2288 0258 0415 0231 2 Slot2/ Unlim Meth


Y280 H100 H V7 Y030 Y125 Y192 Slot5 ited od 7:
x1 Cabli
ng of
the
GPU
cards
on
the
2288
H V7.

0257 Tesla 2488 0258 - 0231 4 Slot1/ 16T Meth


Y068 A2 H V7 Y154 YBEC Slot2/ od 1:
0258 Slot7/ No
Y155 Slot8 powe
r
cable
is
used.

0632 Tesla 5288 - - 2x023 8 Slot1/ Serve Meth


Y012- A2 V7 1YAG Slot2/ r with od 1:
001 U Slot3/ 40 x No
+ 2x0 Slot4/ 3.5"/2 powe
231Y Slot5/ x 2.5" r
AGT Slot6/ drives cable
2x023 Slot7/ dual is
1YAD Slot8 RAID used.
A :
+ 2x0 4096
231Y GB
AGS

0632 Tesla 5885 0258 - 0231 12 Slot1 16T Meth


Y012- A2 H V7 Y063 YBN 0~Slo od 1:
001 0258 H t21 No
Y064 0231 powe
YBNJ r
0258 cable
Y065 is
used.

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 114


FusionServer Server GPU Card
Operation Guide 3 Installing a GPU Card

GPU GPU Serve Riser GPU Fan Maxi Supp Maxi GPU
Part Mode r Card Powe Part mum orted mum Card
No. l Mode Part r No. Num Instal Mem Cable
l No. Cable ber lation ory Conn
Part of Slot Capa ectio
No. GPU city n
and Card Meth
Quan s od
tity

0257 Tesla 5885 0258 0415 0231 4 Slot1 16T Meth


Y017 A16 H V7 Y066 3776x YBN 1/ od 8:
0258 1 H Slot1 Cabli
Y067 0231 3/ ng of
YBNJ Slot1 the
9/ GPU
Slot2 cards
1 on
the
5885
H V7
2x
GPU
chas
sis.

0257 Tesla 5885 0258 0415 0231 4 Slot1 16T Meth


Y018 A40 H V7 Y066 3776x YBN 1/ od 8:
0258 1 H Slot1 Cabli
Y067 0231 3/ ng of
YBNJ Slot1 the
9/ GPU
Slot2 cards
1 on
the
5885
H V7
2x
GPU
chas
sis.

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 115


FusionServer Server GPU Card
Operation Guide 3 Installing a GPU Card

GPU GPU Serve Riser GPU Fan Maxi Supp Maxi GPU
Part Mode r Card Powe Part mum orted mum Card
No. l Mode Part r No. Num Instal Mem Cable
l No. Cable ber lation ory Conn
Part of Slot Capa ectio
No. GPU city n
and Card Meth
Quan s od
tity

0257 Tesla 5885 0258 0415 0231 4 Slot1 16T Meth


Y019 A30 H V7 Y066 3776x YBN 1/ od 8:
0258 1 H Slot1 Cabli
Y067 0231 3/ ng of
YBNJ Slot1 the
9/ GPU
Slot2 cards
1 on
the
5885
H V7
2x
GPU
chas
sis.

0257 Tesla 5885 0258 0415 0231 4 Slot1 16T Meth


Y020 A10 H V7 Y066 3777x YBN 1/ od 8:
0258 1 H Slot1 Cabli
Y067 0231 3/ ng of
YBNJ Slot1 the
9/ GPU
Slot2 cards
1 on
the
5885
H V7
2x
GPU
chas
sis.

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 116


FusionServer Server GPU Card
Operation Guide 3 Installing a GPU Card

GPU GPU Serve Riser GPU Fan Maxi Supp Maxi GPU
Part Mode r Card Powe Part mum orted mum Card
No. l Mode Part r No. Num Instal Mem Cable
l No. Cable ber lation ory Conn
Part of Slot Capa ectio
No. GPU city n
and Card Meth
Quan s od
tity

0632 Tesla 5885 0258 0415 0231 4 Slot1 16T Meth


Y027 A800 H V7 Y066 3776x YBN 1/ od 8:
0258 1 H Slot1 Cabli
Y067 0231 3/ ng of
YBNJ Slot1 the
9/ GPU
Slot2 cards
1 on
the
5885
H V7
2x
GPU
chas
sis.

0257 Tesla 5885 0258 - 0231 4 Slot1 16T Meth


Y068 A2 H V7 Y066 YBN 1/ od 1:
0258 H Slot1 No
Y067 0231 3/ powe
YBNJ Slot1 r
9/ cable
Slot2 is
1 used.

3.2.2 Rack Server GPU Card Cable Connection Method


Some GPU cards of the rack server have high power consumption. Therefore, GPU
card power cables are required to supply power to the GPU independently. The
common power cable connection modes of GPU cards are as follows:
● Method 1: No power cable is used.
● Method 2: Use a 6-pin power cable and an 8-pin power cable.
– Connect the 6-pin connector on the GPU to any 8-pin connector on the riser
card. See (1) in Figure 3-1.
– Connect the 8-pin connector on the GPU to any 8-pin connector on the riser
card. See (2) in Figure 3-1.
● Method 3: Use a 6-pin power cable.
Connect the 6-pin connector on the GPU to any 8-pin connector on the riser
card. See (3) in Figure 3-1.

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 117


FusionServer Server GPU Card
Operation Guide 3 Installing a GPU Card

● Method 4: Use an 8-pin power cable.


Connect the 8-pin connector on the GPU to any 8-pin connector on the riser
card. See (4) in Figure 3-1.
● Method 5: Use an 8-pin (one-to-two) power cable.
Connect the 8-pin connector on the GPU to the one-cable end of the one-to-two
cable delivered with the GPU, and connect the two-cable end of the one-to-two
cable to the 8-pin connector on the riser card. See (5) in Figure 3-1.
● Method 6: Cabling of the GPU cards on the 2288H V6-32DIMM or 2288H V7 4 x
GPU chassis.
Connect the 8-pin connector on the GPU to the 8-pin connector of the
corresponding slot on the riser card. See (1) and (2) in Figure 3-2.
● Method 7: Cabling of the GPU cards on the 2288H V7.
Connect the connector on the GPU to the 12-pin connector of the corresponding
slot on the mainboard. See (1) and (2) in Figure 3-3.
● Method 8: Cabling of the GPU cards on the 5885H V7 2 x GPU chassis.
Connect the 20-pin connector on the riser card to the 20-pin connector of the
corresponding slot on the power backplane. See (1) and (2) in Figure 3-4.
Connect the connector on the GPU to the 12-pin connector of the corresponding
slot on the riser card. See (1) in Figure 3-5.
● Method 9: Cabling of the GPU cards on the 2288H V6-32DIMM.
The connector of the GPU card in the I/O slot 1 is connected to the J88
connector on the mainboard, with a cable enciphered as 0415Y191. See (1) in
Figure 3-6.
The connector of the GPU card in the I/O slot 2 is connected to the J89
connector on the mainboard, with a cable enciphered as 0415Y203. See (2) in
Figure 3-6.

Figure 3-1 Connecting the power cable to a GPU card 1

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 118


FusionServer Server GPU Card
Operation Guide 3 Installing a GPU Card

Figure 3-2 Connecting the power cable to a GPU card 2

Figure 3-3 Connecting the power cable to a GPU card 3

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 119


FusionServer Server GPU Card
Operation Guide 3 Installing a GPU Card

Figure 3-4 Connecting the power cable to a GPU card 4

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 120


FusionServer Server GPU Card
Operation Guide 3 Installing a GPU Card

Figure 3-5 Connecting the power cable to a GPU card 5

Figure 3-6 Connecting the power cable to a GPU card 6

3.3 Installing a GPU Card on a GPU Server


To install GPU cards on GPU servers, follow the GPU card configuration rules. For
details, see 3.3.1 GPU Server GPU Configuration Rule. Some GPUs have high
power consumption. Therefore, GPU power cables are required to supply power to

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 121


FusionServer Server GPU Card
Operation Guide 3 Installing a GPU Card

the GPU separately. For details about how to connect a GPU power cable, see 3.3.2
GPU Server GPU Card Cable Connection Method.

3.3.1 GPU Server GPU Configuration Rule


For details about GPU configuration rules for GPU servers, see Table 3-4 and Table
3-5.
The G5500 supports multiple heterogeneous modules. Pay attention to the following
when installing GPU cards on different heterogeneous modules:
● Install an NVIDIA NVLink module on the GS608
– The PCIe front panel and power cables are not required, but the heat sink
(Part No.: 21162601) needs to be configured.
– The total physical memory capacity of the server must be at least twice the
total memory capacity of the NVLink module. In addition, the physical
memory modules of the server must be symmetrically installed in each
memory channel.
● Install a PCIe GPU card on the GP608 or GP308
– The PCIe front panel dedicated to the G5500 is required. For purchased
GPU cards, you need to replace the original front panel with the dedicated
one. For details, see Table 3-4.
– GPUs whose power consumption is higher than 75 W require dedicated
G5500 power cables. For details, see Table 3-4.
– If the GPU card front panel accessory package is delivered with the server,
the GPU card front panel and power cables are installed on the
corresponding heterogeneous compute module by default. If the accessory
package is purchased as a separate part, select the accessory package
according to Table 3-4.
● Install an HHHL PCIe GPU card on the GP316
– The GPU card can be directly installed without replacing the front panel or
installing power cables.

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 122


FusionServer Server GPU Card
Operation Guide 3 Installing a GPU Card

Table 3-4 GPU server GPU configuration rules 1


GPU GPU Card Gene Heter BOM of BOM Ma Wh GPU
Card Description ral- ogen the and xi eth Card
BOM Purp eous Front Quantity mu er Pow
ose Com Panel of m a er
Com pute Access Power Nu De Cabl
pute Mod ory Cables mb dic e
Mod ule Packag in the er ate Con
ule Mode e (One Front of d necti
Mode l Set for Panel GP Fr on
l Each Accesso U ont Meth
Hetero ry Ca Pa od
geneou Package rds nel
s Is
Module Re
) qui
red

063201 Tesla A100, G530 GP30 0231Y5 0415120 4 Ye Meth


68 40G/80G V5 8 65 1-002 x 4 s od 3:
0632Y0 GP3
10-001 08
GPU
card
cabl
e
conn
ectio
n
meth
od

G560 GP60 02313Q 0415120 8 Ye Meth


V5 8 QQ 1-002 x 8 s od 2:
GP6
08
GPU
card
cabl
e
conn
ectio
n
meth
od

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 123


FusionServer Server GPU Card
Operation Guide 3 Installing a GPU Card

GPU GPU Card Gene Heter BOM of BOM Ma Wh GPU


Card Description ral- ogen the and xi eth Card
BOM Purp eous Front Quantity mu er Pow
ose Com Panel of m a er
Com pute Access Power Nu De Cabl
pute Mod ory Cables mb dic e
Mod ule Packag in the er ate Con
ule Mode e (One Front of d necti
Mode l Set for Panel GP Fr on
l Each Accesso U ont Meth
Hetero ry Ca Pa od
geneou Package rds nel
s Is
Module Re
) qui
red

0632Y0 Tesla A30 G530 GP30 0231Y5 0415120 4 Ye Meth


07 V5 8 65 1-002 x 4 s od 3:
GP3
08
GPU
card
cabl
e
conn
ectio
n
meth
od

G560 GP60 02313Q 0415120 8 Ye Meth


V5 8 QQ 1-002 x 8 s od 2:
GP6
08
GPU
card
cabl
e
conn
ectio
n
meth
od

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 124


FusionServer Server GPU Card
Operation Guide 3 Installing a GPU Card

GPU GPU Card Gene Heter BOM of BOM Ma Wh GPU


Card Description ral- ogen the and xi eth Card
BOM Purp eous Front Quantity mu er Pow
ose Com Panel of m a er
Com pute Access Power Nu De Cabl
pute Mod ory Cables mb dic e
Mod ule Packag in the er ate Con
ule Mode e (One Front of d necti
Mode l Set for Panel GP Fr on
l Each Accesso U ont Meth
Hetero ry Ca Pa od
geneou Package rds nel
s Is
Module Re
) qui
red

063201 NVIDIA dual- G560 GP60 02312G 0415120 8 Ye Meth


05 slot GPU V5 8 AR 1-002 x 8 s od 2:
063201 card (Tesla GP6
10 P40/P100/ 08
V100) GPU
063201 card
21 cabl
063201 e
19 conn
063201 ectio
30 n
meth
od

G530 GP30 02312G 0415120 4 Ye Meth


V5 8 AS 1-002 x 4 s od 3:
GP3
08
GPU
card
cabl
e
conn
ectio
n
meth
od

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 125


FusionServer Server GPU Card
Operation Guide 3 Installing a GPU Card

GPU GPU Card Gene Heter BOM of BOM Ma Wh GPU


Card Description ral- ogen the and xi eth Card
BOM Purp eous Front Quantity mu er Pow
ose Com Panel of m a er
Com pute Access Power Nu De Cabl
pute Mod ory Cables mb dic e
Mod ule Packag in the er ate Con
ule Mode e (One Front of d necti
Mode l Set for Panel GP Fr on
l Each Accesso U ont Meth
Hetero ry Ca Pa od
geneou Package rds nel
s Is
Module Re
) qui
red

G560 GP60 02312G 0415120 8 Ye Meth


8 AR 1-002x8 s od 2:
GP6
08
GPU
card
cabl
e
conn
ectio
n
meth
od

063201 Tesla V100s G560 GP60 02312G 0415120 4 - Meth


65 32G V5 8 AR 1-002 x 8 od 2:
GP6
08
GPU
card
cabl
e
conn
ectio
n
meth
od

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 126


FusionServer Server GPU Card
Operation Guide 3 Installing a GPU Card

GPU GPU Card Gene Heter BOM of BOM Ma Wh GPU


Card Description ral- ogen the and xi eth Card
BOM Purp eous Front Quantity mu er Pow
ose Com Panel of m a er
Com pute Access Power Nu De Cabl
pute Mod ory Cables mb dic e
Mod ule Packag in the er ate Con
ule Mode e (One Front of d necti
Mode l Set for Panel GP Fr on
l Each Accesso U ont Meth
Hetero ry Ca Pa od
geneou Package rds nel
s Is
Module Re
) qui
red

G530 GP30 02312G 0415120 4 Ye Meth


V5 8 AS 1-002x4 s od 3:
GP3
08
GPU
card
cabl
e
conn
ectio
n
meth
od

063201 Tesla V100 G530 GP30 02312G 0415246 8 - Meth


29 FHHL V5 8 DR 7x4 od 4:
GP3
08
GPU
card
cabl
e
conn
ectio
n
meth
od

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 127


FusionServer Server GPU Card
Operation Guide 3 Installing a GPU Card

GPU GPU Card Gene Heter BOM of BOM Ma Wh GPU


Card Description ral- ogen the and xi eth Card
BOM Purp eous Front Quantity mu er Pow
ose Com Panel of m a er
Com pute Access Power Nu De Cabl
pute Mod ory Cables mb dic e
Mod ule Packag in the er ate Con
ule Mode e (One Front of d necti
Mode l Set for Panel GP Fr on
l Each Accesso U ont Meth
Hetero ry Ca Pa od
geneou Package rds nel
s Is
Module Re
) qui
red

G560 DP60 02312G 0415062 8 - Meth


V5 8 FJ 7-002 x 8 od 2:
GP6
08
GPU
card
cabl
e
conn
ectio
n
meth
od

063201 NVIDIA G560 GS60 - - 8 - Meth


24 NVLink V5 8 od 1:
02312E module No
BU (Tesla V100 pow
SXM2, 16 er
02312E GB/32 GB) cabl
RL e is
02312E used
XK .

02312L NVIDIA G560 GP60 02312G - 8 Ye Meth


SB HHHL GPU V5 8 FM s od 1:
card (Tesla No
T4) with a pow
half-height er
front panel cabl
e is
used
.

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 128


FusionServer Server GPU Card
Operation Guide 3 Installing a GPU Card

GPU GPU Card Gene Heter BOM of BOM Ma Wh GPU


Card Description ral- ogen the and xi eth Card
BOM Purp eous Front Quantity mu er Pow
ose Com Panel of m a er
Com pute Access Power Nu De Cabl
pute Mod ory Cables mb dic e
Mod ule Packag in the er ate Con
ule Mode e (One Front of d necti
Mode l Set for Panel GP Fr on
l Each Accesso U ont Meth
Hetero ry Ca Pa od
geneou Package rds nel
s Is
Module Re
) qui
red

G530 GP30 02312G - 8 Ye Meth


V5 8 FD s od 1:
No
pow
er
cabl
e is
used
.

GP31 - - 16 No Meth
6 od 1:
No
pow
er
cabl
e is
used
.

063201 NVIDIA G560 GP60 02312G - 8 Ye Meth


47 HHHL GPU V5 8 FM s od 1:
card (Tesla No
T4) pow
er
cabl
e is
used
.

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 129


FusionServer Server GPU Card
Operation Guide 3 Installing a GPU Card

GPU GPU Card Gene Heter BOM of BOM Ma Wh GPU


Card Description ral- ogen the and xi eth Card
BOM Purp eous Front Quantity mu er Pow
ose Com Panel of m a er
Com pute Access Power Nu De Cabl
pute Mod ory Cables mb dic e
Mod ule Packag in the er ate Con
ule Mode e (One Front of d necti
Mode l Set for Panel GP Fr on
l Each Accesso U ont Meth
Hetero ry Ca Pa od
geneou Package rds nel
s Is
Module Re
) qui
red

G530 GP30 02312G - 8 Ye Meth


V5 8 FD s od 1:
No
pow
er
cabl
e is
used
.

02312D NVIDIA G560 GP60 02312G - 8 Ye Meth


MY HHHL GPU V5 8 FM s od 1:
card (Tesla No
P4) with a pow
half-height er
front panel cabl
e is
used
.

G560 GP60 02312G - 8 Ye Meth


8 FM s od 1:
No
pow
er
cabl
e is
used
.

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 130


FusionServer Server GPU Card
Operation Guide 3 Installing a GPU Card

GPU GPU Card Gene Heter BOM of BOM Ma Wh GPU


Card Description ral- ogen the and xi eth Card
BOM Purp eous Front Quantity mu er Pow
ose Com Panel of m a er
Com pute Access Power Nu De Cabl
pute Mod ory Cables mb dic e
Mod ule Packag in the er ate Con
ule Mode e (One Front of d necti
Mode l Set for Panel GP Fr on
l Each Accesso U ont Meth
Hetero ry Ca Pa od
geneou Package rds nel
s Is
Module Re
) qui
red

063201 G530 GP30 02312G - 8 Ye Meth


07 V5 8 FD s od 1:
No
pow
er
cabl
e is
used
.

G530 GP31 - - 16 No Meth


V5 6 od 1:
No
pow
er
cabl
e is
used
.

02312L Self- G560 GP60 02312G - 8 No Meth


GU developed V5 8 FM od 1:
HHHL Atlas No
300 card pow
(model 3010) er
cabl
e is
used
.

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 131


FusionServer Server GPU Card
Operation Guide 3 Installing a GPU Card

GPU GPU Card Gene Heter BOM of BOM Ma Wh GPU


Card Description ral- ogen the and xi eth Card
BOM Purp eous Front Quantity mu er Pow
ose Com Panel of m a er
Com pute Access Power Nu De Cabl
pute Mod ory Cables mb dic e
Mod ule Packag in the er ate Con
ule Mode e (One Front of d necti
Mode l Set for Panel GP Fr on
l Each Accesso U ont Meth
Hetero ry Ca Pa od
geneou Package rds nel
s Is
Module Re
) qui
red

G530 GP30 02312G - 8 No Meth


V5 8 FD od 1:
No
pow
er
cabl
e is
used
.

02312L Self- G530 GP31 - - 16 No Meth


FY developed V5 6 od 1:
HHHL Atlas No
300 card pow
(model 3010) er
cabl
e is
used
.

063201 Quadro G560 GP60 02313M 0415219 8 - Meth


52 RTX6000 V5 8 ED 4x8 od 2:
GP6
08
GPU
card
cabl
e
conn
ectio
n
meth
od

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 132


FusionServer Server GPU Card
Operation Guide 3 Installing a GPU Card

GPU GPU Card Gene Heter BOM of BOM Ma Wh GPU


Card Description ral- ogen the and xi eth Card
BOM Purp eous Front Quantity mu er Pow
ose Com Panel of m a er
Com pute Access Power Nu De Cabl
pute Mod ory Cables mb dic e
Mod ule Packag in the er ate Con
ule Mode e (One Front of d necti
Mode l Set for Panel GP Fr on
l Each Accesso U ont Meth
Hetero ry Ca Pa od
geneou Package rds nel
s Is
Module Re
) qui
red

G530 GP30 02313M 0415219 4 - Meth


V5 8 EC 4x4 od 3:
GP3
08
GPU
card
cabl
e
conn
ectio
n
meth
od

0632Y0 NVIDIA-Tesla G560 GP60 0231Y5 0415120 8 - Meth


27 A800 V5 8 65 1-002x4 od 2:
GP6
08
GPU
card
cabl
e
conn
ectio
n
meth
od

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 133


FusionServer Server GPU Card
Operation Guide 3 Installing a GPU Card

GPU GPU Card Gene Heter BOM of BOM Ma Wh GPU


Card Description ral- ogen the and xi eth Card
BOM Purp eous Front Quantity mu er Pow
ose Com Panel of m a er
Com pute Access Power Nu De Cabl
pute Mod ory Cables mb dic e
Mod ule Packag in the er ate Con
ule Mode e (One Front of d necti
Mode l Set for Panel GP Fr on
l Each Accesso U ont Meth
Hetero ry Ca Pa od
geneou Package rds nel
s Is
Module Re
) qui
red

G530 GP30 02313Q 0415120 4 - Meth


V5 8 QQ 1-002x8 od 3:
GP3
08
GPU
card
cabl
e
conn
ectio
n
meth
od

Table 3-5 GPU server GPU configuration rules 2


GPU GPU Genera BOM of BOM and Maxi Whet GPU
Card Card l- the Front Quantity mum her a Card
BOM Descript Purpos Panel of Power Num Dedi Powe
ion e Accessor Cables in ber cate r
Compu y Package the Front of d Cable
te Panel GPU Fron Conn
Module Accessor Card t ectio
Model y s Pane n
Package l Is Meth
Req od
uired

0257Y01 Nvidia G5500 0231YBK 0415Y074 8 Yes Meth


0 Tesla V6 M x1 od 5:
A800 G550
0 V6
or
G5...

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 134


FusionServer Server GPU Card
Operation Guide 3 Installing a GPU Card

GPU GPU Genera BOM of BOM and Maxi Whet GPU


Card Card l- the Front Quantity mum her a Card
BOM Descript Purpos Panel of Power Num Dedi Powe
ion e Accessor Cables in ber cate r
Compu y Package the Front of d Cable
te Panel GPU Fron Conn
Module Accessor Card t ectio
Model y s Pane n
Package l Is Meth
Req od
uired

0257Y01 Nvidia G5500 0231YBK 0415Y074 8 Yes Meth


1 Tesla V6 M x1 od 5:
A30 G550
0 V6
or
G5...

0257Y08 Nvidia G5500 - - 8 No Meth


0 Tesla T4 V6 od 1:
No
powe
r
cable
is
used.

0257Y02 Nvidia G5500 0231YBK 0415Y074 8 Yes Meth


2 Tesla V6 M x1 od 5:
A40 G550
0 V6
or
G5...

0257Y02 Nvidia G5500 0231YBK 0415Y075 8 Yes Meth


4 Tesla V6 Q x1 od 5:
A10 G550
0 V6
or
G5...

0257Y15 RTX G5500 0231YBK 0415Y074 8 Yes Meth


3 A6000 V6 M x1 od 5:
G550
0 V6
or
G5...

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 135


FusionServer Server GPU Card
Operation Guide 3 Installing a GPU Card

GPU GPU Genera BOM of BOM and Maxi Whet GPU


Card Card l- the Front Quantity mum her a Card
BOM Descript Purpos Panel of Power Num Dedi Powe
ion e Accessor Cables in ber cate r
Compu y Package the Front of d Cable
te Panel GPU Fron Conn
Module Accessor Card t ectio
Model y s Pane n
Package l Is Meth
Req od
uired

0257Y24 Tesla A2 G5500 - - 8 No Meth


3 V6 od 1:
No
powe
r
cable
is
used.

0257Y30 CloudBla G5500 0231YBK 0415Y074 8 Yes Meth


5 zer T20 V6 M x1 od 5:
G550
0 V6
or
G5...

0257Y24 Tesla G5500 0231YBKN 0415Y155 8 Yes Meth


1 L40 V6 x1 od 5:
G550
0 V6
or
G5...

0257Y24 Tesla L4 G5500 - - 8 No Meth


2 V6 od 1:
No
powe
r
cable
is
used.

0257Y13 Tesla G5500 0231YBK 0415Y074 8 Yes Meth


9 A100 V6 M x1 od 5:
G550
0 V6
or
G5...

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 136


FusionServer Server GPU Card
Operation Guide 3 Installing a GPU Card

GPU GPU Genera BOM of BOM and Maxi Whet GPU


Card Card l- the Front Quantity mum her a Card
BOM Descript Purpos Panel of Power Num Dedi Powe
ion e Accessor Cables in ber cate r
Compu y Package the Front of d Cable
te Panel GPU Fron Conn
Module Accessor Card t ectio
Model y s Pane n
Package l Is Meth
Req od
uired

0257Y36 Tesla G5500 0231YBKN 0415Y155 8 Yes Meth


0 L20 V6 x1 od 5:
G550
0 V6
or
G5...

0257Y38 Tesla L2 G5500 - - 8 No Meth


3 V6 od 1:
No
powe
r
cable
is
used.

0257Y30 Tesla G5500 0231YBKN 0415Y155 8 Yes Meth


8 L40S V6 x1 od 5:
G550
0 V6
or
G5...

0257Y14 Tesla G5500 0231YBKN 0415Y155 10 Yes Meth


8 H100 V7 x1 od 5:
G550
0 V6
or
G5...

0257Y14 Tesla G5500 0231YBKN 0415Y155 10 Yes Meth


7 H800 V7 x1 od 5:
G550
0 V6
or
G5...

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 137


FusionServer Server GPU Card
Operation Guide 3 Installing a GPU Card

GPU GPU Genera BOM of BOM and Maxi Whet GPU


Card Card l- the Front Quantity mum her a Card
BOM Descript Purpos Panel of Power Num Dedi Powe
ion e Accessor Cables in ber cate r
Compu y Package the Front of d Cable
te Panel GPU Fron Conn
Module Accessor Card t ectio
Model y s Pane n
Package l Is Meth
Req od
uired

0257Y22 Tesla G5500 0231YBK 0415Y074 10 Yes Meth


4 A100 V7 M x1 od 5:
G550
0 V6
or
G5...

0257Y22 Tesla G5500 0231YBK 0415Y074 10 Yes Meth


5 A800 V7 M x1 od 5:
G550
0 V6
or
G5...

0257Y36 Tesla G5500 0231YBKN 0415Y155 10 Yes Meth


1 L20 V7 x1 od 5:
G550
0 V6
or
G5...

0257Y14 Tesla G5500 0231YBKN 0415Y155 10 Yes Meth


6 L40 V7 x1 od 5:
G550
0 V6
or
G5...

0257Y27 Tesla G5500 0231YBKN 0415Y155 10 Yes Meth


8 L40S V7 x1 od 5:
G550
0 V6
or
G5...

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 138


FusionServer Server GPU Card
Operation Guide 3 Installing a GPU Card

GPU GPU Genera BOM of BOM and Maxi Whet GPU


Card Card l- the Front Quantity mum her a Card
BOM Descript Purpos Panel of Power Num Dedi Powe
ion e Accessor Cables in ber cate r
Compu y Package the Front of d Cable
te Panel GPU Fron Conn
Module Accessor Card t ectio
Model y s Pane n
Package l Is Meth
Req od
uired

0257Y14 Tesla L4 G5500 - - 10 No Meth


4 V7 od 1:
No
powe
r
cable
is
used.

0257Y38 Tesla L2 G5500 - - 10 No Meth


4 V7 od 1:
No
powe
r
cable
is
used.

3.3.2 GPU Server GPU Card Cable Connection Method


Some GPU cards of the GPU server have high power consumption. Therefore, GPU
card power cables are required to supply power to the GPU independently. The
common power cable connection modes of GPU cards are as follows:
● Method 1: No power cable is used.
● Method 2: GP608 GPU card cable connection method
The GPU card in each slot uses a power cable to connect to a specific power
supply port of the GP608 mother board, as shown in Figure 3-7.
● Method 3: GP308 GPU card cable connection method
The GPU card in each dual-slot uses a power cable to connect to a specific
power supply port of the GP308 mother board, as shown in Figure 3-8.
● Method 4: GP308 GPU card cable connection method
The GPU card in each single-slot uses a power cable to connect to a specific
power supply port of the GP308 mother board, as shown in Figure 3-9.
● Method 5: G5500 V6 or G5500 V7 GPU card cable connection method
The GPU card in each slot uses a power cable to connect to a specific power
supply port of the mother board, as shown in Figure 3-10.

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 139


FusionServer Server GPU Card
Operation Guide 3 Installing a GPU Card

Figure 3-7 Power cables for connecting the GP608 to GPU cards

Figure 3-8 Power cables for connecting the GP308 to dual-width GPU cards

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 140


FusionServer Server GPU Card
Operation Guide 3 Installing a GPU Card

Figure 3-9 Power cables for connecting the GP308 to single-slot GPU cards

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 141


FusionServer Server GPU Card
Operation Guide 3 Installing a GPU Card

Figure 3-10 Connecting a GPU power cable to the G5500 V6 or G5500 V7 server

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 142


FusionServer Server GPU Card
Operation Guide 4 Configuring a GPU Card

4 Configuring a GPU Card

4.1 Installing the GPU Card Driver

4.1 Installing the GPU Card Driver


This section uses Red Hat 7.3 and Windows Server 2016 as examples to describe
how to install the NVIDIA Tesla P40 GPU driver.

4.1.1 Obtaining the Driver Package


Download the corresponding driver package based on the actual application
scenario.
● Download the latest GPU driver.
● Download the driver of an earlier version.
You are advised to download the latest GPU driver.

Downloading the Latest GPU Driver


Step 1 Visit NVIDIA.

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 143


FusionServer Server GPU Card
Operation Guide 4 Configuring a GPU Card

Step 2 Select the corresponding GPU, OS, and latest CUDA Toolkit version (supported by
the driver), and click Search.

Step 3 Download the found GPU driver.

----End

NO TE

For Windows, select the driver package based on the version.


The Linux-64 and Linux 64-bit RHEL 7 drivers are available for RHEL 7.3.
● The Linux-64 driver is in the .run format and needs to be manually compiled. It supports
common Linux OSs of the x86 architecture. For details, see the official NVIDIA website.
● The Linux 64-bit RHEL 7 driver is in .rpm format and needs to be installed using the yum
package management tool. This driver applies only to REHL 7 series OSs.

Downloading the Driver of an Earlier Version


Step 1 Visit NVIDIA.
Step 2 Click Beta and Older Drivers.

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 144


FusionServer Server GPU Card
Operation Guide 4 Configuring a GPU Card

Step 3 Select the corresponding GPU, OS, and historical CUDA Toolkit versions, and click
Search.
Step 4 Download the found GPU driver.

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 145


FusionServer Server GPU Card
Operation Guide 4 Configuring a GPU Card

----End

4.1.2 Installing and Uninstalling Drivers in Linux


Drivers in .prm and .run formats are incompatible. Therefore, the following restrictions
are imposed on driver installation:

● If a driver in .run format has been installed, you need to uninstall the driver
in .run format before installing a driver in .rpm format. You can directly install the
driver in .run format after uninstalling the driver in .run format.
● If a driver in the .rpm format has been installed, you need to uninstall the driver
in the .rpm format before installing the driver in the .run format. Then you can
directly install the driver in the .rpm format.

4.1.2.1 Disabling the Nouveau Driver in Linux


Before installing the NVIDIA video card driver in the Linux OS, you are advised to
uninstall the built-in video card driver Nouveau of the Linux OS.

NO TE

Nouveau is a third-party open-source 3D driver development project organized by enthusiasts


for NVIDIA GPUs. Nouveau is developed without any support from NVIDIA and conflicts with
NVIDIA drivers. In addition, it may affect the GPU running reliability. Therefore, you are
advised to disable this driver before using NVIDIA GPUs.

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 146


FusionServer Server GPU Card
Operation Guide 4 Configuring a GPU Card

Step 1 On the OS CLI, run the lsmod|grep -i nouveau command to check whether the
Nouveau driver is loaded.
NO TE

If the command output contains nouveau, the Nouveau driver has been loaded. Otherwise,
the Nouveau driver is not loaded.

Step 2 Disable the Nouveau driver by referring to A.1.4 How to Disable the Nouveau
Driver for Different Linux Systems.
Step 3 On the OS CLI, run the reboot command to restart the server.
Step 4 Perform Step 1 to check whether the Nouveau driver is disabled.

----End

4.1.2.2 Installing and Uninstalling .run Drivers in Linux


This section uses Red Hat 7.3 as an example to describe how to install and uninstall
the NVIDIA Tesla P40 driver in .run format. The NVIDIA-Linux-x86_64-445.50.run
driver file is used as an example.

Installing .run Drivers


Step 1 Mount the Red Hat 7.3 .run driver file using Directory on the remote virtual console
of the iBMC WebUI.
NO TE

For details about how to use Directory on the remote virtual console of the iBMC WebUI, see
the FusionServer Server iBMC User Guide.

Step 2 Log in to the OS CLI as the root user and run the init 3 command to access the text
interface.
Step 3 Run the mount/dev/sr0 /mnt/ command to mount the driver file to the /mnt directory.
Step 4 Run the following command to copy the driver file NVIDIA-Linux-x86_64-445.50.run
from the /mnt/ directory to the root directory:
#cp /mnt/NVIDIA-Linux-x86_64-445.50.run /

Step 5 Run the lspci | grep -i nvidia command to check whether the GPU card is properly
installed.
NO TE

If the command output contains the NVIDIA device (as shown in Figure 4-1), the GPU card
can be identified. Otherwise, the GPU card is incorrectly configured or the GPU card hardware
is faulty. In this case, resolve the GPU card identification failure first.

Figure 4-1 Viewing video card information

Step 6 Run the cd / command to go to root directory.


Step 7 Run the chmod +x NVIDIA-Linux-x86_64-445.50.run command to grant the
execute permission on the driver.

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 147


FusionServer Server GPU Card
Operation Guide 4 Configuring a GPU Card

Step 8 Run the ./NVIDIA-Linux-x86_64-445.50.run --no-opengl-files command to install


the driver.

The OpenGL component in the driver conflicts with the OS. Therefore, you do to add
the --no-opengl-files parameter in the command. If this parameter is not added, the
GUI cannot be displayed during the installation and an error is reported, as shown in
Figure 4-2.

Figure 4-2 Something has gone wrong

Step 9 A dialog box containing the following information is displayed. In the dialog box,
select Yes and press Enter.
Install NVIDIA's 32-bit compatibility libraries?

Step 10 The following dialog box may be displayed for the driver of an earlier version.

NO TE

● If a computing video card is used, select No. By default, the video card on the mainboard is
used. Otherwise, the GUI cannot be displayed.
● If a display video card is used and the output needs to be displayed through the GPU card,
select Yes. After the driver is installed, restart the system and set the GPU card as the
default video card in the BIOS (For details, see the BIOS parameter reference document of
the corresponding server model.). In this case, the GUI can be properly displayed.

Step 11 A dialog box containing the following information is displayed. In the dialog box,
select OK and press Enter. The NVIDIA GPU card driver is installed.
Installation of the kernel module for the NVIDIA Accelerated Graphics Driver for Linux x86_64 (version 445.50) is now
complete.

Step 12 After the installation is complete, run the nvidia-smi command to view the video card
information. If the model and related information about the video card are displayed
in the command output, the driver is installed properly.

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 148


FusionServer Server GPU Card
Operation Guide 4 Configuring a GPU Card

Step 13 Run the init 5 command to access the GUI.

----End

Uninstalling .run Drivers


Step 1 On the OS CLI, run the nvidia-uninstall command to uninstall the driver.
Step 2 On the following screen, select No and press Enter.

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 149


FusionServer Server GPU Card
Operation Guide 4 Configuring a GPU Card

NO TE

If the xconf file is generated during the GPU card driver installation and the NVIDIA GPU card
is used, select Yes to restore the default configuration and use the video card on the
mainboard.

Step 3 On the screen shown in the following figure, select OK and press Enter. The GPU
card driver is uninstalled.

----End

4.1.2.3 Installing and Uninstalling .prm Drivers in Linux

Installing .prm Drivers


The installation package for RHEL or CentOS is in .prm format. For details about the
installation procedure, see the official website. For details about how to install the
driver on other OSs, see the following driver download page. The .rpm driver needs
to be installed online. Therefore, you are advised to install the .run driver.

Uninstalling .prm Drivers


Use the package management tool yum to uninstall the driver. Run the # yum
remove <package_name> command to uninstall the driver. In the command,

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 150


FusionServer Server GPU Card
Operation Guide 4 Configuring a GPU Card

package_name indicates the driver package name, which does not contain the file
name extension .rpm.

NO TE

Run the command to query the command for uninstalling the driver in RPM format. Use the
queried uninstallation command.

4.1.3 Installing and Uninstalling Drivers in Windows


This section uses Windows Server 2016 as an example to describe how to install and
uninstall the NVIDIA Tesla P40 video card driver.

Installing Drivers in Windows


Step 1 Mount the Windows Server 2016 driver file using Directory on the remote virtual
console of the iBMC WebUI.
NO TE

For details about how to use Directory on the remote virtual console of the iBMC WebUI, see
the iBMC User Guide.

Step 2 In the OS, open Device Manager and check whether the NVIDIA video card can be
identified.

Step 3 Double-click the NVIDIA video card driver installation program in the server OS. In
the displayed dialog box, click OK.

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 151


FusionServer Server GPU Card
Operation Guide 4 Configuring a GPU Card

Step 4 Click AGREE AND CONTINUE.

Step 5 Click NEXT.

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 152


FusionServer Server GPU Card
Operation Guide 4 Configuring a GPU Card

Step 6 Click CLOSE.

Step 7 Go to the default installation directory C:\Program Files\NVIDIA Corporation


\NVSMI\, right-click in the blank area of the folder, and choose Open command
window here from the shortcut menu to open the CLI.

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 153


FusionServer Server GPU Card
Operation Guide 4 Configuring a GPU Card

Step 8 Run the nvidia-smi.exe command to check the video card information. If the video
card model and related information is displayed in the command output, the driver is
installed properly.

----End

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 154


FusionServer Server GPU Card
Operation Guide 4 Configuring a GPU Card

Uninstalling Drivers in Windows


Step 1 On the Windows control panel, click Uninstall a program.

Step 2 Right-click NVIDIA Graphics Driver, choose Uninstall/Change from the shortcut
menu, and uninstall the NVIDIA video driver as prompted.

Step 3 Click RESTART NOW to restart the OS. The NVIDIA video card driver is uninstalled.

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 155


FusionServer Server GPU Card
Operation Guide 4 Configuring a GPU Card

----End

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 156


FusionServer Server GPU Card
Operation Guide A Appendix

A Appendix

A.1 FAQ

A.1.1 GUI Cannot Be Displayed After the GPU Card Is Inserted


After the OS Is Installed

Symptom
If the display video card is inserted (or the computing video card is in Graphic mode),
the Nouveau driver is used together with the external video card by default. As the
Nouveau driver is incompatible with NVIDIA GPU cards, the GUI cannot be properly
displayed.

Solution
Access the text terminal and disable the Nouveau driver by referring to A.1.4 How to
Disable the Nouveau Driver for Different Linux Systems.

A.1.2 GUI Cannot Be Displayed After the GPU Driver Is


Installed

Symptom
When installing the driver in CentOS and RHEL, select yes in the following step to
generate the xorg file. The file is configured to be displayed using the GPU card, but
the computing video card has no display interface. As a result, the GUI fails to be
displayed.

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 157


FusionServer Server GPU Card
Operation Guide A Appendix

Solution
Go to the /etc/X11 directory and delete the xorg.conf file.

A.1.3 Driver Fails to Be Installed Because the GCC Is Not


Installed
Symptom
During the installation of the .run driver, the following error message is displayed,
indicating that the driver fails to be installed.

Solution
Install the GCC and g++ compilers in advance.

A.1.4 How to Disable the Nouveau Driver for Different Linux


Systems
Fedora
● Create the /usr/lib/modprobe.d/blacklist-nouveau.conf file and add the
following information to the file.
blacklist nouveau
options nouveau modeset=0
● Re-generate initramfs.
$sudo dracut --force

RHEL/CentOS
● Create the /etc/modprobe.d/blacklist-nouveau.conf file and add the following
information to the file.
blacklist nouveau
options nouveau modeset=0
● Re-generate initramfs.
$sudo dracut --force

OpenSUSE
● Create the /etc/modprobe.d/blacklist-nouveau.conf file and add the following
information to the file.
blacklist nouveau
options nouveau modeset=0
● Re-generate initrd.
$sudo /sbin/mkinitrd

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 158


FusionServer Server GPU Card
Operation Guide A Appendix

SLES
The Nouveau driver is not installed in SLES.

Ubuntu
● Create the /etc/modprobe.d/blacklist-nouveau.conf file and add the following
information to the file.
blacklist nouveau
options nouveau modeset=0
● Re-generate initramfs.
$sudo update-initramfs -u

A.1.5 Failed to Detect the Kernel Source

Symptom
The header file of the kernel source is used during the installation of the NVIDIA
driver. Therefore, you need to download the kernel source. Otherwise, an error
message is displayed and the installation fails.

Solution
1. If you select a development package during the OS installation, the package will
be installed in advance.

2. Install the kernel-devel package. When installing the driver, run the following
command to specify the kernel source path:
./NVIDIA-Linux-x86_64-396.26.run --kernel-source-path=/usr/src/kernels/3.10.0-x

A.1.6 Compatibility Between Drivers and GPUs/OSs


● Compatibility Between Drivers and GPUs
Go to the official NVIDIA website and find a proper driver version.
In "Supported NVIDIA GPU Products" in the README file, check whether the
driver supports the GPU. You are advised to install the latest driver.
● Compatibility Between Drivers and OSs
Currently, NVIDIA does not provide the compatibility between drivers and
specific OS versions.
For example, if you install the driver of an earlier version 387.44 in CentOS 7.5,
an error indicating that the kernel is incompatible with the driver is displayed and
the driver installation fails. However, the latest driver can be installed properly.
Therefore, you are advised to install the latest driver version for a new OS.

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 159


FusionServer Server GPU Card
Operation Guide A Appendix

A.1.7 Insufficient MMIOH Resources on the OS with Tesla A100


40 GB Configured
Symptom
When the 2288H V5 is configured with Tesla A100 40 GB, the MMIOH resources are
insufficient after the lspci -vvv -s b9:00.0 command is executed on the Linux OS.
That is, the command output contains "Region 1: Memory at <unassigned> (64-bit,
prefetchable)", as shown in the following figure.

NO TE

b9:00.0 is the bus address of Tesla A100 40 GB on the OS. The bus address may vary
depending on hardware configurations.

Solution
On the BIOS setup screen, set MMIO High Granularity Size to 256G or larger. The
procedure is as follows:

Step 1 Restart the server and go to the BIOS setup screen.


Step 2 Choose Advanced > Socket Configuration > Common RefCode Configuration.

Step 3 Choose MMIO High Granularity Size and press Enter. Select 256G or larger and
press Enter.

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 160


FusionServer Server GPU Card
Operation Guide A Appendix

Step 4 Press F10.


The Save Changes&Exit dialog box is displayed.
Step 5 Select Yes and press Enter.
The server automatically restarts for the settings to take effect.
Step 6 Run the lspci -vvv -s b9:00.0 command on the Linux OS again. In the command
output, region 1 can properly allocate address space. In the following example,
"Region 1: Memory at <eb000000000> (64-bit, prefetchable) [size=64G]" is
displayed, where eb000000000 indicates the start address allocated by the MMIO,
size=64G indicates the size of the address space allocated by the MMIO.

----End

A.1.8 The GPU Temperature Exception Alarm Is Displayed on


the BMC
Fault Symptom
Hardware Information : G5500 V6/G5500 V7 + L2/L20-GPU
During the OS reboot process, the BMC occasionally displays an alarm indicating
that the GPU temperature is abnormal.
Alarm information: The value of temperature difference between the current GPU
Card 3 (NVIDIA L20) temperature and the maximum operating temperature is 0.000

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 161


FusionServer Server GPU Card
Operation Guide A Appendix

degrees C, which is lower than the temperature difference threshold (1.000 degrees
C).

Cause
Due to the NV-GPU feature, the minimum system boot is required during reboot.
Therefore, the temperature value obtained before boot-up is invalid.

Solution
After waiting for approximately 20 seconds, the GPU temperature information is
normal when the minimum system boots up.

A.2 Getting Help


If a fault persists during routine maintenance or troubleshooting, contact technical
support.

A.2.1 Collecting Fault Information


Collect fault information before troubleshooting.

The information includes:

● Customer company and address


● Contact person and telephone number
● Time when the fault occurred
● Detailed fault symptom
● Device types and software versions
● Measures taken and effects
● Fault severity and expected rectification deadline

A.2.2 Preparing for Debugging


Technical support engineers can assist you in further collecting fault information and
rectifying the fault.

Before contacting technical support, get ready the spare parts and tools such as
screwdrivers, screws, serial cables, and network cables.

A.2.3 Using Product Documentation


xFusion provides a complete documentation shipped with the device. The
documentation provides guidance on how to solve common problems that occur
during routine maintenance and troubleshooting.

Refer to the documentation before you contact xFusion for technical support.

A.2.4 Technical Support


xFusion provides timely and efficient technical support through:

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 162


FusionServer Server GPU Card
Operation Guide A Appendix

● Local branch offices


● Secondary technical support system
● Telephone technical support
● Remote technical support
● Onsite technical support

Technical Support Website


Technical documents are available at xFusion website.

Cases
To obtain case study about servers, visit Knowledge Base.

Contact xFusion
xFusion provides comprehensive technical support and services. To obtain
assistance, contact xFusion technical support as follows:
● Contact xFusion customer service center.
– Email: [email protected]
● Contact technical support personnel at your local xFusion branch office.

Issue 08 (2024-07-04) Copyright © xFusion Digital Technologies Co., Ltd. 163

You might also like