ECS 3 7 Hardware Guide Rev1.0
ECS 3 7 Hardware Guide Rev1.0
January 2023
Rev. 1.4
Contents
Figures..........................................................................................................................................4
Tables........................................................................................................................................... 8
Revision history......................................................................................................................................................................... 11
Chapter 2: Switches.................................................................................................................... 15
Dell Technologies S5148F switch................................................................................................................................... 15
Front-end switch pair..................................................................................................................................................15
Back-end switch pair...................................................................................................................................................16
Front-end and back-end switch connections........................................................................................................17
Dell Technologies S5248F switch.................................................................................................................................. 19
Front-end switch pair..................................................................................................................................................19
Back-end switch pair.................................................................................................................................................. 22
Front-end and back-end switch connections.......................................................................................................23
Aggregation switch pair S5232F................................................................................................................................... 24
Network connections between multiple ECS appliances in a single site ............................................................25
Connecting HDD Clusters to EXF900 Clusters......................................................................................................... 29
2 Contents
Aggregated EXF900 back-end network between multiple racks .........................................................................98
Contents 3
Figures
4 Figures
40 Back-end switch, front-end switch, and iDRAC ports on an EX5000D node.......................................... 54
41 Node ports on back-end switches...................................................................................................................... 55
42 EX5000 node network port cabling connections............................................................................................ 55
43 EX5000 node network cable labeling................................................................................................................. 56
44 ECS EX5000S Dell Provided Switch/Network cabling.................................................................................. 57
45 ECS EX5000S Customer Provided Switch/Network cabling.......................................................................58
46 ECS EX5000D Dell Provided Switch/Network cabling..................................................................................59
47 ECS EX5000D Customer Provided Switch/Network cabling...................................................................... 60
48 EXF900 minimum (left) and maximum (right) configurations......................................................................64
49 EXF900 server physical dimensions.................................................................................................................... 67
50 EXF900 server chassis front view with 12 disks..............................................................................................68
51 EXF900 server chassis front view with 24 disks............................................................................................. 68
52 Left control panel.................................................................................................................................................... 68
53 Status LEDs decoded view................................................................................................................................... 69
54 Right control panel.................................................................................................................................................. 69
55 EXF900 server chassis rear view.........................................................................................................................70
56 EXF900 disk drive in carrier................................................................................................................................... 71
57 EXF900 Standard Single-Phase AC 0U Cabling...............................................................................................74
58 EXF900 Single-Phase 0U Cabling with Aggregation Switch........................................................................ 76
59 EXF900 Standard Delta 0U Cabling.................................................................................................................... 78
60 EXF900 Standard Three-Phase WYE 0U Cabling............................................................................................79
61 EXF900 Three-Phase Delta 0U PDU with Aggregation Switch AC Cabling.............................................. 81
62 EXF900 Three-Phase WYE 0U PDU with Aggregation Switch AC Cabling.............................................. 82
63 EXF900 Standard Single-Phase 2U PDU AC Cabling..................................................................................... 84
64 EXF900 Single-Phase 2U PDU Cabling with Aggregation Switch...............................................................86
65 EXF900 Standard Three-Phase 2U PDU AC Cabling..................................................................................... 88
66 EXF900 Three-Phase 2U PDU with Aggregation Switch AC Cabling........................................................ 90
67 Fox switch iDRAC ports..........................................................................................................................................91
68 EXF900 iDRAC cabling........................................................................................................................................... 92
69 Front-end and back-end switch connections to an EXF900 node..............................................................93
70 Node ports on front-end switches...................................................................................................................... 94
71 Back-end switch, front-end switch, and iDRAC ports on an EXF900 node............................................. 94
72 Node ports on back-end switches.......................................................................................................................94
73 EXF900 node network port cabling connections............................................................................................ 95
74 EXF900 node network cable labeling................................................................................................................. 95
75 ECS v3 EXF900 network cabling.........................................................................................................................96
76 Aggregation topology............................................................................................................................................. 99
77 Inter-rack switch connectivity - aggregation topology.................................................................................. 99
78 EX500 minimum and maximum configurations............................................................................................... 104
79 EX500 server physical dimensions..................................................................................................................... 110
80 EX500 server chassis front view......................................................................................................................... 111
81 Left control panel....................................................................................................................................................112
82 Status LEDs decoded view...................................................................................................................................112
Figures 5
83 Right control panel................................................................................................................................................. 113
84 EX500 server chassis back view.........................................................................................................................113
85 EX500 disk drive in carrier....................................................................................................................................114
86 EX500 Single Phase AC Cabling Diagram......................................................................................................... 118
87 EX500 Three Phase Delta AC Cabling Diagram..............................................................................................120
88 EX500 Three Phase WYE AC Cabling Diagram............................................................................................... 121
89 Fox switch iDRAC ports....................................................................................................................................... 122
90 iDRAC cabling..........................................................................................................................................................123
91 Frontend and backend switch connections to an EX500 node.................................................................. 125
92 Node ports on frontend S5148F switches....................................................................................................... 126
93 Node ports on frontend S5248F switches.......................................................................................................126
94 Network cable and labeling..................................................................................................................................126
95 Node ports on backend S5148F switches........................................................................................................ 127
96 Node ports on backend S5248F switches....................................................................................................... 127
97 EX500 node network port cabling connections..............................................................................................127
98 EX500 node network cable labeling.................................................................................................................. 129
99 EX500 network cabling........................................................................................................................................ 130
100 EX300 minimum and maximum configurations............................................................................................... 132
101 EX300 server physical dimensions.....................................................................................................................135
102 EX300 server chassis front view....................................................................................................................... 135
103 Left control panel...................................................................................................................................................136
104 Status LEDs decoded view.................................................................................................................................. 136
105 Right control panel.................................................................................................................................................136
106 EX300 server chassis rear view..........................................................................................................................137
107 EX300 disk drive in carrier................................................................................................................................... 138
108 EX300 single-phase AC power cabling.............................................................................................................. 141
109 ECSv3 740xd Single Phase AC Cabling Diagram............................................................................................142
110 Three-phase Delta AC power cabling................................................................................................................143
111 ECSv3 740xd Three Phase Delta AC Cabling Diagram................................................................................. 144
112 Three-phase WYE AC power cabling................................................................................................................ 145
113 ECSv3 740xd Three Phase WYE AC Cabling Diagram..................................................................................146
114 Fox switch iDRAC ports........................................................................................................................................147
115 iDRAC cabling..........................................................................................................................................................148
116 Front-end and back-end switch connections to an EX300 node...............................................................149
117 Node ports on front-end S5148F switches..................................................................................................... 150
118 Node ports on front-end S5248F switches.....................................................................................................150
119 Back-end switch, front-end switch, and iDRAC ports on an EX300 node.............................................. 150
120 Node ports on back-end S5148F switches...................................................................................................... 150
121 Node ports on back-end S5248F switches...................................................................................................... 151
122 EX300 node network port cabling connections.............................................................................................. 151
123 EX300 node network cable labeling.................................................................................................................. 152
124 EX300 network cabling.........................................................................................................................................153
125 EX3000S minimum and maximum configurations for single node chassis...............................................156
6 Figures
126 EX3000D minimum and maximum configurations for dual node chassis..................................................157
127 EX3000 server front view in rack...................................................................................................................... 160
128 EX3000 external chassis view............................................................................................................................. 161
129 EX3000 internal chassis view.............................................................................................................................. 161
130 External view of server sled A in a EX3000D dual node chassis with two sleds....................................162
131 Front-panel features and indicators.................................................................................................................. 162
132 EX3000D server rear view in rack..................................................................................................................... 165
133 Back-panel features and indicators................................................................................................................... 166
134 EX3000 disk drive in carrier.................................................................................................................................167
135 PDU outlet numbers.............................................................................................................................................. 168
136 PDU single-phase diagram................................................................................................................................... 170
137 EX3000S single-phase AC power cabling......................................................................................................... 171
138 EX3000D single-phase AC power cabling........................................................................................................ 172
139 PDU three-phase diagram.................................................................................................................................... 173
140 EX3000S three-phase delta AC power cabling.............................................................................................. 174
141 EX3000D three-phase delta AC power cabling.............................................................................................. 175
142 EX3000S three-phase WYE AC power cabling...............................................................................................176
143 EX3000D three-phase WYE AC power cabling...............................................................................................177
144 EX3000S iDRAC cabling....................................................................................................................................... 179
145 EX3000D iDRAC cabling....................................................................................................................................... 181
146 Front-end and back-end switch connections to an EX3000S node..........................................................182
147 Front-end and back-end switch connections to an EX3000D node......................................................... 183
148 Node ports on front-end S5148F switches......................................................................................................183
149 Node ports on front-end S5248F switches.....................................................................................................184
150 Back-end switch, front-end switch, and iDRAC ports on an EX3000S node......................................... 184
151 Node ports on back-end S5148F switches...................................................................................................... 184
152 Node ports on back-end S5248F switches..................................................................................................... 185
153 EX3000 node network port cabling connections........................................................................................... 185
154 EX3000 node network cable labeling................................................................................................................ 186
155 EX3000S network cabling....................................................................................................................................187
156 EX3000D network cabling................................................................................................................................... 188
Figures 7
Tables
1 Revision history..........................................................................................................................................................11
2 Rack ID........................................................................................................................................................................ 13
3 Default node names................................................................................................................................................. 13
4 Switch port numbers............................................................................................................................................... 16
5 Switch port number................................................................................................................................................. 17
6 Switch port numbers.............................................................................................................................................. 20
7 Switch port number................................................................................................................................................ 22
8 Switch port number................................................................................................................................................ 25
9 EX5000 hardware components............................................................................................................................30
10 EX5000S single node chassis configurations................................................................................................... 34
11 EX5000D dual node chassis configurations...................................................................................................... 34
12 EX5000 Features.....................................................................................................................................................35
13 EX5000 physical dimensions.................................................................................................................................35
14 EX5000S node iDRAC port to BE1 port mapping............................................................................................ 48
15 EX5000D dual node iDRAC port to BE1 port mapping................................................................................... 50
16 Back-end cable kits..................................................................................................................................................61
17 Front-end cable kits.................................................................................................................................................61
18 Speed and model details......................................................................................................................................... 61
19 EXF900 hardware components............................................................................................................................63
20 EXF900 configurations...........................................................................................................................................65
21 Standard features of EXF900 servers................................................................................................................67
22 Decoding of LEDs in light bar............................................................................................................................... 68
23 Server Panel, Ports, and Slots..............................................................................................................................70
24 EXF900 Standard Single-Phase 0U PDU Cabling............................................................................................72
25 EXF900 0U PDU Cabling with Aggregation Switch........................................................................................ 75
26 EXF900 Standard 0U Three-Phase PDU Cabling............................................................................................ 77
27 EXF900 Three-Phase 0U Cabling with Aggregation Switch........................................................................ 80
28 EXF900 Standard Single-Phase 2U PDU Cabling............................................................................................83
29 EXF900 Single-Phase 2U PDU Cabling with Aggregation Switch...............................................................85
30 EXF900 Standard Three-Phase 2U PDU Cabling............................................................................................ 87
31 EXF900 Three-Phase 2U PDU with Aggregation Switch Cabling............................................................... 89
32 EXF900 node iDRAC port to BE1 port mapping............................................................................................... 91
33 Back-end cable kits................................................................................................................................................. 97
34 Front-end cable kits................................................................................................................................................ 97
35 Aggregation connection cable kits.......................................................................................................................97
36 Speed and model details........................................................................................................................................ 97
37 Aggregation port cabling........................................................................................................................................99
38 EX500 hardware components............................................................................................................................ 102
39 EX500 configurations........................................................................................................................................... 106
40 EX500 Disk Upgrade Kit.......................................................................................................................................109
8 Tables
41 Standard features of EX500 servers................................................................................................................ 109
42 Decoding of LEDs in light bar...............................................................................................................................112
43 EX500 0U PDU single-phase zone A/B mapping........................................................................................... 114
44 EX500 PDU three-phase Delta and WYE zone A/B mapping......................................................................115
45 EX500 2U PDU single-phase zone A/B mapping........................................................................................... 116
46 EX500 2U PDU three-phase Delta and WYE zone A/B mapping............................................................... 117
47 EX500 node iDRAC port to BE1 port mapping................................................................................................122
48 EX300 hardware components............................................................................................................................. 131
49 EX300 configurations............................................................................................................................................132
50 Standard features of EX300 servers.................................................................................................................134
51 Decoding of LEDs in light bar..............................................................................................................................136
52 Server Panel, Ports, and Slots............................................................................................................................ 137
53 EX300 0U PDU cabling.........................................................................................................................................138
54 EX300 2U PDU cabling......................................................................................................................................... 139
55 EX300 node iDRAC port to BE1 port mapping................................................................................................ 147
56 EX3000 hardware components.......................................................................................................................... 154
57 EX3000S single node chassis configurations.................................................................................................. 157
58 EX3000D dual node chassis configurations.................................................................................................... 158
59 EX3000 physical dimensions............................................................................................................................... 159
60 Server indicators, buttons, or connectors....................................................................................................... 162
61 Server indicators, buttons, or connectors....................................................................................................... 166
62 EX3000S PDU cabling.......................................................................................................................................... 168
63 EX3000D PDU cabling.......................................................................................................................................... 168
64 EX3000S node iDRAC port to BE1 port mapping...........................................................................................178
65 EX3000D node iDRAC port to BE1 port mapping.......................................................................................... 180
66 Legend for Back-end switch, front-end switch, and iDRAC ports on EX3000S node......................... 184
Tables 9
Notes, cautions, and warnings
NOTE: A NOTE indicates important information that helps you make better use of your product.
CAUTION: A CAUTION indicates either potential damage to hardware or loss of data and tells you how to avoid
the problem.
WARNING: A WARNING indicates a potential for property damage, personal injury, or death.
© 2022 Dell Inc. or its subsidiaries. All rights reserved. Dell Technologies, Dell, and other trademarks are trademarks of Dell Inc. or its
subsidiaries. Other trademarks may be trademarks of their respective owners.
Revision history
Table 1. Revision history
Revision Date Description of change
September 2019 Rev1.0. Initial release of document for EX500 release.
June 2021 Rev 1.1 Updates for 16 TB support on ECS version 3.5 and 2 TB and 4 TB support on ECS
version 3.7.
July 2022 Rev 1.2 Updates for S5248F-ON Switch qualification.
September 2022 Rev 1.3 Updates for 20TB/192GB memory support.
January 2023 Rev 1.4 Updates to change QSFP28 in EX500 servers.
Revision history 11
1
EX-Series Hardware Overview
Topics:
• Introduction
• Rack and node host names
Introduction
This guide describes the hardware components that make up the ECS appliance Generation 3 (Gen3) hardware models.
Hardware generations
ECS appliances are characterized by hardware generation.
Gen3
● EX5000 Gen3 models featuring 16 TB disks (5U ultra dense storage chassis with single or dual node configurations). Lower
1U contains 1x or 2x server sleds and 2x expander modules and the top 4U for 100x 3.5” SATA HDDs, with up to 50 disks per
compute sled. ECS 3.7 and later support this hardware configuration.
● EXF900 Gen 3 models featuring 3.84 TB NVMe SSD became available in November of 2020. ECS 3.6 and later support this
hardware configuration and ECS 3.6.1 and later supports 7.68TB and 15.36TB NVMe SSDs.
● EX500 Gen3 models featuring 2 TB, 4 TB, 8 TB, 12 TB, 16 TB or 20 TB disks (12 or 24 x HDD per node) became available in
September 2019. ECS 3.5 and later supports 16 TB data drives and optional Read Cache SSD upgrade. ECS 3.7 supports 20
TB disks.
Table 2. Rack ID
Rack ID Rack color Rack ID Rack color Rack ID Rack color
1 red 18 carmine 35 cornsilk
2 green 19 auburn 36 ochre
3 blue 20 bronze 37 lavender
4 yellow 21 apricot 38 ginger
5 magenta 22 jasmine 39 ivory
6 cyan 23 army 40 carnelian
7 azure 24 copper 41 taupe
8 violet 25 amaranth 42 navy
9 rose 26 mint 43 indigo
10 orange 27 cobalt 44 veronica
11 chartreuse 28 fern 45 citron
12 pink 29 sienna 46 sand
13 brown 30 mantis 47 russet
14 white 31 denim 48 brick
15 gray 32 aquamarine 49 avocado
16 beige 33 baby 50 bubblegum
17 silver 34 eggplant
Nodes are assigned node names based on their order within the server chassis and within the rack itself. The following table lists
the default node names.
Nodes that are positioned in the same slot in different racks at a site have the same node name. For example, node 4 is called
ogden, assuming that you use the default node names.
The getrackinfo command identifies nodes by a unique combination of node name and rack name. For example, node
4 in rack 1 is identified as ogden-red and can be pinged using its NAN resolvable (through mDNS) name: ogden-
red.nan.local.
Switches 15
Figure 2. Front-end switches
16 Switches
Figure 3. Back-end switches
Switches 17
● Rabbit (FE1) to Hound (BE2)
The connections are shown with green lines in the following diagram.
Figure 4. Connections between front-end and back-end switches within an EX-Series rack
For back-end switch connections between EX-Series racks, port 41 is used for the inbound connection and port 45 is used for
the outbound connection. These ports are used for linear and ring topology rack-to-rack connectivity. For more information,
seeNetwork connections between multiple ECS appliances in a single site .
18 Switches
Figure 6. Front-end switch connections to customer switches (example)
Switches 19
Customers can use their own front-end switch pair (25 GbE for EXF900, EX500, EX300, EX3000, and EX5000). In this case,
the customer must provide the appropriate switches, VLT cables, SFPs, or external connection cables.
CAUTION: It is required to have connections from the customer's network to both front-end switches (rabbit
and hare) in order to maintain the high availability architecture of the ECS appliance. If the customer chooses
not to connect to their network in the required HA manner, there is no guarantee of high data availability for the
use of this product.
20 Switches
Figure 9. Front-end switch connections to customer switches (4X10 example)
Switches 21
Figure 11. Front-end switch connections to customer switches (4X100 example)
22 Switches
Table 7. Switch port number (continued)
Switch Port number Description
53-56 Uplink to Falcon aggregation switch (EXF900 only) (100 GbE).
Fox 1-16 Private network ports connected to nodes (25 GbE).
17-32 iDRAC ports.
33 To Rabbit (FE1) switch.
34 To service tray in front.
35 To Hare (FE2) switch.
36 Open for rear service connectivity.
37-38 These are not designated.
39 In from Gen2 Turtle switch.
40 Out to Gen2 Turtle switch.
41-44 In from EX-Series rack when the ECS system has more than one rack (25 GbE).
45-48 Out to EX-Series rack when the ECS system has more than one rack (25 GbE).
49-52 VLT ports (2 x 200 GbE).
53-56 Uplink to Eagle aggregation switch (EXF900 only) (100 GbE).
Switches 23
Figure 13. Connections between front-end and back-end switches within an EX-Series rack
24 Switches
Table 8. Switch port number
Switch Port number Description
Falcon 1-4 Rack1 Hound uplink ports
5-8 Rack2 Hound uplink ports
9-12 Rack3 Hound uplink ports
13-16 Rack4 Hound uplink ports
17-20 Rack5 Hound uplink ports
21-24 Rack6 Hound uplink ports
25-28 Rack7 Hound uplink ports
29-32 VLT
33-34 Unused
Eagle 1-4 Rack1 Fox uplink ports
5-8 Rack2 Fox uplink ports
9-12 Rack3 Fox uplink ports
13-16 Rack4 Fox uplink ports
17-20 Rack5 Fox uplink ports
21-24 Rack6 Fox uplink ports
25-28 Rack7 Fox uplink ports
29-32 VLT
33-34 Unused
NOTE: It is recommended to connect the aggregation connections between the rack back-end and the aggregation
switches in sequential order to maintain consistency across customer sites. For example, for Rack 2 Aggregation Cabling:
● Fox 53 -> Eagle 5
● Fox 54 -> Eagle 6
● Fox 55 -> Eagle 7
● Fox 56 -> Eagle 8
● Hound 53 -> Falcon 5
● Hound 54 -> Falcon 6
● Hound 55 -> Falcon 7
● Hound 56 -> Falcon 8
NOTE: The private.4 network is also called as the Nile Area Network (NAN).
The ECS intrarack backend management networks are connected together to create the interrack topology. The interrack
network is created by connecting either port channel 100 or 101 to another private switch from another ECS intrarack network.
Through these connections, nodes from any intrarack network can communicate to any other node on the interrack network.
There are three types of topologies that you can use to connect the intrarack LANs into an interrack network:
● Daisy chain or line topology
Switches 25
● Ring topology
● Star topology
This linear or daisy-chain topology is the least dependable setup and is susceptible to split-brain topologies as demonstrated
below.
The interrack linear topology between EX-Series racks is shown in the following figure.
Figure 16. Inter-rack switch connectivity - linear topology (daisy-chain) between EX Series racks
The interrack linear topology between an EX-Series rack and a Gen2 rack is shown in the following figure. For a mixed Gen2 and
Gen3 environment, use Turtle switch port 51 for inbound, and port 52 for outbound. On the Gen3 Fox switch, use port 39 for
inbound and port 40 for outbound. This is a requirement for mixing Gen2 and Gen3 racks in the same VDC. Ports 39 and 40 are
not used in an all Gen3 environment with EX-Series racks.
26 Switches
Figure 17. Inter-rack switch connectivity - linear topology (daisy-chain) between an EX-Series rack and a Gen2
U-Series, D-Series, or C-Series rack
Ring topology
For a more reliable network, the ends of the daisy chain topology can be connected together to create a ring network as
demonstrated below. The ring topology would require two physical link breaks in the topology to create split-brain issue in the
private.4 network.
The ring topology is similar to the daisy chain topology, except that it is more robust since it requires two points of failure to
break the topology which would cause a split-brain issue.
The interrack ring topology between EX-Series racks are shown in the following figure.
Switches 27
Figure 19. Inter-rack switch connectivity - ring topology
Star topology
The limitation with the daisy chain or ring topologies is that they do not scale well for large installations. For ten or more ECS
racks, one or two aggregation switches should be added support the large installation. For high availability, the recommended
topology is to use two aggregation switches with port channel (VLT, vPC, MLAG) connectivity between them. If you use a
single aggregation switch, both the Fox switch (BE1) and the Hound switch (BE2) are connected to the single switch. The
impact of using only one aggregation switch is the loss of high availability for the aggregation switch. For connectivity to
aggregation switches, use the inbound port 41 on each back-end switch to link to one or more aggregation switches.
By using aggregation switches to connect to all the intrarack networks, the star topology provides better protection against
the split-brain issue than both the daisy chain/linear or ring topologies. With aggregation switches, link failures are isolated to a
single intrarack network in the private.4 network.
The aggregation switches connecting to the intrarack networks must be set up as a trunk and allow VLAN traffic to flow
between all ports in the interrack network.
The interrack star topology between EX-Series racks are shown in the following figure.
28 Switches
Figure 21. Inter-rack switch connectivity - star topology
Switches 29
3
EX5000 Platform
Topics:
• EX5000 hardware components
• EX5000 configurations
• EX5000 upgrade paths
• EX5000 server
• EX5000 disk drives
• EX5000 power cabling
• EX5000 iDRAC cabling
• EX5000 network cabling
• EX5000 Cable Kits
30 EX5000 Platform
Table 9. EX5000 hardware components (continued)
Component Description
■ 12x16GB RDIMM, 2933MT/s, Dual Rank, x8 data width
○ H730p Controller
■ For OS and cache drives only
○ 2xHBA355i
■ For data disks only
○ Mellanox ConnectX 4 LX 2x25GbE PCIe NIC card
○ Broadcom BCM57414 2x25GbE OCP2.0 Mezz card
○ iDRAC9 Enterprise
EX5000D ● 5U chassis
○ Lower 1U to contain 2x server sleds and 2x expander modules
○ Top 4U for 100x 3.5” SAS/SATA HDDs
■ Up to 50 disks per compute sled
○ Four 7mm drive slots
■ One 960GB RI SATA drive for OS per compute sled
■ Two 960GB MU SATA drive for caching per compute sled
● Two XE7420 half-width compute sleds. Each of the half-width compute sleds contains the
following configurations:
○ Dual 26 core Cascade Lake CPUs, 192 GB memory
■ Xeon Gold 6230 R 26 core/52 thread 35.75 MB L3, 2.1 GHz base, 4.0 GHz Turbo, 150 W
■ 12x16GB RDIMM, 2933MT/s, Dual Rank, x8 data width
○ H730p Controller
■ For OS and cache drives only
○ HBA355i
■ For data disks only
○ Mellanox ConnectX 4 LX 2x25GbE PCIe NIC card
○ Broadcom BCM57414 2x25GbE OCP2.0 Mezz card
○ iDRAC9 Enterprise
EX5000 configurations
This section describes the EX5000 ECS appliance configurations.
The front views of an EX5000S appliance and an EX5000D appliance in both Dell Technologies and customer-provided racks
with the minimum and maximum node configurations are shown in the following diagrams. There are five SKUs of EX5000
nodes, all have the same configuration except for their drive load and number of nodes.
NOTE: EX5000S and EX5000D chassis cannot be mixed within a customer-provided rack or Dell 42U rack due to minimum
chassis requirements per rack for software data protection.
● EX5000S contains a single node chassis with 25 to 50 to 75 to 100 drives with 16 TB HDDs
○ Minimum five nodes are required at deployment and supports one-node increments.
○ This appliance is always sold with the backend S5248F Dual Dell 25 Gb Switches
○ The front-end S5248F Dual Dell 25 Gb Switches are optional
●
● EX5000D contains dual node chassis with 50 to 100 drives with 16 TB HDDs
○ Minimum eight nodes (four chassis) are required at deployment and supports one-node increments (one chassis).
○ This appliance is always sold with the back-end S5248F Dual Dell 25 Gb Switches
■ The front-end S5248F Dual Dell 25 Gb Switches are optional
EX5000 Platform 31
Figure 23. EX5000 maximum configurations for dual and single node chassis
32 EX5000 Platform
Figure 24. EX5000 minimum configurations for dual and single node chassis
EX5000 Platform 33
The EX5000 appliance is available in the following configurations in both Dell Technologies and customer-provided rack.
34 EX5000 Platform
EX5000 server
This topic describes the features of EX5000 server.
The EX5000 5U server contains the EX5000 chassis and either one server sled (in the EX5000S single node configuration) or
two server sleds (in the EX5000D dual node configuration). EX5000 servers have the following standard features:
EX5000 Platform 35
Figure 25. EX5000 disk drive in carrier
1 - Release button
2 - 3.5-inch hard drive
3 - hard drive carrier handle
4 - hard drive carrier
NOTE: The light bar adapter sub has been added. 071-000-210-00 is the sub for 071-000-253-00; 071-000-211-00 is the
sub for 071-000-254-00.
The following diagram shows the Gen4 0U PDU's outlet numbers for Zone A and Zone B.
WARNING: Only a trained personnel must pair the PDU AC input cable with the PDU Anderson power input
connector. PDU is not a Hot-Swapable unit, so it must disconnect main power before servicing (plugging or
removing) input power cable with Anderson connector to the PDU.
36 EX5000 Platform
Figure 26. Power PDU Mapping
The EX5000 appliance connections to Gen4 0U PDU's outlets are listed in the following tables.
EX5000 Platform 37
Figure 27. EX5000 single-phase AC power cabling
38 EX5000 Platform
Figure 28. EX5000 single-phase AC power cabling Line 1 cord Maximum Configuration
EX5000 Platform 39
Figure 29. EX5000 single-phase AC power cabling Line 2 cord Maximum Configuration
40 EX5000 Platform
Figure 30. EX5000 single-phase AC power cabling Line 3 cord Maximum Configuration
EX5000 Platform 41
Three-phase AC power cabling
The legends in the following diagrams map colored cables to part numbers and cable lengths.
42 EX5000 Platform
Figure 31. EX5000 three-phase delta AC power cabling
EX5000 Platform 43
Figure 32. EX5000 three-phase delta AC power cabling Line 1 cord Maximum Configuration
44 EX5000 Platform
Figure 33. EX5000 three-phase WYE AC power cabling
EX5000 Platform 45
Figure 34. EX5000 three-phase WYE AC power cabling Line 1 cord Maximum Configuration
46 EX5000 Platform
Figure 35. EX5000 three-phase WYE AC power cabling Line 1 cord Maximum Configuration
EX5000 Platform 47
EX5000 iDRAC cabling
This section provides wiring diagrams for the iDRAC cables that connect the iDRAC port on the node to the Fox back-end
switch for the EX5000S system (single node chassis configuration) and the EX5000D system (dual node chassis configuration).
The EX5000S node iDRAC port to the Fox switch (BE1) port connections are listed in the following table.
48 EX5000 Platform
Figure 36. EX5000S single node iDRAC cabling
EX5000 Platform 49
The EX5000D node iDRAC port to the Fox switch (BE1) port connections are listed in the following table.
Table 15. EX5000D dual node iDRAC port to BE1 port mapping
Node 1 iDRAC port (chassis 1) BE1 Port 17
Node 2 iDRAC port (chassis 1) BE1 Port 18
Node 3 iDRAC port (chassis 2) BE1 Port 19
Node 4 iDRAC port (chassis 2) BE1 Port 20
Node 5 iDRAC port (chassis 3) BE1 Port 21
Node 6 iDRAC port (chassis 3) BE1 Port 22
Node 7 iDRAC port (chassis 4) BE1 Port 23
Node 8 iDRAC port (chassis 4) BE1 Port 24
Node 9 iDRAC port (chassis 5) BE1 Port 25
Node 10 iDRAC port (chassis 5) BE1 Port 26
Node 11 iDRAC port (chassis 6) BE1 Port 27
Node 12 iDRAC port (chassis 6) BE1 Port 28
Node 13 iDRAC port (chassis 7) BE1 Port 29
Node 14 iDRAC port (chassis 7) BE1 Port 30
50 EX5000 Platform
Figure 37. EX5000D dual node iDRAC cabling
EX5000 Platform 51
EX5000 network cabling
The network cabling diagrams apply to the EX5000 appliance in a Dell Technologies or customer-provided rack.
Customers connect to an EX5000 appliance by way of 25 GbE ports on the front-end switches. For an EX5000 appliance, the
25GbE ports run at 25GbE. Customer configurations can include 25 GbE front-end switches provided by Dell Technologies or
customers may provide their own front-end switches.
To distinguish between the two front-end switches and the two back-end switches, each switch has a nickname:
● Hare: The top S5248F 1U 25 GbE front-end switch running 25 GbE SFP28 ports to the EX5000 nodes.
● Rabbit: The bottom S5248F 1U 25 GbE front-end switch running 25 GbE SFP28 ports to the EX5000 nodes.
● Hound: The top S5248F 1U 25 GbE back-end switch running 25 GbE SFP28 ports to the EX5000 nodes.
● Fox: The bottom S5248F 1U 25 GbE back-end switch running 25 GbE SFP28 ports to the EX5000 nodes.
The front-end switch and back-end switch connections to an EX5000 node are shown in the following diagram.
The numbered front-end switch ports used for connecting to the ports on the EX5000 nodes are shown in the following
diagram. Port 1 on the Hare switch (FE2) connects to port 4 on Node 1. Port 2 on the Hare switch (FE2) connects to port 4 on
Node 2, and so on. Similarly, Port 1 on the Rabbit switch (FE1) connects to port 3 on Node 1. Port 2 on the Rabbit switch (FE1)
connects to port 3 on Node 2, and so on.
52 EX5000 Platform
Figure 39. Back-end switch, front-end switch, and iDRAC ports on an EX5000S node
EX5000 Platform 53
Figure 40. Back-end switch, front-end switch, and iDRAC ports on an EX5000D node
54 EX5000 Platform
The numbered back-end switch ports used for connecting to the ports on the EX5000 nodes are shown in the following
diagram. Port 1 on the Hound switch (BE2) connects to port 2 on Node 1. Port 2 on the Hound switch (BE2) connects to port
2 on Node 2, and so on. Similarly, Port 1 on the Fox switch (BE1) connects to port 1 on Node 1. Port 2 on the Fox switch (BE1)
connects to port 1 on Node 2, and so on.
The EX5000 node port to the iDRAC, back-end switch, and front-end switch port connections are listed in the following table.
NOTE:
● EX5000S only uses nodes 1-7 in the outlined table.
● EX5000D only uses nodes 1-14 in the outlined table.
The EX5000 node network cable labeling is listed in the following table.
EX5000 Platform 55
Figure 43. EX5000 node network cable labeling
56 EX5000 Platform
Figure 44. ECS EX5000S Dell Provided Switch/Network cabling
EX5000 Platform 57
Figure 45. ECS EX5000S Customer Provided Switch/Network cabling
58 EX5000 Platform
Figure 46. ECS EX5000D Dell Provided Switch/Network cabling
EX5000 Platform 59
Figure 47. ECS EX5000D Customer Provided Switch/Network cabling
60 EX5000 Platform
EX5000 Cable Kits
Learn about the cable kits required for the EX5000 system.
NOTE: If an EX5000S or EX5000D is more than a chassis length from the switches, the 5M length kits are recommended
because up to 1.5M of cable length is used in the cable management arm.
NOTE: Front-end cable kits not required when customer provides front-end switches.25 GbE Optics are available for the
servers when customer- provided switches are installed.
NOTE: If an EX5000S or EX5000D is more than a chassis length from the switches, the 5M length kits are recommended
because up to 1.5M of cable length is used in the cable management arm.
EX5000 Platform 61
Table 18. Speed and model details (continued)
Speed Model
ES6-100GB-QSA
62 EX5000 Platform
4
EXF900 Platform
Topics:
• EXF900 hardware components
• EXF900 configurations
• EXF900 server
• EXF900 Upgrade Paths
• EXF900 disk drives
• EXF900 power cabling
• EXF900 iDRAC cabling
• EXF900 network cabling
• EXF900 Cable Kits
• Aggregated EXF900 back-end network between multiple racks
EXF900 Platform 63
Table 19. EXF900 hardware components (continued)
Component Description
● Each node has 4 x 25 GbE networking.
EXF900 configurations
This section describes the EXF900 ECS appliance configurations.
The following diagram shows the front view of an EXF900 rack with the minimum node configuration and an EXF900 rack with
the maximum node configuration. The rear view requires a brace wherever there is empty space above or below an EXF900
server.
The EXF900 appliance is available in the following configurations within a Dell Technologies rack or a customer-provided rack.
64 EXF900 Platform
Table 20. EXF900 configurations
Nodes Disks in each node Disk size RAW storage capacity
5 (minimum configuration) 12 3.84 TB 230 TB
24 3.84 TB 460 TB
12 7.68 TB 460 TB
24 7.68 TB 921 TB
12 15.36 TB 921 TB
24 15.36 TB 1843 TB
6 12 3.84 TB 276 TB
24 3.84 TB 552 TB
12 7.68 TB 552 TB
24 7.68 TB 1105 TB
12 15.36 TB 1105 TB
24 15.36 TB 2211 TB
7 12 3.84 TB 322 TB
24 3.84 TB 645 TB
12 7.68 TB 645 TB
24 7.68 TB 1290 TB
12 15.36 TB 1290 TB
24 15.36 TB 2580 TB
8 12 3.84 TB 368 TB
24 3.84 TB 737 TB
12 7.68 TB 737 TB
24 7.68 TB 1474 TB
12 15.36 TB 1474 TB
24 15.36 TB 2949 TB
9 12 3.84 TB 414 TB
24 3.84 TB 829 TB
12 7.68 TB 829 TB
24 7.68 TB 1658 TB
12 15.36 TB 1658 TB
24 15.36 TB 3317 TB
10 12 3.84 TB 460 TB
24 3.84 TB 921 TB
12 7.68 TB 921 TB
24 7.68 TB 1843 TB
12 15.36 TB 1843 TB
24 15.36 TB 3686 TB
11 12 3.84 TB 506 TB
EXF900 Platform 65
Table 20. EXF900 configurations (continued)
Nodes Disks in each node Disk size RAW storage capacity
24 3.84 TB 1013 TB
12 7.68 TB 1013 TB
24 7.68 TB 2027 TB
12 15.36 TB 2027 TB
24 15.36 TB 4055 TB
12 12 3.84 TB 552 TB
24 3.84 TB 1105 TB
12 7.68 TB 1105 TB
24 7.68 TB 2211 TB
12 15.36 TB 2211 TB
24 15.36 TB 4423 TB
13 12 3.84 TB 599 TB
24 3.84 TB 1198 TB
12 7.68 TB 1198 TB
24 7.68 TB 2396 TB
12 15.36 TB 2396 TB
24 15.36 TB 4792 TB
14 12 3.84 TB 645 TB
24 3.84 TB 1290 TB
12 7.68 TB 1290 TB
24 7.68 TB 2580 TB
12 15.36 TB 2580 TB
24 15.36 TB 5160 TB
15 12 3.84 TB 601 TB
24 3.84 TB 1382 TB
12 7.68 TB 1382 TB
24 7.68 TB 2764 TB
12 15.36 TB 2764 TB
24 15.36 TB 5529 TB
16 (maximum configuration) 12 3.84 TB 737 TB
24 3.84 TB 1474 TB
12 7.68 TB 1474 TB
24 7.68 TB 2949 TB
12 15.36 TB 2949 TB
24 15.36 TB 5898 TB
66 EXF900 Platform
EXF900 server
EXF900 servers have the following standard features:
EXF900 Platform 67
Server front view
This section helps you understand the front view of the server.
The following figure shows the EXF900 2U server chassis front with (12 / 24) x 2.5" NVMe SSDs.
LED indicators are on the left and right side of the server front panels.
The left control panel LED behavior is broken into two subsets, the light bar and the status LEDs. The light bar also functions as
a button. The light bar indicates chassis health and also functions as System ID when pressed.
68 EXF900 Platform
Table 22. Decoding of LEDs in light bar (continued)
Status ID button
Fault Blink Amber
System ID Blink Blue
There are five status LEDs to indicate and identify any failed hardware components.
EXF900 Platform 69
Figure 55. EXF900 server chassis rear view
70 EXF900 Platform
For example, you have an EXF900 appliance with five nodes containing 24 x 3.84 TB drives. If you want to add nodes of
different drive size (12 x 3.84 TB), you must add five or more nodes, at a time.
NOTE: All drives within a node must be of the same drive size, but there can be nodes of differing drive sizes within a rack.
● Disk upgrade kits are available in 12-disk increments.
● EXF900 upgrades from 12 to 24 disks.
● To add the disk capacity to an EXF900 appliance, disk upgrade kits per node must be ordered based on the existing disk
capacity.
● All empty drive slots must be filled with a disk filler.
EXF900 Platform 71
● EXF900 2U Single-Phase PDU
○ Standard
○ With aggregation switch
● EXF900 2U Three-Phase PDU
○ Standard
○ With aggregation switch
72 EXF900 Platform
Table 24. EXF900 Standard Single-Phase 0U PDU Cabling (continued)
PDU Outlet Component Line cord per zone
4 Node 3 1
3 Empty 1
2 Node 2 1
1 Node 1 1
In the following diagrams, the switches plug into the front of the rack and route through the rails to the rear.
EXF900 Platform 73
Figure 57. EXF900 Standard Single-Phase AC 0U Cabling
74 EXF900 Platform
Table 25. EXF900 0U PDU Cabling with Aggregation Switch
PDU Outlet Component Line cord per zone
37 Empty 4
36 Empty 4
35 Node 15 4
34 Node 14 4
33 Empty 4
32 Node 13 4
31 Node 12 4
30 Empty 3
29 Node 11 3
28 Node 10 3
27 Empty 3
26 Node 9 3
25 Node 8 3
24 Empty 2
23 AGG SW2 2
22 AGG SW1 2
21 Empty 2
20 Empty 2
19 Node 7 2
18 Empty 2
17 Node 6 2
16 Node 5 2
15 Empty 2
14 FE SW2 2
13 FE SW1 2
12 Zone B Service Tray/Zone A Light Bar 1
11 BE SW 2 1
10 BE SW 1 1
9 Empty 1
8 Empty 1
7 Empty 1
6 Empty 1
5 Node 4 1
4 Node 3 1
3 Empty 1
2 Node 2 1
1 Node 1 1
EXF900 Platform 75
Figure 58. EXF900 Single-Phase 0U Cabling with Aggregation Switch
76 EXF900 Platform
Table 26. EXF900 Standard 0U Three-Phase PDU Cabling
PDU Outlet Component Line cord per zone
37 Empty 2
36 Empty 2
35 Empty 2
34 Empty 2
33 Empty 2
32 Empty 2
31 Empty 2
30 Empty 2
29 Empty 2
28 Empty 2
27 Empty 2
26 Node 16 2
25 Node 15 2
24 Empty 2
23 Node 14 2
22 Node 13 2
21 Empty 2
20 Node 12 2
19 Node 11 2
18 Empty 1
17 Node 10 1
16 Node 9 1
15 Node 8 1
14 Empty 1
13 Empty 1
12 FE SW2 1
11 FE SW1 1
10 Zone B Service Tray/Zone A Light Bar 1
9 BE SW 2 1
8 BE SW 1 1
7 Node 7 1
6 Node 6 1
5 Node 5 1
4 Node 4 1
3 Node 3 1
2 Node 2 1
1 Node 1 1
EXF900 Platform 77
Figure 59. EXF900 Standard Delta 0U Cabling
78 EXF900 Platform
Figure 60. EXF900 Standard Three-Phase WYE 0U Cabling
EXF900 Platform 79
Table 27. EXF900 Three-Phase 0U Cabling with Aggregation Switch
PDU Outlet Component Line cord per zone
37 Empty 2
36 Empty 2
35 Empty 2
34 Empty 2
33 Empty 2
32 Empty 2
31 Empty 2
30 Empty 2
29 Empty 2
28 Empty 2
27 Empty 2
26 Node 15 2
25 Node 14 2
24 Empty 2
23 Node 13 2
22 Node 12 2
21 Empty 2
20 Node 11 2
19 Node 10 2
18 Empty 1
17 Node 9 1
16 Node 8 1
15 Empty 1
14 AGG SW2 1
13 AGG SW1 1
12 FE SW2 1
11 FE SW1 1
10 Zone B Service Tray/Zone A Light Bar 1
9 BE SW 2 1
8 BE SW 1 1
7 Node 7 1
6 Node 6 1
5 Node 5 1
4 Node 4 1
3 Node 3 1
2 Node 2 1
1 Node 1 1
80 EXF900 Platform
Figure 61. EXF900 Three-Phase Delta 0U PDU with Aggregation Switch AC Cabling
EXF900 Platform 81
Figure 62. EXF900 Three-Phase WYE 0U PDU with Aggregation Switch AC Cabling
82 EXF900 Platform
Table 28. EXF900 Standard Single-Phase 2U PDU Cabling
PDU Outlet Component Line cord per zone
PDU2 16 Node 14 4
PDU2 15 Node 13 4
PDU2 14 Empty 4
PDU2 13 Empty 4
PDU2 4 Node 16 4
PDU2 3 Node 15 4
PDU2 2 Empty 4
PDU2 1 Empty 4
PDU1 24 Node 12 3
PDU1 23 Node 11 3
PDU1 22 Empty 3
PDU1 21 Empty 3
PDU1 20 Node 8 2
PDU1 19 Node 7 2
PDU1 18 Empty 2
PDU1 17 Empty 2
PDU1 16 Node 4 1
PDU1 15 Node 3 1
PDU1 14 Empty 1
PDU1 13 Zone B Service Tray/Zone A Light Bar 1
PDU1 12 Node 10 3
PDU1 11 Node 9 3
PDU1 10 Empty 3
PDU1 9 Empty 3
PDU1 8 Node 6 2
PDU1 7 Node 5 2
PDU1 6 FE SW2 2
PDU1 5 FE SW1 2
PDU1 4 Node 2 1
PDU1 3 Node 1 1
PDU1 2 BE SW2 1
PDU1 1 BE SW1 1
EXF900 Platform 83
Figure 63. EXF900 Standard Single-Phase 2U PDU AC Cabling
84 EXF900 Platform
Table 29. EXF900 Single-Phase 2U PDU Cabling with Aggregation Switch
PDU Outlet Component Line cord per zone
PDU2 16 Node 13 4
PDU2 15 Node 12 4
PDU2 14 Empty 4
PDU2 13 Empty 4
PDU2 4 Node 15 4
PDU2 3 Node 14 4
PDU2 2 Empty 4
PDU2 1 Empty 4
PDU1 24 Node 11 3
PDU1 23 Node 10 3
PDU1 22 Empty 3
PDU1 21 Empty 3
PDU1 20 Empty 2
PDU1 19 Node 7 2
PDU1 18 AGG SW2 2
PDU1 17 AGG SW1 2
PDU1 16 Node 4 1
PDU1 15 Node 3 1
PDU1 14 Empty 1
PDU1 13 Zone B Service Tray/Zone A Light Bar 1
PDU1 12 Node 9 3
PDU1 11 Node 8 3
PDU1 10 Empty 3
PDU1 9 Empty 3
PDU1 8 Node 6 2
PDU1 7 Node 5 2
PDU1 6 FE SW2 2
PDU1 5 FE SW1 2
PDU1 4 Node 2 1
PDU1 3 Node 1 1
PDU1 2 BE SW2 1
PDU1 1 BE SW1 1
EXF900 Platform 85
Figure 64. EXF900 Single-Phase 2U PDU Cabling with Aggregation Switch
86 EXF900 Platform
Table 30. EXF900 Standard Three-Phase 2U PDU Cabling
PDU Outlet Component Line cord per zone
PDU2 16 Node 14 2
PDU2 15 Node 13 2
PDU2 14 Empty 2
PDU2 13 Empty 2
PDU2 4 Node 16 2
PDU2 3 Node 15 2
PDU2 2 Empty 2
PDU2 1 Empty 2
PDU1 24 Node 12 1
PDU1 23 Node 11 1
PDU1 22 Empty 1
PDU1 21 Empty 1
PDU1 20 Node 8 1
PDU1 19 Node 7 1
PDU1 18 Empty 1
PDU1 17 Empty 1
PDU1 16 Node 4 1
PDU1 15 Node 3 1
PDU1 14 Empty 1
PDU1 13 Zone B Service Tray/Zone A Light Bar 1
PDU1 12 Node 10 1
PDU1 11 Node 9 1
PDU1 10 Empty 1
PDU1 9 Empty 1
PDU1 8 Node 6 1
PDU1 7 Node 5 1
PDU1 6 FE SW2 1
PDU1 5 FE SW1 1
PDU1 4 Node 2 1
PDU1 3 Node 1 1
PDU1 2 BE SW2 1
PDU1 1 BE SW1 1
EXF900 Platform 87
Figure 65. EXF900 Standard Three-Phase 2U PDU AC Cabling
88 EXF900 Platform
Table 31. EXF900 Three-Phase 2U PDU with Aggregation Switch Cabling
PDU Outlet Component Line cord per zone
PDU2 16 Node 13 2
PDU2 15 Node 12 2
PDU2 14 Empty 2
PDU2 13 Empty 2
PDU2 4 Node 15 2
PDU2 3 Node 14 2
PDU2 2 Empty 2
PDU2 1 Empty 2
PDU1 24 Node 11 1
PDU1 23 Node 10 1
PDU1 22 Empty 1
PDU1 21 Empty 1
PDU1 20 Empty 1
PDU1 19 Node 7 1
PDU1 18 AGG SW2 1
PDU1 17 AGG SW1 1
PDU1 16 Node 4 1
PDU1 15 Node 3 1
PDU1 14 Empty 1
PDU1 13 Zone B Service Tray/Zone A Light Bar 1
PDU1 12 Node 9 1
PDU1 11 Node 8 1
PDU1 10 Empty 1
PDU1 9 Empty 1
PDU1 8 Node 6 1
PDU1 7 Node 5 1
PDU1 6 FE SW2 1
PDU1 5 FE SW1 1
PDU1 4 Node 2 1
PDU1 3 Node 1 1
PDU1 2 BE SW2 1
PDU1 1 BE SW1 1
EXF900 Platform 89
Figure 66. EXF900 Three-Phase 2U PDU with Aggregation Switch AC Cabling
90 EXF900 Platform
EXF900 iDRAC cabling
This section provides wiring diagrams for the iDRAC cables that connect the iDRAC port on the node to the Fox back-end
switch.
The Fox switch (BE1) port numbers used for connecting to the iDRAC ports on the EXF900 nodes are shown in the following
diagram.
The EXF900 node iDRAC port to the Fox switch (BE1) port connections are listed in the following table.
EXF900 Platform 91
Figure 68. EXF900 iDRAC cabling
92 EXF900 Platform
EXF900 network cabling
The network cabling diagrams apply to the EXF900 appliance in a Dell Technologies or customer-provided rack.
Customers connect to an EXF900 appliance by way of 25 GbE ports on the front-end switches. For an EXF900 appliance, the
25GbE ports run at 25GbE. Customer configurations can include 25 GbE front-end switches provided by Dell Technologies or
customers may provide their own front-end switches.
To distinguish between the two front-end switches and the two back-end switches, each switch has a nickname:
● Hare: The top S5248F 1U 25 GbE front-end switch running 25 GbE SFP28 ports to EXF900 nodes.
● Rabbit: The bottom S5248F 1U 25 GbE front-end switch running 25 GbE SFP28 ports to EXF900 nodes.
● Hound: The top S5248F 1U 25 GbE back-end switch running 25 GbE SFP28 ports to the nodes.
● Fox: The bottom S5248F 1U 25 GbE back-end switch running 25 GbE SFP28 ports to the nodes.
The front-end switch and back-end switch connections to an EXF900 node are shown in the following diagram.
The numbered front-end switch ports used for connecting to the ports on the EXF900 nodes are shown in the following
diagram. Port 1 on the Hare switch (FE2) connects to port 4 on Node 1. Port 2 on the Hare switch (FE2) connects to port 4 on
Node 2, and so on. Similarly, Port 1 on the Rabbit switch (FE1) connects to port 3 on Node 1. Port 2 on the Rabbit switch (FE1)
connects to port 3 on Node 2, and so on.
EXF900 Platform 93
Figure 70. Node ports on front-end switches
Figure 71. Back-end switch, front-end switch, and iDRAC ports on an EXF900 node
The numbered back-end switch ports used for connecting to the ports on the EXF900 nodes are shown in the following
diagram. Port 1 on the Hound switch (BE2) connects to port 2 on Node 1. Port 2 on the Hound switch (BE2) connects to port
2 on Node 2, and so on. Similarly, Port 1 on the Fox switch (BE1) connects to port 1 on Node 1. Port 2 on the Fox switch (BE1)
connects to port 1 on Node 2, and so on.
The EXF900 node port to the iDRAC, back-end switch, and front-end switch port connections are listed in the following table.
94 EXF900 Platform
Figure 73. EXF900 node network port cabling connections
The EXF900 node network cable labeling is listed in the following table.
EXF900 Platform 95
Figure 75. ECS v3 EXF900 network cabling
96 EXF900 Platform
EXF900 Cable Kits
Learn about the cable kits required for the EXF900 system.
ES6-25-3M-BE-KTS
ES6-25-5M-BE-KTS
NOTE: Front-end cable kits not required when customer provides front-end switches.25 GbE Optics are available for the
servers when customer- provided switches are installed.
NOTE: For connections longer than 30M, it is recommended to purchase four 100Gb optics from the Customer Kits.
Customer can provide required optical cabling.
EXF900 Platform 97
Table 36. Speed and model details (continued)
Speed Model
10 Gb ES6-10GB-SR
ES6-10GB-LR
ES6-10GB-ER
25 Gb ES6-25GB-SR
ES6-25GB-LR
40 Gb ES6-40GB-SR4
ES6-40GB-LR4
100 Gb ES6-100GB-SR4
ES6-100GB-LR4
ES6-100GB-PSM4
ES6-100GB-QSA
NOTE: The private.4 network is also called as the Nile Area Network (NAN).
Ports 53 through 56 are used to create Port-Channel 110 on the Fox and Hound switches. The ports in Port-Channel 110 are
dedicated to connect to the back-end aggregation switches, Eagle, and Falcon.
NOTE: Only connection to other EXF900 nodes is allowed. EXF900 cannot join existing VDCs that include non-EXF900
nodes.
The ECS intrarack backend networks have typically been used for management purposes. New with the introduction of EXF900
is the creation of NVMe over Fabric (NVMe-oF). The EXF900 is the first release of a high performant ECS object storage
appliance. The ECS software uses an NVMe engine to configure local NVMe targets and establish NVMe-oF connections. High
performing and reliable connections to remote storage nodes are accomplished by having a dedicated high available network
using Ethernet-based RDMA as the transport fabric. The number of uplinks between each rack and the aggregation switches
ensures all the EXF900 nodes have line rate performance to any node in any rack. This setup allows for low latency and high
throughput across the entire cluster.
98 EXF900 Platform
Figure 76. Aggregation topology
The aggregation switches can be installed in the Dell Technologies rack or a customer provided rack. Customer must follow all
the recommended power rules that are outlined in the ECS EX900 Third-Party Rack Planning and Installation Guide.
For installation in a Dell Technologies rack, it is recommended to take the place of node 16 and rack Eagle and Falcon in U39 and
U40 respectively.
The aggregation switch allows you to connect up to seven racks of EXF900 nodes in the same cluster.
EXF900 Platform 99
Table 37. Aggregation port cabling (continued)
55 <-------------> 3
56 <-------------> 4
Fox Port Port Eagle
53 <-------------> 1
54 <-------------> 2
55 <-------------> 3
56 <-------------> 4
Rack 2 Hound Port Port Falcon Aggregation
Expansion Switches
53 <-------------> 5
54 <-------------> 6
55 <-------------> 7
56 <-------------> 8
Fox Port Port Eagle
53 <-------------> 5
54 <-------------> 6
55 <-------------> 7
56 <-------------> 8
Rack 3 Hound Port Port Falcon Aggregation
Expansion Switches
53 <-------------> 9
54 <-------------> 10
55 <-------------> 11
56 <-------------> 12
Fox Port Port Eagle
53 <-------------> 9
54 <-------------> 10
55 <-------------> 11
56 <-------------> 12
Rack 4 Hound Port Port Falcon Aggregation
Expansion Switches
53 <-------------> 13
54 <-------------> 14
55 <-------------> 15
56 <-------------> 16
Fox Port Port Eagle
53 <-------------> 13
54 <-------------> 14
55 <-------------> 15
56 <-------------> 16
Rack 5 Hound Port Port Falcon Aggregation
Expansion Switches
NOTE: All drives within a node must be of the same drive size, but there can be nodes of differing drive sizes within a rack.
EX500 server
Learn about the standard features of EX500 server.
The left control panel LED behavior is broken into two subsets, the light bar and the status LEDs. The light bar also functions as
a button. The light bar indicates chassis health and also functions as System ID when pressed.
There are two status LEDs to indicate and identify any failed hardware components.
1. Power button
2. USB 2.0-compliant port
3. Micro-USB for iDRAC Direct
4. iDRAC LED indicator
Table 44. EX500 PDU three-phase Delta and WYE zone A/B mapping
PDU outlet Branch Component Line cord per zone
37 12 Empty 1
36 12 Empty 1
35 12 Empty 1
34 12 Empty 1
33 11 Empty 1
32 11 Empty 1
31 11 Empty 1
30 10 Empty 1
Table 46. EX500 2U PDU three-phase Delta and WYE zone A/B mapping
PDU outlet Branch Component Line cord per zone
24 6 Empty 1
23 6 Empty 1
22 6 Empty 1
21 6 Node 16 1
20 5 Node 11 1
19 5 Node 10 1
18 5 Node 9 1
17 5 Node 8 1
16 4 Node 4 1
15 4 Node 3 1
14 4 FE Switch2 1
13 4 FE Switch 1 1
12 3 Node 15 1
11 3 Node 14 1
10 3 Node 13 1
9 3 Node 12 1
8 2 Tray/Light Bar 1
In the following diagrams, the switches plug into the front of the rack and route through the rails to the rear.
NOTE: The connections to the Fox switch are incorrect. The iDRAC connection to the Fox switch should connect to ports
17-32, NIC Port 1 should connect to ports 1-16.
The numbered front-end switch ports used for connecting to the ports on the EX500 nodes are shown in the following diagram.
Port 1 on the Hare switch (FE2) connects to port 4 on Node 1. Port 2 on the Hare switch (FE2) connects to port 4 on Node 2,
and so on. Similarly, Port 1 on the Rabbit switch (FE1) connects to port 3 on Node 1. Port 2 on the Rabbit switch (FE1) connects
to port 3 on Node 2, and so on.
The numbered backend switch ports used for connecting to the ports on the EX500 nodes are shown in the following diagram.
Port 1 on the Hound switch (BE2) connects to port 2 on Node 1. Port 2 on the Hound switch (BE2) connects to port 2 on Node
The EX500 node port to the iDRAC, back-end switch, and front-end switch port connections are listed in the following table.
EX300 configurations
Describes the EX300 ECS appliance configurations.
The front view of an EX300 rack with the minimum node configuration and an EX300 rack with the maximum node configuration
is shown in the following diagram. The rear view requires a brace wherever there is empty space above or below an EX300
server.
The EX300 appliance is available in the following configurations within a Dell EMC rack or a customer-provided rack.
NOTE: All drives within a node must be of the same drive size, but there can be nodes of differing drive sizes within a rack.
EX300 server
EX300 servers have the following standard features:
LED indicators are on the left and right side of the server front panels.
The left control panel LED behavior is broken into two subsets, the light bar and the status LEDs. The light bar also functions as
a button. The light bar indicates chassis health and also functions as System ID when pressed.
There are five status LEDs to indicate and identify any failed hardware components.
In the following diagrams, the switches plug into the front of the rack and route through the rails to the rear.
The EX300 node iDRAC port to the Fox switch (BE1) port connections are listed in the following table.
The numbered front-end switch ports used for connecting to the ports on the EX300 nodes are shown in the following diagram.
Port 1 on the Hare switch (FE2) connects to port 4 on Node 1. Port 2 on the Hare switch (FE2) connects to port 4 on Node 2,
and so on. Similarly, Port 1 on the Rabbit switch (FE1) connects to port 3 on Node 1. Port 2 on the Rabbit switch (FE1) connects
to port 3 on Node 2, and so on.
Figure 119. Back-end switch, front-end switch, and iDRAC ports on an EX300 node
The numbered back-end switch ports used for connecting to the ports on the EX300 nodes are shown in the following diagram.
Port 1 on the Hound switch (BE2) connects to port 2 on Node 1. Port 2 on the Hound switch (BE2) connects to port 2 on Node
2, and so on. Similarly, Port 1 on the Fox switch (BE1) connects to port 1 on Node 1. Port 2 on the Fox switch (BE1) connects to
port 1 on Node 2, and so on.
The EX300 node port to the iDRAC, back-end switch, and front-end switch port connections are listed in the following table.
The EX300 node network cable labeling is listed in the following table.
EX3000 configurations
Describes the EX3000 ECS appliance configurations.
The front views of an EX3000S appliance and an EX3000D appliance in both DellEMC and customer-provided racks with the
minimum and maximum node configurations are shown in the following diagrams.
There are five SKUs of EX3000 nodes that all have the same configuration except for their drive load and number of nodes.
● EX3000S single node with 45, 60, or 90 12 TB or 16 TB HDDs
● EX3000D dual nodes with 60 or 90 12 TB or 16 TB HDDs total
EX3000S and EX3000D chassis cannot be mixed within a customer-provided rack.
The EX3000 appliance is available in the following configurations in both DellEMC and customer-provided rack.
NOTE: All drives within a node must be of the same drive size, but there can be nodes of differing drive sizes within a rack.
You can add drives to partially populated EX3000 nodes. The following drive upgrades are supported:
● Convert EX3000S-45 to EX3000S-60.
● Convert EX3000S-60 to EX3000S-90.
● Convert EX3000D-30 to EX3000D-45.
EX3000 server
This topic describes the features of EX3000 server.
The EX3000 4U server contains the EX3000 chassis and either one server sled (in the EX3000S single node configuration) or
two server sleds (in the EX3000D dual node configuration). EX3000 servers have the following standard features:
● One-node or two-node servers (4U) with two CPUs per node
● Dual 8-core Broadwell CPU per node. E5-2620v4 8-core/16-thread 2.1 GHz 20M cache 85 W
● 4x16GB RDIMM, 2400MT/s, Dual Rank, x8 Data Width
● One system disk per node (480 GB or 960 GB SSD)
● LED indicators for each node
● Dual hot-swap chassis power supplies per node
● One SAS adapter with two SAS ports per node
The EX3000 physical dimensions are listed in the following table.
1. Server sled (one or two depending on whether the EX3000 system is single- or dual-node chassis configuration)
2. Fan module (6)
3. 3.5-inch HDDs (up to 90)
4. PSU unit (2 for an EX3000S single node and 4 for an EX3000D dual node)
For the EX3000S single-node system, a dummy sled is installed over the bottom sled A compartment and there are air flow
covers over the two empty power supply slots.
6 System identification button ● The identification button can be used to locate a particular system
within a rack.
● Press to switch the system ID on and off.
● If the system stops responding during POST, press and hold the system
ID button for more than five seconds to enter BIOS progress mode.
10 System board status indicator If the system is on, and in good health, the indicator glows solid blue. The
indicator blinks amber if the system is in standby, and if any issue exists
(for example, a failed fan or hard drive).
11 Power button ● The power button controls the PSU output to the system.
● NOTE: On ACPI-compliant operating systems (OSs), turning off
the system using the power button causes the system to perform a
graceful shutdown before power to the system is turned off.
12 System identification button ● The identification button can be used to locate a particular system
within a rack.
● Press to switch the system ID on and off.
● If the system stops responding during POST, press and hold the system
ID button for more than five seconds to enter BIOS progress mode.
● To reset iDRAC (if not disabled in F2 iDRAC setup), press and hold the
button for more than 15 seconds.
NOTE: Items numbers 4, 5, 7, 11, 12, and 15 are not in use on EX3000.
NOTE:
● Features of sled B are for EX3000D dual-node systems only.
● A dummy sled (sled B) is installed over the sled A compartment and two dummy PSUs over the PSU slots for sled B in
the EX3000S single-node system.
NOTE: The 480 GB drive is going end of life in the Dell ordering system and is replaced with S4510 960GB SSD.
1 - Release button
2 - 3.5-inch hard drive
3 - hard drive carrier handle
4 - hard drive carrier
The EX3000S and EX3000D appliance connections to PDU outlets are listed in the following tables.
Each EX3000 install kit contains 93" black and gray power cables and 118" gray and black power cables. The 93'' and 118" cords
are sent with third party and Dell Technologies expansion nodes. However, Dell Technologies racks are shipped from the factory
with 93" AC cables. You should only use the appropriate length cable per the cabinet position being installed as shown in the
following diagrams. EX3000 systems shipped for a third-party rack require the extra 118" cables while Dell Technologies racks
only need the 93" cables. After you complete the power cabling for the EX3000 appliance, you will always have an extra pair of
unused power cables. In the following diagram, the switches plug into the front of the rack and route through the rails to the
rear.
The legends in the following diagrams map colored cables to part numbers and cable lengths.
The EX3000D node iDRAC port to the Fox switch (BE1) port connections are listed in the following table.
The front-end switch and back-end switch connections to an EX3000D node are shown in the following diagram.
The numbered front-end switch ports used for connecting to the ports on the EX3000 nodes are shown in the following
diagram. Port 1 on the Hare switch (FE2) connects to port 4 on Node 1. Port 2 on the Hare switch (FE2) connects to port 4 on
Node 2, and so on. Similarly, Port 1 on the Rabbit switch (FE1) connects to port 3 on Node 1. Port 2 on the Rabbit switch (FE1)
connects to port 3 on Node 2, and so on.
Figure 150. Back-end switch, front-end switch, and iDRAC ports on an EX3000S node
Table 66. Legend for Back-end switch, front-end switch, and iDRAC ports on EX3000S node
Legend Description
1 BE1 Fox switch port
2 BE2 Hound switch port
3 FE1 Rabbit switch port
4 FE2 Hare switch port
5 iDRAC Port
The numbered back-end switch ports used for connecting to the ports on the EX3000 nodes are shown in the following
diagram. Port 1 on the Hound switch (BE2) connects to port 2 on Node 1. Port 2 on the Hound switch (BE2) connects to port
2 on Node 2, and so on. Similarly, Port 1 on the Fox switch (BE1) connects to port 1 on Node 1. Port 2 on the Fox switch (BE1)
connects to port 1 on Node 2, and so on.
The EX3000 node port to the iDRAC, back-end switch, and front-end switch port connections are listed in the following table.
The EX3000 node network cable labeling is listed in the following table.
Document feedback
If you have any feedback or suggestions regarding this document, mailto:[email protected].
191
Index
A
Aggregation switch pair S5232F 24
B
Back-end switch pair 16, 22
E
EX300 disk drives 138
EX300 network cabling 149
EX300 power cabling 138
EX300 Upgrade Paths 134
EX3000 disk drives 167
EX3000 network cabling 182
EX3000 power cabling 168
EX3000 upgrade paths 159
EX500 disk drives 114
EX500 network cabling 123
EX500 power cabling 114
EX500 upgrade paths 109
EX5000 Cable Kits 61
EX5000 disk drives 35
EX5000 network cabling 52
EX5000 power cabling 36
EX5000 upgrade paths 34
EXF900 Cable Kits 97
EXF900 disk drives 71
EXF900 network cabling 93
EXF900 power cabling 71
EXF900 Upgrade Paths 70
F
Front-end and back-end switch connections 17, 23
Front-end switch pair 15
S
Server back view 113
Server front view 68, 110, 135, 160
Server rear view 69, 137, 164