Rack Power Distribution System
Rack Power Distribution System
Joe Prisco
Senior Technical Staff Member
IBM
#DATACENTERWORLD | DATACENTERWORLD.COM
#CPEXPO | CHANNELPARTNERSCONFERENCE.COM
Data Center World – Certified Vendor Neutral
#DATACENTERWORLD
DATACENTERWORLD.COM
Basic Electrical Power Terms
Reactive • Watts
Power (VAR) • Active power or usable electricity
• Heat output (BTU/hr = watts x 3.413)
• VAR (Volt Amps Reactive)
Apparent
Real Power Power (VA) • Imaginary power or wasted electricity
(Watts) • Stored in capacitors and inductors
• VA (Volt Amps)
• Vector sum of the watts and VAR
• Total power available at the line cord
of a piece of equipment
#DATACENTERWORLD | DATACENTERWORLD.COM
Other Helpful Power Terms
#DATACENTERWORLD | DATACENTERWORLD.COM
Power Consumption Values
• Nameplate
• Product safety rating label
• Used for electrical code compliance
• Maximum measured power
consumption
• Found in physical planning manuals
Nameplate
Benchmark
measured • Benchmark
power • Power consumption running an industry
Actual standard performance benchmark
measured • Used in HPC environments to reduce the
power electrical demand overhead
• Actual power consumption
• Typical, every day value
• Used for air conditioning heat rejection
calculations
#DATACENTERWORLD | DATACENTERWORLD.COM
Nameplate – PDU (Ships Worldwide)
• The nameplate includes
all the mandatory legal
Product Safety compliance marks and
Compliance ID information
• The most important
data is about the input
electrical service
• Voltage (V)
EMC • Amperage (A)
overcurrent protection
• 24 amps x 125% = 30A
service
Environmental
• 48 amps x 125% = 60A
service
• Calculate VA = V x A
Single • Use low-line volts
Point
of • 200V x 24A = 4.8 kVA
Contact • 200V x 48A = 9.6 kVA
#DATACENTERWORLD | DATACENTERWORLD.COM
Maximum Measured Power Consumption
• Worst case power consumption • Look for published maximum VA
• Largest configuration (Volt Amps)
• Highest utilization • If VA is not available, an alternative is
• Abnormal conditions that affect fan maximum watts
speed • Convert to VA using power factor
• Internal hardware failures (e.g., power • VA = Watts / PF
supply) • For most IT equipment, power factor is
• High ambient temperature close to 1
• Account for oversubscription
Normal Mode
Amps per Power Supply
4200VA/200V/2 = 10.5 Amps
#DATACENTERWORLD | DATACENTERWORLD.COM
Maximum Measured Power – High Ambient Temperature
• Power consumption is affected by fan • With the increase in fan speed over
power, component power (leakage the range of ambient temperatures,
current), and power conversion the IT flowrates also increase
• If the Inlet temperature increases • The cubic feet per minute (CFM)
demand of the IT equipment must
from 15°C to 35°C, the IT equipment be satisfied or else recirculation
power could increase in the range of could further increase inlet
7 to 20% temperature
#DATACENTERWORLD | DATACENTERWORLD.COM
Oversubscription
• The IT equipment DC
load can draw more
output power than is
available from a single
power supply
• If a single power supply
is unavailable, the IT
equipment throttles the
power consumption to
a level that allows the
machine to run on a
single power supply
#DATACENTERWORLD | DATACENTERWORLD.COM
Rack PDU Planning
• Rack Power Distribution Unit (PDU)
Definition
• Brings electrical power in from the facility
and distributes it to server, storage, and
networking hardware inside a rack
• Think of it as a power strip with superior
features
• Primary circuit breaker protection
• Optional: metering, monitoring, Ethernet
communications, relays
• How to Properly Do Rack Power
Distribution Unit (PDU) Planning for IT
Equipment
• Electrical specification choices for Rack
PDU Planning
• IT equipment manufacturer maximum
measured power consumption Photo is licensed under CC BY-SA-NC
#DATACENTERWORLD | DATACENTERWORLD.COM
Steps to Rack PDU Planning
1. Understand the PDU
#DATACENTERWORLD | DATACENTERWORLD.COM
Step 1 – Understand the PDU
Step 1A – Maximum Input Voltage and Amperage
Line Cord Plug Voltage Rated Amps
#1 NEMA L6-30 200-208 24
#2 IEC 309 332P6W 220-240 32
#3 IEC 309 360P6W 200-208 48
#4 IEC 309 363P6W 220-240 63
#DATACENTERWORLD | DATACENTERWORLD.COM
Step 1C – Level of Facility Redundancy
The IT equipment is
Typically referred to as
designed to run on a single
A-side/B-side or AC power supply
left-side/right-side
redundancy
#DATACENTERWORLD | DATACENTERWORLD.COM
Step 1C – IT Equipment Redundancy
• How many power supplies does the server, storage, or switch have
installed?
• Two power supplies
• Are the supplies current sharing?
• Power supplies draw approximately equal current from the utility (electrical supply)
• Deliver approximately equal current to the load
• Are the power supplies operating like an automatic transfer switch (ATS)?
• Four power supplies
• What is the redundancy setup?
• 2+2 (N+N)
• 3+1 (N+1)
• Is PDU mapping important?
#DATACENTERWORLD | DATACENTERWORLD.COM
Steps 2 and 3 – PDU Calculations and Checks (I)
• Dual Corded IT Equipment
• Divide maximum measured VA (Volts
Amps) by “lowline” Volts (200 V)
• EQ1 = 1750 VA / 200V = 8.75 amps
• EQ2 = 1800 VA / 200 V = 9.00 amps
• PDU Input
• Line cord #1 – 24 amps
• A-side/B-side redundant
P
D Equipment Amps Outlet Pair Pair Amps PDU Total Amps
U
EQ1 8.75 a–1 8.75 8.75
1
& EQ2 9.00 a–2 17.75 17.75
2
EQ1
#DATACENTERWORLD | DATACENTERWORLD.COM
Steps 2 and 3 – PDU Calculations and Checks (II)
• Dual Corded IT Equipment
• Divide maximum measured VA (Volts
Amps) by “lowline” Volts (200 V)
• EQ1 = 1750 VA / 200V = 8.75 amps
• EQ2 = 1800 VA / 200 V = 9.00 amps
• PDU Input
• Line cord #1 – 24 amps
• A-side/B-side redundant
P
D Equipment Amps Outlet Pair Pair Amps PDU Total Amps
U
EQ1 8.75 a–1 8.75 8.75
1
& a–2
2
Equipment Amps Outlet Pair Pair Amps PDU Total Amps P P
D D
EQ2 9.00 b–3 9.00 17.75 U U
1 EQ2 2
b–4
Pair “a” amps less than 16 – OK PDU total amps less than 24 – OK EQ1
Pair “b” amps less than 16 – OK # of line cords less than 12 per PDU – OK
#DATACENTERWORLD | DATACENTERWORLD.COM
Steps 2 and 3 – PDU Calculations and Checks (III)
P
D Equipment Amps Outlet Pair Pair Amps PDU Total Amps
U
EQ1 8.75 a–1 8.75 8.75
1
& a–2
2
Equipment Amps Outlet Pair Pair Amps PDU Total Amps
EQ2 9.00 b–3 9.00 17.75
b–4
#DATACENTERWORLD | DATACENTERWORLD.COM
Steps 2 and 3 – PDU Calculations and Checks (IV)
P
D Equipment Amps Outlet Pair Pair Amps PDU Total Amps
U
EQ1 8.75 a–1 8.75 8.75
1
& a–2
2
Equipment Amps Outlet Pair Pair Amps PDU Total Amps
EQ2 9.00 b–3 9.00 17.75
b–4
P
D Equipment Amps Outlet Pair Pair Amps PDU Total Amps
U
3
EQ1 8.75 a–1 8.75 8.75
& a–2
4
#DATACENTERWORLD | DATACENTERWORLD.COM
Electrical specification choices for Rack PDU Planning
• Use maximum measured power consumption as
specified by the IT equipment manufacturer
• Divide VA by low-line voltage
• Is oversubscription (power capping) used when redundancy is
unavailable?
• Use your own data
• Pre-production testing
• Include corner conditions
• Run worst case applications
• High ambient temperature and/or operate on a single power supply
• Reconfigure the electrical distribution of existing racks
• US National Electrical Code (NEC) 220.87
• Continuously record the demand (loads averaged in 15-minute
intervals) over a minimum 30-day period and find maximum demand
• Factor in conditions that can impact the power consumption of the
equipment
#DATACENTERWORLD | DATACENTERWORLD.COM
Single-Phase or Three-Phase?
Wiring Wall Plug Rated Amps Voltage Power Capacity Primary
VA Geography
1-phase 60 A 48 A 200-208 Vac 𝑃𝑃 = V ⋅ I North America
9.6 kVA
3-phase Delta (Δ) 60 A 48 A 200-208 Vac 𝑃𝑃 = 3 ⋅ V ⋅ I North America
16.6 kVA
3-phase Wye (Y) 32 A 32 A 220-240 Vac 𝑃𝑃 = 3 ⋅ V ⋅ I Europe
21.1 kVA