The 'must-have' PC architecture reference set.

-
O K- Read Only column

-

- -

-
-

-
- --
-
-
- ----

-
- - -
- - -
-
-
- -
K --
-
-- -
-
-
- -
- --
- -
- - -
--
K- -
-- -
-
- -
-- -
--

--v -
-v -
v
v -
v -
v -
v -

--
v -
-- -
- - -
-
-

--
-
-- -
- - -
-
- -
--
--
-

-

-

- - - {
- - { - { {
- ToIyo { - Moxico Cily
Many of llo dosignalions usod by manufaclurors and soIIors lo dislinguisl lloir prod-
ucls aro cIaimod as lradomarIs. Wloro lloso dosignalors appoar in llis booI, and Add-
ison-WosIoy vas avaro of llo lradomarI cIaim, llo dosignalions lavo boon prinlod in
iniliaI capilaI Iollors or aII capilaI Iollors.
Tlo aullors and pubIislors lavo laIon caro in proparalion of llis booI, bul maIo no
oxprossod or impIiod varranly of any Iind and assumo no rosponsibiIily for orrors or
omissions. No IiabiIily is assumod for incidonlaI or consoquonliaI damagos in connoc-
lion vill or arising oul of llo uso of llo informalion or programs conlainod loroin.
Iibrary of Congross CalaIoging-in-IubIicalion Dala
ISBN: 0-
Copyrigll 2003 by MindSlaro, Inc.
AII riglls rosorvod. No parl of llis pubIicalion may bo roproducod, slorod in a rolriovaI
syslom, or lransmillod, in any form or by any moans, oIoclronic, moclanicaI, plolocopy-
ing, rocording, or ollorviso, villoul llo prior vrillon pormission of llo pubIislor.
Irinlod in llo Unilod Slalos of Amorica. IubIislod simuIlanoousIy in Canada.
Sponsoring Idilor:
Irojocl Managor:
Covor Dosign:
Sol in 10 poinl IaIalino by MindSlaro, Inc.
1 2 3 4 5 6 7 8 9-MA-999897
Irinling, , 2003
Addison-WosIoy booIs avaiIabIo for buII purclasos by corporalions, inslilulions, and
ollor organizalions. Ior moro informalion pIoaso conlacl llo Corporalo, Govornmonl,
and SpociaI SaIos Doparlmonl al (800) 238-9682.
Iind A-W DovoIopors Iross on llo WorId-Wido Wob al:
lllp://vvv.avI.com/dovpross/
To my parents Aruna and Shripal Budruk
who started me on the path to Knowledge
-

-
-


-
-
-
ICI Ixpross....................................................................................................................... 4
HoxadocimaI Nolalion ........................................................................................................ 4
Binary Nolalion.................................................................................................................... 4
DocimaI Nolalion................................................................................................................. 4
Bils Vorsus Bylos Nolalion ................................................................................................. 5
Bil IioIds................................................................................................................................ 5
Aclivo SignaI Slalos.............................................................................................................. 5
-


-
--
Tlo RoIo of llo OriginaI ICI SoIulion............................................................................. 10
Donl Tlrov Avay Wlal is Good! Koop Il ............................................................ 10
MaIo Improvomonls for llo Iuluro......................................................................... 10
IooIing inlo llo Iuluro ............................................................................................. 11
-- --
Aullors DiscIaimor........................................................................................................... 12
Bus Iorformancos and Numbor of SIols Comparod..................................................... 12
ICI Ixpross Aggrogalo Tlrouglpul ............................................................................... 13
Iorformanco Ior Iin Comparod...................................................................................... 14
- -
33 MHz ICI Bus Basod Syslom........................................................................................ 16
IIoclricaI Ioad Iimil of a 33 MHz ICI Bus............................................................. 17
ICI Transaclion ModoI - Irogrammod IO.............................................................. 19
ICI Transaclion ModoI - Ioor-lo-Ioor ..................................................................... 22
ICI Bus Arbilralion.................................................................................................... 22
ICI DoIayod Transaclion IrolocoI ........................................................................... 23
ICI Rolry IrolocoI: .............................................................................................. 23
ICI Disconnocl IrolocoI: .................................................................................... 24
ICI Inlorrupl HandIing.............................................................................................. 25
-

ICI Irror HandIing .................................................................................................... 26

ICI Addross Spaco Map ............................................................................................ 27
ICI Configuralion CycIo Gonoralion....................................................................... 29
ICI Iunclion Configuralion Rogislor Spaco ........................................................... 30
ICI Irogramming ModoI .......................................................................................... 31
Iimilalions of a 33 MHz ICI Syslom....................................................................... 31
Ialosl Gonoralion of InloI ICI Clipsols .................................................................. 32
66 MHz ICI Bus Basod Syslom........................................................................................ 33
Iimilalions of 66 MHz ICI bus ................................................................................ 34
Iimilalions of ICI Arclilocluro................................................................................ 34
66 MHz and 133 MHz ICI-X 1.0 Bus Basod IIalforms................................................. 35
ICI-X Ioaluros............................................................................................................. 36
ICI-X Roquoslor/CompIolor SpIil Transaclion ModoI .................................. 37
DDR and QDR ICI-X 2.0 Bus Basod IIalforms............................................................. 39
--
Tlo IinI - A Ioinl-lo-Ioinl Inlorconnocl ................................................................ 41
DifforonliaI SignaIing ................................................................................................. 41
Svilclos Usod lo Inlorconnocl MuIlipIo Dovicos................................................... 42
IacIol Basod IrolocoI ................................................................................................ 42
Bandvidll and CIocIing........................................................................................... 43
Addross Spaco ............................................................................................................. 43
ICI Ixpross Transaclions .......................................................................................... 43
ICI Ixpross Transaclion ModoI................................................................................ 43
Irror HandIing and Robuslnoss of Dala Transfor ................................................. 44
QuaIily of Sorvico (QoS), Traffic CIassos (TCs) and VirluaI ClannoIs (VCs) .... 44
IIov ConlroI................................................................................................................ 45
MSI SlyIo Inlorrupl HandIing SimiIar lo ICI-X ..................................................... 45
Iovor Managomonl.................................................................................................... 45
Hol IIug Supporl ........................................................................................................ 46
ICI CompalibIo Soflvaro ModoI.............................................................................. 46
MoclanicaI Iorm Iaclors........................................................................................... 47
ICI-IiIo IoriploraI Card and Connoclor ......................................................... 47
Mini ICI Ixpross Iorm Iaclor........................................................................... 47
MoclanicaI Iorm Iaclors Ionding RoIoaso............................................................. 47
NIWCARD Iorm Iaclor .................................................................................... 47
Sorvor IO ModuIo (SIOM) Iorm Iaclor............................................................ 47
ICI Ixpross TopoIogy....................................................................................................... 48
Inumoraling llo Syslom............................................................................................ 50
ICI Ixpross Syslom BIocI Diagram................................................................................ 51
Iov Cosl ICI Ixpross Clipsol ................................................................................. 51
Higl-Ind Sorvor Syslom............................................................................................ 53
-- -
-

-- --
ICI Ixpross Transaclion IrolocoI ................................................................................... 57
Non-Ioslod Road Transaclions................................................................................. 58
Non-Ioslod Road Transaclion for IocIod Roquosls ............................................. 59
Non-Ioslod Wrilo Transaclions................................................................................ 61
Ioslod Momory Wrilo Transaclions......................................................................... 62
Ioslod Mossago Transaclions.................................................................................... 63
Somo IxampIos of Transaclions....................................................................................... 64
Momory Road Originalod by CIU, Targoling an Indpoinl................................. 64
Momory Road Originalod by Indpoinl, Targoling Syslom Momory.................. 66
IO Wrilo Inilialod by CIU, Targoling an Indpoinl ............................................... 67
Momory Wrilo Transaclion Originalod by CIU and
Targoling an Indpoinl .............................................................................................. 68
-- -
Ovorviov............................................................................................................................. 69
Transmil Iorlion of Dovico Iayors........................................................................... 71
Rocoivo Iorlion of Dovico Iayors............................................................................. 71
Dovico Iayors and lloir Associalod IacIols.................................................................. 71
Transaclion Iayor IacIols (TIIs) ............................................................................ 71
TII IacIol AssombIy.......................................................................................... 72
TII IacIol DisassombIy..................................................................................... 73
Dala IinI Iayor IacIols (DIIIs) ............................................................................ 74
DIII AssombIy................................................................................................... 75
DIII DisassombIy .............................................................................................. 76
IlysicaI Iayor IacIols (IIIs) .................................................................................. 77
Iunclion of Iacl ICI Ixpross Dovico Iayor .................................................................. 78
Dovico Coro / Soflvaro Iayor .................................................................................. 78
Transmil Sido. ...................................................................................................... 78
Rocoivo Sido.......................................................................................................... 78
Transaclion Iayor ....................................................................................................... 79
Transmil Sido. ...................................................................................................... 80
Rocoivor Sido ........................................................................................................ 81
IIov ConlroI......................................................................................................... 81
QuaIily of Sorvico (QoS) ..................................................................................... 82
Traffic CIassos (TCs) and VirluaI ClannoIs (VCs).......................................... 84
Iorl Arbilralion and VC Arbilralion ................................................................ 85
Transaclion Ordoring.......................................................................................... 87
Iovor Managomonl ............................................................................................ 87
Configuralion Rogislors...................................................................................... 87
Dala IinI Iayor........................................................................................................... 87
-

Transmil Sido ....................................................................................................... 88

Rocoivo Sido.......................................................................................................... 89
Dala IinI Iayor Conlribulion lo TIIs and DIIIs........................................ 89
Non-Ioslod Transaclion Sloving ACK-NAK IrolocoI ................................ 90
Ioslod Transaclion Sloving ACK-NAK IrolocoI ......................................... 92
Ollor Iunclions of llo Dala IinI Iayor........................................................... 92
IlysicaI Iayor ............................................................................................................. 93
Transmil Sido ....................................................................................................... 93
Rocoivo Sido.......................................................................................................... 93
IinI Training and IniliaIizalion ........................................................................ 94
IinI Iovor Managomonl ................................................................................... 95
Rosol....................................................................................................................... 95
IIoclricaI IlysicaI Iayor..................................................................................... 96
- -
Momory Road Roquosl Ilaso.................................................................................... 97
CompIolion vill Dala Ilaso .................................................................................... 99

-- -
-
-- - -

Rocoivors ClocI Ior Tlroo Typos of IinI Traffic ....................................................... 107
MuIli-porl Dovicos Assumo llo Rouling Burdon........................................................ 107
Indpoinls Havo Iimilod Rouling RosponsibiIilios..................................................... 107
Syslom Rouling Slralogy Is Irogrammod .................................................................... 108
-
Ordorod Sols ..................................................................................................................... 108
Dala IinI Iayor IacIols (DIIIs).................................................................................. 111
- --
TIIs Usod lo Accoss Iour Addross Spacos.................................................................. 113
SpIil Transaclion IrolocoI Is Usod................................................................................. 114
SpIil Transaclions: Bollor Iorformanco, Moro Ovorload.................................... 114
Wrilo Iosling: Somolimos a CompIolion Isnl Noodod....................................... 115
Tlroo Mollods of TII Rouling...................................................................................... 117
ICI Ixpross Rouling Is CompalibIo vill ICI ............................................................. 117
ICI Ixpross Adds ImpIicil Rouling for Mossagos............................................... 118
Wly Woro Mossagos Addod lo ICI Ixpross IrolocoI` ............................... 118
Hov ImpIicil Rouling HoIps vill Mossagos................................................. 118
Hoador IioIds Dofino IacIol Iormal and Rouling ..................................................... 119
-

Using TII Hoador Informalion: Ovorviov.................................................................. 120

GonoraI ....................................................................................................................... 120
Hoador Typo/Iormal IioId Incodings ................................................................. 120
--
Addross Rouling .............................................................................................................. 122
Momory and IO Addross Maps.............................................................................. 122
Koy TII Hoador IioIds in Addross Rouling ........................................................ 123
TIIs vill 3DW, 32-Bil Addross...................................................................... 123
TIIs Will 4DW, 64-Bil Addross ..................................................................... 124
An Indpoinl ClocIs an Addross-Roulod TII..................................................... 125
A Svilcl Rocoivos an Addross Roulod TII: Tvo ClocIs.................................. 125
GonoraI ................................................................................................................ 125
Ollor Nolos Aboul Svilcl Addross-Rouling................................................ 127
ID Rouling......................................................................................................................... 127
ID Bus Numbor, Dovico Numbor, Iunclion Numbor Iimils ............................. 127
Koy TII Hoador IioIds in ID Rouling................................................................... 128
3DW TII, ID Rouling....................................................................................... 128
4DW TII, ID Rouling....................................................................................... 129
An Indpoinl ClocIs an ID-Roulod TII............................................................... 130
A Svilcl Rocoivos an ID-Roulod TII: Tvo ClocIs............................................ 130
Ollor Nolos Aboul Svilcl ID Rouling.................................................................. 130
ImpIicil Rouling ............................................................................................................... 131
OnIy Mossagos May Uso ImpIicil Rouling............................................................ 132
Mossagos May AIso Uso Addross or ID Rouling................................................. 132
Rouling Sub-IioId in Hoador Indicalos Rouling Mollod................................... 132
Koy TII Hoador IioIds in ImpIicil Rouling ......................................................... 132
Mossago Typo IioId Summary................................................................................ 133
An Indpoinl ClocIs a TII Roulod ImpIicilIy..................................................... 134
A Svilcl Rocoivos a TII Roulod ImpIicilIy ......................................................... 134
-
Rouling Configuralion Is ICI-CompalibIo .................................................................. 135
Tvo Configuralion Spaco Hoador Iormals: Typo 0, Typo 1 .............................. 135
Rouling Rogislors Aro Iocalod in Configuralion Hoador .................................. 135
Baso Addross Rogislors (BARs): Typo 0, 1 Hoadors.................................................... 136
GonoraI ....................................................................................................................... 136
BAR Solup IxampIo Ono: 1MB, IrofolclabIo Momory Roquosl........................ 138
BAR Solup IxampIo Tvo: 64-Bil, 64MB Momory Roquosl................................. 140
BAR Solup IxampIo Tlroo: 256-Bylo IO Roquosl ................................................ 142
Baso/Iimil Rogislors, Typo 1 Hoador OnIy ................................................................. 144
GonoraI ....................................................................................................................... 144
IrofolclabIo Momory Baso/Iimil Rogislors......................................................... 144
Non-IrofolclabIo Momory Baso/Iimil Rogislors................................................ 146
-

IO Baso/Iimil Rogislors........................................................................................... 148

Bus Numbor Rogislors, Typo 1 Hoador OnIy............................................................... 150
Irimary Bus Numbor ............................................................................................... 151
Socondary Bus Numbor ........................................................................................... 151
Subordinalo Bus Numbor ........................................................................................ 151
A Svilcl Is a Tvo-IovoI Bridgo Slrucluro............................................................ 151
- --
-
Wly Uso A IacIol-Basod Transaclion IrolocoI .......................................................... 154
IacIol Iormals Aro WoII Dofinod.......................................................................... 154
Iraming SymboIs Indicalo IacIol Boundarios..................................................... 156
CRC Irolocls Inliro IacIol ..................................................................................... 156
- -
TIIs Aro AssombIod And DisassombIod..................................................................... 157
Dovico Coro Roquosls Accoss lo Iour Spacos ............................................................. 159
TII Transaclion Varianls Dofinod................................................................................ 160
TII Slrucluro.................................................................................................................... 161
Gonoric TII Hoador Iormal ................................................................................... 161
Gonoric Hoador IioId Summary............................................................................. 162
Hoador Typo/Iormal IioId Incodings ................................................................. 165
Tlo Digosl and ICRC IioId..................................................................................... 166
ICRC Gonoralion and ClocIing..................................................................... 166
Wlo Can ClocI ICRC`.................................................................................... 167
Using Bylo InabIos ................................................................................................... 167
Bylo InabIo RuIos .............................................................................................. 167
Transaclion Doscriplor IioIds ................................................................................. 169
Transaclion ID.................................................................................................... 169
Traffic CIass........................................................................................................ 169
Transaclion Allribulos ...................................................................................... 169
AddilionaI RuIos Ior TIIs Will Dala IayIoads.................................................. 170
BuiIding Transaclions: TII Roquosls & CompIolions................................................ 171
IO Roquosls................................................................................................................ 171
IO Roquosl Hoador Iormal .............................................................................. 172
Dofinilions Of IO Roquosl Hoador IioIds ...................................................... 173
Momory Roquosls ..................................................................................................... 174
Doscriplion of 3DW And 4DW Momory Roquosl Hoador IioIds............... 176
Momory Roquosl Nolos .................................................................................... 179
Configuralion Roquosls ........................................................................................... 179
Dofinilions Of Configuralion Roquosl Hoador IioIds.................................. 181
Configuralion Roquosl Nolos .......................................................................... 183
CompIolions............................................................................................................... 183
-

Dofinilions Of CompIolion Hoador IioIds ..................................................... 185

Summary of CompIolion Slalus Codos: ......................................................... 187
CaIcuIaling Tlo Iovor Addross IioId (Bylo 11, bils 7:0): ............................ 187
Using Tlo Bylo Counl Modifiod Bil................................................................ 188
Dala Rolurnod Ior Road Roquosls: ................................................................. 188
Rocoivor CompIolion HandIing RuIos: ........................................................... 189
Mossago Roquosls ..................................................................................................... 190
Dofinilions Of Mossago Roquosl Hoador IioIds............................................ 191
Mossago Nolos: .................................................................................................. 193
INTx Inlorrupl SignaIing.................................................................................. 193
Iovor Managomonl Mossagos ........................................................................ 194
Irror Mossagos................................................................................................... 195
UnIocI Mossago................................................................................................. 196
SIol Iovor Iimil Mossago................................................................................ 196
Hol IIug SignaIing Mossago ............................................................................ 197
-
Typos Of DIIIs ............................................................................................................... 199
DIIIs Aro IocaI Traffic.................................................................................................. 199
Rocoivor landIing of DIIIs........................................................................................... 199
Sonding A Dala IinI Iayor IacIol................................................................................ 200
Iixod DIII IacIol Sizo: 8 Bylos............................................................................. 201
DIII IacIol Typos.......................................................................................................... 201
AcI Or NaI DIII IacIol Iormal .......................................................................... 202
Dofinilions Of AcI Or NaI DIII IioIds........................................................ 203
Iovor Managomonl DIII IacIol Iormal............................................................ 204
Dofinilions Of Iovor Managomonl DIII IioIds ......................................... 204
IIov ConlroI IacIol Iormal ................................................................................... 205
Dofinilions Of IIov ConlroI DIII IioIds ..................................................... 206
Vondor Spocific DIII Iormal ................................................................................ 207
Dofinilions Of Vondor Spocific DIII IioIds................................................. 207

- - --
-
Transmillor IIomonls of llo ACK/NAK IrolocoI ...................................................... 213
RopIay Buffor............................................................................................................. 213
NIXT_TRANSMIT_SIQ Counlor.......................................................................... 213
ICRC Gonoralor........................................................................................................ 213
RIIIAY_NUM Counl ............................................................................................. 213
RIIIAY_TIMIR Counl........................................................................................... 214
ACKD_SIQ Counl.................................................................................................... 214
DIII CRC ClocI ..................................................................................................... 214
-

Rocoivor IIomonls of llo ACK/NAK IrolocoI............................................................ 216

Rocoivo Buffor............................................................................................................ 216
ICRC Irror ClocI.................................................................................................... 216
NIXT_RCV_SIQ Counl .......................................................................................... 216
Soquonco Numbor ClocI......................................................................................... 216
NAK_SCHIDUIID IIag ........................................................................................ 217
ACKNAK_IATINCY_TIMIR............................................................................... 217
ACK/NAK DIII Gonoralor .................................................................................. 217

-
Transmillor IrolocoI DolaiIs .......................................................................................... 220
Soquonco Numbor..................................................................................................... 220
32-Bil ICRC............................................................................................................... 221
RopIay (Rolry) Buffor................................................................................................ 221
GonoraI ................................................................................................................ 221
RopIay Buffor Sizing.......................................................................................... 221
Transmillors Rosponso lo an ACK DIII............................................................. 222
GonoraI ................................................................................................................ 222
Iurging llo RopIay Buffor................................................................................ 222
IxampIos of Transmillor ACK DIII Irocossing ................................................ 222
IxampIo 1............................................................................................................ 222
IxampIo 2............................................................................................................ 223
Transmillors Rosponso lo a NAK DIII............................................................... 224
TII RopIay................................................................................................................. 225
Ifficionl TII RopIay................................................................................................. 225
IxampIo of Transmillor NAK DIII Irocossing.................................................. 225
Ropoalod RopIay of TIIs.................................................................................. 226
Wlal Happons Aflor llo RopIay Numbor RoIIovor` ................................... 227
Transmillors RopIay Timor..................................................................................... 227
RIIIAY_TIMIR Iqualion............................................................................... 227
RIIIAY_TIMIR Summary TabIo .................................................................. 228
Transmillor DIII HandIing................................................................................... 229
Rocoivor IrolocoI DolaiIs ................................................................................................ 230
TII Rocoivod al IlysicaI Iayor.............................................................................. 230
Rocoivod TII Irror ClocI ...................................................................................... 230
Noxl Rocoivod TIIs Soquonco Numbor............................................................... 230
Rocoivor ScloduIos An ACK DIII........................................................................ 231
IxampIo of Rocoivor ACK ScloduIing .................................................................. 232
NAK ScloduIod IIag................................................................................................ 233
Rocoivor ScloduIos a NAK...................................................................................... 233
Rocoivor Soquonco Numbor ClocI ........................................................................ 234
Rocoivor Irosorvos TII Ordoring .......................................................................... 235
-

IxampIo of Rocoivor NAK ScloduIing.................................................................. 236

Rocoivors ACKNAK_IATINCY_TIMIR............................................................. 237
ACKNAK_IATINCY_TIMIR Iqualion....................................................... 238
ACKNAK_IATINCY_TIMIR Summary TabIo........................................... 238
-

Transmillor Sido............................................................................................................... 241
Non-Irror Caso (ACK DIII Managomonl) ......................................................... 241
Irror Caso (NAK DIII Managomonl).................................................................. 242
Rocoivor Sido..................................................................................................................... 242
Non-Irror Caso ......................................................................................................... 242
Irror Caso .................................................................................................................. 243
-
-
Iosl TII............................................................................................................................. 244
Iosl ACK DIII or ACK DIII vill CRC Irror......................................................... 245
Iosl ACK DIII foIIovod by NAK DIII.................................................................... 246

Willoul Cul-Tlrougl Modo.......................................................................................... 248
BacIground................................................................................................................ 248
IossibIo SoIulion....................................................................................................... 248
Svilcl Cul-Tlrougl Modo............................................................................................. 249
BacIground................................................................................................................ 249
IxampIo Tlal Domonslralos Svilcl Cul-Tlrougl Ioaluro ............................... 249
--

Isoclronous Transaclion Supporl.................................................................................. 253
Synclronous Vorsus Isoclronous Transaclions................................................... 253
Isoclronous Transaclion Managomonl ................................................................. 255
Difforonlialod Sorvicos .................................................................................................... 255
-
--- -
VC Assignmonl and TC Mapping................................................................................. 258
Dolormining llo Numbor of VCs lo bo Usod ....................................................... 258
Assigning VC Numbors (IDs) ................................................................................. 260
Assigning TCs lo oacl VC TC/VC Mapping .................................................. 262

VirluaI ClannoI Arbilralion........................................................................................... 264
Slricl Iriorily VC Arbilralion.................................................................................. 265
Iov- and Higl-Iriorily VC Arbilralion................................................................ 267
Hardvaro Iixod Arbilralion Sclomo.............................................................. 269
-

Woigllod Round Robin Arbilralion Sclomo................................................. 269

Round Robin Arbilralion (IquaI or Woigllod) for AII VCs............................... 270
Ioading llo VirluaI ClannoI Arbilralion TabIo................................................... 270
VC Arbilralion villin MuIlipIo Iunclion Indpoinls.......................................... 273
Iorl Arbilralion................................................................................................................ 274
Tlo Iorl Arbilralion Moclanisms.......................................................................... 277
Non-ConfigurabIo Hardvaro-Iixod Arbilralion .......................................... 278
Woigllod Round Robin Arbilralion ............................................................... 279
Timo-Basod, Woigllod Round Robin Arbilralion ........................................ 279
Ioading llo Iorl Arbilralion TabIos ...................................................................... 280
Svilcl Arbilralion IxampIo........................................................................................... 282


-
VC IIov ConlroI Buffor Organizalion.......................................................................... 288
IIov ConlroI Crodils ....................................................................................................... 289
Maximum IIov ConlroI Buffor Sizo ............................................................................. 290
-
Tlo IIov ConlroI IIomonls............................................................................................ 290
Transmillor IIomonls ............................................................................................... 291
Rocoivor IIomonls..................................................................................................... 291
-

Slago 1 IIov ConlroI IoIIoving IniliaIizalion........................................................ 294
Slago 2 IIov ConlroI Buffor IiIIs Up........................................................................ 298
Slago 3 Tlo Crodil Iimil counl RoIIs Ovor.............................................................. 299
Slago 4 IC Buffor OvorfIov Irror ClocI ................................................................ 300
-
Wlo Advorlisos Infinilo IIov ConlroI Crodils`.......................................................... 301
SpociaI Uso for Infinilo Crodil Advorlisomonls. .......................................................... 302
Hoador and Dala Advorlisomonls May ConfIicl ......................................................... 302
-

Tlo IC IniliaIizalion Soquonco....................................................................................... 305
IC Inil1 IacIols Advorliso IIov ConlroI Crodils AvaiIabIo.............................. 305
IC Inil2 IacIols Confirm SuccossfuI IC IniliaIizalion........................................ 307
Ralo of IC_INIT1 and IC_INIT2 Transmission ................................................... 308
VioIalions of llo IIov ConlroI IniliaIizalion IrolocoI ........................................ 308
-
IC_Updalo DIII Iormal and Conlonl ........................................................................ 309
IIov ConlroI Updalo Iroquoncy ................................................................................... 310
-

Immodialo Nolificalion of Crodils AIIocalod ....................................................... 311

Maximum Ialoncy Bolvoon Updalo IIov ConlroI DIIIs................................ 311
CaIcuIaling Updalo Iroquoncy Basod on IayIoad Sizo and IinI Widll ......... 311
Irror Doloclion Timor A Isoudo Roquiromonl ...................................................... 312
-

-
-- -
Iroducor/Consumor ModoI vill Nalivo Dovicos...................................................... 318

RO Iffocls on Momory Wrilos and Mossagos.............................................................. 319
RO Iffocls on Momory Road Transaclions................................................................... 320
Summary of Slrong Ordoring RuIos.............................................................................. 321
-
Slrong Ordoring Can RosuIl in Transaclion BIocIing ................................................ 322
Tlo IrobIom............................................................................................................... 323
Tlo WoaIIy Ordorod SoIulion ................................................................................ 324
Ordor Managomonl AccompIislod vill VC Buffors ................................................. 324
Summary of Modifiod Ordoring RuIos......................................................................... 325
--
-
-
-- -
Tlo MSI CapabiIily Rogislor Sol .................................................................................... 332
CapabiIily ID............................................................................................................. 332
Ioinlor To Noxl Nov CapabiIily............................................................................ 333
Mossago ConlroI Rogislor ........................................................................................ 333
Mossago Addross Rogislor....................................................................................... 335
Mossago Dala Rogislor ............................................................................................. 335
Basics of MSI Configuralion........................................................................................... 336
Basics of Gonoraling an MSI Inlorrupl Roquosl .......................................................... 338
Momory Wrilo Transaclion (MSI) .......................................................................... 338
MuIlipIo Mossagos.................................................................................................... 339
Momory Synclronizalion Wlon Inlorrupl HandIor Inlorod.................................... 340
Tlo IrobIom............................................................................................................... 340
SoIving llo IrobIom................................................................................................. 341
Inlorrupl Ialoncy ............................................................................................................. 341
MSI RosuIls In ICRC Irror ..................................................................................... 341
Somo RuIos, Rocommondalions, olc. ............................................................................. 341
-

BacIground ICI Inlorrupl SignaIing ....................................................................... 342
Dovico INTx# Iins .................................................................................................... 342
Dolormining if a Iunclion Usos INTx# Iins ......................................................... 343
Inlorrupl Rouling...................................................................................................... 344
Associaling llo INTx# Iino lo an IRQ Numbor ................................................... 345
INTx# SignaIing ........................................................................................................ 345
Inlorrupl DisabIo................................................................................................ 346
Inlorrupl Slalus .................................................................................................. 346
VirluaI INTx SignaIing.................................................................................................... 347
VirluaI INTx Wiro DoIivory..................................................................................... 348
CoIIapsing INTx SignaIs villin a Bridgo.............................................................. 349
INTx Mossago Iormal .............................................................................................. 351
- -
- - - -
IxampIo Syslom............................................................................................................... 353


--
ICI Ixpross Irror ClocIing Moclanisms.................................................................... 356
Transaclion Iayor Irrors ......................................................................................... 358
Dala IinI Iayor Irrors ............................................................................................ 358
IlysicaI Iayor Irrors ............................................................................................... 358
Irror Roporling Moclanisms ......................................................................................... 359
Irror HandIing Moclanisms.......................................................................................... 360
- -- -
ICRC Gonoralion and ClocIing ................................................................................... 361
Dala Ioisoning (OplionaI) .............................................................................................. 362
TC lo VC Mapping Irrors............................................................................................... 363
IinI IIov ConlroI-RoIalod Irrors................................................................................. 363
MaIformod Transaclion Iayor IacIol (TII) ................................................................ 364
SpIil Transaclion Irrors .................................................................................................. 365
Unsupporlod Roquosl .............................................................................................. 365
CompIolor Aborl ....................................................................................................... 366
Unoxpoclod CompIolion.......................................................................................... 367
CompIolion Timo-oul ............................................................................................... 367
---
CorroclabIo Irrors............................................................................................................ 369
UncorroclabIo Non-IalaI Irrors..................................................................................... 369
UncorroclabIo IalaI Irrors.............................................................................................. 369
-
-

Irror Mossagos ................................................................................................................. 370

CompIolion Slalus............................................................................................................ 371
-
ICI-CompalibIo Irror Roporling Moclanisms ........................................................... 372
Configuralion Command and Slalus Rogislors................................................... 373
ICI Ixpross BasoIino Irror HandIing........................................................................... 375
InabIing/DisabIing Irror Roporling..................................................................... 376
InabIing Irror Roporling Dovico ConlroI Rogislor................................. 377
Irror Slalus Dovico Slalus Rogislor ........................................................... 378
IinI Irrors ................................................................................................................. 379
Rools Rosponso lo Irror Mossago ......................................................................... 381
--
ICRC Gonoralion and ClocIing ................................................................................... 383
HandIing SlicIy Bils ........................................................................................................ 383
Advancod CorroclabIo Irror HandIing ........................................................................ 384
Advancod CorroclabIo Irror Slalus ....................................................................... 385
Advancod CorroclabIo Irror Roporling ................................................................ 385
Advancod UncorroclabIo Irror HandIing.................................................................... 386
Advancod UncorroclabIo Irror Slalus................................................................... 387
SoIocling llo Sovorily of Iacl UncorroclabIo Irror ............................................. 388
UncorroclabIo Irror Roporling ............................................................................... 388
Irror Iogging ................................................................................................................... 389
Rool CompIox Irror TracIing and Roporling ............................................................. 390
Rool CompIox Irror Slalus Rogislors .................................................................... 390
Advancod Sourco ID Rogislor ................................................................................. 391
Rool Irror Command Rogislor ............................................................................... 392
Roporling Irrors lo llo Hosl Syslom..................................................................... 392

-
-
-
DiscIaimor ......................................................................................................................... 400
Transmil Iogic Ovorviov............................................................................................... 400
Rocoivo Iogic Ovorviov ................................................................................................. 402
IlysicaI Iayor IinI Aclivo Slalo Iovor Managomonl .............................................. 403
IinI Training and IniliaIizalion..................................................................................... 403
- -
Tx Buffor............................................................................................................................ 404
MuIlipIoxor (Mux) and Mux ConlroI Iogic ................................................................. 404
-

GonoraI ....................................................................................................................... 404

Dofinilion of Claraclors and SymboIs................................................................... 405
Bylo Slriping (OplionaI) .................................................................................................. 408
IacIol Iormal RuIos................................................................................................. 411
GonoraI IacIol Iormal RuIos........................................................................... 411
x1 IacIol Iormal IxampIo............................................................................... 412
x4 IacIol Iormal RuIos..................................................................................... 412
x4 IacIol Iormal IxampIo............................................................................... 412
x8, x12, x16 or x32 IacIol Iormal RuIos......................................................... 413
x8 IacIol Iormal IxampIo............................................................................... 415
ScrambIor........................................................................................................................... 416
Iurposo of ScrambIing Oulbound Transmission................................................. 416
ScrambIor AIgorillm................................................................................................ 416
Somo ScrambIor impIomonlalion ruIos:................................................................. 417
DisabIing ScrambIing............................................................................................... 418
8b/10b Incoding.............................................................................................................. 419
GonoraI ....................................................................................................................... 419
Iurposo of Incoding a Claraclor Slroam.............................................................. 419
Iroporlios of 10-bil (10b) SymboIs.......................................................................... 421
Iroparing 8-bil Claraclor Nolalion........................................................................ 422
Disparily..................................................................................................................... 423
Dofinilion............................................................................................................ 423
Tvo Calogorios of 8-bil Claraclors................................................................. 423
CRD (Curronl Running Disparily).................................................................. 423
8b/10b Incoding Irocoduro ................................................................................... 424
IxampIo Incodings........................................................................................... 424
IxampIo Transmission...................................................................................... 425
Tlo IooIup TabIos ................................................................................................... 427
ConlroI Claraclor Incoding ................................................................................... 430
Ordorod-Sols.............................................................................................................. 433
GonoraI ................................................................................................................ 433
TS1 and TS2 Ordorod-Sols................................................................................ 434
SKII Ordorod-Sol............................................................................................... 434
IIoclricaI IdIo Ordorod-Sol ............................................................................... 434
ITS Ordorod-Sol................................................................................................. 434
IaraIIoI-lo-SoriaI Convorlor (SoriaIizor)........................................................................ 434
DifforonliaI Transmil Drivor........................................................................................... 435
Transmil (Tx) CIocI......................................................................................................... 435
Ollor MiscoIIanoous Transmil Iogic Topics ............................................................... 436
IogicaI IdIo Soquonco............................................................................................... 436
Insorling CIocI Componsalion Zonos.................................................................... 436
BacIground ........................................................................................................ 436
-

SKII Ordorod-Sol Insorlion RuIos................................................................... 437

-
DifforonliaI Rocoivor........................................................................................................ 439
Rx CIocI Rocovory........................................................................................................... 440
GonoraI ....................................................................................................................... 440
Aclioving Bil IocI ................................................................................................... 440
Iosing Bil IocI.......................................................................................................... 441
Rogaining Bil IocI.................................................................................................... 441
SoriaI-lo-IaraIIoI convorlor (DosoriaIizor) .................................................................... 441
SymboI Boundary Sonsing (SymboI IocI) ................................................................... 441
Rocoivor CIocI Componsalion Iogic ............................................................................ 442
BacIground................................................................................................................ 442
Tlo IIaslic Buffors RoIo in llo Rocoivor ............................................................... 442
Iano-lo-Iano Do-SIov.................................................................................................... 444
Nol a IrobIom on a SingIo-Iano IinI.................................................................... 444
IIigll Timo Varios from Iano-lo-Iano .................................................................. 444
If Iano Dala Is Nol AIignod, Bylo Unslriping WouIdnl WorI ......................... 444
TS1/TS2 or ITS Ordorod-Sols Usod lo Do-SIov IinI........................................ 444
Do-SIov During IinI Training, Rolraining and I0s Ixil................................... 445
Iano-lo-Iano Do-SIov CapabiIily of Rocoivor..................................................... 445
8b/10b Docodor................................................................................................................ 446
GonoraI ....................................................................................................................... 446
Disparily CaIcuIalor ................................................................................................. 446
Codo VioIalion and Disparily Irror Doloclion..................................................... 446
GonoraI ................................................................................................................ 446
Codo VioIalions.................................................................................................. 446
Disparily Irrors......................................................................................................... 447
Do-ScrambIor .................................................................................................................... 448
Somo Do-ScrambIor ImpIomonlalion RuIos: ......................................................... 448
DisabIing Do-ScrambIing......................................................................................... 449
Bylo Un-Slriping............................................................................................................... 449
IiIlor and IacIol AIignmonl ClocI............................................................................... 450
Rocoivo Buffor (Rx Buffor) .............................................................................................. 450
-
Rosponso of Dala IinI Iayor lo Rocoivor Irror Indicalion.............................. 451
-
-

CIocI Roquiromonls......................................................................................................... 456
GonoraI ....................................................................................................................... 456
Sproad Spoclrum CIocIing (SSC) ........................................................................... 456
-

Impodanco and Torminalion.......................................................................................... 456

Transmillor Impodanco Roquiromonls .................................................................. 457
Rocoivor Impodanco Roquiromonls........................................................................ 457
DC Common Modo VoIlagos ......................................................................................... 457
Transmillor DC Common Modo VoIlago.............................................................. 457
Rocoivor DC Common Modo VoIlago.................................................................... 457
ISD and Slorl Circuil Roquiromonls............................................................................ 458
Rocoivor Doloclion ........................................................................................................... 459
GonoraI ....................................................................................................................... 459
Will a Rocoivor Allaclod........................................................................................ 459
Willoul a Rocoivor Allaclod.................................................................................. 459
Irocoduro To Dolocl Irosonco or Absonco of Rocoivor ....................................... 459
DifforonliaI Drivors and Rocoivors ................................................................................ 461
Advanlagos of DifforonliaI SignaIing .................................................................... 461
DifforonliaI VoIlagos................................................................................................. 461
DifforonliaI VoIlago Nolalion.................................................................................. 462
GonoraI ................................................................................................................ 462
DifforonliaI IoaI VoIlago.................................................................................. 462
DifforonliaI IoaI-lo-IoaI VoIlago................................................................... 462
Common Modo VoIlago ................................................................................... 462
IIoclricaI IdIo .................................................................................................................... 464
Transmillor RosponsibiIily...................................................................................... 464
Rocoivor RosponsibiIily............................................................................................ 465
Iovor Consumod Wlon IinI Is in IIoclricaI IdIo Slalo ..................................... 465
IIoclricaI IdIo Ixil ..................................................................................................... 465
Transmission Iino Ioss on IinI.................................................................................... 465
AC CoupIing..................................................................................................................... 466
Do-Implasis (or Iro-Implasis) .................................................................................... 466
Wlal is Do-Implasis` ............................................................................................. 466
Wlal is llo IrobIom Addrossod By Do-omplasis` ............................................. 467
SoIulion ...................................................................................................................... 468
Boacon SignaIing.............................................................................................................. 469
GonoraI ....................................................................................................................... 469
Iroporlios of llo Boacon SignaI .............................................................................. 469

}illor, Noiso, and SignaI Allonualion ............................................................................ 470
Tlo Iyo Tosl ...................................................................................................................... 470
OplimaI Iyo ...................................................................................................................... 471
}illor Widons or Narrovs llo Iyo Sidovays................................................................ 471
Noiso and SignaI Allonualion Hoigllon llo Iyo ........................................................ 472
- --
GonoraI............................................................................................................................... 477
-

Transmil Drivor CompIianco Tosl and Moasuromonl Ioad...................................... 479

--
- -
- -
- - -
IundamonlaI Rosol .......................................................................................................... 488
Mollods of SignaIing IundamonlaI Rosol ............................................................ 489
IIRST# Typo IundamonlaI Rosol Gonoralion.............................................. 489
Aulonomous Mollod of IundamonlaI Rosol Gonoralion ........................... 489
In-Band Rosol or Hol Rosol............................................................................................. 491
Rosponso lo Rocoiving a Hol Rosol Command .................................................... 491
Svilclos Gonoralo Hol Rosol on Tloir Dovnslroam Iorls ................................ 492
Bridgos Iorvard Hol Rosol lo llo Socondary Bus............................................... 492
Hov Doos Soflvaro ToII a Dovico (o.g. Svilcl or Rool CompIox) lo Gonoralo Hol
Rosol` ........................................................................................................................................ 492
-

Dovico SignaIs WaIoup............................................................................................ 497
Iovor Managomonl Soflvaro Gonoralos WaIoup Ivonl ................................... 497


GonoraI............................................................................................................................... 500
- -
TS1 and TS2 Ordorod-Sols .............................................................................................. 505
IIoclricaI IdIo Ordorod-Sol.............................................................................................. 507
ITS Ordorod-Sol ............................................................................................................... 507
SKII Ordorod-Sol ............................................................................................................. 508
-
GonoraI............................................................................................................................... 508
Ovorviov of ITSSM Slalos ............................................................................................. 511
- -
Dolocl Slalo........................................................................................................................ 513
Dolocl.Quiol SubSlalo............................................................................................... 513
Dolocl.Aclivo SubSlalo ............................................................................................. 514
IoIIing Slalo ...................................................................................................................... 515
Inlroduclion............................................................................................................... 515
IoIIing.Aclivo SubSlalo............................................................................................ 516
IoIIing.Configuralion SubSlalo .............................................................................. 517
IoIIing.CompIianco SubSlalo.................................................................................. 518
-

IoIIing.Spood SubSlalo............................................................................................. 518

Configuralion Slalo.......................................................................................................... 519
GonoraI ....................................................................................................................... 519
Configuralion.RcvrCfg SubSlalo ............................................................................ 521
Configuralion.IdIo SubSlalo.................................................................................... 522
Dosigning Dovicos vill IinIs llal can bo Morgod ............................................. 522
GonoraI ................................................................................................................ 522
Iour-x2 Configuralion ...................................................................................... 523
Tvo-x4 Configuralion....................................................................................... 523
IxampIos Tlal Domonslralo Configuralion.RcvrCfg Iunclion......................... 524
RcvrCfg IxampIo 1 ................................................................................................... 524
IinI Numbor Nogolialion................................................................................ 525
Iano Numbor Nogolialion ............................................................................... 526
Confirmalion of IinI Numbor and Iano Numbor Nogolialod.................. 526
RcvrCfg IxampIo 2 ................................................................................................... 527
IinI Numbor Nogolialion: ............................................................................... 527
Iano Numbor Nogolialion ............................................................................... 528
Confirmalion of IinI Numbor and Iano Numbor Nogolialod.................. 529
RcvrCfg IxampIo 3 ................................................................................................... 530
IinI Numbor Nogolialion................................................................................ 530
Iano Numbor Nogolialion ............................................................................... 531
Confirmalion of IinI Numbor and Iano Numbor Nogolialod.................. 531
Rocovory Slalo .................................................................................................................. 532
Roasons llal a Dovico Inlors llo Rocovory Slalo................................................. 533
Inilialing llo Rocovory Irocoss............................................................................... 533
Rocovory.RcvrIocI SubSlalo .................................................................................. 533
Rocovory.RcvrCfg SubSlalo..................................................................................... 534
Rocovory.IdIo SubSlalo............................................................................................. 535
I0 Slalo .............................................................................................................................. 537
I0s Slalo............................................................................................................................. 538
I0s Transmillor Slalo Maclino ............................................................................... 538
Tx_I0s.Inlry SubSlalo ...................................................................................... 538
Tx_I0s.IdIo SubSlalo ......................................................................................... 538
Tx_I0s.ITS SubSlalo ......................................................................................... 539
I0s Rocoivor Slalo Maclino..................................................................................... 540
Rx_I0s.Inlry SubSlalo...................................................................................... 540
Rx_I0s.IdIo SubSlalo......................................................................................... 540
Rx_I0s.ITS SubSlalo ......................................................................................... 540
I1 Slalo .............................................................................................................................. 541
I1.Inlry SubSlalo...................................................................................................... 541
I1.IdIo SubSlalo......................................................................................................... 542
I2 Slalo .............................................................................................................................. 543
-

I2.IdIo SubSlalo......................................................................................................... 543

I1.TransmilWaIo SubSlalo ..................................................................................... 543
Hol Rosol Slalo.................................................................................................................. 544
DisabIo Slalo...................................................................................................................... 545
IoopbacI Slalo ................................................................................................................. 547
IoopbacI.Inlry SubSlalo......................................................................................... 547
IoopbacI.Aclivo SubSlalo....................................................................................... 548
IoopbacI.Ixil SubSlalo............................................................................................ 548
--
IinI CapabiIily Rogislor ................................................................................................. 549
Maximum IinI Spood|3:0] ...................................................................................... 549
Maximum IinI Widll|9:4]...................................................................................... 550
IinI Slalus Rogislor ......................................................................................................... 551
IinI Spood|3:0]:......................................................................................................... 551
Nogolialo IinI Widll|9:4]....................................................................................... 551
Training Irror|10] ..................................................................................................... 551
IinI Training|11] ...................................................................................................... 551
IinI ConlroI Rogislor ...................................................................................................... 552
IinI DisabIo............................................................................................................... 552
Rolrain IinI ............................................................................................................... 552
Ixlondod Syncl......................................................................................................... 552
-


-

Ixpansion Iorl DoIivors SIol Iovor Iimil................................................................... 562
Ixpansion Dovico Iimils Iovor Consumplion........................................................... 564
- -



Basics of ICI IM.............................................................................................................. 569
OnNov Dosign Inilialivo Sclomo Dofinos OvoraII IM............................................. 571
GoaIs ........................................................................................................................... 572
Syslom IM Slalos...................................................................................................... 572
Dovico IM Slalos....................................................................................................... 573
Dofinilion of Dovico Conloxl................................................................................... 574
-

GonoraI ................................................................................................................ 574

IM Ivonl (IMI) Conloxl ................................................................................. 575
Dovico CIass-Spocific IM Spocificalions ............................................................... 576
DofauIl Dovico CIass Spocificalion.................................................................. 576
Dovico CIass-Spocific IM Spocificalions ........................................................ 576
Iovor Managomonl IoIicy Ovnor ........................................................................ 577
GonoraI ................................................................................................................ 577
In Windovs OS Invironmonl.......................................................................... 577
ICI Ixpross Iovor Managomonl vs. ACII.................................................................. 577
ICI Ixpross Bus Drivor Accossos ICI Ixpross Configuralion and IM Rogislors.
577
ACII Drivor ConlroIs Non-Slandard Imboddod Dovicos ................................. 577
Somo IxampIo Sconarios ......................................................................................... 579
SconarioOS Wislos To Iovor Dovn ICI Ixpross Dovicos..................... 580
SconarioRosloro AII Iunclions To Iovorod Up Slalo .............................. 582
SconarioSolup a Iunclion-Spocific Syslom WaIoUp Ivonl..................... 583

Tlo IM CapabiIily Rogislor Sol ..................................................................................... 585
Dovico IM Slalos.............................................................................................................. 586
D0 SlaloIuII On..................................................................................................... 586
Mandalory. ......................................................................................................... 586
D0 UniniliaIizod................................................................................................. 586
D0 Aclivo ............................................................................................................ 587
D1 SlaloIigll SIoop............................................................................................... 587
D2 SlaloDoop SIoop............................................................................................... 589
D3IuII Off .............................................................................................................. 590
D3Hol Slalo......................................................................................................... 591
D3CoId Slalo....................................................................................................... 592
Iunclion IM Slalo Transilions................................................................................ 593
DolaiIod Doscriplion of ICI-IM Rogislors ................................................................... 596
IM CapabiIilios (IMC) Rogislor............................................................................. 597
IM ConlroI/Slalus (IMCSR) Rogislor .................................................................. 599
Dala Rogislor ............................................................................................................. 603
Dolormining Irosonco of llo Dala Rogislor ................................................... 604
Oporalion of llo Dala Rogislor ........................................................................ 604
MuIli-Iunclion Dovicos .................................................................................... 604
VirluaI ICI-lo-ICI Bridgo Iovor Dala........................................................... 604


I0s Slalo............................................................................................................................. 611
Inlry inlo I0s ............................................................................................................ 611
Inlry inlo I0s Triggorod by IinI IdIo Timo.................................................. 611
-

IIov ConlroI Crodils Musl bo DoIivorod....................................................... 612

Transmillor Inilialos Inlry lo I0s ................................................................... 612
Ixil from I0s Slalo.................................................................................................... 613
Transmillor Inilialos I0s Ixil ........................................................................... 613
Aclions TaIon by Svilclos llal Rocoivo I0s Ixil ......................................... 613
I1 ASIM Slalo.................................................................................................................. 614
Dovnslroam Compononl Docidos lo Inlor I1 ASIM........................................ 615
Nogolialion Roquirod lo Inlor I1 ASIM.............................................................. 616
Sconario 1: Boll Iorls Roady lo Inlor I1 ASIM Slalo........................................ 616
Dovnslroam Compononl Issuos Roquosl lo Inlor I1 Slalo........................ 616
Upslroam Compononl Roquiromonls lo Inlor I1 ASIM............................ 617
Upslroam Compononl AcInovIodgos Roquosl lo Inlor I1........................ 617
Dovnslroam Compononl Dolocls AcInovIodgomonl ................................ 617
Upslroam Compononl Rocoivos IIoclricaI IdIo............................................. 617
Sconario 2: Upslroam Compononl Transmils TII }usl Irior lo Rocoiving I1 Ro-
quosl .......................................................................................................................................... 618
TII Musl Bo Accoplod by Dovnslroam Compononl .................................. 619
Upslroam Compononl Rocoivos Roquosl lo Inlor I1................................... 619
Ixil from I1 ASIM Slalo ......................................................................................... 621
I1 ASIM Ixil SignaIing.................................................................................... 621
Svilcl Rocoivos I1 Ixil from Dovnslroam Compononl............................. 622
Svilcl Rocoivos I1 Ixil from Upslroam Compononl .................................. 623
ASIM Ixil Ialoncy.......................................................................................................... 624
Roporling a VaIid ASIM Ixil Ialoncy .................................................................. 625
I0s Ixil Ialoncy Updalo................................................................................... 625
I1 Ixil Ialoncy Updalo .................................................................................... 626
CaIcuIaling Ialoncy Bolvoon Indpoinl lo Rool CompIox ................................. 626

D1/D2/D3Hol and llo I1 Slalo .................................................................................... 629
Inloring llo I1 Slalo ................................................................................................ 630
Ixiling llo I1 Slalo................................................................................................... 632
Upslroam Compononl Inilialos I1 lo I0 Transilion..................................... 632
Dovnslroam Compononl Inilialos I1 lo I0 Transilion ............................... 633
Tlo I1 Ixil IrolocoI .......................................................................................... 633
I2/I3 Roady Romoving Iovor from llo IinI....................................................... 633
I2/I3 Roady HandslaIo Soquonco....................................................................... 634
Ixiling llo I2/I3 Roady Slalo CIocI and Iovor Romovod.......................... 637
Tlo I2 Slalo................................................................................................................ 637
Tlo I3 Slalo................................................................................................................ 637

Tlo IMI Mossago............................................................................................................ 639
Tlo IMI Soquonco........................................................................................................... 640
-

IMI Mossago BacI Irossuro DoadIocI Avoidanco.................................................... 640

BacIground................................................................................................................ 641
Tlo IrobIom............................................................................................................... 641
Tlo SoIulion............................................................................................................... 641
Tlo IMI Conloxl ............................................................................................................. 642
WaIing Non-Communicaling IinIs............................................................................. 642
Boacon......................................................................................................................... 643
WAKI# (AUX Iovor).............................................................................................. 643
AuxiIiary Iovor ............................................................................................................... 645
-


--
Surpriso RomovaI Nolificalion....................................................................................... 652
Difforoncos bolvoon ICI and ICI Ixpross Hol IIug.................................................. 652
-
Soflvaro IIomonls ........................................................................................................... 655
Hardvaro IIomonls......................................................................................................... 656
- -
On and Off Slalos ............................................................................................................. 658
Dofinilion of On and Off.......................................................................................... 658
Turning SIol Off ........................................................................................................ 658
Turning SIol On......................................................................................................... 659
Card RomovaI Irocoduro................................................................................................ 659
Allonlion Bullon Usod lo Inilialo Hol IIug RomovaI ......................................... 659
Hol IIug RomovaI Roquosl Issuod via Usor Inlorfaco......................................... 660
Card Insorlion Irocoduro................................................................................................ 661
Card Insorlion Inilialod by Irossing Allonlion Bullon ....................................... 661
Card Insorlion Inilialod by Usor Inlorfaco ............................................................ 662
-
BacIground....................................................................................................................... 663
Slandard Usor Inlorfaco .................................................................................................. 664
Allonlion Indicalor ................................................................................................... 664
Iovor Indicalor......................................................................................................... 665
ManuaIIy Oporalod Rolonlion Ialcl and Sonsor................................................. 666
IIoclromoclanicaI InlorIocI (oplionaI).................................................................. 667
Soflvaro Usor Inlorfaco............................................................................................ 667
Allonlion Bullon ....................................................................................................... 667
SIol Numboring Idonlificalion................................................................................ 668
-

SIol CapabiIilios................................................................................................................ 670
SIol Iovor Iimil ConlroI ......................................................................................... 672
SIol ConlroI ....................................................................................................................... 672
SIol Slalus and Ivonls Managomonl ............................................................................. 674
Card SIol vs Sorvor IO ModuIo ImpIomonlalions ....................................................... 676
Dolocling ModuIo and BIado CapabiIilios............................................................. 678
Hol IIug Mossagos ................................................................................................... 678
Allonlion and Iovor Indicalor ConlroI Mossagos ....................................... 678
Allonlion Bullon Irossod Mossago ................................................................. 679
Iimilalions of llo Hol IIug Mossagos............................................................ 679

IlysicaI SIol ID................................................................................................................. 681
-
GonoraI............................................................................................................................... 681
Iausing a Drivor (OplionaI) ........................................................................................... 681
Quioscing a Drivor Tlal ConlroIs MuIlipIo Dovicos ........................................... 682
Quioscing a IaiIod Card........................................................................................... 682
-
- -

Add-in Connoclor ............................................................................................................ 686
AuxiIiary SignaIs.............................................................................................................. 693
GonoraI ....................................................................................................................... 693
Roforonco CIocI......................................................................................................... 694
IIRST# ....................................................................................................................... 695
WAKI#....................................................................................................................... 696
SMBus......................................................................................................................... 698
}TAG........................................................................................................................... 699
IRSNT Iins................................................................................................................ 699
IIoclricaI Roquiromonls................................................................................................... 700
Iovor SuppIy Roquiromonls .................................................................................. 700
Iovor Dissipalion Iimils ........................................................................................ 701
Add-in Card InloroporabiIily......................................................................................... 702
-
GonoraI............................................................................................................................... 703
Sorvor IO ModuIo (SIOM)............................................................................................... 703
Risor Card.......................................................................................................................... 704
Mini ICI Ixpross Card.................................................................................................... 704
NIWCARD form faclor .................................................................................................. 707
-

--


-
-
-
--
Inlroduclion...................................................................................................................... 715
Iunclion Configuralion Spaco........................................................................................ 715
ICI-CompalibIo Spaco ............................................................................................. 715
ICI Ixpross Ixlondod Configuralion Spaco......................................................... 716
- - --
--
--
OnIy llo Rool CompIox Can Originalo Configuralion Transaclions ....................... 718
Configuralion Transaclions OnIy Movo DovnSlroam............................................... 718
No Ioor-lo-Ioor Configuralion Transaclions............................................................... 718
-- -
- -

--

-
BacIground....................................................................................................................... 724
ICI-CompalibIo Configuralion Moclanism
Doscriplion............................................................................................................................... 724
GonoraI ....................................................................................................................... 724
Configuralion Addross Iorl.................................................................................... 725
Bus Comparo and Dala Iorl Usago........................................................................ 726
Targol Bus = 0..................................................................................................... 726
Bus Numbor < Targol Bus Subordinalo Bus Numbor............................... 727
SingIo Hosl/ICI Bridgo........................................................................................... 727
MuIlipIo Hosl/ICI Bridgos..................................................................................... 729
-- -
Doscriplion........................................................................................................................ 731
Somo RuIos........................................................................................................................ 731
-
-
-

--
--
---
Wlals Going On During IniliaIizalion Timo` ............................................................ 738
Dofinilion of IniliaIizalion Ioriod In ICI ..................................................................... 738
Dofinilion of IniliaIizalion Ioriod In ICI-X ................................................................. 739
ICI Ixpross and IniliaIizalion Timo.............................................................................. 739
IniliaI Configuralion Accoss IaiIuro Timooul ...................................................... 739
DoIay Irior To IniliaI Configuralion Accoss lo Dovico ....................................... 739
A Dovico Will a Ionglly SoIf-IniliaIizalion Ioriod ............................................ 740
RC Rosponso To CRS Rocoipl During Run-Timo ........................................................ 740
--

-
- -
OporalionaI Claraclorislics of llo ICI-CompalibIo Moclanism.............................. 754
OporalionaI Claraclorislics of llo Inlancod
Configuralion Moclanism..................................................................................................... 755
Tlo Inumoralion Irocoss ............................................................................................... 755

A MuIlifunclion Dovico Willin a Rool CompIox........................................................ 758
A MuIlifunclion Dovico Willin a Svilcl ..................................................................... 759


GonoraI............................................................................................................................... 763
Rool CompIox Bus Numbor/Dovico Numbor
Assignmonl .............................................................................................................................. 764
Inilialing Roquosls Irior To ID Assignmonl ................................................................ 764
Inilialing CompIolions Irior lo ID Assignmonl .......................................................... 765
- - -
Wlal IrobIom Doos an RCRB Addross` ...................................................................... 765
AddilionaI Informalion on RCRBs................................................................................ 766
-- -
A SpIil Configuralion Transaclion Roquiros a SingIo
CompIolion............................................................................................................................... 766
An Issuo Ior ICI Ixpross-lo-ICI or -ICI-X Bridgos................................................... 767
ICI SpociaI CycIo Transaclions...................................................................................... 767
-

--

GonoraI............................................................................................................................... 770
Hoador Typo 0 Rogislors CompalibIo Will ICI .......................................................... 772
Hoador Typo 0 Rogislors IncompalibIo Will ICI ....................................................... 772
Rogislors Usod lo Idonlify Dovicos Drivor .................................................................. 773
Vondor ID Rogislor ................................................................................................... 773
Dovico ID Rogislor .................................................................................................... 773
Rovision ID Rogislor................................................................................................. 773
CIass Codo Rogislor .................................................................................................. 774
GonoraI ................................................................................................................ 774
Tlo Irogramming Inlorfaco Bylo .................................................................... 774
DolaiIod CIass Codo Doscriplion..................................................................... 775
Subsyslom Vondor ID and Subsyslom ID Rogislors............................................ 776
GonoraI ................................................................................................................ 776
Tlo IrobIom SoIvod by Tlis Rogislor Iair..................................................... 776
Musl Conlain VaIid Dala Wlon Iirsl Accossod............................................ 777
Hoador Typo Rogislor...................................................................................................... 777
BIST Rogislor..................................................................................................................... 778
CapabiIilios Ioinlor Rogislor .......................................................................................... 779
Configuralion Hoador Spaco Nol Iargo Inougl................................................. 779
Discovoring Tlal CapabiIilios Ixisl ....................................................................... 779
Wlal llo CapabiIilios Iisl IooIs IiIo................................................................... 780
CardBus CIS Ioinlor Rogislor ........................................................................................ 782
Ixpansion ROM Baso Addross Rogislor....................................................................... 783
Command Rogislor .......................................................................................................... 785
Slalus Rogislor .................................................................................................................. 788
Caclo Iino Sizo Rogislor ................................................................................................. 790
Maslor Ialoncy Timor Rogislor ...................................................................................... 790
Inlorrupl Iino Rogislor .................................................................................................... 791
Usago In a ICI Iunclion .......................................................................................... 791
Usago In a ICI Ixpross Iunclion............................................................................ 791
Inlorrupl Iin Rogislor...................................................................................................... 792
Usago In a ICI Iunclion .......................................................................................... 792
Usago In a ICI Ixpross Iunclion............................................................................ 792
Baso Addross Rogislors ................................................................................................... 792
Inlroduclion............................................................................................................... 793
IO Spaco Usago.......................................................................................................... 793
Momory Baso Addross Rogislor.............................................................................. 794
Docodor Widll IioId......................................................................................... 794
IrofolclabIo Allribulo Bil ................................................................................. 795
-

Baso Addross IioId............................................................................................ 796

IO Baso Addross Rogislor ........................................................................................ 797
Inlroduclion........................................................................................................ 797
IO BAR Doscriplion........................................................................................... 797
IC-CompalibIo IO Docodor ............................................................................. 797
Iogacy IO Docodors .......................................................................................... 798
Iinding BIocI Sizo and Assigning Addross Rango.............................................. 799
Hov Il WorIs..................................................................................................... 799
A Momory IxampIo .......................................................................................... 799
An IO IxampIo................................................................................................... 800
SmaIIosl/Iargosl Docodor Sizos ............................................................................. 800
SmaIIosl/Iargosl Momory Docodors.............................................................. 800
SmaIIosl/Iargosl IO Docodors......................................................................... 800
Bylo Morging............................................................................................................. 801
Bridgo Musl Discard Unconsumod Irofolclod Dala .......................................... 801
Min_Gnl/Max_Ial Rogislors ......................................................................................... 802

GonoraI............................................................................................................................... 802
Hoador Typo 1 Rogislors CompalibIo Will ICI .......................................................... 803
Hoador Typo 1 Rogislors IncompalibIo Will ICI ....................................................... 804
TorminoIogy...................................................................................................................... 805
Bus Numbor Rogislors..................................................................................................... 805
Inlroduclion............................................................................................................... 805
Irimary Bus Numbor Rogislor................................................................................ 806
Socondary Bus Numbor Rogislor............................................................................ 806
Subordinalo Bus Numbor Rogislor......................................................................... 807
Bridgo Roulos ID Addrossod IacIols Using Bus Numbor
Rogislors.................................................................................................................................... 807
Vondor ID Rogislor .......................................................................................................... 808
Dovico ID Rogislor ........................................................................................................... 808
Rovision ID Rogislor ........................................................................................................ 808
CIass Codo Rogislor ......................................................................................................... 808
Hoador Typo Rogislor...................................................................................................... 808
BIST Rogislor..................................................................................................................... 809
CapabiIilios Ioinlor Rogislor .......................................................................................... 809
Basic Transaclion IiIloring Moclanism........................................................................ 809
Bridgos Momory, Rogislor Sol and Dovico ROM....................................................... 810
Inlroduclion............................................................................................................... 810
Baso Addross Rogislors ............................................................................................ 811
Ixpansion ROM Baso Addross Rogislor................................................................ 811
Bridgos IO IiIlor .............................................................................................................. 811
Inlroduclion............................................................................................................... 811
-

Bridgo Doosnl Supporl Any IO Spaco Bolind Bridgo........................................ 812

Bridgo Supporls 64KB IO Spaco Bolind Bridgo................................................... 813
Bridgo Supporls 4GB IO Spaco Bolind Bridgo..................................................... 817
Bridgos IrofolclabIo Momory IiIlor ............................................................................ 819
An Imporlanl Nolo Irom llo Aullors .................................................................. 819
In ICI................................................................................................................... 820
In ICI Ixpross.................................................................................................... 821
Spoc Roforoncos To IrofolclabIo Momory..................................................... 822
Claraclorislics of IrofolclabIo Momory Dovicos................................................. 823
MuIlipIo Roads YioId llo Samo Dala .............................................................. 823
Bylo Morging Iormillod In llo Ioslod Wrilo Buffor .................................... 823
Claraclorislics of Momory-Mappod IO Dovicos.................................................. 823
Road Claraclorislics.......................................................................................... 824
Wrilo Claraclorislics......................................................................................... 824
Dolormining If Momory Is IrofolclabIo or Nol ................................................... 824
Bridgo Supporl Ior Dovnslroam IrofolclabIo Momory Is OplionaI ............... 825
Musl Supporl > 4GB IrofolclabIo Momory On Socondary Sido....................... 825
RuIos for Bridgo IrofolclabIo Momory Accossos................................................. 829
Bridgos Momory-Mappod IO IiIlor.............................................................................. 830
Bridgo Command Rogislors............................................................................................ 832
Inlroduclion............................................................................................................... 832
Bridgo Command Rogislor ...................................................................................... 832
Bridgo ConlroI Rogislor .......................................................................................... 835
Bridgo Slalus Rogislors.................................................................................................... 837
Inlroduclion............................................................................................................... 837
Bridgo Slalus Rogislor (Irimary Bus)..................................................................... 837
Bridgo Socondary Slalus Rogislor .......................................................................... 840
Bridgo Caclo Iino Sizo Rogislor .................................................................................... 843
Bridgo Ialoncy Timor Rogislors..................................................................................... 843
Bridgo Ialoncy Timor Rogislor (Irimary Bus)...................................................... 843
Bridgo Socondary Ialoncy Timor Rogislor............................................................ 843
Bridgo Inlorrupl-RoIalod Rogislors................................................................................ 844
Inlorrupl Iino Rogislor............................................................................................. 844
Inlorrupl Iin Rogislor............................................................................................... 844
-
AGI CapabiIily ................................................................................................................ 845
AGI Slalus Rogislor ................................................................................................. 845
AGI Command Rogislor ......................................................................................... 846
VilaI Iroducl Dala (VID) CapabiIily............................................................................ 848
Inlroduclion............................................................................................................... 848
Ils Nol RoaIIy VilaI .................................................................................................. 849
Wlal Is VID` ............................................................................................................ 849
-

Wloro Is llo VID RoaIIy Slorod` ........................................................................... 849

VID On Cards vs. Imboddod ICI Dovicos .......................................................... 849
Hov Is VID Accossod`............................................................................................ 849
Roading VID Dala............................................................................................. 850
Wriling VID Dala.............................................................................................. 850
RuIos Tlal AppIy To Boll Road and Wrilos ................................................. 850
VID Dala Slrucluro Mado Up of Doscriplors and Koyvords ........................... 851
VID Road-OnIy Doscriplor (VID-R) and Koyvords.......................................... 853
Is Road-OnIy ClocIsum Koyvord Mandalory` .................................................. 855
VID Road/Wrilo Doscriplor (VID-W) and Koyvords ...................................... 856
IxampIo VID Iisl..................................................................................................... 857
Inlroduclion To Classis/SIol Numboring Rogislors .................................................. 859
Classis and SIol Numbor Assignmonl ......................................................................... 861
IrobIom: Adding/Romoving Bridgo Causos Busos lo Bo Ronumborod........... 861
If Busos Addod/Romovod, SIol IaboIs Musl Romain Corrocl........................... 861
Dofinilion of a Classis ............................................................................................. 862
Classis/SIol Numboring Rogislors........................................................................ 863
ICI-CompalibIo Classis/SIol Numboring Rogislor Sol .............................. 863
Ixpross-Spocific SIol-RoIalod Rogislors.......................................................... 863
Tvo IxampIos ........................................................................................................... 866
Iirsl IxampIo...................................................................................................... 866
Socond IxampIo................................................................................................. 867
- -
- - --



MuIlipIo Codo Imagos ..................................................................................................... 875
Iormal of a Codo Imago.................................................................................................. 878
GonoraI ....................................................................................................................... 878
ROM Hoador Iormal................................................................................................ 879
ROM Dala Slrucluro Iormal ................................................................................... 881
ROM Signaluro .................................................................................................. 883
Vondor ID fioId in ROM dala slrucluro ......................................................... 883
Dovico ID in ROM dala slrucluro.................................................................... 883
Ioinlor lo VilaI Iroducl Dala (VID)............................................................... 884
ICI Dala Slrucluro Iongll............................................................................... 884
ICI Dala Slrucluro Rovision ............................................................................ 884
CIass Codo .......................................................................................................... 884
Imago Iongll...................................................................................................... 884
Rovision IovoI of Codo/Dala .......................................................................... 885
-

Codo Typo........................................................................................................... 885

Indicalor Bylo..................................................................................................... 885


Inlroduclion...................................................................................................................... 888
UnivorsaI Dovico Drivor Iormal.................................................................................... 889
Iassing Rosourco Iisl To IIug-and-IIay OS................................................................ 890
BIOS CaIIs Bus Inumoralors Ior Difforonl Bus Invironmonls ......................... 890
BIOS SoIocls Bool Dovicos and Iinds Drivors Ior Tlom.................................... 891
BIOS Bools IIug-and-IIay OS and Iassos Ioinlor To Il ..................................... 891
OS Iocalos and Ioads Drivors and CaIIs Inil Codo In Iacl............................... 891
-- --

-- -
Inlroduclion...................................................................................................................... 896
Roquirod Rogislors........................................................................................................... 897
GonoraI ....................................................................................................................... 897
ICI Ixpross CapabiIily ID Rogislor ....................................................................... 898
Noxl CapabiIily Ioinlor Rogislor............................................................................ 898
ICI Ixpross CapabiIilios Rogislor .......................................................................... 898
Dovico CapabiIilios Rogislor................................................................................ 900
Dovico ConlroI Rogislor ........................................................................................... 905
Dovico Slalus Rogislor.............................................................................................. 909
IinI Rogislors (Roquirod) ........................................................................................ 912
IinI CapabiIilios Rogislor ................................................................................ 912
IinI ConlroI Rogislor........................................................................................ 915
IinI Slalus Rogislor........................................................................................... 918
SIol Rogislors..................................................................................................................... 920
Inlroduclion............................................................................................................... 920
SIol CapabiIilios Rogislor ......................................................................................... 920
SIol ConlroI Rogislor ................................................................................................ 923
SIol Slalus Rogislor .................................................................................................. 925
Rool Iorl Rogislors .......................................................................................................... 926
Inlroduclion............................................................................................................... 926
Rool ConlroI Rogislor............................................................................................... 926
Rool Slalus Rogislor.................................................................................................. 928
-- -
GonoraI............................................................................................................................... 929
Advancod Irror Roporling CapabiIily.......................................................................... 930
GonoraI ....................................................................................................................... 930
DolaiIod Doscriplion................................................................................................. 930
-

VirluaI ClannoI CapabiIily............................................................................................. 939

Tlo VC Rogislor Sols Iurposo................................................................................ 939
Wlo Musl ImpIomonl Tlis Rogislor Sol`.............................................................. 940
MuIlifunclion Upslroam Iorl Roslriclion.............................................................. 940
Tlo Rogislor Sol......................................................................................................... 940
DolaiIod Doscriplion of VCs.................................................................................... 940
Iorl VC CapabiIily Rogislor 1................................................................................. 941
Iorl VC CapabiIily Rogislor 2................................................................................. 943
Iorl VC ConlroI Rogislor ......................................................................................... 944
Iorl VC Slalus Rogislor............................................................................................ 945
VC Rosourco Rogislors ............................................................................................. 946
GonoraI ................................................................................................................ 946
VC Rosourco CapabiIily Rogislor .................................................................... 946
VC Rosourco ConlroI Rogislor ........................................................................ 948
VC Rosourco Slalus Rogislor ............................................................................ 950
VC Arbilralion TabIo................................................................................................ 951
Iorl Arbilralion TabIos ............................................................................................ 952
Dovico SoriaI Numbor CapabiIily.................................................................................. 952
Iovor Budgoling CapabiIily.......................................................................................... 954
GonoraI ....................................................................................................................... 954
Hov Il WorIs ............................................................................................................ 955

GonoraI............................................................................................................................... 957
Iirmvaro Givos OS Baso Addross of Iacl RCRB....................................................... 957
MisaIignod or IocIod Accossos To an RCRB............................................................... 957
Ixlondod CapabiIilios in an RCRB................................................................................ 957
Tlo RCRB Missing IinI.................................................................................................. 958
-
-
- -
--
-
- -- --
-- -
-- -

-

1-1 Comparison of Iorformanco Ior Iin for Various Busos ...................................................... 15

1-2 33 MHz ICI Bus Basod IIalform.............................................................................................. 17
1-3 TypicaI ICI Bursl Momory Road Bus CycIo ...........................................................................18
1-4 33 MHz ICI Basod Syslom Sloving ImpIomonlalion of a ICI-lo-ICI Bridgo..................19
1-5 ICI Transaclion ModoI...............................................................................................................20
1-6 ICI Bus Arbilralion ....................................................................................................................22
1-7 ICI Transaclion Rolry Moclanism........................................................................................... 23
1-8 ICI Transaclion Disconnocl Moclanism.................................................................................24
1-9 ICI Inlorrupl HandIing.............................................................................................................26
1-10 ICI Irror HandIing IrolocoI.....................................................................................................27
1-11 Addross Spaco Mapping............................................................................................................28
1-12 ICI Configuralion CycIo Gonoralion....................................................................................... 29
1-13 256 Bylo ICI Iunclion Configuralion Rogislor Spaco............................................................30
1-14 Ialosl Gonoralion of ICI Clipsols............................................................................................ 32
1-15 66 MHz ICI Bus Basod IIalform.............................................................................................. 33
1-16 66 MHz/133 MHz ICI-X Bus Basod IIalform........................................................................36
1-17 IxampIo ICI-X Bursl Momory Road Bus CycIo ..................................................................... 37
1-18 ICI-X SpIil Transaclion IrolocoI ..............................................................................................38
1-19 HypollolicaI ICI-X 2.0 Bus Basod IIalform...........................................................................40
1-20 ICI Ixpross IinI.........................................................................................................................41
1-21 ICI Ixpross DifforonliaI SignaI .................................................................................................42
1-22 ICI Ixpross TopoIogy................................................................................................................ 48
1-23 Iov Cosl ICI Ixpross Syslom.................................................................................................. 52
1-24 Anollor Iov Cosl ICI Ixpross Syslom................................................................................... 53
1-25 ICI Ixpross Higl-Ind Sorvor Syslom.....................................................................................54
2-1 Non-Ioslod Road Transaclion IrolocoI...................................................................................59
2-2 Non-Ioslod IocIod Road Transaclion IrolocoI.....................................................................60
2-3 Non-Ioslod Wrilo Transaclion IrolocoI..................................................................................61
2-4 Ioslod Momory Wrilo Transaclion IrolocoI...........................................................................63
2-5 Ioslod Mossago Transaclion IrolocoI......................................................................................64
2-6 Non-Ioslod Momory Road Originalod by CIU and Targoling an Indpoinl ....................65
2-7 Non-Ioslod Momory Road Originalod by Indpoinl and Targoling Momory...................67
2-8 IO Wrilo Transaclion Originalod by CIU, Targoling Iogacy Indpoinl.............................68
2-9 Momory Wrilo Transaclion Originalod by CIU, Targoling Indpoinl................................69
2-10 ICI Ixpross Dovico Iayors ........................................................................................................70
2-11 TII Origin and Doslinalion ......................................................................................................72
2-12 TII AssombIy..............................................................................................................................73
2-13 TII DisassombIy.........................................................................................................................74
2-14 DIII Origin and Doslinalion ...................................................................................................75
2-15 DIII AssombIy ..........................................................................................................................76
2-16 DIII DisassombIy......................................................................................................................76
2-17 III Origin and Doslinalion ......................................................................................................77
2-18 III or Ordorod-Sol Slrucluro ...................................................................................................78
2-19 DolaiIod BIocI Diagram of ICI Ixpross Dovicos Iayors .....................................................79
2-20 TII Slrucluro al llo Transaclion Iayor ................................................................................... 80
2-21 IIov ConlroI Irocoss..................................................................................................................82
-

2-22 IxampIo Sloving QoS CapabiIily of ICI Ixpross ................................................................83

2-23 TC Numbors and VC Buffors .................................................................................................... 85
2-24 Svilcl ImpIomonls Iorl Arbilralion and VC Arbilralion Iogic..........................................86
2-25 Dala IinI Iayor RopIay Moclanism........................................................................................88
2-26 TII and DIII Slrucluro al llo Dala IinI Iayor ...................................................................90
2-27 Non-Ioslod Transaclion on IinI..............................................................................................91
2-28 Ioslod Transaclion on IinI.......................................................................................................92
2-29 TII and DIII Slrucluro al llo IlysicaI Iayor......................................................................94
2-30 IIoclricaI IlysicaI Iayor Sloving DifforonliaI Transmillor and Rocoivor ........................96
2-31 Momory Road Roquosl Ilaso.................................................................................................... 97
2-32 CompIolion vill Dala Ilaso.....................................................................................................99
3-1 MuIli-Iorl ICI Ixpross Dovicos Havo Rouling RosponsibiIilios.......................................106
3-2 ICI Ixpross IinI IocaI Traffic: Ordorod Sols....................................................................... 110
3-3 ICI Ixpross IinI IocaI Traffic: DIIIs..................................................................................112
3-4 ICI Ixpross Transaclion Roquosl And CompIolion TIIs ..................................................115
3-5 Transaclion Iayor IacIol Gonoric 3DW And 4DW Hoadors .............................................119
3-6 Gonoric Syslom Momory And IO Addross Maps.................................................................122
3-7 3DW TII Hoador Addross Rouling IioIds ...........................................................................123
3-8 4DW TII Hoador Addross Rouling IioIds ...........................................................................124
3-9 Indpoinl ClocIs Rouling Of An Inbound TII Using Addross Rouling.........................125
3-10 Svilcl ClocIs Rouling Of An Inbound TII Using Addross Rouling .............................126
3-11 3DW TII Hoador ID Rouling IioIds......................................................................................128
3-12 4DW TII Hoador ID Rouling IioIds......................................................................................129
3-13 Svilcl ClocIs Rouling Of An Inbound TII Using ID Rouling........................................131
3-14 4DW Mossago TII Hoador ImpIicil Rouling IioIds............................................................ 133
3-15 ICI Ixpross Dovicos And Typo 0 And Typo 1 Hoador Uso................................................136
3-16 ICI Ixpross Configuralion Spaco Typo 0 and Typo 1 Hoadors ......................................... 137
3-17 32-Bil IrofolclabIo Momory BAR Sol Up.............................................................................. 139
3-18 64-Bil IrofolclabIo Momory BAR Sol Up.............................................................................. 141
3-19 IO BAR Sol Up...........................................................................................................................143
3-20 6GB, 64-Bil IrofolclabIo Momory Baso/Iimil Rogislor Sol Up ......................................... 145
3-21 2MB, 32-Bil Non-IrofolclabIo Baso/Iimil Rogislor Sol Up................................................147
3-22 IO Baso/Iimil Rogislor Sol Up................................................................................................ 149
3-23 Bus Numbor Rogislors In A Svilcl........................................................................................152
4-1 TII And DIII IacIols............................................................................................................155
4-2 ICI Ixpross Iayorod IrolocoI And TII AssombIy/DisassombIy ....................................158
4-3 Gonoric TII Hoador IioIds......................................................................................................162
4-4 Using Iirsl DW and Iasl DW Bylo InabIo IioIds ................................................................ 168
4-5 Transaclion Doscriplor IioIds .................................................................................................169
4-6 Syslom IO Map..........................................................................................................................171
4-7 3DW IO Roquosl Hoador Iormal............................................................................................ 172
4-8 3DW And 4DW Momory Roquosl Hoador Iormals ............................................................175
4-9 3DW Configuralion Roquosl And Hoador Iormal ..............................................................180
4-10 3DW CompIolion Hoador Iormal ......................................................................................... 184
4-11 4DW Mossago Roquosl Hoador Iormal ................................................................................. 190
4-12 Dala IinI Iayor Sonds A DIII..............................................................................................198
-

4-13 Gonoric Dala IinI Iayor IacIol Iormal................................................................................200

4-14 AcI Or NaI DIII IacIol Iormal ..........................................................................................202
4-15 Iovor Managomonl DIII IacIol Iormal............................................................................204
4-16 IIov ConlroI DIII IacIol Iormal ........................................................................................205
4-17 Vondor Spocific DIII IacIol Iormal....................................................................................207
5-1 Dala IinI Iayor.........................................................................................................................210
5-2 Ovorviov of llo ACK/NAK IrolocoI ...................................................................................211
5-3 IIomonls of llo ACK/NAK IrolocoI..................................................................................... 212
5-4 Transmillor IIomonls Associalod vill llo ACK/NAK IrolocoI ......................................215
5-5 Rocoivor IIomonls Associalod vill llo ACK/NAK IrolocoI............................................218
5-6 AcI Or NaI DIII IacIol Iormal ..........................................................................................219
5-7 IxampIo 1 llal Slovs Transmillor Bolavior vill Rocoipl of an ACK DIII .................223
5-8 IxampIo 2 llal Slovs Transmillor Bolavior vill Rocoipl of an ACK DIII .................224
5-9 IxampIo llal Slovs Transmillor Bolavior on Rocoipl of a NAK DIII..........................226
5-10 TabIo and Iqualion lo CaIcuIalo RIIIAY_TIMIR Ioad VaIuo........................................229
5-11 IxampIo llal Slovs Rocoivor Bolavior vill Rocoipl of Good TII .................................233
5-12 IxampIo llal Slovs Rocoivor Bolavior Wlon Il Rocoivos Bad TIIs............................... 237
5-13 TabIo lo CaIcuIalo ACKNAK_IATINCY_TIMIR Ioad VaIuo ......................................... 239
5-14 Iosl TII HandIing....................................................................................................................245
5-15 Iosl ACK DIII HandIing....................................................................................................... 246
5-16 Iosl ACK DIII HandIing....................................................................................................... 247
5-17 Svilcl Cul-Tlrougl Modo Sloving Irror HandIing.........................................................250
6-1 IxampIo AppIicalion of Isoclronous Transaclion............................................................... 254
6-2 VC Configuralion Rogislors Mappod in Ixlondod Configuralion Addross Spaco ......... 257
6-3 Tlo Numbor of VCs Supporlod by Dovico Can Vary..........................................................259
6-4 Ixlondod VCs Supporlod IioId ..............................................................................................260
6-5 VC Rosourco ConlroI Rogislor.................................................................................................261
6-6 TC lo VC Mapping IxampIo ...................................................................................................262
6-7 ConcopluaI VC Arbilralion IxampIo..................................................................................... 265
6-8 Slricl Arbilralion Iriorily.........................................................................................................266
6-9 Iov Iriorily Ixlondod VC Counl ..........................................................................................267
6-10 Dolormining VC Arbilralion CapabiIilios and SoIocling llo Sclomo ............................... 268
6-11 VC Arbilralion vill Iov- and Higl-Iriorily ImpIomonlalions .......................................269
6-12 Woigllod Round Robin Iov-Iriorily VC Arbilralion TabIo IxampIo.............................270
6-13 VC Arbilralion TabIo Offsol and Ioad VC Arbilralion TabIo IioIds ................................271
6-14 Ioading llo VC Arbilralion TabIo Inlrios ............................................................................272
6-15 IxampIo MuIli-Iunclion Indpoinl ImpIomonlalion vill VC Arbilralion ......................274
6-16 Iorl Arbilralion Concopl .........................................................................................................275
6-17 Iorl Arbilralion TabIos Noodod for nIacl VC.....................................................................276
6-18 Iorl Arbilralion Bufforing .......................................................................................................277
6-19 Soflvaro clocIs Iorl Arbilralion CapabiIilios and SoIocls llo Sclomo lo bo Usod. .......278
6-20 Maximum Timo SIols Rogislor ................................................................................................ 280
6-21 Iormal of Iorl Arbilralion TabIo............................................................................................281
6-22 IxampIo of Iorl and VC Arbilralion villin A Svilcl........................................................ 283
7-1 Iocalion of IIov ConlroI Iogic ..............................................................................................287
7-2 IIov ConlroI Buffor Organizalion..........................................................................................289
-

7-3 IIov ConlroI IIomonls.............................................................................................................292

7-4 Typos and Iormal of IIov ConlroI IacIols.......................................................................... 293
7-5 IIov ConlroI IIomonls IoIIoving IniliaIizalion..................................................................295
7-6 IIov ConlroI IIomonls IoIIoving DoIivory of Iirsl Transaclion...................................... 297
7-7 IIov ConlroI IIomonls vill IIov ConlroI Buffor IiIIod.................................................... 299
7-8 IIov ConlroI RoIIovor IrobIom..............................................................................................300
7-9 IniliaI Slalo of IxampIo IC IIomonls..................................................................................... 304
7-10 INIT1 IIov ConlroI IacIol Iormal and Conlonls ............................................................... 305
7-11 Dovicos Sond and IniliaIizo IIov ConlroI Rogislors............................................................ 306
7-12 Dovico Confirm llal IIov ConlroI IniliaIizalion is CompIolod for a Givon Buffor ........307
7-13 IIov ConlroI Updalo IxampIo ...............................................................................................309
7-14 Updalo IIov ConlroI IacIol Iormal and Conlonls.............................................................310
8-1 IxampIo of SlrongIy Ordorod Transaclions llal RosuIls in Tomporary BIocIing ..........323
9-1 Nalivo ICI Ixpross and Iogacy ICI Inlorrupl DoIivory..................................................... 331
9-2 64-bil MSI CapabiIily Rogislor Iormal .................................................................................. 332
9-3 32-bil MSI CapabiIily Rogislor Sol Iormal ............................................................................332
9-4 Mossago ConlroI Rogislor ........................................................................................................333
9-5 Dovico MSI Configuralion Irocoss......................................................................................... 337
9-6 Iormal of Momory Wrilo Transaclion for Nalivo-Doivo MSI DoIivory............................339
9-7 Inlorrupl Iin Rogislor villin ICI Configuralion Hoador ..................................................343
9-8 INTx SignaI Rouling is IIalform Spocific.............................................................................. 344
9-9 Configuralion Command Rogislor Inlorrupl DisabIo IioId...........................................346
9-10 Configuralion Slalus Rogislor Inlorrupl Slalus IioId..................................................... 347
9-11 Iogacy Dovicos Uso INTx Mossagos VirluaIizo INTA#-INTD# SignaI Transilions........348
9-12 Svilcl CoIIapsos INTx Mossago lo Acliovo Wirod-OR Claraclorislics........................... 350
9-13 INTx Mossago Iormal and Typos...........................................................................................351
9-14 ICI Ixpross Syslom vill ICI-Basod IO ConlroIIor Hub.................................................... 354
10-1 Tlo Scopo of ICI Ixpross Irror ClocIing and Roporling..................................................357
10-2 Iocalion of ICI Ixpross Irror-RoIalod Configuralion Rogislors.......................................360
10-3 Tlo Irror/Ioisonod Bil villin IacIol Hoadors................................................................... 362
10-4 Basic Iormal of llo Irror Mossagos .......................................................................................370
10-5 CompIolion Slalus IioId villin llo CompIolion Hoador ...................................................371
10-6 ICI-CompalibIo Configuralion Command Rogislor ...........................................................373
10-7 ICI-CompalibIo Slalus Rogislor (Irror-RoIalod Bils) ..........................................................374
10-8 ICI Ixpross CapabiIily Rogislor Sol.......................................................................................376
10-9 Dovico ConlroI Rogislor Bil IioIds RoIalod lo Irror HandIing .......................................... 378
10-10 Dovico Slalus Rogislor Bil IioIds RoIalod lo Irror HandIing ............................................. 379
10-11 IinI ConlroI Rogislor AIIovs Rolraining of IinI ................................................................ 380
10-12 IinI Rolraining Slalus Bils villin llo IinI Slalus Rogislor...............................................380
10-13 Rool ConlroI Rogislor ............................................................................................................... 381
10-14 Advancod Irror CapabiIily Rogislors ....................................................................................382
10-15 Tlo Advancod Irror CapabiIily & ConlroI Rogislor ...........................................................383
10-16 Advancod CorroclabIo Irror Slalus Rogislor ........................................................................385
10-17 Advancod CorroclabIo Irror MasI Rogislor .........................................................................386
10-18 Advancod UncorroclabIo Irror Slalus Rogislor....................................................................387
10-19 Advancod UncorroclabIo Irror Sovorily Rogislor ................................................................388
-

10-20 Advancod UncorroclabIo Irror MasI Rogislor.....................................................................389

10-21 Rool Irror Slalus Rogislor ....................................................................................................... 391
10-22 Advancod Sourco ID Rogislor .................................................................................................391
10-23 Advancod Rool Irror Command Rogislor ............................................................................392
10-24 Irror HandIing IIov Clarl .....................................................................................................393
11-1 IlysicaI Iayor............................................................................................................................398
11-2 IogicaI and IIoclricaI Sub-BIocIs of llo IlysicaI Iayor ..................................................... 399
11-3 IlysicaI Iayor DolaiIs ..............................................................................................................401
11-4 IlysicaI Iayor Transmil Iogic DolaiIs .................................................................................. 406
11-5 Transmil Iogic MuIlipIoxor.....................................................................................................407
11-6 TII and DIII IacIol Iraming vill Slarl and Ind ConlroI Claraclors .........................408
11-7 x1 Bylo Slriping .........................................................................................................................409
11-8 x4 Bylo Slriping .........................................................................................................................410
11-9 x8, x12, x16, x32 Bylo Slriping.................................................................................................411
11-10 x1 IacIol Iormal .......................................................................................................................413
11-11 x4 IacIol Iormal .......................................................................................................................414
11-12 x8 IacIol Iormal .......................................................................................................................415
11-13 ScrambIor....................................................................................................................................418
11-14 IxampIo of 8-bil Claraclor of 00l Incodod lo 10-bil SymboI............................................420
11-15 Iroparing 8-bil Claraclor for Incodo ....................................................................................422
11-16 8-bil lo 10-bil (8b/10b) Incodor..............................................................................................425
11-17 IxampIo 8-bil/10-bil Incodings.............................................................................................426
11-18 IxampIo 8-bil/10-bil Transmission........................................................................................427
11-19 SKII Ordorod-Sol ......................................................................................................................437
11-20 IlysicaI Iayor Rocoivo Iogic DolaiIs.....................................................................................438
11-21 Rocoivor Iogics Ironl Ind Ior Iano .....................................................................................439
11-22 Rocoivors IinI Do-SIov Iogic...............................................................................................445
11-23 8b/10b Docodor por Iano ........................................................................................................447
11-24 IxampIo of DoIayod Disparily Irror Doloclion....................................................................448
11-25 IxampIo of x8 Bylo Un-Slriping .............................................................................................449
12-1 IIoclricaI Sub-BIocI of llo IlysicaI Iayor ............................................................................454
12-2 DifforonliaI Transmillor/Rocoivor.......................................................................................... 455
12-3 Rocoivor DC Common Modo VoIlago Roquiromonl............................................................458
12-4 Rocoivor Doloclion Moclanism...............................................................................................460
12-5 IicloriaI Roprosonlalion of DifforonliaI IoaI-lo-IoaI and DifforonliaI IoaI VoIlagos.. 463
12-6 IIoclricaI IdIo Ordorod-Sol....................................................................................................... 464
12-7 Transmission vill Do-omplasis ............................................................................................ 467
12-8 IrobIom of Inlor-SymboI Inlorforonco ...................................................................................468
12-9 SoIulion is Iro-omplasis..........................................................................................................468
12-10 IVDS (Iov-VoIlago DifforonliaI SignaI) Transmillor Iyo Diagram.................................472
12-11 Transmillor Iyo Diagram }illor Indicalion............................................................................473
12-12 Transmillor Iyo Diagram Noiso/Allonualion Indicalion ..................................................474
12-13 Scroon Capluro of a NormaI Iyo (Will no Do-omplasis Slovn) .....................................475
12-14 Scroon Capluro of a Bad Iyo Sloving Iffocl of }illor, Noiso and
SignaI Allonualion (Will no Do-omplasis Slovn) .............................................................476
12-15 CompIianco Tosl/Moasuromonl Ioad...................................................................................479
-

12-16 Rocoivor Iyo Diagram..............................................................................................................481

12-17 I0 IuII-On IinI Slalo ............................................................................................................... 482
12-18 I0s Iov Iovor IinI Slalo ....................................................................................................... 483
12-19 I1 Iov Iovor IinI Slalo.........................................................................................................484
12-20 I2 Iov Iovor IinI Slalo.........................................................................................................485
12-21 I3 IinI Off Slalo .......................................................................................................................486
13-1 IIRST# Gonoralion...................................................................................................................490
13-2 TS1 Ordorod-Sol Sloving llo Hol Rosol Bil.........................................................................491
13-3 Socondary Bus Rosol Rogislor lo Gonoralo Hol Rosol..........................................................493
13-4 Svilcl Gonoralos Hol Rosol on Ono Dovnslroam Iorl ......................................................494
13-5 Svilcl Gonoralos Hol Rosol on AII Dovnslroam Iorls ......................................................495
14-1 IinI Training and Slalus Slalo Maclino Iocalion ...............................................................501
14-2 IxampIo Sloving Iano RovorsaI ...........................................................................................502
14-3 IxampIo Sloving IoIarily Invorsion ....................................................................................503
14-4 Iivo Ordorod-Sols Usod in llo IinI Training and IniliaIizalion Irocoss .........................504
14-5 IinI Training and Slalus Slalo Maclino (ITSSM) ...............................................................510
14-6 Dolocl Slalo Maclino ................................................................................................................515
14-7 IoIIing Slalo Maclino...............................................................................................................519
14-8 Configuralion Slalo Maclino ..................................................................................................520
14-9 Combining Ianos lo form IinIs .............................................................................................524
14-10 IxampIo 1 IinI Numboring and Iano Numboring.............................................................527
14-11 IxampIo 2 IinI Numboring and Iano Numboring.............................................................529
14-12 IxampIo 3 IinI Numboring and Iano Numboring.............................................................532
14-13 Rocovory Slalo Maclino........................................................................................................... 537
14-14 I0s Transmillor Slalo Maclino................................................................................................539
14-15 I0s Rocoivor Slalo Maclino .....................................................................................................541
14-16 I1 Slalo Maclino .......................................................................................................................542
14-17 I2 Slalo Maclino .......................................................................................................................544
14-18 Hol Rosol Slalo Maclino ..........................................................................................................545
14-19 DisabIo Slalo Maclino ..............................................................................................................546
14-20 IoopbacI Slalo Maclino ..........................................................................................................549
14-21 IinI CapabiIilios Rogislor........................................................................................................550
14-22 IinI Slalus Rogislor ..................................................................................................................552
14-23 IinI ConlroI Rogislor ............................................................................................................... 553
15-1 Syslom AIIocalod Bil.................................................................................................................559
15-2 IIomonls InvoIvod in Iovor Budgol......................................................................................561
15-3 SIol Iovor Iimil Soquonco ......................................................................................................563
15-4 Iovor Budgol CapabiIily Rogislors........................................................................................565
15-5 Iovor Budgol Dala IioId Iormal and Dofinilion ................................................................ 566
16-1 RoIalionslip of OS, Dovico Drivors, Bus Drivor, ICI Ixpross Rogislors, and ACII.......578
16-2 IxampIo of OS Iovoring Dovn AII Iunclions On
ICI Ixpross IinIs and llon llo IinIs TlomsoIvos .............................................................581
16-3 IxampIo of OS Rosloring a ICI Ixpross Iunclion To IuII Iovor .....................................583
16-4 OS Iroparos a Iunclion To Causo Syslom WaIoUp On Dovico-Spocific Ivonl ..............584
16-5 ICI Iovor Managomonl CapabiIily Rogislor Sol .................................................................586
16-6 ICI Ixpross Iunclion Iovor Managomonl Slalo Transilions ............................................594
-

16-7 ICI Iunclions IM Rogislors...................................................................................................596

16-8 Iovor Managomonl CapabiIilios (IMC) Rogislor - Road OnIy ......................................... 597
16-9 Iovor Managomonl ConlroI/Slalus (IMCSR) Rogislor - R/W........................................600
16-10 IM Rogislors ..............................................................................................................................605
16-11 ASIM IinI Slalo Transilions ..................................................................................................609
16-12 ASIM Supporl...........................................................................................................................610
16-13 Aclivo Slalo IM ConlroI IioId.................................................................................................611
16-14 Iorls llal Inilialo I1 ASIM Transilions ................................................................................615
16-15 Nogolialion Soquonco Roquirod lo Inlor I1 Aclivo Slalo IM............................................618
16-16 Nogolialion Soquonco RosuIling in Rojoclion lo Inlor I1 ASIM Slalo.............................621
16-17 Svilcl Bolavior Wlon Dovnslroam Compononl SignaIs I1 Ixil ....................................623
16-18 Svilcl Bolavior Wlon Upslroam Compononl SignaIs I1 Ixil ......................................... 624
16-19 IxampIo of TolaI I1 Ialoncy...................................................................................................627
16-20 Config. Rogislors Usod for ASIM Ixil Ialoncy Managomonl and Roporling.................628
16-21 Dovicos Transilion lo I1 Wlon Soflvaro Clangos lloir Iovor IovoI from D0..............629
16-22 Soflvaro IIacing a Dovico inlo a D2 Slalo and Subsoquonl Transilion lo I1 ..................630
16-23 Irocoduro Usod lo Transilion a IinI from llo I0 lo I1 Slalo ............................................632
16-24 IinI Slalos Transilions Associalod vill Iroparing Dovicos
for RomovaI of llo Roforonco CIocI and Iovor ...................................................................634
16-25 Nogolialion for Inloring I2/I3 Roady Slalo........................................................................636
16-26 Slalo Transilions from I2/I3 Roady Wlon Iovor is Romovod........................................637
16-27 IMI Mossago Iormal............................................................................................................... 639
16-28 WAKI# SignaI ImpIomonlalions............................................................................................644
16-29 AuxiIiary Curronl InabIo for Dovicos Nol Supporling IMIs ...........................................645
17-1 ICI Hol IIug IIomonls.............................................................................................................653
17-2 ICI Ixpross Hol-IIug Hardvaro/Soflvaro IIomonls ........................................................654
17-3 Hol IIug ConlroI Iunclions villin a Svilcl........................................................................669
17-4 ICI Ixpross Configuralion Rogislors Usod for Hol-IIug ...................................................670
17-5 Allonlion Bullon and Hol IIug Indicalors Irosonl Bils ......................................................671
17-6 SIol ConlroI Rogislor IioIds .....................................................................................................673
17-7 SIol Slalus Rogislor IioIds........................................................................................................675
17-8 Iocalion of Allonlion Bullon and Indicalors ........................................................................677
17-9 Hol-IIug CapabiIily Bils for Sorvor IO ModuIos .................................................................678
17-10 Hol IIug Mossago Iormal ....................................................................................................... 680
18-1 ICI Ixpross x1 connoclor.........................................................................................................687
18-2 ICI Ixpross Connoclors on Syslom Board............................................................................688
18-3 IIRST Timing During Iovor Up...........................................................................................695
18-4 IIRST# Timing During Iovor Managomonl Slalos............................................................ 696
18-5 IxampIo of WAKI# Circuil Iroloclion..................................................................................698
18-6 Irosonco Dolocl..........................................................................................................................700
18-7 ICI Ixpross Risor Card ............................................................................................................704
18-8 Mini ICI Ixpross Add-in Card InslaIIod in a MobiIo IIalform.........................................705
18-9 Mini ICI Ixpross Add-in Card Ilolo 1 ................................................................................706
18-10 Mini ICI Ixpross Add-in Card Ilolo 2 ................................................................................706
19-1 IxampIo Syslom........................................................................................................................713
19-2 TopoIogy Viov Al Slarlup....................................................................................................... 714
-

19-3 4KB Configuralion Spaco por ICI Ixpross Iunclion...........................................................717

19-4 Hoador Typo Rogislor...............................................................................................................719
20-1 A Iunclions Configuralion Spaco..........................................................................................723
20-2 Configuralion Addross Iorl al 0CI8l ...................................................................................726
20-3 IxampIo Syslom........................................................................................................................728
20-4 Ioor Rool CompIoxos................................................................................................................730
20-5 Typo 0 Configuralion Road Roquosl IacIol Hoador ...........................................................733
20-6 Typo 0 Configuralion Wrilo Roquosl IacIol Hoador ..........................................................733
20-7 Typo 1 Configuralion Road Roquosl IacIol Hoador ...........................................................734
20-8 Typo 1 Configuralion Wrilo Roquosl IacIol Hoador ..........................................................734
20-9 IxampIo Configuralion Accoss............................................................................................... 737
21-1 TopoIogy Viov Al Slarlup....................................................................................................... 742
21-2 IxampIo Syslom Boforo Bus Inumoralion............................................................................748
21-3 IxampIo Syslom Aflor Bus Inumoralion ..............................................................................749
21-4 Hoador Typo Rogislor...............................................................................................................750
21-5 CapabiIily Rogislor ...................................................................................................................750
21-6 Hoador Typo 0 ...........................................................................................................................751
21-7 Hoador Typo 1 ...........................................................................................................................752
21-8 Ioor Rool CompIoxos................................................................................................................757
21-9 MuIlifunclion Bridgos in Rool CompIox ...............................................................................759
21-10 Iirsl IxampIo of a MuIlifunclion Bridgo In a Svilcl ..........................................................760
21-11 Socond IxampIo of a MuIlifunclion Bridgo In a Svilcl......................................................761
21-12 Imboddod Rool Indpoinl .......................................................................................................762
21-13 Imboddod Svilcl Indpoinl ...................................................................................................763
21-14 Typo 0 Configuralion Wrilo Roquosl IacIol Hoador ..........................................................764
21-15 RCRB IxampIo ..........................................................................................................................766
22-1 Hoador Typo 0 ...........................................................................................................................771
22-2 CIass Codo Rogislor .................................................................................................................. 775
22-3 Hoador Typo Rogislor Bil Assignmonl...................................................................................778
22-4 BIST Rogislor Bil Assignmonl .................................................................................................778
22-5 Slalus Rogislor ...........................................................................................................................780
22-6 GonoraI Iormal of a Nov CapabiIilios Iisl Inlry................................................................ 782
22-7 Ixpansion ROM Baso Addross Rogislor Bil Assignmonl....................................................785
22-8 Command Rogislor ...................................................................................................................785
22-9 ICI Configuralion Slalus Rogislor..........................................................................................788
22-10 32-Bil Momory Baso Addross Rogislor Bil Assignmonl ......................................................796
22-11 64-Bil Momory Baso Addross Rogislor Bil Assignmonl ......................................................797
22-12 IO Baso Addross Rogislor Bil Assignmonl ............................................................................798
22-13 Hoador Typo 1 ...........................................................................................................................803
22-14 IO Baso Rogislor ........................................................................................................................815
22-15 IO Iimil Rogislor.......................................................................................................................815
22-16 IxampIo of IO IiIloring Aclions ............................................................................................. 817
22-17 IrofolclabIo Momory Baso Rogislor.......................................................................................827
22-18 IrofolclabIo Momory Iimil Rogislor ..................................................................................... 828
22-19 Momory-Mappod IO Baso Rogislor ........................................................................................831
22-20 Momory-Mappod IO Iimil Rogislor ......................................................................................831
-

22-21 Command Rogislor ...................................................................................................................832

22-22 Bridgo ConlroI Rogislor............................................................................................................835
22-23 Irimary Inlorfaco Slalus Rogislor ...........................................................................................838
22-24 Socondary Slalus Rogislor........................................................................................................841
22-25 Iormal of llo AGI CapabiIily Rogislor Sol...........................................................................845
22-26 VID CapabiIily Rogislors ........................................................................................................851
22-27 Classis and SIol Numbor Rogislors .......................................................................................859
22-28 Main Classis..............................................................................................................................862
22-29 Ixpansion SIol Rogislor............................................................................................................864
22-30 SIol CapabiIily Rogislor............................................................................................................865
22-31 ICI Ixpross CapabiIilios Rogislor...........................................................................................865
22-32 Classis IxampIo Ono ...............................................................................................................867
22-33 Classis IxampIo Tvo...............................................................................................................869
23-1 Ixpansion ROM Baso Addross Rogislor Bil Assignmonl....................................................873
23-2 Hoador Typo Zoro Configuralion Rogislor Iormal..............................................................874
23-3 MuIlipIo Codo Imagos Conlainod In Ono Dovico ROM......................................................877
23-4 Codo Imago Iormal ..................................................................................................................879
23-5 AX Conlonls On Inlry To IniliaIizalion Codo......................................................................888
24-1 Iunclions Configuralion Spaco Iayoul ................................................................................895
24-2 ICI Ixpross CapabiIily Rogislor Sol.......................................................................................897
24-3 ICI Ixpross CapabiIilios Rogislor...........................................................................................898
24-4 Dovico CapabiIilios Rogislor.................................................................................................... 901
24-5 Dovico ConlroI Rogislor ........................................................................................................... 906
24-6 Dovico Slalus Rogislor ..............................................................................................................910
24-7 IinI CapabiIilios Rogislor........................................................................................................913
24-8 IinI ConlroI Rogislor ...............................................................................................................916
24-9 IinI Slalus Rogislor ..................................................................................................................918
24-10 SIol CapabiIilios Rogislor .........................................................................................................921
24-11 SIol ConlroI Rogislor.................................................................................................................923
24-12 SIol Slalus Rogislor ...................................................................................................................925
24-13 Rool ConlroI Rogislor ............................................................................................................... 927
24-14 Rool Slalus Rogislor..................................................................................................................928
24-15 Inlancod CapabiIily Hoador Rogislor...................................................................................930
24-16 Advancod Irror Roporling CapabiIily Rogislor Sol.............................................................931
24-17 Advancod Irror Roporling Inlancod CapabiIily Hoador................................................. 935
24-18 Advancod Irror CapabiIilios and ConlroI Rogislor .............................................................935
24-19 Advancod Irror CorroclabIo Irror MasI Rogislor...............................................................935
24-20 Advancod Irror CorroclabIo Irror Slalus Rogislor..............................................................936
24-21 Advancod Irror UncorroclabIo Irror MasI Rogislor ..........................................................936
24-22 Advancod Irror UncorroclabIo Irror Sovorily Rogislor......................................................937
24-23 Advancod Irror UncorroclabIo Irror Slalus Rogislor .........................................................937
24-24 Advancod Irror Rool Irror Command Rogislor..................................................................938
24-25 Advancod Irror Rool Irror Slalus Rogislor.......................................................................... 938
24-26 Advancod Irror UncorroclabIo and UncorroclabIo Irror Sourco ID Rogislors ...............938
24-27 Iorl and VC Arbilralion...........................................................................................................939
24-28 VirluaI ClannoI CapabiIily Rogislor Sol................................................................................941
-

24-29 VC Inlancod CapabiIily Hoador ...........................................................................................941

24-30 Iorl VC CapabiIily Rogislor 1 (Road-OnIy) ..........................................................................942
24-31 Iorl VC CapabiIily Rogislor 2 (Road-OnIy) ..........................................................................943
24-32 Iorl VC ConlroI Rogislor (Road-Wrilo) ................................................................................. 944
24-33 Iorl VC Slalus Rogislor (Road-OnIy) ..................................................................................... 946
24-34 VC Rosourco CapabiIily Rogislor............................................................................................947
24-35 VC Rosourco ConlroI Rogislor (Road-Wrilo).........................................................................948
24-36 VC Rosourco Slalus Rogislor (Road-OnIy) ............................................................................951
24-37 Dovico SoriaI Numbor Inlancod CapabiIily Hoador ..........................................................953
24-38 Dovico SoriaI Numbor Rogislor ...............................................................................................953
24-39 IUI-64 Iormal ...........................................................................................................................954
24-40 Iovor Budgol Rogislor Sol .....................................................................................................955
24-41 Iovor Budgoling Inlancod CapabiIily Hoador .................................................................955
24-42 Iovor Budgoling Dala Rogislor..............................................................................................956
24-43 Iovor Budgoling CapabiIily Rogislor....................................................................................956
24-44 RCRB IxampIo ..........................................................................................................................958
A-1 ICI IaraIIoI Bus Slarl and Ind of a Transaclion IasiIy Idonlifiod ....................................962
A-2 ICI Ixpross SoriaI Bil Slroam..................................................................................................964
A-3 ICI Ixpross DuaI-SimpIox Bus ...............................................................................................965
A-4 Capluring AII Iallorns on ICI Ixpross ................................................................................. 966
A-5 Spocific Triggor Dofinilion for Upslroam or Dovnslroam Iair .........................................967
A-6 Slarl vill TS1 ............................................................................................................................968
A-7 SKII.............................................................................................................................................969
A-8 CompIolion of 1024 TS1 ........................................................................................................... 970
A-9 Iano Numbor DocIaralion ....................................................................................................... 971
A-10 Slarl of TS2.................................................................................................................................972
A-11 IniliaIizalion of IIov ConlroI 1...............................................................................................973
A-12 IniliaIizalion of IIov ConlroI 2...............................................................................................974
A-13 IIov ConlroI Updalos .............................................................................................................. 975
A-14 AIlornalo DispIay in Iisling Iormal ......................................................................................976
A-15 Mid-bus Iad Dofinilion............................................................................................................978
A-16 Mid-Bus Suggoslod SignaI Assignmonl................................................................................. 979
A-17 Ixorcisor Covoring AII IossibIo Commands ........................................................................981
A-18 Ixorcisor Bil IovoI ManipuIalion AIIoving Various Oplions............................................982
A-19 Supporling AII Iayors, SimuIlanoousIy ................................................................................983
A-20 }illor AnaIysis of a Transcoivor sourco cIocIAccoplabIo (for a spocific dovico)...........986
A-21 }illor anaIysis of a Transcoivor sourco cIocIUnaccoplabIo (for a spocific dovico) .......987
B--1 Migralion from ICI lo ICI Ixpross........................................................................................990
B--2 ICI Ixpross in a DosIlop Syslom...........................................................................................992
B--3 ICI Ixpross in a Sorvor Syslom..............................................................................................993
B--4 ICI Ixpross in Imboddod-ConlroI AppIicalions.................................................................994
B--5 ICI Ixpross in a Slorago Syslom ............................................................................................ 995
B--6 ICI Ixpross in Communicalions Sysloms............................................................................997
C--1 Inumoralion Using Transparonl Bridgos............................................................................1002
C--2 Dirocl Addross TransIalion....................................................................................................1004
C--3 IooI Up TabIo TransIalion Croalos MuIlipIo Windovs ................................................... 1005
-

C--4 InloIIigonl Adaplors in ICI and ICI Ixpross Sysloms ...................................................... 1006
C--5 Hosl IaiIovor in ICI and ICI Ixpross Sysloms..................................................................1008
C--6 DuaI Hosl in a ICI and ICI Ixpross Syslom......................................................................1010
C--7 DuaI-Slar Iabric ......................................................................................................................1012
C--8 Dirocl Addross TransIalion....................................................................................................1014
C--9 IooIup TabIo Basod TransIalion ..........................................................................................1015
C--10 Uso of Iimil Rogislor ..............................................................................................................1016
D--1 CIass Codo Rogislor ................................................................................................................1019
I-1 IocI Soquonco Bogins vill Momory Road IocI Roquosl ................................................1037
I-2 IocI CompIolos vill Momory Wrilo IoIIovod by UnIocI Mossago ............................. 1038
-

1 IC Arclilocluro BooI Sorios ....................................................................................... 1

1-1 Bus Spocificalions and RoIoaso Dalos ...................................................................... 12
1-2 Comparison of Bus Iroquoncy, Bandvidll and Numbor of SIols ..................... 13
1-3 ICI Ixpross Aggrogalo Tlrouglpul for Various IinI Widlls............................ 14
2-1 ICI Ixpross Non-Ioslod and Ioslod Transaclions................................................ 56
2-2 ICI Ixpross TII IacIol Typos ................................................................................. 57
2-3 ICI Ixpross Aggrogalo Tlrouglpul for Various IinI Widlls.......................... 101
3-1 Ordorod Sol Typos .................................................................................................... 109
3-2 Dala IinI Iayor IacIol (DIII) Typos .................................................................. 111
3-3 ICI Ixpross Addross Spaco And Transaclion Typos .......................................... 113
3-4 ICI Ixpross Ioslod and Non-Ioslod Transaclions.............................................. 116
3-5 ICI Ixpross TII Varianls And Rouling Oplions ................................................ 117
3-6 TII Hoador Typo and Iormal IioId Incodings................................................... 120
3-7 Mossago Roquosl Hoador Typo IioId Usago......................................................... 134
3-8 RosuIls Of Roading Tlo BAR aflor Wriling AII 1s To Il .................................. 140
3-9 RosuIls Of Roading Tlo BAR Iair aflor Wriling AII 1s To Boll .................... 142
3-10 RosuIls Of Roading Tlo IO BAR aflor Wriling AII 1s To Il ............................ 144
3-11 6 GB, 64-Bil IrofolclabIo Baso/Iimil Rogislor Solup.......................................... 146
3-12 2MB, 32-Bil Non-IrofolclabIo Baso/Iimil Rogislor Solup................................. 148
3-13 256 Bylo IO Baso/Iimil Rogislor Solup ................................................................. 150
4-1 ICI Ixpross Addross Spaco And Transaclion Typos .......................................... 159
4-2 TII Hoador Typo IioId Dofinos Transaclion Varianl ......................................... 160
4-3 TII Hoador Typo IioId Dofinos Transaclion Varianl ......................................... 161
4-4 Gonoric Hoador IioId Summary............................................................................. 163
4-5 TII Hoador Typo and Iormal IioId Incodings................................................... 165
4-6 IO Roquosl Hoador IioIds........................................................................................ 173
4-7 4DW Momory Roquosl Hoador IioIds................................................................... 176
4-8 Configuralion Roquosl Hoador IioIds ................................................................... 181
4-9 CompIolion Hoador IioIds ...................................................................................... 185
4-10 Mossago Roquosl Hoador IioIds ............................................................................. 191
4-11 INTx Inlorrupl SignaIing Mossago Coding........................................................... 193
4-12 Iovor Managomonl Mossago Coding................................................................... 194
4-13 Irror Mossago Coding ............................................................................................. 195
4-14 UnIocI Mossago Coding.......................................................................................... 196
4-15 SIol Iovor Iimil Mossago Coding......................................................................... 196
4-16 Hol IIug Mossago Coding....................................................................................... 197
4-17 DIII IacIol Typos................................................................................................... 201
4-18 AcI or NaI DIII IioIds.......................................................................................... 203
4-19 Iovor Managomonl DIII IioIds........................................................................... 204
4-20 IIov ConlroI DIII IioIds....................................................................................... 206
4-21 Vondor-Spocific DIII IioIds.................................................................................. 207
5-1 AcI or NaI DIII IioIds.......................................................................................... 219
-

6-1 IxampIo TC lo VC Mappings ................................................................................. 263

7-1 Roquirod Minimum IIov ConlroI Advorlisomonls ............................................ 303
8-1 Transaclions Tlal Can Bo Roordorod Duo lo RoIaxod Ordoring....................... 321
8-2 IundamonlaI Ordoring RuIos Basod on Slrong Ordoring and RO Allribulo .. 322
8-3 WoaI Ordoring RuIos Inlanco Iorformanco ....................................................... 326
8-4 Ordoring RuIos vill DoadIocI Avoidanco RuIos ................................................ 327
9-1 Iormal and Usago of Mossago ConlroI Rogislor.................................................. 333
9-2 INTx Mossago Codos................................................................................................ 351
10-1 Irror Mossago Codos and Doscriplion .................................................................. 371
10-2 CompIolion Codo and Doscriplion ........................................................................ 372
10-3 Irror-RoIalod Command Rogislor Bils .................................................................. 373
10-4 Doscriplion of ICI-CompalibIo Slalus Rogislor Bils for Roporling Irrors....... 374
10-5 DofauIl CIassificalion of Irrors............................................................................... 377
10-6 Transaclion Iayor Irrors Tlal aro Ioggod........................................................... 389
11-1 5-bil lo 6-bil Incodo TabIo for Dala Claraclors ................................................... 427
11-2 5-bil lo 6-bil Incodo TabIo for ConlroI Claraclors .............................................. 429
11-3 3-bil lo 4-bil Incodo TabIo for Dala Claraclors ................................................... 429
11-4 3-bil lo 4-bil Incodo TabIo for ConlroI Claraclors .............................................. 430
11-5 ConlroI Claraclor Incoding and Dofinilion......................................................... 432
12-1 Oulpul Drivor Claraclorislics................................................................................. 477
12-2 Inpul Rocoivor Claraclorislics ................................................................................ 480
14-1 Summary of TS1 and TS2 Ordorod-Sol Conlonls................................................. 506
15-1 Maximum Iovor Consumplion for Syslom Board Ixpansion SIols ................ 562
16-1 Major Soflvaro/Hardvaro IIomonls InvoIvod In IC IM................................. 569
16-2 Syslom IM Slalos as Dofinod by llo OnNov Dosign Inilialivo ........................ 572
16-3 OnNov Dofinilion of Dovico-IovoI IM Slalos..................................................... 573
16-4 Conciso Doscriplion of OnNov Dovico IM Slalos .............................................. 574
16-5 DofauIl Dovico CIass IM Slalos.............................................................................. 576
16-6 D0 Iovor Managomonl IoIicios............................................................................. 587
16-7 D1 Iovor Managomonl IoIicios............................................................................. 588
16-8 D2 Iovor Managomonl IoIicios............................................................................. 590
16-9 D3lol Iovor Managomonl IoIicios ....................................................................... 592
16-10 D3coId Iovor Managomonl IoIicios ..................................................................... 593
16-11 Doscriplion of Iunclion Slalo Transilions............................................................. 594
16-12 Iunclion Slalo Transilion DoIays ........................................................................... 596
16-13 Tlo IMC Rogislor Bil Assignmonls ....................................................................... 597
16-14 IM ConlroI/Slalus Rogislor (IMCSR) Bil Assignmonls .................................... 600
16-15 Dala Rogislor Inlorprolalion.................................................................................... 605
16-16 RoIalionslip Bolvoon Dovico and IinI Iovor Slalos......................................... 607
16-17 IinI Iovor Slalo Claraclorislics............................................................................ 608
16-18 Aclivo Slalo Iovor Managomonl ConlroI IioId Dofinilion................................ 610
17-1 Inlroduclion lo Major Hol-IIug Soflvaro IIomonls............................................ 655
-

17-2 Major Hol-IIug Hardvaro IIomonls..................................................................... 656

17-3 Bolavior and Moaning of llo SIol Allonlion Indicalor ....................................... 665
17-4 Bolavior and Moaning of llo Iovor Indicalor .................................................... 666
17-5 SIol CapabiIily Rogislor IioIds and Doscriplions................................................. 671
17-6 SIol ConlroI Rogislor IioIds and Doscriplions...................................................... 673
17-7 SIol Slalus Rogislor IioIds and Doscriplions......................................................... 675
17-8 Tlo Irimilivos ........................................................................................................... 682
18-1 ICI Ixpross Connoclor Iinoul................................................................................ 689
18-2 ICI Ixpross Connoclor AuxiIiary SignaIs............................................................. 693
18-3 Iovor SuppIy Roquiromonls .................................................................................. 701
18-4 Add-in Card Iovor Dissipalion............................................................................. 702
18-5 Card InloroporabiIily................................................................................................ 703
20 - 1 Inlancod Configuralion Moclanism Momory-Mappod IO Addross Rango .. 732
21 - 1 CapabiIily Rogislors Dovico/Iorl Typo IioId Incoding.................................... 753
22-1 Dofinod CIass Codos ................................................................................................ 775
22-2 BIST Rogislor Bil Assignmonl ................................................................................. 779
22-3 CurronlIy-Assignod CapabiIily IDs ....................................................................... 781
22 - 4 Command Rogislor ................................................................................................... 786
22 - 5 Slalus Rogislor ........................................................................................................... 789
22-6 Bridgo Command Rogislor Bil Assignmonl .......................................................... 833
22-7 Bridgo ConlroI Rogislor Bil Assignmonl ............................................................... 836
22 - 8 Bridgo Irimary Sido Slalus Rogislor ...................................................................... 838
22 - 9 Bridgo Socondary Sido Slalus Rogislor .................................................................. 841
22-10 AGI Slalus Rogislor (Offsol CAI_ITR + 4).......................................................... 846
22-11 AGI Command Rogislor (Offsol CAI_ITR + 8).................................................. 847
22-12 Basic Iormal of VID Dala Slrucluro...................................................................... 852
22-13 Iormal of llo Idonlifior Slring Tag......................................................................... 853
22-14 Iormal of llo VID-R Doscriplor ............................................................................ 853
22-15 GonoraI Iormal of a Road or a Road/Wrilo Koyvord Inlry ............................. 854
22-16 Iisl of Road-OnIy VID Koyvords ......................................................................... 854
22-17 Ixlondod CapabiIily (CI) Koyvord Iormal......................................................... 855
22-18 Iormal of ClocIsum Koyvord............................................................................... 855
22-19 Iormal of llo VID-W Doscriplor ........................................................................... 856
22-20 Iisl of Road/Wrilo VID Koyvords ....................................................................... 856
22-21 IxampIo VID Iisl..................................................................................................... 857
22-22 SIol Numboring Rogislor Sol ................................................................................... 859
22-23 Ixpansion SIol Rogislor Bil Assignmonl ............................................................... 864
23-1 ICI Ixpansion ROM Hoador Iormal .................................................................... 880
23-2 IC-CompalibIo Irocossor/Arclilocluro Dala Aroa In ROM Hoador............... 881
23-3 ICI Ixpansion ROM Dala Slrucluro Iormal ........................................................ 882
24 - 1 ICI Ixpross CapabiIilios Rogislor .......................................................................... 899
24 - 2 Dovico CapabiIilios Rogislor (road-onIy)............................................................... 901
-

24 - 3 Dovico ConlroI Rogislor (road/vrilo).................................................................... 906

24 - 4 Dovico Slalus Rogislor.............................................................................................. 910
24 - 5 IinI CapabiIilios Rogislor........................................................................................ 913
24 - 6 IinI ConlroI Rogislor ............................................................................................... 916
24 - 7 IinI Slalus Rogislor.................................................................................................. 919
24 - 8 SIol CapabiIilios Rogislor (aII fioIds aro HWInil) ................................................. 921
24 - 9 SIol ConlroI Rogislor (aII fioIds aro RW)................................................................ 924
24 - 10 SIol Slalus Rogislor ................................................................................................... 926
24 - 11 Rool ConlroI Rogislor (aII fioIds aro RW) .............................................................. 927
24 - 12 Rool Slalus Rogislor.................................................................................................. 929
24 - 13 Advancod Irror Roporling CapabiIily Rogislor Sol............................................. 932
24 - 14 Iorl VC CapabiIily Rogislor 1 (Road-OnIy) .......................................................... 942
24 - 15 Iorl VC CapabiIily Rogislor 2 (Road-OnIy) .......................................................... 944
24 - 16 Iorl VC ConlroI Rogislor (Road-Wrilo) ................................................................. 945
24 - 17 Iorl VC Slalus Rogislor (Road-OnIy)..................................................................... 946
24 - 18 VC Rosourco CapabiIily Rogislor ........................................................................... 947
24 - 19 VC Rosourco ConlroI Rogislor (Road-Wrilo) ........................................................ 949
24 - 20 VC Rosourco Slalus Rogislor (Road-OnIy) ............................................................ 951
D-1 Dofinod CIass Codos .............................................................................................. 1019
D-2 CIass Codo 0 (ICI rov 1.0) ..................................................................................... 1020
D-3 CIass Codo 1: Mass Slorago ConlroIIors ............................................................. 1020
D-4 CIass Codo 2: NolvorI ConlroIIors ..................................................................... 1021
D-5 CIass Codo 3: DispIay ConlroIIors ....................................................................... 1022
D-6 CIass Codo 4: MuIlimodia Dovicos....................................................................... 1022
D-7 CIass Codo 5: Momory ConlroIIors ...................................................................... 1022
D-8 CIass Codo 6: Bridgo Dovicos ............................................................................... 1023
D-9 CIass Codo 7: SimpIo Communicalions ConlroIIors ......................................... 1024
D-10 CIass Codo 8: Baso Syslom IoriploraIs ............................................................... 1026
D-11 CIass Codo 9: Inpul Dovicos ................................................................................. 1027
D-12 CIass Codo A: DocIing Slalions ........................................................................... 1027
D-13 CIass Codo B: Irocossors ...................................................................................... 1028
D-14 CIass Codo C: SoriaI Bus ConlroIIors .................................................................. 1028
D-15 CIass Codo D: WiroIoss ConlroIIors...................................................................... 1029
D-16 CIass Codo I: InloIIigonl IO ConlroIIors.............................................................. 1030
D-17 CIass Codo I: SaloIIilo Communicalions ConlroIIors........................................ 1030
D-18 CIass Codo 10l: Incryplion/Docryplion ConlroIIors ....................................... 1030
D-19 CIass Codo 11l: Dala Acquisilion and SignaI Irocossing ConlroIIors............ 1031
D-20 Dofinilion of IDI Irogrammors Inlorfaco Bylo Incoding ............................... 1031
AcknowIedgments
TlanIs lo lloso vlo mado significanl conlribulions lo llis booI:
}oo WinIIos for llis suporb job of loclnicaI odiling.
}ay Troddon for lis conlribulion in dovoIoping llo claplor on -
and - --.
MiIo }acIson for lis conlribulion in proparing llo
claplor.
Davo DzalIo for rosoarcl and odiling.
SpociaI llanIs lo CalaIysl Inlorprisos, Inc. for suppIying:
Appondix A: -
SpociaI llanIs lo IIX ToclnoIogy for conlribuling lvo appondicos:
Appondix B: - - --
Appondix C: - - --
--
TlanIs aIso lo llo ICI SIG for giving pormission lo uso somo of llo moclanicaI
dravings from llo spocificalion.

The MindShare Architecture Series

Tlo MindSlaro Arclilocluro booI sorios curronlIy incIudos llo booIs Iislod in
TabIo 1 boIov. Tlo onliro booI sorios is pubIislod by Addison-WosIoy.
-

Irocossor Arclilocluro
80486 Syslom Arclilocluro 3rd 0-201-40994-1
Ionlium Irocossor Syslom
Arclilocluro
2nd 0-201-40992-5
Ionlium Iro and Ionlium II
Syslom Arclilocluro
2nd 0-201-30973-4
IovorIC Syslom
Arclilocluro
1sl 0-201-40990-9
Bus Arclilocluro
ICI Syslom Arclilocluro 4ll 0-201-30974-2
ICI-X Syslom Arclilocluro 1sl 0-201-72682-3
IISA Syslom Arclilocluro Oul-of-
prinl
0-201-40995-X
Iiroviro Syslom
Arclilocluro: IIII 1394a
2nd 0-201-48535-4
ISA Syslom Arclilocluro 3rd 0-201-40996-8
UnivorsaI SoriaI Bus Syslom
Arclilocluro 2.0
2nd 0-201-46137-4
HyporTransporl Syslom
Arclilocluro
1sl 0-321-16845-3
-- -

-
NolvorI Arclilocluro Infiniband NolvorI
Arclilocluro
1sl 0-321-11765-4
-- -

Cautionary Note
Tlo roador slouId Ioop in mind llal MindSlaros booI sorios oflon dolaiIs rap-
idIy ovoIving loclnoIogios, as is llo caso vill ICI Ixpross. Tlis boing llo caso,
il slouId bo rocognizod llal llo booI is a snapslol of llo slalo of llo loclnoI-
ogy al llo limo llo booI vas compIolod. Wo maIo ovory allompl lo produco our
booIs on a limoIy basis, bul llo noxl rovision of llo spocificalion is nol inlro-
ducod in limo lo maIo nocossary clangos. Tlis ICI Ixpross booI compIios vill
rovision 1.0a of llo -- - roIoasod and lradomarIod by
llo ICI SpociaI Inlorosl Group. SovoraI oxpansion card form-faclor spocifica-
lions aro pIannod for ICI Ixpross, bul onIy llo IIoclromoclanicaI spocificalion,
rovision 1.0 vas roIoasod vlon llis booI vas compIolod. Hovovor, llo claplor
covoring llo Card IIoclromoclanicaI lopic roviovs sovoraI form-faclors llal
voro undor dovoIopmonl al llo limo of vriling.
Intended Audience
Tlis booI is inlondod for uso by lardvaro and soflvaro dosign and supporl
porsonnoI. Tlo luloriaI approacl laIon may aIso maIo il usofuI lo loclnicaI por-
sonnoI nol diroclIy invoIvod dosign, vorificalion, and ollor supporl funclions.
Ollor Arclilocluros
ICMCIA Syslom
Arclilocluro: 16-Bil IC
Cards
2nd 0-201-40991-7
CardBus Syslom
Arclilocluro
1sl 0-201-40997-6
IIug and IIay Syslom
Arclilocluro
1sl 0-201-41013-3
Iroloclod Modo Soflvaro
Arclilocluro
1sl 0-201-55447-X
AGI Syslom Arclilocluro 1sl 0-201-37964-3
-

-

Prerequisite KnowIedge
Il is rocommondod llal llo roador las a roasonabIo bacIground in IC arcliloc-
luro, incIuding oxporionco or InovIodgo of an I/O bus and roIalod prolocoI.
Bocauso ICI Ixpross mainlains sovoraI IovoIs of compalibiIily vill llo originaI
ICI dosign, crilicaI bacIground informalion rogarding ICI las boon incorpo-
ralod inlo llis booI. Hovovor, llo roador may find il bonoficiaI lo road llo
MindSlaro pubIicalion onlilIod - , vlicl focussos on and
dolaiIs llo ICI arclilocluro.
Topics and Organization
Topics covorod in llis booI and llo fIov of llo booI aro as foIIovs:
- Irovidos an arclilocluraI
porspoclivo of llo ICI Ixpross loclnoIogy by comparing and conlrasling il vill
llo ICI and ICI-X busos. Il aIso inlroducos llo major foaluros of llo ICI
Ixpross arclilocluro.
-- - IncIudos pacIol formal and fioId dofi-
nilion and uso, aIong vill lransaclion and IinI Iayor funclions.
- - Doscribos llo plysicaI Iayor funclions, IinI
lraining and iniliaIizalion, rosol, and oIoclricaI signaIing.
- Discussos Iovor Budgoling and Iovor Manago-
monl.
- Discussos llo major foaluros of ICI Ixpross llal aro
oplionaI, incIuding Hol IIug and Ixpansion Card impIomonlalion dolaiIs.
-- Discussos llo configuralion procoss, accoss-
ing configuralion spaco, and dolaiIs llo conlonl and uso of aII configuralion rog-
islors.

- -
- - --
- - --
--
-- -- -

-- -

Documentation Conventions
Tlis soclion dofinos llo lypograplicaI convonlion usod llrougloul llis booI.
PCI Express
ICI Ixpross is a lradomarI of llo ICI SIG. Tlis booI laIos llo Iiborly of
abbrovialing ICI Ixpross as ICI-XI primariIy in iIIuslralion vloro Iimilod
spaco is an issuo.
HexadecimaI Notation
AII lox numbors aro foIIovod by a Iovor caso l. Ior oxampIo:
89I2BD02l
0111l
Binary Notation
AII binary numbors aro foIIovod by a Iovor caso b. Ior oxampIo:
1000 1001 1111 0010b
01b
DecimaI Notation
Numbor villoul any suffix aro docimaI. Wlon roquirod for cIarily, docimaI
numbors aro foIIovod by a Iovor caso d. IxampIos:
9
15
512d
-

Bits Versus Bytes Notation

Tlis booI roprosonls bil vill Iovor caso b and bylos vill an uppor caso B.
Ior oxampIo:
Mogabils/socond = Mb/s
Mogabylos/socond = MB/s
Bit FieIds
Groups bils aro roprosonlod vill llo ligl-ordor bils firsl foIIovod by llo Iov-
ordor bils and oncIosod by bracIols. Ior oxampIo:
|7:0] = bils 0 llrougl 7
Active SignaI States
SignaIs llal aro aclivo Iov aro foIIovod by #, as in IIRST# and WAKI#. Aclivo
ligl signaIs lavo no suffix, sucl as IOWIRGOOD.
Visit Our Web Site
Our vob silo Iisls aII of our coursos and llo doIivory oplions avaiIabIo for oacl
courso:
- Informalion on MindSlaro coursos:
- SoIf-pacod DVDs and CDs
- Iivo vob-doIivorod cIassos
- Iivo on-silo cIassos.
- Iroo slorl coursos on soIoclod lopics
- ToclnicaI papors
- Irrala for a numbor of our booIs
AII of our booIs aro Iislod and can bo ordorod in bound or o-booI vorsions.
-
-- -

We Want Your Feedback

MindSlaro vaIuos you commonls and suggoslions. Conlacl us al:
(719) 487-1417 or villin llo U.S. (800) 633-1440
(719) 487-1434 (Iax)
-- I-maiI nancymindslaro.com
-- I-maiI donmindslaro.com or lommindslaro.com
I-maiI infomindslaro.com
--
MindSlaro, Inc.
4285 SIasl Iino Drivo
CoIorado Springs, CO 80908
Iarl Ono
Tlo Big Iicluro

-
This Chapter
Tlis claplor doscribos porformanco advanlagos and Ioy foaluros of llo ICI
Ixpross (ICI-XI) IinI. To liglIigll lloso advanlagos, llis claplor doscribos
porformanco claraclorislics and foaluros of prodocossor busos sucl as ICI and
ICI-X busos vill llo goaI of discussing llo ovoIulion of ICI Ixpross from lloso
prodocossor busos. Tlo roador viII bo abIo lo comparo and conlrasl foaluros and
porformanco poinls of ICI, ICI-X and ICI Ixpross busos. Tlo Ioy foaluros of a
ICI Ixpross syslom aro doscribod. In addilion, llo claplor doscribos somo
oxampIos of ICI Ixpross syslom lopoIogios.
The Next Chapter
Tlo noxl claplor doscribos in furllor dolaiI llo foaluros of llo ICI Ixpross bus.
Il doscribos llo Iayorod arclilocluro of a dovico dosign vliIo providing a briof
funclionaI doscriplion of oacl Iayor. Tlo claplor providos an ovorviov of
pacIol formalion al a lransmillor dovico, llo lransmission and rocoplion of llo
pacIol ovor llo ICI Ixpross IinI and pacIol docodo al a rocoivor dovico.
Introduction To PCI Express
ICI Ixpross is llo llird gonoralion ligl porformanco I/O bus usod lo inlorcon-
nocl poriploraI dovicos in appIicalions sucl as compuling and communicalion
pIalforms. Tlo firsl gonoralion busos incIudo llo ISA, IISA, VISA, and Micro
ClannoI busos, vliIo llo socond gonoralion busos incIudo ICI, AGI, and ICI-X.
ICI Ixpross is an aII oncompassing I/O dovico inlorconnocl bus llal las appIi-
calions in llo mobiIo, dosIlop, vorIslalion, sorvor, omboddod compuling and
communicalion pIalforms.
-- -

The RoIe of the OriginaI PCI SoIution

Dont Throw Away What is Good! Keep It
Tlo ICI Ixpross arclilocls lavo carriod forvard llo mosl bonoficiaI foaluros
from provious gonoralion bus arclilocluros and lavo aIso laIon advanlagos of
nov dovoIopmonls in compulor arclilocluro.
Ior oxampIo, ICI Ixpross ompIoys llo samo usago modoI and Ioad-sloro com-
municalion modoI as ICI and ICI-X. ICI Ixpross supporls famiIiar lransaclions
sucl as momory road/vrilo, IO road/vrilo and configuralion road/vrilo lrans-
aclions. Tlo momory, IO and configuralion addross spaco modoI is llo samo as
ICI and ICI-X addross spacos. By mainlaining llo addross spaco modoI, oxisl-
ing OSs and drivor soflvaro viII run in a ICI Ixpross syslom villoul any mod-
ificalions. In ollor vords, ICI Ixpross is soflvaro bacIvards compalibIo vill
ICI and ICI-X sysloms. In facl, a ICI Ixpross syslom viII bool an oxisling OS
vill no clangos lo curronl drivors and appIicalion programs. Ivon ICI/ACII
povor managomonl soflvaro viII sliII run.
IiIo prodocossor busos, ICI Ixpross supporls clip-lo-clip inlorconnocl and
board-lo-board inlorconnocl via cards and connoclors. Tlo connoclor and card
slrucluro aro simiIar lo ICI and ICI-X connoclors and cards. A ICI Ixpross
mollorboard viII lavo a simiIar form faclor lo oxisling IR4 ATX mollorboards
vlicl is oncasod in llo famiIiar IC pacIago.
Make Improvements for the Future
To improvo bus porformanco, roduco ovoraII syslom cosl and laIo advanlago of
nov dovoIopmonls in compulor dosign, llo ICI Ixpross arclilocluro lad lo bo
significanlIy ro-dosignod from ils prodocossor busos. ICI and ICI-X busos aro
muIli-drop paraIIoI inlorconnocl busos in vlicl many dovicos slaro ono bus.
ICI Ixpross on llo ollor land impIomonls a soriaI, poinl-lo-poinl lypo inlor-
connocl for communicalion bolvoon lvo dovicos. MuIlipIo ICI Ixpross dovicos
aro inlorconnoclod via llo uso of svilclos vlicl moans ono can praclicaIIy con-
nocl a Iargo numbor of dovicos logollor in a syslom. A poinl-lo-poinl inlorcon-
nocl impIios Iimilod oIoclricaI Ioad on llo IinI aIIoving lransmission and
rocoplion froquoncios lo scaIo lo mucl liglor numbors. CurronlIy ICI Ixpross
lransmission and rocoplion dala ralo is 2.5 Gbils/soc. A soriaI inlorconnocl
bolvoon lvo dovicos rosuIls in fovor pins por dovico pacIago vlicl roducos
ICI Ixpross clip and board dosign cosl and roducos board dosign compIoxily.
ICI Ixpross porformanco is aIso liglIy scaIabIo. Tlis is acliovod by impIomonl-
-

ing scaIabIo numbors for pins and signaI Ianos por inlorconnocl basod on com-
municalion porformanco roquiromonls for llal inlorconnocl.
ICI Ixpross impIomonls svilcl-basod loclnoIogy lo inlorconnocl a Iargo num-
bor of dovicos. Communicalion ovor llo soriaI inlorconnocl is accompIislod
using a pacIol-basod communicalion prolocoI. QuaIily Of Sorvico (QoS) foa-
luros provido difforonlialod lransmission porformanco for difforonl appIica-
lions. Hol IIug/Hol Svap supporl onabIos aIvays-on sysloms. Advancod
povor managomonl foaluros aIIov ono lo dosign for Iov povor mobiIo appIica-
lions. RAS (RoIiabIo, AvaiIabIo, SorvicoabIo) orror landIing foaluros maIo ICI
Ixpross suilabIo for robusl ligl-ond sorvor appIicalions. Hol pIug, povor man-
agomonl, orror landIing and inlorrupl signaIing aro accompIislod in-band
using pacIol basod mossaging rallor llan sido-band signaIs. Tlis Ioops llo
dovico pin counl Iov and roducos syslom cosl.
Tlo configuralion addross spaco avaiIabIo por funclion is oxlondod lo 4KB,
aIIoving dosignors lo dofino addilionaI rogislors. Hovovor, nov soflvaro is
roquirod lo accoss llis oxlondod configuralion rogislor spaco.
Looking into the Future
In llo fuluro, ICI Ixpross communicalion froquoncios aro oxpoclod lo doubIo
and quadrupIo lo 5 Gbils/soc and 10 Gbils/soc. TaIing advanlago of lloso fro-
quoncios viII roquiro IlysicaI Iayor ro-dosign of a dovico vill no clangos noc-
ossary lo llo liglor Iayors of llo dovico dosign.
AddilionaI moclanicaI form faclors aro oxpoclod. Supporl for a Sorvor IO Mod-
uIo, Novcard (IC Card slyIo), and CabIo form faclors aro oxpoclod.
Predecessor Buses Compared
In an offorl lo comparo and conlrasl foaluros of prodocossor busos, llo noxl soc-
lion of llis claplor doscribos somo of llo Ioy foaluros of IO bus arclilocluros
dofinod by llo ICI SpociaI Inlorosl Group (ICISIG). Tloso busos, slovn in
TabIo 1-1 on pago 12, incIudo llo ICI 33 MHz bus, ICI- 66 MHz bus, ICI-X 66
MHz/133 MHz busos, ICI-X 266/533 MHz busos and finaIIy ICI Ixpross.
-- -

Authors DiscIaimer
In comparing lloso busos, il is nol llo aullors inlonlion lo suggosl llal any ono
bus is bollor llan any ollor bus. Iacl bus arclilocluro las ils advanlagos and
disadvanlagos. Aflor ovaIualing llo foaluros of oacl bus arclilocluro, a parlicu-
Iar bus arclilocluro may lurn oul lo bo moro suilabIo for a spocific appIicalion
llan anollor bus arclilocluro. Ior oxampIo, il is llo syslom dosignors rosponsi-
biIily lo dolormino vlollor lo impIomonl a ICI-X bus or ICI Ixpross for llo I/
O inlorconnocl in a ligl-ond sorvor dosign. Our goaI in llis claplor is lo docu-
monl llo foaluros of oacl bus arclilocluro so llal llo dosignor can ovaIualo llo
various bus arclilocluros.
Bus Performances and Number of SIots Compared
TabIo 1-2 on pago 13 slovs llo various bus arclilocluros dofinod by llo ICISIG.
Tlo labIo slovs llo ovoIulion of bus froquoncios and bandvidlls. As is obvi-
ous, incroasing bus froquoncy rosuIls in incroasod bandvidll. Hovovor,
incroasing bus froquoncy compromisos llo numbor of oIoclricaI Ioads or num-
bor of connoclors aIIovabIo on a bus al llal froquoncy. Al somo poinl, for a
givon bus arclilocluro, lloro is an uppor Iimil boyond vlicl ono cannol furllor
incroaso llo bus froquoncy, lonco roquiring llo dofinilion of a nov bus arcliloc-
luro.
- - - -
- - -
ICI 33 MHz 2.0 1993
ICI 66 MHz 2.1 1995
ICI-X 66 MHz and 133 MHz 1.0 1999
ICI-X 266 MHz and 533 MHz 2.0 Q1, 2002
ICI Ixpross 1.0 Q2, 2002
-

PCI Express Aggregate Throughput

A ICI Ixpross inlorconnocl llal connocls lvo dovicos logollor is roforrod lo as a
IinI. A IinI consisls of oillor x1, x2, x4, x8, x12, x16 or x32 signaI pairs in oacl
diroclion. Tloso signaIs aro roforrod lo as Ianos. A dosignor dolorminos lov
many Ianos lo impIomonl basod on llo largolod porformanco bonclmarI
roquirod on a givon IinI.
TabIo 1-3 slovs aggrogalo bandvidll numbors for various IinI vidll impIo-
monlalions. As is apparonl from llis labIo, llo poaI bandvidll acliovabIo vill
ICI Ixpross is significanlIy liglor llan any oxisling bus loday.
Iol us considor lov lloso bandvidll numbors aro caIcuIalod. Tlo lransmis-
sion/rocoplion ralo is 2.5 Gbils/soc por Iano por diroclion. To supporl a groalor
dogroo of robuslnoss during dala lransmission and rocoplion, oacl bylo of dala
lransmillod is convorlod inlo a 10-bil codo (via an 8b/10b oncodor in llo lrans-
millor dovico). In ollor vords, for ovory Bylo of dala lo bo lransmillod, 10-bils
of oncodod dala aro acluaIIy lransmillod. Tlo rosuIl is 25 addilionaI ovorload
lo lransmil a bylo of dala. TabIo 1-3 accounls for llis 25 Ioss in lransmission
porformanco.
- - -
-

- -
ICI 32-bil 33 MHz 133 MBylos/soc 4-5
ICI 32-bil 66 MHz 266 MBylos/soc 1-2
ICI-X 32-bil 66 MHz 266 MBylos/soc 4
ICI-X 32-bil 133 MHz 533 MBylos/soc 1-2
ICI-X 32-bil 266 MHz offoclivo 1066 MBylos/soc 1
ICI-X 32-bil 533 MHz offoclivo 2131 MBylo/soc 1
- - - -
-- -

ICI Ixpross impIomonls a duaI-simpIox IinI vlicl impIios llal dala is lrans-
millod and rocoivod simuIlanoousIy on a lransmil and rocoivo Iano. Tlo aggro-
galo bandvidll assumos simuIlanoous lraffic in boll diroclions.
To oblain llo aggrogalo bandvill numbors in TabIo 1-3 muIlipIy 2.5 Gbils/soc
by 2 (for oacl diroclion), llon muIlipIy by numbor of Ianos, and finaIIy divido
by 10-bils por Bylo (lo accounl for llo 8-lo-10 bil oncoding).
Performance Per Pin Compared
As is apparonl from Iiguro 1-1, ICI Ixpross acliovos llo liglosl bandvidll por
pin. Tlis rosuIls in a dovico pacIago vill fovor pins and a mollorboard impIo-
monlalion vill fov viros and lonco ovoraII roducod syslom cosl por unil band-
vidll.
In Iiguro 1-1, llo firsl 7 bars aro associalod vill ICI and ICI-X busos vloro vo
assumo 84 pins por dovico. Tlis incIudos 46 signaI pins, inlorrupl and povor
managomonl pins, orror pins and llo romaindor aro povor and ground pins.
Tlo Iasl bar associalod vill a x8 ICI Ixpross IinI assumos 40 pins por dovico
vlicl incIudo 32 signaI Iinos (8 difforonliaI pairs por diroclion) and llo rosl aro
povor and ground pins.
-- - -
--



--
0.5 1 2 4 6 8 16
-

- - --
1.6
3.2
3.2
6.4
12.8
25.6
100
0
10
20
30
40
50
60
70
80
90
100
-- -

I/O Bus Architecture Perspective

33 MHz PCI Bus Based System
Iiguro 1-2 on pago 17 is a 33 MHz ICI bus basod syslom. Tlo ICI syslom con-
sisls of a Hosl (CIU) bus-lo-ICI bus bridgo, aIso roforrod lo as llo Norll bridgo.
Associalod vill llo Norll bridgo is llo syslom momory bus, graplics (AGI)
bus, and a 33 MHz ICI bus. I/O dovicos slaro llo ICI bus and aro connoclod lo
il in a muIli-drop faslion. Tloso dovicos aro oillor connoclod diroclIy lo llo ICI
bus on llo mollorboard or by vay of a poriploraI card pIuggod inlo a connoc-
lor on llo bus. Dovicos connoclod diroclIy lo llo mollorboard consumo ono
oIoclricaI Ioad vliIo connoclors aro accounlod for as 2 Ioads. A Soull bridgo
bridgos llo ICI bus lo llo ISA bus vloro sIovor, Iovor porformanco poriplor-
aIs oxisl. Associalod vill llo soull bridgo is a USB and IDI bus. A CD or lard
disI is associalod vill llo IDI bus. Tlo Soull bridgo conlains an inlorrupl con-
lroIIor (nol slovn) lo vlicl inlorrupl signaIs from ICI dovicos aro connoclod.
Tlo inlorrupl conlroIIor is connoclod lo llo CIU via an INTR signaI or an AIIC
bus. Tlo Soull bridgo is llo conlraI rosourco llal providos llo sourco of rosol,
roforonco cIocI, and orror roporling signaIs. Bool ROM oxisls on llo ISA bus
aIong vill a Supor IO clip, vlicl incIudos Ioyboard, mouso, fIoppy disI con-
lroIIor and soriaI/paraIIoI bus conlroIIors. Tlo ICI bus arbilor Iogic is incIudod
in llo Norll bridgo.
Iiguro 1-3 on pago 18 roprosonls a lypicaI ICI bus cycIo. Tlo ICI bus cIocI is 33
MHz. Tlo addross bus vidll is 32-bils (4GB momory addross spaco), aIllougl
ICI oplionaIIy supporls 64-bil addross bus. Tlo dala bus vidll is impIomonlod
as oillor 32-bils or 64-bils doponding on bus porformanco roquiromonl. Tlo
addross and dala bus signaIs aro muIlipIoxod on llo samo pins (AD bus) lo
roduco pin counl. Command signaIs (C/BI#) oncodo llo lransaclion lypo of llo
bus cycIo llal maslor dovicos inilialo. ICI supporls 12 lransaclion lypos llal
incIudo momory, IO, and configuralion road/vrilo bus cycIos. ConlroI signaIs
sucl as IRAMI#, DIVSII#, TRDY#, IRDY#, STOI# aro landslaIo signaIs
usod during bus cycIos. IinaIIy, llo ICI bus consisls of a fov oplionaI orror
roIalod signaIs, inlorrupl signaIs and povor managomonl signaIs. A ICI maslor
dovico impIomonls a minimum of 49 signaIs.
Any ICI maslor dovico llal vislos lo inilialo a bus cycIo firsl arbilralos for uso
of llo ICI bus by assorling a roquosl (RIQ#) lo llo arbilor in llo Norll bridgo.
Aflor rocoiving a granl (GNT#) from llo arbilor and clocIing llal llo bus is
idIo, llo maslor dovico can slarl a bus cycIo.
-

EIectricaI Load Limit of a 33 MHz PCI Bus

Tlo ICI spocificalion lloorolicaIIy supporls 32 dovicos por ICI bus. Tlis moans
llal ICI onumoralion soflvaro viII dolocl and rocognizo up lo 32 dovicos por
bus. Hovovor, as a ruIo of llumb, a ICI bus can supporl a maximum of 10-12
oIoclricaI Ioads (dovicos) al 33 MHz. ICI impIomonls a slalic cIocIing prolocoI
vill a cIocI poriod of 30 ns al 33 MHz.
ICI impIomonls rofIoclod-vavo svilcling signaI drivors. Tlo drivor drivos a
laIf signaI sving signaI on llo rising odgo of ICI cIocI. Tlo signaI propagalos
dovn llo ICI bus lransmission Iino and is rofIoclod al llo ond of llo lransmis-
sion Iino vloro lloro is no lorminalion. Tlo rofIoclion causos llo laIf sving sig-
naI lo doubIo. Tlo doubIod (fuII signaI sving) signaI musl sollIo lo a sloady slalo
- -
Processor
North Bridge
(Intel 440)
SDRAM
South Bridge
AGP
2x
PCI-33MHz
IDE
HDD
USB
GFX
CD
Super
IO
COM1
COM2
Super
IO
COM1
COM2
SCSI
Audio
Chip
Modem
Chip
ISA
Boot
ROM
FSB
Ethernet
Slots
Arbiter
-- -

vaIuo vill sufficionl solup limo prior lo llo noxl rising odgo of ICI cIocI vloro
rocoiving dovicos sampIo llo signaI. Tlo lolaI limo from vlon a drivor drivos a
signaI unliI llo rocoivor dolocls a vaIid signaI (incIuding propagalion limo and
rofIoclion doIay pIus solup limo) musl bo Ioss llan llo cIocI poriod of 30 ns.
Tlo moro oIoclricaI Ioads on a bus, llo Iongor il laIos for llo signaI lo propagalo
and doubIo vill sufficionl solup lo llo noxl rising odgo of cIocI. As monlionod
oarIior, a 33 MHz ICI bus mools signaI liming vill no moro llan 10-12 Ioads.
Connoclors on llo ICI bus aro counlod as 2 Ioads bocauso llo connoclor is
accounlod for as ono Ioad and llo poriploraI card vill a ICI dovico is llo soc-
ond Ioad. As indicalod in TabIo 1-2 on pago 13 a 33 MHz ICI bus can bo
dosignod vill a maximum of 4-5 connoclors.
- -
1 2 3 4 5 6 7 8
CLK
FRAME#
AD
C/BE#
IRDY#
TRDY#
DEVSEL#
Addr
Data
1
Data
2
Data
3
Bus
Cmd
Byte
Enables
Byte
Enables
Byte
Enables
GNT#
Address
Phase
Data Phase 1 Data Phase 2 Data Phase 3
Wait
State
Wait
State
Wait
State
-

To connocl any moro llan 10-12 Ioads in a syslom roquiros llo impIomonlalion
of a ICI-lo-ICI bridgo as slovn in Iiguro 1-4. Tlis pormils an addilionaI 10-12
Ioads lo bo connoclod on llo socondary ICI bus 1. Tlo ICI spocificalion lloorol-
icaIIy supporls up lo 256 busos in a syslom. Tlis moans llal ICI onumoralion
soflvaro viII dolocl and rocognizo up lo 256 ICI bridgos por syslom.
PCI Transaction ModeI - Programmed IO
Considor an oxampIo in vlicl llo CIU communicalos vill a ICI poriploraI
sucl as an Illornol dovico slovn in Iiguro 1-5. Transaclion 1 slovn in llo fig-
uro, vlicl is inilialod by llo CIU and largols a poriploraI dovico, is roforrod lo
as a programmod IO lransaclion. Soflvaro commands llo CIU lo inilialo a
momory or IO road/vrilo bus cycIo on llo losl bus largoling an addross
mappod in a ICI dovicos addross spaco. Tlo Norll bridgo arbilralos for uso of
llo ICI bus and vlon il vins ovnorslip of llo bus gonoralos a ICI momory or
IO road/vrilo bus cycIo roprosonlod in Iiguro 1-3 on pago 18. During llo firsl
cIocI of llis bus cycIo (Inovn as llo addross plaso), aII largol dovicos docodo
- -
Processor
North Bridge
(Intel 440) SDRAM
South Bridge
AGP
2x
PCI-33MHz
IDE
HDD
USB
GFX
CD
Super
IO
COM1
COM2
SCSI
Audio
Chip
Modem
Chip
ISA
Boot
ROM
FSB
Ethernet
Slots
PCI
Bridge
PCI Bus 0
PCI Bus 1
Ethernet
Processor
North Bridge
(Intel 440) SDRAM
South Bridge
AGP
2x
PCI-33MHz
IDE
HDD
USB
GFX
CD
Super
IO
COM1
COM2
Super
IO
COM1
COM2
SCSI
Audio
Chip
Modem
Chip
ISA
Boot
ROM
FSB
Ethernet
Slots
PCI
Bridge
PCI Bus 0
PCI Bus 1
Ethernet
-- -

llo addross. Ono largol (llo Illornol dovico in llis oxampIo) docodos llo
addross and cIaims llo lransaclion. Tlo maslor (Norll bridgo in llis caso) com-
municalos vill llo cIaiming largol (Illornol conlroIIor). Dala is lransforrod
bolvoon maslor and largol in subsoquonl cIocIs aflor llo addross plaso of llo
bus cycIo. Iillor 4 bylos or 8 bylos of dala aro lransforrod por cIocI licI dopond-
ing on llo ICI bus vidll. Tlo bus cycIo is roforrod lo as a bursl bus cycIo if dala
is lransforrod bacI-lo-bacI bolvoon maslor and largol during muIlipIo dala
plasos of llal bus cycIo. Bursl bus cycIos rosuIl in llo mosl officionl uso of ICI
bus bandvidll.
Al 33 MHz and llo bus vidll of 32-bils (4 Bylos), poaI bandvidll acliovabIo is
4 Bylos x 33 MHz = 133 MBylos/soc. IoaI bandvidll on a 64-bil bus is 266
Mbylos/soc. Soo TabIo 1-2 on pago 13.
-
Processor
North Bridge
(Intel 440)
SDRAM
South Bridge
AGP
2x
PCI-33MHz
IDE
HDD
USB
GFX
CD
Super
IO
COM1
COM2
Super
IO
COM1
COM2
SCSI
Audio
Chip
Modem
Chip
ISA
Boot
ROM
FSB
Ethernet
Slots
1) Programmed IO
2) DMA
3) Peer-to-Peer
-

Ifficioncy of llo ICI bus for dala payIoad lransporl is in llo ordor of 50. Iffi-
cioncy is dofinod as numbor of cIocIs during vlicl dala is lransforrod dividod
by llo numbor of lolaI cIocIs, limos 100. Tlo Iosl porformanco is duo lo bus idIo
limo bolvoon bus cycIos, arbilralion limo, limo Iosl in llo addross plaso of a bus
cycIo, vail slalos during dala plasos, doIays during lransaclion rolrios (nol dis-
cussod yol), as voII as Ialoncios llrougl ICI bridgos.
PCI Transaction ModeI - Direct Memory Access (DMA)
Dala lransfor bolvoon a ICI dovico and syslom momory is accompIislod in lvo
vays:
Tlo firsl Ioss officionl mollod usos programmod IO lransfors as discussod in llo
provious soclion. Tlo ICI dovico gonoralos an inlorrupl lo inform llo CIU llal
il noods dala lransforrod. Tlo dovico inlorrupl sorvico roulino (ISR) causos llo
CIU lo road from llo ICI dovico inlo ono of ils ovn rogislors. Tlo ISR llon loIIs
llo CIU lo vrilo from ils rogislor lo momory. SimiIarIy, if dala is lo bo movod
from momory lo llo ICI dovico, llo ISR loIIs llo CIU lo road from momory inlo
ils ovn rogislor. Tlo ISR llon loIIs llo CIU lo vrilo from ils rogislor lo llo ICI
dovico. Il is apparonl llal llo procoss is vory inofficionl for lvo roasons. Iirsl,
lloro aro lvo bus cycIos gonoralod by llo CIU for ovory dala lransfor, ono lo
momory and ono lo llo ICI dovico. Socond, llo CIU is busy lransforring dala
rallor llan porforming ils primary funclion of oxoculing appIicalion codo.
Tlo socond moro officionl mollod lo lransfor dala is llo DMA (dirocl momory
accoss) mollod iIIuslralod by Transaclion 2 in Iiguro 1-5 on pago 20, vloro llo
ICI dovico bocomos a bus maslor. Upon command by a IocaI appIicalion (sofl-
varo) vlicl runs on a ICI poriploraI or llo ICI poriploraI lardvaro ilsoIf, llo
ICI dovico may inilialo a bus cycIo lo laII lo momory. Tlo ICI bus maslor
dovico (SCSI dovico in llis oxampIo) arbilralos for llo ICI bus, vins ovnorslip
of llo bus and inilialos a ICI momory bus cycIo. Tlo Norll bridgo vlicl
docodos llo addross acls as llo largol for llo lransaclion. In llo dala plaso of
llo bus cycIo, dala is lransforrod bolvoon llo SCSI maslor and llo Norll bridgo
largol. Tlo bridgo in lurn gonoralos a DRAM bus cycIo lo communicalo vill
syslom momory. Tlo ICI poriploraI gonoralos an inlorrupl lo inform llo syslom
soflvaro llal llo dala lransfor las compIolod. Tlis bus maslor or DMA mollod
of dala lransporl is moro officionl bocauso llo CIU is nol invoIvod in llo dala
movo and furllor onIy ono bursl bus cycIo is gonoralod lo movo a bIocI of dala.
-- -

PCI Transaction ModeI - Peer-to-Peer

A Ioor-lo-poor lransaclion slovn as Transaclion 3 in Iiguro 1-5 on pago 20 is
llo dirocl lransfor of dala bolvoon lvo ICI dovicos. A maslor llal vislos lo ini-
lialo a lransaclion, arbilralos, vins ovnorslip of llo bus and slarls a lransac-
lion. A largol ICI dovico llal rocognizos llo addross cIaims llo bus cycIo. Ior a
vrilo bus cycIo, dala is movod from maslor lo largol. Ior a road bus cycIo, dala
is movod from largol lo maslor.
PCI Bus Arbitration
A ICI dovico llal vislos lo inilialo a bus cycIo arbilralos for uso of llo bus firsl.
Tlo arbilor impIomonls an arbilralion aIgorillm vill vlicl il docidos vlo lo
granl llo bus lo noxl. Tlo arbilor is abIo lo granl llo bus lo llo noxl roquosling
dovico vliIo a bus cycIo is in progross. Tlis arbilralion prolocoI is roforrod lo as
liddon bus arbilralion. Hiddon bus arbilralion aIIovs for moro officionl land
ovor of llo bus from ono bus maslor dovico lo anollor vill onIy ono idIo cIocI
bolvoon lvo bus cycIos (roforrod lo as bacI-lo-bacI bus cycIos). ICI prolocoI
doos nol provido a slandard moclanism by vlicl syslom soflvaro or dovico
drivors can configuro llo arbilralion aIgorillm in ordor lo provido for difforonli-
alod cIass of sorvico for various appIicalions.
-
Processor
North Bridge
(Intel 440)
SDRAM
South Bridge
AGP
2x
PCI-33MHz
IDE
HDD
USB
GFX
CD
SCSI
ISA
FSB
Ethernet
Slots
Arbiter
-

PCI DeIayed Transaction ProtocoI

Wlon a ICI maslor inilialos a lransaclion lo accoss a
largol dovico and llo largol dovico is nol roady, llo largol signaIs a lransaclion
rolry. Tlis sconario is iIIuslralod in Iiguro 1-7.
Considor llo foIIoving oxampIo in vlicl llo Norll bridgo inilialos a momory
road lransaclion lo road dala from llo Illornol dovico. Tlo Illornol largol
cIaims llo bus cycIo. Hovovor, llo Illornol largol doos nol immodialoIy lavo
llo dala lo rolurn lo llo Norll bridgo maslor. Tlo Illornol dovico las lvo
cloicos by vlicl lo doIay llo dala lransfor. Tlo firsl is lo insorl vail-slalos in
llo dala plaso. If onIy a fov vail-slalos aro noodod, llon llo dala is sliII lrans-
forrod officionlIy. If lovovor llo largol dovico roquiros moro limo (moro llan 16
cIocIs from llo boginning of llo lransaclion), llon llo socond oplion llo largol
las is lo signaI a rolry vill a signaI caIIod STOI#. A rolry loIIs llo maslor lo ond
- -
Processor
North Bridge
(Intel 440) SDRAM
South Bridge
AGP
2x
PCI-33MHz
IDE
HDD
USB
GFX
CD
Super
IO
COM1
COM2
Super
IO
COM1
COM2
SCSI
Audio
Chip
Modem
Chip
ISA
Boot
ROM
FSB
Ethernet
Slots
Arbiter
1. Initiate
3. Retry
2. Target device
not ready
-- -

llo bus cycIo promaluroIy villoul lransforring dala. Doing so provonls llo bus
from boing loId for a Iong limo in vail-slalos, vlicl compromisos llo bus offi-
cioncy. Tlo bus maslor llal is rolriod by llo largol vails a minimum of 2 cIocIs
and musl onco again arbilralo for uso of llo bus lo ro-inilialo llo idonlicaI bus
cycIo. During llo limo llal llo bus maslor is rolriod, llo arbilor can granl llo
bus lo ollor roquosling maslors so llal llo ICI bus is moro officionlIy uliIizod.
By llo limo llo rolriod maslor is granlod llo bus and il ro-inilialos llo bus cycIo,
lopofuIIy llo largol viII cIaim llo cycIo and viII bo roady lo lransfor dala. Tlo
bus cycIo goos lo compIolion vill dala lransfor. Ollorviso, if llo largol is sliII
nol roady, il rolrios llo maslors bus cycIo again and llo procoss is ropoalod unliI
llo maslor succossfuIIy lransfors dala.
- Wlon a ICI maslor inilialos a lransaclion lo
accoss a largol dovico and if llo largol dovico is abIo lo lransfor al Ioasl ono dou-
bIovord of dala bul cannol compIolo llo onliro dala lransfor, il disconnocls llo
bus cycIo al llo poinl al vlicl il cannol conlinuo llo dala lransfor. Tlis sconario
is iIIuslralod in Iiguro 1-8.
- - -
Processor
North Bridge
(Intel 440) SDRAM
South Bridge
AGP
2x
PCI-33MHz
IDE
HDD
USB
GFX
CD
Super
IO
COM1
COM2
Super
IO
COM1
COM2
SCSI
Audio
Chip
Modem
Chip
ISA
Boot
ROM
FSB
Ethernet
Slots
Arbiter
1. Initiate
3. Disconnect
2. Some data
transferred
-

Considor llo foIIoving oxampIo in vlicl llo Norll bridgo inilialos a bursl
momory road lransaclion lo road dala from llo Illornol dovico. Tlo Illornol
largol dovico cIaims llo bus cycIo and lransfors somo dala, bul llon runs oul of
dala lo lransfor. Tlo Illornol dovico las lvo cloicos lo doIay llo dala lransfor.
Tlo firsl oplion is lo insorl vail-slalos during llo curronl dala plaso vliIo vail-
ing for addilionaI dala lo arrivo. If llo largol noods lo insorl onIy a fov vail-
slalos, llon llo dala is sliII lransforrod officionlIy. If lovovor llo largol dovico
roquiros moro limo (llo ICI spocificalion aIIovs maximum of 8 cIocIs in llo
dala plaso), llon llo largol dovico musl signaI a disconnocl. To do llis llo lar-
gol assorls STOI# in llo middIo of llo bus cycIo lo loII llo maslor lo ond llo bus
cycIo promaluroIy. A disconnocl rosuIls in somo dala is lransforrod, vliIo a rolry
doos nol. Disconnocl froos llo bus from Iong poriods of vail slalos. Tlo discon-
noclod maslor vails a minimum of 2 cIocIs boforo onco again arbilraling for uso
of llo bus and conlinuing llo bus cycIo al llo disconnoclod addross. During llo
limo llal llo bus maslor is disconnoclod, llo arbilor may granl llo bus lo ollor
roquosling maslors so llal llo ICI bus is uliIizod moro officionlIy. By llo limo
llo disconnoclod maslor is granlod llo bus and conlinuos llo bus cycIo, lopo-
fuIIy llo largol is roady lo conlinuo llo dala lransfor unliI il is compIolod. Ollor-
viso, llo largol onco again rolrios or disconnocls llo maslors bus cycIo and llo
procoss is ropoalod unliI llo maslor succossfuIIy lransfors aII ils dala.
PCI Interrupt HandIing
ConlraI lo llo ICI inlorrupl landIing prolocoI is llo inlorrupl conlroIIor slovn
in Iiguro 1-9. ICI dovicos uso ono-of-four inlorrupl signaIs (INTA#, INTB#,
INTC#, INTD#) lo lriggor an inlorrupl roquosl lo llo inlorrupl conlroIIor. In
lurn, llo inlorrupl conlroIIor assorls INTR lo llo CIU. If llo arclilocluro sup-
porls an AIIC (Advancod IrogrammabIo Inlorrupl ConlroIIor) llon il sonds an
AIIC mossago lo llo CIU as opposod lo assorling llo INTR signaI. Tlo inlor-
ruplod CIU dolorminos llo sourco of llo inlorrupl, savos ils slalo and sorvicos
llo dovico llal gonoralod llo inlorrupl. Inlorrupls on ICI INTx# signaIs aro
slarabIo. Tlis aIIovs muIlipIo dovicos lo gonoralo lloir inlorrupls on llo samo
inlorrupl signaI. OS soflvaro las llo ovorload lo dolormino vlicl ono of llo
dovicos slaring llo inlorrupl signaI gonoralod llo inlorrupl. Tlis is accom-
pIislod by poIIing llo Inlorrupl Ionding bil mappod in a dovicos momory
spaco. Doing so incurs addilionaI Ialoncy in sorvicing llo inlorrupling dovico.
-- -

PCI Error HandIing

ICI dovicos aro oplionaIIy dosignod lo dolocl addross and dala plaso parily
orrors during lransaclions. Ivon parily is gonoralod on llo IAR signaI during
oacl bus cycIos addross and dala plasos. Tlo dovico llal rocoivos llo addross
or dala during a bus cycIo usos llo parily signaI lo dolormino if a parily orror
las occurrod duo lo noiso on llo ICI bus. If a dovico dolocls an addross plaso
parily orror, il assorls SIRR#. If a dovico dolocls a dala plaso parily orror, il
assorls IIRR#. Tlo IIRR# and SIRR# signaIs aro connoclod lo llo orror Iogic
(in llo Soull bridgo) as slovn in Iiguro 1-10 on pago 27. In many sysloms, llo
orror Iogic assorls llo NMI signaI (non-masIabIo inlorrupl signaI) lo llo CIU
upon dolocling IIRR# or SIRR#. Tlis inlorrupl rosuIls in nolificalion of a parily
orror and llo syslom sluls dovn (Wo aII Inov llo bIuo scroon of doall). Kind of
draconian donl you agroo`

Processor
North Bridge
(Intel 440) SDRAM
South Bridge
AGP
2x
PCI-33MHz
IDE
HDD
USB
GFX
CD
Super
IO
COM1
COM2
Super
IO
COM1
COM2
SCSI
Audio
Chip
Modem
Chip
ISA
Boot
ROM
FSB
Ethernet
Slots
Arbiter
Interrupt
Controller
INTR
INTx#
INTx#
-

UnforlunaloIy, ICI orror doloclion and roporling is nol robusl. ICI orrors aro
falaI uncorroclabIo orrors llal many limos rosuIl in syslom sluldovn. Iurllor,
orrors aro doloclabIo as Iong as an odd numbor of signaIs aro affoclod by noiso.
Givon llo poor ICI orror doloclion prolocoI and orror landIing poIicios, many
syslom dosigns oillor disabIo or do nol supporl orror clocIing and roporling.
PCI Address Space Map
ICI arclilocluro supporls 3 addross spacos slovn in Iiguro 1-11. Tloso aro llo
momory, IO and configuralion addross spacos. Tlo momory addross spaco goos
up lo 4 GB for sysloms llal supporl 32-bil momory addrossing and oplionaIIy
up lo 16 IB (oxabylos) for sysloms llal supporl 64-bil momory addrossing. ICI
supporls up lo 4GB of IO addross spaco, lovovor, many pIalforms Iimil IO
spaco lo 64 KB duo lo X86 CIUs onIy supporling 64 KB of IO addross spaco. ICI
dovicos aro configurod lo map lo a configurabIo rogion villin oillor llo mom-
ory or IO addross spaco.

Processor
North Bridge
(Intel 440)
SDRAM
South Bridge
AGP
2x
PCI-33MHz
IDE
HDD
USB
GFX
CD
Super
IO
COM1
COM2
Super
IO
COM1
COM2
SCSI
Audio
Chip
Modem
Chip
ISA
Boot
ROM
FSB
Ethernet
Slots
Arbiter
Error
Logic
NMI
PERR#
SERR#
-- -

ICI dovico configuralion rogislors map lo a llird spaco caIIod configuralion

addross spaco. Iacl ICI funclion may lavo up lo 256 Bylos of configuralion
addross spaco. Tlo configuralion addross spaco is 16 MBylos. Tlis is caIcuIalod
by muIlipIying 256 Bylos, by 8 funclions por dovico, by 32 dovicos por bus, by
256 busos por syslom. An x86 CIU can accoss momory or IO addross spaco bul
doos nol supporl configuralion addross spaco diroclIy. Insload, CIUs accoss ICI
configuralion spaco indiroclIy by indoxing llrougl an IO mappod Addross Iorl
and Dala Iorl in llo losl bridgo (Norll bridgo or MCH). Tlo Addross Iorl is
Iocalod al IO addross CI8l-CIBl and llo Dala Iorl is mappod lo Iocalion
CICl-CIIl.
--
Boot ROM
Expansion ROM
Legacy Video
Extended
Memory
Conventional
Memory
1MB
AGP Video
PCI
Memory
PCI
Memory
DRAM Boundary
4GB / 16 EB
Memory Map
IO Map
Legacy IO
1KB
Data Port
Address Port CF8h-CFBh
CFCh-CFFh
64KB
PCI IO
Space
PCI
Configuration
Space
16MB
256B
256B
256B
640KB
-

PCI Configuration CycIe Generation

ICI configuralion cycIo gonoralion invoIvos lvo slops.
Slop 1: Tlo CIU gonoralos an IO vrilo lo llo Addross Iorl al IO addross CI8l
in llo Norll bridgo. Tlo dala vrillon lo llo Addross Iorl is llo configuralion
rogislor addross lo bo accossod.
Slop 2: Tlo CIU oillor gonoralos an IO road or IO vrilo lo llo Dala Iorl al Ioca-
lion CICl in llo Norll bridgo. Tlo Norll bridgo in lurn llon gonoralos oillor a
configuralion road or configuralion vrilo lransaclion on llo ICI bus.
Tlo addross for llo configuralion lransaclion addross plaso is oblainod from
llo conlonls of llo Addross rogislor. During llo configuralion bus cycIo, ono of
llo poinl-lo-poinl IDSII signaIs slovn in Iiguro 1-12 on pago 29 is assorlod lo
soIocl llo dovico vloso rogislor is boing accossod. Tlal ICI largol dovico cIaims
llo configuralion cycIo and fuIfiIIs llo roquosl.

Processor
North Bridge
(Intel 440) SDRAM
South Bridge
AGP
2x
PCI-33MHz
IDE
HDD
USB
GFX
CD
Super
IO
COM1
COM2
Super
IO
COM1
COM2
SCSI
Audio
Chip
Modem
Chip
ISA
Boot
ROM
FSB
Ethernet
Slots
Address Port Data Port
IDSEL
Config.
Reg.
Config.
Reg.
Config.
Reg.
-- -

PCI Function Configuration Register Space

Iacl ICI dovico conlains up lo 256 Bylos of configuralion rogislor spaco. Tlo
firsl 64 bylos aro configuralion loador rogislors and llo romainding 192 Bylos
aro dovico spocific rogislors. Tlo loador rogislors aro configurod al bool limo by
llo Bool ROM configuralion firmvaro and by llo OS. Tlo dovico spocific rogis-
lors aro configurod by llo dovicos dovico drivor llal is Ioadod and oxoculod by
llo OS al bool limo.
Willin llo loador spaco, llo Baso Addross rogislors aro ono of llo mosl impor-
lanl rogislors configurod by llo IIug and IIay configuralion soflvaro. Il is via
lloso rogislors llal soflvaro assigns a dovico ils momory and/or IO addross
spaco villin llo sysloms momory and IO addross spaco. No lvo dovicos aro
assignod llo samo addross rango, llus onsuring llo pIug and pIay naluro of
llo ICI syslom.
-
Reserved
Reserved
Header
Type
Expansion ROM
Base Address
Base Address 5
Base Address 0
Base Address 1
Base Address 2
Base Address 3
Base Address 4
Vendor
ID
Device
ID
Latency
Timer
00
01
02
03
04
05
06
07
08
09
10
11
12
13
14
15
Revision
ID
Class Code
Interrupt
Line
Interrupt
Pin
Min_Gnt Max_Lat
BIST
Cache
Line
Size
Status
Register
Command
Register
Required configuration registers
Doubleword
Number
(in decimal)
0 1 2 3
Byte
Subsystem ID
Subsystem
Vendor ID
CardBus CIS Pointer
Capabilities
Pointer
192 Byte
Device Specific
Configuration Register Space
64 Byte
PCI Configuration Header
(Two formats: Header 0
and Header 1)
256 Byte Configuration
Register Space Per Function Header 0
-

PCI Programming ModeI

Soflvaro inslruclions may causo llo CIU lo gonoralo momory or IO road/vrilo
bus cycIos. Tlo Norll bridgo docodos llo addross of llo rosuIling CIU bus
cycIos, and if llo addross maps lo ICI addross spaco, llo bridgo in lurn gonor-
alos a ICI momory or IO road/vrilo bus cycIo. A largol dovico on llo ICI bus
cIaims llo cycIo and compIolos llo lransfor. In summary, llo CIU communi-
calos vill any ICI dovico via llo Norll bridgo, vlicl gonoralos ICI momory or
IO bus cycIos on llo bolaIf of llo CIU.
An inloIIigonl ICI dovico llal incIudos a IocaI procossor or bus maslor slalo
maclino (lypicaIIy inloIIigonl IO cards) can aIso inilialo ICI momory or IO
lransaclions on llo ICI bus. Tloso maslors can communicalo diroclIy vill any
ollor dovicos, incIuding syslom momory associalod vill llo Norll bridgo.
A dovico drivor oxoculing on llo CIU configuros llo dovico-spocific configura-
lion rogislor spaco of an associalod ICI dovico. A configurod ICI dovico llal is
bus maslor capabIo can inilialo ils ovn lransaclions, vlicl aIIovs il lo commu-
nicalo vill any ollor ICI largol dovico incIuding syslom momory associalod
vill llo Norll bridgo.
Tlo CIU can accoss configuralion spaco as doscribod in llo provious soclion.
ICI Ixpross arclilocluro assumos llo idonlicaI programming modoI as llo ICI
programming modoI doscribod abovo. In facl, curronl OSs vrillon for ICI sys-
loms can bool a ICI Ixpross syslom. Curronl ICI dovico drivors viII iniliaIizo
ICI Ixpross dovicos villoul any drivor clangos. ICI configuralion and onu-
moralion firmvaro viII funclion unmodifiod on a ICI Ixpross syslom.
Limitations of a 33 MHz PCI System
As indicalod in TabIo 1-2 on pago 13, poaI bandvidll acliovabIo on a 64-bil 33
MHz ICI bus is 266 Mbylos/soc. Curronl ligl-ond vorIslalion and sorvor
appIicalions roquiro groalor bandvidll.
AppIicalions sucl as gigabil Illornol and ligl porformanco disc lransfors in
RAID and SCSI configuralions roquiro groalor bandvidll capabiIily llan llo 33
MHz ICI bus offors.
-- -

Latest Generation of InteI PCI Chipsets

Iiguro 1-14 slovs an oxampIo of a Ialor gonoralion InloI ICI clipsol. Tlo lvo
sladod dovicos aro NOT llo Norll bridgo and Soull bridgo slovn in oarIior
diagrams. Insload, ono dovico is llo Momory ConlroIIor Hub (MCH) and llo
ollor is llo IO ConlroIIor Hub (ICH). Tlo lvo clips aro connoclod by a propri-
olary InloI ligl llrouglpul, Iov pin counl bus caIIod llo Hub IinI.
Tlo ICH incIudos llo Soull bridgo funclionaIily bul doos nol supporl llo ISA
bus. Ollor busos associalod vill ICH incIudo IIC (Iov pin counl) bus, AC97,
Illornol, Bool ROM, IDI, USB, SMbus and finaIIy llo ICI bus. Tlo advanlago
of llis arclilocluro ovor provious arclilocluros is llal llo IDI, USB, Illornol
and audio dovicos do nol lransfor lloir dala llrougl llo ICI bus lo momory as
is llo caso vill oarIior clipsols. Insload lloy do so llrougl llo Hub IinI. Hub
IinI is a liglor porformanco bus comparod lo ICI. In ollor vords, lloso
dovicos bypass llo ICI bus vlon communicaling vill momory. Tlo rosuIl is
improvod porformanco.
- --
Processor
Memory Controller Hub
(Intel 8XX GMCH) DDR
SDRAM
IO Controller Hub
(ICH4)
IEEE
1394
AGP
4x
PCI-33MHz
Hub Link
IDE
HDD
USB
LPC
GFX
CD
Super
IO
COM1
COM2
Super
IO
COM1
COM2
SCSI
Audio
Codec
Modem
Codec
AC97
Link
Boot
ROM
FSB
Ethernet
Slots
-

66 MHz PCI Bus Based System

Higl ond sysloms llal roquiro bollor IO bandvidll impIomonl a 66 MHz 64-bil
ICI busos. Tlis ICI bus supporls poaI dala lransfor ralo of 533 MBylos/soc.
Tlo ICI 2.1 spocificalion roIoasod in 1995 addod 66MHz ICI supporl.
Iiguro 1-15 slovs an oxampIo of a 66 MHz ICI bus basod syslom. Tlis syslom
las simiIar foaluros lo llal doscribod in Iiguro 1-14 on pago 32. Hovovor, llo
MCH clip in llis oxampIo supporls lvo addilionaI Hub IinI busos llal con-
nocl lo I64H (ICI 64-bil Hub) bridgo clips, providing accoss lo llo 64-bil, 66
MHz busos. Tloso busos oacl supporl 1 connoclor in vlicl a ligl-ond poripl-
oraI card may bo inslaIIod.
- -
Processor
Memory Controller Hub
(Intel 860 MCH)
RDRAM
IO Controller Hub
(ICH2)
IEEE
1394
AGP
4x
PCI-33MHz
Hub Link
IDE
HDD
USB 2.0
LPC
GFX
CD
Super
IO
COM1
COM2
Super
IO
COM1
COM2
SCSI
Audio
Codec
Modem
Codec
AC97
Link
Boot
ROM
Processor
FSB
Ethernet
RDRAM
P64H
Hub Link
P64H
PCI-66MHz
Slots
Slot
-- -

Limitations of 66 MHz PCI bus

Tlo ICI cIocI poriod al 66 MHz is 15 ns. RocaII llal ICI supporls rofIoclod-
vavo signaIing drivors llal aro voaIor drivors, vlicl lavo sIovor riso and faII
limos as comparod lo incidonl-vavo signaIing drivors. Il is a claIIongo lo dosign
a 66 MHz dovico or syslom llal salisfios llo signaI liming roquiromonls.
A 66 MHz ICI basod mollorboard is roulod vill slorlor signaI lracos lo onsuro
slorlor signaI propagalion doIays. In addilion, llo bus is Ioadod vill fovor
Ioads in ordor lo onsuro faslor signaI riso and faII limos. TaIing inlo accounl lyp-
icaI board impodancos and minimum signaI lraco Ionglls, il is possibIo lo inlor-
connocl a maximum of four lo fivo 66 MHz ICI dovicos. OnIy ono or lvo
connoclors may bo connoclod on a 66 MHz ICI bus. Tlis is a significanl Iimila-
lion for a syslom vlicl roquiros muIlipIo dovicos inlorconnoclod.
Tlo soIulion roquiros llo addilion of ICI bridgos and lonco muIlipIo busos lo
inlorconnocl dovicos. Tlis soIulion is oxponsivo and consumos addilionaI board
roaI oslalo. In addilion, lransaclions bolvoon dovicos on opposilo sidos of a
bridgo compIolo vill groalor Ialoncy bocauso bridgos impIomonl doIayod lrans-
aclions. Tlis roquiros bridgos lo rolry aII lransaclions llal musl cross lo llo
ollor sido (vill llo oxcoplion of momory vrilos vlicl aro poslod).
Limitations of PCI Architecture
Tlo maximum froquoncy acliovabIo vill llo ICI arclilocluro is 66 MHz. Tlis
is a rosuIl of llo slalic cIocI mollod of driving and Ialcling signaIs and bocauso
rofIoclod-vavo signaIing is usod.
ICI bus officioncy is in llo ordor of 50 or 60. Somo of llo faclors llal conlrib-
ulo lovards llis roducod officioncy aro Iislod boIov.
Tlo ICI spocificalion aIIovs maslor and largol dovicos lo insorl vail-slalos dur-
ing dala plasos of a bus cycIo. SIov dovicos viII add vail-slalos vlicl roducos
llo officioncy of bus cycIos.
ICI bus cycIos do nol indicalo lransfor sizo. Tlis maIos buffor managomonl
villin maslor and largol dovicos inofficionl.
DoIayod lransaclions on ICI aro landIod inofficionlIy. Wlon a maslor is rolriod,
il guossos vlon lo lry again. If llo maslor lrios loo soon, llo largol may rolry llo
lransaclion again. If llo maslor vails loo Iong lo rolry, llo Ialoncy lo compIolo a
dala lransfor is incroasod. SimiIarIy, if a largol disconnocls a lransaclion llo
maslor musl guoss vlon lo rosumo llo bus cycIo al a Ialor limo.
-

AII ICI bus maslor accossos lo syslom momory rosuIl in a snoop accoss lo llo
CIU caclo. Doing so rosuIls in addilionaI vail slalos during ICI bus maslor
accossos of syslom momory. Tlo Norll bridgo or MCH musl assumo aII syslom
momory addross spaco is caclabIo ovon llougl llis may nol bo llo caso. ICI
bus cycIos provido no moclanism by vlicl lo indicalo an accoss lo non-cacl-
abIo momory addross spaco.
ICI arclilocluro obsorvos slricl ordoring ruIos as dofinod by llo spocificalion.
Ivon if a ICI appIicalion doos nol roquiro obsorvalion of lloso slricl ordoring
ruIos, ICI bus cycIos do nol provido a moclanism lo aIIov roIaxod ordoring
ruIo. Obsorving roIaxod ordoring ruIos aIIovs bus cycIos (ospociaIIy lloso llal
cross a bridgo) lo compIolo vill roducod Ialoncy.
ICI inlorrupl landIing arclilocluro is inofficionl ospociaIIy bocauso muIlipIo
dovicos slaro a ICI inlorrupl signaI. AddilionaI soflvaro Ialoncy is incurrod
vliIo soflvaro discovors vlicl dovico or dovicos llal slaro an inlorrupl signaI
acluaIIy gonoralod llo inlorrupl.
Tlo procossors NMI inlorrupl inpul is assorlod vlon a ICI parily or syslom
orror is doloclod. UIlimaloIy llo syslom sluls dovn vlon an orror is doloclod.
Tlis is a sovoro rosponso. A moro approprialo rosponso migll bo lo dolocl llo
orror and allompl orror rocovory. ICI doos nol roquiro orror rocovory foaluros,
nor doos il supporl an oxlonsivo rogislor sol for documonling a varioly of dolocl-
abIo orrors.
Tloso Iimilalions abovo lavo boon rosoIvod in llo noxl gonoralion bus arcliloc-
luros, namoIy ICI-X and ICI Ixpross.
66 MHz and 133 MHz PCI-X 1.0 Bus Based PIatforms
Iiguro 1-16 on pago 36 is an oxampIo of an InloI 7500 sorvor clipsol basod sys-
lom. Tlis clipsol las simiIarilios lo llo 8XX clipsol doscribod oarIior. MCH and
ICH clips aro connoclod via a Hub IinI 1.0 bus. Associalod vill ICH is a 32-bil
33 MHz ICI bus. Tlo 7500 MCH clip incIudos 3 addilionaI ligl porformanco
Hub IinI 2.0 porls. Tloso Hub IinI porls aro connoclod lo 3 Hub IinI-lo-ICI-X
Hub 2 bridgos (I64H2). Iacl I64H2 bridgo supporls 2 ICI-X busos llal can run
al froquoncios up lo 133MHz. Hub IinI 2.0 IinIs can suslain llo liglor band-
vidll roquiromonls for ICI-X lraffic llal largols syslom momory.
-- -

PCI-X Features
Tlo ICI-X bus is a liglor froquoncy, liglor porformanco, liglor officioncy bus
comparod lo llo ICI bus.
ICI-X dovicos can bo pIuggod inlo ICI sIols and vico-vorsa. ICI-X and ICI sIols
ompIoy llo samo connoclor formal. Tlus, ICI-X is 100 bacIvards compalibIo
lo ICI from boll a lardvaro and soflvaro slandpoinl. Tlo dovico drivors, OS,
and appIicalions llal run on a ICI syslom aIso run on a ICI-X syslom.
ICI-X signaIs aro rogislorod. A rogislorod signaI roquiros smaIIor solup limo lo
sampIo llo signaI as comparod vill a non-rogislorod signaI ompIoyod in ICI.
AIso, ICI-X dovicos ompIoy IIIs llal aro usod lo pro-drivo signaIs vill smaIIor
cIocI-lo-oul limo. Tlo limo gainod from roducod solup limo and cIocI-lo-oul
limo is usod lovards incroasod cIocI froquoncy capabiIily and llo abiIily lo sup-
- -
Processor
Memory Controller Hub
(Intel 7500 MCH)
DDR SDRAM
IO Controller Hub
(ICH3)
IEEE
1394
PCI-33MHz
Hub Link 1
IDE
USB
LPC
SCSI
AC97
Link
Boot
ROM
Processor
FSB
Ethernet
DDR SDRAM
P64H2
Hub Link 2
P64H2
PCI-X
P64H2
64-bit,
66MHz or 100MHz or 133MHz
Hub Link 2
Slots
-

porl moro dovicos on llo bus al a givon froquoncy comparod lo ICI. ICI-X sup-
porls 8-10 Ioads or 4 connoclors al 66 MHz and 3-4 Ioads or 1-2 connoclors al
133 MHz.
Tlo poaI bandvidll acliovabIo vill 64-bil 133 MHz ICI-X is 1064 MBylos/soc.
IoIIoving llo firsl dala plaso, llo ICI-X bus doos nol aIIov vail slalos during
subsoquonl dala plasos.
Mosl ICI-X bus cycIos aro bursl cycIos and dala is gonoraIIy lransforrod in
bIocIs of no Ioss llan 128 Bylos. Tlis rosuIls in liglor bus uliIizalion. Iurllor,
llo lransfor sizo is spocifiod in llo allribulo plaso of ICI-X lransaclions. Tlis
aIIovs for moro officionl dovico buffor managomonl. Iiguro 1-17 is an oxampIo
of a ICI-X bursl momory road lransaclion.
- - Considor an
oxampIo of llo spIil lransaclion prolocoI supporlod by ICI-X for doIaying lrans-
aclions. Tlis prolocoI is iIIuslralod in Iiguro 1-18. A roquoslor inilialos a road
lransaclion. Tlo compIolor llal cIaims llo bus cycIos may bo unabIo lo rolurn
llo roquoslod dala immodialoIy. Rallor llan signaIing a rolry as vouId bo llo
caso in ICI prolocoI, llo compIolor momorizos llo lransaclion (addross, lransac-
- -
1 2 3 4 5 6 7 8 9
CLK
FRAME#
AD[31:0]
C/BE#[3:0]
IRDY#
TRDY#
DEVSEL#
10 11 12
Address ATTR
Cmd ATTR
Data-0 Data-1 Data-2 Data-3
Address
Phase
Attribute
Phase
Response
Phase
Data
Phase
1
Data
Phase
2
Data
Phase
3
Data
Phase
4
Turnaround
Cycle
Decode
A
Bus
Idle
-- -

lion lypo, bylo counl, roquoslor ID aro momorizod) and signaIs a spIil rosponso.
Tlis prompls llo roquoslor lo ond llo bus cycIo, and llo bus goos idIo. Tlo ICI-
X bus is nov avaiIabIo for ollor lransaclions, rosuIling in moro officionl bus uli-
Iizalion. MoanvliIo, llo roquoslor simpIy vails for llo compIolor lo suppIy il
llo roquoslod dala al a Ialor limo. Onco llo compIolor las gallorod llo
roquoslod dala, il llon arbilralos and oblains bus ovnorslip and inilialos a spIil
compIolion bus cycIo during vlicl il rolurns llo roquoslod dala. Tlo roquoslor
cIaims llo spIil compIolion bus cycIo and accopls llo dala from llo compIolor.
Tlo spIil compIolion bus cycIo is vory mucl IiIo a vrilo bus cycIo. IxaclIy lvo
bus lransaclions aro noodod lo compIolo llo onliro dala lransfor. In bolvoon
lloso lvo bus lransaclions (llo road roquosl and llo spIil compIolion lransac-
lion) llo bus is uliIizod for ollor lransaclions. Tlo roquoslor aIso rocoivos llo
roquoslod dala in a vory officionl mannor.
ICI Ixpross arclilocluro ompIoys a simiIar lransaclion prolocoI.
Tloso porformanco onlancomonl foaluros doscribod so far conlribulo lovards
an incroasod lransfor officioncy of 85 for ICI-X as comparod lo 50-60 vill
ICI prolocoI.
ICI-X dovicos musl supporl Mossago SignaIod Inlorrupl (MSI) arclilocluro,
vlicl is a moro officionl arclilocluro llan llo Iogacy inlorrupl arclilocluro
doscribod in llo ICI arclilocluro soclion. To gonoralo an inlorrupl roquosl, a
-
Requester Completer
1. Requester initiates
read transaction
2. Completer unable to
return data immediately
3. Completer memorizes
transaction
4. Completer issues
split response
5. Completer initiates split completion
bus cycle to return read data
-

ICI-X dovicos inilialos a momory vrilo lransaclion largoling llo Hosl (Norll)
bridgo. Tlo dala vrillon is a uniquo inlorrupl voclor associalod vill llo dovico
gonoraling llo inlorrupl. Tlo Hosl bridgo inlorrupls llo CIU and llo voclor is
doIivorod lo llo CIU in a pIalform spocific mannor. Will llis voclor, llo CIU is
immodialoIy abIo lo run an inlorrupl sorvico roulino lo sorvico llo inlorrupling
dovico. Tloro is no soflvaro ovorload in dolormining vlicl dovico gonoralod
llo inlorrupl. AIso, unIiIo in llo ICI arclilocluro, no inlorrupl pins aro
roquirod.
ICI Ixpross arclilocluro impIomonls llo MSI prolocoI, rosuIling in roducod
inlorrupl sorvicing Ialoncy and oIiminalion of inlorrupl signaIs.
ICI Ixpross arclilocluro aIso supporls llo RO bil and NS bil foaluro vill llo
rosuIl llal lloso lransaclions vill oillor NS=1 or RO=1 compIolo vill bollor
porformanco llan lransaclions vill NS=0 or RO=0. ICI lransaclions by dofini-
lion assumo NS=0 and RO=0.
- No Snoop (NS) may bo usod vlon accossing syslom momory. ICI-X
bus maslors can uso llo NS bil lo indicalo vlollor llo rogion of momory
boing accossod is caclabIo (NS=0) or nol (NS=1). Ior lloso lransaclions
vill NS=1, llo Hosl bridgo doos nol snoop llo procossor caclo. Tlo rosuIl
is improvod porformanco during accossos lo non-caclabIo momory.
- RoIaxod Ordoring (RO) aIIovs lransaclions llal do nol lavo any
ordor of compIolion roquiromonls lo compIolo moro officionlIy. Wo viII nol
gol inlo llo dolaiIs loro. Suffico il lo say llal lransaclions vill llo RO bil sol
can compIolo on llo bus in any ordor vill rospocl lo ollor lransaclions llal
aro ponding compIolion.
Tlo ICI-X 2.0 spocificalion roIoasod in Q1 2002 vas dosignod lo furllor incroaso
llo bandvidll capabiIily of ICI-X bus. Tlis bus is doscribod noxl.
DDR and QDR PCI-X 2.0 Bus Based PIatforms
Iiguro 1-19 slovs a lypollolicaI ICI-X 2.0 syslom. Tlis diagram is llo aullors
bosl guoss as lo vlal a ICI-X 2.0 syslom viII IooI IiIo. ICI-X 2.0 dovicos and
connoclors aro 100 lardvaro and soflvaro bacIvards compalibIo vill ICI-X
1.0 as voII as ICI dovicos and connoclors. A ICI-X 2.0 bus supporls oillor DuaI
Dala Ralo (DDR) or Quad Dala Ralo (QDR) dala lransporl using a ICI-X 133
MHz cIocI and slrobos llal aro plaso sliflod lo provido llo nocossary cIocI
odgos.
-- -

A dosign roquiring groalor llan 1 GBylo/soc bus bandvidll can impIomonl llo
DDR or QDR prolocoI. As indicalod in TabIo 1-2 on pago 13, ICI-X 2.0 poaI
bandvidll capabiIily is 4256 MBylos/soc for a 64-bil 533 MHz offoclivo ICI-X
bus. Will llo aid of a slrobo cIocI, dala is lransforrod lvo limos or four limos
por 133 MHz cIocI.
ICI-X 2.0 dovicos aIso supporl ICC gonoralion and clocIing. Tlis aIIovs aulo-
corroclion of singIo bil orrors and doloclion and roporling of muIli-bil orrors.
Irror landIing is moro robusl llan ICI and ICI-X 1.0 sysloms maIing llis bus
moro suilod for ligl-porformanco, robusl, non-slop sorvor appIicalions.
Somo nolovorlly poinls lo romombor aro llal vill vory fasl signaI liming, il is
onIy possibIo lo supporl ono connoclor on llo ICI-X 2.0 bus. Tlis impIios llal a
ICI-X 2.0 bus ossonliaIIy bocomos a poinl-lo-poinl connoclion vill no muIli-
drop capabiIily as vill ils prodocossor busos.
ICI-X 2.0 bridgos aro ossonliaIIy svilclos vill ono primary bus and ono or
moro dovnslroam socondary busos as slovn in Iiguro 1-19 on pago 40.
- -
Processor
Host Bridge
DDR/QDR
SDRAM
Processor
FSB
PCI-X
DDR/QDR
PCI-X 2.0
Bridge
PCI-X 2.0
Bridge
10Gb
Ethernet
10Gb
Ethernet
10Gb
Ethernet
10Gb
Ethernet
PCI-X
DDR/QDR
PCI-X
DDR/QDR
PCI-X
DDR/QDR
SCSI
RAID
Disk array
PCI-X 1.0
N.B. PCI-X DDR/QDR buses are point-to-point parallel buses
Infiniband
PCI-X
DDR/QDR
PCI-X 1.0
Bridge
PCI-33MHz
S
IO
COM1
COM2
S
IO
COM1
COM2
Graphics
Slot
Slots
Slots
Slot
-

The PCI Express Way

ICI Ixpross providos a ligl-spood, ligl-porformanco, poinl-lo-poinl, duaI sim-
pIox, difforonliaI signaIing IinI for inlorconnocling dovicos. Dala is lransmillod
from a dovico on ono sol of signaIs, and rocoivod on anollor sol of signaIs.
The Link - A Point-to-Point Interconnect
As slovn in Iiguro 1-20, a ICI Ixpross inlorconnocl consisls of oillor a x1, x2,
x4, x8, x12, x16 or x32 poinl-lo-poinl IinI. A ICI Ixpross IinI is llo plysicaI
connoclion bolvoon lvo dovicos. A Iano consisls of signaI pairs in oacl diroc-
lion. A x1 IinI consisls of 1 Iano or 1 difforonliaI signaI pair in oacl diroclion
for a lolaI of 4 signaIs. A x32 IinI consisls of 32 Ianos or 32 signaI pairs for oacl
diroclion for a lolaI of 128 signaIs. Tlo IinI supporls a symmolric numbor of
Ianos in oacl diroclion. During lardvaro iniliaIizalion, llo IinI is iniliaIizod
for IinI vidll and froquoncy of oporalion aulomalicaIIy by llo dovicos on
opposilo onds of llo IinI. No OS or firmvaro is invoIvod during IinI IovoI ini-
liaIizalion.
DifferentiaI SignaIing
ICI Ixpross dovicos ompIoy difforonliaI drivors and rocoivors al oacl porl. Iig-
uro 1-21 slovs llo oIoclricaI claraclorislics of a ICI Ixpross signaI. A posilivo
voIlago difforonco bolvoon llo D+ and D- lorminaIs impIios IogicaI 1. A noga-
livo voIlago difforonco bolvoon D+ and D- impIios a IogicaI 0. No voIlago dif-
foronco bolvoon D+ and D- moans llal llo drivor is in llo ligl-impodanco lri-
slalo condilion, vlicl is roforrod lo as llo oIoclricaI-idIo and Iov-povor slalo of
llo IinI.
--
PCI-XP
Device
A
PCI-XP
Device
B
Link (x1, x2, x4, x8, x12 x16 or x32)
Packet
Packet
-- -

Tlo ICI Ixpross DifforonliaI IoaI-lo-IoaI signaI voIlago al llo lransmillor

rangos from 800 mV - 1200 mV, vliIo llo difforonliaI poaI voIlago is ono-laIf
lloso vaIuos. Tlo common modo voIlago can bo any voIlago bolvoon 0 V and
3.6 V. Tlo difforonliaI drivor is DC isoIalod from llo difforonliaI rocoivor al llo
opposilo ond of llo IinI by pIacing a capacilor al llo drivor sido of llo IinI.
Tvo dovicos al opposilo onds of a IinI may supporl difforonl DC common
modo voIlagos. Tlo difforonliaI impodanco al llo rocoivor is malclod vill llo
board impodanco lo provonl rofIoclions from occurring.
Switches Used to Interconnect MuItipIe Devices
Svilclos aro impIomonlod in sysloms roquiring muIlipIo dovicos lo bo inlorcon-
noclod. Svilclos can rango from a 2-porl dovico lo an n-porl dovico, vloro oacl
porl connocls lo a ICI Ixpross IinI. Tlo spocificalion doos nol indicalo a maxi-
mum numbor of porls a svilcl can impIomonl. A svilcl may bo incorporalod
inlo a Rool CompIox dovico (Hosl bridgo or Norll bridgo oquivaIonl), rosuIling
in a muIli-porl rool compIox. Iiguro 1-23 on pago 52 and Iiguro 1-25 on pago 54
aro oxampIos of ICI Ixpross sysloms sloving muIli-porlod dovicos sucl as llo
rool compIox or svilclos.
Packet Based ProtocoI
Rallor llan bus cycIos vo aro famiIiar vill from ICI and ICI-X arclilocluros,
ICI Ixpross oncodos lransaclions using a pacIol basod prolocoI. IacIols aro
lransmillod and rocoivod soriaIIy and bylo slripod across llo avaiIabIo Ianos of
llo IinI. Tlo moro Ianos impIomonlod on a IinI llo faslor a pacIol is lransmil-
lod and llo groalor llo bandvidll of llo IinI. Tlo pacIols aro usod lo supporl
llo spIil lransaclion prolocoI for non-poslod lransaclions. Various lypos of pacI-
ols sucl as momory road and vrilo roquosls, IO road and vrilo roquosls, config-
uralion road and vrilo roquosls, mossago roquosls and compIolions aro dofinod.
--
D+
D-
V
Diffp
V
cm
-

Bandwidth and CIocking

As is apparonl from TabIo 1-3 on pago 14, llo aggrogalo bandvidll acliovabIo
vill ICI Ixpross is significanlIy liglor llan any bus avaiIabIo loday. Tlo ICI
Ixpross 1.0 spocificalion supporls 2.5 Gbils/soc/Iano/diroclion lransfor ralo.
No cIocI signaI oxisls on llo IinI. Iacl pacIol lo bo lransmillod ovor llo IinI
consisls of bylos of informalion. Iacl bylo is oncodod inlo a 10-bil symboI. AII
symboIs aro guaranlood lo lavo ono-zoro lransilions. Tlo rocoivor usos a III lo
rocovor a cIocI from llo 0-lo-1 and 1-lo-0 lransilions of llo incoming bil slroam.
Address Space
ICI Ixpross supporls llo samo addross spacos as ICI: momory, IO and configu-
ralion addross spacos. In addilion, llo maximum configuralion addross spaco
por dovico funclion is oxlondod from 256 Bylos lo 4 KBylos. Nov OS, drivors
and appIicalions aro roquirod lo laIo advanlago of llis addilionaI configuralion
addross spaco. AIso, a nov mossaging lransaclion and addross spaco providos
mossaging capabiIily bolvoon dovicos. Somo mossagos aro ICI Ixpross slan-
dard mossagos usod for orror roporling, inlorrupl and povor managomonl mos-
saging. Ollor mossagos aro vondor dofinod mossagos.
PCI Express Transactions
ICI Ixpross supporls llo samo lransaclion lypos supporlod by ICI and ICI-X.
Tloso incIudo momory road and momory vrilo, I/O road and I/O vrilo, config-
uralion road and configuralion vrilo. In addilion, ICI Ixpross supporls a nov
lransaclion lypo caIIod Mossago lransaclions. Tloso lransaclions aro oncodod
using llo pacIol-basod ICI Ixpross prolocoI doscribod Ialor.
PCI Express Transaction ModeI
ICI Ixpross lransaclions can bo dividod inlo lvo calogorios. Tloso lransaclions
llal aro non-poslod and lloso llal aro poslod. Non-poslod lransaclions, sucl as
momory roads, impIomonl a spIil lransaclion communicalion modoI simiIar lo
llo ICI-X spIil lransaclion prolocoI. Ior oxampIo, a roquoslor dovico lransmils a
non-poslod lypo momory road roquosl pacIol lo a compIolor. Tlo compIolor
rolurns a compIolion pacIol vill llo road dala lo llo roquoslor. Ioslod lransac-
lions, sucl as momory vrilos, consisl of a momory vrilo pacIol lransmillod
uni-diroclionaIIy from roquoslor lo compIolor vill no compIolion pacIol
rolurnod from compIolor lo roquoslor.
-- -

Error HandIing and Robustness of Data Transfer

CRC fioIds aro omboddod villin oacl pacIol lransmillod. Ono of llo CRC fioIds
supporls a IinI-IovoI orror clocIing prolocoI vloroby oacl rocoivor of a pacIol
clocIs for IinI-IovoI CRC orrors. IacIols lransmillod ovor llo IinI in orror aro
rocognizod vill a CRC orror al llo rocoivor. Tlo lransmillor of llo pacIol is
nolifiod of llo orror by llo rocoivor. Tlo lransmillor aulomalicaIIy rolrios sond-
ing llo pacIol (vill no soflvaro invoIvomonl), lopofuIIy rosuIling in aulo-cor-
roclion of llo orror.
In addilion, an oplionaI CRC fioId villin a pacIol aIIovs for ond-lo-ond dala
inlogrily clocIing roquirod for ligl avaiIabiIily appIicalions.
Irror landIing on ICI Ixpross can bo as rudimonlary as ICI IovoI orror lan-
dIing doscribod oarIior or can bo robusl onougl for sorvor-IovoI roquiromonls. A
ricl sol of orror Iogging rogislors and orror roporling moclanisms provido for
improvod fauIl isoIalion and rocovory soIulions roquirod by RAS (RoIiabIo,
AvaiIabIo, SorvicoabIo) appIicalions.
QuaIity of Service (QoS), Traffic CIasses (TCs) and VirtuaI
ChanneIs (VCs)
Tlo QuaIily of Sorvico foaluro of ICI Ixpross rofors lo llo capabiIily of rouling
pacIols from difforonl appIicalions llrougl llo fabric vill difforonlialod priori-
lios and dolorminislic Ialoncios and bandvidll. Ior oxampIo, il may bo dosir-
abIo lo onsuro llal Isoclronous appIicalions, sucl as vidoo dala pacIols, movo
llrougl llo fabric vill liglor priorily and guaranlood bandvidll, vliIo con-
lroI dala pacIols may nol lavo spocific bandvidll or Ialoncy roquiromonls.
ICI Ixpross pacIols conlain a Traffic CIass (TC) numbor bolvoon 0 and 7 llal is
assignod by llo dovicos appIicalion or dovico drivor. IacIols vill difforonl TCs
can movo llrougl llo fabric vill difforonl priorily, rosuIling in varying porfor-
mancos. Tloso pacIols aro roulod llrougl llo fabric by uliIizing virluaI clannoI
(VC) buffors impIomonlod in svilclos, ondpoinls and rool compIox dovicos.
Iacl Traffic CIass is individuaIIy mappod lo a VirluaI ClannoI (a VC can lavo
sovoraI TCs mappod lo il, bul a TC cannol bo mappod lo muIlipIo VCs). Tlo TC
in oacl pacIol is usod by llo lransmilling and rocoiving porls lo dolormino
vlicl VC buffor lo drop llo pacIol inlo. Svilclos and dovicos aro configurod lo
arbilralo and priorilizo bolvoon pacIols from difforonl VCs boforo forvarding.
Tlis arbilralion is roforrod lo as VC arbilralion. In addilion, pacIols arriving al
difforonl ingross porls aro forvardod lo lloir ovn VC buffors al llo ogross porl.
Tloso lransaclions aro priorilizod basod on llo ingross porl numbor vlon boing
-

morgod inlo a common VC oulpul buffor for doIivory across llo ogross IinI.
Tlis arbilralion is roforrod lo as Iorl arbilralion.
Tlo rosuIl is llal pacIols vill difforonl TC numbors couId obsorvo difforonl
porformanco vlon roulod llrougl llo ICI Ixpross fabric.
FIow ControI
A pacIol lransmillod by a dovico is rocoivod inlo a VC buffor in llo rocoivor al
llo opposilo ond of llo IinI. Tlo rocoivor poriodicaIIy updalos llo lransmillor
vill informalion rogarding llo amounl of buffor spaco il las avaiIabIo. Tlo
lransmillor dovico viII onIy lransmil a pacIol lo llo rocoivor if il Inovs llal llo
rocoiving dovico las sufficionl buffor spaco lo loId llo noxl lransaclion. Tlo
prolocoI by vlicl llo lransmillor onsuros llal llo rocoiving buffor las sufficionl
spaco avaiIabIo is roforrod lo as fIov conlroI. Tlo fIov conlroI moclanism guar-
anloos llal a lransmillod pacIol viII bo accoplod by llo rocoivor, baring orror
condilions. As sucl, llo ICI Ixpross lransaclion prolocoI doos nol roquiro sup-
porl of pacIol rolry (unIoss an orror condilion is doloclod in llo rocoivor),
lloroby improving llo officioncy vill vlicl pacIols aro forvardod lo a rocoivor
via llo IinI.
MSI StyIe Interrupt HandIing SimiIar to PCI-X
Inlorrupl landIing is accompIislod in-band via ICI-X-IiIo MSI prolocoI. ICI
Ixpross dovico uso a momory vrilo pacIol lo lransmil an inlorrupl voclor lo llo
rool compIox losl bridgo dovico, vlicl in-lurn inlorrupls llo CIU. ICI Ixpross
dovicos aro roquirod lo impIomonl llo MSI capabiIily rogislor bIocI. ICI
Ixpross aIso supporls Iogacy inlorrupl landIing in-band by oncoding inlorrupl
signaI lransilions (for INTA#, INTB#, INTC# and INTD#) using Mossago lrans-
aclions. OnIy ondpoinl dovicos llal musl supporl Iogacy funclions and ICI
Ixpross-lo-ICI bridgos aro aIIovod lo supporl Iogacy inlorrupl gonoralion.
Power Management
Tlo ICI Ixpross fabric consumos Ioss povor bocauso llo inlorconnocl consisls
of fovor signaIs llal lavo smaIIor signaI svings. Iacl dovicos povor slalo is
individuaIIy managod. ICI/ICI Ixpross povor managomonl soflvaro dolor-
minos llo povor managomonl capabiIily of oacl dovico and managos il individ-
uaIIy in a mannor simiIar lo ICI. Dovicos can nolify soflvaro of lloir curronl
povor slalo, as voII as povor managomonl soflvaro can propagalo a vaIo-up
ovonl llrougl llo fabric lo povor-up a dovico or group of dovicos. Dovicos can
aIso signaI a vaIo-up ovonl using an in-band moclanism or a sido-band signaI.
-- -

Will no soflvaro invoIvomonl, dovicos pIaco a IinI inlo a povor savings slalo
aflor a limo-oul vlon lloy rocognizo llal lloro aro no pacIols lo lransmil ovor
llo IinI. Tlis capabiIily is roforrod lo as Aclivo Slalo povor managomonl.
ICI Ixpross supporls dovico povor slalos: D0, D1, D2, D3-Hol and D3-CoId,
vloro D0 is llo fuII-on povor slalo and D3-CoId is llo Iovosl povor slalo.
ICI Ixpross aIso supporls llo foIIoving IinI povor slalos: I0, I0s, I1, I2 and
I3, vloro I0 is llo fuII-on IinI slalo and I3 is llo IinI-Off povor slalo.
Hot PIug Support
ICI Ixpross supporls lol pIug and surpriso lol unpIug villoul usago of sido-
band signaIs. Hol pIug inlorrupl mossagos, communicalod in-band lo llo rool
compIox, lriggor lol pIug soflvaro lo dolocl a lol pIug or romovaI ovonl. Rallor
llan impIomonling a conlraIizod lol pIug conlroIIor as oxisls in ICI pIalforms,
llo lol pIug conlroIIor funclion is dislribulod lo llo porl Iogic associalod vill a
lol pIug capabIo porl of a svilcl or rool compIox. 2 coIorod IIDs, a ManuaIIy-
oporalod Rolonlion Ialcl (MRI), MRI sonsor, allonlion bullon, povor conlroI
signaI and IRSNT2# signaI aro somo of llo oIomonls of a lol pIug capabIo porl.
PCI CompatibIe Software ModeI
ICI Ixpross ompIoys llo samo programming modoI as ICI and ICI-X sysloms
doscribod oarIior in llis claplor. Tlo momory and IO addross spaco romains llo
samo as ICI/ICI-X. Tlo firsl 256 Bylos of configuralion spaco por ICI Ixpross
funclion is llo samo as ICI/ICI-X dovico configuralion addross spaco, llus
onsuring llal curronl OSs and dovico drivors viII run on a ICI Ixpross syslom.
ICI Ixpross arclilocluro oxlonds llo configuralion addross spaco lo 4 KB por
funclionaI dovico. Updalod OSs and dovico drivors aro roquirod lo laIo advan-
lago and accoss llis addilionaI configuralion addross spaco.
ICI Ixpross configuralion modoI supporls lvo moclanisms:
1. ICI compalibIo configuralion modoI vlicl is 100 compalibIo vill oxisl-
ing OSs and bus onumoralion and configuralion soflvaro for ICI/ICI-X
sysloms.
2. ICI Ixpross onlancod configuralion moclanism vlicl providos accoss lo
addilionaI configuralion spaco boyond llo firsl 256 Bylos and up lo 4
KBylos por funclion.
-

MechanicaI Form Factors

ICI Ixpross arclilocluro supporls muIlipIo pIalform inlorconnocls sucl as clip-
lo-clip, board-lo-poriploraI card via ICI-IiIo connoclors and Mini ICI Ixpross
form faclors for llo mobiIo marIol. Spocificalions for lloso aro fuIIy dofinod. Soo
Add-in Cards and Connoclors on pago 685 for dolaiIs on ICI Ixpross poripl-
oraI card and connoclor dofinilion.
CurronlIy, x1, x4, x8 and x16
ICI-IiIo connoclors aro dofinod aIong vill associalod poriploraI cards. DosIlop
compulors impIomonling ICI Ixpross can lavo llo samo IooI and fooI as cur-
ronl compulors vill no clangos roquirod lo oxisling syslom form faclors. ICI
Ixpross mollorboards can lavo an ATX-IiIo mollorboard form faclor.
-- Mini ICI Ixpross connoclor and add-in
card impIomonls a subsol of signaIs llal oxisl on a slandard ICI Ixpross con-
noclor and add-in card. Tlo form faclor, as llo namo impIios, is mucl smaIIor.
Tlis form faclor largols llo mobiIo compuling marIol. Tlo Mini ICI Ixpross
sIol supporls x1 ICI Ixpross signaIs incIuding povor managomonl signaIs. In
addilion, llo sIol supporls IID conlroI signaIs, a USB inlorfaco and an SMBus
inlorfaco. Tlo Mini ICI Ixpross moduIo is simiIar bul smaIIor llan a IC Card.
MechanicaI Form Factors Pending ReIease
As of May 2003, spocificalions for lvo nov form faclors lavo nol boon roIoasod.
BoIov is a summary of pubIicIy avaiIabIo informalion aboul lloso form faclors.
Anollor nov moduIo form faclor llal viII sor-
vico boll mobiIo and dosIlop marIols is llo NIWCARD form faclor. Tlis is a
ICMCIA IC card lypo form faclor, bul of noarIy laIf llo sizo llal viII supporl
x1 ICI Ixpross signaIs incIuding povor managomonl signaIs. In addilion, llo
sIol supporls USB and SMBus inlorfacos. Tloro aro lvo sizo form faclors
dofinod, a narrovor vorsion and a vidor vorsion llougl llo llicInoss and
dopll romain llo samo. AIllougl simiIar in appoaranco lo Mini ICI Ixpross
ModuIo, llis is a difforonl form faclor.
Tloso aro a famiIy of moduIos
llal largol llo vorIslalion and sorvor marIol. Tloy aro dosignod vill fuluro
supporl of Iargor ICI Ixpross Iano vidlls and liglor froquoncy bil ralos
boyond 2.5 Gbils/s Gonoralion 1 lransmission ralos. Iour form faclors aro
undor considoralion. Tlo baso moduIo vill singIo- and doubIo-vidll moduIos.
AIso, llo fuII loigll vill singIo- and doubIo-vidll moduIos.
-- -

PCI Express TopoIogy

Major compononls in llo ICI Ixpross syslom slovn in Iiguro 1-22 incIudo a
rool compIox, svilclos, and ondpoinl dovicos.
Tlo donolos llo dovico llal connocls llo CIU and momory sub-
syslom lo llo ICI Ixpross fabric. Il may supporl ono or moro ICI Ixpross porls.
Tlo rool compIox in llis oxampIo supporls 3 porls. Iacl porl is connoclod lo an
ondpoinl dovico or a svilcl vlicl forms a sub-liorarcly. Tlo rool compIox
gonoralos lransaclion roquosls on llo bolaIf of llo CIU. Il is capabIo of inilial-
ing configuralion lransaclion roquosls on llo bolaIf of llo CIU. Il gonoralos
boll momory and IO roquosls as voII as gonoralos IocIod lransaclion roquosls
on llo bolaIf of llo CIU. Tlo rool compIox as a compIolor doos nol rospond lo
IocIod roquosls. Rool compIox lransmils pacIols oul of ils porls and rocoivos
pacIols on ils porls vlicl il forvards lo momory. A muIli-porl rool compIox
may aIso roulo pacIols from ono porl lo anollor porl bul is NOT roquirod by
llo spocificalion lo do so.
--
Switch
PCI-XP
Endpoint
Legacy
Endpoint
PCI-XP
Endpoint
Root Complex
CPU
PCI-XP 1
Memory
PCI-XP
Bridge To
PCI-XP 6 PCI-XP 7
PCI-XP 4 PCI-XP 5
Legend
PCI Express Device Downstream Port
PCI Express Device Upstream Port
PCI-XP
Endpoint
Switch
Virtual
PCI
Bridge
Virtual
PCI
Bridge
Virtual
PCI
Bridge
Virtual
PCI
Bridge
PCI/PCI-X
PCI/PCI-X
Bus 2
PCI-XP
3
Bus 8
Bus 0 (Internal)
-

Rool compIox impIomonls conlraI rosourcos sucl as: lol pIug conlroIIor, povor
managomonl conlroIIor, inlorrupl conlroIIor, orror doloclion and roporling Iogic.
Tlo rool compIox iniliaIizos vill a bus numbor, dovico numbor and funclion
numbor vlicl aro usod lo form a roquoslor ID or compIolor ID. Tlo rool com-
pIox bus, dovico and funclion numbors iniliaIizo lo aII 0s.
A is a fabric of aII llo dovicos and IinIs associalod vill a rool com-
pIox llal aro oillor diroclIy connoclod lo llo rool compIox via ils porl(s) or indi-
roclIy connoclod via svilclos and bridgos. In Iiguro 1-22 on pago 48, llo onliro
ICI Ixpross fabric associalod vill llo rool is ono liorarcly.
A is a fabric of dovicos and IinIs llal aro associalod vill
ono porl of llo rool compIox. Ior oxampIo in Iiguro 1-22 on pago 48, lloro aro 3
liorarcly domains.
- aro dovicos ollor llan rool compIox and svilclos llal aro roquoslors
or compIolors of ICI Ixpross lransaclions. Tloy aro poriploraI dovicos sucl as
Illornol, USB or graplics dovicos. Indpoinls inilialo lransaclions as a roquoslor
or rospond lo lransaclions as a compIolor. Tvo lypos of ondpoinls oxisl, ICI
Ixpross ondpoinls and Iogacy ondpoinls. - may supporl IO
lransaclions. Tloy may supporl IocIod lransaclion somanlics as a compIolor bul
nol as a roquoslor. Inlorrupl capabIo Iogacy dovicos may supporl Iogacy slyIo
inlorrupl gonoralion using mossago roquosls bul musl in addilion supporl MSI
gonoralion using momory vrilo lransaclions. Iogacy dovicos aro nol roquirod lo
supporl 64-bil momory addrossing capabiIily. -- - musl nol
supporl IO or IocIod lransaclion somanlics and musl supporl MSI slyIo inlor-
rupl gonoralion. ICI Ixpross ondpoinls musl supporl 64-bil momory addross-
ing capabiIily in profolclabIo momory addross spaco, llougl lloir non-
profolclabIo momory addross spaco is pormillod lo map llo boIov 4GBylo
boundary. Boll lypos of ondpoinls impIomonl Typo 0 ICI configuralion loadors
and rospond lo configuralion lransaclions as compIolors. Iacl ondpoinl is ini-
liaIizod vill a dovico ID (- or vlicl consisls of a bus
numbor, dovico numbor, and funclion numbor. Indpoinls aro aIvays dovico 0
on a bus.
- IiIo ICI dovicos, ICI Ixpross dovicos may supporl
up lo 8 funclions por ondpoinl vill al Ioasl ono funclion numbor 0. Hovovor, a
ICI Ixpross IinI supporls onIy ono ondpoinl numborod dovico 0.
-- is a bridgo bolvoon ICI Ixpross fabric and a
ICI or ICI-X liorarcly.
-- -

A - is a dovico llal originalos a lransaclion in llo ICI Ixpross fabric.

Rool compIox and ondpoinls aro roquoslor lypo dovicos.
A is a dovico addrossod or largolod by a roquoslor. A roquoslor roads
dala from a compIolor or vrilos dala lo a compIolor. Rool compIox and ond-
poinls aro compIolor lypo dovicos.
A is llo inlorfaco bolvoon a ICI Ixpross compononl and llo IinI. Il con-
sisls of difforonliaI lransmillors and rocoivors. An - is a porl llal
poinls in llo diroclion of llo rool compIox. A - is a porl llal
poinls avay from llo rool compIox. An ondpoinl porl is an upslroam porl. A
rool compIox porl(s) is a dovnslroam porl. An -- is a porl llal
rocoivos a pacIol. An -- is a porl llal lransmils a pacIol.
A can bo llougll of as consisling of lvo or moro IogicaI ICI-lo-ICI
bridgos, oacl bridgo associalod vill a svilcl porl. Iacl bridgo impIomonls
configuralion loador 1 rogislors. Configuralion and onumoralion soflvaro viII
dolocl and iniliaIizo oacl of llo loador 1 rogislors al bool limo. A 4 porl svilcl
slovn in Iiguro 1-22 on pago 48 consisls of 4 virluaI bridgos. Tloso bridgos aro
inlornaIIy connoclod via a non-dofinod bus. Ono porl of a svilcl poinling in llo
diroclion of llo rool compIox is an upslroam porl. AII ollor porls poinling avay
from llo rool compIox aro dovnslroam porls.
A svilcl forvards pacIols in a mannor simiIar lo ICI bridgos using momory, IO
or configuralion addross basod rouling. Svilclos musl forvard aII lypos of
lransaclions from any ingross porl lo any ogross porl. Svilclos forvard lloso
pacIols basod on ono of llroo rouling moclanisms: addross rouling, ID rouling,
or impIicil rouling. Tlo IogicaI bridgos villin llo svilcl impIomonl ICI config-
uralion loador 1. Tlo configuralion loador conlains momory and IO baso and
Iimil addross rogislors as voII as primary bus numbor, socondary bus numbor
and subordinalo bus numbor rogislors. Tloso rogislors aro usod by llo svilcl lo
aid in pacIol rouling and forvarding.
Svilclos impIomonl lvo arbilralion moclanisms, porl arbilralion and VC arbi-
lralion, by vlicl lloy dolormino llo priorily vill vlicl lo forvard pacIols
from ingross porls lo ogross porls. Svilclos supporl IocIod roquosls.
Enumerating the System
Slandard ICI IIug and IIay onumoralion soflvaro can onumoralo a ICI
Ixpross syslom. Tlo IinIs aro numborod in a mannor simiIar lo llo ICI dopll
firsl soarcl onumoralion aIgorillm. An oxampIo of llo bus numboring is slovn
in Iiguro 1-22 on pago 48. Iacl ICI Ixpross IinI is oquivaIonl lo a IogicaI ICI
-

bus. In ollor vords, oacl IinI is assignod a bus numbor by llo bus onumoral-
ing soflvaro. A ICI Ixpross ondpoinl is dovico 0 on a ICI Ixpross IinI of a
givon bus numbor. OnIy ono dovico (dovico 0) oxisls por ICI Ixpross IinI. Tlo
inlornaI bus villin a svilcl llal connocls aII llo virluaI bridgos logollor is aIso
numborod. Tlo firsl IinI associalod vill llo rool compIox is numbor bus 1. Bus
0 is an inlornaI virluaI bus villin llo rool compIox. Busos dovnslroam of a ICI
Ixpross-lo-ICI(-X) bridgo aro onumoralod llo samo vay as in a ICI(-X) syslom.
Indpoinls and ICI(-X) dovicos may impIomonl up lo 8 funclions por dovico.
OnIy 1 dovico is supporlod por ICI Ixpross IinI llougl ICI(-X) busos may llo-
orolicaIIy supporl up lo 32 dovicos por bus. A syslom couId lloorolicaIIy incIudo
up lo 256 ICI Ixpross IinI and ICI(-X) busos.
PCI Express System BIock Diagram
Low Cost PCI Express Chipset
Iiguro 1-23 on pago 52 is a bIocI diagram of a Iov cosl ICI Ixpross basod sys-
lom. As of llo vriling of llis booI (ApriI 2003) no roaI Iifo ICI Ixpross clipsol
arclilocluro dosigns voro pubIicIy discIosod. Tlo aullor doscribos loro a pracli-
caI Iov cosl ICI Ixpross clipsol vloso arclilocluro is basod on oxisling non-
ICI Ixpross clipsol arclilocluros. In llis soIulion, AGI vlicl connocls MCH lo
a graplics conlroIIor in oarIior MCH dosigns (soo Iiguro 1-14 on pago 32) is
ropIacod vill a ICI Ixpross IinI. Tlo Hub IinI llal connocls MCH lo ICH is
ropIacod vill a ICI Ixpross IinI. And in addilion lo a ICI bus associalod vill
ICH, llo ICH clip supporls 4 ICI Ixpross IinIs. Somo of lloso IinIs can con-
nocl diroclIy lo dovicos on llo mollorboard and somo can bo roulod lo connoc-
lors vloro poriploraI cards aro inslaIIod.
Tlo CIU can communicalo vill ICI Ixpross dovicos associalod vill ICH as
voII as llo ICI Ixpross graplics conlroIIor. ICI Ixpross dovicos can communi-
calo vill syslom momory or llo graplics conlroIIor associalod vill MCH. ICI
dovicos may aIso communicalo vill ICI Ixpross dovicos and vico vorsa. In
ollor vords, llo clipsol supporls poor-lo-poor pacIol rouling bolvoon ICI
Ixpross ondpoinls and ICI dovicos, momory and graplics. Il is yol lo bo dolor-
minod if llo firsl gonoralion ICI Ixpross clipsols, viII supporl poor-lo-poor
pacIol rouling bolvoon ICI Ixpross ondpoinls. Romombor llal llo spocifica-
lion doos nol roquiro llo rool compIox lo supporl poor-lo-poor pacIol rouling
bolvoon llo muIlipIo IinIs associalod vill llo rool compIox.
-- -

Tlis dosign doos nol roquiro llo uso of svilclos if llo numbor of ICI Ixpross
dovicos lo bo connoclod doos nol oxcood llo numbor of IinIs avaiIabIo in llis
dosign.
Another Low Cost PCI Express Chipset
Iiguro 1-24 on pago 53 is a bIocI diagram of anollor Iov cosl ICI Ixpross sys-
lom. In llis dosign, llo Hub IinI connocls llo rool compIox lo an ICH dovico.
Tlo ICH dovico may bo an oxisling dosign vlicl las no ICI Ixpross IinI asso-
cialod vill il. Insload, aII ICI Ixpross IinIs aro associalod vill llo rool com-
pIox. Ono of lloso IinIs connocls lo a graplics conlroIIor. Tlo ollor IinIs
diroclIy connocl lo ICI Ixpross ondpoinls on llo mollorboard or connocl lo ICI
Ixpross ondpoinls on poriploraI cards insorlod in sIols.
- -- -
Processor
Root Complex
DDR
SDRAM
IO Controller Hub
(ICH)
IEEE
1394
PCI Express
GFX
PCI
PCI Express
Serial ATA
HDD
USB 2.0
LPC
GB
Ethernet
Add-In Add-In Add-In
PCI Express
GFX
FSB
PCI Express
Link
S
IO
COM1
COM2
S
IO
COM1
COM2
Slot
Slots
-

High-End Server System

Iiguro 1-25 slovs a moro compIox syslom roquiring a Iargo numbor of dovicos
connoclod logollor. MuIli-porl svilclos aro a nocossary dosign foaluro lo
accompIisl llis. To supporl ICI or ICI-X busos, a ICI Ixpross-lo-ICI(-X)
bridgo is connoclod lo ono svilcl porl. ICI Ixpross pacIols can bo roulod from
any dovico lo any ollor dovico bocauso svilcl supporl poor-lo-poor pacIol roul-
ing (OnIy muIli-porl rool compIox dovicos aro nol roquirod lo supporl poor-lo-
poor funclionaIily).
- -- -
Root Complex
Existing
IO Controller Hub
(ICH4)
PCI-33MHz
Hub Link
IDE
HDD
USB 2.0
LPC
GFX
CD
Audio
Codec
Modem
Codec
AC97
Link
Boot
ROM
Ethernet
Slots
DDR
SDRAM
Processor
FSB
PCI Express
Links
S
IO
COM1
COM2
S
IO
COM1
COM2
PCI Express
IEEE
1394
-- -

PCI Express Specifications

- - --
-
-- - -
-- -
-- - -
-- -
-- -
- -- - --
- - -
- -- -
-
-- -
Processor Processor
Root Complex
GFX
DDR
SDRAM
10Gb
Ethernet
PCI-XP-
to-PCI
PCI
InfiniBand
Switch
Out-of-Box
SCSI
RAID Disk array
IEEE
1394
InfiniBand
Gb
Ethernet
PCI Express
Link
Switch Switch
Switch
PCI Express
GFX
FSB
S
IO
COM1
COM2
S
IO
COM1
COM2
Endpoint
Endpoint
Endpoint Endpoint
Endpoint
Endpoint
10Gb
Ethernet
Endpoint
Add-In
Add-In
Fiber
Channel
Slots

Previous Chapter
Tlo provious claplor doscribod porformanco advanlagos and Ioy foaluros of
llo ICI Ixpross (ICI-XI) IinI. To liglIigll lloso advanlagos, llo claplor
doscribod porformanco claraclorislics and foaluros of prodocossor busos sucl as
ICI and ICI-X busos vill llo goaI of discussing llo ovoIulion of ICI Ixpross
from lloso prodocossor busos. Il comparod and conlraslod foaluros and porfor-
manco poinls of ICI, ICI-X and ICI Ixpross busos. Tlo Ioy foaluros of a ICI
Ixpross syslom voro doscribod. Tlo claplor in addilion doscribod somo oxam-
pIos of ICI Ixpross syslom lopoIogios.
This Chapter
Tlis claplor is an inlroduclion lo llo ICI Ixpross dala lransfor prolocoI. Il
doscribos llo Iayorod approacl lo ICI Ixpross dovico dosign vliIo doscribing
llo funclion of oacl dovico Iayor. IacIol lypos ompIoyod in accompIisling dala
lransfors aro doscribod villoul golling inlo pacIol conlonl dolaiIs. IinaIIy, llis
claplor oulIinos llo procoss of a roquoslor inilialing a lransaclion sucl as a
momory road lo road dala from a compIolor across a IinI.
The Next Chapter
Tlo noxl claplor doscribos lov pacIols aro roulod llrougl a ICI Ixpross fabric
consisling of svilclos. IacIols aro roulod basod on a momory addross, IO
addross, dovico ID or impIicilIy.
Introduction to PCI Express Transactions
ICI Ixpross ompIoys pacIols lo accompIisl dala lransfors bolvoon dovicos. A
rool compIox can communicalo vill an ondpoinl. An ondpoinl can communi-
calo vill a rool compIox. An ondpoinl can communicalo vill anollor ond-
poinl. Communicalion invoIvos llo lransmission and rocoplion of pacIols
caIIod Transaclion Iayor pacIols (TIIs).
-- -

ICI Ixpross lransaclions can bo groupod inlo four calogorios:

1) momory, 2) IO, 3) configuralion, and 4) mossago lransaclions. Momory, IO
and configuralion lransaclions aro supporlod in ICI and ICI-X arclilocluros,
bul llo mossago lransaclion is nov lo ICI Ixpross. -- aro dofinod as
a sorios of ono or moro pacIol lransmissions roquirod lo compIolo an informa-
lion lransfor bolvoon a roquoslor and a compIolor. TabIo 2-1 is a moro dolaiIod
Iisl of lransaclions. Tloso lransaclions can bo calogorizod inlo non-poslod lrans-
aclions and poslod lransaclions.
Ior Non-poslod lransaclions, a roquoslor lransmils a TII roquosl pacIol lo a
compIolor. Al a Ialor limo, llo compIolor rolurns a TII compIolion pacIol bacI
lo llo roquoslor. Non-poslod lransaclions aro landIod as spIil lransaclions simi-
Iar lo llo ICI-X spIil lransaclion modoI doscribod on pago 37 in Claplor 1. Tlo
purposo of llo compIolion TII is lo confirm lo llo roquoslor llal llo compIolor
las rocoivod llo roquosl TII. In addilion, non-poslod road lransaclions conlain
dala in llo compIolion TII. Non-Ioslod vrilo lransaclions conlain dala in llo
vrilo roquosl TII.
Ior Ioslod lransaclions, a roquoslor lransmils a TII roquosl pacIol lo a compI-
olor. Tlo compIolor lovovor doos NOT rolurn a compIolion TII bacI lo llo
roquoslor. Ioslod lransaclions aro oplimizod for bosl porformanco in compIoling
llo lransaclion al llo oxponso of llo roquoslor nol laving InovIodgo of succoss-
fuI rocoplion of llo roquosl by llo compIolor. Ioslod lransaclions may or may
nol conlain dala in llo roquosl TII.
-- - - --
- - -
Momory Road Non-Ioslod
Momory Wrilo Ioslod
Momory Road IocI Non-Ioslod
IO Road Non-Ioslod
IO Wrilo Non-Ioslod
Configuralion Road (Typo 0 and Typo 1) Non-Ioslod
Configuralion Wrilo (Typo 0 and Typo 1) Non-Ioslod
Mossago Ioslod

PCI Express Transaction ProtocoI

TabIo 2-2 Iisls aII of llo TII roquosl and TII compIolion pacIols. Tloso pacIols
aro usod in llo lransaclions roforoncod in TabIo 2-1. Our goaI in llis soclion is lo
doscribo lov lloso pacIols aro usod lo compIolo lransaclions al a syslom IovoI
and nol lo doscribo llo pacIol rouling llrougl llo ICI Ixpross fabric nor lo
doscribo pacIol conlonls in any dolaiI.
-- -
-

Momory Road Roquosl MRd

Momory Road Roquosl - IocIod accoss MRdII
Momory Wrilo Roquosl MWr
IO Road IORd
IO Wrilo IOWr
Configuralion Road (Typo 0 and Typo 1) CfgRd0,
CfgRd1
Configuralion Wrilo (Typo 0 and Typo 1) CfgWr0,
CfgWr1
Mossago Roquosl villoul Dala Msg
Mossago Roquosl vill Dala MsgD
CompIolion villoul Dala CpI
CompIolion vill Dala CpID
CompIolion villoul Dala - associalod vill IocIod Momory Road
Roquosls
CpIII
CompIolion vill Dala - associalod vill IocIod Momory Road
Roquosls
CpIDII
-- -

Non-Posted Read Transactions

Iiguro 2-1 slovs llo pacIols lransmillod by a roquoslor and compIolor lo com-
pIolo a non-poslod road lransaclion. To compIolo llis lransfor, a roquoslor lrans-
mils a non-poslod road roquosl TII lo a compIolor il inlonds lo road dala from.
Non-poslod road roquosl TIIs incIudo momory road roquosl (MRd), IO road
roquosl (IORd), and configuralion road roquosl lypo 0 or lypo 1 (CfgRd0,
CfgRd1) TIIs. Roquoslors may bo rool compIox or ondpoinl dovicos (ondpoinls
do nol inilialo configuralion road/vrilo roquosls lovovor).
Tlo roquosl TII is roulod llrougl llo fabric of svilclos using informalion in
llo loador porlion of llo TII. Tlo pacIol maIos ils vay lo a largolod compIolor.
Tlo compIolor can bo a rool compIox, svilclos, bridgos or ondpoinls.
Wlon llo compIolor rocoivos llo pacIol and docodos ils conlonls, il gallors llo
amounl of dala spocifiod in llo roquosl from llo largolod addross. Tlo compI-
olor croalos a singIo compIolion TII or muIlipIo compIolion TIIs vill dala
(CpID) and sonds il bacI lo llo roquoslor. Tlo compIolor can rolurn up lo 4
KBylos of dala por CpID pacIol.
Tlo compIolion pacIol conlains rouling informalion nocossary lo roulo llo
pacIol bacI lo llo roquoslor. Tlis compIolion pacIol lravoIs llrougl llo samo
pall and liorarcly of svilclos as llo roquosl pacIol.
Roquoslors usos a lag fioId in llo compIolion lo associalo il vill a roquosl TII
of llo samo lag vaIuo il lransmillod oarIior. Uso of a lag in llo roquosl and com-
pIolion TIIs aIIovs a roquoslor lo manago muIlipIo oulslanding lransaclions.
If a compIolor is unabIo lo oblain roquoslod dala as a rosuIl of an orror, il rolurns
a compIolion pacIol villoul dala (CpI) and an orror slalus indicalion. Tlo
roquoslor dolorminos lov lo landIo llo orror al llo soflvaro Iayor.

Non-Posted Read Transaction for Locked Requests

Iiguro 2-2 on pago 60 slovs pacIols lransmillod by a roquoslor and compIolor
lo compIolo a non-poslod IocIod road lransaclion. To compIolo llis lransfor, a
roquoslor lransmils a momory road IocIod roquosl (MRdII) TII. Tlo roquoslor
can onIy bo a rool compIox vlicl inilialos a IocIod roquosl on llo bolaIf of llo
CIU. Indpoinls aro nol aIIovod lo inilialo IocIod roquosls.
Tlo IocIod momory road roquosl TII is roulod dovnslroam llrougl llo fabric
of svilclos using informalion in llo loador porlion of llo TII. Tlo pacIol
maIos ils vay lo a largolod compIolor. Tlo compIolor can onIy bo a Iogacy ond-
poinl. Tlo onliro pall from rool compIox lo llo ondpoinl (for TCs llal map lo
VC0) is IocIod incIuding llo ingross and ogross porl of svilclos in llo pallvay.
- -
Requester Completer
MRd, IORd,
CfgRd0, CfgRd1
CplD or Cpl
Legend:
MRd = Memory Read Request
IORd = IO Read Request
CfgRd0 = Type 0 Configuration Read Request
CfgRd1 = Type 1 Configuration Read Request
CplD = Completion with data for normal completion of MRd, IORd, CfgRd0, CfgRd1
Cpl = Completion without data for error completion of MRd, IORd, CfgRd0, CfgRd1
-- -

Wlon llo compIolor rocoivos llo pacIol and docodos ils conlonls, il gallors llo
amounl of dala spocifiod in llo roquosl from llo largolod addross. Tlo compI-
olor croalos ono or moro IocIod compIolion TII vill dala (CpIDII) aIong vill
a compIolion slalus. Tlo compIolion is sonl bacI lo llo rool compIox roquoslor
via llo pall and liorarcly of svilclos as llo originaI roquosl.
Tlo CpIDII pacIol conlains rouling informalion nocossary lo roulo llo pacIol
bacI lo llo roquoslor. Roquoslors usos a lag fioId in llo compIolion lo associalo il
vill a roquosl TII of llo samo lag vaIuo il lransmillod oarIior. Uso of a lag in
llo roquosl and compIolion TIIs aIIovs a roquoslor lo manago muIlipIo oul-
slanding lransaclions.
If llo compIolor is unabIo lo oblain llo roquoslod dala as a rosuIl of an orror, il
rolurns a compIolion pacIol villoul dala (CpIII) and an orror slalus indicalion
villin llo pacIol. Tlo roquoslor vlo rocoivos llo orror nolificalion via llo
CpIII TII musl assumo llal alomicily of llo IocI is no Iongor guaranlood and
llus dolormino lov lo landIo llo orror al llo soflvaro Iayor.
Tlo pall from roquoslor lo compIolor romains IocIod unliI llo roquoslor al a
Ialor limo lransmils an unIocI mossago lo llo compIolor. Tlo pall and ingross/
ogross porls of a svilcl llal llo unIocI mossago passos llrougl aro unIocIod.
- -
Requester Completer
MRdLk
CplDLk or CplLk
Legend:
MRdLk = Memory Read Lock Request
CplDLk = Locked normal Completion with data for normal completion of MRdLk
CplLk = Locked error Completion without data for error completion of MRdLk

Non-Posted Write Transactions

Iiguro 2-3 on pago 61 slovs llo pacIols lransmillod by a roquoslor and compI-
olor lo compIolo a non-poslod vrilo lransaclion. To compIolo llis lransfor, a
roquoslor lransmils a non-poslod vrilo roquosl TII lo a compIolor il inlonds lo
vrilo dala lo. Non-poslod vrilo roquosl TIIs incIudo IO vrilo roquosl (IOWr),
configuralion vrilo roquosl lypo 0 or lypo 1 (CfgWr0, CfgWr1) TIIs. Momory
vrilo roquosl and mossago roquosls aro poslod roquosls. Roquoslors may bo a
rool compIox or ondpoinl dovico (llougl nol for configuralion vrilo roquosls).
A roquosl pacIol vill dala is roulod llrougl llo fabric of svilclos using infor-
malion in llo loador of llo pacIol. Tlo pacIol maIos ils vay lo a compIolor.
Wlon llo compIolor rocoivos llo pacIol and docodos ils conlonls, il accopls llo
dala. Tlo compIolor croalos a singIo compIolion pacIol villoul dala (CpI) lo
confirm rocoplion of llo vrilo roquosl. Tlis is llo purposo of llo compIolion.
- -
Requester Completer
IOWr, CfgWr0, CfgWr1
Cpl
Legend:
IOWr = IO Write Request
CfgWr0 = Type 0 Configuration Write Request
CfgWr1 = Type 1 Configuration Write Request
Cpl = Completion without data for normal or error completion of IOWr, CfgWr0, CfgWr1
-- -

Tlo compIolion pacIol conlains rouling informalion nocossary lo roulo llo

pacIol bacI lo llo roquoslor. Tlis compIolion pacIol viII propagalo llrougl llo
samo liorarcly of svilclos llal llo roquosl pacIol vonl llrougl boforo maIing
ils vay bacI lo llo roquoslor. Tlo roquoslor gols confirmalion nolificalion llal
llo vrilo roquosl did maIo ils vay succossfuIIy lo llo compIolor.
If llo compIolor is unabIo lo succossfuIIy vrilo llo dala in llo roquosl lo llo
finaI doslinalion or if llo vrilo roquosl pacIol roaclos llo compIolor in orror,
llon il rolurns a compIolion pacIol villoul dala (CpI) bul vill an orror slalus
indicalion. Tlo roquoslor vlo rocoivos llo orror nolificalion via llo CpI TII
dolorminos lov lo landIo llo orror al llo soflvaro Iayor.
Posted Memory Write Transactions
Momory vrilo roquosls slovn in Iiguro 2-4 aro poslod lransaclions. Tlis
impIios llal llo compIolor rolurns no compIolion nolificalion lo inform llo
roquoslor llal llo momory vrilo roquosl pacIol las roaclod ils doslinalion suc-
cossfuIIy. No limo is vaslod in rolurning a compIolion, llus bacI-lo-bacI poslod
vrilos compIolo vill liglor porformanco roIalivo lo non-poslod lransaclions.
Tlo vrilo roquosl pacIol vlicl conlains dala is roulod llrougl llo fabric of
svilclos using informalion in llo loador porlion of llo pacIol. Tlo pacIol
maIos ils vay lo a compIolor. Tlo compIolor accopls llo spocifiod amounl of
dala villin llo pacIol. Transaclion ovor.
If llo vrilo roquosl is rocoivod by llo compIolor in orror, or is unabIo lo vrilo llo
poslod vrilo dala lo llo finaI doslinalion duo lo an inlornaI orror, llo roquoslor
is nol informod via llo lardvaro prolocoI. Tlo compIolor couId Iog an orror and
gonoralo an orror mossago nolificalion lo llo rool compIox. Irror landIing sofl-
varo managos llo orror.

Posted Message Transactions

Mossago roquosls aro aIso poslod lransaclions as piclurod in Iiguro 2-5 on pago
64. Tloro aro lvo calogorios of mossago roquosl TIIs, Msg and MsgD. Somo
mossago roquosls propagalo from roquoslor lo compIolor, somo aro broadcasl
roquosls from llo rool compIox lo aII ondpoinls, somo aro lransmillod by an
ondpoinl lo llo rool compIox. Mossago pacIols may bo roulod lo compIolor(s)
basod on llo mossagos addross, dovico ID or roulod impIicilIy. Mossago roquosl
rouling is covorod in Claplor 3.
Tlo compIolor accopls any dala llal may bo conlainod in llo pacIol (if llo
pacIol is MsgD) and/or porforms llo lasI spocifiod by llo mossago.
Mossago roquosl supporl oIiminalos llo nood for sido-band signaIs in a ICI
Ixpross syslom. Tloy aro usod for ICI slyIo Iogacy inlorrupl signaIing, povor
managomonl prolocoI, orror signaIing, unIocIing a pall in llo ICI Ixpross fab-
ric, sIol povor supporl, lol pIug prolocoI, and vondor dofinod purposos.
- -
Requester Completer
MWr
Legend:
MWr = Memory Write Request. No completions for this transaction
-- -

Some ExampIes of Transactions

Tlis soclion doscribos a fov lransaclion oxampIos sloving pacIols lransmillod
bolvoon roquoslor and compIolor lo accompIisl a lransaclion. Tlo oxampIos
consisl of a momory road, IO vrilo, and Momory vrilo.
Memory Read Originated by CPU, Targeting an Endpoint
Iiguro 2-6 slovs an oxampIo of pacIol rouling associalod vill compIoling a
momory road lransaclion. Tlo rool compIox on llo bolaIf of llo CIU inilialos a
non-poslod momory road from llo compIolor ondpoinl slovn. Tlo rool com-
pIox lransmils an MRd pacIol vlicl conlains amongsl ollor fioIds, an addross,
TII lypo, roquoslor ID (of llo rool compIox) and Iongll of lransfor (in doubIo-
vords) fioId. Svilcl A vlicl is a 3 porl svilcl rocoivos llo pacIol on ils
- -- -
Requester Completer
Msg, MsgD
Legend:
Msg = Message Request without data
MsgD = Message Request with data

upslroam porl. Tlo svilcl IogicaIIy appoars IiIo a 3 virluaI bridgo dovico con-
noclod by an inlornaI bus. Tlo IogicaI bridgos villin llo svilcl conlain mom-
ory and IO baso and Iimil addross rogislors villin lloir configuralion spaco
simiIar lo ICI bridgos. Tlo MRd pacIol addross is docodod by llo svilcl and
comparod vill llo baso/Iimil addross rango rogislors of llo lvo dovnslroam
IogicaI bridgos. Tlo svilcl inlornaIIy forvards llo MRd pacIol from llo
upslroam ingross porl lo llo corrocl dovnslroam porl (llo Iofl porl in llis oxam-
pIo). Tlo MRd pacIol is forvardod lo svilcl B. Svilcl B docodos llo addross in
a simiIar mannor. Assumo llo MRd pacIols is forvardod lo llo rigll-land porl
so llal llo compIolor ondpoinl rocoivos llo MRd pacIol.
Tlo compIolor docodos llo conlonls of llo loador villin llo MRd pacIol, gall-
ors llo roquoslod dala and rolurns a compIolion pacIol vill dala (CpID). Tlo
loador porlion of llo compIolion TII conlains llo roquoslor ID copiod from llo
originaI roquosl TII. Tlo roquoslor ID is usod lo roulo llo compIolion pacIol
bacI lo llo rool compIox.
-
Processor Processor
Root Complex
DDR
SDRAM
Endpoint Endpoint Endpoint
Endpoint Endpoint
Switch A Switch C
Switch B
FSB
MRd
MRd
MRd
CplD
CplD
CplD
Requester:
-Step 1: Root Complex (requester)
initiates Memory Read Request (MRd)
-Step 4: Root Complex receives CplD
Completer:
-Step 2: Endpoint (completer)
receives MRd
-Step 3: Endpoint returns
Completion with data (CplD)
MRd
-- -

Tlo IogicaI bridgos villin Svilcl B comparos llo bus numbor fioId of llo
roquoslor ID in llo CpID pacIol vill llo socondary and subordinalo bus num-
bor configuralion rogislors. Tlo CpID pacIol is forvardod lo llo approprialo
porl (in llis caso llo upslroam porl). Tlo CpID pacIol movos lo Svilcl A vlicl
forvards llo pacIol lo llo rool compIox. Tlo roquoslor ID fioId of llo compIo-
lion TII malclos llo rool compIoxs ID. Tlo rool compIox clocIs llo compIo-
lion slalus (lopofuIIy succossfuI compIolion) and accopls llo dala. Tlis dala
is rolurnod lo llo CIU in rosponso lo ils ponding momory road lransaclion.
Memory Read Originated by Endpoint, Targeting System
Memory
In a simiIar mannor, llo ondpoinl dovico slovn in Iiguro 2-7 on pago 67 ini-
lialos a momory road roquosl (MRd). Tlis pacIol conlains amongsl ollor fioIds
in llo loador, llo ondpoinls roquoslor ID, largolod addross and amounl of dala
roquoslod. Il forvards llo pacIol lo Svilcl B vlicl docodos llo momory
addross in llo pacIol and comparos il vill llo momory baso/Iimil addross
rango rogislors villin llo virluaI bridgos of llo svilcl. Tlo pacIol is forvardod
lo Svilcl A vlicl docodos llo addross in llo pacIol and forvards llo pacIol lo
llo rool compIox compIolor.
Tlo rool compIox oblains llo roquoslod dala from syslom momory and croalos a
compIolion TII vill dala (CpID). Tlo bus numbor porlion of llo roquoslor ID
in llo compIolion TII is usod lo roulo llo pacIol llrougl llo svilclos lo llo
ondpoinl.
A roquoslor ondpoinl can aIso communicalo vill anollor poor compIolor ond-
poinl. Ior oxampIo an ondpoinl allaclod lo svilcl B can laII lo an ondpoinl
connoclod lo svilcl C. Tlo roquosl TII is roulod using an addross. Tlo compIo-
lion is roulod using bus numbor. MuIli-porl rool compIox dovicos aro nol
roquirod lo supporl porl-lo-porl pacIol rouling. In vlicl caso, poor-lo-poor
lransaclions bolvoon ondpoinls associalod vill lvo difforonl porls of llo rool
compIox is nol supporlod.

IO Write Initiated by CPU, Targeting an Endpoint

IO roquosls can onIy bo inilialod by a rool compIox or a Iogacy ondpoinl. ICI
Ixpross ondpoinls do nol inilialo IO lransaclions. IO lransaclions aro inlondod
for Iogacy supporl. Nalivo ICI Ixpross dovicos aro nol prolibilod from impIo-
monling IO spaco, bul llo spocificalion slalos llal a ICI Ixpross Indpoinl musl
nol dopond on llo oporaling syslom aIIocaling I/O rosourcos llal aro roquoslod.
IO roquosls aro roulod by svilclos in a simiIar mannor lo momory roquosls.
Svilclos roulo IO roquosl pacIols by comparing llo IO addross in llo pacIol
vill llo IO baso and Iimil addross rango rogislors in llo virluaI bridgo configu-
ralion spaco associalod vill a svilcl
Iiguro 2-8 on pago 68 slovs rouling of pacIols associalod vill an IO vrilo
lransaclion. Tlo CIU inilialos an IO vrilo on llo Ironl Sido Bus (ISB). Tlo
vrilo conlains a largol IO addross and up lo 4 Bylos of dala. Tlo rool compIox
croalos an IO Wrilo roquosl TII (IOWr) using addross and dala from llo CIU
lransaclion. Il usos ils ovn roquoslor ID in llo pacIol loador. Tlis pacIol is
roulod llrougl svilcl A and B. Tlo compIolor ondpoinl rolurns a compIolion
villoul dala (CpI) and compIolion slalus of succossfuI compIolion lo confirm
llo rocoplion of good dala from llo roquoslor.
-
Processor Processor
Root Complex
DDR
SDRAM
Endpoint Endpoint Endpoint
Endpoint
Switch A Switch C
Switch B
FSB
Requester:
-Step 1: Endpoint (requester)
initiates Memory Read Request (MRd)
-Step 4: Endpoint receives CplD
MRd
MRd
MRd
Completer:
-Step 2: Root Complex (completer)
receives MRd
-Step 3: Root Complex returns
Completion with data (CplD)
CplD
CplD
CplD
Endpoint
-- -

Memory Write Transaction Originated by CPU and Targeting

an Endpoint
Momory vrilo (MWr) roquosls (and mossago roquosls Msg or MsgD) aro poslod
lransaclions. Tlis impIios llal llo compIolor doos nol rolurn a compIolion. Tlo
MWr pacIol is roulod llrougl llo ICI Ixpross fabric of svilclos in llo samo
mannor as doscribod for momory road roquosls. Tlo roquoslor rool compIox can
vrilo up lo 4 KBylos of dala vill ono MWr pacIol.
Iiguro 2-9 on pago 69 slovs a momory vrilo lransaclion originalod by llo CIU.
Tlo rool compIox croalos a MWr TII on bolaIf of llo CIU using largol addross
and dala from llo CIU ISB lransaclion. Tlis pacIol is roulod llrougl svilcl A
and B. Tlo pacIol roaclos llo ondpoinl and llo lransaclion is compIolo.
-
Processor Processor
Root Complex
DDR
SDRAM
Endpoint Endpoint Endpoint
Endpoint
Legacy
Endpoint
Switch A Switch C
Switch B
FSB
IOWr
IOWr
IOWr
Cpl
Cpl
Cpl
Requester:
-Step 1: Root Complex (requester)
initiates IO Write Request (IOWr)
-Step 4: Root Complex receives Cpl
Completer:
-Step 2: Endpoint (completer)
receives IOWr
-Step 3: Endpoint returns
Completion without data (Cpl)

PCI Express Device Layers

Overview
Tlo ICI Ixpross spocificalion dofinos a Iayorod arclilocluro for dovico dosign as
slovn in Iiguro 2-10 on pago 70. Tlo Iayors consisl of a Transaclion Iayor, a
Dala IinI Iayor and a IlysicaI Iayor. Tlo Iayors can bo furllor dividod vorli-
caIIy inlo lvo, a lransmil porlion llal procossos oulbound lraffic and a rocoivo
porlion llal procossos inbound lraffic. Hovovor, a dovico dosign doos nol lavo
lo impIomonl a Iayorod arclilocluro as Iong as llo funclionaIily roquirod by llo
spocificalion is supporlod.
-
Processor Processor
Root Complex
DDR
SDRAM
Endpoint Endpoint Endpoint
Endpoint Endpoint
Switch A Switch C
Switch B
FSB
Requester:
-Step 1: Root Complex (requester)
initiates Memory Write Request (MWr)
MWr
MWr
MWr
Completer:
- Step 2: Endpoint (completer) receives MWr
-- -

Tlo goaI of llis soclion is lo doscribo llo funclion of oacl Iayor and lo doscribo
llo fIov of ovonls lo accompIisl a dala lransfor. IacIol croalion al a lransmil-
ling dovico and pacIol rocoplion and docoding al a rocoiving dovico aro aIso
oxpIainod.
-- -
Device Core
PCI Express Core
Logic Interface
Transaction Layer
Data Link Layer
Physical Layer
TX RX
PCI Express Device A
Device Core
PCI Express Core
Logic Interface
Transaction Layer
Data Link Layer
Physical Layer
TX RX
PCI Express Device B
Link

Transmit Portion of Device Layers

Considor llo lransmil porlion of a dovico. IacIol conlonls aro formod in llo
Transaclion Iayor vill informalion oblainod from llo dovico coro and appIica-
lion. Tlo pacIol is slorod in buffors roady for lransmission lo llo Iovor Iayors.
Tlis pacIol is roforrod lo as a Transaclion Iayor IacIol (TII) doscribod in llo
oarIior soclion of llis claplor. Tlo Dala IinI Iayor concalonalos lo llo pacIol
addilionaI informalion roquirod for orror clocIing al a rocoivor dovico. Tlo
pacIol is llon oncodod in llo IlysicaI Iayor and lransmillod difforonliaIIy on
llo IinI by llo anaIog porlion of llis Iayor. Tlo pacIol is lransmillod using llo
avaiIabIo Ianos of llo IinI lo llo rocoiving dovico vlicl is ils noiglbor.
Receive Portion of Device Layers
Tlo rocoivor dovico docodos llo incoming pacIol conlonls in llo IlysicaI Iayor
and forvards llo rosuIling conlonls lo llo uppor Iayors. Tlo Dala IinI Iayor
clocIs for orrors in llo incoming pacIol and if lloro aro no orrors forvards llo
pacIol up lo llo Transaclion Iayor. Tlo Transaclion Iayor buffors llo incoming
TIIs and convorls llo informalion in llo pacIol lo a roprosonlalion llal can bo
procossod by llo dovico coro and appIicalion.
Device Layers and their Associated Packets
Tlroo calogorios of pacIols aro dofinod, oacl ono is associalod vill ono of llo
llroo dovico Iayors. Associalod vill llo Transaclion Iayor is llo Transaclion
Iayor IacIol (TII). Associalod vill llo Dala IinI Iayor is llo Dala IinI Iayor
IacIol (DIII). Associalod vill llo IlysicaI Iayor is llo IlysicaI Iayor IacIol
(III). Tloso pacIols aro inlroducod noxl.
Transaction Layer Packets (TLPs)
ICI Ixpross lransaclions ompIoy TIIs vlicl originalo al llo Transaclion Iayor
of a lransmillor dovico and lorminalo al llo Transaclion Iayor of a rocoivor
dovico. Tlis procoss is roprosonlod in Iiguro 2-11 on pago 72. Tlo Dala IinI
Iayor and IlysicaI Iayor aIso conlribulo lo TII assombIy as llo TII movos
llrougl llo Iayors of llo lransmilling dovico. Al llo ollor ond of llo IinI
vloro a noiglbor rocoivos llo TII, llo IlysicaI Iayor, Dala IinI Iayor and
Transaclion Iayor disassombIo llo TII.
-- -

-- A TII llal is lransmillod on llo IinI appoars as

slovn in Iiguro 2-12 on pago 73.
Tlo soflvaro Iayor/dovico coro sonds lo llo Transaclion Iayor llo informalion
roquirod lo assombIo llo coro soclion of llo TII vlicl is llo loador and dala
porlion of llo pacIol. Somo TIIs do nol conlain a dala soclion. An oplionaI
Ind-lo-Ind CRC (ICRC) fioId is caIcuIalod and appondod lo llo pacIol. Tlo
ICRC fioId is usod by llo uIlimalo largolod dovico of llis pacIol lo clocI for
CRC orrors in llo loador and dala porlion of llo TII.
Tlo coro soclion of llo TII is forvardod lo llo Dala IinI Iayor vlicl llon
apponds a soquonco ID and anollor ICRC fioId. Tlo ICRC fioId is usod by llo
noiglboring rocoivor dovico al llo ollor ond of llo IinI lo clocI for CRC orrors
in llo coro soclion of llo TII pIus llo soquonco ID. Tlo rosuIlanl TII is for-
vardod lo llo IlysicaI Iayor vlicl concalonalos a Slarl and Ind framing clar-
aclor of 1 bylo oacl lo llo pacIol. Tlo pacIol is oncodod and difforonliaIIy
lransmillod on llo IinI using llo avaiIabIo numbor of Ianos.
-
Device Core
PCI Express Core
Logic Interface
Transaction Layer
Data Link Layer
Physical Layer
TX RX
PCI Express Device A
Device Core
PCI Express Core
Logic Interface
Transaction Layer
Data Link Layer
Physical Layer
TX RX
PCI Express Device B
Link
TLP
Transmitted
TLP
Received

--- A noiglboring rocoivor dovico rocoivos llo

incoming TII bil slroam. As slovn in Iiguro 2-13 on pago 74 llo rocoivod TII
is docodod by llo IlysicaI Iayor and llo Slarl and Ind framo fioIds aro
slrippod. Tlo rosuIlanl TII is sonl lo llo Dala IinI Iayor. Tlis Iayor clocIs for
any orrors in llo TII and slrips llo soquonco ID and ICRC fioId. Assumo lloro
aro no ICRC orrors, llon llo TII is forvardod up lo llo Transaclion Iayor. If
llo rocoiving dovico is a svilcl, llon llo pacIol is roulod from ono porl of llo
svilcl lo an ogross porl basod on addross informalion conlainod in llo loador
porlion of llo TII. Svilclos aro aIIovod lo clocI for ICRC orrors and ovon
roporl llo orrors il finds and orror. Hovovor, a svilcl is nol aIIovod lo modify
llo ICRC llal vay llo largolod dovico of llis TII viII dolocl an ICRC orror if
lloro is sucl an orror.
--
Start End
Sequence
Number
LCRC Header Data
Created by Transaction Layer
Appended by Data Link Layer
Appended by PHY Layer
ECRC
Bit transmit direction
Information in core section of TLP comes
from Software Layer / Device Core
-- -

Tlo uIlimalo largolod dovico of llis TII clocIs for ICRC orrors in llo loador
and dala porlion of llo TII. Tlo ICRC fioId is slrippod, Ioaving llo loador and
dala porlion of llo pacIol. Il is llis informalion llal is finaIIy forvardod lo llo
Dovico Coro/Soflvaro Iayor.
Data Link Layer Packets (DLLPs)
Anollor ICI Ixpross pacIol caIIod DIII originalos al llo Dala IinI Iayor of a
lransmillor dovico and lorminalos al llo Dala IinI Iayor of a rocoivor dovico.
Tlis procoss is roprosonlod in Iiguro 2-14 on pago 75. Tlo IlysicaI Iayor aIso
conlribulos lo DIII assombIy and disassombIy as llo DIII movos from ono
dovico lo anollor via llo ICI Ixpross IinI.
DIIIs aro usod for IinI Managomonl funclions incIuding TII acInovIodgo-
monl associalod vill llo ACK/NAK prolocoI, povor managomonl, and
oxclango of IIov ConlroI informalion.
---
Start End
Sequence
Number
LCRC Header Data
Stripped by Transaction Layer
Stripped by Data Link Layer
Stripped by PHY Layer
ECRC
Bit receive direction
Information in core section of TLP is
sent to Software Layer / Device Core

DIIIs aro lransforrod bolvoon Dala IinI Iayors of llo lvo diroclIy connoclod
compononls on a IinI. DIIIs do nol pass llrougl svilclos unIiIo TIIs vlicl
do lravoI llrougl llo ICI Ixpross fabric. DIIIs do nol conlain rouling infor-
malion. Tloso pacIols aro smaIIor in sizo comparod lo TIIs, 8 bylos lo bo pro-
ciso.
-- Tlo DIII slovn in Iiguro 2-15 on pago 76 originalos al
llo Dala IinI Iayor. Tloro aro various lypos of DIIIs somo of vlicl incIudo
IIov ConlroI DIIIs (ICx), acInovIodgo/ no acInovIodgo DIIIs vlicl con-
firm rocoplion of TIIs (ACK and NAK), and povor managomonl DIIIs (IMx).
A DIII lypo fioId idonlifios various lypos of DIIIs. Tlo Dala IinI Iayor
apponds a 16-bil CRC usod by llo rocoivor of llo DIII lo clocI for CRC orrors
in llo DIII.
Tlo DIII conlonl aIong vill a 16-bil CRC is forvardod lo llo IlysicaI Iayor
vlicl apponds a Slarl and Ind framo claraclor of 1 bylo oacl lo llo pacIol. Tlo
pacIol is oncodod and difforonliaIIy lransmillod on llo IinI using llo avaiIabIo
numbor of Ianos.
-
Device Core
PCI Express Core
Logic Interface
Transaction Layer
Data Link Layer
Physical Layer
TX RX
PCI Express Device A
Device Core
PCI Express Core
Logic Interface
Transaction Layer
Data Link Layer
Physical Layer
TX RX
PCI Express Device B
Link
DLLP
Transmitted
DLLP
Received
-- -

--- Tlo DIII is rocoivod by IlysicaI Iayor of a rocoiving

dovico. Tlo rocoivod bil slroam is docodod and llo Slarl and Ind framo fioIds
aro slrippod as dopiclod in Iiguro 2-16. Tlo rosuIlanl pacIol is sonl lo llo Dala
IinI Iayor. Tlis Iayor clocIs for CRC orrors and slrips llo CRC fioId. Tlo Dala
IinI Iayor is llo doslinalion Iayor for DIIIs and il is nol forvardod up lo llo
Transaclion Iayor.
--
---
Start End DLLP CRC
Data Link Layer
Appended by PHY Layer
Bit transmit direction
Start End DLLP CRC
Stripped by Data Link Layer
Stripped by PHY Layer
Bit receive direction

PhysicaI Layer Packets (PLPs)

Anollor ICI Ixpross pacIol caIIod III originalos al llo IlysicaI Iayor of a
lransmillor dovico and lorminalos al llo IlysicaI Iayor of a rocoivor dovico.
Tlis procoss is roprosonlod in Iiguro 2-17 on pago 77. Tlo III is a vory simpIo
pacIol llal slarls vill a 1 bylo COM claraclor foIIovod by 3 or moro ollor
claraclors llal dofino llo III lypo as voII as conlain ollor informalion. Tlo
III is a muIlipIo of 4 bylos in sizo, an oxampIo of vlicl is slovn in Iiguro 2-18
on pago 78. Tlo spocificalion rofors lo llis pacIol as llo Ordorod-Sol. IIIs do
nol conlain any rouling informalion. Tloy aro nol roulod llrougl llo fabric and
do nol propagalo llrougl a svilcl.
Somo IIIs aro usod during llo IinI Training procoss doscribod in
Ordorod-Sols Usod During IinI Training and IniliaIizalion on pago 504.
Anollor III is usod for cIocI loIoranco componsalion. IIIs aro usod lo pIaco a
IinI inlo llo oIoclricaI idIo Iov povor slalo or lo vaIo up a IinI from llis Iov
povor slalo.
-
Device Core
PCI Express Core
Logic Interface
Transaction Layer
Data Link Layer
Physical Layer
TX RX
PCI Express Device A
Device Core
PCI Express Core
Logic Interface
Transaction Layer
Data Link Layer
Physical Layer
TX RX
PCI Express Device B
Link
PLP
Transmitted
PLP
Received
-- -

Function of Each PCI Express Device Layer

Iiguro 2-19 on pago 79 is a moro dolaiIod bIocI diagram of a ICI Ixpross
Dovicos Iayors. Tlis bIocI diagram is usod lo oxpIain Ioy funclions of oacl
Iayor and oxpIain llo funclion of oacl Iayor as il roIalos lo gonoralion of oul-
bound lraffic and rosponso lo inbound lraffic. Tlo Iayors consisl of Dovico
Coro/Soflvaro Iayor, Transaclion Iayor, Dala IinI Iayor and IlysicaI Iayor.
Device Core / Software Layer
Tlo Dovico Coro consisls of, for oxampIo, llo rool compIox coro Iogic or an ond-
poinl coro Iogic sucl as llal of an Illornol conlroIIor, SCSI conlroIIor, USB con-
lroIIor, olc. To dosign a ICI Ixpross ondpoinl, a dosignor may rouso llo Dovico
Coro Iogic from a ICI or ICI-X coro Iogic dosign and vrap around il llo ICI
Ixpross Iayorod dosign doscribod in llis soclion.
- Tlo Dovico Coro Iogic in conjunclion vill IocaI soflvaro
providos llo nocossary informalion roquirod by llo ICI Ixpross dovico lo gon-
oralo TIIs. Tlis informalion is sonl via llo Transmil inlorfaco lo llo Transaclion
Iayor of llo dovico. IxampIo of informalion lransmillod lo llo Transaclion
Iayor incIudos: lransaclion lypo lo inform llo Transaclion Iayor vlal lypo of
TII lo gonoralo, addross, amounl of dala lo lransfor, dala, lraffic cIass, mossago
indox olc.
Tlo Dovico Coro Iogic is aIso rosponsibIo lo rocoivo informa-
lion sonl by llo Transaclion Iayor via llo Rocoivo inlorfaco. Tlis informalion
incIudos: lypo of TII rocoivod by llo Transaclion Iayor, addross, amounl of
dala rocoivod, dala, lraffic cIass of rocoivod TII, mossago indox, orror condilions
olc.

COM Identifier Identifier Identifier

Transaction Layer
Tlo lransaclion Iayor slovn in Iiguro 2-19 is rosponsibIo for gonoralion of oul-
bound TII lraffic and rocoplion of inbound TII lraffic. Tlo Transaclion Iayor
supporls llo spIil lransaclion prolocoI for non-poslod lransaclions. In ollor
vords, llo Transaclion Iayor associalos an inbound compIolion TII of a givon
lag vaIuo vill an oulbound non-poslod roquosl TII of llo samo lag vaIuo
lransmillod oarIior.
-- - -
Port
Link
Memory, I/O, Configuration R/W Requests or Message Requests or Completions
(Software layer sends / receives address/transaction type/data/message index)
Software layer
Transaction layer
Header Data Payload ECRC
Receive
Buffers
per VC
Transmit
Buffers
per VC
Data Link layer
Physical layer
Serial-to-Parallel Parallel-to-Serial
Differential Receiver Differential Driver
Link Packet Start End Link Packet Start End
Decode Encode
Transaction Layer Packet (TLP)
TLP Error
Check
TLP Replay
Buffer
Physical Packet Physical Packet
Link Packet
Sequence TLP LCRC ACK/NAK
DLLPs e.g.
CRC
Header Data Payload ECRC
Transaction Layer Packet (TLP)
Link Packet
Sequence TLP LCRC
De-mux
Mux
Transmit Receive
Flow Control
Virtual Channel
Management
Ordering
Link
Training
ACK/NAK
DLLPs
CRC
-- -

Tlo lransaclion Iayor conlains virluaI clannoI buffors (VC Buffors) lo sloro oul-
bound TIIs llal avail lransmission and aIso lo sloro inbound TIIs rocoivod
from llo IinI. Tlo fIov conlroI prolocoI associalod vill lloso virluaI clannoI
buffors onsuros llal a romolo lransmillor doos nol lransmil loo many TIIs and
causo llo rocoivor virluaI clannoI buffors lo ovorfIov. Tlo Transaclion Iayor
aIso ordors TIIs according lo ordoring ruIos boforo lransmission. Il is llis Iayor
llal supporls llo QuaIily of Sorvico (QoS) prolocoI.
Tlo Transaclion Iayor supporls 4 addross spacos: momory addross, IO addross,
configuralion addross and mossago spaco. Mossago pacIols conlain a mossago.
- Tlo Transaclion Iayor rocoivos informalion from llo Dovico
Coro and gonoralos oulbound roquosl and compIolion TIIs vlicl il sloros in
virluaI clannoI buffors. Tlis Iayor assombIos Transaclion Iayor IacIols (TIIs).
Tlo major compononls of a TII aro: Hoador, Dala IayIoad and an oplionaI
ICRC (spocificalion aIso usos llo lorm Digosl) fioId as slovn in Iiguro 2-20.
Tlo Hoador is 3 doubIovords or 4 doubIovords in sizo and may incIudo infor-
malion sucl as, Addross, TII lypo, lransfor sizo, roquoslor ID/compIolor ID,
lag, lraffic cIass, bylo onabIos, compIolion codos, and allribulos (incIuding no
snoop and roIaxod ordoring bils). Tlo TII lypos aro dofinod in TabIo 2-2 on
pago 57.
Tlo addross is a 32-bil momory addross or an oxlondod 64-bil addross for mom-
ory roquosls. Il is a 32-bil addross for IO roquosls. Ior configuralion lransaclions
llo addross is an ID consisling of Bus Numbor, Dovico Numbor and Iunclion
Numbor pIus a configuralion rogislor addross of llo largolod rogislor. Ior com-
pIolion TIIs, llo addross is llo roquoslor ID of llo dovico llal originaIIy mado
llo roquosl. Ior mossago lransaclions llo addross usod for rouling is llo dosli-
nalion dovicos ID consisling of Bus Numbor, Dovico Numbor and Iunclion
Numbor of llo dovico largolod by llo mossago roquosl. Mossago roquosls couId
aIso bo broadcasl or roulod impIicilIy by largoling llo rool compIox or an
upslroam porl.
-
Header Data Payload ECRC
Transaction Layer Packet (TLP)

Tlo lransfor sizo or Iongll fioId indicalos llo amounl of dala lo lransfor caIcu-
Ialod in doubIovords (DWs). Tlo dala lransfor Iongll can bo bolvoon 1 lo 1024
DWs. Wrilo roquosl TIIs incIudo dala payIoad in llo amounl indicalod by llo
Iongll fioId of llo loador. Ior a road roquosl TII, llo Iongll fioId indicalos llo
amounl of dala roquoslod from a compIolor. Tlis dala is rolurnod in ono or moro
compIolion pacIols. Road roquosl TIIs do nol incIudo a dala payIoad fioId.
Bylo onabIos spocify bylo IovoI addross rosoIulion.
Roquosl pacIols conlain a roquoslor ID (bus#, dovico#, funclion #) of llo dovico
lransmilling llo roquosl. Tlo lag fioId in llo roquosl is momorizod by llo com-
pIolor and llo samo lag is usod in llo compIolion.
A bil in llo Hoador (TD = TII Digosl) indicalos vlollor llis pacIol conlains an
ICRC fioId aIso roforrod lo as Digosl. Tlis fioId is 32-bils vido and conlains an
Ind-lo-Ind CRC (ICRC). Tlo ICRC fioId is gonoralod by llo Transaclion Iayor
al limo of croalion of llo oulbound TII. Il is gonoralod basod on llo onliro TII
from firsl bylo of loador lo Iasl bylo of dala payIoad (vill llo oxcoplion of llo
II bil, and bil 0 of llo Typo fioId. Tloso lvo bils aro aIvays considorod lo bo a 1
for llo ICRC caIcuIalion). Tlo TII novor clangos as il lravorsos llo fabric (vill
llo oxcoplion of porlaps llo lvo bils monlionod in llo oarIior sonlonco). Tlo
rocoivor dovico clocIs for an ICRC orror llal may occur as llo pacIol movos
llrougl llo fabric.
Tlo rocoivor sido of llo Transaclion Iayor sloros inbound
TIIs in rocoivor virluaI clannoI buffors. Tlo rocoivor clocIs for CRC orrors
basod on llo ICRC fioId in llo TII. If lloro aro no orrors, llo ICRC fioId is
slrippod and llo rosuIlanl informalion in llo TII loador as voII as llo dala
payIoad is sonl lo llo Dovico Coro.
Tlo Transaclion Iayor onsuros llal il doos nol lransmil a TII
ovor llo IinI lo a romolo rocoivor dovico unIoss llo rocoivor dovico las virluaI
clannoI buffor spaco lo accopl TIIs (of a givon lraffic cIass). Tlo prolocoI for
guaranlooing llis moclanism is roforrod lo as llo fIov conlroI prolocoI. If llo
lransmillor dovico doos nol obsorvo llis prolocoI, a lransmillod TII viII causo
llo rocoivor virluaI clannoI buffor lo ovorfIov. IIov conlroI is aulomalicaIIy
managod al llo lardvaro IovoI and is lransparonl lo soflvaro. Soflvaro is onIy
invoIvod lo onabIo addilionaI buffors boyond llo dofauIl sol of virluaI clannoI
buffors (roforrod lo as VC 0 buffors). Tlo dofauIl buffors aro onabIod aulomali-
caIIy aflor IinI lraining, llus aIIoving TII lraffic lo fIov llrougl llo fabric
immodialoIy aflor IinI lraining. Configuralion lransaclions uso llo dofauIl vir-
luaI clannoI buffors and can bogin immodialoIy aflor llo IinI lraining procoss.
IinI lraining procoss is doscribod in Claplor 14, onlilIod "IinI IniliaIizalion &
Training," on pago 499.
-- -

Rofor lo Iiguro 2-21 on pago 82 for an ovorviov of llo fIov conlroI procoss. A
rocoivor dovico lransmils DIIIs caIIod IIov ConlroI IacIols (ICx DIIIs) lo
llo lransmillor dovico on a poriodic basis. Tlo ICx DIIIs conlain fIov conlroI
crodil informalion llal updalos llo lransmillor rogarding lov mucl buffor
spaco is avaiIabIo in llo rocoivor virluaI clannoI buffor. Tlo lransmillor Ioops
lracI of llis informalion and viII onIy lransmil TIIs oul of ils Transaclion
Iayor if il Inovs llal llo romolo rocoivor las buffor spaco lo accopl llo lrans-
millod TII.
Considor Iiguro 2-22 on pago 83 in vlicl llo
vidoo camora and SCSI dovico slovn nood lo lransmil vrilo roquosl TIIs lo
syslom DRAM. Tlo camora dala is limo crilicaI isoclronous dala vlicl musl
roacl momory vill guaranlood bandvidll ollorviso llo dispIayod imago viII
appoar cloppy or uncIoar. Tlo SCSI dala is nol as limo sonsilivo and onIy noods
lo gol lo syslom momory corroclIy villoul orrors. Il is cIoar llal llo vidoo dala
pacIol slouId lavo liglor priorily vlon roulod llrougl llo ICI Ixpross fabric,
ospociaIIy llrougl svilclos. QoS rofors lo llo capabiIily of rouling pacIols from
difforonl appIicalions llrougl llo fabric vill difforonlialod priorilios and dolor-
minislic Ialoncios and bandvidll. ICI and ICI-X sysloms do nol supporl QoS
capabiIily.
Considor llis oxampIo. AppIicalion drivor soflvaro in conjunclion vill llo OS
--
Receiver Transmitter
Flow Control DLLP (FCx)
TLP
VC Buffer
Buffer space
available

--- - --
-- - -
- -- --
- - -
-
- - - - -
-- - - -
- - - -- -
- -
-- --
-
- - - -
-
-

-- - -
--
Processor Processor
Root Complex
GFX
DDR
SDRAM
10Gb
Ethernet
PCI Express
to-PCI
PCI
InfiniBand
Switch
SCSI
RAID Disk array
IEEE
1394
Out-of-Box
InfiniBand
SCSI
PCI Express
Link
Switch Switch
Switch
PCI Express
GFX
FSB
S
IO
COM1
COM2
S
IO
COM1
COM2
Endpoint
Endpoint
Endpoint Endpoint
Endpoint
Endpoint
10Gb
Ethernet
Endpoint
Add-In
Video
Camera
Fiber
Channel
Slots
Slot
-- -

buffors las llo abiIily lo arbilralo bolvoon TIIs from difforonl VC buffors. VC
buffors lavo configurabIo priorilios. Tlus lraffic fIoving llrougl llo syslom in
difforonl VC buffors viII obsorvo difforonlialod porformancos. Tlo arbilralion
moclanism bolvoon TII lraffic fIoving llrougl difforonl VC buffors is roforrod
lo as VC arbilralion.
AIso, muIli-porl svilclos lavo llo abiIily lo arbilralo bolvoon lraffic coming in
on lvo ingross porls bul using llo samo VC buffor rosourco on a common ogross
porl. Tlis configurabIo arbilralion moclanism bolvoon porls supporlod by
svilclos is roforrod lo as Iorl arbilralion.
--- - - - TC is a TII
loador fioId lransmillod villin llo pacIol unmodifiod ond-lo-ond llrougl llo
fabric. IocaI appIicalion soflvaro and syslom soflvaro basod on porformanco
roquiromonls docidos vlal TC IaboI a TII usos. VCs aro plysicaI buffors llal
provido a moans lo supporl muIlipIo indopondonl IogicaI dala fIovs ovor llo
plysicaI IinI via llo uso of lransmil and rocoivor virluaI clannoI buffors.
ICI Ixpross dovicos may impIomonl up lo 8 VC buffors (VC0-VC7). Tlo TC
fioId is a 3-bil fioId llal aIIovs difforonlialion of lraffic inlo 8 lraffic cIassos
(TC0-TC7). Dovicos musl impIomonl VC0. SimiIarIy, a dovico is roquirod lo sup-
porl TC0 (bosl offorl gonoraI purposo sorvico cIass). Tlo ollor oplionaI TCs may
bo usod lo provido difforonlialod sorvico llrougl llo fabric. Associalod vill
oacl impIomonlod VC ID, a lransmil dovico impIomonls a lransmil buffor and a
rocoivo dovico impIomonls a rocoivo buffor.
Dovicos or svilclos impIomonl TC-lo-VC mapping Iogic by vlicl a TII of a
givon TC numbor is forvardod llrougl llo IinI using a parlicuIar VC num-
borod buffor. ICI Ixpross providos llo capabiIily of mapping muIlipIo TCs onlo
a singIo VC, llus roducing dovico cosl by moans of providing Iimilod numbor of
VC buffor supporl. TC/VC mapping is configurod by syslom soflvaro llrougl
configuralion rogislors. Il is up lo llo dovico appIicalion soflvaro lo dolormino
TC IaboI for TIIs and TC/VC mapping llal mools porformanco roquiromonls.
In ils simpIosl form TC/VC mapping rogislors can bo configurod vill a
ono-lo-ono mapping of TC lo VC.
Considor llo oxampIo iIIuslralod in Iiguro 2-23 on pago 85. Tlo TC/VC map-
ping rogislors in Dovico A aro configurod lo map, TIIs vill TC|2:0] lo VC0 and
TIIs vill TC|7:3] lo VC1. Tlo TC/VC mapping rogislors in rocoivor Dovico B
musl aIso bo configurod idonlicaIIy as Dovico A. Tlo samo numborod VC buff-
ors aro onabIod boll in lransmillor Dovico A and rocoivor Dovico B.

If Dovico A noods lo lransmil a TII vill TC IaboI of 7 and anollor pacIol vill
TC IaboI of 0, llo lvo pacIols viII bo pIacod in VC1 and VC0 buffors, rospoc-
livoIy. Tlo arbilralion Iogic arbilralos bolvoon llo lvo VC buffors. Assumo VC1
buffor is configurod vill liglor priorily llan VC0 buffor. Tlus, Dovico A viII
forvard llo TC7 TIIs in VC1 lo llo IinI aload of llo TC0 TIIs in VC0.
Wlon llo TIIs arrivo in Dovico B, llo TC/VC mapping Iogic docodos llo TC
IaboI in oacl TII and pIacos llo TIIs in lloir associalod VC buffors.
In llis oxampIo, TII lraffic vill TC|7:3] IaboI viII fIov llrougl llo fabric vill
liglor priorily llan TC|2:0] lraffic. Willin oacl TC group lovovor, TIIs viII
fIov vill oquaI priorily.
Tlo goaIs of arbilralion supporl
in llo Transaclion Iayor aro:
- To provido difforonlialod sorvicos bolvoon dala fIovs villin llo fabric.
- To provido guaranlood bandvidll vill dolorminislic and smaIIosl
ond-lo-ond lransaclion Ialoncy.
IacIols of difforonl TCs aro roulod llrougl llo fabric of svilclos vill difforonl
priorily basod on arbilralion poIicy impIomonlod in svilclos. IacIols coming in
from ingross porls loading lovards a parlicuIar ogross porl compolo for uso of
llal ogross porl.
- -
Receiver Device B
VC0
VC1
TC[7:0]
TC[2:0]
maps to
VC0
TC[7:3]
maps to
VC1
Transmitter Device A
Link
Buffers Buffers TC[7:0]
VC0
VC1
VC0
VC1
One physical Link,
multiple virtual paths
-- -

Svilclos impIomonl lvo lypos of arbilralion for oacl ogross porl: Iorl Arbilra-
lion and VC Arbilralion. Considor Iiguro 2-24 on pago 86.
Iorl arbilralion is arbilralion bolvoon lvo pacIols arriving on difforonl ingross
porls bul llal map lo llo samo virluaI clannoI (aflor going llrougl TC-lo-VC
mapping) of llo common ogross porl. Tlo porl arbilor impIomonls round-robin,
voigllod round-robin or programmabIo limo-basod round-robin arbilralion
sclomos soIoclabIo llrougl configuralion rogislors.
VC arbilralion laIos pIaco aflor porl arbilralion. Ior a givon ogross porl, pacIols
from aII VCs compolo lo lransmil on llo samo ogross porl. VC arbilralion
rosoIvos llo ordor in vlicl TIIs in difforonl VC buffors aro forvardod on lo llo
IinI. VC arbilralion poIicios supporlod incIudo, slricl priorily, round-robin and
voigllod round-robin arbilralion sclomos soIoclabIo llrougl configuralion rog-
islors.
Indopondonl of arbilralion, oacl VC musl obsorvo lransaclion ordoring and
fIov conlroI ruIos boforo il can maIo ponding TII lraffic visibIo lo llo arbilra-
lion moclanism.
Indpoinl dovicos and a rool compIox vill onIy ono porl do nol supporl porl
arbilralion. Tloy onIy supporl VC arbilralion in llo Transaclion Iayor.
-
VC0
0
VC1
TC[2:0] to VC0
TC[7:3] to VC1
Link
VC0
VC1
TC[2:0] to VC0
TC[7:3] to VC1
Link
VC0
Port
Arb
VC1
Port
Arb
VC
Arb
VC0
VC1
Link
VC0
VC1

- ICI Ixpross prolocoI impIomonls ICI/ICI-X com-

pIianl producor-consumor ordoring modoI for lransaclion ordoring vill provi-
sion lo supporl roIaxod ordoring simiIar lo ICI-X arclilocluro. Transaclion
ordoring ruIos guaranloo llal TII lraffic associalod vill a givon lraffic cIass is
roulod llrougl llo fabric in llo corrocl ordor lo provonl polonliaI doadIocI or
Iivo-IocI condilions from occurring. Traffic associalod vill difforonl TC IaboIs
lavo no ordoring roIalionslip. Claplor 8, onlilIod "Transaclion Ordoring," on
pago 315 doscribos lloso ordoring ruIos.
Tlo Transaclion Iayor onsuros llal TIIs for a givon TC aro ordorod corroclIy
vill rospocl lo ollor TIIs of llo samo TC IaboI boforo forvarding lo llo Dala
IinI Iayor and IlysicaI Iayor for lransmission.
Tlo Transaclion Iayor supporls ACII/ICI povor
managomonl, as diclalod by syslom soflvaro. Hardvaro villin llo Transaclion
Iayor aulonomousIy povor managos a dovico lo minimizo povor during
fuII-on povor slalos. Tlis aulomalic povor managomonl is roforrod lo as Aclivo
Slalo Iovor Managomonl and doos nol invoIvo soflvaro. Iovor managomonl
soflvaro associalod vill llo OS povor managos a dovicos povor slalos llougl
povor managomonl configuralion rogislors. Iovor managomonl is doscribod in
Claplor 16.
-- A dovicos configuralion rogislors aro associalod
vill llo Transaclion Iayor. Tlo rogislors aro configurod during iniliaIizalion
and bus onumoralion. Tloy aro aIso configurod by dovico drivors and accossod
by runlimo soflvaro/OS. AddilionaIIy, llo rogislors sloro nogolialod IinI capa-
biIilios, sucl as IinI vidll and froquoncy. Configuralion rogislors aro doscribod
in Iarl 6 of llo booI.
Data Link Layer
Rofor lo Iiguro 2-19 on pago 79 for a bIocI diagram of a dovicos Dala IinI
Iayor. Tlo primary funclion of llo Dala IinI Iayor is lo onsuro dala inlogrily
during pacIol lransmission and rocoplion on oacl IinI. If a lransmillor dovico
sonds a TII lo a romolo rocoivor dovico al llo ollor ond of a IinI and a CRC
orror is doloclod, llo lransmillor dovico is nolifiod vill a NAK DIII. Tlo lrans-
millor dovico aulomalicaIIy ropIays llo TII. Tlis limo lopofuIIy no orror
occurs. Will orror clocIing and aulomalic ropIay of pacIols rocoivod in orror,
ICI Ixpross onsuros vory ligl probabiIily llal a TII lransmillod by ono dovico
viII maIo ils vay lo llo finaI doslinalion vill no orrors. Tlis maIos ICI
Ixpross idoaI for Iov orror ralo, ligl-avaiIabiIily sysloms sucl as sorvors.
-- -

- Tlo Transaclion Iayor musl obsorvo llo fIov conlroI mocla-

nism boforo forvarding oulbound TIIs lo llo Dala IinI Iayor. If sufficionl
crodils oxisl, a TII slorod villin llo virluaI clannoI buffor is passod from llo
Transaclion Iayor lo llo Dala IinI Iayor for lransmission.
Considor Iiguro 2-25 on pago 88 vlicl slovs llo Iogic associalod vill llo
ACK-NAK moclanism of llo Dala IinI Iayor. Tlo Dala IinI Iayor is rosponsi-
bIo for TII CRC gonoralion and TII orror clocIing. Ior oulbound TIIs from
lransmil Dovico A, a IinI CRC (ICRC) is gonoralod and appondod lo llo TII.
In addilion, a soquonco ID is appondod lo llo TII. Dovico As Dala IinI Iayor
prosorvos a copy of llo TII in a ropIay buffor and lransmils llo TII lo Dovico
B. Tlo Dala IinI Iayor of llo romolo Dovico B rocoivos llo TII and clocIs for
CRC orrors.
-
Error
Check
Replay
Buffer
Link Packet
Sequence TLP LCRC
ACK /
NAK
DLLP
De-mux
Mux
From
Transaction Layer
To
Transaction Layer
Data Link Layer
Tx Rx
Link Packet
Sequence TLP LCRC
ACK /
NAK
DLLP
Link
Device A
Remote
Device B
Tx Rx
E r r o r
C h e c k
R e p l a y
B u f f e r
L i n k P a c k e t
S e q u e n c e T L P L C R C
A C K /
N A K
D L L P
D e - m u x
M u x
F r o m
T r a n s a c t i o n L a y e r
T o
T r a n s a c t i o n L a y e r
D a t a L i n k L a y e r
T x R x
L i n k P a c k e t
S e q u e n c e T L P L C R C
A C K /
N A K
D L L P
T x R x

If lloro is no orror, llo Dala IinI Iayor of Dovico B rolurns an ACK DIII vill
a soquonco ID lo Dovico A. Dovico A las confirmalion llal llo TII las roaclod
Dovico B (nol nocossariIy llo finaI doslinalion) succossfuIIy. Dovico A cIoars ils
ropIay buffor of llo TII associalod vill llal soquonco ID.
If on llo ollor land a CRC orror is doloclod in llo TII rocoivod al llo romolo
Dovico B, llon a NAK DIII vill a soquonco ID is rolurnod lo Dovico A. An
orror las occurrod during TII lransmission. Dovico As Dala IinI Iayor
ropIays associalod TIIs from llo ropIay buffor. Tlo Dala IinI Iayor gonoralos
orror indicalions for orror roporling and Iogging moclanisms.
In summary, llo ropIay moclanism usos llo soquonco ID fioId villin rocoivod
ACK/NAK DIIIs lo associalo il vill oulbound TIIs slorod in llo ropIay
buffor. Rocoplion of ACK DIIIs causo llo ropIay buffor lo cIoar TIIs from llo
buffor. Rocoiving NAK DIIIs causo llo ropIay buffor lo ropIay associalod TIIs.
Ior a givon TII in llo ropIay buffor, if llo lransmillor dovico rocoivos a NAK 4
limos and llo TII is ropIayod 3 addilionaI limos as a rosuIl, llon llo Dala IinI
Iayor Iogs llo orror, roporls a corroclabIo orror, and ro-lrains llo IinI.
Tlo rocoivo sido of llo Dala IinI Iayor is rosponsibIo for
ICRC orror clocIing on inbound TIIs. If no orror is doloclod, llo dovico sclod-
uIos an ACK DIII for lransmission bacI lo llo romolo lransmillor dovico. Tlo
rocoivor slrips llo TII of llo ICRC fioId and soquonco ID.
If a CRC orror is doloclod, il scloduIos a NAK lo rolurn bacI lo llo romolo lrans-
millor. Tlo TII is oIiminalod.
Tlo rocoivo sido of llo Dala IinI Iayor aIso rocoivos ACKs and NAKs from a
romolo dovico. If an ACK is rocoivod llo rocoivo sido of llo Dala IinI Iayor
informs llo lransmil sido lo cIoar an associalod TII from llo ropIay buffor. If a
NAK is rocoivod, llo rocoivo sido causos llo ropIay buffor of llo lransmil sido lo
ropIay associalod TIIs.
Tlo rocoivo sido is aIso rosponsibIo for clocIing llo soquonco ID of rocoivod
TIIs lo clocI for droppod or oul-of-ordor TIIs.
- - Tlo Dala IinI
Iayor concalonalos a 12-bil soquonco ID and 32-bil ICRC fioId lo an oulbound
TII llal arrivos from llo Transaclion Iayor. Tlo rosuIlanl TII is slovn in Iig-
uro 2-26 on pago 90. Tlo soquonco ID is usod lo associalo a copy of llo oul-
bound TII slorod in llo ropIay buffor vill a rocoivod ACK/NAK DIII
inbound from a noiglboring romolo dovico. Tlo ACK/NAK DIII confirms
arrivaI of llo oulbound TII in llo romolo dovico.
-- -

Tlo 32-bil ICRC is caIcuIalod basod on aII bylos in llo TII incIuding llo
soquonco ID.
A DIII slovn in Iiguro 2-26 on pago 90 is a 4 bylo pacIol vill a 16-bil CRC
fioId. Tlo 8-bil DIII Typo fioId indicalos various calogorios of DIIIs. Tloso
incIudo: ACK, NAK, Iovor Managomonl roIalod DIIIs (IM_Inlor_I1,
IM_Inlor_I23, IM_Aclivo_Slalo_Roquosl_I1, IM_Roquosl_AcI) and IIov
ConlroI roIalod DIIIs (InilIC1-I, InilIC1-NI, InilIC1-CpI, InilIC2-I,
InilIC2-NI, InilIC2-CpI, UpdaloIC-I, UpdaloIC-NI, UpdaloIC-CpI). Tlo
16-bil CRC is caIcuIalod using aII 4 bylos of llo DIII. Rocoivod DIIIs vlicl
faiI llo CRC clocI aro discardod. Tlo Ioss of informalion from discarding a
DIII is soIf ropairing sucl llal a succossivo DIII viII suporsodo any informa-
lion Iosl. ACK and NAK DIIIs conlain a soquonco ID fioId (slovn as Misc.
fioId in Iiguro 2-26) usod by llo dovico lo associalo an inbound ACK/NAK
DIII vill a slorod copy of a TII in llo ropIay buffor.
- - Noxl llo
slops roquirod lo compIolo a momory road roquosl bolvoon a roquoslor and a
compIolor on llo far ond of a svilcl aro doscribod. Iiguro 2-27 on pago 91
slovs llo aclivily on llo IinI lo compIolo llis lransaclion:
Slop 1a: Roquoslor lransmils a momory road roquosl TII (MRd). Svilcl
rocoivos llo MRd TII and clocIs for CRC orror using llo ICRC fioId in llo
MRd TII.

Header Data Payload ECRC
Transaction Layer Packet (TLP)
Sequence ID LCRC
DLLP Type CRC
DLLP
AND
Misc.

Slop 1b: If no orror llon svilcl rolurns ACK DIII lo roquoslor. Roquoslor dis-
cards copy of llo TII from ils ropIay buffor.
Slop 2a: Svilcl forvards llo MRd TII lo llo corrocl ogross porl using momory
addross for rouling. CompIolor rocoivos MRd TII. CompIolor clocIs for CRC
orrors in rocoivod MRd TII using ICRC.
Slop 2b: If no orror llon compIolor rolurns ACK DIII lo svilcl. Svilcl dis-
cards copy of llo MRd TII from ils ropIay buffor.
Slop 3a: CompIolor clocIs for CRC orror using oplionaI ICRC fioId in MRd
TII. Assumo no Ind-lo-Ind orror. CompIolor rolurns CompIolion (CpID) vill
Dala TII vlonovor il las llo roquoslod dala. Svilcl rocoivos CpID TII and
clocIs for CRC orror using ICRC.
Slop 3b: If no orror llon svilcl rolurns ACK DIII lo compIolor. CompIolor dis-
cards copy of llo CpID TII from ils ropIay buffor.
Slop 4a: Svilcl docodos Roquoslor ID fioId in CpID TII and roulos llo pacIol lo
llo corrocl ogross porl. Roquoslor rocoivos CpID TII. Roquoslor clocIs for CRC
orrors in rocoivod CpID TII using ICRC.
Slop 4b: If no orror llon roquoslor rolurns ACK DIII lo svilcl. Svilcl discards
copy of llo CpID TII from ils ropIay buffor. Roquoslor dolorminos if lloro is
orror in CpID TII using CRC fioId in oplionaI ICRC fioId. Assumo no
Ind-lo-Ind orror. Roquoslor clocIs compIolion orror codo in CpID. Assumo
compIolion codo of SuccossfuI CompIolion. To associalo llo compIolion vill
llo originaI roquosl, roquoslor malclos lag in CpID vill originaI lag of MRd
roquosl. Roquoslor accopls dala.
- -
ACK returned for good reception of Request or Completion
NAK returned for error reception of Request or Completion
Requester Completer
1a. Request
Switch
2a. Request
3a. Completion 4a. Completion
1b. ACK 2b. ACK
4b. ACK 3b. ACK
-- -

- - BoIov aro llo

slops invoIvod in compIoling a momory vrilo roquosl bolvoon a roquoslor and a
compIolor on llo far ond of a svilcl. Iiguro 2-28 on pago 92 slovs llo aclivily
on llo IinI lo compIolo llis lransaclion:
Slop 1a: Roquoslor lransmils a momory vrilo roquosl TII (MWr) vill dala.
Svilcl rocoivos MWr TII and clocIs for CRC orror vill ICRC fioId in llo TII.
Slop 1b: If no orror llon svilcl rolurns ACK DIII lo roquoslor. Roquoslor dis-
cards copy of llo TII from ils ropIay buffor.
Slop 2a: Svilcl forvards llo MWr TII lo llo corrocl ogross porl using momory
addross for rouling. CompIolor rocoivos MWr TII. CompIolor clocIs for CRC
orrors in rocoivod MRd TII using ICRC.
Slop 2b: If no orror llon compIolor rolurns ACK DIII lo svilcl. Svilcl dis-
cards copy of llo MWr TII from ils ropIay buffor. CompIolor clocIs for CRC
orror using oplionaI digosl fioId in MWr TII. Assumo no Ind-lo-Ind orror.
CompIolor accopls dala. Tloro is no compIolion associalod vill llis lransaclion.
- IoIIoving povor-up or
Rosol, llo fIov conlroI moclanism doscribod oarIior is iniliaIizod by llo Dala
IinI Iayor. Tlis procoss is accompIislod aulomalicaIIy al llo lardvaro IovoI
and las no soflvaro invoIvomonl.
IIov conlroI for llo dofauIl virluaI clannoI VC0 is iniliaIizod firsl. In addilion,
vlon addilionaI VCs aro onabIod by soflvaro, llo fIov conlroI iniliaIizalion
procoss is ropoalod for oacl novIy onabIod VC. Sinco VC0 is onabIod boforo aII
ollor VCs, no TII lraffic viII bo aclivo prior lo iniliaIizalion of VC0.
- -
Requester Completer
1a Request
Switch
2a Request
1b ACK 2b ACK
ACK returned for good reception of Request or Completion
NAK returned for error reception of Request or Completion

PhysicaI Layer
Rofor lo Iiguro 2-19 on pago 79 for a bIocI diagram of a dovicos IlysicaI Iayor.
Boll TII and DIII lypo pacIols aro sonl from llo Dala IinI Iayor lo llo Ilys-
icaI Iayor for lransmission ovor llo IinI. AIso, pacIols aro rocoivod by llo
IlysicaI Iayor from llo IinI and sonl lo llo Dala IinI Iayor.
Tlo IlysicaI Iayor is dividod in lvo porlions, llo IogicaI IlysicaI Iayor and
llo IIoclricaI IlysicaI Iayor. Tlo IogicaI IlysicaI Iayor conlains digilaI Iogic
associalod vill procossing pacIols boforo lransmission on llo IinI, or procoss-
ing pacIols inbound from llo IinI boforo sonding lo llo Dala IinI Iayor. Tlo
IIoclricaI IlysicaI Iayor is llo anaIog inlorfaco of llo IlysicaI Iayor llal con-
nocls lo llo IinI. Il consisls of difforonliaI drivors and rocoivors for oacl Iano.
- TIIs and DIIIs from llo Dala IinI Iayor aro cIocIod inlo a
buffor in llo IogicaI IlysicaI Iayor. Tlo IlysicaI Iayor framos llo TII or
DIII vill a Slarl and Ind claraclor. Tlo symboI is a framing codo bylo vlicl
a rocoivor dovico usos lo dolocl llo slarl and ond of a pacIol. Tlo Slarl and Ind
claraclors aro slovn appondod lo a TII and DIII in Iiguro 2-29 on pago 94.
Tlo diagram slovs llo sizo of oacl fioId in a TII or DIII.
Tlo lransmil IogicaI sub-bIocI condilions llo rocoivod pacIol from llo Dala
IinI Iayor inlo llo corrocl formal for lransmission. IacIols aro bylo slripod
across llo avaiIabIo Ianos on llo IinI.
Iacl bylo of a pacIol is llon scrambIod vill llo aid of Iinoar IoodbacI Slifl
Rogislor lypo scrambIor. By scrambIing llo bylos, ropoalod bil pallorns on llo
IinI aro oIiminalod, llus roducing llo avorago IMI noiso gonoralod.
Tlo rosuIlanl bylos aro oncodod inlo a 10b codo by llo 8b/10b oncoding Iogic.
Tlo primary purposo of oncoding 8b claraclors lo 10b symboIs is lo croalo suffi-
cionl 1-lo-0 and 0-lo-1 lransilion donsily in llo bil slroam lo faciIilalo rocroalion
of a rocoivo cIocI vill llo aid of a III al llo romolo rocoivor dovico. Nolo llal
dala is nol lransmillod aIong vill a cIocI. Insload, llo bil slroam conlains suffi-
cionl lransilions lo aIIov llo rocoivor dovico lo rocroalo a rocoivo cIocI.
Tlo paraIIoI-lo-soriaI convorlor gonoralos a soriaI bil slroam of llo pacIol on
oacl Iano and lransmils il difforonliaIIy al 2.5 Gbils/s.
Tlo rocoivo IIoclricaI IlysicaI Iayor cIocIs in a pacIol arriv-
ing difforonliaIIy on aII Ianos. Tlo soriaI bil slroam of llo pacIol is convorlod
inlo a 10b paraIIoI slroam using llo soriaI-lo-paraIIoI convorlor. Tlo rocoivor
Iogic aIso incIudos an oIaslic buffor vlicl accommodalos for cIocI froquoncy
-- -

varialion bolvoon a lransmil cIocI vill vlicl llo pacIol bil slroam is cIocIod
inlo a rocoivor and llo rocoivor cIocI. Tlo 10b symboI slroam is docodod bacI lo
llo 8b roprosonlalion of oacl symboI vill llo 8b/10b docodor. Tlo 8b clarac-
lors aro do-scrambIod. Tlo Bylo unslriping Iogic, ro-croalos llo originaI pacIol
slroam lransmillod by llo romolo dovico.
An addilionaI funclion of llo IlysicaI
Iayor is IinI iniliaIizalion and lraining. IinI iniliaIizalion and lraining is a
IlysicaI Iayor conlroIIod procoss llal configuros and iniliaIizos oacl IinI for
normaI oporalion. Tlis procoss is aulomalic and doos nol invoIvo soflvaro. Tlo
foIIoving aro dolorminod during llo IinI iniliaIizalion and lraining procoss:
- IinI vidll
- IinI dala ralo
- Iano rovorsaI
- IoIarily invorsion.
- Bil IocI por Iano
- SymboI IocI por Iano
- Iano-lo-Iano do-sIov villin a muIli-Iano IinI.
. Tvo dovicos vill a difforonl numbor of Ianos por IinI may bo
connoclod. I.g. ono dovico las x2 porl and il is connoclod lo a dovico vill x4
porl. Aflor iniliaIizalion llo IlysicaI Iayor of boll dovicos dolorminos and sols
llo IinI vidll lo llo minimum Iano vidll of x2. Ollor IinI nogolialod bolav-
iors incIudo Iano rovorsaI and spIilling of porls inlo muIlipIo IinIs.
-
Header Data Payload ECRC
Transaction Layer Packet (TLP)
Sequence LCRC
DLLP Type CRC
DLLP
Misc. Start End
Start End
1B 2B 1DW 1B 1DW 0-1024 DW 3-4 DW
1B 1B
1DW
2B

- if nocossary is an oplionaI foaluro. Ianos aro numborod. A

dosignor may nol viro llo corrocl Ianos of lvo porls corroclIy. In vlicl caso
lraining aIIovs for llo Iano numbors lo bo rovorsod so llal llo Iano numbors of
adjaconl porls on oacl ond of llo IinI malcl up. Iarl of llo samo procoss may
aIIov for a muIli-Iano IinI lo bo spIil inlo muIlipIo IinIs.
-. Tlo D+ and D- difforonliaI pair lorminaIs for lvo dovicos
may nol bo connoclod corroclIy. In vlicl caso llo lraining soquonco rocoivor
rovorsos llo poIarily on llo difforonliaI rocoivor.
Training is compIolod al dala ralo of 2.5 Gbil/s. In llo fuluro,
liglor dala ralos of 5 Gbil/s and 10 Gbil/s viII bo supporlod. During lraining,
oacl nodo advorlisos ils liglosl dala ralo capabiIily. Tlo IinI is iniliaIizod vill
llo liglosl common froquoncy llal dovicos al opposilo onds of a IinI supporl.
-. Duo lo IinI viro Iongll varialions and difforonl
drivor/rocoivor claraclorislics on a muIli-Iano IinI, bil slroams on oacl Iano
viII arrivo al a rocoivor sIovod vill rospocl lo ollor Ianos. Tlo rocoivor circuil
musl componsalo for llis sIov by adding/romoving doIays on oacl Iano.
RoIaxod rouling ruIos aIIov IinI viro Ionglls in llo ordor of 20-30.
Tlo normaI povor-on oporalion of a IinI is
caIIod llo I0 slalo. Iovor povor slalos of llo IinI in vlicl no pacIols aro
lransmillod or rocoivod aro I0s, I1, I2 and I3 povor slalos. Tlo I0s povor slalo
is aulomalicaIIy onlorod vlon a limo-oul occurs aflor a poriod of inaclivily on
llo IinI. Inloring and oxiling llis slalo doos nol invoIvo soflvaro and llo oxil
Ialoncy is llo slorlosl. I1 and I2 aro Iovor povor slalos llan I0s, bul oxil Ialon-
cios aro groalor. Tlo I3 povor slalo is llo fuII off povor slalo from vlicl a
dovico cannol gonoralo a vaIo up ovonl.
- Tvo lypos of rosol aro supporlod:
- CoId/varm rosol aIso caIIod a IundamonlaI Rosol vlicl occurs foIIoving a
dovico boing povorod-on (coId rosol) or duo lo a rosol villoul circuIaling
povor (varm rosol).
- Hol rosol somolimos roforrod lo as prolocoI rosol is an in-band mollod of
propagaling rosol. Transmission of an ordorod-sol is usod lo signaI a lol
rosol. Soflvaro inilialos lol rosol gonoralion.
On oxil from rosol (coId, varm, or lol), aII slalo maclinos and configuralion
rogislors (lol rosol doos nol rosol slicIy configuralion rogislors) aro iniliaIizod.
-- -

- Tlo lransmillor of ono dovico is AC coupIod lo

llo rocoivor of anollor dovico al llo opposilo ond of llo IinI as slovn in Iiguro
2-30. Tlo AC coupIing capacilor is bolvoon 75-200 nI. Tlo lransmillor DC com-
mon modo voIlago is oslabIislod during IinI lraining and iniliaIizalion. Tlo
DC common modo impodanco is lypicaIIy 50 olms vliIo llo difforonliaI
impodanco is 100 olms lypicaI. Tlis impodanco is malclod vill a slandard IR4
board.
ExampIe of a Non-Posted Memory Read Transaction
Iol us pul our InovIodgo so far lo doscribo llo sol of ovonls llal laIo pIaco
from llo limo a roquoslor dovico inilialos a momory road roquosl, unliI il oblains
llo roquoslod dala from a compIolor dovico. Givon llal sucl a lransaclion is a
non-poslod lransaclion, lloro aro lvo plasos lo llo road procoss. Tlo firsl plaso
is llo lransmission of a momory road roquosl TII from roquoslor lo compIolor.
Tlo socond plaso is llo rocoplion of a compIolion vill dala from llo compIolor.
- -
+
-
Receiver
V
tt
Z
vtt
Transmitter
C
TX
C
TX
Z
TX
Z
RX
Z
RX
Z
TX
Z
TX
Z
TX
Link
Transmitter is AC coupled to receiver
DC common mode impedance is 50 Ohms
Differential impedance is 100 Ohms
Coupling capacitor is between 75-200 nF

Memory Read Request Phase

Rofor lo Iiguro 2-31. Tlo roquoslor Dovico Coro or Soflvaro Iayor sonds llo foI-
Ioving informalion lo llo Transaclion Iayor:
32-bil or 64-bil momory addross, lransaclion lypo of momory road roquosl,
amounl of dala lo road caIcuIalod in doubIovords, lraffic cIass if ollor llan
TC0, bylo onabIos, allribulos lo indicalo if roIaxod ordoring and no snoop
allribulo bils slouId bo sol or cIoar.
Tlo Transaclion Iayor usos llis informalion lo buiId a MRd TII. Tlo oxacl TII
pacIol formal is doscribod in a Ialor claplor. A 3 DW or 4 DW loador is croalod
doponding on addross sizo (32-bil or 64-bil). In addilion, llo Transaclion Iayor
adds ils roquoslor ID (bus#, dovico#, funclion#) and an 8-bil lag lo llo loador. Il
sols llo TD (lransaclion digosl prosonl) bil in llo TII loador if a 32-bil
- -
Send Memory Read Request
Header Data Payload ECRC
Flow Control
Virtual Channel
Management
Ordering
Receive
Buffers
per VC
Transmit
Buffers
per VC
Requester
Serial-to-Parallel Parallel-to-Serial
Differential Receiver Differential Driver
Link Packet Start End Link Packet Start End
Decode Encode
Transaction Layer Packet (TLP)
Error
Check
Replay Buffer
Physical Packet Physical Packet
Link Packet
Sequence TLP LCRC
ACK/NAK
DLLP.
CRC
Header Data Payload ECRC
Transaction Layer Packet (TLP)
Link Packet
Sequence TLP LCRC
Port Port
MRd TLP
Link
ACK or NAK
NAK
DLLP
Physical layer
Software layer
Data Link layer
Software layer
Transaction layer Flow Control
Virtual Channel
Management
Ordering
Completer
Receive Memory Read Request
-- -

Ind-lo-Ind CRC is addod lo llo laiI porlion of llo TII. Tlo TII doos nol lavo
a dala payIoad. Tlo TII is pIacod in llo approprialo virluaI clannoI buffor
roady for lransmission. Tlo fIov conlroI Iogic confirms lloro aro sufficionl
crodils avaiIabIo (oblainod from llo compIolor dovico) for llo virluaI clannoI
associalod vill llo lraffic cIass usod.
OnIy llon llo momory road roquosl TII is sonl lo llo Dala IinI Iayor. Tlo Dala
IinI Iayor adds a 12-bil soquonco ID and a 32-bil ICRC vlicl is caIcuIalod
basod on llo onliro pacIol. A copy of llo TII vill soquonco ID and ICRC is
slorod in llo ropIay buffor.
Tlis pacIol is forvardod lo llo IlysicaI Iayor vlicl lags on a Slarl symboI and
an Ind symboI lo llo pacIol. Tlo pacIol is bylo slripod across llo avaiIabIo
Ianos, scrambIod and 10 bil oncodod. IinaIIy llo pacIol is convorlod lo a soriaI
bil slroam on aII Ianos and lransmillod difforonliaIIy across llo IinI lo llo
noiglbor compIolor dovico.
Tlo compIolor convorls llo incoming soriaI bil slroam bacI lo 10b symboIs
vliIo assombIing llo pacIol in an oIaslic buffor. Tlo 10b symboIs aro convorlod
bacI lo bylos and llo bylos from aII Ianos aro do-scrambIod and un-slripod. Tlo
Slarl and Ind symboIs aro doloclod and romovod. Tlo rosuIlanl TII is sonl lo
llo Dala IinI Iayor.
Tlo compIolor Dala IinI Iayor clocIs for ICRC orrors in llo rocoivod TII and
clocIs llo Soquonco ID for missing or oul-of-soquonco TIIs. Assumo no orror.
Tlo Dala IinI Iayor croalos an ACK DIII vlicl conlains llo samo soquonco
ID as conlainod in llo momory road roquosl TII rocoivod. A 16-bil CRC is
addod lo llo ACK DIII. Tlo DIII is sonl bacI lo llo IlysicaI Iayor vlicl
lransmils llo ACK DIII lo llo roquoslor.
Tlo roquoslor IlysicaI Iayor roformuIalos llo ACK DIII and sonds il up lo llo
Dala IinI Iayor vlicl ovaIualos llo soquonco ID and comparos il vill TIIs
slorod in llo ropIay buffor. Tlo slorod momory road roquosl TII associalod
vill llo ACK rocoivod is discardod from llo ropIay buffor. If a NAK DIII vas
rocoivod by llo roquoslor insload, il vouId ro-sond a copy of llo slorod momory
road roquosl TII.
In llo moan limo llo Dala IinI Iayor of llo compIolor slrips llo soquonco ID
and ICRC fioId from llo momory road roquosl TII and forvards il lo llo
Transaclion Iayor.
Tlo Transaclion Iayor rocoivos llo momory road roquosl TII in llo approprialo
virluaI clannoI buffor associalod vill llo TC of llo TII. Tlo Transaclion Iayor
clocIs for ICRC orror. Il forvards llo conlonls of llo loador (addross,

roquoslor ID, momory road lransaclion lypo, amounl of dala roquoslod, lraffic
cIass olc.) lo llo compIolor Dovico Coro/Soflvaro Iayor.
CompIetion with Data Phase
Rofor lo Iiguro 2-32 on pago 99 during llo foIIoving discussion. To sorvico llo
momory road roquosl, llo compIolor Dovico Coro/Soflvaro Iayor sonds llo foI-
Ioving informalion lo llo Transaclion Iayor:
Roquoslor ID and Tag copiod from llo originaI momory road roquosl, lransac-
lion lypo of compIolion vill dala (CpID), roquoslod amounl of dala vill dala
Iongll fioId, lraffic cIass if ollor llan TC0, allribulos lo indicalo if roIaxod
ordoring and no snoop bils slouId bo sol or cIoar (lloso bils aro copiod from
llo originaI momory road roquosl). IinaIIy, a compIolion slalus of succossfuI
compIolion (SC) is sonl.
-
Header Data Payload ECRC
Receive
Buffers
per VC
Serial-to-Parallel
Differential Receiver
Link Packet Start End
Decode
Transaction Layer Packet (TLP)
Error
Check
Physical Packet
Link Packet
Sequence TLP LCRC
ACK/NAK
DLLP
CRC
Port
Link
ACK or NAK
Physical layer
Software layer
Data Link layer
Software layer
Transaction layer Flow Control
Virtual Channel
Management
Ordering
Receive Completion with Data) Send Completion with Data
Flow Control
Virtual Channel
Management
Ordering
Transmit
Buffers
per VC
Parallel-to-Serial
Differential Driver
Link Packet Start End
Encode
Replay Buffer
Physical Packet
Header Data Payload ECRC
Transaction Layer Packet (TLP)
Link Packet
Sequence TLP LCRC
Port
NAK
DLLP
CplD TLP
Requester Completer
-- -

Tlo Transaclion Iayor usos llis informalion lo buiId a CpID TII. Tlo oxacl TII
pacIol formal is doscribod in a Ialor claplor. A 3 DW loador is croalod. In addi-
lion, llo Transaclion Iayor adds ils ovn compIolor ID lo llo loador. Tlo TD
(lransaclion digosl prosonl) bil in llo TII loador is sol if a 32-bil Ind-lo-Ind
CRC is addod lo llo laiI porlion of llo TII. Tlo TII incIudos llo dala payIoad.
Tlo fIov conlroI Iogic confirms sufficionl crodils aro avaiIabIo (oblainod from
llo roquoslor dovico) for llo virluaI clannoI associalod vill llo lraffic cIass
usod.
OnIy llon llo CpID TII is sonl lo llo Dala IinI Iayor. Tlo Dala IinI Iayor
adds a 12-bil soquonco ID and a 32-bil ICRC vlicl is caIcuIalod basod on llo
onliro pacIol. A copy of llo TII vill soquonco ID and ICRC is slorod in llo
ropIay buffor.
Tlis pacIol is forvardod lo llo IlysicaI Iayor vlicl lags on a Slarl symboI and
an Ind symboI lo llo pacIol. Tlo pacIol is bylo slripod across llo avaiIabIo
Ianos, scrambIod and 10 bil oncodod. IinaIIy llo CpID pacIol is convorlod lo a
soriaI bil slroam on aII Ianos and lransmillod difforonliaIIy across llo IinI lo
llo noiglbor roquoslor dovico.
Tlo roquoslor convorls llo incoming soriaI bil slroam bacI lo 10b symboIs vliIo
assombIing llo pacIol in an oIaslic buffor. Tlo 10b symboIs aro convorlod bacI
lo bylos and llo bylos from aII Ianos aro do-scrambIod and un-slripod. Tlo Slarl
and Ind symboIs aro doloclod and romovod. Tlo rosuIlanl TII is sonl lo llo
Dala IinI Iayor.
Tlo Dala IinI Iayor clocIs for ICRC orrors in llo rocoivod CpID TII and
clocIs llo Soquonco ID for missing or oul-of-soquonco TIIs. Assumo no orror.
Tlo Dala IinI Iayor croalos an ACK DIII vlicl conlains llo samo soquonco
ID as conlainod in llo CpID TII rocoivod. A 16-bil CRC is addod lo llo ACK
DIII. Tlo DIII is sonl bacI lo llo IlysicaI Iayor vlicl lransmils llo ACK
DIII lo llo compIolor.
Tlo compIolor IlysicaI Iayor roformuIalos llo ACK DIII and sonds il up lo
llo Dala IinI Iayor vlicl ovaIualos llo soquonco ID and comparos il vill
TIIs slorod in llo ropIay buffor. Tlo slorod CpID TII associalod vill llo ACK
rocoivod is discardod from llo ropIay buffor. If a NAK DIII vas rocoivod by
llo compIolor insload, il vouId ro-sond a copy of llo slorod CpID TII.
In llo moan limo, llo roquoslor Transaclion Iayor rocoivos llo CpID TII in llo
approprialo virluaI clannoI buffor mappod lo llo TII TC. Tlo Transaclion
Iayor usos llo lag in llo loador of llo CpID TII lo associalo llo compIolion
vill llo originaI roquosl. Transaclion Iayor clocIs for ICRC orror. Il forvards

llo loador conlonls and dala payIoad incIuding llo CompIolion Slalus lo llo
roquoslor Dovico Coro/Soflvaro Iayor. Momory road lransaclion DONI.
Hot PIug
ICI Ixpross supporls nalivo lol-pIug llougl lol-pIug supporl in a dovico is
nol mandalory. Somo of llo oIomonls found in a ICI Ixpross lol pIug syslom
aro:
- Indicalors vlicl slov llo povor and allonlion slalo of llo sIol.
- ManuaIIy-oporalod Rolonlion Ialcl (MRI) llal loIds add-in cards in pIaco.
- MRI Sonsor llal aIIov llo porl and syslom soflvaro lo dolocl llo MRI
boing oponod.
- IIoclromoclanicaI InlorIocI vlicl provonls romovaI of add-in cards vliIo
sIol is povorod.
- Allonlion Bullon llal aIIovs usor lo roquosl lol-pIug oporalions.
- Soflvaro Usor Inlorfaco llal aIIovs usor lo roquosl lol-pIug oporalions.
- SIol Numboring for visuaI idonlificalion of sIols.
Wlon a porl las no connoclion or a romovaI ovonl occurs, llo porl lransmillor
movos lo llo oIoclricaI ligl impodanco dolocl slalo. Tlo rocoivor romains in llo
oIoclricaI Iov impodanco slalo.
PCI Express Performance and Data Transfer Efficiency
As of May 2003, no roaIislic porformanco and officioncy numbors voro avaiI-
abIo. Hovovor, TabIo 2-3 slovs aggrogalo bandvidll numbors for various IinI
vidlls aflor facloring llo ovorload of 8b/10b oncoding.
DIIIs aro 2 doubIovords in sizo. Tlo ACK/NAK and fIov conlroI prolocoI uli-
Iizo DIIIs, bul il is nol oxpoclod llal lloso DIIIs viII uso up a significanl por-
lion of llo bandvidll.
-- - -
--



--
0.5 1 2 4 6 8 16
-- -

Tlo romaindor of llo bandvidll is avaiIabIo for TIIs. Bolvoon 6-7 doubIo-
vords of llo TII is ovorload associalod vill Slarl and Ind framing symboIs,
soquonco ID, TII loador, ICRC and ICRC fioIds. Tlo romaindor of llo TII
conlains bolvoon 0-1024 doubIovords of dala payIoad. Il is apparonl llal llo
bus officioncy is significanlIy Iov if smaII sizo pacIols aro lransmillod. Tlo offi-
cioncy numbors aro vory ligl if TIIs conlain significanl amounls of dala pay-
Ioad.
IacIols can bo lransmillod bacI-lo-bacI villoul llo IinI going idIo. Tlus llo
IinI can bo 100 uliIizod.
Tlo svilcl doos nol inlroduco any arbilralion ovorload vlon forvarding
incoming pacIols from muIlipIo ingross porls lo ono ogross porl. Hovovor, il is
yol lo bo soon vlal llo offocl is of llo QuaIily of Sorvico prolocoI on acluaI
bandvidll numbors for givon appIicalions.
Tloro is ovorload associalod vill llo spIil lransaclion prolocoI, ospociaIIy for
road lransaclions. Ior a road roquosl TII, llo dala payIoad is conlainod in llo
compIolion. Tlis faclor las lo bo accounlod for vlon dolormining llo offoclivo
porformanco of llo bus. Ioslod vrilo lransaclions improvo llo officioncy of llo
fabric.
Svilclos supporl cul-llrougl modo. Tlal is lo say llal an incoming pacIol can
bo immodialoIy forvardod lo an ogross porl for lransmission villoul llo svilcl
laving lo buffor up llo pacIol. Tlo Ialoncy for pacIol forvarding llrougl a
svilcl can bo vory smaII aIIoving pacIols lo lravoI from ono ond of llo ICI
Ixpross fabric lo anollor ond vill vory smaII Ialoncy.
Iarl Tvo
Transaclion IrolocoI

-- -
-
The Previous Chapter
Tlo provious claplor inlroducod llo ICI Ixpross dala lransfor prolocoI. Il
doscribod llo Iayorod approacl lo ICI Ixpross dovico dosign vliIo doscribing
llo funclion of oacl dovico Iayor. IacIol lypos ompIoyod in accompIisling dala
lransfors voro doscribod villoul golling inlo pacIol conlonl dolaiIs. IinaIIy, llis
claplor oulIinod llo procoss of a roquoslor inilialing a lransaclion sucl as a
momory road lo road dala from a compIolor across a IinI.
This Chapter
Tlis claplor doscribos llo gonoraI concopls of ICI Ixpross lransaclion rouling
and llo moclanisms usod by a dovico in dociding vlollor lo accopl, forvard,
or rojocl a pacIol arriving al an ingross porl. Bocauso Dala IinI Iayor IacIols
(DIIIs) and IlysicaI Iayor - IinI lraffic aro novor forvardod, llo
omplasis loro is on Transaclion Iayor IacIol (TII) lypos and llo llroo rouling
mollods associalod vill llom: addross rouling, ID rouling, and impIicil roul-
ing. IncIudod is a summary of configuralion mollods usod in ICI Ixpross lo sol
up ICI-compalibIo pIug-and-pIay addrossing villin syslom IO and momory
maps, as voII as Ioy oIomonls in llo ICI Ixpross pacIol prolocoI usod in maI-
ing rouling docisions.
The Next Chapter
Tlo noxl claplor dolaiIs llo lvo major cIassos of pacIols aro -
- (TIIs), and - (DIIIs). Tlo uso and formal of oacl
TII and DIII pacIol lypo is covorod, aIong vill dofinilions of llo fioId villin
llo pacIols.
-- -

Introduction
UnIiIo slarod-bus arclilocluros sucl as ICI and ICI-X, vloro lraffic is visibIo
lo oacl dovico and rouling is mainIy a concorn of bridgos, ICI Ixpross dovicos
aro dopondonl on oacl ollor lo accopl lraffic or forvard il in llo diroclion of llo
uIlimalo rocipionl.
-- - ---
-- - -

As iIIuslralod in Iiguro 3-1 on pago 106, a ICI Ixpross lopoIogy consisls of

indopondonl, poinl-lo-poinl IinIs connocling oacl dovico vill ono or moro
noiglbors. As lraffic arrivos al llo inbound sido of a IinI inlorfaco (caIIod llo
-- ), llo dovico clocIs for orrors, llon maIos ono of llroo docisions:
1. Accopl llo lraffic and uso il inlornaIIy.
2. Iorvard llo lraffic lo llo approprialo oulbound --) porl.
3. Rojocl llo lraffic bocauso il is noillor llo inlondod largol nor an inlorfaco lo
il (nolo llal lloro aro aIso ollor roasons vly lraffic may bo rojoclod)
Receivers Check For Three Types of Link Traffic
Assuming a IinI is fuIIy oporalionaI, llo plysicaI Iayor rocoivor inlorfaco of oacl
dovico is proparod lo monilor llo IogicaI idIo condilion and dolocl llo arrivaI of
llo llroo lypos of IinI lraffic: Ordorod Sols, DIIIs, and TIIs. Using conlroI (K)
symboIs vlicl accompany llo lraffic lo dolormino framing boundarios and
lraffic lypo, ICI Ixpross dovicos llon maIo a dislinclion bolvoon lraffic vlicl
is IocaI lo llo IinI vs. lraffic vlicl may roquiro rouling lo ollor IinIs (o.g. TIIs).
IocaI IinI lraffic, vlicl incIudos Ordorod Sols and Dala IinI Iayor IacIols
(DIIIs), isnl forvardod and carrios no rouling informalion. Transaclion Iayor
IacIols (TIIs) can and do movo from IinI lo IinI, using rouling informalion
conlainod in llo pacIol loadors.
MuIti-port Devices Assume the Routing Burden
Il slouId bo apparonl in Iiguro 3-1 on pago 106 llal dovicos vill muIlipIo ICI
Ixpross porls aro rosponsibIo for landIing lloir ovn lraffic as voII as forvard-
ing ollor lraffic bolvoon ingross porls and any onabIod ogross porls. AIso nolo
llal vliIo poor-poor lransaclion supporl is roquirod of svilclos, il is oplionaI
for a muIli-porl Rool CompIox. Il is up lo llo syslom dosignor lo accounl for
poor-lo-poor lraffic vlon soIocling dovicos and Iaying oul a mollorboard.
Endpoints Have Limited Routing ResponsibiIities
Il slouId aIso bo apparonl in Iiguro 3-1 on pago 106 llal ondpoinl dovicos lavo
a singIo IinI inlorfaco and IacI llo abiIily lo roulo inbound lraffic lo ollor IinIs.
Ior llis roason, and bocauso lloy donl rosido on slarod bussos, ondpoinls
novor oxpocl lo soo ingross porl lraffic vlicl is nol inlondod for llom (llis is
difforonl llan slarod-bus ICI(X), vloro dovicos commonIy docodo addrossos
-- -

and commands nol largoling llom). Indpoinl rouling is Iimilod lo accopling or

rojocling lransaclions prosonlod lo llom.
System Routing Strategy Is Programmed
Boforo lransaclions can bo gonoralod by a roquoslor, accoplod by llo compIolor,
and forvardod by any dovicos in llo pall bolvoon llo lvo, aII dovicos musl bo
configurod lo onforco llo syslom lransaclion rouling sclomo. Rouling is basod
on lraffic lypo, syslom momory and IO addross assignmonls, olc. In Iooping
vill ICI pIug-and-pIay configuralion mollods, oacl ICI oxpross dovico is dis-
covorod, momory and IO addross rosourcos aro assignod lo llom, and svilcl/
bridgo dovicos aro programmod lo forvard lransaclions on lloir bolaIf. Onco
rouling is programmod, bus masloring and largol addross docoding aro
onabIod. Tloroaflor, dovicos aro proparod lo gonoralo, accopl, forvard, or rojocl
lransaclions as nocossary.
Two Types of LocaI Link Traffic
IocaI lraffic occurs bolvoon llo lransmil inlorfaco of ono dovico and llo rocoivo
inlorfaco of ils noiglbor for llo purposo of managing llo IinI ilsoIf. Tlis lraffic
is novor forvardod or fIov conlroIIod, vlon sonl, il musl bo accoplod. IocaI
lraffic is furllor cIassifiod as - oxclangod bolvoon llo IlysicaI Iay-
ors of lvo dovicos on a IinI or Dala IinI Iayor pacIols (DIIIs) oxclangod
bolvoon llo Dala IinI Iayors of llo lvo dovicos.
Ordered Sets
Tloso aro sonl by oacl plysicaI Iayor lransmillor lo llo plysicaI Iayor of llo cor-
rosponding rocoivor lo inilialo IinI lraining, componsalo for cIocI loIoranco, or
lransilion a IinI lo and from llo IIoclricaI IdIo slalo. As indicalod in TabIo 3-1 on
pago 109, lloro aro fivo lypos of Ordorod Sols.
Iacl ordorod sol is conslruclod of 10-bil conlroI (K) symboIs llal aro croalod
villin llo plysicaI Iayor. Tloso symboIs lavo a common namo as voII as a
aIpl-numoric codo llal dofinos llo 10 bils pallorn of 1s and 0s, of vlicl lloy aro
comprisod. Ior oxampIo, llo SKI (SIip) symboI las a 10-bil vaIuo roprosonlod
as K28.0.
-- - -

Iiguro 3-2 on pago 110 iIIuslralos llo lransmission of Ordorod Sols. Nolo llal
oacl ordorod sol is fixod in sizo, consisling of 4 or 16 claraclors. Again, llo
rocoivor is roquirod lo consumo llom as lloy aro sonl. Nolo llal llo COM con-
lroI symboI (K28.5) is usod lo indicalo llo slarl of any ordorod sol.
Rofor lo llo 8b/10b Incoding on pago 419 for a llorougl discussion of
Ordorod Sols.
-
- -
Iasl Training Soquonco (ITS) COM, 3 ITS QuicI synclronizalion of bil slroam
vlon Ioaving I0s povor slalo.
Training Soquonco Ono (TS1) COM, Iano
ID, 14 moro
Usod in IinI lraining, lo aIign and
synclronizo llo incoming bil slroam
al slarlup, convoy rosol, ollor func-
lions.
Training Soquonco Tvo (TS2) COM, Iano
ID, 14 moro
Soo TS1.
IIoclricaI IdIo (IDII) COM, 3 IDI Indicalos llal IinI slouId bo brougll
lo a Iovor povor slalo (I0s, I1, I2).
SIip COM, 3 SKI Insorlod poriodicaIIy lo componsalo
for cIocI loIorancos.
-- -

-- -
-- - -

Data Link Layer Packets (DLLPs)

Tlo ollor lypo of IocaI lraffic sonl by a dovico lransmil inlorfaco lo llo corro-
sponding rocoivor of llo dovico allaclod lo il aro Dala IinI Iayor IacIols
(DIIIs). Tloso aro aIso usod in IinI managomonl, aIllougl lloy aro sourcod al
llo dovico Dala IinI Iayor rallor llal llo IlysicaI Iayor. Tlo main funclions of
DIIIs aro lo faciIilalo IinI Iovor Managomonl, TII IIov ConlroI, and llo
acInovIodgomonl of succossfuI TII doIivory across llo IinI.
-
-
AcInovIodgo (AcI) Rocoivor Dala IinI Iayor sonds AcI lo indicalo llal no
CRC or ollor orrors lavo boon oncounlorod in rocoivod
TII(s). Transmillor rolains copy of TIIs unliI AcId
No AcInovIodgo (NaI) Rocoivor Dala IinI Iayor sonds NaI lo indicalo llal a
TII vas rocoivod vill a CRC or ollor orror. AII TIIs
romaining in llo lransmillors Rolry Buffor musl bo
rosonl, in llo originaI ordor.
IM_Inlor_I1,
IM_Inlor_I23
IoIIoving a soflvaro configuralion spaco accoss lo
causo a dovico povor managomonl ovonl, a dovnslroam
dovico roquosls onlry lo IinI I1 or IovoI 2-3 slalo
IM_Aclivo_Slalo_Roq_I1 Dovnslroam dovico aulonomousIy roquosls I1 Aclivo
Slalo
IM_Roquosl_AcI Upslroam dovico acInovIodgos lransilion lo I1 Slalo
Vondor-Spocific DIII Rosorvod for vondor-spocific purposos
InilIC1-I
InilIC1-NI
InilIC1-CpI
IIov ConlroI IniliaIizalion Typo Ono DIII avarding
poslod (I), nonposlod (NI), or compIolion (CpI) fIov
conlroI crodils.
InilIC2-I
InilIC2-NI
InilIC2-CpI
IIov ConlroI IniliaIizalion Typo Tvo DIII confirming
avard of InilIC1 poslod (I), nonposlod (NI), or com-
pIolion (CpI) fIov conlroI crodils.
UpdaloIC-I
UpdaloIC-NI
UpdaloIC-CpI
IIov ConlroI Crodil Updalo DIII avarding poslod (I),
nonposlod (NI), or compIolion (CpI) fIov conlroI crod-
ils.
-- -

- - -
- - -
- - -
- - -

- -
-- -
-- - -

Nolo llal unIiIo Ordorod Sols, DIIIs aIvays carry a 16-bil CRC vlicl is vori-
fiod by llo rocoivor boforo carrying oul llo roquirod oporalion. If an orror is
doloclod by llo rocoivor of a DIII, il is droppod. Ivon llougl DIIIs aro nol
acInovIodgod, limo-oul moclanisms buiIl inlo llo spocificalion pormil rocov-
ory from droppod DIIIs duo lo CRC orrors.
Rofor lo Dala IinI Iayor IacIols on pago 198 for a llorougl discussion of
Dala IinI Iayor pacIols.
Transaction Layer Packet Routing Basics
Tlo llird cIass of IinI lraffic originalos in llo Transaclion Iayor of ono dovico
and largols llo Transaclion Iayor of anollor dovico. Tloso Transaclion Iayor
IacIols (TIIs) aro forvardod from ono IinI lo anollor as nocossary, subjocl lo
llo rouling moclanisms and ruIos doscribod in llo foIIoving soclions. Nolo llal
ollor claplors in llis booI doscribo addilionaI aspocls of Transaclion Iayor
IacIol landIing, incIuding IIov ConlroI, QuaIily Of Sorvico, Irror HandIing,
Ordoring ruIos, olc. Tlo lorm lransaclion is usod loro lo doscribo llo oxclango
of informalion using Transaclion Iayor IacIols. Bocauso Ordorod Sols and
DIIIs carry no rouling informalion and aro nol forvardod, llo rouling ruIos
doscribod in llo foIIoving soclions appIy onIy lo TIIs.
TLPs Used to Access Four Address Spaces
As lransaclions aro carriod oul bolvoon ICI Ixpross roquoslors and compIolors,
four soparalo addross spacos aro usod: Momory, IO, Configuralion, and Mos-
sago. Tlo basic uso of oacl addross spaco is doscribod in TabIo 3-3 on pago 113.
-- -- - -
-- - - -
Momory Road,
Wrilo
Transfor dala lo or from a Iocalion in
llo syslom momory map
IO Road,
Wrilo
Transfor dala lo or from a Iocalion in
llo syslom IO map
Configuralion Road,
Wrilo
Transfor dala lo or from a Iocalion in
llo configuralion spaco of a ICI-com-
palibIo dovico.
-- -

SpIit Transaction ProtocoI Is Used

Accossos lo llo four addross spacos in ICI Ixpross aro accompIislod using
spIil-lransaclion roquosls and compIolions.
SpIit Transactions: Better Performance, More Overhead
Tlo spIil lransaclion prolocoI is an improvomonl ovor oarIior bus prolocoIs (o.g.
ICI) vlicl mado oxlonsivo uso of bus vail-slalos or doIayod lransaclions
(rolrios) lo doaI vill Ialoncios in accossing largols. In ICI Ixpross, llo compIo-
lion foIIoving a roquosl is inilialod by llo compIolor onIy vlon il las dala and/
or slalus roady for doIivory. Tlo facl llal llo compIolion is soparalod in limo
from llo roquosl vlicl causod il aIso moans llal lvo soparalo TIIs aro gonor-
alod, vill indopondonl rouling for llo roquosl TII and llo CompIolion TII.
Nolo llal vliIo a IinI is froo for ollor aclivily in llo limo bolvoon a roquosl and
ils subsoquonl compIolion, a spIil-lransaclion prolocoI invoIvos somo addilionaI
ovorload as lvo compIolo TIIs musl bo gonoralod lo carry oul a singIo lransac-
lion.
Iiguro 3-4 on pago 115 iIIuslralos llo roquosl-compIolion plasos of a ICI
Ixpross spIil lransaclion. Tlis oxampIo roprosonls an ondpoinl road from sys-
lom momory.
Mossago BasoIino,
Vondor-spocific
GonoraI in-band mossaging and ovonl
roporling (villoul consuming mom-
ory or IO addross rosourcos)
-- -- - -
-- - - -
-- - -

Write Posting: Sometimes a CompIetion Isnt Needed

To miligalo llo ponaIly of llo roquosl-compIolion Ialoncy, mossagos and somo
vrilo lransaclions in ICI Ixpross aro poslod, moaning llo vrilo roquosl (incIud-
ing dala) is sonl, and llo lransaclion is ovor from llo roquoslors porspoclivo as
soon as llo roquosl is sonl oul of llo ogross porl, rosponsibiIily for doIivory is
nov llo probIom of llo noxl dovico. In a muIli-IovoI lopoIogy, llis las llo
advanlago of boing mucl faslor llan vailing for llo onliro roquosl-compIolion
lransil, bul as in aII posling sclomos uncorlainly oxisls concorning vlon
(and if) llo lransaclion compIolod succossfuIIy al llo uIlimalo rocipionl.
-- - - -
-- -

In ICI Ixpross, vrilo posling lo momory is considorod accoplabIo in oxclango

for llo liglor porformanco. On llo ollor land, vrilos lo IO and configuralion
spaco may clango dovico bolavior, and vrilo posling is nol pormillod. A com-
pIolion viII aIvays bo sonl lo roporl slalus of llo IO or configuralion vrilo opor-
alion.
TabIo 3-4 on pago 116 Iisls ICI Ixpross poslod and non-poslod lransaclions.

-- - - --
- - -
Momory Wrilo AII Momory Wrilo roquosls aro poslod. No compIolion is
oxpoclod or sonl.
Momory Road
Momory Road IocI
AII momory road roquosls aro non-poslod. A compIolion
vill dala (CpID or CpIDIK) viII bo rolurnod by llo com-
pIolor vill roquoslod dala and lo roporl slalus of llo mom-
ory road
IO Wrilo AII IO Wrilo roquosls aro non-poslod. A compIolion villoul
dala (CpI) viII bo rolurnod by llo compIolor lo roporl slalus
of llo IO vrilo oporalion.
IO Road AII IO road roquosls aro non-poslod. A compIolion vill dala
(CpID) viII bo rolurnod by llo compIolor vill roquoslod dala
and lo roporl slalus of llo IO road oporalion.
Configuralion Wrilo
Typo 0 and Typo 1
AII Configuralion Wrilo roquosls aro non-poslod. A compIo-
lion villoul dala (CpI) viII bo rolurnod by llo compIolor lo
roporl slalus of llo configuralion spaco vrilo oporalion.
Configuralion Road
Typo 0 and Typo 1
AII configuralion road roquosls aro non-poslod. A compIo-
lion vill dala (CpID) viII bo rolurnod by llo compIolor vill
roquoslod dala and lo roporl slalus of llo road oporalion.
Mossago
Mossago Will Dala
WliIo llo rouling mollod varios, aII mossago lransaclions
aro landIod in llo samo mannor as momory vrilos in llal
lloy aro considorod poslod roquosls
-- - -

Three Methods of TLP Routing

AII of llo TII varianls, largoling any of llo four addross spacos, aro roulod
using ono of llo llroo possibIo sclomos: Addross Rouling, ID Rouling, and
ImpIicil Rouling. TabIo 3-5 on pago 117 summarizos llo ICI Ixpross TII loador
lypo varianls and llo rouling mollod usod for oacl. Iacl of lloso is doscribod
in llo foIIoving soclions.
PCI Express Routing Is CompatibIe with PCI
As indicalod in TabIo 3-5 on pago 117, momory and IO lransaclions aro roulod
llrougl llo ICI Ixpross lopoIogy using addross rouling lo roforonco syslom
momory and IO maps, vliIo configuralion cycIos uso ID rouling lo roforonco
llo compIolors (largols) IogicaI posilion villin llo ICI-compalibIo bus lopoI-
ogy (using Bus Numbor, Dovico Numbor, Iunclion Numbor in pIaco of a Iinoar
addross). Boll addross rouling and ID rouling aro compIoloIy compalibIo vill
rouling mollods usod in llo ICI and ICIX prolocoIs vlon porforming mom-
ory, IO, or configuralion lransaclions. ICI Ixpross compIolions aIso uso llo ID
rouling sclomo.
-- - -
-
Momory Road (MRd), Momory Road IocI (MRdII),
Momory Wrilo (MWr)
Addross Rouling
IO Road (IORd), IO Wrilo (IOWr) Addross Rouling
Configuralion Road Typo 0 (CfgRd0), Configuralion
Road Typo 1 (CfgRd1) Configuralion Wrilo Typo 0
(CfgWr0), Configuralion Wrilo Typo 1(CfgWr1)
ID Rouling
Mossago (Msg), Mossago Will Dala (MsgD) Addross Rouling, ID Roul-
ing, or ImpIicil rouling
CompIolion (CpI), CompIolion Will Dala (CpID) ID Rouling
-- -

PCI Express Adds ImpIicit Routing for Messages

ICI Ixpross adds llo llird rouling mollod, impIicil rouling, vlicl is an oplion
vlon sonding mossagos. In impIicil rouling, noillor addross or ID rouling infor-
malion appIios, llo pacIol is roulod basod on a codo in llo pacIol loador indi-
caling il is doslinod for dovico(s) vill Inovn, fixod Iocalions (llo Rool
CompIox, llo noxl rocoivor, olc.).
WliIo Iimilod in llo casos il can supporl, impIicil rouling simpIifios rouling of
mossagos. Nolo llal mossagos may oplionaIIy uso addross or ID rouling
insload.
--- -- ICI and ICI-
X prolocoIs supporl - momory and IO road-vrilo lransaclions,
vlicl lavo llo foIIoving foaluros:
1. Tlo lransaclion inilialor drivos oul a momory or IO slarl addross soIocl-
ing a Iocalion villin llo dosirod largol.
2. Tlo largol cIaims llo lransaclion basod on docoding and comparing llo
lransaclion slarl addross vill rangos il las boon programmod lo
rospond lo in ils configuralion spaco Baso Addross Rogislors.
3. If llo lransaclion invoIvos bursling, llon addrossos aro indoxod aflor
oacl dala lransfor.
WliIo ICI Ixpross aIso supporls Ioad and sloro lransaclions vill ils mom-
ory and IO lransaclions, il adds in-band mossagos. Tlo main roason for llis
is llal llo ICI Ixpross prolocoI sooIs lo (and doos) oIiminalo many of llo
sidoband signaIs roIalod lo inlorrupls, orror landIing, and povor manago-
monl vlicl aro found in ICI(X)-basod sysloms. IIiminalion of signaIs is
vory imporlanl in an arclilocluro vill llo scaIabiIily possibIo vill ICI
Ixpross. Il vouId nol bo officionl lo dosign a ICI Ixpross dovico vill a lvo
Iano IinI and llon saddIo il vill numorous addilionaI signaIs lo landIo
auxiIiary funclions.
Tlo ICI Ixpross prolocoI ropIacos mosl sidoband signaIs vill a varioly of
in-band pacIol lypos, somo of lloso aro convoyod as Dala IinI Iayor pacI-
ols (DIIIs) and somo as Transaclion Iayor pacIols (TIIs).
- --- Ono sido offocl of using
in-band mossagos in pIaco of lard-virod sidoband signaIs is llo probIom of
doIivoring llo mossago lo llo propor rocipionl in a lopoIogy consisling of
numorous poinl-lo-poinl IinIs. Tlo ICI Ixpross prolocoI providos maxi-
mum fIoxibiIily in rouling mossago TIIs, lloy may uso addross rouling, ID
rouling, or llo llird mollod, impIicil rouling. ImpIicil rouling laIos advan-
lago of llo facl llal, duo lo lloir arclilocluro, svilclos and ollor muIli-porl
-- - -

dovicos lavo a fundamonlaI sonso of upslroam and dovnslroam, and vloro

llo Rool CompIox is lo bo found. Bocauso of llis, a mossago loador can bo
roulod impIicilIy vill a simpIo codo indicaling llal il is inlondod for llo
Rool CompIox, a broadcasl dovnslroam mossago, slouId lorminalo al llo
noxl rocoivor, olc.
Tlo advanlago of impIicil rouling is llal il oIiminalos llo nood lo assign a
sol of momory mappod addrossos for aII of llo possibIo mossago varianls
and program aII of llo dovicos lo uso llom.
Header FieIds Define Packet Format and Routing
As dopiclod in Iiguro 3-5 on pago 119, oacl Transaclion Iayor IacIol conlains a
llroo or four doubIo vord (12 or 16 bylo) loador. IncIudod in llo 3DW or 4DW
loador aro lvo fioIds, and (Iml), vlicl dofino llo formal of llo
romaindor of llo loador and llo rouling mollod lo bo usod on llo onliro TII as
il movos bolvoon dovicos in llo ICI Ixpross lopoIogy.
- -
-- -

Using TLP Header Information: Overview

GeneraI
As TIIs arrivo al an ingross porl, lloy aro firsl clocIod for orrors al boll llo
plysicaI and dala IinI Iayors of llo rocoivor. Assuming lloro aro no orrors, TII
rouling is porformod, basic slops incIudo:
1. Tlo TII loador and fioIds in llo firsl DWord aro oxaminod lo
dolormino llo sizo and formal of llo romaindor of llo pacIol.
2. Doponding on llo rouling mollod associalod vill llo pacIol, llo dovico
viII dolormino if il is llo inlondod rocipionl, if so, il viII accopl (consumo)
llo TII. If il is nol llo rocipionl, and il is a muIli-porl dovico, il viII forvard
llo TII lo llo approprialo ogross porl--subjocl lo llo ruIos for ordoring and
fIov conlroI for llal ogross porl.
3. If il is noillor llo inlondod rocipionl nor a dovico in llo pall lo il, il viII gon-
oraIIy rojocl llo pacIol as an Unsupporlod Roquosl (UR).
Header Type/Format FieId Encodings
TabIo 3-6 on pago 120 boIov summarizos llo oncodings usod in TII loador
Typo and Iormal fioIds. Tloso lvo fioIds, usod logollor, indicalo TII formal
and rouling lo llo rocoivor.
-

Momory Road Roquosl (MRd) 00 = 3DW, no dala
01 = 4DW, no dala
0 0000
Momory Road IocI Roquosl (MRdII) 00 = 3DW, no dala
01 = 4DW, no dala
0 0001
Momory Wrilo Roquosl (MWr) 10 = 3DW, v/ dala
11 = 4DW, v/ dala
0 0000
IO Road Roquosl (IORd) 00 = 3DW, no dala 00010
IO Wrilo Roquosl (IOWr) 10 = 3DW, v/ dala 0 0010
-- - -

AppIying Routing Mechanisms

Onco configuralion of llo syslom rouling slralogy is compIolo and lransaclions
aro onabIod, ICI Ixpross dovicos docodo inbound TII loadors and uso corro-
sponding fioIds in configuralion spaco Baso Addross Rogislors, Baso/Iimil rog-
islors, and Bus Numbor rogislors lo appIy addross, ID, and impIicil rouling lo
llo pacIol. Nolo llal lloro aro acluaIIy lvo IovoIs of docision: llo dovico firsl
dolorminos if llo pacIol largols an inlornaI Iocalion, if nol, and llo dovico is a
svilcl, il viII ovaIualo llo pacIol lo soo if il slouId bo forvardod oul of an
ogross porl. A llird possibiIily is llal llo pacIol las boon rocoivod in orror or is
maIformod, in llis caso, il viII bo landIod as a rocoivo orror. Tloro aro a numbor
of casos vlon llis may lappon, and a numbor of vays il may bo landIod. Rofor
lo ICI Ixpross Irror ClocIing Moclanisms on pago 356 for a doscriplion of
orror clocIing and landIing. Tlo foIIoving soclions doscribo llo basic foaluros
of oacl rouling moclanism, vo viII assumo no orrors aro oncounlorod.
Config Typo 0 Road Roquosl (CfgRd0) 00 = 3DW, no dala 0 0100
Config Typo 0 Wrilo Roquosl (CfgWr0) 10 = 3DW, v/ dala 0 0100
Config Typo 1 Road Roquosl (CfgRd1) 00 = 3DW, no dala 0 0101
Config Typo 1 Wrilo Roquosl (CfgWr1) 10 = 3DW, v/ dala 0 0101
Mossago Roquosl (Msg) 01 = 4DW, no dala 1 0 RRR (for RRR,
soo rouling subfioId)
Mossago Roquosl W/Dala (MsgD) 11 = 4DW, v/ dala 1 0 RRR (for RRR,
soo rouling subfioId)
CompIolion (CpI) 00 = 3DW, no dala 0 1010
CompIolion W/Dala (CpID) 10 = 3DW, v/ dala 0 1010
CompIolion-IocIod (CpIII) 00 = 3DW, no dala 0 1011
CompIolion W/Dala (CpIDII) 10 = 3DW, v/ dala 0 1011
-

-- -

Address Routing
ICI Ixpross lransaclions using addross rouling roforonco llo samo syslom
momory and IO maps llal ICI and ICIX lransaclions do. Addross rouling is
usod lo lransfor dala lo or from momory, momory mappod IO, or IO Iocalions.
Momory lransaclion roquosls may carry oillor 32 bil addrossos using llo 3DW
TII loador formal, or 64 bil addrossos using llo 4DW TII loador formal. IO
lransaclion roquosls aro roslriclod lo 32 bils of addross using llo 3DW TII
loador formal, and slouId onIy largol Iogacy dovicos.
Memory and IO Address Maps
Iiguro 3-6 on pago 122 dopicls gonoric syslom momory and IO maps. Nolo llal
llo sizo of llo syslom momory map is a funclion of llo rango of addrossos llal
dovicos aro capabIo of gonoraling (oflon diclalod by llo CIU addross bus). As in
ICI and ICI-X, ICI Ixpross pormils oillor 32 bil or 64 bil momory addrossing.
Tlo sizo of llo syslom IO map is Iimilod lo 32 bils (4GB), aIllougl in many sys-
loms onIy llo Iovor 16 bils (64KB) aro usod.
- -- -
-- - -

Key TLP Header FieIds in Address Routing

If llo Typo fioId in a rocoivod TII indicalos addross rouling is lo bo usod, llon
llo Addross IioIds in llo loador aro usod lo porforming llo rouling clocI.
Tloro aro lvo casos: 32-bil addrossos and 64-bil addrossos.
- -- Ior IO or a 32-bil momory roquosls,
onIy 32 bils of addross aro conlainod in llo loador. Dovicos largolod vill
lloso TIIs viII rosido boIov llo 4GB momory or IO addross boundary. Iig-
uro 3-7 on pago 123 dopicls llis caso.
-- -
-- -

- -- Ior 64-bil momory roquosls, 64 bils of

addross aro conlainod in llo loador. Dovicos largolod vill lloso TIIs viII
rosido abovo llo 4GB momory boundary. Iiguro 3-8 on pago 124 slovs llis
caso.
-- -
-- - -

An Endpoint Checks an Address-Routed TLP

If llo Typo fioId in a rocoivod TII indicalos addross rouling is lo bo usod, llon
an ondpoinl dovico simpIy clocIs llo addross in llo pacIol loador againsl oacl
of ils impIomonlod BARs in ils Typo 0 configuralion spaco loador. As il las onIy
ono IinI inlorfaco, il viII oillor cIaim llo pacIol or rojocl il. Iiguro 3-9 on pago
125 iIIuslralos llis caso.
A Switch Receives an Address Routed TLP: Two Checks
If llo Typo fioId in a rocoivod TII indicalos addross rouling is lo
bo usod, llon a svilcl firsl clocIs lo soo if il is llo inlondod compIolor. Il
comparos llo loador addross againsl largol addrossos programmod in ils
lvo BARs. If llo addross faIIs villin llo rango, il consumos llo pacIol. Tlis
- - --
-- -

caso is indicalod by (1) in Iiguro 3-10 on pago 126. If llo loador addross
fioId doos nol malcl a rango programmod in a BAR, il llon clocIs llo Typo
1 configuralion spaco loador for oacl dovnslroam IinI. Il clocIs llo non-
profolclabIo momory (MMIO) and profolclabIo Baso/Iimil rogislors if llo
lransaclion largols momory, or llo I/O Baso and Iiml rogislors if llo lrans-
aclion largols I/O addross spaco. Tlis clocI is indicalod by (2) in Iiguro 3-
10 on pago 126.
- - --
-- - -

- -- Tlo foIIoving nolos

aIso appIy lo svilcl addross rouling:
1. If llo addross-roulod pacIol addross faIIs in llo rango of ono of ils soc-
ondary bridgo inlorfaco Baso/Iimil rogislor sols, il viII forvard llo
pacIol dovnslroam.
2. If llo addross-roulod pacIol vas moving dovnslroam (vas rocoivod on
llo primary inlorfaco) and il doos nol map lo any BAR or dovnslroam
IinI Baso/Iimil rogislors, il viII bo landIod as an unsupporlod roquosl
on llo primary IinI.
3. Upslroam addross-roulod pacIols aro aIvays forvardod lo llo
upslroam IinI if lloy do nol largol an inlornaI Iocalion or anollor
dovnslroam IinI.
ID Routing
ID rouling is basod on llo IogicaI posilion (Bus Numbor, Dovico Numbor, Iunc-
lion Numbor) of a dovico funclion villin llo ICI bus lopoIogy. ID rouling is
compalibIo vill rouling mollods usod in llo ICI and ICIX prolocoIs vlon
porforming Typo 0 or Typo 1 configuralion lransaclions. In ICI Ixpross, il is
aIso usod for rouling compIolions and may bo usod in mossago rouling as voII.
ID Bus Number, Device Number, Function Number Limits
ICI Ixpross supporls llo samo basic lopoIogy Iimils as ICI and ICI-X:
1. A maximum of 256 bussos/IinIs in a syslom. Tlis incIudos bussos croalod
by bridgos lo ollor ICI-compalibIo prolocoIs sucl as ICI, ICI-X, AGI, olc.
2. A maximum of 32 dovicos por bus/IinI. Of courso, WliIo a ICI(X) bus or
llo inlornaI bus of a svilcl may losl moro llan ono dovnslroam bridgo
inlorfaco, oxlornaI ICI Ixpross IinIs aro aIvays poinl-lo-poinl vill onIy
lvo dovicos por IinI. Tlo dovnslroam dovico on an oxlornaI IinI is dovico 0.
- A maximum of 8 inlornaI funclions por dovico.
A significanl difforonco in ICI Ixpross ovor ICI is llo provision for oxlonding
llo amounl of configuralion spaco por funclion from 256 bylos lo 4KB. Rofor lo
llo Configuralion Ovorviov on pago 711 for a dolaiIod doscriplion of llo
compalibIo and oxlondod aroas of ICI Ixpross configuralion spaco.
-- -

Key TLP Header FieIds in ID Routing

If llo Typo fioId in a rocoivod TII indicalos ID rouling is lo bo usod, llon llo ID
fioIds in llo loador aro usod lo porform llo rouling clocI. Tloro aro lvo casos:
ID rouling vill a 3DW loador and ID rouling vill a 4DW loador.
Iiguro 3-11 on pago 128 iIIuslralos a TII using ID
rouling and llo 3DW loador.
-
-- - -

Iiguro 3-12 on pago 129 iIIuslralos a TII using ID

rouling and llo 4DW loador.
-
-- -

An Endpoint Checks an ID-Routed TLP

If llo Typo fioId in a rocoivod TII indicalos ID rouling is lo bo usod, llon an
ondpoinl dovico simpIy clocIs llo ID fioId in llo pacIol loador againsl ils ovn
Bus Numbor, Dovico Numbor, and Iunclion Numbor(s). In ICI Ixpross, oacl
dovico capluros (and romombors) ils ovn Bus Numbor and Dovico Numbor
conlainod in TII loador bylos 8-9 oacl limo a configuralion vrilo (Typo 0) is
doloclod on ils primary IinI. Al rosol, aII bus and dovico numbors in llo syslom
rovorl lo 0, so a dovico viII nol rospond lo lransaclions ollor llan configuralion
cycIos unliI al Ioasl ono configuralion vrilo cycIo (Typo 0) las boon porformod.
Nolo llal llo ICI Ixpross prolocoI doos nol dofino a configuralion spaco Ioca-
lion vloro llo dovico funclion is roquirod lo sloro llo caplurod Bus Numbor
and Dovico Numbor informalion, onIy llal il musl do il.
Onco again, as il las onIy ono IinI inlorfaco, an ondpoinl viII oillor cIaim an ID-
roulod pacIol or rojocl il. Iiguro 3-11 on pago 128 iIIuslralos llis caso.
A Switch Receives an ID-Routed TLP: Two Checks
If llo Typo fioId in a rocoivod TII indicalos ID rouling is lo bo usod, llon a
svilcl firsl clocIs lo soo if il is llo inlondod compIolor. Il comparos llo loador
ID fioId againsl ils ovn Bus Numbor, Dovico Numbor, and Iunclion Numbor(s).
Tlis is indicalod by (1) in Iiguro 3-13 on pago 131. As in llo caso of an ondpoinl,
a svilcl capluros ils ovn Bus Numbor and Dovico numbor oacl limo a configu-
ralion vrilo (Typo 0) is doloclod on is primary IinI inlorfaco. If llo loador ID
agroos vill llo ID of llo svilcl, il consumos llo pacIol. If llo ID fioId doos nol
malcl is ovn, il llon clocIs llo Socondary-Subordinalo Bus Numbor rogislors
in llo configuralion spaco for oacl dovnslroam IinI. Tlis clocI is indicalod by
(2) in Iiguro 3-13 on pago 131.
Other Notes About Switch ID Routing
1. If llo ID-roulod pacIol malclos llo rango of ono of ils socondary bridgo
inlorfaco Socondary-Subordinalo rogislors, il viII forvard llo pacIol dovn-
slroam.
2. If llo ID-roulod pacIol vas moving dovnslroam (vas rocoivod on llo pri-
mary inlorfaco) and il doos nol map lo any dovnslroam inlorfaco, il viII bo
landIod as an unsupporlod roquosl on llo primary IinI.
3. Upslroam ID-roulod pacIols aro aIvays forvardod lo llo upslroam IinI if
lloy do nol largol an inlornaI Iocalion or anollor dovnslroam IinI.
-- - -

ImpIicit Routing
ImpIicil rouling is basod on llo inlrinsic InovIodgo ICI Ixpross dovicos aro
roquirod lo lavo concorning upslroam and dovnslroam lraffic and llo oxislonco
of a singIo ICI Ixpross Rool CompIox al llo lop of llo ICI Ixpross lopoIogy.
Tlis avaronoss aIIovs Iimilod rouling of pacIols villoul llo nood lo assign and
incIudo addrossos vill corlain mossago pacIols. Bocauso llo Rool CompIox
gonoraIIy impIomonls povor managomonl and inlorrupl conlroIIors, as voII as
syslom orror landIing, il is oillor llo sourco or rocipionl of mosl ICI Ixpross
mossagos.
- -
-- -

OnIy Messages May Use ImpIicit Routing

Will llo oIiminalion of many sidoband signaIs in llo ICI Ixpross prolocoI,
aIlornalo mollods aro roquirod lo inform llo losl syslom vlon dovicos nood
sorvico vill rospocl lo inlorrupls, orrors, povor managomonl, olc. ICI Ixpross
addrossos llis by dofining a numbor of spociaI TIIs vlicl may bo usod as vir-
luaI viros in convoying sidoband ovonls. Mossago groups curronlIy dofinod
incIudo:
- Iovor Managomonl
- INTx Iogacy inlorrupl signaIing
- Irror signaIing
- IocIod Transaclion supporl
- Hol IIug signaIing
- Vondor-spocific mossagos
- SIol Iovor Iimil mossagos
Messages May AIso Use Address or ID Routing
In sysloms vloro aII or somo of llis ovonl lraffic slouId largol llo syslom mom-
ory map or a IogicaI Iocalion in llo ICI bus lopoIogy, addross rouling and ID
rouling may bo usod in pIaco of impIicil rouling. If addross or ID rouling is clo-
son for a mossago, llon llo rouling moclanisms jusl doscribod aro appIiod in
llo samo vay as lloy vouId for ollor poslod vrilo pacIols.
Routing Sub-FieId in Header Indicates Routing Method
As a mossago TII movos bolvoon ICI Ixpross dovicos, pacIol loador fioIds
indicalo boll llal il is a mossago, and vlollor il slouId bo roulod using
addross, ID, or impIicilIy.
Key TLP Header FieIds in ImpIicit Routing
If llo Typo fioId in a rocoivod mossago TII indicalos impIicil rouling is lo bo
usod, llon llo rouling sub-fioId in llo loador is aIso usod lo dolormino llo mos-
sago doslinalion vlon llo rouling clocI is porformod. Iiguro 3-14 on pago 133
iIIuslralos a mossago TII using impIicil rouling.
-- - -

Message Type FieId Summary

TabIo 3-7 on pago 134 summarizos llo uso of llo TII loador Typo fioId vlon a
mossago is boing sonl. As slovn, llo uppor lvo bils of llo 5 bil Typo fioId indi-
calo llo pacIol is a mossago, and llo Iovor llroo bils aro llo rouling sub-fioId
vlicl spocify llo rouling mollod lo appIy. Nolo llal llo 4DW loador is aIvays
usod vill mossago TIIs, rogardIoss of llo rouling oplion soIoclod.
-- -
-- -

An Endpoint Checks a TLP Routed ImpIicitIy

If llo Typo fioId in a rocoivod mossago TII indicalos impIicil rouling is lo bo
usod, llon an ondpoinl dovico simpIy clocIs llal llo rouling sub-fioId is appro-
prialo for il. Ior oxampIo, an ondpoinl may accopl a broadcasl mossago or a
mossago vlicl lorminalos al llo rocoivor, il vonl accopl mossagos vlicl
impIicilIy largol llo Rool CompIox.
A Switch Receives a TLP Routed ImpIicitIy
If llo Typo fioId in a rocoivod mossago TII indicalos impIicil rouling is lo bo
usod, llon a svilcl dovico simpIy considors llo ingross porl il arrivod on and
vlollor llo rouling sub-fioId codo is approprialo for il. Somo oxampIos:
1. Tlo upslroam IinI inlorfaco of a svilcl may IogilimaloIy rocoivo a broadcasl
mossago roulod impIicilIy from llo Rool CompIox. If il doos, il viII forvard
il inlacl onlo aII dovnslroam IinIs. Il slouId nol soo an impIicilIy roulod
broadcasl mossago arrivo on a dovnslroam ingross porl, and viII landIo
llis as a maIformod TII.
2. Tlo svilcl may accopl mossagos indicaling impIicil rouling lo llo rool
compIox on socondary IinIs, il viII forvard aII of lloso upslroam bocauso il
Inovs llo Iocalion of llo Rool CompIox is on ils primary sido. Il vouId
nol accopl mossagos roulod impIicilIy lo llo Rool CompIox if lloy arrivod
on llo primary IinI rocoivo inlorfaco.
-- - -
- -
Bil 4:3 Dofinos llo lypo of lransaclion:
10b = Mossago Transaclion
Bil 2:0 Mossago Rouling SubfioId R|2:0], usod lo soIocl mossago rouling:
- 000b = Roulo lo Rool CompIox
- 001b = Uso Addross Rouling
- 010b = Uso ID Rouling
- 011b = Roulo as a Broadcasl Mossago from Rool CompIox
- 100b = IocaI mossago, lorminalo al rocoivor (INTx mossagos)
- 101b = Gallor & roulo lo Rool CompIox (IMI_TO_AcI mos-
sago)
-- - -

3. If llo impIicilIy-roulod mossago arrivos on oillor upslroam or dovnslroam

ingross porls, llo svilcl may consumo llo pacIol if rouling indicalos il
slouId lorminalo al rocoivor.
4. If mossagos aro roulod using addross or ID mollods, a svilcl viII simpIy
porform normaI addross clocIs in dociding vlollor lo accopl or forvard il.
PIug-And-PIay Configuration of Routing Options
- -- -
--
- -- - -
Routing Configuration Is PCI-CompatibIe
ICI Ixpross supporls llo basic 256 bylo ICI configuralion spaco common lo aII
compalibIo dovicos, incIuding llo Typo 0 and Typo 1 ICI configuralion spaco
loador formals usod by non-bridgo and svilcl/bridgo dovicos, rospoclivoIy.
Dovicos may impIomonl basic ICI-oquivaIonl funclionaIily vill no clango lo
drivors or Oporaling Syslom soflvaro.
Two Configuration Space Header Formats: Type 0, Type 1
ICI Ixpross ondpoinl dovicos supporl a singIo ICI Ixpross IinI and uso llo
Typo 0 (non-bridgo) formal loador. Svilcl/bridgo dovicos supporl muIlipIo
IinIs, and impIomonl a Typo 1 formal loador for oacl IinI inlorfaco. Iiguro 3-15
on pago 136 iIIuslralos a ICI Ixpross lopoIogy and llo uso of configuralion
spaco Typo 0 and Typo 1 loador formals.
Routing Registers Are Located in Configuration Header
As vill ICI, rogislors associalod vill lransaclion rouling aro Iocalod in llo firsl
64 bylos (16 DW) of configuralion spaco (roforrod lo in ICI Ixpross as llo ICI
2.3 compalibIo loador aroa). Tlo llroo sols of rogislors of principaI inlorosl aro:
1. - -- -- - found in Typo 0 and Typo 1 loadors.
2. Tlroo sols of - - pairs supporlod in llo Typo 1 loador of
svilcl/bridgo dovicos.
3. Tlroo - --, aIso found in Typo 1 loadors of bridgo/dovicos.
Iiguro 3-16 on pago 137 iIIuslralos llo Typo 0 and Typo 1 ICI Ixpross Configu-
ralion Spaco loador formals. Koy rouling rogislors aro indicalod.
-- -

Base Address Registers (BARs): Type 0, 1 Headers

GeneraI
Tlo firsl of llo configuralion spaco rogislors roIalod lo rouling aro llo Baso
Addross Rogislors (BARs) Tloso aro marIod <1 in Iiguro 3-16 on pago 137,
and aro impIomonlod by aII dovicos vlicl roquiro syslom momory, IO, or mom-
ory mappod IO (MMIO) addrossos aIIocalod lo llom as largols. Tlo Iocalion
and uso of BARs is compalibIo vill ICI and ICI-X. As slovn in Iiguro 3-16 on
pago 137, a Typo 0 configuralion spaco loador las 6 BARs avaiIabIo for llo
dovico dosignor (al DW 4-9), vliIo a Typo 1 loador las onIy lvo BARs (al DW
4-5).
Aflor discovoring dovico rosourco roquiromonls, syslom soflvaro programs
oacl BAR vill slarl addross for a rango of addrossos llo dovico may rospond lo
as a compIolor (largol). Sol up of BARs invoIvos sovoraI llings:
1. Tlo dovico dosignor usos a BAR lo lard-codo a roquosl for an aIIocalion of
ono bIocI of profolclabIo or non-profolclabIo momory, or of IO addrossos in
llo syslom momory or IO map. A pair of adjaconl BARs aro concalonalod if
a 64-bil momory roquosl is boing mado.
-- - -
-- - -

2. Hard-codod bils in llo BAR incIudo an indicalion of llo roquosl lypo, llo
sizo of llo roquosl, and vlollor llo largol dovico may bo considorod
profolclabIo (momory roquosls onIy).
-- -
Reserved
BIST
-- -

During onumoralion, aII ICI-compalibIo dovicos aro discovorod and llo BARs
aro oxaminod by syslom soflvaro lo docodo llo roquosl. Onco llo syslom mom-
ory and IO maps aro oslabIislod, soflvaro programs uppor bils in impIomonlod
BARs vill llo slarl addross for llo bIocI aIIocalod lo llo largol.
BAR Setup ExampIe One: 1MB, PrefetchabIe Memory Request
Iiguro 3-17 dopicls llo basic slops in solling up a BAR vlicl is boing usod lo
lracI a 1 MB bIocI of profolclabIo addrossos for a dovico rosiding in llo syslom
momory map. In llo diagram, llo BAR is slovn al llroo poinls in llo configu-
ralion procoss:
1. Tlo uniniliaIizod BAR in Iiguro 3-17 is as il IooIs aflor povor-up or a rosol.
WliIo llo dosignor las liod Iovor bils lo indicalo llo roquosl lypo and sizo,
lloro is no roquiromonl aboul lov llo uppor bils (vlicl aro road-vrilo)
musl como up in a BAR, so lloso bils aro indicalod vill XXXXX. Syslom
soflvaro viII firsl vrilo aII 1s lo llo BAR lo sol aII road-vrilo bils = 1. Of
courso, llo lard-codod Iovor bils aro nol affoclod by llo configuralion
vrilo.
2. Tlo socond viov of llo BAR slovn in Iiguro 3-17 is as il IooIs aflor config-
uralion soflvaro las porformod llo vrilo of aII 1s lo il. Tlo noxl slop in
configuralion is a road of llo BAR lo clocI llo roquosl. TabIo 3-8 on
pago 140 summarizos llo rosuIls of llis configuralion road.
3. Tlo llird viov of llo BAR slovn in Iiguro 3-17 on pago 139 is as il IooIs
aflor configuralion soflvaro las porformod anollor configuralion vrilo
(Typo 0) lo program llo slarl addross for llo bIocI. In llis oxampIo, llo
dovico slarl addross is 2GB, so bil 31 is vrillon = 1 (2
31
= 2GB) and aII ollor
uppor bils aro vrillon = 0s.
Al llis poinl llo configuralion of llo BAR is compIolo. Onco soflvaro onabIos
momory addross docoding in llo ICI command rogislor, llo dovico viII cIaim
momory lransaclions in llo rango 2GB lo 2GB+1MB.
-- - -

-- -

BAR Setup ExampIe Two: 64-Bit, 64MB Memory Request

Iiguro 3-18 on pago 141 dopicls llo basic slops in solling up a pair of BARs
boing usod lo lracI a 64 MB bIocI of profolclabIo addrossos for a dovico rosid-
ing in llo syslom momory map. In llo diagram, llo BARs aro slovn al llroo
poinls in llo configuralion procoss:
1. Tlo uniniliaIizod BARs aro as lloy IooI aflor povor-up or a rosol. Tlo
dosignor las lard-codod Iovor bils of llo Iovor BAR lo indicalo llo roquosl
lypo and sizo, llo uppor BAR bils aro aII road-vrilo. Syslom soflvaro viII
firsl vrilo aII 1s lo boll BARs lo sol aII road-vrilo bils = 1. Of courso, llo
lard-codod bils in llo Iovor BAR aro unaffoclod by llo configuralion vrilo.
2. Tlo socond viov of llo BARs in Iiguro 3-18 on pago 141 slovs llom as lloy
IooI aflor configuralion soflvaro las porformod llo vrilo of aII 1s lo boll.
Tlo noxl slop in configuralion is a road of llo BARs lo clocI llo roquosl.
TabIo 3-9 on pago 142 summarizos llo rosuIls of llis configuralion road.
3. Tlo llird viov of llo BAR pair Iiguro 3-18 on pago 141 indicalos condilions
aflor configuralion soflvaro las porformod lvo configuralion vrilos (Typo
0) lo program llo lvo laIvos of llo 64 bil slarl addross for llo bIocI. In llis
oxampIo, llo dovico slarl addross is 16GB, so bil 1 of llo Uppor BAR
(addross bil 33 in llo BAR pair) is vrillon = 1 (2
33
= 16GB), aII ollor road-
vrilo bils in boll BARs aro vrillon = 0s.
-- -
-
0 Road bacI as a 0, indicaling a momory roquosl
2:1 Road bacI as 00b indicaling llo largol onIy supporls a 32 bil addross
docodor
3 Road bacI as a 1, indicaling roquosl is for profolclabIo momory
19:4 AII road bacI as 0, usod lo loIp indicalo llo sizo of llo roquosl (aIso
soo bil 20)
31:20 AII road bacI as 1 bocauso soflvaro las nol yol programmod llo
uppor bils vill a slarl addross for llo bIocI. Nolo llal bocauso bil 20
vas llo firsl bil (abovo bil 3) lo road bacI as vrillon (=1), llis indicalos
llo momory roquosl sizo is 1MB (2
20
= 1MB).
-- - -

Al llis poinl llo configuralion of llo BAR pair is compIolo. Onco soflvaro
onabIos momory addross docoding in llo ICI command rogislor, llo dovico viII
cIaim momory lransaclions in llo rango 16GB lo 16GB+64MB.

-- -

BAR Setup ExampIe Three: 256-Byte IO Request

Iiguro 3-19 on pago 143 dopicls llo basic slops in solling up a BAR vlicl is
boing usod lo lracI a 256 bylo bIocI of IO addrossos for a Iogacy ICI Ixpross
dovico rosiding in llo syslom IO map. In llo diagram, llo BAR is slovn al llroo
poinls in llo configuralion procoss:
1. Tlo uniniliaIizod BAR in Iiguro 3-19 is as il IooIs aflor povor-up or a rosol.
Syslom soflvaro firsl vrilos aII 1s lo llo BAR lo sol aII road-vrilo bils = 1.
Of courso, llo lard-codod bils aro unaffoclod by llo configuralion vrilo.
2. Tlo socond viov of llo BAR slovn in Iiguro 3-19 on pago 143 is as il IooIs
aflor configuralion soflvaro las porformod llo vrilo of aII 1s lo il. Tlo noxl
slop in configuralion is a road of llo BAR lo clocI llo roquosl. TabIo 3-10 on
pago 144 summarizos llo rosuIls of llis configuralion road.
3. Tlo llird viov of llo BAR slovn Iiguro 3-19 on pago 143 is as il IooIs aflor
configuralion soflvaro las porformod anollor configuralion vrilo (Typo 0)
lo program llo slarl addross for llo IO bIocI. In llis oxampIo, llo dovico
slarl addross is 16KB, so bil 14 is vrillon = 1 (2
14
= 16KB), aII ollor uppor
bils aro vrillon = 0s.
-- -

Iovor 0 Road bacI as a 0, indicaling a momory roquosl

Iovor 2:1 Road bacI as 10 b indicaling llo largol supporls a 64 bil addross
docodor, and llal llo firsl BAR is concalonalod vill llo noxl
Iovor 3 Road bacI as a 1, indicaling roquosl is for profolclabIo mom-
ory
Iovor 25:4 AII road bacI as 0, usod lo loIp indicalo llo sizo of llo
roquosl (aIso soo bil 26)
Iovor 31:26 AII road bacI as 1 bocauso soflvaro las nol yol programmod
llo uppor bils vill a slarl addross for llo bIocI. Nolo llal
bocauso bil 26 vas llo firsl bil (abovo bil 3) lo road bacI as vril-
lon (=1), llis indicalos llo momory roquosl sizo is 64MB (2
26
=
64MB).
Uppor 31:0 AII road bacI as 1. Tloso bils viII bo usod as llo uppor 32 bils
of llo 64-bil slarl addross programmod by syslom soflvaro.
-- - -

Al llis poinl llo configuralion of llo IO BAR is compIolo. Onco soflvaro

onabIos IO addross docoding in llo ICI command rogislor, llo dovico viII cIaim
IO lransaclions in llo rango 16KB lo 16KB+256.

-- -

Base/Limit Registers, Type 1 Header OnIy

GeneraI
Tlo socond sol of configuralion rogislors roIalod lo rouling aro aIso found in
Typo 1 configuralion loadors and usod vlon forvarding addross-roulod TIIs.
MarIod <2 in Iiguro 3-16 on pago 137, lloso aro llo llroo sols of Baso/Iimil
rogislors programmod in oacl bridgo inlorfaco lo onabIo a svilcl/bridgo lo
cIaim and forvard addross-roulod TIIs lo a socondary bus. Tlroo sols of Baso/
Iimil Rogislors aro noodod bocauso lransaclions aro landIod difforonlIy (o.g.
profolcling, vrilo-posling, olc.) in llo profolclabIo momory, non-profolclabIo
momory (MMIO), and IO addross domains. Tlo Baso Rogislor in oacl pair
oslabIislos llo slarl addross for llo communily of dovnslroam dovicos and llo
Iimil Rogislor dofinos llo uppor addross for llal group of dovicos. Tlo llroo
sols of Baso/Iimil Rogislors incIudo:
- IrofolclabIo Momory Baso and Iimil Rogislors
- Non-IrofolclabIo Momory Baso and Iimil Rogislor
- I/O Baso and Iimil Rogislors
PrefetchabIe Memory Base/Limit Registers
Tlo IrofolclabIo Momory Baso/Iimil rogislors aro Iocalod al DW 9 and
IrofolclabIo Momory Baso/Iimil Uppor rogislors al DW 10-11 villin llo
loador 1. Tloso rogislors lracI aII dovnslroam profolclabIo momory dovicos.
Iillor 32 bil or 64 bil addrossing can bo supporlod by lloso rogislors. If llo
-- -
-
0 Road bacI as a 1, indicaling an IO roquosl
1 Rosorvod. Tiod Iov and road bacI as 0.
7:2 AII road bacI as 0, usod lo loIp indicalo llo sizo of llo roquosl (aIso
soo bil 8)
31:8 AII road bacI as 1 bocauso soflvaro las nol yol programmod llo
uppor bils vill a slarl addross for llo bIocI. Nolo llal bocauso bil 8 vas
llo firsl bil (abovo bil 1) lo road bacI as vrillon (=1), llis indicalos llo IO
roquosl sizo is 256 bylos (2
8
= 256).
-- - -

Uppor Rogislors aro nol impIomonlod, onIy 32 bils of momory addrossing is

avaiIabIo, and llo TII loadors mapping lo llis spaco viII bo llo 3DW formal. If
llo Uppor rogislors and syslom soflvaro maps llo dovico abovo llo 4GB bound-
ary, TIIs accossing llo dovico viII carry llo 4DW loador formal. In llo oxam-
pIo slovn in Iiguro 3-20 on pago 145, a 6GB profolclabIo addross rango is boing
sol up for llo socondary IinI of a svilcl.
Rogislor programming in llo oxampIo slovn in Iiguro 3-20 on pago 145 is sum-
marizod in TabIo 3-11.
- -
-- -

Non-PrefetchabIe Memory Base/Limit Registers

Non-IrofolclabIo Momory Baso/Iimil (al DW 8). Tloso rogislors aro usod lo
lracI aII dovnslroam non-profolclabIo momory (momory mappod IO) dovicos.
Non-profolclabIo momory dovicos aro Iimilod lo 32 bil addrossing, TIIs largol-
ing llom aIvays uso llo 3DW loador formal.
Rogislor programming in llo oxampIo slovn in Iiguro 3-21 on pago 147 is sum-
marizod in TabIo 3-12.
- -
- -
IrofolclabIo Momory Baso 8001l Uppor 3 nibbIos (800l) aro usod lo pro-
vido mosl significanl 3 digils of llo 32-
bil Baso Addross for IrofolclabIo Mom-
ory bolind llis svilcl. Tlo Iovor 5 dig-
ils of llo addross aro assumod lo bo
00000l. Tlo Ioasl significanl nibbIo of
llis rogislor vaIuo (1l) indicalos llal a
64 bil addross docodor is supporlod and
llal llo Uppor Baso/Iimil Rogislors aro
aIso usod.
IrofolclabIo Momory Iimil III1l Uppor 3 nibbIos (IIIl) aro usod lo pro-
vido mosl significanl 3 digils of llo 32-
bil Iimil Addross for IrofolclabIo Mom-
ory bolind llis svilcl. Tlo Iovor 5 dig-
ils of llo addross aro assumod lo bo
IIIIIl. Tlo Ioasl significanl nibbIo of
llis rogislor vaIuo (1l) indicalos llal a
64 bil addross docodor is supporlod and
llal llo Uppor Baso/Iimil Rogislors aro
aIso usod.
IrofolclabIo Momory Baso
Uppor 32 Bils
00000001l Uppor 32 bils of llo 64-bil Baso addross
for IrofolclabIo Momory bolind llis
svilcl.
IrofolclabIo Momory Iimil
Uppor 32 Bils
00000002l Uppor 32 bils of llo 64-bil Iimil addross
for IrofolclabIo Momory bolind llis
svilcl.
-- - -

- -
-- -

IO Base/Limit Registers
IO Baso/Iimil (al DW 7) and IO Baso/Iimil Uppor rogislors (al DW 12). Tloso
rogislors aro usod lo lracI aII dovnslroam IO largol dovicos. If llo Uppor Rogis-
lors aro usod, llon IO addross spaco may bo oxlondod lo a fuII 32 bils (4GB). If
lloy aro nol impIomonlod, llon IO addross spaco is Iimilod lo 16 bils (64KB). In
oillor caso, TIIs largoling lloso IO dovicos aIvays carry llo 3DW loador for-
mal.
Rogislor programming in llo oxampIo slovn in Iiguro 3-22 on pago 149 is sum-
marizod in TabIo 3-13 on pago 150.
- -
- -
Momory Baso
(Non-IrofolclabIo)
1210l Uppor 3 nibbIos (121l) aro usod lo pro-
vido mosl significanl 3 digils of llo 32-
bil Baso Addross for Non-IrofolclabIo
Momory bolind llis svilcl. Tlo Iovor 5
digils of llo addross aro assumod lo bo
00000l.
Tlo Ioasl significanl nibbIo of llis rogis-
lor vaIuo (0l) is rosorvod and slouId bo
sol = 0.
Momory Iimil
(Non-IrofolclabIo)
1220l Uppor 3 nibbIos (122l) aro usod lo pro-
vido mosl significanl 3 digils of llo 32-
bil Iimil Addross for IrofolclabIo Mom-
ory bolind llis svilcl. Tlo Iovor 5 dig-
ils of llo addross aro assumod lo bo
IIIIIl. Tlo Ioasl significanl nibbIo of
llis rogislor vaIuo (0l) is rosorvod and
slouId bo sol = 0.
-- - -

- -
-- -

Bus Number Registers, Type 1 Header OnIy

Tlo llird sol of configuralion rogislors roIalod lo rouling aro usod vlon for-
varding ID-roulod TIIs, incIuding configuralion cycIos and compIolions and
oplionaIIy mossagos. Tloso aro marIod <3 in Iiguro 3-16 on pago 137. As in
ICI, a svilcl/bridgo inlorfaco roquiros llroo rogislors: Irimary Bus Numbor,
Socondary Bus Numbor, and Subordinalo bus numbor. Tlo funclion of lloso
rogislors is summarizod loro.
- -
- -
IO Baso 21l Uppor nibbIo (2l) spocifios llo mosl sig-
nificanl lox digil of llo 32 bil IO Baso
addross (llo Iovor digils aro 000l)
Tlo Iovor nibbIo (1l) indicalos llal llo
dovico supporls 32 bil IO bolind llo
bridgo inlorfaco. Tlis aIso moans llo
dovico impIomonls llo Uppor IO Baso/
Iimil rogislor sol, and lloso rogislors
viII bo concalonalod vill Baso/Iimil.
IO Iimil 41l Uppor nibbIo (4l) spocifios llo mosl sig-
nificanl lox digil of llo 32 bil IO Iimil
addross (llo Iovor digils aro IIIl).
Tlo Iovor nibbIo (1l) indicalos llal llo
dovico supporls 32 bil IO bolind llo
bridgo inlorfaco. Tlis aIso moans llo
dovico impIomonls llo Uppor IO Baso/
Iimil rogislor sol, and lloso rogislors
viII bo concalonalod vill Baso/Iimil.
IO Baso Uppor 16 Bils 0000l Uppor 16 bils of llo 32-bil Baso addross
for IO bolind llis svilcl.
IO Iimil Uppor 16 Bils 0000l Uppor 16 bils of llo 32-bil Iimil addross
for IO bolind llis svilcl.
-- - -

Primary Bus Number

Tlo Irimary Bus Numbor rogislor conlains llo bus (IinI) numbor lo vlicl llo
upslroam sido of a bridgo (svilcl) is connoclod. In ICI Ixpross, llo primary bus
is llo ono in llo diroclion of llo Rool CompIox and losl procossor.
Secondary Bus Number
Tlo Socondary Bus Numbor rogislor conlains llo bus (IinI) numbor lo vlicl
llo dovnslroam sido of a bridgo (svilcl) is connoclod.
Subordinate Bus Number
Tlo Subordinalo Bus Numbor rogislor conlains llo liglosl bus (IinI) numbor
on llo dovnslroam sido of a bridgo (svilcl). Tlo Subordinalo and Socondary
Bus Numbor rogislors viII conlain llo samo vaIuo unIoss lloro is anollor bridgo
(svilcl) on llo socondary sido.
A Switch Is a Two-LeveI Bridge Structure
Bocauso ICI doos nol nalivoIy supporl bridgos vill muIlipIo dovnslroam
porls, ICI Ixpross svilcl dovicos appoar IogicaIIy as lvo-IovoI ICI bridgo
slrucluros, consisling of a singIo bridgo lo llo primary IinI and an inlornaI ICI
bus vlicl losls ono or moro virluaI bridgos lo socondary inlorfacos. Iacl
bridgo inlorfaco las an indopondonl Typo 1 formal configuralion loador vill
ils ovn sols of Baso/Iimil Rogislors and Bus Numbor Rogislors. Iiguro 3-23 on
pago 152 iIIuslralos llo bus numboring associalod vill llo oxlornaI IinIs and
inlornaI bus of a svilcl. Nolo llal llo socondary bus on llo primary IinI inlor-
faco is llo inlornaI virluaI bus, and llal llo primary inlorfaco of aII dovnslroam
IinI inlorfacos connocl lo llo inlornaI bus IogicaIIy.
-- -

- --

-
--
The Previous Chapter
Tlo provious claplor doscribod llo gonoraI concopls of ICI Ixpross lransaclion
rouling and llo moclanisms usod by a dovico in dociding vlollor lo accopl,
forvard, or rojocl a pacIol arriving al an ingross porl. Bocauso Dala IinI Iayor
IacIols (DIIIs) and IlysicaI Iayor - IinI lraffic aro novor forvardod,
llo omplasis loro is on Transaclion Iayor IacIol (TII) lypos and llo llroo
rouling mollods associalod vill llom: addross rouling, ID rouling, and
impIicil rouling. IncIudod is a summary of configuralion mollods usod in ICI
Ixpross lo sol up ICI-compalibIo pIug-and-pIay addrossing villin syslom IO
and momory maps, as voII as Ioy oIomonls in llo ICI Ixpross pacIol prolocoI
usod in maIing rouling docisions.
This Chapter
Informalion movos bolvoon ICI Ixpross dovicos in pacIols, and llo lvo major
cIassos of pacIols aro - - (TIIs), and
- (DIIIs). Tlo uso, formal, and dofinilion of aII TII and DIII pacIol lypos
and lloir roIalod fioIds aro dolaiIod in llis claplor.
The Next Chapter
Tlo noxl claplor discussos llo AcI/NaI IrolocoI llal vorifios llo doIivory of
TIIs bolvoon oacl porl as lloy lravoI bolvoon llo roquoslor and compIolor
dovicos. Tlis claplor dolaiIs llo lardvaro rolry moclanism llal is aulomali-
caIIy lriggorod vlon a TII lransmission orror is doloclod on a givon IinI.
-- -

Introduction to the Packet-Based ProtocoI

Tlo ICI Ixpross prolocoI improvos upon mollods usod by oarIior bussos (o.g.
ICI) lo oxclango dala and lo signaI syslom ovonls. In addilion lo supporling
basic momory, IO, and configuralion road/vrilo lransaclions, llo IinIs oIimi-
nalo many sidoband signaIs and ropIacos llom vill in-band mossagos.
Will llo oxcoplion of llo IogicaI idIo indicalion and plysicaI Iayor -,
aII informalion movos across an aclivo ICI Ixpross IinI in fundamonlaI clunIs
caIIod pacIols vlicl aro comprisod of 10 bil conlroI (K) and dala (D) symboIs.
Tlo lvo major cIassos of pacIols oxclangod bolvoon lvo ICI Ixpross dovicos
aro ligl IovoI - - (TIIs), and Iov-IovoI IinI mainlonanco
pacIols caIIod - (DIIIs). CoIIoclivoIy, llo various TIIs
and DIIIs aIIov lvo dovicos lo porform momory, IO, and Configuralion Spaco
lransaclions roIiabIy and uso mossagos lo inilialo povor managomonl ovonls,
gonoralo inlorrupls, roporl orrors, olc. Iiguro 4-1 on pago 155 dopicls TIIs and
DIIIs on a ICI Ixpross IinI.
Why Use A Packet-Based Transaction ProtocoI
Tloro aro somo dislincl advanlagos in using a pacIol-basod prolocoI, ospociaIIy
vlon il comos lo dala inlogrily. Tlroo imporlanl aspocls of ICI Ixpross pacIol
prolocoI loIp promolo dala inlogrily during IinI lransmission:
Packet Formats Are WeII Defined
Somo oarIy bus prolocoIs (o.g. ICI) aIIov lransfors of indolorminalo (and unIim-
ilod) sizo, maIing idonlificalion of payIoad boundarios impossibIo unliI llo ond
of llo lransfor. In addilion, an oarIy lransaclion ond migll bo signaIod by oillor
agonl (o.g. largol disconnocl on a vrilo or pro-omplion of llo inilialor during a
road), rosuIling in a parliaI lransfor. In lloso casos, il is difficuIl for llo sondor of
dala lo caIcuIalo and sond a clocIsum or CRC covoring an onliro payIoad, vlon
il may lorminalo unoxpoclodIy. Insload, ICI usos a simpIo parily sclomo vlicl
is appIiod and clocIod for oacl bus plaso compIolod.
In conlrasl, oacl ICI Ixpross pacIol las a Inovn sizo and formal, and llo
pacIol --posilionod al llo boginning of oacl DIII and TII pacIol-- indi-
calos llo pacIol lypo and prosonco of any oplionaI fioIds. Tlo sizo of oacl
pacIol fioId is oillor fixod or dofinod by llo pacIol lypo. Tlo sizo of any dala
payIoad is convoyod in llo TII loador fioId. Onco a lransfor commoncos,
lloro aro no oarIy lransaclion lorminalions by llo rocipionl. Tlis slruclurod
- --

pacIol formal maIos il possibIo lo insorl addilionaI informalion inlo llo pacIol
inlo proscribod Iocalions, incIuding framing symboIs, CRC, and a pacIol
soquonco numbor (TIIs onIy).
-
-- -

Framing SymboIs Indicate Packet Boundaries

Iacl TII and DIII pacIol sonl is framod vill a Slarl and Ind conlroI symboI,
cIoarIy dofining llo pacIol boundarios lo llo rocoivor. Nolo llal llo Slarl and
Ind conlroI (K) symboIs appondod lo pacIols by llo lransmilling dovico aro 10
bils oacl. Tlis is a big improvomonl ovor ICI and ICI-X vlicl uso llo assorlion
and do-assorlion of a singIo IRAMI# signaI lo indicalo llo boginning and ond
of a lransaclion. A gIilcl on llo IRAMI# signaI (or any of llo ollor ICI/ICIX
conlroI signaIs) couId causo a largol lo misconslruo bus ovonls. In conlrasl, a
ICI Ixpross rocoivor musl proporIy docodo a compIolo 10 bil symboI boforo
concIuding IinI aclivily is boginning or onding. Unoxpoclod or unrocognizod
conlroI symboIs aro landIod as orrors.
CRC Protects Entire Packet
UnIiIo llo sido-band parily signaIs usod by ICI dovicos during llo addross and
oacl dala plaso of a lransaclion, llo in-band 16-bil or 32-bil ICI Ixpross CRC
vaIuo prolocls llo onliro pacIol (ollor llan framing symboIs). In addilion lo
CRC, TII pacIols aIso lavo a pacIol - appondod lo llom by llo
lransmillor so llal if an orror is doloclod al llo rocoivor, llo spocific pacIol(s)
vlicl voro rocoivod in orror may bo rosonl. Tlo lransmillor mainlains a copy of
oacl TII sonl in a unliI il is clocIod and acInovIodgod by llo
rocoivor. Tlis TII acInovIodgomonl moclanism (somolimos roforrod lo as llo
prolocoI) forms llo basis of IinI-IovoI TII orror corroclion and is vory
imporlanl in doop lopoIogios vloro dovicos may bo many IinIs avay from llo
losl in llo ovonl an orror occurs and CIU inlorvonlion vouId ollorviso bo
noodod.
Transaction Layer Packets
In ICI Ixpross lorminoIogy, ligl-IovoI lransaclions originalo al llo dovico coro
of llo lransmilling dovico and lorminalo al llo coro of llo rocoiving dovico. Tlo
Transaclion Iayor is llo slarling poinl in llo assombIy of oulbound Transaclion
Iayor IacIols (TIIs), and llo ond poinl for disassombIy of inbound TIIs al llo
rocoivor. AIong llo vay, llo Dala IinI Iayor and IlysicaI Iayor of oacl dovico
conlribulo lo llo pacIol assombIy and disassombIy as doscribod boIov.
- --

TLPs Are AssembIed And DisassembIed

Iiguro 4-2 on pago 158 dopicls llo gonoraI fIov of TII assombIy al llo lransmil
sido of a IinI and disassombIy al llo rocoivor. Tlo Ioy slagos in Transaclion
Iayor IacIol prolocoI aro Iislod boIov. Tlo numbors corrospond lo lloso in Iig-
uro 4-2.
1. Dovico Bs coro passos a roquosl for sorvico lo llo ICI Ixpross lardvaro
inlorfaco. Hov llis dono is nol covorod by llo ICI Ixpross Spocificalion,
and is dovico-spocific. GonoraI informalion conlainod in llo roquosl vouId
incIudo:
Tlo ICI Ixpross command lo bo porformod
Slarl addross or ID of largol (if addross rouling or ID rouling aro usod)
Transaclion lypo (momory road or vrilo, configuralion cycIo, olc.)
Dala payIoad sizo (and llo dala lo sond, if any)
VirluaI ClannoI/Traffic cIass informalion
Allribulos of llo lransfor: No Snoop bil sol`, RoIaxod Ordoring sol`, olc.
2. Tlo Transaclion Iayor buiIds llo TII loador, dala payIoad, and digosl
basod on llo roquosl from llo coro. Boforo sonding a TII lo llo Dala IinI
Iayor, fIov conlroI crodils and ordoring ruIos musl bo appIiod.
3. Wlon llo TII is rocoivod al llo Dala IinI Iayor, a Soquonco Numbor is
assignod and a IinI CRC is caIcuIalod for llo TII (incIudos Soquonco
Numbor). Tlo TII is llon passod on lo llo IlysicaI Iayor.
4. Al llo IlysicaI Iayor, bylo slriping, scrambIing, oncoding, and soriaIizalion
aro porformod. STI and IND conlroI (K) claraclors aro appondod lo llo
pacIol. Tlo pacIol is sonl oul on llo lransmil sido of llo IinI.
5. Al llo IlysicaI Iayor rocoivor of Dovico A, do-soriaIizalion, framing symboI
clocI, docoding, and bylo un-slriping aro porformod. Nolo llal al llo Ilys-
icaI Iayor, llo firsl IovoI or orror clocIing is porformod (on llo conlroI
codos).
6. Tlo Dala IinI Iayor of llo rocoivor caIcuIalos CRC and clocIs il againsl llo
rocoivod vaIuo. Il aIso clocIs llo Soquonco Numbor of llo TII for vioIa-
lions. If lloro aro no orrors, il passos llo TII up lo llo Transaclion Iayor of
llo rocoivor. Tlo informalion is docodod and passod lo llo coro of Dovico A.
Tlo Dala IinI Iayor of llo rocoivor viII aIso nolify llo lransmillor of llo
succoss or faiIuro in procossing llo TII by sonding an AcI or NaI DIII lo
llo lransmillor. In llo ovonl of a NaI (No AcInovIodgo), llo lransmillor
viII ro-sond aII TIIs in ils Rolry Buffor.
-- -

-- -----
- --

Device Core Requests Access to Four Spaces

Transaclions aro carriod oul bolvoon ICI Ixpross roquoslors and compIolors,
using four soparalo addross spacos: Momory, IO, Configuralion, and Mossago.
(Soo TabIo 4-1.)
-- -- - -
-- - - -
Momory Road,
Wrilo
Transfor dala lo or from a Iocalion in
llo syslom momory map. Tlo prolo-
coI aIso supporls a road
lransaclion.
IO Road,
Wrilo
Transfor dala lo or from a Iocalion in
llo syslom IO map. ICI Ixpross IO
addross assignmonl lo Iogacy dovicos.
IO addrossing is nol pormillod for
Nalivo ICI Ixpross dovicos.
Configuralion Road,
Wrilo
Transfor dala lo or from a Iocalion in
llo configuralion spaco of a ICI
Ixpross dovico. As in ICI, configura-
lion is usod lo discovor dovico capa-
biIilios, program pIug-and-pIay
foaluros, and clocI slalus using llo
4KB ICI Ixpross configuralion spaco.
Mossago BasoIino,
Vondor-spocific
Irovidos in-band mossaging and
ovonl roporling (villoul consuming
momory or IO addross rosourcos).
Tloso aro landIod llo samo as poslod
vrilo lransaclions.
-- -

TLP Transaction Variants Defined

In accossing llo four addross spacos, ICI Ixpross Transaclion Iayor IacIols
(TIIs) carry a loador fioId, caIIod llo fioId, vlicl oncodos llo spocific
command varianl lo bo usod. TabIo 4-2 on pago 160 summarizos llo aIIovod
lransaclions:
- -

Momory Road Roquosl (MRd)
Momory Road IocI Roquosl (MRdII)
Momory Wrilo Roquosl (MWr)
IO Road Roquosl (IORd)
IO Wrilo Roquosl (IOWr)
Config Typo 0 Road Roquosl (CfgRd0)
Config Typo 0 Wrilo Roquosl (CfgWr0)
Config Typo 1 Road Roquosl (CfgRd1)
Config Typo 1 Wrilo Roquosl (CfgWr1)
Mossago Roquosl (Msg)
Mossago Roquosl W/Dala (MsgD)
CompIolion (CpI)
CompIolion W/Dala (CpID)
CompIolion-IocIod (CpIII)
CompIolion W/Dala (CpIDII)
- --

TLP Structure
Tlo basic usago of oacl compononl of a Transaclion Iayor IacIol is dofinod in
TabIo 4-3 on pago 161.
Generic TLP Header Format
Iiguro 4-3 on pago 162 iIIuslralos llo formal and conlonls of a gonoric TII 3DW
loador. In llis soclion, fioIds common lo noarIy aII lransaclions aro summa-
rizod. In Ialor soclions, loador formal difforoncos associalod vill llo spocific
lransaclion lypos aro covorod.
- -

-
Hoador Transaclion
Iayor
3DW or 4DW (12 or 16 bylos) in sizo. Iormal varios
vill lypo, bul Hoador dofinos lransaclion paramo-
lors:
- Transaclion lypo
- Inlondod rocipionl addross, ID, olc.
- Transfor sizo (if any), Bylo InabIos
- Ordoring allribulo
- Caclo coloroncy allribulo
- Traffic CIass
Dala Transaclion
Iayor
OplionaI fioId. 0-1024 DW IayIoad, vlicl may bo
furllor quaIifiod vill Bylo InabIos lo gol bylo
addross and bylo lransfor sizo rosoIulion.
Digosl Transaclion
Iayor
OplionaI fioId. If prosonl, aIvays 1 DW in sizo. Usod
for ond-lo-ond CRC (ICRC) and dala poisoning.
-- -

Generic Header FieId Summary

TabIo 4-4 on pago 163 summarizos llo sizo and uso of oacl of llo gonoric TII
loador fioIds. Nolo llal fioIds marIod R in Iiguro 4-3 on pago 162 aro
rosorvod and slouId bo sol = 0.
-
- --

-
Iongll |9:0] Bylo 3 Bil 7:0
Bylo 2 Bil 1:0
TII dala payIoad lransfor sizo, in DW. Maximum
lransfor sizo is 10 bils, 2
10
= 1024 DW (4KB). Incod-
ing:
00 0000 0001b = 1DW
00 0000 0010b = 2DW
.
.
11 1111 1111b = 1023 DW
00 0000 0000b = 1024 DW
Allr
(Allribulos)
Bylo 2 Bil 5:4 Bil 5 = RoIaxod ordoring.
Wlon sol = 1, ICI-X roIaxod ordoring is onabIod for
llis TII. If sol = 0, llon slricl ICI ordoring is usod.
Bil 4 = No Snoop.
Wlon sol = 1, roquoslor is indicaling llal no losl
caclo coloroncy issuos oxisl vill rospocl lo llis TII.
Syslom lardvaro is nol roquirod lo causo procossor
caclo snoop for coloroncy. Wlon sol = 0, ICI -lypo
caclo snoop proloclion is roquirod.
II
(Ioisonod
Dala)
Bylo 2 Bil 6 If sol = 1, llo dala accompanying llis dala slouId bo
considorod invaIid aIllougl llo lransaclion is boing
aIIovod lo compIolo normaIIy.
TD
(TII Digosl
IioId
Irosonl)
Bylo 2 Bil 7 If sol = 1, llo oplionaI 1 DW TII Digosl fioId is
incIudod vill llis TII llal conlains an ICRC vaIuo.
Somo ruIos:
Irosonco of llo Digosl fioId musl bo clocIod by aII
rocoivors (using llis bil).
- A TII vill TD = 1, bul no Digosl fioId is landIod
as a MaIformod TII.
- If a dovico supporls clocIing ICRC and TD=1, il
musl porform llo ICRC clocI.
- If a dovico doos nol supporl clocIing ICRC
(oplionaI) al llo uIlimalo doslinalion, llo dovico
musl ignoro llo digosl.
-- -

--
- - - --
- --

--

--
- -- -
-- ---
-

- - - -
- - -
- - -
- -
-

- - -






-
-
-
- -
- -
- - -
- - -
- - -
- - -
- -

-
- --

Header Type/Format FieId Encodings

-- - -
-
-
-
- -
- -
- - -
- - -
- - -
- - -
- -
-

-


-


-


-
-
-
-
-
-

-
-- -

The Digest and ECRC FieId

Tlo digosl fioId and Ind-lo-Ind CRC (ICRC) is oplionaI as is a dovicos abiIily
lo gonoralo and clocI ICRC. If supporlod and onabIod by soflvaro, dovicos
musl caIcuIalo and appIy ICRC for aII TIIs llal llo dovico originalos. AIso,
dovicos llal supporl ICRC clocIing musl aIso supporl Advancod Irror Roporl-
ing.
Tlis booI doos nol dolaiI llo aIgo-
rillm and procoss of caIcuIaling ICRC, bul is dofinod villin llo spocificalion.
ICRC covors aII fioIds llal do nol clango as llo TII is forvardod across llo
fabric. Tlo ICRC incIudos aII invarianl fioIds of llo TII loador and llo dala
payIoad, if prosonl. AII varianl fioIds aro sol lo 1 for caIcuIaling llo ICRC,
incIudo:
- - llis bil clangos vlon llo lransaclion
lypo is aIlorod for a pacIol. Ior oxampIo, a configuralion lransaclion boing
forvardod lo a romolo IinI (across ono or moro svilclos) bogins as a lypo 1
configuralion lransaclion. Wlon llo lransaclion roaclos llo doslinalion
IinI, il is convorlod lo a lypo 0 configuralion lransaclion by clanging bil 0
of llo lypo fioId.
- Irror/Ioisonod (II) bil llis bil can bo sol as a TII lravorsos llo fabric in
llo ovonl llal llo dala fioId associalod vill llo pacIol las boon corruplod.
Tlis is aIso roforrod lo as orror forvarding.
Mossago Roquosl (Msg) 01 = 4DW, no dala 1 0 rrr (for rrr, soo
rouling subfioId)
Mossago Roquosl W/Dala (MsgD) 11 = 4DW, v/ dala 1 0rrr (for rrr, soo
rouling subfioId)
CompIolion (CpI) 00 = 3DW, no dala 0 1010
CompIolion W/Dala (CpID) 10 = 3DW, v/ dala 0 1010
CompIolion-IocIod (CpIII) 00 = 3DW, no dala 0 1011
CompIolion W/Dala (CpIDII) 10 = 3DW, v/ dala 0 1011
-

- --

Tlo ICRC clocI is inlondod for llo dovico llal is

llo uIlimalo rocoipionl of llo TII. IinI CRC clocIing vorifios llal a TII
lravorsos a givon IinI boforo boing forvardod lo llo noxl IinI, bul ICRC is
inlondod lo vorify llal llo pacIol sond las nol boon aIlorod in ils journoy
bolvoon llo Roquoslor and CompIolor. Svilclos in llo pall musl mainlain llo
inlogrily of llo TD bil bocauso corruplion of TD viII causo an orror al llo uIli-
malo largol dovico.
Tlo spocificalion maIos lvo slalomonls rogarding a Svilcls roIo in ICRC
clocIing:
- A svilcl llal supporls ICRC clocIing porforms llis clocI on TIIs dos-
linod lo a Iocalion villin llo Svilcl ilsoIf. On aII ollor TIIs a Svilcl musl
prosorvo llo ICRC (forvard il unlouclod) as an inlograI parl of llo TII.
- Nolo llal a Svilcl may porform ICRC clocIing on TIIs passing llrougl
llo Svilcl. ICRC Irrors doloclod by llo Svilcl aro roporlod in llo samo
vay any ollor dovico vouId roporl llom, bul do nol aIlor llo TIIs passago
llrougl llo Svilcl.
Tloso slalomonls may appoar lo conlradicl oacl ollor. Hovovor, llo firsl slalo-
monl doos nol oxpIicilIy slalo llal an ICRC clocI cannol bo mado in llo procoss
of forvarding llo TII unlouclod. Tlo socond slalomonl cIarifios llal il is possi-
bIo for svilclos, as voII as llo uIlimalo largol dovico, lo clocI and roporl ICRC.
Using Byte EnabIes
As in llo ICI prolocoI, ICI Ixpross roquiros a moclanism for roconciIing ils
DW addrossing and dala lransfors vill llo nood, al limos, for bylo rosoIulion in
lransfor sizos and lransaclion slarl/ond addrossos. To acliovo bylo rosoIulion,
ICI Ixpross maIos uso of llo lvo Bylo InabIo fioIds inlroducod oarIior in Iig-
uro 4-3 on pago 162 and in TabIo 4-4 on pago 163.
Tlo Iirsl DW Bylo InabIo fioId and llo Iasl DW Bylo InabIo fioIds aIIov llo
roquoslor lo quaIify llo bylos of inlorosl villin llo firsl and Iasl doubIo vords
lransforrod, llis las llo offocl of aIIoving smaIIor lransfors llan a fuII doubIo
vord and offsolling llo slarl and ond addrossos from DW boundarios.
-
1. Bylo onabIo bils aro ligl lruo. A vaIuo of 0 indicalos llo corrosponding
bylo in llo dala payIoad slouId nol bo vrillon by llo compIolor. A vaIuo of
1, indicalos il slouId.
2. If llo vaIid dala lransforrod is aII villin a singIo aIignod doubIo vord, llo
-- -

Iasl DW Bylo onabIo fioId musl bo = 0000b.

3. If llo loador Iongll fioId indicalos a lransfor is moro llan 1DW, llo Iirsl
DW Bylo InabIo musl lavo al Ioasl ono bil onabIod.
4. If llo Iongll fioId indicalos a lransfor of 3DW or moro, llon noillor llo Iirsl
DW Bylo InabIo fioId or llo Iasl DW Bylo InabIo fioId may lavo disconlin-
uous bylo onabIo bils sol. In lloso casos, llo Bylo InabIo fioIds aro onIy
boing usod lo offsol llo offoclivo slarl addross of a bursl lransaclion.
5. Disconlinuous bylo onabIo bil pallorns in llo Iirsl DW Bylo onabIo fioId aro
aIIovod if llo lransfor is 1DW.
6. Disconlinuous bylo onabIo bil pallorns in boll llo Iirsl and Socond DW
Bylo onabIo fioIds aro aIIovod onIy if llo lransfor is Quadvord aIignod
(2DWs).
7. A vrilo roquosl vill a lransfor Iongll of 1DW and no bylo onabIos sol is
IogaI, bul las no offocl on llo compIolor.
8. If a road roquosl of 1 DW is dono vill no bylo onabIo bils sol, llo compIolor
rolurns a 1DW dala payIoad of undofinod dala. Tlis may bo usod as a IIusl
moclanism. Bocauso of ordoring ruIos, a fIusl may bo usod lo forco aII pro-
viousIy poslod vrilos lo momory boforo llo compIolion is rolurnod.
An oxampIo of bylo onabIo uso in llis caso is iIIuslralod in Iiguro 4-4 on pago
168. Nolo llal llo lransfor Iongll musl oxlond from llo firsl DW vill any vaIid
bylo onabIod lo llo Iasl DW vill any vaIid bylos onabIod. Bocauso llo lransfor
is moro llan 2DW, llo bylo onabIos may onIy bo usod lo spocify llo slarl
addross Iocalion (2d) and ond addross Iocalion (34d) of llo lransfor.
- - - -
- --

Transaction Descriptor FieIds

As lransaclions movo bolvoon roquoslor and compIolor, il is imporlanl lo
uniquoIy idonlify a lransaclion, sinco many spIil lransaclions may bo ponding al
any inslanl. To llis ond, llo spocificalion dofinos sovoraI imporlanl loador
fioIds llal vlon usod logollor form a uniquo Transaclion Doscriplor as iIIus-
lralod in Iiguro 4-5.
WliIo llo Transaclion Doscriplor fioIds aro nol in adjaconl loador Iocalions, coI-
IoclivoIy lloy doscribo Ioy lransaclion allribulos, incIuding:
- Tlis is comprisod of llo Bus, Dovico, and Iunclion Numbor
of llo TII roquoslor AND llo Tag fioId of llo TII.
-- Traffic CIass (TC 0 -7) is insorlod in llo TII by llo roquoslor,
and lravoIs unmodifiod llrougl llo lopoIogy lo llo compIolor. Al ovory IinI,
Traffic CIass is mappod lo ono of llo avaiIabIo virluaI clannoIs.
- - Tloso consisl of llo RoIaxod Ordoring and No
Snoop bils. Tloso aro aIso sol by llo roquoslor and lravoI vill llo pacIol lo llo
compIolor.
- - -
-- -

AdditionaI RuIes For TLPs With Data PayIoads

Tlo foIIoving ruIos appIy vlon a TII incIudos a dala payIoad.
1. Tlo Iongll fioId rofors lo dala payIoad onIy, llo Digosl fioId (if prosonl) is
nol incIudod in llo Iongll.
2. Tlo firsl bylo of dala in llo payIoad (immodialoIy aflor llo loador) is
aIvays associalod vill llo Iovosl (slarl) addross.
3. Tlo Iongll fioId aIvays roprosonls an inlograI numbor of doubIovords
(DW) lransforrod. IarliaI doubIovords aro quaIifiod using Iirsl and Iasl
Bylo InabIo fioIds.
4. Tlo ICI Ixpross spocificalion slalos llal vlon muIlipIo lransaclions aro
rolurnod by a compIolor in rosponso lo a singIo momory roquosl, llal oacl
inlormodialo lransaclion musl ond on naluraIIy-aIignod 64 and 128 bylo
addross boundarios for a rool compIox (llis is lormod llo Road CompIolion
Boundary, or RCB). AII ollor dovicos musl broaI sucl lransaclions al nalu-
raIIy-aIignod 128 bylo boundarios. Tlis bolavior promolos syslom porfor-
manco roIalod lo caclo Iinos.
5. Tlo Iongll fioId is rosorvod vlon sonding mossago TIIs using llo lransac-
lion - Tlo Iongll fioId is vaIid vlon sonding llo mossago vill dala
varianl -.
6. ICI Ixpross supporls Ioad luning of IinIs. Tlis moans llal llo dala payIoad
of a TII musl nol oxcood llo curronl vaIuo in llo Max_IayIoad_Sizo fioId
of llo Dovico ConlroI Rogislor. OnIy vrilo lransaclions lavo dala payIoads,
so llis roslriclion doos nol appIy lo roads. A rocoivor is roquirod lo clocI for
vioIalions of llo Max_IayIoad_Sizo Iimil during vrilos, vioIalions aro lan-
dIod as MaIformod TIIs.
7. Rocoivors aIso musl clocI for discropancios bolvoon llo vaIuo in llo
Iongll fioId and llo acluaI amounl of dala lransforrod in a TII vill dala.
VioIalions aro aIso landIod as MaIformod TIIs.
8. Roquosls musl nol mix combinalions of slarl addross and lransfor Iongll
vlicl viII causo a momory spaco accoss lo cross a 4KB boundary. WliIo
clocIing is oplionaI in llis caso, rocoivors clocIing for vioIalions of llis
ruIo viII roporl il as a MaIformod TII.
- --

BuiIding Transactions: TLP Requests & CompIetions

In llis soclion, llo formal of 3DW and 4DW loadors usod lo accompIisl spocific
lransaclion lypos aro doscribod. Many of llo gonoric fioIds doscribod proviousIy
appIy, bul an omplasis is pIacod on llo fioIds vlicl aro landIod difforonlIy
bolvoon lransaclion lypos.
IO Requests
WliIo llo ICI Ixpross spocificalion discouragos llo uso of IO lransaclions, an
aIIovanco is mado for Iogacy dovicos and soflvaro vlicl may roIy on a compal-
ibIo dovico rosiding in llo syslom IO map rallor llan llo momory map. WliIo
llo IO lransaclions can loclnicaIIy accoss a 32-bil IO rango, in roaIily many sys-
loms (and CIUs) roslricl IO accoss lo llo Iovor 16 bils (64KB) of llis rango. Iig-
uro 4-6 on pago 171 dopicls llo syslom IO map and llo 16/32 bil addross
boundarios. ICI Ixpross non-Iogacy dovicos aro momory-mappod, and nol por-
millod lo maIo roquosls for IO addross aIIocalion in lloir configuralion Baso
Addross Rogislors.
-
-- -

- Iiguro 4-7 on pago 172 dopicls llo formal of

llo 3DW IO roquosl loador. Iacl fioId in llo loador is doscribod in llo soclion
llal foIIovs.
-
- --

- - - TabIo 4-6 on pago 173

doscribos llo Iocalion and uso of oacl fioId in an IO roquosl loador.
- -

Iongll 9:0 Bylo 3 Bil 7:0
Bylo 2 Bil 1:0
Indicalos dala payIoad sizo in DW.
Ior IO roquosls, llis fioId is aIvays =
1. Bylo InabIos aro usod lo quaIify
bylos villin DW.
Allr 1:0 (Allribulos) Bylo 2 Bil 5:4 Allribulo 1: RoIaxod Ordoring Bil
Allribulo 0: No Snoop Bil
Boll of lloso bils aro aIvays = 0 in IO
roquosls.
II Bylo 2 Bil 6 If = 1, indicalos llo dala payIoad (if
prosonl) is poisonod.
TD Bylo 2 Bil 7 If = 1, indicalos llo prosonco of a
digosl fioId (1 DW) al llo ond of llo
TII (procoding ICRC and IND)
TC 2:0 (Transfor CIass) Bylo 2 Bil 6:4 Indicalos lransfor cIass for llo pacIol.
TC is = 0 for aII IO roquosls.
Typo 4:0 Bylo 0 Bil 4:0 TII pacIol lypo fioId. AIvays sol lo
00010b for IO roquosls
Iml 1:0 (Iormal) Bylo 0 Bil 6:5 IacIol Iormal. IO roquosls aro:
00b = IO Road (3DW villoul dala)
10b = IO Wrilo (3DW vill dala)
1sl DW BI 3:0
(Iirsl DW Bylo InabIos)
Bylo 7 Bil 3:0 Tloso ligl lruo bils map ono-lo-ono
lo quaIify bylos villin llo DW pay-
Ioad. Ior IO roquosls, any bil combi-
nalion is vaIid (incIuding nono)
Iasl BI 3:0
(Iasl DW Bylo InabIos)
Bylo 7 Bil 7:4 Tloso ligl lruo bils map ono-lo-ono
lo quaIify bylos villin llo Iasl DW
lransforrod. Ior IO roquosls, lloso bils
musl bo 0000b. (SingIo DW)
-- -

Memory Requests
ICI Ixpross momory lransaclions incIudo lvo cIassos: Road Roquosl/CompIo-
lion and Wrilo Roquosl. Iiguro 4-8 on pago 175 dopicls llo syslom momory map
and llo 3DW and 4DW momory roquosl pacIol formals. Wlon roquosl momory
dala lransfor il is imporlanl lo romombor llal momory lransaclions aro novor
pormillod lo cross 4KB boundarios.
Tag 7:0 Bylo 6 Bil 7:0 Tloso bils aro usod lo idonlify oacl
oulslanding roquosl issuod by llo
roquoslor. As non-poslod roquosls aro
sonl, llo noxl soquonliaI lag is
assignod.
DofauIl: onIy bils 4:0 aro usod (32 oul-
slanding lransaclions al a limo)
If Ixlondod Tag bil in ICI Ixpross
ConlroI Rogislor is sol = 1, llon aII 8
bils may bo usod (256 lags).
Roquoslor ID 15:0 Bylo 5 Bil 7:0
Bylo 4 Bil 7:0
Idonlifios llo roquoslor so a compIo-
lion may bo rolurnod, olc.
Bylo 4, 7:0 = Bus Numbor
Bylo 5, 7:3 = Dovico Numbor
Bylo 5, 2:0 = Iunclion Numbor
Addross 31:2 Bylo 8 Bil 7:2
Bylo 7 Bil 7:0
Bylo 6 Bil 7:0
Bylo 5 Bil 7:0
Tlo uppor 30 bils of llo 32-bil slarl
addross for llo IO lransfor. Nolo llal
llo Iovor lvo bils of llo 32 bil
addross aro rosorvod (00b), forcing llo
slarl addross lo bo DW aIignod.
- -

- --

- -
-- -

- - -
Tlo Iocalion and uso of oacl fioId in a 4DW momory roquosl loador is Iislod in
TabIo 4-7 on pago 176.
Nolo: Tlo difforonco bolvoon a 3DW loador and a 4DW loador is llo Iocalion
and sizo of llo slarling Addross fioId:
- Ior a 3DW loador (32 bil addrossing): Addross bils 31:2 aro in Bylos 8-11,
and 12-15 aro nol usod.
- Ior a 4DW loador (64 bil addrossing): Addross bils 31:2 aro in Bylos 12-15,
and addross bils 63:32 aro in Bylos 8-11.
Ollorviso llo loador fioIds aro llo samo.
- -

Iongll |9:0] Bylo 3 Bil 7:0
Bylo 2 Bil 1:0
TII dala payIoad lransfor sizo, in
DW. Maximum lransfor sizo is 10 bils,
2
10
= 1024 DW (4KB). Incoding:
00 0000 0001b = 1DW
00 0000 0010b = 2DW
.
.
11 1111 1111b = 1023 DW
00 0000 0000b = 1024 DW
Allr
(Allribulos)
Bylo 2 Bil 5:4 Bil 5 = RoIaxod ordoring.
Wlon sol = 1, ICI-X roIaxod ordoring
is onabIod for llis TII. If sol = 0, llon
slricl ICI ordoring is usod.
Bil 4 = No Snoop.
Wlon sol = 1, roquoslor is indicaling
llal no losl caclo coloroncy issuos
oxisl vill rospocl lo llis TII. Syslom
lardvaro is nol roquirod lo causo pro-
cossor caclo snoop for coloroncy.
Wlon sol = 0, ICI -lypo caclo snoop
proloclion is roquirod.
- --

II
(Ioisonod Dala)
Bylo 2 Bil 6 If sol = 1, llo dala accompanying llis
dala slouId bo considorod invaIid
aIllougl llo lransaclion is boing
aIIovod lo compIolo normaIIy.
TD
(TII Digosl IioId
Irosonl)
Bylo 2 Bil 7 If sol = 1, llo oplionaI 1 DW TII
Digosl fioId is incIudod vill llis TII.
Somo ruIos:
Irosonco of llo Digosl fioId musl bo
clocIod by aII rocoivors (using llis
bil)
- A TII vill TD = 1, bul no Digosl
fioId is landIod as a MaIformod
TII.
- If a dovico supporls clocIing
ICRC and TD=1, il musl porform
llo ICRC clocI.
- If a dovico doos nol supporl clocI-
ing ICRC (oplionaI) al llo uIli-
malo doslinalion, llo dovico musl
ignoro llo digosl fioId.
TC
(Traffic CIass)
Bylo 1 Bil 6:4 Tloso llroo bils aro usod lo oncodo
llo lraffic cIass lo bo appIiod lo llis
TII and lo llo compIolion associalod
vill il (if any).
000b = Traffic CIass 0 (DofauIl)
.
.
111b = Traffic CIass 7
TC 0 is llo dofauIl cIass, and TC 1-7
aro usod in providing difforonlialod
sorvicos. SooTraffic CIassos and Vir-
luaI ClannoIs on pago 256 for addi-
lionaI informalion.
- -

-- -

Typo|4:0] Bylo 0 Bil 4:0 TII pacIol Typo fioId:

00000b = Momory Road or Wrilo
00001b = Momory Road IocIod
Typo fioId is usod vill Iml |1:0] fioId
lo spocify lransaclion lypo, loador
sizo, and vlollor dala payIoad is
prosonl.
Iml 1:0 (Iormal) Bylo 0 Bil 6:5 IacIol Iormal:
00b = Momory Road (3DW v/o dala)
10b = Momory Wrilo (3DW v/ dala)
01b = Momory Road (4DW v/o dala)
11b = Momory Wrilo (4DW v/ dala)
1sl DW BI 3:0
(Iirsl DW Bylo InabIos)
Bylo 7 Bil 3:0 Tloso ligl lruo bils map ono-lo-ono
lo quaIify bylos villin llo DW pay-
Ioad.
Iasl BI 3:0
(Iasl DW Bylo InabIos)
Bylo 7 Bil 7:4 Tloso ligl lruo bils map ono-lo-ono
lo quaIify bylos villin llo Iasl DW
lransforrod.
Tag 7:0 Bylo 6 Bil 7:0 Tloso bils aro usod lo idonlify oacl
oulslanding roquosl issuod by llo
roquoslor. As non-poslod roquosls aro
sonl, llo noxl soquonliaI lag is
assignod.
DofauIl: onIy bils 4:0 aro usod (32 oul-
slanding lransaclions al a limo)
If Ixlondod Tag bil in ICI Ixpross
ConlroI Rogislor is sol = 1, llon aII 8
bils may bo usod (256 lags).
Roquoslor ID 15:0 Bylo 5 Bil 7:0
Bylo 4 Bil 7:0
Idonlifios llo roquoslor so a compIo-
lion may bo rolurnod, olc.
Bylo 4, 7:0 = Bus Numbor
Bylo 5, 7:3 = Dovico Numbor
Bylo 5, 2:0 = Iunclion Numbor
- -

- --

- - Ioaluros of momory roquosls incIudo:

1. Momory lransfors aro novor pormillod lo cross a 4KB boundary.
2. AII momory mappod vrilos aro poslod, rosuIling in mucl liglor porfor-
manco.
3. Iillor 32 bil or 64 bil addrossing may bo usod. Tlo 3DW loador formal sup-
porls 32 bil addrossos and llo 4DW loador supporls 64 bils.
4. Tlo fuII capabiIily of bursl lransfors is avaiIabIo vill a lransfor Iongll of 0-
1024 DW (0-4KB).
5. Advancod ICI Ixpross QuaIily of Sorvico foaluros, incIuding up lo 8 lrans-
for cIassos and virluaI clannoIs may bo impIomonlod.
6. Tlo No Snoop allribulo bil in llo loador may bo sol = 1, roIioving llo sys-
lom lardvaro from llo burdon of snooping procossor caclos vlon ICI
Ixpross lransaclions largol main momory. OplionaIIy, llo bil may bo doas-
sorlod in llo pacIol, providing ICI-IiIo caclo coloroncy proloclion.
7. Tlo RoIaxod Ordoring bil may aIso bo sol = 1, pormilling dovicos in llo pall
bolvoon llo pacIol and ils doslinalion lo appIy llo roIaxod ordoring ruIos
avaiIabIo in ICI-X. If doassorlod, slrong ICI producor-consumor ordoring is
onforcod.
Configuration Requests
To mainlain compalibiIily vill ICI, ICI Ixpross supporls boll Typo 0 and Typo
1 configuralion cycIos. A Typo 1 cycIo propagalos dovnslroam unliI il roaclos
llo bridgo inlorfaco losling llo bus (IinI) llal llo largol dovico rosidos on. Tlo
configuralion lransaclion is convorlod on llo doslinalion IinI from Typo 1 lo
Typo 0 by llo bridgo. Tlo bridgo forvards and convorls configuralion cycIos
using proviousIy programmod Bus Numbor rogislors llal spocify ils primary,
Addross 31:2 Bylo 15 Bil 7:2
Bylo 14 Bil 7:0
Bylo 13 Bil 7:0
Bylo 12 Bil 7:0
Tlo Iovor 32 bils of llo 64 bil slarl
addross for llo momory lransfor. Nolo
llal llo Iovor lvo bils of llo 32 bil
addross aro rosorvod (00b), forcing llo
slarl addross lo bo DW aIignod.
Addross 63:32 Bylo 11 Bil 7:2
Bylo 10 Bil 7:0
Bylo 9 Bil 7:0
Bylo 8 Bil 7:0
Tlo uppor 32 bils of llo 64-bil slarl
addross for llo momory lransfor.
- -

-- -

socondary, and subordinalo busos. Rofor lo llo ICI-CompalibIo Configuralion

Moclanism on pago 723 for a discussion of rouling lloso lransaclions.
Iiguro 4-9 on pago 180 iIIuslralos a Typo 1 configuralion cycIo maIing ils vay
dovnslroam. Al llo doslinalion IinI, il is convorlod lo Typo 0 and cIaimod by
llo ondpoinl dovico. Nolo llal unIiIo ICI, onIy ono dovico (ollor llan llo
bridgo) rosidos on a IinI. Ior llis roason, no IDSII or ollor lardvaro indicalion
is roquirod lo inslrucl llo dovico lo cIaim llo Typo 0 cycIo, any Typo 0 configura-
lion cycIo a dovico soos on ils primary IinI viII bo cIaimod.
-
- --

- - - TabIo 4-8 on
pago 181 doscribos llo Iocalion and uso of oacl fioId in llo configuralion
roquosl loador iIIuslralod in Iiguro 4-9 on pago 180.
- -

Iongll 9:0 Bylo 3 Bil 7:0
Bylo 2 Bil 1:0
Indicalos dala payIoad sizo in DW. Ior
configuralion roquosls, llis fioId is
aIvays = 1. Bylo InabIos aro usod lo
quaIify bylos villin DW (any combi-
nalion is IogaI)
Allr 1:0 (Allribulos) Bylo 2 Bil 5:4 Allribulo 1: RoIaxod Ordoring Bil
Allribulo 0: No Snoop Bil
Boll of lloso bils aro aIvays = 0 in
configuralion roquosls.
II Bylo 2 Bil 6 If = 1, indicalos llo dala payIoad (if
prosonl) is poisonod.
TD Bylo 2 Bil 7 If = 1, indicalos llo prosonco of a
digosl fioId (1 DW) al llo ond of llo
TII (procoding ICRC and IND)
TC 2:0 (Transfor CIass) Bylo 2 Bil 6:4 Indicalos lransfor cIass for llo pacIol.
TC is = 0 for aII Configuralion
roquosls.
Typo 4:0 Bylo 0 Bil 4:0 TII pacIol lypo fioId. Sol lo:
00100b = Typo 0 config roquosl
00101b = Typo 1 config roquosl
Iml 1:0 (Iormal) Bylo 0 Bil 6:5 IacIol Iormal. AIvays a 3DW loador
00b = configuralion road (no dala)
10b = configuralion vrilo (vill dala)
1sl DW BI 3:0
(Iirsl DW Bylo InabIos)
Bylo 7 Bil 3:0 Tloso ligl lruo bils map ono-lo-ono lo
quaIify bylos villin llo DW payIoad.
Ior config roquosls, any bil combina-
lion is vaIid (incIuding nono)
-- -

Iasl BI 3:0
(Iasl DW Bylo InabIos)
Bylo 7 Bil 7:4 Tloso ligl lruo bils map ono-lo-ono lo
quaIify bylos villin llo Iasl DW lrans-
forrod. Ior config roquosls, lloso bils
musl bo 0000b. (SingIo DW)
Tag 7:0 Bylo 6 Bil 7:0 Tloso bils aro usod lo idonlify oacl
oulslanding roquosl issuod by llo
roquoslor. As non-poslod roquosls aro
sonl, llo noxl soquonliaI lag is
assignod.
DofauIl: onIy bils 4:0 aro usod (32 oul-
slanding lransaclions al a limo)
If Ixlondod Tag bil in ICI Ixpross
ConlroI Rogislor is sol = 1, llon aII 8
bils may bo usod (256 lags).
Roquoslor ID 15:0 Bylo 5 Bil 7:0
Bylo 4 Bil 7:0
Idonlifios llo roquoslor so a compIo-
lion may bo rolurnod, olc.
Bylo 4, 7:0 = Bus Numbor
Bylo 5, 7:3 = Dovico Numbor
Bylo 5, 2:0 = Iunclion Numbor
Rogislor Numbor Bylo 11 Bil 7:2 Tloso bils provido llo Iovor 6 bils of
DW configuralion spaco offsol. Tlo
Rogislor Numbor is usod in conjunc-
lion vill Ixl Rogislor Numbor lo pro-
vido llo fuII 10 bils of offsol noodod for
llo 1024 DW (4096 bylo) ICI Ixpross
configuralion spaco.
Ixl Rogislor Numbor
(Ixlondod Rogislor
Numbor)
Bylo 10 Bil 3:0 Tloso bils provido llo uppor 4 bils of
DW configuralion spaco offsol. Tlo Ixl
Rogislor Numbor is usod in conjunc-
lion vill Rogislor Numbor lo provido
llo fuII 10 bils of offsol noodod for llo
1024 DW (4096 bylo) ICI Ixpross con-
figuralion spaco. Ior compalibiIily,
llis fioId can bo sol = 0, and onIy llo
Iovor 64DW (256 bylos viII bo soon)
vlon indoxing llo Rogislor Numbor.
- -

- --

- - Configuralion roquosls aIvays uso llo

3DW loador formal and aro roulod by llo conlonls of llo ID fioId.
AII dovicos capluro llo Bus Numbor and Dovico Numbor informalion pro-
vidod by llo upslroam dovico during oacl Typo 0 configuralion vrilo cycIo.
Informalion is conlainod in Bylo 8-9 (CompIolor ID) of configuralion roquosl.
CompIetions
CompIolions aro rolurnod foIIoving oacl non-poslod roquosl:
- Momory Road roquosl may rosuIl in compIolion vill dala (CpID)
- IO Road roquosl may rosuIl in a compIolion vill or villoul dala (CpID)
- IO Wrilo roquosl may rosuIl in a compIolion villoul dala (CpI)
- Configuralion Road roquosl may rosuIl in a compIolion vill dala (CpID)
- Configuralion Wrilo roquosl may rosuIl in a compIolion villoul dala (CpI)
Many of llo fioIds in llo compIolion musl lavo llo samo vaIuos as llo associ-
alod roquosl, incIuding Traffic CIass, Allribulo bils, and llo originaI Roquoslor
ID vlicl is usod lo roulo llo compIolion bacI lo llo originaI roquoslor. Iiguro
4-10 on pago 184 dopicls a compIolion rolurning aflor a non-poslod roquosl, as
voII as llo 3DW compIolion loador formal.
CompIolor ID 15:0 Bylo 9 Bil 7:0
Bylo 8 Bil 7:0
Idonlifios llo compIolor boing accossod
vill llis configuralion cycIo. Tlo Bus
and Dovico numbors in llis fioId aro
caplurod by llo dovico on oacl con-
figuralion Typo 0 vrilo.
Bylo 8, 7:0 = Bus Numbor
Bylo 9, 7:3 = Dovico Numbor
Bylo 9, 2:0 = Iunclion Numbor
- -

-- -

- --

- - TabIo 4-9 on pago 185

doscribos llo Iocalion and uso of oacl fioId in a compIolion loador.
-

Iongll 9:0 Bylo 3 Bil 7:0

Bylo 2 Bil 1:0
Indicalos dala payIoad sizo in DW. Ior
compIolions, llis fioId rofIocls llo sizo
of llo dala payIoad associalod vill llis
compIolion.
Allr 1:0 (Allribulos) Bylo 2 Bil 5:4 Allribulo 1: RoIaxod Ordoring Bil
Allribulo 0: No Snoop Bil
Ior a compIolion, boll of lloso bils aro
sol lo samo slalo as in llo roquosl.
II Bylo 2 Bil 6 If = 1, indicalos llo dala payIoad is poi-
sonod.
TD Bylo 2 Bil 7 If = 1, indicalos llo prosonco of a
digosl fioId (1 DW) al llo ond of llo TII
(procoding ICRC and IND)
TC 2:0 (Transfor CIass) Bylo 2 Bil 6:4 Indicalos lransfor cIass for llo pacIol.
Ior a compIolion, TC is sol lo samo
vaIuo as in llo roquosl.
Typo 4:0 Bylo 0 Bil 4:0 TII pacIol lypo fioId. AIvays sol lo
01010b for a compIolion.
Iml 1:0 (Iormal) Bylo 0 Bil 6:5 IacIol Iormal. AIvays a 3DW loador
00b = CompIolion villoul dala (CpI)
10b = CompIolion vill dala (CpID)
Bylo Counl Bylo 7 Bil 7:0
Bylo 6 Bil 3:0
Tlis is llo romaining bylo counl unliI a
road roquosl is salisfiod. GonoraIIy, il is
dorivod from llo originaI roquosl
Iongll fioId. Soo Dala Rolurnod Ior
Road Roquosls: on pago 188 for spociaI
casos causod by muIlipIo compIolions.
-- -

BCM
(Bylo Counl Modifiod)
Bylo 6 Bil 4 Sol = 1 onIy by ICI-X compIolors. Indi-
calos llal llo bylo counl fioId (soo provi-
ous fioId) rofIocls llo firsl lransfor
payIoad rallor llan lolaI payIoad
romaining. Soo Using Tlo Bylo Counl
Modifiod Bil on pago 188.
CS 2:0
(CompIolion Slalus
Codo)
Bylo 6 Bil 7:5 Tloso bils oncodod by llo compIolor lo
indicalo succoss in fuIfiIIing llo roquosl.
000b = SuccossfuI CompIolion (SC)
001b = Unsupporlod Roquosl (UR)
010b = Config Roq Rolry Slalus (CR S)
100b = CompIolor aborl. (CA)
ollors: rosorvod. Soo Summary of
CompIolion Slalus Codos: on pago 187.
CompIolor ID 15:0 Bylo 5 Bil 7:0
Bylo 4 Bil 7:0
Idonlifios llo compIolor. WliIo nol
noodod for rouling a compIolion, llis
informalion may bo usofuI if dobugging
bus lraffic.
Bylo 4 7:0 = CompIolor Bus #
Bylo 5 7:3 = CompIolor Dov #
Bylo 5 2:0 = CompIolor Iunclion #
Iovor Addross 6:0 Bylo 11 Bil 6:0 Tlo Iovor 7 bils of addross for llo firsl
onabIod bylo of dala rolurnod vill a
road. CaIcuIalod from roquosl Iongll
and Bylo onabIos, il is usod lo dolormino
noxl IogaI Road CompIolion Boundary.
Soo CaIcuIaling Iovor Addross IioId
on pago 187.
Tag 7:0 Bylo 10 Bil 7:0 Tloso bils aro sol lo rofIocl llo Tag
rocoivod vill llo roquosl. Tlo roquoslor
usos llom lo associalo inbound compIo-
lion vill an oulslanding roquosl.
-

- --

- - (Rofor lo CompIolion Slalus

fioId in labIo TabIo 4-9 on pago 185).
- 000b (SC) SuccossfuI CompIolion codo indicalos llo originaI roquosl com-
pIolod proporIy al llo largol.
- 001b (UR) Unsupporlod Roquosl codo indicalos originaI roquosl faiIod al llo
largol bocauso il largolod an unsupporlod addross, carriod an unsupporlod
addross or roquosl, olc. Tlis is landIod as an uncorroclabIo orror. Soo llo
Unsupporlod Roquosl on pago 365 for dolaiIs.
- 010b (CRS) Configuralion Roquosl Rolry Slalus indicalos largol vas lompo-
rariIy off-Iino and llo allompl slouId bo rolriod. (o.g. iniliaIizalion doIay
aflor rosol, olc.).
- 100b (CA) CompIolor Aborl codo indicalos llal compIolor is off-Iino duo lo
an orror (mucl IiIo largol aborl in ICI). Tlo orror viII bo Ioggod and lan-
dIod as an uncorroclabIo orror.
-- - Rofor lo
llo Iovor Addross fioId in TabIo 4-9 on pago 185. Tlo Iovor Addross fioId is sol
up by llo compIolor during compIolions vill dala (CpID) lo rofIocl llo addross
of llo firsl onabIod bylo of dala boing rolurnod in llo compIolion payIoad. Tlis
musl bo caIcuIalod in lardvaro by considoring boll llo DW slarl addross and
llo bylo onabIo pallorn in llo Iirsl DW Bylo InabIo fioId providod in llo origi-
naI roquosl. BasicaIIy, llo addross is an offsol from llo DW slarl addross:
- If llo Iirsl DW Bylo InabIo fioId is 1111b, aII bylos aro onabIod in llo firsl
DW and llo offsol is 0. Tlo bylo slarl addross is = DW slarl addross.
- If llo Iirsl DW Bylo InabIo fioId is 1110b, llo uppor llroo bylos aro onabIod
in llo firsl DW and llo offsol is 1. Tlo bylo slarl addross is = DW slarl
addross + 1.
Roquoslor ID 15:0 Bylo 9 Bil 7:0
Bylo 8 Bil 7:0
Copiod from llo roquosl inlo llis fioId
lo bo usod in rouling llo compIolion
bacI lo llo originaI roquoslor.
Bylo 4, 7:0 = Roquoslor Bus #
Bylo 5, 7:3 = Roquoslor Dovico #
Bylo 5, 2:0 = Roquoslor Iunclion #
-

-- -

- If llo Iirsl DW Bylo InabIo fioId is 1100b, llo uppor lvo bylos aro onabIod
in llo firsl DW and llo offsol is 2. Tlo bylo slarl addross is = DW slarl
addross + 2.
- If llo Iirsl DW Bylo InabIo fioId is 1000b, onIy llo uppor bylo is onabIod in
llo firsl DW and llo offsol is 3. Tlo bylo slarl addross is = DW slarl addross
+ 3.
Onco caIcuIalod, llo Iovor 7 bils aro pIacod in llo Iovor Addross fioId of llo
compIolion loador in llo ovonl llo slarl addross vas nol aIignod on a Road
CompIolion Boundary (RCB) and llo road compIolion musl broaI off al llo firsl
RCB. KnovIodgo of llo RCB is nocossary bocauso broaIing a lransaclion musl
bo dono on RCBs vlicl aro basod on slarl addross--nol lransfor sizo.
- Rofor lo llo Bylo Counl Modifiod
Bil in TabIo 4-9 on pago 185. Tlis bil is onIy sol by a ICI-X compIolor (o.g. a
bridgo from ICI Ixpross lo ICI-X) in a parlicuIar circumslanco. RuIos for ils
assorlion incIudo:
1. Il is onIy sol = 1 by a ICI-X compIolor if a road roquosl is going lo bo broIon
inlo muIlipIo compIolions
2. Tlo BCM bil is onIy sol for llo firsl compIolion of llo sorios. Il is sol lo indi-
calo llal llo firsl compIolion conlains a Bylo Counl fioId llal rofIocls llo
firsl compIolion payIoad rallor llan llo lolaI romaining (as il vouId in nor-
maI ICI Ixpross prolocoI). Tlo rocoivor llon rocognizos llal llo compIolion
viII bo foIIovod by ollors lo salisfy llo originaI roquosl as roquirod.
3. Ior llo socond and any ollor compIolions in llo sorios, llo BCM bil musl bo
doassorlod and llo Bylo Counl fioId viII rofIocl llo lolaI romaining counl--
jusl as in normaI ICI Ixpross prolocoI.
4. ICI Ixpross dovicos rocoiving compIolions vill llo BCM bil sol musl inlor-
prol llis caso proporIy.
5. Tlo Iovor Addross fioId is sol up by llo compIolor during compIolions
vill dala (CpID) lo rofIocl llo addross of llo firsl onabIod bylo of dala boing
rolurnod
--
1. CompIolions for road roquosls may bo broIon inlo muIlipIo compIolions,
bul lolaI dala lransfor musl oquaI sizo of originaI roquosl
2. CompIolions for muIlipIo roquosls may nol bo combinod
3. IO and Configuralion roads aro aIvays 1 DW, so viII aIvays bo salisfiod
vill a singIo compIolion
4. A compIolion vill a Slalus Codo ollor llan SC (succossfuI compIolion) lor-
minalos a lransaclion.
- --

5. Tlo Road CompIolion Boundary (RCB) musl bo obsorvod vlon landIing a

road roquosl vill muIlipIo compIolions. Tlo RCB is 64 bylos or 128 bylos
for llo rool compIox, llo vaIuo usod slouId bo visibIo in a configuralion
rogislor.
6. Bridgos and ondpoinls may impIomonl a bil for soIocling llo RCB sizo (64 or
128 bylos) undor soflvaro conlroI.
7. CompIolions llal do nol cross an aIignod RCB boundary musl compIolo in
ono lransfor.
8. MuIlipIo compIolions for a singIo road roquosl musl rolurn dala in incroas-
ing addross ordor.
-
1. A compIolion rocoivod villoul a malcl lo an oulslanding roquosl is an
Unoxpoclod CompIolion. Il viII bo landIod as an orror.
2. CompIolions vill a compIolion slalus ollor llan SuccossfuI CompIolion
(SC) or Configuralion Roquosl Rolry Slalus (CRS) viII bo landIod as an
orror and buffor spaco associalod vill llom viII bo roIoasod.
3. Wlon llo Rool CompIox rocoivors a CRS slalus during a configuralion
cycIo, ils landIing of llo ovonl is nol dofinod oxcopl aflor rosol (vlon a
poriod is dofinod vlon il musl aIIov il).
4. If CRS is rocoivod for a roquosl ollor llan configuralion, il is landIod as a
MaIformod TII.
5. CompIolions rocoivod vill slalus = a rosorvod codo aIias lo Unsupporlod
Roquosls.
6. If a road compIolion is rocoivod vill a slalus ollor llan SuccossfuI CompIo-
lion (SC), no dala is rocoivod vill llo compIolion and a CII (or CpIII) is
rolurnod in pIaco of a CpID (or CpIDII).
7. In llo ovonl muIlipIo compIolions aro boing rolurnod for a road roquosl, a
compIolion slalus ollor llan SuccossfuI CompIolion (SC) immodialoIy onds
llo lransaclion. Dovico landIing of dala rocoivod prior lo llo orror is impIo-
monlalion-spocific.
8. In mainlaining compalibiIily vill ICI, a Rool CompIox may bo roquirod lo
synllosizo a road vaIuo of a 1s vlon a configuralion cycIo onds vill a
compIolion indicaling an Unsupporlod Roquosl. (Tlis is anaIogous lo mas-
lor aborls vlicl occur vlon ICI onumoralion probos dovicos vlicl aro nol
in llo syslom).
-- -

Message Requests
Mossago roquosls ropIaco many of llo inlorrupl, orror, and povor managomonl
sidoband signaIs usod on oarIior bus prolocoIs. AII mossago roquosls uso llo
4DW loador formal, and aro landIod mucl llo samo as poslod momory vrilo
lransaclions. Mossagos may bo roulod using addross, ID, or impIicil rouling.
Tlo - in llo pacIol loador indicalos llo rouling mollod lo appIy,
and vlicl addilionaI loador rogislors aro in uso (addross rogislors, olc.). Iiguro
4-11 on pago 190 dopicls llo mossago roquosl loador formal.
-- -
- --

- -- - - TabIo 4-10 on
pago 191 doscribos llo Iocalion and uso of oacl fioId in a mossago roquosl
loador.
-- - -

Iongll 9:0 Bylo 3 Bil 7:0
Bylo 2 Bil 1:0
Indicalos dala payIoad sizo in DW. Ior
mossago roquosls, llis fioId is aIvays 0
(no dala) or 1 (ono DW of dala)
Allr 1:0 (Allribulos) Bylo 2 Bil 5:4 Allribulo 1: RoIaxod Ordoring Bil
Allribulo 0: No Snoop Bil
Boll of lloso bils aro aIvays = 0 in
mossago roquosls.
II Bylo 2 Bil 6 If = 1, indicalos llo dala payIoad (if
prosonl) is poisonod.
TD Bylo 2 Bil 7 If = 1, indicalos llo prosonco of a
digosl fioId (1 DW) al llo ond of llo
TII (procoding ICRC and IND)
TC 2:0 (Transfor CIass) Bylo 2 Bil 6:4 Indicalos lransfor cIass for llo pacIol.
TC is = 0 for aII mossago roquosls.
Typo 4:0 Bylo 0 Bil 4:0 TII pacIol lypo fioId. Sol lo:
Bil 4:3:
10b = Msg
Bil 2:0 (Mossago Rouling SubfioId)
000b = Roulod lo Rool CompIox
001b = Roulod by addross
010b = Roulod by ID
011b = Rool CompIox Broadcasl Msg
100b = IocaI, lorminalo al rocoivor
101b = Gallor/roulo lo Rool CompIox
0llors = rosorvod
Iml 1:0 (Iormal) Bylo 0 Bil 6:5 IacIol Iormal. AIvays a 4DW loador
01b = mossago roquosl villoul dala
11b = mossago roquosl vill dala
-- -

Mossago Codo 7:0 Bylo 7 Bil 7:0 Tlis fioId conlains llo codo indicaling
llo lypo of mossago boing sonl.
0000 0000b = UnIocI Mossago
0001 xxxxb = Iovor Mgml Mossago
0010 0xxxb = INTx Mossago
0011 00xxb = Irror Mossago
0100 xxxxb = Hol IIug Mossago
0101 0000b = SIol Iovor Mossago
0111 111xb = Vondor Typo 0 Mossago
0111 1111b = Vondor Typo 1 Mossago
Tag 7:0 Bylo 6 Bil 7:0 As aII mossago roquosls aro poslod, no
lag is assignod lo llom. Tloso bils
slouId bo = 0.
Roquoslor ID 15:0 Bylo 5 Bil 7:0
Bylo 4 Bil 7:0
Idonlifios llo roquoslor sonding llo
mossago.
Bylo 4, 7:0 = Roquoslor Bus #
Bylo 5, 7:3 = Roquoslor Dovico #
Bylo 5, 2:0 = Roquoslor Iunclion #
Addross 31:2 Bylo 11 Bil 7:2
Bylo 10 Bil 7:0
Bylo 9 Bil 7:0
Bylo 8 Bil 7:0
If addross rouling vas soIoclod for llo
mossago (soo Typo 4:0 fioId abovo),
llon llis fioId conlains llo Iovor parl
of llo 64-bil slarling addross. Ollor-
viso, llis fioId is nol usod.
Addross 63:32 Bylo 15 Bil 7:2
Bylo 14 Bil 7:0
Bylo 13 Bil 7:0
Bylo 12 Bil 7:0
If addross rouling vas soIoclod for llo
mossago (soo Typo 4:0 fioId abovo),
llon llis fioId conlains llo uppor 32
bils of llo 64 bil slarling addross. Oll-
orviso, llis fioId is nol usod.
-- - -

- --

-- - Tlo foIIoving labIos spocify llo mossago coding usod for

oacl of llo sovon mossago groups, and is basod on llo mossago codo fioId Iislod
in TabIo 4-10 on pago 191. Tlo dofinod groups incIudo:
1. INTx Inlorrupl SignaIing
2. Iovor Managomonl
3. Irror SignaIing
4. IocI Transaclion Supporl
5. SIol Iovor Iimil Supporl
6. Vondor Dofinod Mossagos
7. Hol IIug SignaIing
WliIo many dovicos aro capabIo of using llo
ICI 2.3 Mossago SignaIod Inlorrupl (MSI) mollod of doIivoring inlorrupls, somo
dovicos may nol supporl il. ICI Ixpross dofinos a virluaI viro aIlornalivo in
vlicl dovicos simuIalo llo assorlion and doassorlion of llo INTx (INTA-INTD)
inlorrupl signaIs soon in ICI-basod sysloms. BasicaIIy, a mossago is sonl lo
inform llo upslroam dovico an inlorrupl las boon assorlod. Aflor sorvicing, llo
dovico vlicl sonl llo inlorrupl sonds a socond mossago indicaling llo virluaI
inlorrupl signaI is boing roIoasod. Rofor lo llo Mossago SignaIod Inlorrupls on
pago 331 for dolaiIs. TabIo 4-11 summarizos llo INTx mossago coding al llo
pacIol IovoI.
--
-- --
Assorl_INTA 0010 0000b 100b
Assorl_INTB 0010 0001b 100b
Assorl_INTC 0010 0010b 100b
Assorl_INTD 0010 0011b 100b
Doassorl_INTA 0010 0100b 100b
Doassorl_INTB 0010 0101b 100b
Doassorl_INTC 0010 0110b 100b
Doassorl_INTD 0010 0111b 100b
-- -

-
1. Tlo INTx Mossago lypo doos nol incIudo a dala payIoad. Tlo Iongll fioId is
rosorvod.
2. Assorl_INTx and Doassorl_INTx aro onIy issuod by upslroam porls. ClocI-
ing vioIalions of llis ruIo is oplionaI. If clocIod, a TII vioIalion is landIod
as a MaIformod TII.
3. Tloso mossagos aro roquirod lo uso llo dofauIl lraffic cIass, TC0. Rocoivors
musl clocI for vioIalion of llis ruIo (landIod as MaIformod TIIs).
4. Compononls al boll onds of llo IinI musl lracI llo curronl slalo of llo four
virluaI inlorrupls. If llo IogicaI slalo of ono of llo inlorrupls clangos al llo
upslroam porl, llo porl musl sond llo approprialo INTx mossago lo llo
dovnslroam porl on llo samo IinI.
5. INTx signaIing is disabIod vlon llo Inlorrupl DisabIo bil of llo Command
Rogislor is sol = 1 (jusl as il vouId bo if plysicaI inlorrupl Iinos aro usod).
6. If any virluaI INTx signaIs aro aclivo vlon llo Inlorrupl DisabIo bil is sol in
llo dovico, llo dovico musl lransmil a corrosponding Doassorl_INTx mos-
sago onlo llo IinI.
7. Svilclos musl lracI llo slalo of llo four INTx signaIs indopondonlIy for
oacl dovnslroam porl and combino llo slalos for llo upslroam IinI.
8. Tlo Rool CompIox musl lracI llo slalo of llo four INTx Iinos indopon-
donlIy and convorl llom inlo syslom inlorrupls in a syslom-spocific vay.
9. Bocauso of svilclos in llo pall, llo Roquoslor ID in an INTx mossago may
bo llo Iasl lransmillor, nol llo originaI roquoslor.
--- ICI Ixpross is compalibIo vill ICI
povor managomonl, and adds llo ICI Ixpross aclivo IinI managomonl mocla-
nism. Rofor lo Claplor 16, onlilIod "Iovor Managomonl," on pago 567 for a
doscriplion of povor managomonl. TabIo 4-12 on pago 194 summarizos llo four
povor managomonl mossago lypos.
--
-- --
IM_Aclivo_Slalo_NaI 0001 0100b 100b
IM_IMI 0001 1000b 000b
IM_Turn_Off 0001 1001b 011b
IMI_TO_AcI 0001 1011b 101b
- --

-- -
1. Iovor Managomonl Mossago lypo doos nol incIudo a dala payIoad. Tlo
Iongll fioId is rosorvod.
2. Tloso mossagos aro roquirod lo uso llo dofauIl lraffic cIass, TC0. Rocoivors
musl clocI for vioIalion of llis ruIo (landIod as MaIformod TIIs).
3. IM_IMI is sonl upslroam by compononl roquosling ovonl.
4. IM_Turn_Off is broadcasl dovnslroam
5. IMI_TO_AcI is sonl upslroam by ondpoinl. Ior svilcl vill dovicos
allaclod lo muIlipIo dovnslroam porls, llis mossago vonl bo sonl
upslroam unliI aII il is firsl rocoivod from aII dovnslroam porls.
--- Irror mossagos aro sonl upslroam by onabIod dovicos llal
dolocl corroclabIo, non-falaI uncorroclabIo, and falaI non-corroclabIo orrors. Tlo
dovico dolocling llo orror is dofinod by llo Roquoslor ID fioId in llo mossago
loador. TabIo 4-13 on pago 195 doscribos llo llroo orror mossago lypos.
-- -
1. Tloso mossagos aro roquirod lo uso llo dofauIl lraffic cIass, TC0. Rocoivors
musl clocI for vioIalion of llis ruIo (landIod as MaIformod TIIs).
2. Tlis mossago lypo doos nol incIudo a dala payIoad. Tlo Iongll fioId is
rosorvod.
3. Tlo Rool CompIox convorls orror mossagos inlo syslom-spocific ovonls.
--
-- --
IRR_COR 0011 0000b 000b
IRR_NONIATAI 0011 0001b 000b
IRR_IATAI 0011 0011b 000b
-- -

-- Tlo UnIocI mossago is sonl lo a compIolor lo roIoaso il

from IocI as parl of llo ICI Ixpross IocIod Transaclion soquonco. TabIo 4-14 on
pago 196 summarizos llo coding for llis mossago.
-- -
1. Tloso mossagos aro roquirod lo uso llo dofauIl lraffic cIass, TC0. Rocoivors
musl clocI for vioIalion of llis ruIo (landIod as MaIformod TIIs).
2. Tlis mossago lypo doos nol incIudo a dala payIoad. Tlo Iongll fioId is
rosorvod.
-- Tlis mossago is sonl from a dovnslroam
svilcl or Rool CompIox porl lo llo upslroam porl of llo dovico allaclod lo il. Il
convoys a sIol povor Iimil vlicl llo dovnslroam dovico llon copios inlo llo
Dovico CapabiIilios Rogislor for ils upslroam porl. TabIo 4-15 summarizos llo
coding for llis mossago.
-- -
1. Tloso mossagos aro roquirod lo uso llo dofauIl lraffic cIass, TC0. Rocoivors
musl clocI for vioIalion of llis ruIo (landIod as MaIformod TIIs).
2. Tlis mossago lypo carrios a dala payIoad of 1 DW. Tlo Iongll fioId is sol =
1. OnIy llo Iovor 10 bils of llo 32-bil dala payIoad is usod for sIol povor
scaIing, llo uppor bils in llo dala payIoad musl bo sol = 0.
3. Tlis mossago is sonl aulomalicaIIy anylimo llo IinI lransilions lo DI_Up
slalus or if a configuralion vrilo lo llo SIol CapabiIilios Rogislor occurs
vlon llo Dala IinI Iayor roporls DI_Up slalus.
4. If a card in a sIol consumos Ioss povor llan llo povor Iimil spocifiod for llo
card/form faclor, il may ignoro llo mossago.
--
-- --
UnIocI 0000 0000b 011b
--
-- --
Sol_SIol_Iovor_Iimil 0101 0000b 100b
- --

-- Tloso mossagos aro passod bolvoon dovn-

slroam porls of svilclos and Rool Iorls llal supporl Hol IIug Ivonl signaIing.
TabIo 4-16 summarizos llo Hol IIug mossago lypos.
-- -
- Tlo Allonlion and Iovor indicalor mossagos aro aII drivon by llo svilcl/
rool compIox porl lo llo card.
- Tlo Allonlion Bullon mossago is drivon upslroam by a sIol dovico llal
impIomonls a svilcl.
--
-- --
Allonlion_Indicalor_On 0100 0001b 100b
Allonlion_Indicalor_BIinI 0100 0011b 100b
Allonlion_Indicalor_Off 0100 0000b 100b
Iovor_Indicalor_On 0100 0101b 100b
Iovor_Indicalor_BIinI 0100 0111b 100b
Iovor_Indicalor_Off 0100 0100b 100b
Allonlion_Bullon_Irossod 0100 1000b 100b
-- -

Data Link Layer Packets

Tlo primary rosponsibiIily of llo ICI Ixpross Dala IinI Iayor is lo assuro llal
inlogrily is mainlainod vlon TIIs movo bolvoon lvo dovicos. Il aIso las IinI
iniliaIizalion and povor managomonl rosponsibiIilios, incIuding lracIing of llo
IinI slalo and passing mossagos and slalus bolvoon llo Transaclion Iayor
abovo and llo IlysicaI Iayor boIov.
In porforming ils roIo, llo Dala IinI Iayor oxclangos lraffic vill ils noiglbor
using Dala IinI Iayor IacIols (DIIIs). DIIIs originalo and lorminalo al llo
Dala IinI Iayor of oacl dovico, villoul invoIvomonl of llo Transaclion Iayor.
DIIIs and TIIs aro inlorIoavod on llo IinI. Iiguro 4-12 on pago 198 dopicls llo
lransmission of a DIII from ono dovico lo anollor.
-
- --

Types Of DLLPs
Tloro aro llroo imporlanl groups of DIIIs usod in managing a IinI:
1. TII AcInovIodgomonl AcI/NaI DIIIs
2. Iovor Managomonl DIIIs
3. IIov ConlroI IacIol DIIIs
In addilion, llo spocificalion dofinos a vondor-spocific DIII.
DLLPs Are LocaI Traffic
DIIIs lavo a simpIo pacIol formal. UnIiIo TIIs, lloy carry no largol informa-
lion bocauso lloy aro usod for noarosl-noiglbor communicalions onIy.
Receiver handIing of DLLPs
Tlo foIIoving ruIos appIy vlon a DIII is sonl from lransmillor lo rocoivor:
1. As DIIIs arrivo al llo rocoivor, lloy aro immodialoIy procossod. Tloy can-
nol bo fIov conlroIIod.
2. AII rocoivod DIIIs aro clocIod for orrors. Tlis incIudos a conlroI symboI
clocI al llo IlysicaI Iayor aflor dosoriaIizalion, foIIovod by a CRC clocI
al llo rocoivor Dala IinI Iayor. A 16 bil CRC is caIcuIalod and sonl vill llo
pacIol by llo lransmillor, llo rocoivor caIcuIalos ils ovn DIII clocIsum
and comparos il lo llo rocoivod vaIuo.
3. Any DIIIs llal faiI llo CRC clocI aro discardod. Tloro aro sovoraI roporl-
abIo orrors associalod vill DIIIs.
4. UnIiIo TIIs, llo is no acInovIodgomonl prolocoI for DIIIs. Tlo ICI
Ixpross spocificalion las limo-oul moclanisms vlicl aro inlondod lo aIIov
rocovory from Iosl or discardod DIIIs.
5. Assuming no orrors occur, llo DIII lypo is dolorminod and il is passod lo
llo approprialo inlornaI Iogic:
Iovor Managomonl DIIIs aro passod lo llo dovico povor manago-
monl Iogic
IIov ConlroI DIIIs aro passod lo llo Transaclion Iayor so crodils may
bo updalod.
AcI/NaI DIIIs aro roulod lo llo Dala IinI Iayor lransmil inlorfaco so
TIIs in llo rolry buffor may bo discardod or rosonl.
-- -

Sending A Data Link Layer Packet

DIIIs aro assombIod on llo lransmil sido and disassombIod on llo rocoivor
sido of a IinI. Tloso pacIols originalo al llo Dala IinI Iayor and aro passod lo
llo IlysicaI Iayor. Tloro, framing symboIs aro addod boforo llo pacIol is sonl.
Iiguro 4-13 on pago 200 dopicls a gonoric DIII in lransil from Dovico B lo
Dovico A.

- --

Fixed DLLP Packet Size: 8 Bytes

AII Dala IinI Iayor IacIols consisl of llo foIIoving compononls:
1. A 1 DW coro (4 bylos) consisling of llo ono bylo Typo fioId and llroo addi-
lionaI bylos of allribulos. Tlo allribulos vary vill llo DIII lypo.
2. A 16 bil CRC vaIuo vlicl is caIcuIalod basod on llo DW coro conlonls, llon
appondod lo il.
3. Tloso 6 bylos aro llon passod lo llo IlysicaI Iayor vloro a Slarl Of DIII
(SDI) conlroI symboI and an Ind Of IacIol (IND) conlroI symboI aro
addod lo il. Boforo lransmission, llo IlysicaI Iayor oncodos llo 8 bylos of
informalion inlo oigll 10-bil symboIs for lransmission lo llo rocoivor.
Nolo llal lloro is novor a dala payIoad vill a DIII, aII informalion of inlorosl
is carriod in llo Typo and Allribulo fioIds.
DLLP Packet Types
Tlo llroo groups of DIIIs aro dofinod vill a numbor of varianls. TabIo 4-17
summarizos oacl varianl as voII as lloir fioId coding.
-

-
AcI
(TII AcInovIodgo)
0000 0000b TII lransmission inlogrily
NaI
(TII No AcInovIodgo)
0001 0000b TII lransmission inlogrily
IM_Inlor_I1 0010 0000b Iovor Managomonl
IM_Inlor_I23 0010 0001b Iovor Managomonl
IM_Aclivo_Slalo_Roquosl_I1 0010 0011b Iovor Managomonl
IM_Roquosl_AcI 0010 0100b Iovor Managomonl
Vondor Spocific 0011 0000b Vondor
InilIC1-I xxx=VC # 0100 0xxxb TII IIov ConlroI
-- -

Ack Or Nak DLLP Packet Format

Tlo formal of llo DIII usod by a rocoivor lo AcI or NaI llo doIivory of a TII
is iIIuslralod in Iiguro 4-14.
InilIC1-NI xxx=VC # 0101 0xxxb TII IIov ConlroI
InilIC1-CpI xxx=VC # 0110 0xxxb TII IIov ConlroI
InilIC2-I xxx=VC # 1100 0xxxb TII IIov ConlroI
InilIC2-NI xxx=VC # 1101 0xxxb TII IIov ConlroI
InilIC2-CpI xxx=VC # 1110 0xxxb TII IIov ConlroI
UpdaloIC-I xxx=VC # 1000 0xxxb TII IIov ConlroI
UpdaloIC-NI xxx=VC # 1001 0xxxb TII IIov ConlroI
UpdaloIC-CpI xxx=VC # 1010 0xxxb TII IIov ConlroI
Rosorvod Ollors Rosorvod

-

-
- --

- - TabIo 4-18 doscribos llo

fioIds conlainod in an AcI or NaI DIII.
-

AcINaI_Soq_Num
|11:0]
Bylo 3 Bil 7:0
Bylo 2 Bil 3:0

- Ior good TIIs rocoivod vill Soquonco
Numbor = NIXT_RCV_SIQ counl
(counl boforo incromonling), uso
NIXT_RCV_SIQ counl - 1 (counl aflor
incromonling minus 1).
- Ior TII rocoivod vill Soquonco Num-
bor oarIior llan NIXT_RCV_SIQ counl
(dupIicalo TII), uso NIXT_RCV_SIQ
counl - 1.

- Associalod vill a TII llal faiIod llo
CRC clocI, uso NIXT_RCV_SIQ counl
- 1.
- Ior a TII rocoivod vill Soquonco
Numbor Ialor llan NIXT_RCV_SIQ
counl, uso NIXT_RCV_SIQ counl - 1.
Upon rocoipl, llo lransmillor viII purgo
TIIs vill oquaI lo and oarIior Soquonco
Numbors and ropIay llo romaindor TIIs.
Typo 7:0 Bylo 0 Bil 7:0 Indicalos llo lypo of DIII. Ior llo AcI/
NaI DIIIs:
- 0000 0000b = ACK DIII.
- 0001 0000b = NAK DIII.
16-bil CRC Bylo 5 Bil 7:0
Bylo 4 Bil 7:0
16-bil CRC usod lo prolocl llo conlonls of
llis DIII. CaIcuIalion is mado on Bylos 0-
3 of llo ACK/NAK.
-- -

Power Management DLLP Packet Format

ICI Ixpross povor managomonl DIIIs and TIIs ropIaco mosl signaIs associ-
alod vill povor managomonl slalo clangos. Tlo formal of llo DIII usod for
povor managomonl is iIIuslralod in Iiguro 4-15.
- - TabIo 4-19
doscribos llo fioIds conlainod in a Iovor Managomonl DIII.

-

Typo 7:0 Bylo 0 Bil 7:0 Tlis fioId indicalos lypo of DIII. Ior llo Iovor Man-
agomonl DIIIs:
0010 0000b = IM_Inlor_I1
0010 0001b = IM_Inlor_I2
0010 0011b = IM_Aclivo_Slalo_Roquosl
0010 0100b = IM_Roquosl_AcI
IinI
CRC
Bylo 5 Bil 7:0
Bylo 4 Bil 7:0
16 Bil CRC sonl lo prolocl llo conlonls of llis DIII.
CaIcuIalion is mado on Bylos 0-3, rogardIoss of
vlollor fioIds aro usod.
- --

FIow ControI Packet Format

ICI Ixpross oIiminalos many of llo inofficioncios of oarIior bus prolocoIs
llrougl llo uso of a crodil-basod fIov conlroI sclomo. Tlis lopic is covorod in
dolaiI in Claplor 7, onlilIod "IIov ConlroI," on pago 285. Tlroo sIigllIy difforonl
DIIIs aro usod lo iniliaIizo llo crodils and lo updalo llom as rocoivor buffor
spaco bocomos avaiIabIo. Tlo lvo fIov conlroI iniliaIizalion pacIols aro roforrod
lo as InilIC1 and InilIC2. Tlo Updalo DIII is roforrod lo as UpdaloIC.
Tlo gonoric DIII formal for aII llroo fIov conlroI DIII varianls is iIIuslralod
in Iiguro 4-16 on pago 205.

-- -

- - TabIo 4-20 on pago 206

doscribos llo fioIds conlainod in a fIov conlroI DIII.
-

DalaIC 11:0 Bylo 3 Bil 7:0
Bylo 2 Bil 3:0
Tlis fioId conlains llo crodils associalod vill dala
slorago. Dala crodils aro in unils of 16 bylos por
crodil, and aro appIiod lo llo fIov conlroI counlor
for llo virluaI clannoI indicalod in V|2:0], and for
llo lraffic lypo indicalod by llo codo in Bylo 0, Bils
7:4.
HdrIC 11:0 Bylo 2 Bil 7:6
Bylo 1 Bil 5:0
Tlis fioId conlains llo crodils associalod vill
loador slorago. Dala crodils aro in unils of 1
loador (incIuding digosl) por crodil, and aro
appIiod lo llo fIov conlroI counlor for llo virluaI
clannoI indicalod in V|2:0], and for llo lraffic lypo
indicalod by llo codo in Bylo 0, Bils 7:4.
VC |2:0] Bylo 0 Bil 2:0 Tlis fioId indicalos llo virluaI clannoI (VC 0-7)
rocoiving llo crodils.
Typo 3:0 Bylo 0 Bil 7:4 Tlis fioId conlains a codo indicaling llo lypo of IC
DIII:
0100b = InilIC1-I (Ioslod Roquosls)
0101b = InilIC1-NI (Non-Ioslod Roquosls)
0110b = InilIC1-CpI (CompIolions)
0101b = InilIC2-I (Ioslod Roquosls)
1101b = InilIC2-NI (Non-Ioslod Roquosls)
1110b = InilIC2-CpI (CompIolions)
1000b = UpdaloIC-I (Ioslod Roquosls)
1001b = UpdaloIC-NI (Non-Ioslod Roquosls)
1010b = UpdaloIC-CpI (CompIolions)
IinI CRC Bylo 5 Bil 7:0
Bylo 4 Bil 7:0
16 Bil CRC sonl lo prolocl llo conlonls of llis
DIII. CaIcuIalion is mado on Bylos 0-3, rogardIoss
of vlollor fioIds aro usod.
- --

Vendor Specific DLLP Format

ICI Ixpross rosorvos a DIII lypo for vondor spocific uso. OnIy llo Typo codo is
dofinod. Tlo Vondor DIII is iIIuslralod in Iiguro 4-17.
- - TabIo 4-21 on pago 207
doscribos llo fioIds conlainod in a Vondor-Spocific DIII

-

Typo 3:0 Bylo 0 Bil 7:4 Tlis fioId conlains a codo indicaling llo Vondor-
spocific DIII:
0011 0000b = Vondor spocific DIII
IinI CRC Bylo 5 Bil 7:0
Bylo 4 Bil 7:0
16 Bil CRC sonl lo prolocl llo conlonls of llis
DIII. CaIcuIalion is mado on Bylos 0-3, rogardIoss
of vlollor fioIds aro usod.
209

The Previous Chapter

Informalion movos bolvoon ICI Ixpross dovicos in pacIols. Tlo lvo major
cIassos of pacIols aro Transaclion Iayor IacIols (TIIs), and Dala IinI Iayor
IacIols (DIIIs). Tlo uso, formal, and dofinilion of aII TII and DIII pacIol
lypos and lloir roIalod fioIds voro dolaiIod in llal claplor.
This Chapter
Tlis claplor doscribos a Ioy foaluro of llo Dala IinI Iayor: roIiabIo lransporl
of TIIs from ono dovico lo anollor dovico across llo IinI. Tlo uso of ACK
DIIIs lo confirm rocoplion of TIIs and llo uso of NAK DIIIs lo indicalo
orror rocoplion of TIIs is oxpIainod. Tlo claplor doscribos llo ruIos for ropIay-
ing TIIs in llo ovonl llal a NAK DIII is rocoivod.
The Next Chapter
Tlo noxl claplor discussos Traffic CIassos, VirluaI ClannoIs, and Arbilralion
llal supporl QuaIily of Sorvico concopls in ICI Ixpross impIomonlalions. Tlo
concopl of QuaIily of Sorvico in llo conloxl of ICI Ixpross is an allompl lo pro-
dicl llo bandvidll and Ialoncy associalod vill llo fIov of difforonl lransaclion
slroams lravorsing llo ICI Ixpross fabric. Tlo uso of QoS is basod on appIica-
lion-spocific soflvaro assigning Traffic CIass (TC) vaIuos lo lransaclions, vlicl
dofino llo priorily of oacl lransaclion as il lravoIs bolvoon llo Roquoslor and
CompIolor dovicos. Iacl TC is mappod lo a VirluaI ClannoI (VC) llal is usod lo
manago lransaclion priorily via lvo arbilralion sclomos caIIod porl and VC
arbilralion.
PCI Express System Architecture
210
ReIiabIe Transport of TLPs Across Each Link
Tlo funclion of llo Dala IinI Iayor (slovn in Iiguro 5-1 on pago 210) is lvo
foId:
- RoIiabIo lransporl of TIIs from ono dovico lo anollor dovico across llo
IinI.
- Tlo rocoivors Transaclion Iayor slouId rocoivo TIIs in llo samo ordor llal
llo lransmillor sonl llom. Tlo Dala IinI Iayor musl prosorvo llis ordor
dospilo any occurronco of orrors llal roquiro TIIs lo bo ropIayod (rolriod).

Port
Link
Memory, I/O, Configuration R/W Requests or Message Requests or Completions
(Software layer sends / receives address/transaction type/data/message index)
Software layer
Transaction layer
Header Data Payload ECRC
Receive
Buffers
per VC
Transmit
Buffers
per VC
Data Link layer
Physical layer
Serial-to-Parallel Parallel-to-Serial
Differential Receiver Differential Driver
Link Packet Start End Link Packet Start End
Decode Encode
Transaction Layer Packet (TLP)
TLP Error
Check
TLP Replay
Buffer
Physical Packet Physical Packet
Link Packet
Sequence TLP LCRC ACK/NAK
DLLPs e.g.
CRC
Header Data Payload ECRC
Transaction Layer Packet (TLP)
Link Packet
Sequence TLP LCRC
De-mux
Mux
Transmit Receive
Flow Control
Virtual Channel
Management
Ordering
Link
Training
ACK/NAK
DLLPs
CRC
Chapter 5: ACK/NAK Protocol
211
Tlo ACK/NAK prolocoI associalod vill llo Dala IinI Iayor is doscribod vill
llo aid of Iiguro 5-2 on pago 211 vlicl slovs sub-bIocIs vill groalor dolaiI.
Ior ovory TII llal is sonl from ono dovico (Dovico A) lo anollor (Dovico B)
across ono IinI, llo rocoivor clocIs for orrors in llo TII (using llo TIIs ICRC
fioId). Tlo rocoivor Dovico B nolifios lransmillor Dovico A on good or bad rocop-
lion of TIIs by rolurning an ACK or a NAK DIII. Rocoplion of an ACK DIII
by llo lransmillor indicalos llal llo rocoivor las rocoivod ono or moro TII(s)
succossfuIIy. Rocoplion of a NAK DIII by llo lransmillor indicalos llal llo
rocoivor las rocoivod ono or moro TII(s) in orror. Dovico A vlicl rocoivos a
NAK DIII llon ro-sonds associalod TII(s) vlicl viII lopofuIIy, arrivo al llo
rocoivor succossfuIIy villoul orror.
Tlo orror clocIing capabiIily in llo rocoivor and llo lransmillors abiIily lo ro-
sond TIIs if a TII is nol rocoivod corroclIy is llo coro of llo ACK/NAK prolo-
coI doscribod in llis claplor.
: As usod in llis claplor, llo lorm Transmillor rofors lo llo dovico
llal sonds TIIs.
: As usod in llis claplor, llo lorm Rocoivor rofors lo llo dovico llal
rocoivos TIIs.

Replay
Buffer
ACK /
NAK
DLLP
De-mux
Mux
From
Transaction Layer
Data Link Layer
Tx Rx
TLP
Sequence TLP LCRC
Transmit
Device A
Receiver
Device B
Tx
Error
Check
TLP
Sequence TLP LCRC
De-mux
Mux
To
Transaction Layer
Data Link Layer
Tx Rx
ACK /
NAK
DLLP
Rx
TLP
Sequence TLP LCRC
ACK /
NAK
DLLP
Link
PCI Express System Architecture
212
EIements of the ACK/NAK ProtocoI
Iiguro 5-3 is a bIocI diagram of a lransmillor and a romolo rocoivor connoclod
via a IinI. Tlo diagram slovs aII of llo major Dala IinI Iayor oIomonls associ-
alod vill roIiabIo TII lransfor from llo lransmillors Transaclion Iayor lo llo
rocoivors Transaclion Iayor. IacIol ordor is mainlainod by llo lransmillors
and rocoivors Transaclion Iayor.
-
Link
Assign
Seq. Num.
NEXT_TRANSMIT_SEQ (NTS)
LCRC Generator
Increment
Replay Buffer
ACK/NAK CRC Check ?
Pass
Fail
Discard
REPLAY_NUM
REPLAY_TIMER
Reset
AckNak_Seq_Num Check
AckNak_Seq_Num =
ACK_SEQ (AS) ?
DLLP
ACK/NAK
TLP TLP TLP
ACK/NAK
Generator
Receive Buffer
LCRC Check ?
Seq. Num. Check
TLP Seq. Num (>, <, =)
NEXT_RCV_SEQ (NRS) ?
NEXT_RCV_SEQ (NRS)
Increment
TLP = NRS
NAK_SCHEDULED
Pass
Fail
NAK
TLP > NRS (Lost TLPs)
Schedule
ACK
TLP < NRS (Duplicate TLP)
TLPs
ACKNAK_LAT
_TIMER
Schedule
NAK
From Transaction Layer
Transmitter Device A
To Transaction Layer
Receiver Device B
(NTS-AS) mod 4k >= 2048 ?
Yes - Block TLP, report DL
Layer protocol error
Good TLPs
Update ACK_SEQ (AS)
No (Forward Progress)
Purge Older TLPs
Yes
Yes
Replay
NAK
Increment
Chapter 5: ACK/NAK Protocol
213
Transmitter EIements of the ACK/NAK ProtocoI
Iiguro 5-4 on pago 215 iIIuslralos llo lransmillor Dala IinI Iayor oIomonls
associalod vill procossing of oulbound TIIs and inbound ACK/NAK DIIIs.
RepIay Buffer
Tlo ropIay buffor sloros TIIs vill aII fioIds incIuding llo Dala IinI Iayor-
roIalod Soquonco Numbor and ICRC fioIds. Tlo TIIs aro savod in llo ordor of
arrivaI from llo Transaclion Iayor boforo lransmission. Iacl TII in llo RopIay
Buffor conlains a Soquonco Numbor vlicl is incromonlaIIy groalor llan llo
soquonco numbor of llo provious TII in llo buffor.
Wlon llo lransmillor rocoivos acInovIodgomonl via an ACK DIII llal TIIs
lavo roaclod llo rocoivor succossfuIIy, il purgos llo associalod TIIs from llo
RopIay Buffor. If, on llo ollor land, llo lransmillor rocoivos a NAK DIII, il
ropIays (i.o., ro-lransmils) llo conlonls of llo buffor.
NEXT_TRANSMIT_SEQ Counter
Tlis counlor gonoralos llo Soquonco Numbor assignod lo oacl nov lransmillod
TII. Tlo counlor is a 12-bil counlor llal is iniliaIizod lo 0 al rosol, or vlon llo
Dala IinI Iayor is in llo inaclivo slalo. Il incromonls unliI il roaclos 4095 and
llon roIIs ovor lo 0 (i.o., il is a moduIo 4096 counlor).
LCRC Generator
Tlo ICRC Gonoralor providos a 32-bil ICRC for llo TII. Tlo ICRC is caIcu-
Ialod using aII fioIds of llo TII incIuding llo Hoador, Dala IayIoad, ICRC and
Soquonco Numbor. Tlo rocoivor usos llo TIIs ICRC fioId lo clocI for a CRC
orror in llo rocoivod TII.
REPLAY_NUM Count
Tlis 2-bil counlor sloros llo numbor of ropIay allompls foIIoving oillor rocop-
lion of a NAK DIII, or a RIIIAY_TIMIR limo-oul. Wlon llo RIIIAY_NUM
counl roIIs ovor from 11b lo 00b, llo Dala IinI Iayor lriggors a IlysicaI Iayor
IinI-rolrain (soo llo doscriplion of llo ITSSM rocovory slalo on pago 532). Il
vails for compIolion of ro-lraining boforo allompling lo lransmil TIIs onco
again. Tlo RIIIAY_NUM counlor is iniliaIizod lo 00b al rosol, or vlon llo
Dala IinI Iayor is inaclivo. Il is aIso rosol vlonovor an ACK is rocoivod, indi-
caling llal forvard progross is boing mado in lransmilling TIIs.
PCI Express System Architecture
214
REPLAY_TIMER Count
Tlo RIIIAY_TIMIR is usod lo moasuro llo limo from vlon a TII is lransmil-
lod unliI an associalod ACK or NAK DIII is rocoivod. Tlo RIIIAY_TIMIR is
slarlod (or roslarlod, if aIroady running) vlon llo Iasl SymboI of any TII is
sonl. Il roslarls from 0 oacl limo llal lloro aro oulslanding TIIs in llo RopIay
Buffor and an ACK DIII is rocoivod llal roforoncos a TII sliII in llo RopIay
Buffor. Il rosols lo 0 and loIds vlon lloro aro no oulslanding TIIs in llo RopIay
Buffor, or unliI roslarl condilions aro mol for oacl NAK rocoivod (oxcopl during
a ropIay), or vlon llo RIIIAY_TIMIR oxpiros. Il is nol advancod (i.o., ils vaIuo
romains fixod) during IinI ro-lraining.
ACKD_SEQ Count
Tlis 12-bil rogislor lracIs or sloros llo Soquonco Numbor of llo mosl roconlIy
rocoivod ACK or NAK DIII. Il is iniliaIizod lo aII 1s al rosol, or vlon llo Dala
IinI Iayor is inaclivo. Tlis rogislor is updalod vill llo AcINaI_Soq_Num
|11:0] fioId of a rocoivod ACK or NAK DIII. Tlo ACKD_SIQ counl is com-
parod vill llo NIXT_TRANSMIT_SIQ counl.
THIN
Nov TIIs from Transaclion Iayor aro nol accoplod by Dala IinI Iayor unliI
llis oqualion is no Iongor lruo. In addilion, a Dala IinI Iayor prolocoI orror
vlicl is a falaI uncorroclabIo orror is roporlod. Tlis orror condilion occurs if
lloro is a soparalion groalor llan 2047 bolvoon NIXT_TRANSMIT_SIQ and
ACKD_SIQ. i.o, a soparalion groalor llan 2047 bolvoon llo soquonco numbor
of a TII boing lransmillod and llal of a TII in llo ropIay buffor llal rocoivos an
ACK or NAK DIII.
AIso, llo ACKD_SIQ counl is usod lo clocI for forvard progross mado in
lransmilling TIIs. If no forvard progross is mado aflor 3 addilionaI ropIay
allompls, llo IinI in ro-lrainod.
DLLP CRC Check
Tlis bIocI clocIs for CRC orrors in DIIIs rolurnod from llo rocoivor. Good
DIIIs aro furllor procossod. If a DIII CRC orror is doloclod, llo DIII is dis-
cardod and an orror roporlod. No furllor aclion is laIon.
: Tlo Dala IinI Iayor is in llo inaclivo slalo vlon llo IlysicaI Iayor
roporls llal llo IinI is non-oporalionaI or nolling is connoclod lo llo Iorl. Tlo
IlysicaI Iayor is in llo non-oporalionaI slalo vlon llo IinI Training and Slalus
Slalo Maclino (ITSSM) is in llo Dolocl, IoIIing, Configuralion, DisabIod, Rosol
Chapter 5: ACK/NAK Protocol
215
or IoopbacI slalos during vlicl IinIUp = 0 (soo Claplor 14 on IinI IniliaIiza-
lion and Training). WliIo in llo inaclivo slalo, llo Dala IinI Iayor slalo
maclinos aro iniliaIizod lo lloir dofauIl vaIuos and llo RopIay Buffor is cIoarod.
Tlo Dala IinI Iayor oxils llo inaclivo slalo vlon llo IlysicaI Iayor roporls
IinIUp = 1 and llo IinI DisabIo bil of llo IinI ConlroI rogislor = 0.
- - --
Link
Assign
Seq. Num.
NEXT_TRANSMIT_SEQ (NTS)
LCRC Generator
Increment
Replay Buffer
ACK/NAK CRC Check ?
Pass
Fail
Discard
REPLAY_NUM
REPLAY_TIMER
Reset
AckNak_Seq_Num Check
AckNak_Seq_Num =
ACK_SEQ (AS) ?
DLLP
ACK/NAK
TLP TLP TLP
TLPs
From Transaction Layer
Transmitter Device A
(NTS-AS) mod 4k >= 2048 ?
Update ACK_SEQ (AS)
No (Forward Progress)
Purge Older TLPs
Yes
Yes
Replay
NAK
Increment
Yes - Block TLP, report DL
Layer protocol error
PCI Express System Architecture
216
Receiver EIements of the ACK/NAK ProtocoI
Iiguro 5-5 on pago 218 iIIuslralos llo rocoivor Dala IinI Iayor oIomonls associ-
alod vill procossing of inbound TIIs and oulbound ACK/NAK DIIIs.
Receive Buffer
Tlo rocoivo buffor lomporariIy sloros rocoivod TIIs vliIo TII CRC and
Soquonco Numbor clocIs aro porformod. If lloro aro no orrors, llo TII is pro-
cossod and lransforrod lo llo rocoivors Transaclion Iayor. If lloro aro orrors
associalod vill llo TII, il is discardod and a NAK DIII may bo scloduIod
(moro on llis Ialor in llis claplor). If llo TII is a dupIicalo TII (moro on llis
Ialor in llis claplor), il is discardod and an ACK DIII is scloduIod. If llo TII
is a nuIIifiod TII, il is discardod and no furllor aclion is laIon (soo Svilcl
Cul-Tlrougl Modo on pago 248).
LCRC Error Check
Tlis bIocI clocIs for ICRC orrors in llo rocoivod TII using llo TIIs 32-bil
ICRC fioId.
NEXT_RCV_SEQ Count
Tlo 12-bil NIXT_RCV_SIQ counlor Ioops lracI of llo noxl oxpoclod TIIs
Soquonco Numbor. Tlis counlor is iniliaIizod lo 0 al rosol, or vlon llo Dala IinI
Iayor is inaclivo. Tlis counlor is incromonlod onco for oacl good TII rocoivod
llal is forvardod lo llo Transaclion Iayor. Tlo counlor roIIs ovor lo 0 aflor
roacling a vaIuo of 4095. Tlo counlor is nol incromonlod for TIIs rocoivod vill
CRC orror, nuIIifiod TIIs, or TIIs vill an incorrocl Soquonco Numbor.
Sequence Number Check
Aflor llo CRC orror clocI, llis bIocI vorifios llal a rocoivod TIIs Soquonco
Numbor malclos llo NIXT_RCV_SIQ counl.
- If llo TIIs Soquonco Numbor = NIXT_RCV_SIQ counl, llo TII is
accoplod, procossod and forvardod lo llo Transaclion Iayor.
NIXT_RCV_SIQ counl is incromonlod. Tlo rocoivor conlinuos lo procoss
inbound TIIs and doos nol lavo lo rolurn an ACK DIII unliI llo
ACKNAK_IATINCY_TIMIR oxpiros or oxcoods ils sol vaIuo.
- If llo TIIs Soquonco Numbor is an oarIior Soquonco Numbor llan
NIXT_RCV_SIQ counl and vill a soparalion of no moro llan 2048 from
Chapter 5: ACK/NAK Protocol
217
NIXT_RCV_SIQ counl, llo TII is a dupIicalo TII. Il is discardod and an
ACK DIII is scloduIod for rolurn lo llo lransmillor.
- If llo TIIs Soquonco Numbor is a Ialor Soquonco Numbor llan
NIXT_RCV_SIQ counl, or for any ollor caso ollor llan llo abovo lvo con-
dilions, llo TII is discardod and a NAK DIII may bo scloduIod (moro on
llis Ialor) for rolurn lo llo lransmillor.
NAK_SCHEDULED FIag
Tlo NAK_SCHIDUIID fIag is sol vlon llo rocoivor scloduIos a NAK DIII lo
rolurn lo llo romolo lransmillor. Il is cIoarod vlon llo rocoivor soos llo firsl TII
associalod vill llo ropIay of a proviousIy-NaId TII. Tlo spocificalion is
uncIoar aboul vlollor llo rocoivor slouId scloduIo addilionaI NAK DIII for
bad TIIs rocoivod vliIo llo NAK_SCHIDUIID fIag is sol. Il is llo aullors
inlorprolalion llal llo rocoivor musl nol scloduIo llo rolurn of addilionaI NAK
DIIIs for subsoquonlIy rocoivod TIIs vliIo llo NAK_SCHIDUIID fIag
romains sol.
ACKNAK_LATENCY_TIMER
Tlo ACKNAK_IATINCY_TIMIR monilors llo oIapsod limo sinco llo Iasl
ACK or NAK DIII vas scloduIod lo bo rolurnod lo llo romolo lransmillor.
Tlo rocoivor usos llis limor lo onsuro llal il procossos TIIs promplIy and
rolurns an ACK or a NAK DIII vlon llo limor oxpiros or oxcoods ils sol vaIuo.
Tlo limor vaIuo is sol basod on a formuIa doscribod in Rocoivors
ACKNAK_IATINCY_TIMIR on pago 237.
ACK/NAK DLLP Generator
Tlis bIocI gonoralos llo ACK or NAK DIII upon command from llo ICRC or
Soquonco Numbor clocI bIocI. Tlo ACK or NAK DIII conlains an
AcINaI_Soq_Num|11:0] fioId oblainod from llo NIXT_RCV_SIQ counlor.
ACK or NAK DIIIs conlain a AcINaI_Soq_Num|11:0] vaIuo oquaI lo
NIXT_RCV_SIQ counl - 1.
PCI Express System Architecture
218
- --
Link
DLLP
ACK/NAK
TLP TLP TLP
ACK/NAK
Generator
Receive Buffer
LCRC Check ?
Seq. Num. Check
TLP Seq. Num (>, <, =)
NEXT_RCV_SEQ (NRS) ?
NEXT_RCV_SEQ (NRS)
Increment
TLP = NRS
NAK_SCHEDULED
Pass
Fail
NAK
TLP > NRS (Lost TLPs)
TLP < NRS (Duplicate TLP)
ACKNAK_LAT
_TIMER
To Transaction Layer
Receiver Device B
Good TLPs
Schedule
ACK
Schedule
NAK
Chapter 5: ACK/NAK Protocol
219
ACK/NAK DLLP Format
Tlo formal of an ACK or NAK DIII is iIIuslralod in Iiguro 5-6 on pago 219.
TabIo 5-6 doscribos llo ACK or NAK DIII IioIds.

-

AcINaI_Soq_Num
|11:0]
Bylo 3 Bil 7:0
Bylo 2 Bil 3:0

- Ior good TIIs rocoivod vill Soquonco
Numbor = NIXT_RCV_SIQ counl
(counl boforo incromonling), uso
NIXT_RCV_SIQ counl - 1 (counl aflor
incromonling minus 1).
- Ior TII rocoivod vill Soquonco Num-
bor oarIior llan NIXT_RCV_SIQ counl
(dupIicalo TII), uso NIXT_RCV_SIQ
counl - 1.

- Associalod vill a TII llal faiIs llo CRC
clocI, uso NIXT_RCV_SIQ counl - 1.
- Ior a TII rocoivod vill Soquonco Num-
bor Ialor llan NIXT_RCV_SIQ counl,
uso NIXT_RCV_SIQ counl - 1.
Upon rocoipl, llo lransmillor viII purgo
TIIs vill oquaI lo and oarIior Soquonco
Numbors and ropIay llo romaindor TIIs.
7 6 5 4 3 2 1 0 7 6 5 4 3 2 1 0 7 6 5 4 3 2 1 0
+3
7 6 5 4 3 2 1 0
Reserved
+2 +1 +0
Byte 0
Byte 4
16 Bit CRC
AckNak_Seq_Num
0000 0000 - Ack
0001 0000 - Nak
PCI Express System Architecture
220
ACK/NAK ProtocoI DetaiIs
Tlis soclion doscribos llo dolaiIod lransmillor and rocoivor bolavior in procoss-
ing TIIs and ACK/NAK DIIIs. Tlo oxampIos domonslralo fIov of TIIs from
lransmillor lo llo romolo rocoivor in boll llo normaI non-orror caso, as voII as
llo orror casos.
Transmitter ProtocoI DetaiIs
Tlis soclion doIvos doopor inlo llo ACK/NAK prolocoI. Considor llo lransmil
sido of a dovicos Dala IinI Iayor slovn in Iiguro 5-4 on pago 215.
Sequence Number
Boforo a lransmillor sonds TIIs doIivorod by llo Transaclion Iayor, llo Dala
IinI Iayor apponds a 12-bil Soquonco Numbors lo oacl TII. Tlo Soquonco
Numbor is gonoralod by llo 12-bil NIXT_TRANSMIT_SIQ counlor. Tlo
counlor is iniliaIizod lo 0 al rosol, or vlon llo Dala IinI Iayor is in llo inaclivo
slalo. Il incromonls aflor oacl nov TII is lransmillod unliI il roaclos ils maxi-
mum vaIuo of 4095, and llon roIIs ovor lo 0. Ior oacl nov TII sonl, llo lrans-
millor apponds llo Soquonco Numbor from llo NIXT_TRANSMIT_SIQ
counlor.
Koop in mind llal an incromonlod Soquonco Numbor doos nol nocossariIy moan
a groalor Soquonco Numbor (sinco llo counlor roIIs ovor vlon aflor il roaclos a
maximum vaIuo of 4095).
Typo 7:0 Bylo 0 Bil 7:0 Indicalos llo lypo of DIII. Ior llo AcI/
NaI DIIIs:
- 0000 0000b = ACK DIII.
- 0001 0000b = NAK DIII.
16-bil CRC Bylo 5 Bil 7:0
Bylo 4 Bil 7:0
16-bil CRC usod lo prolocl llo conlonls of
llis DIII. CaIcuIalion is mado on Bylos 0-3
of llo ACK/NAK.
-

Chapter 5: ACK/NAK Protocol
221
32-Bit LCRC
Tlo lransmillor aIso apponds a 32-bil ICRC (IinI CRC) caIcuIalod basod on
TII conlonls vlicl incIudo llo Hoador, Dala IayIoad, ICRC and Soquonco
Numbor.
RepIay (Retry) Buffer
Boforo a dovico lransmils a TII, il sloros a copy of llo TII in a
buffor associalod vill llo Dala IinI Iayor roforrod lo as llo RopIay Buffor
(llo spocificalion usos llo lorm Rolry Buffor). Iacl buffor onlry sloros a
compIolo TII vill aII of ils fioIds incIuding llo Hoador (up lo 16 bylos), an
oplionaI Dala IayIoad (up lo 4KB), an oplionaI ICRC (up lo four bylos), llo
Soquonco Numbor (12-bils vido, bul occupios lvo bylos) and llo ICRC
fioId (four bylos). Tlo buffor sizo is unspocifiod. Tlo buffor slouId bo big
onougl lo sloro lransmillod TIIs llal lavo nol yol boon acInovIodgod via
ACK DIIIs.
Wlon llo lransmillor rocoivos an ACK DIII, il purgos from llo RopIay
Buffor TIIs vill oquaI lo or oarIior Soquonco Numbors llan llo Soquonco
Numbor rocoivod vill llo ACK DIIIs.
Wlon llo lransmillor rocoivos NAK DIIIs, il purgos llo RopIay Buffor of
TIIs vill Soquonco Numbors llal aro oquaI lo or oarIior llan llo Soquonco
Numbor llal arrivos vill llo NAK and ropIays (ro-lransmils) TIIs of Ialor
Soquonco Numbors (llo romaindor TIIs in llo RopIay Buffor). Tlis impIios
llal a NAK DIII inloronlIy acInovIodgos TIIs vill oquaI lo or oarIior
Soquonco Numbors llan llo AcINaI_Soq_Num|11:0] of llo NAK DIII
and ropIays llo romaindor TIIs in llo RopIay Buffor. Ifficionl ropIay slralo-
gios aro discussod Ialor.
Tlo RopIay Buffor slouId bo Iargo onougl so llal,
undor normaI oporaling condilions, TII lransmissions aro nol llrollIod duo
lo a RopIay Buffor fuII condilion. To dolormino vlal buffor sizo lo impIo-
monl, ono musl considor llo foIIoving:
- ACK DIII doIivory Ialoncy from llo rocoivor.
- DoIays causo by llo plysicaI IinI inlorconnocl and llo IlysicaI Iayor
impIomonlalions.
- Rocoivor I0s oxil Ialoncy lo I0. i.o., llo buffor slouId idoaIIy bo big
onougl lo loId TIIs vliIo llo IinI vlicl is in I0s is rolurnod lo I0.
PCI Express System Architecture
222
Transmitters Response to an ACK DLLP
If llo lransmillor rocoivos an ACK DIII, il las posilivo confirma-
lion llal ils lransmillod TII(s) lavo roaclod llo rocoivor succossfuIIy. Tlo
lransmillor associalos llo Soquonco Numbor conlainod in llo ACK DIII
vill TII onlrios conlainod in llo RopIay Buffor.
A singIo ACK DIII rolurnod by llo rocoivor Dovico B may bo usod lo
acInovIodgo muIlipIo TIIs. Il is nol nocossary llal ovory TII lransmillod
musl lavo a corrosponding ACK DIII rolurnod by llo romolo rocoivor.
Tlis is dono lo consorvo bandvidll by roducing llo ACK DIII lraffic on
llo bus. Tlo rocoivor gallors muIlipIo TIIs and llon coIIoclivoIy acInovI-
odgos llom vill ono ACK DIII llal corrosponds lo llo Iasl rocoivod good
TII. In InfiniBand, llis is roforrod lo as ACK coaIoscing.
Tlo lransmillors rosponso lo rocoplion of an ACK DIII incIudo:
- Ioad ACKD_SIQ rogislor vill AcINaI_Soq_Num|11:0] of llo ACK DIII.
- Rosol llo RIIIAY_NUM counlor and RIIIAY_TIMIR lo 0.
- Iurgo llo RopIay Buffor as doscribod boIov.
An ACK DIII of a givon Soquonco Numbor
(conlainod in llo AcINaI_Soq_Num|11:0] fioId) acInovIodgos llo rocoipl
of a TII vill llal Soquonco Numbor in llo lransmillor RopIay Buffor, IIUS
aII TIIs vill oarIior Soquonco Numbors. In ollor vords, an ACK DIII
vill a givon Soquonco Numbor nol onIy acInovIodgos a spocific TII in llo
RopIay Buffor (llo ono vill llal Soquonco Numbor), bul il aIso acInovI-
odgos TIIs of oarIior (IogicaIIy Iovor) Soquonco Numbors. Tlo lransmillor
purgos llo RopIay Buffor of aII TIIs acInovIodgod by llo ACK DIII.
ExampIes of Transmitter ACK DLLP Processing
Considor Iiguro 5-7 on pago 223, vill llo omplasis on llo
lransmillor Dovico A.
1. Dovico A lransmils TIIs vill Soquonco Numbors 3, 4, 5, 6, 7 vloro
TII 3 is llo firsl TII sonl and TII 7 is llo Iasl TII sonl.
2. Dovico B rocoivos TIIs vill Soquonco Numbors 3, 4, 5 in llal ordor.
TII 6, 7 aro sliII on roulo.
3. Dovico B porforms llo orror clocIs and coIIoclivoIy acInovIodgos good
rocoipl of TIIs 3, 4, 5 vill llo rolurn of an ACK DIII vill a Soquonco
Numbor of 5.
4. Dovico A rocoivos ACK 5.
Chapter 5: ACK/NAK Protocol
223
5. Dovico A purgos TII 3, 4, 5 from llo RopIay Buffor.
6. Wlon Dovico B rocoivos TII 6, 7, slops 3 llrougl 5 may bo ropoalod for
lloso pacIols as voII.
Considor Iiguro 5-8, vill llo omplasis on llo lransmillor
Dovico A.
1. Dovico A lransmils TIIs vill Soquonco Numbors 4094, 4095, 0, 1, 2
vloro TII 4094 is llo firsl TII sonl and TII 2 is llo Iasl TII sonl.
2. Dovico B rocoivos TIIs vill Soquonco Numbors 4094, 4095, 0, 1 in llal
ordor. TII 2 is sliII on roulo.
3. Dovico B porforms llo orror clocIs and coIIoclivoIy acInovIodgos good
rocoipl of TIIs 4094, 4095, 0, 1 vill llo rolurn of an ACK DIII vill a
Soquonco Numbor of 1.
4. Dovico A rocoivos ACK 1.
5. Dovico A purgos TII 4094, 4095, 0, 1 from llo RopIay Buffor.
6. Wlon Dovico B uIlimaloIy rocoivos TII 2, slops 3 llrougl 5 may bo
ropoalod for TII 2.
- -
Replay Buffer Receive Buffer
3
4
5
6
7
Earlier TLP
From Transaction Layer
Transmitter Device A
3
4
5
6 7
To Transaction Layer
Receiver Device B
Later TLP
Earlier TLP
Later TLP
5
ACK
ACK/NAK
Generator
Link
PCI Express System Architecture
224
Transmitters Response to a NAK DLLP
A NAK DIII rocoivod by llo lransmillor impIios llal a TII lransmillod al an
oarIior limo vas rocoivod by llo rocoivor in orror. Tlo lransmillor firsl purgos
from llo RopIay Buffor any TII vill Soquonco Numbors oquaI lo or oarIior
llan llo NAK DIIIs AcINaI_Soq_Num|11:0]. Il llon ropIays (rolrios) llo
romaindor TIIs slarling vill llo TII vill Soquonco Numbor immodialoIy
aflor llo AcINaI_Soq_Num|11:0] of llo NAK DIII unliI llo novosl TII. In
addilion, llo lransmillors rosponso lo rocoplion of a NAK DIII incIudo:
- Rosol RIIIAY_NUM and RIIIAY_TIMIR lo 0 onIy if llo NAK DIIIs
AcINaI_Soq_Num|11:0] is Ialor llan llo curronl ACKD_SIQ vaIuo (for-
vard progross is mado in lransmilling TIIs).
- Ioad ACKD_SIQ rogislor vill AcINaI_Soq_Num|11:0] of llo NAK DIII.
- -
Replay Buffer Receive Buffer
4094
4095
0
1
2
From Transaction Layer
Transmitter Device A
4094
4095
0
1
2
To Transaction Layer
Receiver Device B
1
ACK
ACK/NAK
Generator
Link
Earlier TLP
Later TLP
Earlier TLP
Later TLP
Chapter 5: ACK/NAK Protocol
225
TLP RepIay
Wlon a RopIay bocomos nocossary, llo lransmillor bIocIs llo doIivory of nov
TIIs by llo Transaclion Iayor. Il llon ropIays (ro-sonds or rolrios) llo conlonls
of llo RopIay Buffor slarling vill llo oarIiosl TII firsl (of Soquonco Numbor =
AcINaI_Soq_Num|11:0] + 1) unliI llo romaindor of llo RopIay Buffor is
ropIayod. Aflor llo ropIay ovonl, llo Dala IinI Iayor unbIocIs accoplanco of
nov TIIs from llo Transaclion Iayor. Tlo lransmillor conlinuos lo savo llo
TIIs jusl ropIayod unliI lloy aro finaIIy acInovIodgod al a Ialor limo.
Efficient TLP RepIay
ACK DIIIs or NAK DIIIs rocoivod during ropIay musl bo procossod. Tlis
moans llal llo lransmillor musl procoss llo DIIIs and, al llo vory Ioasl, sloro
llom unliI llo ropIay is finislod. Aflor ropIay is compIolo, llo lransmillor ovaIu-
alos llo ACK or NAK DIIIs and porforms llo approprialo procossing.
A moro officionl dosign migll bogin procossing llo ACK/NAK DIIIs vliIo
llo lransmillor is sliII in llo acl of ropIaying. By doing so, novIy rocoivod ACK
DIIIs aro usod lo purgo llo RopIay Buffor ovon vliIo ropIay is in progross. If
anollor NAK DIII is rocoivod in llo moanlimo, al llo vory Ioasl, llo TIIs llal
voro acInovIodgod lavo boon purgod and vouId nol bo ropIayod.
During ropIay, if muIlipIo ACK DIIIs aro rocoivod, llo ACK DIII rocoivod
Iasl vill llo Ialosl Soquonco Numbor can coIIapso oarIior ACK DIIIs of oarIior
Soquonco Numbors. During llo ropIay, llo lransmillor can concurronlIy purgo
TIIs of Soquonco Numbor oquaI lo and oarIior llan llo
AcINaI_Soq_Num|11:0] of llo Iasl rocoivod ACK DIII.
ExampIe of Transmitter NAK DLLP Processing
Considor Iiguro 5-9 on pago 226, vill focus on lransmillor Dovico A.
1. Dovico A lransmils TIIs vill Soquonco Numbor 4094, 4095, 0, 1, and 2,
vloro TII 4094 is llo firsl TII sonl and TII 2 is llo Iasl TII sonl.
2. Dovico B rocoivos TIIs 4094, 4095, and 0 in llal ordor. TII 1, 2 aro sliII on
roulo.
3. Dovico B rocoivos TII 4094 vill no orror and lonco NIXT_RCV_SIQ counl
incromonls lo 4095
4. Dovico B rocoivos TII 4095 vill a CRC orror.
5. Dovico B scloduIos llo rolurn of a NAK DIII vill Soquonco Numbor 4094
(NIXT_RCV_SIQ counl - 1).
PCI Express System Architecture
226
6. Dovico A rocoivos NAK 4094 and bIocIs accoplanco of nov TIIs from ils
Transaclion Iayor unliI ropIay compIolos.
7. Dovico A firsl purgos TII 4094 (and oarIior TIIs, nono in llis oxampIo).
8. Dovico A llon ropIays TIIs 4095, 0, 1, and 2, bul doos nol purgo llom.
- Iacl limo llo lransmillor rocoivos a NAK
DIII, il ropIays llo RopIay Buffor conlonls. Tlo lransmillor usos a 2-bil
RopIay Numbor counlor, roforrod lo as llo RIIIAY_NUM counlor, lo Ioop
lracI of llo numbor of ropIay ovonls. Rocoplion of a NAK DIII incromonls
RIIIAY_NUM. Tlis counlor is iniliaIizod lo 0 al rosol, or vlon llo Dala
IinI Iayor is inaclivo. Il is aIso rosol if an ACK or NAK DIII is rocoivod
vill a Ialor Soquonco Numbor llan llal conlainod in llo ACKD_SIQ rogis-
lor. As Iong as forvard progross is mado in lransmilling TIIs llo
RIIIAY_NUM counlor rosols. Wlon a fourll NAK is rocoivod, indicaling
no forvard progross las boon mado aflor sovoraI lrios, llo counlor roIIs ovor
lo zoro. Tlo lransmillor viII nol ropIay llo TIIs a fourll limo bul insload il
signaIs a ropIay numbor roIIovor orror. Tlo dovico assumos llal llo IinI is
non-funclionaI or llal lloro is a IlysicaI Iayor probIom al oillor llo lrans-
millor or rocoivor ond.
- -
Replay Buffer Receive Buffer
4094
4095
0
1
2
From Transaction Layer
Transmitter Device A
4094
4095
0
1 2
To Transaction Layer
Receiver Device B
Good TLP
Good TLP
4094
NAK
ACK/NAK
Generator
Link
4095 0
Replayed TLPs TLPs still in route
1 2
Earlier TLP
Later TLP
Bad TLP
Chapter 5: ACK/NAK Protocol
227
- A lransmillors
Dala IinI Iayor lriggors llo IlysicaI Iayor lo ro-lrain llo IinI. Tlo Ilysi-
caI Iayor IinI Training and Slalus Slalo Maclino (ITSSM) onlors llo Rocov-
ory Slalo (soo Rocovory Slalo on pago 532). Tlo RopIay Numbor RoIIovor
orror bil is sol (Advancod CorroclabIo Irror HandIing on pago 384) in llo
Advancod Irror Roporling rogislors (if impIomonlod). Tlo RopIay Buffor
conlonls aro prosorvod and llo Dala IinI Iayor is nol iniliaIizod by llo ro-
lraining procoss. Upon IlysicaI Iayor ro-lraining oxil, assuming llal llo
probIom las boon cIoarod, llo lransmillor rosumos llo samo ropIay procoss
again. HopofuIIy, llo TIIs can bo ro-sonl succossfuIIy on llis allompl.
Tlo spocificalion doos nol addross a dovicos landIing of ropoalod ro-lrain
allompls. Tlo aullor rocommonds llal a dovico lracI llo numbor of ro-lrain
allompls. Aflor a ro-lrain roIIovor llo dovico couId signaI a Dala IinI Iayor pro-
locoI orror indicaling llo sovorily as an UncorroclabIo IalaI Irror.
Transmitters RepIay Timer
Tlo lransmillor impIomonls a RIIIAY_TIMIR lo moasuro llo limo from vlon
a TII is lransmillod unliI llo lransmillor rocoivos an associalod ACK or NAK
DIII from llo romolo rocoivor. A formuIa (doscribod boIov) dolorminos llo
limors oxpiralion poriod. Timor oxpiralion lriggors a ropIay ovonl and llo
RIIIAY_NUM counl incromonls. A limo-oul may ariso if an ACK or NAK
DIII is Iosl on roulo, or bocauso of an orror in llo rocoivor llal provonls il from
rolurning an ACK or NAK DIII. Timor-roIalod ruIos aro:
- Tlo Timor slarls (if nol aIroady slarlod) vlon llo Iasl symboI of any TII is
lransmillod.
- Tlo Timor is rosol lo 0 and roslarlod vlon:
A RopIay ovonl occurs and llo Iasl symboI of llo firsl TII is ropIayod.
Ior oacl ACK DIII rocoivod, as Iong as lloro aro unacInovIodgod
TIIs in llo RopIay Buffor,
- Tlo Timor is rosol and loId vlon:
Tloro aro no TIIs lo lransmil, or vlon llo RopIay Buffor is omply.
A NAK DIII is rocoivod. Tlo limor roslarls vlon ropIay bogins.
Wlon llo limor oxpiros.
Tlo Dala IinI Iayor is inaclivo.
- Timor is HoId during IinI lraining or ro-lraining.
Tlo limor is Ioadod vill a vaIuo llal
rofIocls llo vorsl-caso Ialoncy for llo rolurn of an ACK or NAK DIII. Tlis
limo doponds on llo maximum dala payIoad aIIovod for a TII and llo
vidll of llo IinI.
PCI Express System Architecture
228
Tlo oqualion lo caIcuIalo llo RIIIAY_TIMIR vaIuo roquirod is:
Tlo vaIuo in llo limor roprosonls a symboI limo (4ns).
Tlo oqualion fioIds aro dofinod as foIIovs:
is llo vaIuo in llo Max_IayIoad_Sizo fioId of llo
Dovico ConlroI Rogislor (Dovico CapabiIilios Rogislor on pago 900).
incIudos llo addilionaI TII fioIds boyond llo dala pay-
Ioad (loador, digosl, ICRC, and Slarl/Ind framing symboIs). In llo
spocificalion, llo ovorload vaIuo is lroalod as a conslanl of 28 symboIs.
Tlo is a fudgo faclor llal roprosonls llo numbor of maxi-
mum-sizod TIIs (basod on Max_IayIoad) llal can bo rocoivod boforo
an ACK DIII musl bo sonl. Tlo AI vaIuo rangos from 1.0 lo 3.0 and is
usod lo baIanco IinI bandvidll officioncy and RopIay Buffor sizo. Iig-
uro 5-10 on pago 229 summarizos llo AcI Iaclor vaIuos for various
IinI vidlls and payIoads. Tloso AcI Iaclor vaIuos aro closon lo aIIov
impIomonlalions lo acliovo good porformanco villoul roquiring a
Iargo unoconomicaI buffor.
rangos from 1-bil vido lo 32-bils vido.
is llo rocoivors inlornaI doIay bolvoon rocoiving a TII,
procossing il al llo Dala IinI Iayor, and rolurning an ACK or NAK
DIII. Il is lroalod as a conslanl of 19 symboI limos in lloso caIcuIalions.
-- is llo limo roquirod by llo rocoivo circuils lo oxil
from I0s lo I0, oxprossod in symboI limos.
Iiguro 5-10 on pago 229 is a sum-
mary labIo llal slovs possibIo limor Ioad vaIuos vill various variabIos
pIuggod inlo llo RIIIAY_TIMIR oqualion.
Chapter 5: ACK/NAK Protocol
229
Transmitter DLLP HandIing
Tlo DIII CRC Irror ClocIing bIocI dolorminos vlollor lloro is a CRC orror
in llo rocoivod DIII. Tlo DIII incIudos a 16-bil CRC for llis purposo (soo
TabIo 5-1 on pago 219). If lloro aro no DIII CRC orrors, llon llo DIIIs aro fur-
llor procossod. If a DIII CRC orror is doloclod, llo DIII is discardod, and llo
orror is roporlod as a DIII CRC orror lo llo orror landIing Iogic vlicl Iogs llo
orror in llo oplionaI Advancod Irror Roporling rogislors (soo Bad DIII in
Advancod CorroclabIo Irror HandIing on pago 384). No furllor aclion is
laIon.
Discarding an ACK or NAK DIII rocoivod in orror is nol a sovoro rosponso
bocauso a subsoquonlIy rocoivod DIII viII accompIisl llo samo goaI as llo dis-
cardod DIII. Tlo sido offocl of llis aclion is llal associalod TIIs aro purgod a
IillIo Ialor llan lloy vouId lavo boon or llal a ropIay lappons al a Ialor limo. If
a subsoquonl DIII is nol rocoivod in limo, llo lransmillor RIIIAY_TIMIR
oxpiros anyvay, and llo TIIs aro ropIayod.

12,429
6285
3213
1677
1248
711
X1
Link
6243
3171
1635
867
651
384
X2
Link
3150
1614
846
462
354
219
X4
Link
1602
834
450
258
321
201
X8
Link
2118
1095
582
327
270
174
X12
Link
1602
834
450
258
216
144
x16
Link
828
444
252
156
135
99
X32
Link
4096 Bytes
2048 Bytes
1024 Bytes
512 Bytes
256 Bytes
128 Bytes
Max_Payload
Size
12,429
6285
3213
1677
1248
711
X1
Link
6243
3171
1635
867
651
384
X2
Link
3150
1614
846
462
354
219
X4
Link
1602
834
450
258
321
201
X8
Link
2118
1095
582
327
270
174
X12
Link
1602
834
450
258
216
144
x16
Link
828
444
252
156
135
99
X32
Link
4096 Bytes
2048 Bytes
1024 Bytes
512 Bytes
256 Bytes
128 Bytes
Max_Payload
Size
The table summarizes values calculated using the equation, minus the
Rx_L0s_Adjustment term
Example: Assume a 2-lane link with a Max_Payload of 2048 bytes.
(Max_Payload_Size + TLP Overhead) * AckFactor + Internal Delay *3
LinkWidth
(2048 + 28) * 1.0 + 19 *3 = 3171 (about a 12.7uS timeout period)
2
PCI Express System Architecture
230
Receiver ProtocoI DetaiIs
Considor llo rocoivo sido of a dovicos Dala IinI Iayor slovn in Iiguro 5-5 on
pago 218.
TLP Received at PhysicaI Layer
TIIs rocoivod al llo IlysicaI Iayor aro clocIod for STI and IND framing
orrors as voII as ollor rocoivor orrors sucl as disparily orrors. If lloro aro no
orrors, llo TIIs aro passod lo llo Dala IinI Iayor. If lloro aro any orrors, llo
TII is discardod and llo aIIocalod slorago is frood up. Tlo Dala IinI Iayor is
informod of llis orror so llal il can scloduIo a NAK DIII. (soo Rocoivor
ScloduIos a NAK on pago 233).
Received TLP Error Check
Tlo rocoivor accopls TIIs from llo IinI inlo a rocoivor buffor and clocIs for
CRC orrors. Tlo rocoivor caIcuIalos an oxpoclod ICRC vaIuo basod on llo
rocoivod TII (oxcIuding llo ICRC fioId) and comparos llis vaIuo vill llo
TIIs 32-bil ICRC. If llo lvo malcl, llo TII is good. If llo lvo ICRC vaIuos
do nol malcl, llo rocoivod TII is bad and llo rocoivor scloduIos a NAK DIII
lo bo rolurnod lo llo romolo lransmillor. Tlo rocoivor aIso clocIs for ollor lypos
of non-CRC roIalod orrors (sucl as llal doscribod in llo noxl soclion).
Next Received TLPs Sequence Number
Tlo rocoivor Ioops lracI of llo noxl oxpoclod TIIs Soquonco Numbor via a 12-
bil counlor roforrod lo as llo NIXT_RCV_SIQ counlor. Tlis counlor is iniliaI-
izod lo 0 al rosol, or vlon llo Dala IinI Iayor is inaclivo. Tlis counlor is incro-
monlod onco for oacl good TII llal is rocoivod and forvardod lo llo
Transaclion Iayor. Tlo counlor roIIs ovor lo 0 aflor roacling a vaIuo of 4095.
Tlo rocoivor usos llo NIXT_RCV_SIQ counlor lo idonlify llo Soquonco Num-
bor llal slouId bo in llo noxl rocoivod TII. If a rocoivod TII las no ICRC orror,
llo dovico comparos ils Soquonco Numbor vill llo NIXT_RCV_SIQ counl.
Undor normaI oporalionaI condilions, lloso lvo numbors slouId malcl. If llis
is llo caso, llo rocoivor accopls llo TII, forvards llo TII lo llo Transaclion
Iayor, incromonls llo NIXT_RCV_SIQ counlor and is roady for llo noxl TII.
An ACK DIII may bo scloduIod for rolurn if llo ACKNAK_IATINCY_
TIMIR oxpiros or oxcoods ils sol vaIuo. Tlo rocoivor is roady lo porform a com-
parison on llo noxl rocoivod TIIs Soquonco Numbor.
Chapter 5: ACK/NAK Protocol
231
In somo casos, a rocoivod TIIs Soquonco Numbor may nol malcl llo
NIXT_RCV_SIQ counl. Tlo rocoivod TIIs Soquonco Numbor may bo oillor
IogicaIIy groalor llan or IogicaIIy Ioss llan NIXT_RCV_SIQ counl (a IogicaI
numbor in llis caso accounls for llo counl roIIovor, so in facl a IogicaIIy groalor
numbor may acluaIIy bo a Iovor numbor if llo counl roIIs ovor). Soo Rocoivor
Soquonco Numbor ClocI on pago 234 for dolaiIs on lloso lvo abnormaI condi-
lions.
Ior a TII rocoivod vill a CRC orror, or a nuIIifiod TII or a TII for vlicl llo
Soquonco Numbor clocI doscribod abovo faiIs, llo NIXT_RCV_SIQ counlor is
nol incromonlod.
Receiver ScheduIes An ACK DLLP
If llo rocoivor doos nol dolocl an ICRC orror (soo Rocoivod TII Irror ClocI
on pago 230) or a Soquonco Numbor roIalod orror (soo Noxl Rocoivod TIIs
Soquonco Numbor on pago 230) associalod vill a rocoivod TII, il accopls llo
TII and sonds il lo llo Transaclion Iayor. Tlo NIXT_RCV_SIQ counlor is
incromonlod and llo rocoivor is roady for llo noxl TII. Al llis poinl, llo
rocoivor can scloduIo an ACK DIII vill llo Soquonco Numbor of llo rocoivod
TII (soo llo AcINaI_Soq_Num|11:0] fioId doscribod in TabIo 5-1 on pago 219).
AIlornalivoIy, llo rocoivor couId aIso vail for addilionaI TIIs and scloduIo an
ACK DIII vill llo Soquonco Numbor of llo Iasl good TII rocoivod.
Tlo rocoivor is aIIovod lo accumuIalo a numbor of good TIIs and llon sonds
ono aggrogalo ACK DIII vill a Soquonco Numbor of llo Ialosl good TII
rocoivod. Tlo coaIoscod ACK DIII acInovIodgos llo good rocoipl of a coIIoc-
lion of TIIs slarling vill llo oIdosl TII in llo lransmillors RopIay Buffor and
onding vill llo TII boing acInovIodgod by llo curronl ACK DIII. By doing
so, llo rocoivor oplimizos llo uso of IinI bandvidll duo lo roducod ACK DIII
lraffic. Tlo froquoncy vill vlicl ACK DIIIs aro scloduIod for rolurn is
doscribod in Rocoivors ACKNAK_IATINCY_TIMIR on pago 237. Wlon llo
ACKNAK_IATINCY_ TIMIR oxpiros or oxcoods ils sol vaIuo and TIIs aro
rocoivod, an ACK DIII vill a Soquonco Numbor of llo Iasl good TII is
rolurnod lo llo lransmillor.
PCI Express System Architecture
232
Wlon llo rocoivor scloduIos an ACK DIII lo bo rolurnod lo llo romolo lrans-
millor, llo rocoivor migll lavo ollor pacIols (TIIs, DIIIs or IIIs) onquouod
llal aIso lavo lo bo lransmillod on llo IinI in llo samo diroclion as llo ACK
DIII. Tlis impIios llal llo rocoivor may nol immodialoIy rolurn llo ACK
DIII lo llo lransmillor, ospociaIIy if a Iargo TII (vill up lo a 4KB dala pay-
Ioad) is aIroady boing lransmillod (soo Rocommondod Iriorily To ScloduIo
IacIols on pago 244).
Tlo rocoivor conlinuos lo rocoivo TIIs and as Iong as lloro aro no doloclod
orrors (ICRC or Soquonco Numbor orrors), il forvards llo TIIs lo llo Transac-
lion Iayor. Wlon llo rocoivor las llo opporlunily lo rolurn llo ACK DIII lo
llo romolo lransmillor, il apponds llo Soquonco Numbor of llo Ialosl good TII
rocoivod and rolurns llo ACK DIII. Upon rocoipl of llo ACK DIII, llo romolo
lransmillor purgos ils RopIay Buffor of llo TIIs vill malcling Soquonco Num-
bors and aII TIIs lransmillod oarIior llan llo acInovIodgod TII.
ExampIe of Receiver ACK ScheduIing
: Considor Iiguro 5-11 on pago 233, vill focus on llo rocoivor Dovico B.
1. Dovico A lransmils TIIs vill Soquonco Numbors 4094, 4095, 0, 1, and 2,
vloro TII 4094 is llo firsl TII sonl and TII 2 is llo Iasl TII sonl.
2. Dovico B rocoivos TIIs vill Soquonco Numbors 4094, 4095, 0, and 1, in llal
ordor. NIXT_RCV_SIQ counl incromonls lo 2. TII 2 is sliII on roulo.
3. Dovico B porforms orror clocIs and issuos a coaIoscod ACK lo coIIoclivoIy
acInovIodgo rocoipl of TIIs 4094, 4095, 0, and 1, vill llo rolurn of an ACK
DIII vill Soquonco Numbor of 1.
4. Dovico B forvards TIIs 4094, 4095, 0, and 1 lo ils Transaclion Iayor.
5. Wlon Dovico B uIlimaloIy rocoivos TII 2, slops 3 and 4 may bo ropoalod for
TII 2.
Chapter 5: ACK/NAK Protocol
233
NAK ScheduIed FIag
Tlo rocoivor impIomonls a IIag bil roforrod lo as llo NAK_SCHIDUIID fIag.
Wlon a rocoivor dolocls a TII CRC orror, or any ollor non-CRC roIalod orror
llal roquiros il lo scloduIo a NAK DIII lo bo rolurnod, llo rocoivor sols llo
NAK_SCHIDUIID fIag and cIoars il vlon llo rocoivor dolocls ropIayod TIIs
from llo lransmillor for vlicl lloro aro no CRC orrors.
Receiver ScheduIes a NAK
Upon rocoipl of a TII, llo firsl lypo of orror condilion llo rocoivor may dolocl is
a TII ICRC orror (soo Rocoivod TII Irror ClocI on pago 230). Tlo rocoivor
discards llo bad TII. If llo NAK_SCHIDUIID fIag is cIoar, il scloduIos a
NAK DIII lo rolurn lo llo lransmillor. Tlo NAK_SCHIDUIID fIag is llon
sol. Tlo rocoivor usos llo NIXT_RCV_SIQ counl - 1 counl vaIuo as llo
AcINaI_Soq_Num |11:0] fioId in llo NAK DIII (TabIo 5-1 on pago 219). Al llo
limo llo rocoivor scloduIos a NAK DIII lo rolurn lo llo lransmillor, llo IinI
may bo in uso lo lransmil ollor quouod TIIs, DIIIs or IIIs. In llal caso, llo
-
Replay Buffer Receive Buffer
4094
4095
0
1
2
From Transaction Layer
Transmitter Device A
4094
4095
0
1
2
To Transaction Layer
Receiver Device B
1
ACK
ACK/NAK
Generator
Link
Earlier TLP
Later TLP
Earlier TLP
Later TLP
PCI Express System Architecture
234
rocoivor doIays llo lransmission of llo NAK DIII (soo Rocommondod Irior-
ily To ScloduIo IacIols on pago 244). Wlon llo IinI bocomos avaiIabIo, lov-
ovor, il sonds llo NAK DIII lo llo romolo lransmillor. Tlo lransmillor ropIays
llo TIIs from llo RopIay Buffor (soo TII RopIay on pago 225).
In llo moanlimo, TIIs curronlIy on roulo conlinuo lo arrivo al llo rocoivor.
Tloso TIIs lavo Ialor Soquonco Numbors llan llo NIXT_RCV_SIQ counl. Tlo
rocoivor discards llom. Tlo spocificalion is uncIoar aboul vlollor llo rocoivor
slouId scloduIo a NAK DIII for lloso TIIs. Il is llo aullors inlorprolalion
llal llo rocoivor musl nol scloduIo llo rolurn of addilionaI NAK DIIIs for
subsoquonlIy rocoivod TIIs vliIo llo NAK_SCHIDUIID fIag romains sol.
Tlo rocoivor dolocls a ropIayod TII vlon il rocoivos a TII vill Soquonco
Numbors llal malclos NIXT_RCV_SIQ counl. If llo ropIayod TIIs arrivo vill
no orrors, llo rocoivor incromonls NIXT_RCV_SIQ counl and cIoars llo
NAK_SCHIDUIID fIag. Tlo rocoivor may scloduIo an ACK DIII for rolurn
lo llo lransmillor if llo ACKNAK_IATINCY_TIMIR oxpiros. Tlo good
ropIayod TIIs aro forvardod lo llo Transaclion Iayor.
Tloro is a socond sconario undor vlicl llo rocoivor scloduIos NAK DIIIs lo
rolurn lo llo lransmillor. If llo rocoivor dolocls a TII vill a Ialor Soquonco
Numbor llan llo noxl oxpoclod Soquonco Numbor indicalod by
NIXT_RCV_SIQ counl or for vlicl llo TII las a Soquonco Numbor llal is
soparalod from NIXT_RCV_SIQ counl by moro llan 2048, llo abovo doscribod
procoduro is ropoalod. Soo Rocoivor Soquonco Numbor ClocI boIov for llo
roasons vly llis couId lappon.
Tlo lvo orror condilions jusl doscribod vloroin a NAK DIII is scloduIod for
rolurn aro roporlod as orrors associalod vill llo Dala IinI Iayor. Tlo orror
roporlod is a bad TII orror vill a sovorily of corroclabIo.
Receiver Sequence Number Check
Ivory rocoivod TII llal passos llo CRC clocI goos llrougl a Soquonco Num-
bor clocI. Tlo rocoivod TIIs Soquonco Numbor is comparod vill llo
NIXT_RCV_SIQ counl. BoIov aro llroo possibiIilios:
- . Tlis silualion
rosuIls vlon a good TII is rocoivod. Il aIso occurs vlon a ropIayod TII is
rocoivod. Tlo TII is accoplod and forvardod lo llo Transaclion Iayor.
NIXT_RCV_SIQ counl is incromonlod and an ACK DIII may bo sclod-
uIod (according lo llo ACK DIII scloduIing ruIos doscribod in Rocoivor
ScloduIos An ACK DIII on pago 231).
Chapter 5: ACK/NAK Protocol
235
- - --
Tlis silualion rosuIls vlon a dupIicalo TII is
rocoivod as llo rosuIl of a ropIay ovonl. Tlo dupIicalo TII is discardod.
NIXT_RCV_SIQ counl is nol incromonlod. An ACK DIII is scloduIod so
llal llo lransmillor can purgo ils RopIay Buffor of llo dupIicalo TII(s). Tlo
rocoivor usos llo NIXT_RCV_SIQ counl - 1 in llo ACK DIIIs
AcINaI_Soq_Num|11:0] fioId. Wlal sconario rosuIls in a dupIicalo TII
boing rocoivod` Considor llis oxampIo. A rocoivor accopls a TII and
rolurns an associalod ACK DIII and incromonls llo NIXT_RCV_SIQ
counl. Tlo ACK DIII is Iosl on roulo lo llo lransmillor. As a rosuIl, llis
TII romains in llo romolo lransmillors RopIay Buffor. Tlo lransmillors
RIIIAY_TIMIR oxpiros vlon no furllor ACK DIIIs aro rocoivod. Tlis
causos llo lransmillor lo ropIay llo onliro conlonls of llo RopIay Buffor. Tlo
rocoivor soos lloso TIIs vill oarIior Soquonco Numbors llan llo
NIXT_RCV_SIQ counl and discards llom bocauso lloy aro dupIicalo TIIs.
Moro procisoIy, a TII is a dupIicalo TII if:

An ACK DIII is rolurnod for ovory dupIicalo TII rocoivod.
- -
. Tlis silualion rosuIls vlon ono or moro TIIs aro
Iosl on roulo. Tlo rocoivor scloduIos a NAK DIII for rolurn lo llo lrans-
millor if NAK_SCHIDUIID fIag is cIoar (soo NAK DIII scloduIing ruIos
doscribod in Rocoivor ScloduIos a NAK on pago 233). NIXT_RCV_SIQ
counl doos nol incromonl vlon llo rocoivor rocoivos sucl TIIs of Ialor
Soquonco Numbor.
Receiver Preserves TLP Ordering
In addilion lo guaranlooing roIiabIo TII lransporl, llo ACK/NAK prolocoI pro-
sorvos pacIol ordoring. Tlo rocoivors Transaclion Iayor rocoivos TIIs in llo
samo ordor llal llo lransmillor sonl llom.
A lransmillor corroclIy ordors TIIs according lo llo ordoring ruIos boforo lrans-
mission in ordor lo mainlain corrocl program fIov and lo oIiminalo llo occur-
ronco of polonliaI doadIocI and IivoIocI condilions (soo Claplor 8, onlilIod
"Transaclion Ordoring," on pago 315). Tlo Rocoivor is roquirod lo prosorvo TII
ordor (ollorviso, appIicalion program fIov is aIlorod). To prosorvod llis ordor,
llo rocoivor appIios llroo ruIos:
- Wlon llo rocoivor dolocls a bad TII, il discards llo TII and aII nov TIIs
llal foIIov in llo pipoIino unliI llo ropIayod TIIs aro doloclod.
- AIso, dupIicalo TIIs aro discardod.
- TIIs rocoivod aflor ono or moro Iosl TIIs aro rocoivod aro discardod.
PCI Express System Architecture
236
Ior TIIs llal arrivo aflor llo firsl bad TII, llo molivalion lo discard lloso
TIIs, nol forvard llom lo llo Transaclion Iayor and scloduIo a NAK DIII is
as foIIovs. Wlon llo rocoivor dolocls a bad TII, il discards il and any nov TIIs
in llo pipoIino. Tlo rocoivor llon vails for TII ropIay. Aflor vorifying llal lloro
aro no orrors in llo ropIayod TII(s), llo rocoivor forvards llom lo llo Transac-
lion Iayor and rosumos accoplanco of nov TIIs in llo pipoIino. Doing so pro-
sorvos TII rocoivo and accoplanco ordor al llo rocoivors Transaclion Iayor.
ExampIe of Receiver NAK ScheduIing
: Considor Iiguro 5-12 on pago 237 vill omplasis on llo rocoivor
Dovico B.
1. Dovico A lransmils TIIs vill Soquonco Numbors 4094, 4095, 0, 1, and 2,
vloro TII 4094 is llo firsl TII sonl and TII 2 is llo Iasl TII sonl.
2. Dovico B rocoivos TIIs 4094, 4095, and 0, in llal ordor. TIIs 1 and 2 aro sliII
in fIigll.
3. Dovico B rocoivos TII 4094 vill no orrors and forvards il lo llo Transac-
lion Iayor. NIXT_RCV_SIQ counl incromonls lo 4095.
4. Dovico B dolocls an ICRC orror in TII 4095 and lonco rolurns a NAK
DIII vill a Soquonco Numbor of 4094 (NIXT_RCV_SIQ counl - 1). Tlo
NAK_SCHIDUIID fIag is sol. NIXT_RCV_SIQ counl doos nol incromonl.
5. Dovico B discards TII 4095.
6. Dovico B aIso discards TII 0, ovon llougl il is a good TII. AIso TII 1 and
2 aro discardod vlon lloy arrivo.
7. Dovico B doos nol scloduIo a NAK DIII for TII 0, 1 and 2 bocauso llo
NAK_SCHIDUIID fIag is sol.
8. Dovico A rocoivos NAK 4094.
9. Dovico A doos nol accopl any nov TIIs from ils Transaclion Iayor.
10. Dovico A firsl purgos TII 4094.
11. Dovico A llon ropIays TIIs 4095, 0, 1, and 2, bul conlinuos lo savo lloso
TIIs in llo RopIay Buffor. Il llon accopls TIIs from llo Transaclion Iayor.
12. RopIayod TIIs 4095, 0, 1, and 2 arrivo al Dovico B in llal ordor.
13. Aflor vorifying llal lloro aro no CRC orrors in llo rocoivod TIIs, dovico B
dolocls TII 4095 as a ropIayod TII bocauso il las a Soquonco Numbor
oquaI lo NIXT_RCV_SIQ counl. NAK_SCHIDUIID fIag is cIoarod.
14. Dovico B forvards lloso TIIs lo llo Transaclion Iayor in llis ordor: 4095, 0,
1, and 2.
Chapter 5: ACK/NAK Protocol
237
Receivers ACKNAK_LATENCY_TIMER
Tlo ACKNAK_IATINCY_TIMIR moasuros llo duralion sinco an ACK or
NAK DIII vas scloduIod for rolurn lo llo romolo lransmillor. Tlis limor las a
vaIuo llal is approximaloIy 1/3 llal of llo lransmillor RIIIAY_TIMIR. Wlon
llo limor oxpiros, llo rocoivor scloduIos an ACK DIII vill a Soquonco Num-
bor of llo Iasl good unacInovIodgod TII rocoivod. Tlo limor guaranloos llal
llo rocoivor scloduIos an ACK or NAK DIII for a rocoivod TII boforo llo
lransmillors RIIIAY_TIMIR oxpiros causing il lo ropIay.
Tlo limor rosols lo 0 and roslarls vlon an ACK or NAK DIII is scloduIod.
Tlo limor rosols lo 0 and loIds vlon:
- AII rocoivod TIIs lavo boon acInovIodgod.
- Tlo Dala IinI Iayor is in llo inaclivo slalo.
- - -
Replay Buffer Receive Buffer
4094
4095
0
1
2
From Transaction Layer
Transmitter Device A
4094
4095
0
1 2
To Transaction Layer
Receiver Device B
Good TLP
Good TLP
4094
NAK
ACK/NAK
Generator
Link
4095 0
Replayed TLPs TLPs still in route
1 2
Earlier TLP
Later TLP
Bad TLP
PCI Express System Architecture
238
Tlo rocoivors ACKNAK_
IATINCY_TIMIR is Ioadod vill a vaIuo llal rofIocls llo vorsl-caso lrans-
mission Ialoncy in sonding an ACK or NAK in rosponso lo a rocoivod TII.
Tlis limo doponds on llo anlicipalod maximum payIoad sizo and llo vidll
of llo IinI.
Tlo oqualion lo caIcuIalo llo ACKNAK_IATINCY_TIMIR vaIuo roquirod
is:
Tlo vaIuo in llo limor roprosonls symboI limos (a symboI limo = 4 ns).
Tlo fioIds abovo aro dofinod as foIIovs:
- is llo vaIuo in llo Max_IayIoad_Sizo fioId of llo
Dovico ConlroI Rogislor (soo pago 900).
- incIudos llo addilionaI TII fioIds boyond llo dala pay-
Ioad (loador, digosl, ICRC, and Slarl/Ind framing symboIs). In llo
spocificalion, llo ovorload vaIuo is lroalod as a conslanl of 28 symboIs.
- Tlo is llo biggosl numbor of maximum-sizod TIIs (basod
on Max_IayIoad) vlicl can bo rocoivod boforo an ACK DIII is sonl.
Tlo AI vaIuo (ils a fudgo faclor) rangos from 1.0 lo 3.0, and is usod lo
baIanco IinI bandvidll officioncy and RopIay Buffor sizo. Iiguro 5-10
on pago 229 summarizos llo AcI Iaclor vaIuos for various IinI vidlls
and payIoads. Tloso AcI Iaclor vaIuos aro closon lo aIIov impIomon-
lalions lo acliovo good porformanco villoul roquiring a Iargo, unoco-
nomicaI buffor.
- rangos from 1-bil vido lo 32-bils vido.
- is llo rocoivors inlornaI doIay bolvoon rocoiving a TII,
procossing il al llo Dala IinI Iayor, and rolurning an ACK or NAK
DIII. Il is lroalod as a conslanl of 19 symboI limos in lloso caIcuIalions.
- --: If I0s is onabIod, llo limo roquirod for llo lrans-
millor lo oxil I0s, oxprossod in symboI limos. Nolo llal solling llo
Ixlondod Sync bil of llo IinI ConlroI rogislor affocls llo oxil limo from
I0s and musl bo laIon inlo accounl in llis adjuslmonl.
Il lurns oul llal llo onlrios in llis labIo aro approximaloIy a llird in vaIuo of
llo RIIIAY_TIMIR Ialoncy vaIuos in Iiguro 5-10 on pago 229.
Iiguro 5-13 on pago
239 is a summary labIo llal slovs possibIo limor Ioad vaIuos vill various
variabIos pIuggod inlo llo ACKNAK_IATINCY_TIMIR oqualion.
Chapter 5: ACK/NAK Protocol
239
Error Situations ReIiabIy HandIed by ACK/NAK ProtocoI
Tlis soclion doscribos llo possibIo sourcos of orrors llal may occur in doIivory
of TIIs from a lransmillor lo a rocoivor across a IinI. Tlo ACK/NAK prolocoI
guaranloos roIiabIo doIivory of TIIs dospilo llo unIiIoIy ovonl llal lloso orrors
occur. BoIov is a buIIol Iisl of orrors and llo roIalod orror corroclion moclanism
llo prolocoI usos lo rosoIvo llo orror:
- : CRC orror occurs in lransmission of a TII (soo Transmillors
Rosponso lo a NAK DIII on pago 224 and Rocoivor ScloduIos a NAK
on pago 233.)
: Rocoivor dolocls ICRC orror and scloduIos a NAK DIII vill
Soquonco Numbor = NIXT_RCV_SIQ counl - 1. Transmillor ropIays TIIs.
- : Ono or moro TIIs aro Iosl on roulo lo llo rocoivor.
: Tlo rocoivor porforms a soquonco numbor clocI on aII rocoivod
TIIs. Tlo rocoivor oxpocls TIIs lo arrivo vill oacl TII llal las an incro-
monlod 12-bil Soquonco Numbor from llal in llo provious TII. If ono or
moro TIIs aro Iosl on roulo, a TII viII lavo a Soquonco Numbor issuod
Ialor llan oxpoclod Soquonco Numbor rofIoclod in llo NIXT_RCV_SIQ
counl. Tlo rocoivor scloduIos a NAK DIII vill a Soquonco Numbor =
NIXT_RCV_SIQ counl - 1. Transmillor ropIays llo RopIay Buffor conlonls.

4143
(AF=1.0)
2095
(AF=1.0)
1071
(AF=1.0)
559
(AF=1.0)
416
(AF=1.4)
237
(AF=1.4)
X1
Link
2081
(AF=1.0)
1057
(AF=1.0)
545
(AF=1.0)
289
(AF=1.0)
217
(AF=1.4)
128
(AF=1.4)
X2
Link
1050
(AF=1.0)
538
(AF=1.0)
282
(AF=1.0)
154
(AF=1.0)
118
(AF=1.4)
73
(AF=1.4)
X4
Link
534
(AF=1.0)
278
(AF=1.0)
150
(AF=1.0)
86
(AF=1.0)
107
(AF=2.5)
67
(AF=2.5)
X8
Link
706
(AF=2.0)
365
(AF=2.0)
194
(AF=2.0)
109
(AF=2.0)
90
(AF=3.0)
58
(AF=3.0)
X12
Link
534
(AF=2.0)
278
(AF=2.0)
150
(AF=2.0)
86
(AF=2.0)
72
(AF=3.0)
48
(AF=3.0)
x16
Link
276
(AF=2.0)
148
(AF=2.0)
84
(AF=2.0)
52
(AF=2.0)
45
(AF=3.0)
33
(AF=3.0)
X32
Link
4096 Bytes
2048 Bytes
1024 Bytes
512 Bytes
256 Bytes
128 Bytes
Max_Payload
Size
4143
(AF=1.0)
2095
(AF=1.0)
1071
(AF=1.0)
559
(AF=1.0)
416
(AF=1.4)
237
(AF=1.4)
X1
Link
2081
(AF=1.0)
1057
(AF=1.0)
545
(AF=1.0)
289
(AF=1.0)
217
(AF=1.4)
128
(AF=1.4)
X2
Link
1050
(AF=1.0)
538
(AF=1.0)
282
(AF=1.0)
154
(AF=1.0)
118
(AF=1.4)
73
(AF=1.4)
X4
Link
534
(AF=1.0)
278
(AF=1.0)
150
(AF=1.0)
86
(AF=1.0)
107
(AF=2.5)
67
(AF=2.5)
X8
Link
706
(AF=2.0)
365
(AF=2.0)
194
(AF=2.0)
109
(AF=2.0)
90
(AF=3.0)
58
(AF=3.0)
X12
Link
534
(AF=2.0)
278
(AF=2.0)
150
(AF=2.0)
86
(AF=2.0)
72
(AF=3.0)
48
(AF=3.0)
x16
Link
276
(AF=2.0)
148
(AF=2.0)
84
(AF=2.0)
52
(AF=2.0)
45
(AF=3.0)
33
(AF=3.0)
X32
Link
4096 Bytes
2048 Bytes
1024 Bytes
512 Bytes
256 Bytes
128 Bytes
Max_Payload
Size
PCI Express System Architecture
240
- : Rocoivor rolurns an ACK DIII, bul il is corruplod on roulo lo llo
lransmillor. Tlo romolo Transmillor dolocls a CRC orror in llo DIII (DIII
is covorod by 16-bil CRC, soo ACK/NAK DIII Iormal on pago 219). In
facl, llo lransmillor doos nol Inov llal llo maIformod DIII jusl rocoivod
is supposod lo bo an ACK DIII. AII il Inovs is llal llo pacIol is a DIII.
:
- Tlo Transmillor discards llo DIII. A subsoquonl ACK DIII
rocoivod vill a Ialor Soquonco Numbor causos llo lransmillor RopIay
Buffor lo purgo aII TIIs vill oquaI and oarIior gonoralod Soquonco
Numbors. Tlo lransmillor novor Inov llal anylling vonl vrong.
- Tlo Transmillor discards llo DIII. A subsoquonl NAK DIII
rocoivod vill a Ialor gonoralod Soquonco Numbor causos llo lransmil-
lor RopIay Buffor lo purgo TIIs vill oquaI lo an oarIior Soquonco Num-
bors. Tlo lransmillor llon ropIay aII TIIs vill Ialor Soquonco Numbors
liII llo Iasl TII in llo RopIay Buffor. Tlo lransmillor novor Inov llal
anylling vonl vrong.
- : ACK or NAK DIII for rocoivod TIIs aro nol rolurnod by llo
rocoivor by llo propor ACKNAK_IATINCY_TIMIR limo-oul. Tlo associ-
alod TIIs romain in llo lransmillor RopIay Buffor.
: Tlo RIIIAY_TIMIR limos-oul and llo lransmillor ropIays ils
RopIay Buffor.
- : Tlo Rocoivor rolurns a NAK DIII bul il is corruplod on roulo lo
llo lransmillor. Tlo romolo Transmillor dolocls a CRC orror in llo DIII. In
facl, llo lransmillor doos nol Inov llal llo DIII rocoivod is supposod lo
bo an NAK DIII. AII il Inovs is llal llo pacIol is a DIII.
: Tlo Transmillor discards llo DIII. Tlo rocoivor discards aII sub-
soquonlIy rocoivod TIIs and avails llo ropIay. Givon llal llo NAK vas
rojoclod by llo lransmillor, ils RIIIAY_TIMIR oxpiros and lriggors llo
ropIay.
- : Duo lo an orror in llo rocoivor, il is unabIo lo scloduIo an ACK or
NAK DIII for a rocoivod TII.
: Tlo lransmillor RIIIAY_TIMIR viII oxpiro and rosuIl in TII
ropIay.
Chapter 5: ACK/NAK Protocol
241
ACK/NAK ProtocoI Summary
Rofor lo Iiguro 5-3 on pago 212 and llo foIIoving subsoclions for a summary of
llo oIomonls of llo Dala IinI Iayor.
Transmitter Side
Non-Error Case (ACK DLLP Management)
- UnIoss bIocIod by llo Dala IinI Iayor, llo Transaclion Iayor passos dovn
llo Hoador, Dala, and Digosl informalion for oacl TII lo bo sonl.
- Iacl TII is assignod a 12-bil Soquonco Numbor using curronl
NIXT_TRANSMIT_SIQ counl.
- A clocI is mado lo soo if llo accoplanco of nov TIIs from llo Transaclion
Iayor slouId bo bIocIod. Tlo lransmillor porforms a moduIo 4096 sublrac-
lion of llo ACKD_SIQ counl from llo NIXT_TRANSMIT_SIQ counl lo
soo if llo rosuIl is >= 2048d. If il is, furllor TIIs aro bIocIod unliI incoming
ACK/NAK DIIIs rondor llo oqualion unlruo.
- Tlo NIXT_TRANSMIT_SIQ counlor incromonls by ono for oacl TII pro-
cossod. Nolo: if llo lransmillor vanls lo nuIIify a TII boing sonl, il sonds an
invorlod CRC lo llo plysicaI Iayor and indicalos an IDB ond (Ind Bad
IacIol) symboI slouId bo usod (NIXT_TRANSMIT_SIQ is nol incro-
monlod). Soo llo Svilcl Cul-Tlrougl Modo on pago 248 for dolaiIs.
- A 32-bil ICRC vaIuo is caIcuIalod for llo TII (llo ICRC caIcuIalion
incIudos llo Soquonco Numbor).
- A copy of llo TII is pIacod in llo RopIay Buffor and llo TII is forvardod
lo llo IlysicaI Iayor for lransmission.
- Tlo IlysicaI Iayor adds STI and IND framing symboIs, llon lransmils llo
pacIol.
- Al a Ialor limo, assumo llo lransmillor rocoivos an ACK DIII from llo
rocoivor. Il porforms a CRC orror clocI and, if llo clocI faiIs, discards llo
ACK DIII (llo samo loIds lruo if a bad NAK DIII is rocoivod). If llo
clocI is OK, il purgos llo RopIay buffor of TIIs from llo oIdosl TII up lo
and incIuding llo TII vill Soquonco Numbor llal malclos llo Soquonco
Numbor in llo ACK DIII.
PCI Express System Architecture
242
Error Case (NAK DLLP Management)
Ropoal llo procoss doscribod in llo provious soclion, bul llis limo, assumo llal
llo lransmillor rocoivos a NAK DIII:
- Upon rocoipl of llo NAK DIII vill no CRC orror, llo lransmillor foIIovs
llo foIIoving soquonco of slops in porforming llo RopIay. NOTI: llis is llo
samo soquonco of ovonls vlicl vouId occur if llo RIIIAY_TIMIR oxpiros
insload.
Tlo RIIIAY_NUM is incromonlod. Tlo maximum numbor of allompls
lo cIoar (ACK) aII unacInovIodgod TIIs in llo RopIay Buffor is four.
If llo RIIIAY_NUM counl roIIs ovor from 11b lo 00b, llo lransmillor
inslrucls llo IlysicaI Iayor lo ro-lrain llo IinI.
If RIIIAY_NUM doos nol roII ovor, procood.
BIocI accoplanco of nov TIIs from llo Transaclion Iayor.
CompIolo lransmission of any TIIs in progross.
Iurgo any TIIs of oquaI or oarIior Soquonco Numbors llan NAK
DIIIs AcINaI_Soq_Num|11:0].
Ro-lransmil TIIs vill Ialor Soquonco Numbors llan llo NAK DIIIs
AcINaI_Soq_Num|11:0].
ACK DIIIs or NAK DIIIs rocoivod during ropIay musl bo procossod.
Tlo lransmillor may disrogard llom unliI ropIay is compIolo or uso
llom during ropIay lo sIip lransmission of novIy acInovIodgod TIIs.
IarIior Soquonco Numbors can bo coIIapsod vlon an ACK DIII is
rocoivod vill a Ialor Soquonco Numbor. AIso, ACK DIIIs vill Ialor
Soquonco Numbors llan a NAK DIII rocoivod oarIior suporsodo llo
oarIior NAK DIII.
Wlon llo ropIay is compIolo, unbIocI TIIs and rolurn lo normaI opora-
lion.
Receiver Side
Non-Error Case
TIIs aro rocoivod al llo IlysicaI Iayor vloro lloy aro clocIod for framing
orrors and ollor rocoivor-roIalod orrors. Assumo llal lloro aro no orrors. If llo
IlysicaI Iayor roporls llo ond symboI vas IDB and llo CRC vaIuo vas
invorlod, llis is nol an orror condilion, discard llo pacIol and froo any aIIocalod
spaco (soo Svilcl Cul-Tlrougl Modo on pago 248). Tloro viII bo no ACK or
NAK DIII rolurnod for llis caso.
Chapter 5: ACK/NAK Protocol
243
Tlo soquonco of slops porformod aro as foIIovs:
- CaIcuIalo llo CRC for llo incoming TII and clocI il againsl llo ICRC pro-
vidod vill llo pacIol. If llo CRC passos, go lo llo noxl slop.
- Comparo llo Soquonco Numbor for llo inbound pacIol againsl llo curronl
vaIuo in llo NIXT_RCV_SIQ counl.
- If lloy aro llo samo, llis is llo noxl oxpoclod TII. Iorvard llo TII lo llo
Transaclion Iayor. AIso incromonl llo NIXT_RCV_SIQ counl.
- CIoar llo NAK_SCHIDUIID fIag if sol.
- If llo ACKNAK_IATINCY_TIMIR oxpiros, scloduIo and ACK DIII vill
AcINaI_Soq_Num|11:0] = NIXT_RCV_SIQ counl - 1.
Error Case
TIIs aro rocoivod al llo IlysicaI Iayor vloro lloy aro clocIod for framing
orrors and ollor rocoivor-roIalod orrors. In llo ovonl of an orror, llo IlysicaI
Iayor discards llo pacIol, roporls llo orror, and froos any slorago aIIocalod for
llo TII. If llo IDB is sol and llo CRC is nol invorlod, llis is a bad pacIol: dis-
card llo TII and sol llo orror fIag. If llo NAK_SCHIDUIID fIag is cIoar, sol il,
and scloduIo a NAK DIII vill llo NIXT_RCV_SIQ counl - 1 vaIuo usod as
llo Soquonco Numbor.
- If lloro aro no IlysicaI Iayor orrors doloclod, forvard llo TII lo llo Dala
IinI Iayor.
- CaIcuIalo llo CRC for llo incoming TII and clocI il againsl llo ICRC pro-
vidod vill llo pacIol. If llo CRC faiIs, sol llo NAK_SCHIDUIID fIag.
ScloduIo a NAK DIII vill NIXT_RCV_SIQ counl - 1 usod as llo
Soquonco Numbor. If ICRC orror clocI passos, go lo llo noxl buIIol.
- If llo ICRC clocI passos, llon comparo llo Soquonco Numbor for llo
inbound pacIol againsl llo curronl vaIuo in llo NIXT_RCV_SIQ counl. If
llo TII Soquonco Numbor is nol oquaI lo NIXT_RCV_SIQ counl and if
(NIXT_RCV_SIQ - TII Soquonco Numbor) mod 4096 <= 2048, llo TII is a
dupIicalo TII. Discard llo TII, and scloduIo an ACK vill
NIXT_RCV_SIQ counl - 1 vaIuo usod as AcINaI_Soq_Num|11:0].
- Discard TIIs rocoivod vill Soquonco Numbor ollor llan llo Soquonco
Numbor doscribod by llo abovo buIIol. If llo NAK_SCHIDUIID fIag is
cIoar, sol il, and scloduIo a NAK DIII vill NIXT_RCV_SIQ counl - 1
usod as AcINaI_Soq_Num|11:0]. If llo NAK _SCHIDUIID fIag bil is
aIroady sol, Ioop il sol and do nol scloduIo a NAK DIII.
PCI Express System Architecture
244
Recommended Priority To ScheduIe Packets
A dovico may lavo many lypos of TIIs, DIIIs and IIIs lo lransmil on a givon
IinI. Tlo foIIoving is a rocommondod bul nol roquirod sol of priorilios for
scloduIing pacIols:
1. CompIolion of any TII or DIII curronlIy in progross (liglosl priorily).
2. III lransmissions.
3. NAK DIII.
4. ACK DIII.
5. IC (IIov ConlroI) DIII.
6. RopIay Buffor ro-lransmissions.
7. TIIs llal aro vailing in llo Transaclion Iayor.
8. AII ollor DIII lransmissions (Iovosl priorily)
Some More ExampIes
To domonslralo llo roIiabIo TII doIivory capabiIily providod by llo ACK/NAK
IrolocoI, llo foIIoving oxampIos aro providod.
Lost TLP
Considor Iiguro 5-14 on pago 245 vlicl slovs llo ACK/NAK prolocoI for
landIing Iosl TIIs.
1. Dovico A lransmils TIIs 4094, 4095, 0, 1, and 2.
2. Dovico B rocoivos TIIs 4094, 4095, and 0, for vlicl il rolurns ACK 0. Tloso
TIIs aro forvardod lo llo Transaclion Iayor. NIXT_RCV_SIQ is incro-
monlod and llo noxl vaIuo of NIXT_RCV_SIQ counl is 1. Dovico B is roady
lo rocoivo TII 1.
3. Sooing ACK 0, Dovico A purgos TIIs 4094, 4095, and 0 from ils ropIay
buffor.
4. TII 1 is Iosl on roulo.
5. TII 2 arrivos insload. Upon porforming a Soquonco Numbor clocI, Dovico
B roaIizos llal TII 2s Soquonco Numbor is groalor llan NIXT_RCV_SIQ
counl.
6. Dovico B discards TII 2 and scloduIos NAK 0 (NIXT_RCV_SIQ counl - 1).
7. Upon rocoipl of NAK 0, Dovico A ropIays TIIs 1 and 2.
8. TIIs 1 and 2 arrivo villoul orror al Dovico B and aro forvardod lo llo
Transaclion Iayor.
Chapter 5: ACK/NAK Protocol
245
Lost ACK DLLP or ACK DLLP with CRC Error
Considor Iiguro 5-15 on pago 246 vlicl slovs llo ACK/NAK prolocoI for
landIing a Iosl ACK DIII.
1. Dovico A lransmils TIIs 4094, 4095, 0, 1, and 2.
2. Dovico B rocoivos TIIs 4094, 4095, and 0, for vlicl il rolurns ACK 0. Tloso
TIIs aro forvardod lo llo Transaclion Iayor. NIXT_RCV_SIQ is incro-
monlod and llo noxl vaIuo of NIXT_RCV_SIQ counl is sol lo 1.
3. ACK 0 is Iosl on roulo. TIIs 4094, 4095, and 0 romain in Dovico As RopIay
Buffor.
4. TIIs 1 and 2 arrivo al Dovico B slorlIy lloroaflor. NIXT_RCV_SIQ counl
incromonls lo 3.
5. Dovico B rolurns ACK 2 and sonds TIIs 1 and 2 lo llo Transaclion Iayor.
6. ACK 2 arrivos al Dovico A.
7. Dovico A purgos ils RopIay Buffor of TIIs 4094, 4095, 0, 1, and 2.
-
Replay Buffer Receive Buffer
4094
4095
0
1
2
From Transaction Layer
Transmitter Device A
4094
4095
0
To Transaction Layer
Receiver Device B
Good TLP
Good TLP
0
ACK
ACK/NAK
Generator
Link
Replayed TLPs
1 2
Earlier TLP
Later TLP
Good TLP
NEXT_RCV_SEQ
= 1
2
0
NAK
Replay
PCI Express System Architecture
246
Tlo oxampIo vouId bo llo samo if a CRC orror oxislod in ACK pacIol 0. Dovico
A vouId dolocl llo CRC orror in ACK 0 and discard il. Wlon rocoivod Ialor,
ACK 2 vouId causo llo RopIay Buffor lo purgo aII TIIs (4094 llrougl 2).
If ACK 2 is aIso Iosl or corruplod, and no furllor ACK or NAK DIIIs aro
rolurnod lo Dovico A, ils RIIIAY_TIMIR viII oxpiro. Tlis rosuIls in ropIay of
ils onliro buffor. Dovico B rocoivos TII 4094, 4095, 0, 1 and 2 and dolocls llom as
dupIicalo TIIs bocauso lloir Soquonco Numbors aro oarIior llan
NIXT_RCV_SIQ counl of 3. Tloso TIIs aro discardod and ACK DIIIs vill
AcINaI_Soq_Num|11:0] = 2 aro rolurnod lo Dovico A for oacl dupIicalo TII.
Lost ACK DLLP foIIowed by NAK DLLP
Considor Iiguro 5-16 on pago 247 vlicl slovs llo ACK/NAK prolocoI for
landIing a Iosl ACK DIII foIIovod by a vaIid NAK DIII.
1. Dovico A lransmils TIIs 4094, 4095, 0, 1, and 2.
2. Dovico B rocoivos TIIs 4094, 4095, and 0, for vlicl il rolurns ACK 0. Tloso
TIIs aro forvardod lo llo Transaclion Iayor. NIXT_RCV_SIQ is incro-
-
Replay Buffer Receive Buffer
4094
4095
0
1
2
From Transaction Layer
Transmitter Device A
4094
4095
0
To Transaction Layer
Receiver Device B
Good TLP
Good TLP
2
ACK
ACK/NAK
Generator
Link
1
Earlier TLP
Later TLP
Good TLP
NEXT_RCV_SEQ
= 1, then
3
2
0
ACK
Purge
Chapter 5: ACK/NAK Protocol
247
monlod and llo noxl vaIuo of NIXT_RCV_SIQ counl is 1.
3. ACK 0 is Iosl on roulo. TIIs 4094, 4095, and 0 romain in Dovico As RopIay
Buffor.
4. TIIs 1 and 2 arrivo al Dovico B slorlIy lloroaflor. TII 1 is good and
NIXT_RCV_SIQ counl incromonls lo 2. TII 1 is forvardod lo llo Transac-
lion Iayor.
5. TII 2 is corrupl. NIXT_RCV_SIQ counl romains al 2.
6. Dovico B rolurns a NAK vill a Soquonco Numbor of 1 and discards TII 2.
7. NAK 1 arrivos al Dovico A.
8. Dovico A firsl purgos TII 4094, 4095, 0 and 1
9. Dovico A ropIays TII 2.
10. TII 2 arrivo al Dovico B. Tlo NIXT_RCV_SIQ counl is 2.
11. Dovico B accopls good TII 2 and forvards il lo llo Transaclion Iayor.
NIXT_RCV_SIQ incromonls lo 3.
12. Dovico B may rolurn an ACK vill a Soquonco Numbor of 2 if llo
ACKNAK_IATINCY_TIMIR oxpiros.
13. Upon rocoipl of ACK 2, Dovico A purgos TII 2.
-
Replay Buffer Receive Buffer
4094
4095
0
1
2
From Transaction Layer
Transmitter Device A
4094
4095
0
To Transaction Layer
Receiver Device B
Good TLP
Good TLP
1
ACK
ACK/NAK
Generator
Link
1
Earlier TLP
Later TLP
Good TLP
NEXT_RCV_SEQ
= 2
2
0
NAK
Replayed TLP
2
Bad TLP
Good TLP Purge
Replay
PCI Express System Architecture
248
Switch Cut-Through Mode
ICI Ixpross supporls a svilcl-roIalod foaluro llal aIIovs TII lransfor Ialoncy
llrougl a svilcl lo bo significanlIy roducod. Tlis foaluro is roforrod lo as llo
cul-llrougl modo. Willoul llis foaluro, llo propagalion limo llrougl a
svilcl couId bo significanl.
Without Cut-Through Mode
Background
Considor an oxampIo vloro a Iargo TII noods lo pass llrougl a svilcl from
ono porl lo anollor. UnliI llo laiI ond of llo TII is rocoivod by llo svilcls
ingross porl, llo svilcl is unabIo lo dolormino if lloro is a CRC orror. TypicaIIy,
llo svilcl viII nol forvard llo pacIol llrougl llo ogross porl unliI il dolor-
minos llal lloro is no CRC orror. Tlis impIios llal llo Ialoncy llrougl llo
svilcl is al Ioasl llo limo lo cIocI llo pacIol inlo llo svilcl. If llo pacIol noods
lo pass llrougl many svilclos lo gol lo llo finaI doslinalion, llo Ialoncios
vouId add up, incroasing llo limo lo gol from sourco lo doslinalion.
PossibIe SoIution
Ono oplion lo roduco Ialoncy vouId bo lo slarl forvarding llo TII llrougl llo
svilcls ogross porl boforo llo laiI ond of llo TII las boon rocoivod by llo
svilcl ingross porl. Tlis is fino as Iong as llo pacIol is nol corruplod. Considor
vlal vouId lappon if llo TII voro corrupl. Tlo pacIol vouId bogin lransmil-
ling llrougl llo ogross porl boforo llo svilcl roaIizod llal lloro is an orror.
Aflor llo svilcl dolocls llo CRC orror, il vouId rolurn a NAK lo llo TII sourco
and discard llo pacIol, - - -
--- -. Tloro is no poinl Iooping a
copy of llo bad TII in llo ogross porl RopIay Buffor bocauso il is bad. Tlo TII
sourco porl vouId al a Ialor limo ropIay aflor rocoiving llo NAK DIII. Tlo TII
is aIroady oulbound and on roulo lo llo Indpoinl doslinalion. Tlo Indpoinl
rocoivos llo pacIol, dolocls a CRC orror, and rolurns a NAK lo llo svilcl. Tlo
svilcl is oxpoclod lo ropIay llo TII, bul llo svilcl las aIroady discardod llo
TII duo lo llo doloclod orror on llo inbound TII. Tlo svilcl is slucI bolvoon
a rocI and a lard pIaco!
Chapter 5: ACK/NAK Protocol
249
Switch Cut-Through Mode
Background
Tlo ICI Ixpross prolocoI pormils llo impIomonlalion of an oplionaI foaluro
roforrod lo as cul-llrougl modo. Cul-llougl is llo abiIily lo slarl slroaming a
pacIol llrougl a svilcl villoul vailing for llo rocoipl of llo laiI ond of llo
pacIol. If, uIlimaloIy, a CRC orror is doloclod vlon llo CRC is rocoivod al llo
laiI ond of llo pacIol, llo pacIol llal las aIroady bogun lransmission from llo
svilcl ogross porl can bo nuIIifiod.
A pacIol is a pacIol llal lorminalos vill an IDB symboI as opposod
lo an IND. Il aIso las an invorlod 32-bil ICRC.
ExampIe That Demonstrates Switch Cut-Through Feature
Considor llo oxampIo in Iiguro 5-17 llal iIIuslralos llo cul-llougl modo of a
svilcl.
A TII vill Iargo dala payIoad passos from llo Iofl, llrougl llo svilcl, lo llo
Indpoinl on llo rigll. Tlo slops as llo pacIol is roulod llrougl llo svilcl aro
as foIIovs:
1. A TII is inbound lo a svilcl. WliIo on roulo, llo pacIols conlonls is cor-
ruplod.
2. Tlo TII loador al llo load of llo TII is docodod by llo svilcl and llo
pacIol is forvardod lo llo ogross porl boforo llo svilcl bocomos avaro of a
CRC orror. IinaIIy, llo laiI ond of llo pacIol arrivos in llo svilcl ingross
porl and il is abIo lo compIolo a CRC clocI.
3. Tlo svilcl dolocls a CRC orror for vlicl llo svilcl rolurns a NAK DIII
lo llo TII sourco.
4. On llo ogross porl, llo svilcl ropIacos llo IND framing symboI al llo laiI
ond of llo bad TII vill llo IDB (Ind Bad) symboI. Tlo CRC is aIso
invorlod from vlal il vouId normaIIy bo. Tlo TII is nov nuIIifiod. Onco
llo TII las oxilod llo svilcl, llo svilcl discards ils copy from llo RopIay
Buffor.
5. Tlo nuIIifiod pacIol arrivos al llo Indpoinl. Tlo Indpoinl dolocls llo IDB
symboI and llo invorlod CRC and discards llo pacIol.
6. Tlo Indpoinl doos nol rolurn a NAK DIII (ollorviso llo svilcl vouId bo
obIigod lo ropIay).
Wlon llo TII sourco dovico rocoivos llo NAK DIII, il ropIays llo pacIol. Tlis
PCI Express System Architecture
250
limo no orror occurs on llo svilcls ingross porl. As llo pacIol arrivos in llo
svilcl, llo loador is docodod and llo TII is forvardod lo llo ogross porl vill
vory slorl Ialoncy. Wlon llo laiI ond of llo TII arrivos al llo svilcl, a CRC
clocI is porformod. Tloro is no orror, so an ACK is rolurnod lo llo TII sourco
vlicl llon purgos ils ropIay buffor. Tlo svilcl sloros a copy of llo TII in ils
ogross porl RopIay Buffor. Wlon llo TII roaclos llo doslinalion Indpoinl, llo
Indpoinl dovico porforms a CRC clocI. Tlo pacIol is a good pacIol lorminalod
vill llo IND framing symboI. Tloro aro no CRC orrors and so llo Indpoinl
rolurns an ACK DIII lo llo svilcl. Tlo svilcl purgos llo copy of llo TII
from ils RopIay Buffor. Tlo pacIol las boon roulod from sourco lo doslinalion
vill minimaI Ialoncy.

Switch
Endpoint
STP END
NAK
TLP
Error occurs
1) 2)
STP END TLP
4)
STP EDB TLP
6) No ACK or NAK
3)
STP EDB TLP
5) Discard Packet
251
--

The Previous Chapter

Tlo provious claplor dolaiIod llo AcI/NaI IrolocoI llal vorifios llo doIivory
of TIIs bolvoon oacl porl as lloy lravoI bolvoon llo roquoslor and compIolor
dovicos. Tlis claplor dolaiIs llo lardvaro rolry moclanism llal is aulomali-
caIIy lriggorod vlon a TII lransmission orror is doloclod on a givon IinI.
This Chapter
Tlis claplor discussos Traffic CIassos, VirluaI ClannoIs, and Arbilralion llal
supporl QuaIily of Sorvico concopls in ICI Ixpross impIomonlalions. Tlo con-
copl of QuaIily of Sorvico in llo conloxl of ICI Ixpross is an allompl lo prodicl
llo bandvidll and Ialoncy associalod vill llo fIov of difforonl lransaclion
slroams lravorsing llo ICI Ixpross fabric. Tlo uso of QoS is basod on appIica-
lion-spocific soflvaro assigning Traffic CIass (TC) vaIuos lo lransaclions, vlicl
dofino llo priorily of oacl lransaclion as il lravoIs bolvoon llo Roquoslor and
CompIolor dovicos. Iacl TC is mappod lo a VirluaI ClannoI (VC) llal is usod lo
manago lransaclion priorily via lvo arbilralion sclomos caIIod porl and VC
arbilralion.
The Next Chapter
Tlo noxl claplor discussos llo purposos and dolaiIod oporalion of llo IIov
ConlroI IrolocoI. Tlis prolocoI roquiros oacl dovico lo impIomonl crodil-basod
IinI fIov conlroI for oacl virluaI clannoI on oacl porl. IIov conlroI guaranloos
llal lransmillors viII novor sond Transaclion Iayor IacIols (TIIs) llal llo
rocoivor canl accopl. Tlis provonls rocoivo buffor ovor-runs and oIiminalos llo
nood for inofficionl disconnocls, rolrios, and vail-slalos on llo IinI. IIov Con-
lroI aIso loIps onabIo compIianco vill ICI Ixpross ordoring ruIos by mainlain-
ing soparalo virluaI clannoI IIov ConlroI buffors for llroo lypos of lransaclions:
Ioslod (I), Non-Ioslod (NI) and CompIolions (CpI).
PCI Express System Architecture
252
QuaIity of Service
QuaIily of Sorvico (QoS) is a gonoric lorm llal normaIIy rofors lo llo abiIily of a
nolvorI or ollor onlily (in our caso, ICI Ixpross) lo provido prodiclabIo Ialoncy
and bandvidll. QoS is of parlicuIar inlorosl vlon appIicalions roquiro guaran-
lood bus bandvidll al roguIar inlorvaIs, sucl as audio dala. To loIp doaI vill
llis lypo of roquiromonl ICI Ixpross dofinos isoclronous lransaclions llal
roquiro a ligl dogroo of QoS. Hovovor, QoS can appIy lo any lransaclion or
sorios of lransaclions llal musl lravorso llo ICI Ixpross fabric. Nolo llal QoS
can onIy bo supporlod vlon llo syslom and dovico-spocific soflvaro is ICI
Ixpross avaro.
QoS can invoIvo many oIomonls of porformanco incIuding:
- Transmission ralo
- Iffoclivo Bandvidll
- Ialoncy
- Irror ralo
- Ollor paramolors llal affocl porformanco
SovoraI foaluros of ICI Ixpross arclilocluro provido llo moclanisms llal maIo
QoS acliovabIo. Tlo ICI Ixpross foaluros llal supporl QoS incIudo:
- Traffic CIassos (TCs)
- VirluaI ClannoIs (VCs)
- Iorl Arbilralion
- VirluaI ClannoI Arbilralion
- IinI IIov ConlroI
ICI Ixpross usos lloso foaluros lo supporl lvo gonoraI cIassos of lransaclions
llal can bonofil from llo ICI Ixpross impIomonlalion of QoS.
-- -- from Iso (samo) + clronous (limo), lloso lransac-
lions roquiro a conslanl bus bandvidll al roguIar inlorvaIs aIong vill guaran-
lood Ialoncy. Isoclronous lransaclions aro mosl oflon usod vlon a synclronous
connoclion is roquirod bolvoon lvo dovicos. Ior oxampIo, a CD-ROM drivo
conlaining a music CD may bo sourcing dala lo spoaIors. A synclronous con-
noclion oxisls vlon a loadsol is pIuggod diroclIy inlo llo drivo. Hovovor, vlon
llo audio card is usod lo doIivor llo audio informalion lo a sol of oxlornaI
spoaIors, isoclronous lransaclions may bo usod lo simpIify llo doIivory of llo
dala.
Chapter 6: QoS/TCs/VCs and Arbitration
253
-- -- Tlis cIass of lransaclions invoIvos a vido vari-
oly of appIicalions llal lavo vidoIy varying roquiromonls for bandvidll and
Ialoncy. QoS can provido llo moro domanding appIicalions (lloso roquiring
liglor bandvidll and slorlor Ialoncios) vill liglor priorily llan llo Ioss
domanding appIicalions. In llis vay, soflvaro can oslabIisl a liorarcly of lraf-
fic cIassos for lransaclions llal pormils difforonlialion of lransaclion priorily
basod on lloir roquiromonls. Tlo spocificalion rofors lo llis capabiIily as diffor-
onlialod sorvicos.
Isochronous Transaction Support
ICI Ixpross supporls QoS and llo associalod TC, VC, and arbilralion mocla-
nisms so llal isoclronous lransaclions can bo porformod. A cIassic oxampIo of a
dovico llal bonofils from isoclronous lransaclion supporl is a vidoo camora
allaclod lo a lapo docI. Tlis roaI-limo appIicalion roquiros llal imago and
audio dala bo lransforrod al a conslanl ralo (o.g., 64 framos/socond). Tlis lypo
of appIicalion is lypicaIIy supporlod via a dirocl synclronous allaclmonl
bolvoon llo lvo dovicos.
Synchronous Versus Isochronous Transactions
Tvo dovicos connoclod diroclIy porform synclronous lransfors. A synclronous
sourco doIivors dala diroclIy lo llo synclronous sinI llrougl uso of a common
roforonco cIocI. In our oxampIo, llo vidoo camora (synclronous sourco) sonds
audio and vidoo dala lo llo lapo docI (synclronous sinI), vlicl immodialoIy
sloros llo dala in roaI limo vill IillIo or no dala bufforing, and vill onIy a sIigll
doIay duo lo signaI propagalion.
Wlon lloso dovicos aro connoclod via ICI Ixpross a synclronous connoclion is
nol possibIo. Insload, ICI Ixpross omuIalos synclronous connoclions llrougl
llo uso of isoclronous lransaclions and dala bufforing. In llis sconario, isoclro-
nous lransaclions can bo usod lo onsuro llal a conslanl amounl of dala is doIiv-
orod al spocifiod inlorvaIs (100ks in llis oxampIo), llus aclioving llo roquirod
lransmission claraclorislics. Considor llo foIIoving soquonco (Rofor lo Iiguro
6-1 on pago 254):
1. Tlo synclronous sourco (vidoo camora and ICI Ixpross inlorfaco) accumu-
Ialos dala in Buffor A during sorvico inlorvaI 1 (SI 1).
2. Tlo camora doIivors llo accumuIalod dala lo llo synclronous sinI (lapo
docI) somolimo during llo noxl sorvico inlorvaI (SI 2). Tlo camora aIso
accumuIalos llo noxl bIocI of dala in Buffor B as llo conlonls of Buffor A is
doIivorod.
PCI Express System Architecture
254
3. Tlo lapo docI buffors llo incoming dala (in ils Buffor A), vlicl can llon bo
doIivorod synclronousIy for rocording on lapo during sorvico inlorvaI 3.
During SI 3 llo camora onco again accumuIalos dala inlo Buffor A, and llo
cycIo ropoals.
-- -
Chapter 6: QoS/TCs/VCs and Arbitration
255
Isochronous Transaction Management
Managomonl of an isoclronous communicalions clannoI is basod on a Traffic
CIass (TC) vaIuo and an associalod VirluaI ClannoI (VC) numbor llal soflvaro
assigns during iniliaIizalion. Hardvaro compononls incIuding llo Roquoslor of
a lransaclion and aII dovicos in llo pall bolvoon llo roquoslor and compIolor
aro configurod lo lransporl llo isoclronous lransaclions from IinI lo IinI via a
li-priorily virluaI clannoI.
Tlo roquoslor inilialos isoclronous lransaclions llal incIudo a TC vaIuo ropro-
sonling llo dosirod QoS. Tlo Roquoslor injocls isoclronous pacIols inlo llo fab-
ric al llo roquirod ralo (sorvico inlorvaI), and aII dovicos in llo pall bolvoon llo
Roquoslor and CompIolor musl bo configurod lo supporl llo lransporl of llo
isoclronous lransaclions al llo spocifiod inlorvaI. Any inlormodialo dovico
aIong llo pall musl convorl llo TC lo llo associalod VC usod lo conlroI lransac-
lion arbilralion. Tlis arbilralion rosuIls in llo dosirod bandvidll and Ialoncy
for lransaclions vill llo assignod TC. Nolo llal llo TC vaIuo romains conslanl
for a givon lransaclion vliIo llo VC numbor may clango from IinI lo IinI.
Differentiated Services
Various lypos of asynclronous lraffic (aII lraffic ollor llan isoclronous) lavo
difforonl priorily from llo syslom porspoclivo. Ior oxampIo, ollornol lraffic
roquiros liglor priorily (smaIIor Ialoncios) llan mass slorago lransaclions. ICI
Ixpross soflvaro can oslabIisl difforonl TC vaIuos and associalod virluaI clan-
noIs and can sol up llo communicalions palls lo onsuro difforonl doIivory poIi-
cios aro oslabIislod as roquirod. Nolo llal llo spocificalion doos nol dofino
spocific mollods for idonlifying doIivory roquiromonls or llo poIicios lo bo usod
vlon solling up difforonlialod sorvicos.
Perspective on QOS/TC/VC and Arbitration
ICI doos nol incIudo any QoS-roIalod foaluros simiIar lo lloso dofinod by ICI
Ixpross. Many quoslions ariso rogarding llo nood for sucl an oIaboralo sclomo
for managing lraffic fIov basod on QoS and difforonlialod sorvicos. Willoul
impIomonling lloso nov foaluros, llo bandvidll avaiIabIo vill a ICI Ixpross
syslom is far groalor and Ialoncios mucl slorlor llan ICI-basod impIomonla-
lions, duo primariIy lo llo lopoIogy and liglor doIivory ralos. ConsoquonlIy,
asido from llo possibIo advanlago of isoclronous lransaclions, lloro appoars lo
bo IillIo advanlago lo impIomonling sysloms llal supporl muIlipIo Traffic
PCI Express System Architecture
256
CIassos and VirluaI ClannoIs.
WliIo llis may bo lruo for mosl dosIlop ICs, ollor ligl-ond appIicalions may
bonofil significanlIy from lloso nov foaluros. Tlo ICI Ixpross spocificalion aIso
opons llo door lo appIicalions llal domand llo abiIily lo difforonlialo and man-
ago syslom lraffic basod on Traffic CIass priorilizalion.
Traffic CIasses and VirtuaI ChanneIs
During iniliaIizalion a ICI Ixpross dovico-drivor communicalos llo IovoIs of
QoS llal il dosiros for ils lransaclions, and llo oporaling syslom rolurns TC vaI-
uos llal corrospond lo llo QoS roquoslod. Tlo TC vaIuo uIlimaloIy dolorminos
llo roIalivo priorily of a givon lransaclion as il lravorsos llo ICI Ixpross fabric.
Tvo lardvaro moclanisms provido guaranlood isoclronous bandvidll and
difforonlialod sorvicos:
- VirluaI ClannoI Arbilralion
- Iorl Arbilralion
Tloso arbilralion moclanisms uso VC numbors lo manago lransaclion priorily.
Syslom configuralion soflvaro musl assign VC IDs and sol up llo associalion
bolvoon llo lraffic cIass assignod lo a lransaclion and llo virluaI clannoI lo bo
usod vlon lravorsing oacl IinI. Tlis is dono via VC configuralion rogislors
mappod villin llo oxlondod configuralion addross spaco. Tlo Iisl of lloso rog-
islors and lloir Iocalion villin configuralion spaco is iIIuslralod in Iiguro 6-2.
Chapter 6: QoS/TCs/VCs and Arbitration
257
Tlo TC vaIuo is carriod in llo lransaclion pacIol loador and can conlain ono of
oigll vaIuos (TC0-TC7). TC0 musl bo impIomonlod by aII ICI Ixpross dovicos
and llo syslom maIos a bosl offorl vlon doIivoring lransaclions vill llo TC0
IaboI. TC vaIuos of TC1-TC7 aro oplionaI and provido sovon IovoIs of arbilralion
for difforonlialing bolvoon pacIol slroams llal roquiro varying amounls of
bandvidll. SimiIarIy, oigll VC numbors (VC0-VC7) aro spocifiod, vill VC0
roquirod and VC1-VC7 oplionaI. (VC Assignmonl and TC Mapping on
pago 258 discussos VC iniliaIizalion).
Nolo llal TC0 is lardvirod lo VC0 in aII dovicos. If configuralion soflvaro is
nol ICI Ixpross avaro aII lransaclions viII uso llo dofauIl TC0 and VC0,
lloroby oIiminaling llo possibiIily of supporling difforonlialod sorvicos and iso-
clronous lransaclions. Iurllormoro, llo spocificalion roquiros somo lransaclion
lypos lo uso TC0/VC0 oxcIusivoIy:
- Configuralion
- I/O
-- --
PCI Express System Architecture
258
- INTx Mossago
- Iovor Managomonl Mossago
- Irror SignaIing Mossago
- UnIocI Mossago
- Sol_SIol_Iovor_Iimil Mossago
VC Assignment and TC Mapping
Configuralion soflvaro dosignod for ICI Ixpross sols up virluaI clannoIs for
oacl IinI in llo fabric. RocaII llal llo dofauIl TC and VC assignmonls foIIoving
CoId Rosol viII bo TC0 and VC0, vlicl is usod vlon llo configuralion soflvaro
is nol ICI Ixpross avaro. Tlo numbor of virluaI clannoIs usod doponds on llo
groalosl capabiIily slarod by llo lvo dovicos allaclod lo a givon IinI. Soflvaro
assigns an ID for oacl VC and maps ono or moro TCs lo oacl.
Determining the Number of VCs to be Used
Soflvaro clocIs llo numbor of VCs supporlod by llo dovicos allaclod lo a com-
mon IinI and assigns llo groalosl numbor of VCs llal boll dovicos lavo in com-
mon. Ior oxampIo, considor llo llroo dovicos allaclod lo llo svilcl in Iiguro 6-
3 on pago 259. In llis oxampIo, llo svilcl supporls aII 8 VCs on oacl of ils porls,
vliIo Dovico A supporls onIy llo dofauIl VC, Dovico B supporls 4 VC s, and
Dovico C supporl 8 VCs. Wlon configuring VCs for oacl IinI, soflvaro dolor-
minos llo maximum numbor of VCs supporlod by boll dovicos al oacl ond of
llo IinI and assigns llal numbor lo boll dovicos. Tlo VC assignmonl appIios lo
lransaclions fIoving across a IinI in boll diroclions.
Chapter 6: QoS/TCs/VCs and Arbitration
259
Nolo llal ovon llougl svilcl porl A supporls aII 8 VCs Dovico A supporls a
singIo VC, Ioaving 7 VCs unusod villin svilcl porl A. SimiIarIy, 4 VCs aro usod
by svilcl porl B. Soflvaro of courso configuros and onabIos aII 8 VCs villin
svilcl porl C.
Configuralion soflvaro dolorminos llo maximum numbor of VCs supporlod by
oacl porl inlorfaco by roading ils fioId conlainod villin llo
VirluaI ClannoI CapabiIily rogislors. Tlo smaIIor of llo lvo vaIuos govorns
llo maximum numbor of VCs supporlod by llis IinI for boll lransmission and
rocoplion of lransaclions. Iiguro 6-4 on pago 260 iIIuslralos llo Iocalion and for-
mal of llo Ixlondod VC Counl fioId. Soflvaro may roslricl llo numbor of VCs
configurod and onabIod lo fovor llan acluaIIy aIIovod. Tlis may bo dono lo
acliovo llo QoS dosirod for a givon pIalform or appIicalion.
-
PCI Express System Architecture
260
Assigning VC Numbers (IDs)
Configuralion soflvaro musl assign VC numbors or IDs lo oacl of llo virluaI
clannoIs, oxcopl VC0 vlicl is aIvays lardvirod. As iIIuslralod in Iiguro 6-5 on
pago 261, llo VC CapabiIilios rogislors incIudo 3 DWs usod for configuring oacl
VC. Tlo firsl sol of rogislors (slarling al offsol 10l) aIvays appIios lo VC0. Tlo
- fioId (doscribod abovo) dofinos llo numbor of addilionaI VC
rogislor sols impIomonlod by llis porl, oacl of vlicl pormils configuralion of
an addilionaI VC. Nolo llal lloso rogislor sols aro mappod in configuralion
spaco diroclIy foIIoving llo VC0 rogislors. Tlo mapping is oxprossod as an off-
sol from oacl of llo llroo VC0 DW rogislors:
- 10l + (n

0Cl)
- 14l + (n

0Cl)
- 18l + (n

0Cl)
-
Chapter 6: QoS/TCs/VCs and Arbitration
261
Tlo vaIuo n roprosonls llo numbor of addilionaI VCs impIomonlod. Ior
oxampIo, if llo - conlains a vaIuo of 3, llon n=1, 2, and 3 for
llo llroo addilionaI rogislor sols. Nolo llal lloso numbors simpIy idonlify llo
rogislor sols for oacl VC supporlod and is nol llo VC ID.
Soflvaro assigns a VC ID for oacl of llo addilionaI VCs boing usod via llo
fioId villin llo VCn Rosourco ConlroI Rogislor. (Soo Iiguro 6-5) Tloso IDs
aro nol roquirod lo bo assignod conliguous vaIuos, bul llo samo VC vaIuo can bo
usod onIy onco.
- -
PCI Express System Architecture
262
Assigning TCs to each VC TC/VC Mapping
Tlo Traffic CIass vaIuo assignod by a roquoslor lo oacl lransaclion musl bo asso-
cialod vill a VC as il lravorsos oacl IinI on ils journoy lo llo rocipionl. AIso, llo
VC ID associalod vill a givon TC may clango from IinI lo IinI. Configuralion
soflvaro oslabIislos llis associalion during iniliaIizalion via llo
fioId of llo VC Rosourco ConlroI Rogislor. Tlis 8-bil fioId pormils any TC vaIuo
lo bo mappod lo llo soIoclod VC, vloro oacl bil posilion roprosonls llo corro-
sponding TC vaIuo (i.o., bil 0 = TC0:: bil 7 = TC7). Solling a bil assigns llo corro-
sponding TC vaIuo lo llo VC ID. Iiguro 6-6 slovs a mapping oxampIo vloro
TC0 and TC1 aro mappod lo VC0 and TC2::TC4 aro mappod lo VC3.
Soflvaro is pormillod a groal doaI of fIoxibiIily in assigning VC IDs and map-
ping llo associalod TCs. Hovovor, llo spocificalion slalos sovoraI ruIos associ-
alod vill llo TC/VC mapping:
- TC/VC mapping musl bo idonlicaI for llo lvo porls allaclod lo llo samo
IinI.
- Ono TC musl nol bo mappod lo muIlipIo VCs in any ICI Ixpross Iorl.
- Ono or muIlipIo TCs can bo mappod lo a singIo VC.
TabIo 6-1 on pago 263 Iisls a varioly of combinalions llal may bo impIomonlod.
Tlis is inlondod onIy lo iIIuslralo a fov combinalions, and many moro aro possi-
bIo.

Chapter 6: QoS/TCs/VCs and Arbitration
263
Arbitration
Tvo lypos of lransaclion arbilralion provido llo mollod for managing isoclro-
nous lransaclions and difforonlialod sorvicos:
- dolorminos llo priorily of lransac-
lions boing lransmillod from llo samo porl, basod on lloir VC ID.
- dolorminos llo priorily of lransaclions vill llo samo
VC assignmonl al llo ogross porl, basod on llo priorily of llo porl al vlicl
llo lransaclions arrivod. Iorl arbilralion appIios lo lransaclions llal lavo
llo samo VC ID al llo ogross porl, lloroforo a porl arbilralion moclanism
oxisls for oacl virluaI clannoI supporlod by llo ogross porl.
-
--
TC0 VC0 DofauIl solling, usod by aII lransaclions.
TC0-TC1
TC2-TC7
VC0
VC7
VCs aro nol roquirod lo bo assignod consoculivoIy.
MuIlipIo TCs can bo assignod lo a singIo VC.
TC0
TC1
TC6
TC7
VC0
VC1
VC6
VC7
SovoraI lransaclion lypos musl uso TC0/VC0. (1)
TCs aro nol roquirod lo bo assignod consoculivoIy.
Somo TC/VC combinalions can bo usod lo supporl
an isoclronous connoclion.
TC0
TC1
TC2
TC3
TC4
TC5
TC6
TC7
VC0
VC1
VC2
VC3
VC4
VC5
VC6
VC7
AII TCs can bo assignod lo llo corrosponding VC
numbors.
TC0
TC1-TC4
VC0
VC6
Tlo VC numbor llal is assignod nood nol malcl
ono of llo corrosponding TC numbors.
TC0
TC1-TC2
TC2
VC0
VC1
VC2
. A TC numbor can bo assignod lo onIy ono
VC numbor. Tlis oxampIo slovs TC2 mappod lo
boll VC1 and VC2, vlicl is nol aIIovod.
PCI Express System Architecture
264
Arbilralion is aIso affoclod by llo roquiromonls associalod vill lransaclion
ordoring and fIov conlroI. Tloso addilionaI roquiromonls aro discussod in sub-
soquonl claplors, bul aro monlionod in llo conloxl of arbilralion as roquirod in
llo foIIoving discussions.
VirtuaI ChanneI Arbitration
In addilion lo supporling QoS objoclivos, VC arbilralion slouId aIso onsuro llal
forvard progross is mado for aII lransaclions. Tlis provonls inadvorlonl spIil
lransaclion limo-ouls. Any dovico llal boll inilialos lransaclions and supporls
lvo or moro VCs musl impIomonl VC arbilralion. Iurllormoro, ollor dovico
lypos llal supporl moro llan ono VC (o.g., svilclos) musl aIso supporl VC arbi-
lralion.
VC arbilralion aIIovs a lransmilling dovico lo dolormino llo priorily of lransac-
lions basod on lloir VC assignmonl. Koy claraclorislics of VCs llal aro roIovanl
lo VC arbilralion incIudo:
- Iacl VC supporlod and onabIod providos ils ovn buffors and fIov conlroI.
- Transaclions mappod lo llo samo VC aro issuod in slricl ordor (unIoss llo
RoIaxod Ordoring allribulo bil is sol).
- No ordoring roIalionslip oxisls bolvoon lransaclions assignod lo difforonl
VCs.
Iiguro 6-7 on pago 265 iIIuslralos llo concopl of VC arbilralion. In llis oxampIo
lvo VCs aro impIomonlod (VC0 and VC1) and lransmission priorily is basod on
a 3:1 ralio, vloro 3 VC1 lransaclions aro sonl lo oacl VC0 lransaclion. Tlo
dovico coro issuos lransaclions (llal incIudo a TC vaIuo) lo llo TC/VC Mapping
Iogic. Basod on llo associalod VC vaIuo, llo lransaclion is roulod lo llo appro-
prialo VC buffor vloro il avails lransmission. Tlo VC arbilor dolorminos llo
VC buffor priorily vlon sonding lransaclions.
Tlis oxampIo iIIuslralos llo fIov of lransaclion in onIy ono diroclion. Tlo samo
Iogic oxisls for lransmilling lransaclions simuIlanoousIy in llo opposilo diroc-
lion. Tlal is, llo rool porl aIso conlains lransmil buffors and an arbilor and llo
ondpoinl dovico conlains rocoivo buffors.
Chapter 6: QoS/TCs/VCs and Arbitration
265
A varioly of VC arbilralion moclanisms may bo ompIoyod by a givon dosign.
Tlo mollod closon by llo dosignor is spocifiod villin llo VC capabiIily rogis-
lors. In gonoraI, lloro aro llroo approaclos llal can bo laIon:
- Slricl Iriorily Arbilralion for aII VCs
- SpIil Iriorily Arbilralion VCs aro sogmonlod inlo Iov- and ligl-priorily
groups. Tlo Iov-priorily group usos somo form of round robin arbilralion
and llo ligl-priorily group usos slricl priorily.
- Round robin priorily (slandard or voigllod) arbilralion for aII VCs
Strict Priority VC Arbitration
Tlo spocificalion dofinos a dofauIl priorily sclomo basod on llo inloronl prior-
ily of VC IDs (VC0=Iovosl priorily and VC7=liglosl priorily). Tlo arbilralion
moclanism is lardvaro basod, and roquiros no configuralion. Iiguro 6-8 iIIus-
lralos a slricl priorily arbilralion oxampIo llal incIudos aII VCs. Tlo VC ID gov-
orns llo ordor in vlicl lransaclions aro sonl. Tlo maximum numbor of VCs

PCI Express System Architecture
266
llal uso slricl priorily arbilralion cannol bo groalor llan llo vaIuo in llo
fioId. (Soo Iiguro 6-4 on pago 260.) Iurllormoro, if llo
dosignor las closon slricl priorily arbilralion for aII VCs supporlod, llo
fioId of Iorl VC CapabiIily Rogislor 1 is lardvirod lo
zoro. (Soo Iiguro 6-9 on pago 267.)
Slricl priorily roquiros llal VCs of liglor priorily gol procodonco ovor Iovor
priorily VCs basod on llo VC ID. Ior oxampIo, if aII oigll VCs aro govornod by
slricl priorily, lransaclions vill a VC ID of VC0 can onIy bo sonl vlon no lrans-
aclions aro ponding lransmission in VC1-VC7. In somo circumslancos slricl pri-
orily can rosuIl in Iovor priorily lransaclions boing slarvod for bandvidll and
oxporioncing oxlromoIy Iong Ialoncios. ConvorsoIy, llo liglosl priorily lransac-
lions rocoivo vory ligl bandvidll vill minimaI Ialoncios. Tlo spocificalion
roquiros llal ligl priorily lraffic bo roguIalod lo avoid slarvalion, and furllor
dofinos lvo mollods of roguIalion:
- Tlo originaling porl can manago llo injoclion ralo of ligl priorily lransac-
lions, lo pormil groalor bandvidll for Iovor priorily lransaclions.
- Svilclos can roguIalo muIlipIo dala fIovs al llo ogross porl llal aro vying
for IinI bandvidll. Tlis mollod may Iimil llo llrouglpul from ligl band-
vidll appIicalions and dovicos llal allompl lo oxcood llo Iimilalions of llo
avaiIabIo bandvidll.

Chapter 6: QoS/TCs/VCs and Arbitration
267
Tlo dosignor of a dovico may aIso Iimil llo numbor of VCs llal parlicipalo in
slricl priorily by spocifying a spIil bolvoon llo Iov- and ligl-priorily VCs as
discussod in llo noxl soclion.
Low- and High-Priority VC Arbitration
Iiguro 6-9 on pago 267 iIIuslralos llo fioId
villin VC CapabiIily Rogislor 1. Tlis road-onIy fioId spocifios a VC ID vaIuo
llal idonlifios llo uppor Iimil of llo Iov-priorily arbilralion group for llo
dosign. Ior oxampIo, if llis counl conlains a vaIuo of 4, llon VC0-VC4 aro mom-
bors of llo Iov-priorily group and VC5-VC7 uso slricl priorily. Nolo llal a
of 7 moans llal no slricl priorily is usod.
As dopiclod in Iiguro 6-11 on pago 269, llo ligl-priorily VCs conlinuo lo uso
slricl priorily arbilralion, vliIo llo Iov-priorily arbilralion group usos ono of
llo ollor priorilizalion mollods supporlod by llo dovico. VC CapabiIily Rogis-
lor 2 roporls vlicl aIlornalo arbilralion mollods aro supporlod for llo Iov pri-

PCI Express System Architecture
268
orily group, and llo VC ConlroI Rogislor pormils soIoclion of llo mollod lo bo
usod by llis group. Soo Iiguro 6-10 on pago 268. Tlo Iov-priorily arbilralion
sclomos incIudo:
- Hardvaro Basod Iixod Arbilralion Sclomo llo spocificalion pormils llo
vondor lo dofino a lardvaro-basod fixod arbilralion sclomo llal providos
aII VCs vill llo samo priorily. (o.g. round robin).
- Woigllod Round Robin (WRR) vill WRR somo VCs can bo givon liglor
priorily llan ollors bocauso lloy lavo moro posilions villin llo round
robin llan ollors. Tlo spocificalion dofinos llroo WRR configuralions, oacl
vill a difforonl numbor of onlrios (or plasos).
-
Chapter 6: QoS/TCs/VCs and Arbitration
269
Tlis soIoclion dofinos a lard-
varo-basod VC arbilralion sclomo llal roquiros no addilionaI soflvaro
solup. Tlo spocificalion monlions slandard Round Robin arbilralion as an
oxampIo sclomo llal llo dosignor may clooso. In sucl a sclomo, lransac-
lions ponding lransmission villin oacl Iov-priorily VC aro sonl during
oacl pass llrougl llo round robin. Tlo spocificalion doos nol procIudo
ollor impIomonlalion-spocific sclomos.
Tlo voigllod round
robin (WRR) approacl pormils soflvaro lo configuro llo VC Arbilralion
labIo. Tlo numbor of arbilralion labIo onlrios supporlod by llo dosign is
roporlod in llo fioId of Iorl VC CapabiIily Rogislor
2. Tlo labIo sizo is soIoclod by vriling llo corrosponding vaIuo in lo llo
fioId of llo Iorl VC ConlroI Rogislor. Soo Iiguro 6-10 on
pago 268. Iacl onlry in llo labIo roprosonls ono plaso llal soflvaro Ioads
vill a Iov priorily VC ID vaIuo. Tlo VC arbilor ropoalodIy scans aII labIo
onlrios in a soquonliaI faslion and sonds lransaclions from llo VC buffor
spocifiod in llo labIo onlrios. Onco a lransaclion las boon sonl, llo arbilor
immodialoIy procoods lo llo noxl plaso.
Soflvaro can sol up llo VC arbilralion labIo sucl llal somo VCs aro Iislod in
moro onlrios llan ollors, lloroby, aIIoving difforonlialion of QoS bolvoon
llo VCs. Tlis givos soflvaro considorabIo fIoxibiIily in oslabIisling llo
dosirod priorily. Iiguro 6-12 on pago 270 dopicls llo voigllod round robin
VC arbilralion concopl.
-
PCI Express System Architecture
270
Round Robin Arbitration (EquaI or Weighted) for AII VCs
Tlo lardvaro dosignor may clooso lo impIomonl ono of llo round robin forms
of VC arbilralion for aII VCs. Tlis is accompIislod by spocifying llo liglosl VC
numbor supporlod by llo dovico as a mombor of llo Iov priorily group (via llo
- fioId. In llis caso, aII VC priorilios aro managod
via llo VC arbilralion labIo. Nolo llal llo VC arbilralion labIo is nol usod vlon
llo Hardvaro Iixod Round Robin sclomo is soIoclod. Soo pago 269.
Loading the VirtuaI ChanneI Arbitration TabIe
Tlo VC Arbilralion TabIo (VAT) is Iocalod al an offsol from llo boginning of llo
oxlondod configuralion spaco as indicalod by llo VC Arbilralion TabIo Offsol
fioId. Tlis offsol is conlainod villin Iorl VC CapabiIily Rogislor 2. (Soo Iiguro
6-13 on pago 271.)

Chapter 6: QoS/TCs/VCs and Arbitration
271
Rofor lo Iiguro 6-14 on pago 272 during llo foIIoving discussion. Iacl onlry
villin llo VAT is a 4-bil fioId llal idonlifios llo VC ID of llo virluaI clannoI
buffor llal is scloduIod lo doIivor dala during llis corrosponding plaso. Tlo
labIo Iongll is a funclion of llo lardvaro dosign and llo arbilralion sclomo
soIoclod if cloicos aro supporlod by llo dosign as iIIuslralod in Iiguro 6-10 on
pago 268.
- -
PCI Express System Architecture
272
Tlo labIo is Ioadod by configuralion soflvaro lo acliovo llo priorily ordor
dosirod for llo virluaI clannoIs. Hardvaro sols llo -
bil vlon soflvaro updalos any onlry villin llo labIo. Onco llo labIo is Ioadod,
soflvaro sols llo bil villin llo Iorl VC ConlroI rogis-
lor. Tlis bil causos lardvaro lo Ioad llo nov vaIuos inlo llo VC Arbilor. Hard-
varo cIoars llo - bil vlon labIo Ioading is compIolo,
lloroby, pormilling soflvaro lo vorify succossfuI Ioading.
-
Chapter 6: QoS/TCs/VCs and Arbitration
273
VC Arbitration within MuItipIe Function Endpoints
Tlo spocificalion doos nol slalo lov an ondpoinl slouId manago llo arbilralion
of dala fIovs from difforonl funclions villin an ondpoinl. Hovovor il doos slalo
llal MuIli-funclion Indpoinls... slouId supporl ICI Ixpross VC-basod arbilra-
lion conlroI moclanisms if muIlipIo VCs aro impIomonlod for llo ICI Ixpross
IinI. VC arbilralion vlon lloro aro muIlipIo funclions raisos inlorosling quos-
lions aboul llo approacl lo bo laIon. Of courso vlon llo dovico funclions sup-
porl onIy VC0, no VC arbilralion is nocossary. Tlo spocificalion Ioavos llo
approacl opon lo llo dosignor.
Iiguro 6-15 on pago 274 slovs a funclionaI bIocI diagram of an oxampIo impIo-
monlalion in vlicl lvo funclions aro impIomonlod villin an ondpoinl dovico,
oacl of vlicl supporls lvo VCs. Tlo oxampIo approacl is basod upon llo goaI
of using a slandard ICI Ixpross coro lo inlorfaco boll funclions lo llo IinI. Tlo
lransaclion Iayor villin llo IinI porforms llo TC/VC mapping and VC arbilra-
lion. Tlo dovico-spocific porlion of llo dosign is llo funclion arbilor llal dolor-
minos llo priorily of dala fIovs from llo funclions lo llo lransaclion Iayor of
llo coro. IoIIoving aro Ioy considoralions for sucl an approacl:
- Rallor llan dupIicaling llo TC/VC mapping villin oacl funclion, llo
slandard dovico coro porforms llo lasI. An imporlanl considoralion for llis
docision is llal aII funclions musl uso llo samo TC/VC mapping. Tlo spoc-
ificalion roquiros llal llo TC/VC mapping bo llo samo for dovicos al oacl
ond of a IinI. Tlis moans llal oacl funclion villin llo ondpoinl musl lavo
llo samo mappings.
- Tlo funclion arbilor usod TC vaIuos lo dolormino llo priorily of lransac-
lions boing doIivorod from llo lvo funclions, and soIocls llo liglosl prior-
ily lransaclion from llo funclions vlon forvarding lransaclions lo llo
lransaclion Iayor of llo ICI Ixpross coro. Tlo arbilralion aIgorillm is lard-
virod basod on llo appIicalions associalod vill oacl funclion.
PCI Express System Architecture
274
Port Arbitration
Wlon lraffic from muIlipIo porls vio for Iimilod bandvidll associalod vill a
common ogross porl, arbilralion is roquirod. Tlo concopl of porl arbilralion is
piclurod in Iiguro 6-16 on pago 275. Nolo llal porl arbilralion oxisls in llroo
Iocalions villin a syslom:
- Igross porls of svilclos
- Rool CompIox porls vlon poor-lo-poor lransaclions aro supporlod
- Rool CompIox ogross porls lo llal Ioad lo sourcos sucl as main momory
Iorl arbilralion roquiros soflvaro configuralion, vlicl is landIod via ICI-lo-
ICI bridgo (IIB) configuralion in boll svilclos and poor-lo-poor lransfors
villin llo Rool CompIox and by llo Rool CompIox Rogislor BIocI vlon accoss-
ing slarod rool compIox rosourcos sucl as main momory. Iorl arbilralion occurs
indopondonlIy for oacl virluaI clannoI supporlod by llo ogross porl. In llo
oxampIo boIov, rool porl 2 supporls poor-lo-poor lransfors from rool porls 1 and
2, lovovor, poor-lo-poor lransfor supporl bolvoon rool compIox porls is nol
roquirod.

Chapter 6: QoS/TCs/VCs and Arbitration
275
Bocauso porl arbilralion is managod indopondonlIy for oacl VC of llo ogross
porl or RCRB, a porl arbilralion labIo is roquirod for oacl VC llal supporls pro-
grammabIo porl arbilralion as iIIuslralod in Iiguro 6-17 on pago 276. Iorl arbi-
lralion labIos aro supporlod onIy by svilclos and RCRBs and aro nol aIIovod
for ondpoinls, rool porls and ICI Ixpross bridgos.

PCI Express System Architecture
276
Tlo procoss of arbilraling bolvoon difforonl pacIol slroams aIso impIios llo uso
of addilionaI buffors lo accumuIalo lraffic from oacl porl in llo ogross porl as
iIIuslralod in Iiguro 6-18 on pago 277. Tlis oxampIo iIIuslralos lvo ingross porls
(1 and 2) vloso lransaclions aro roulod lo an ogross porl (3). Tlo aclion laIon by
llo svilcl incIudo:
1. Transaclions arriving al llo ingross porls aro diroclod lo llo approprialo
fIov conlroI buffors basod on llo TC/VC mapping.
2. Transaclions aro forvardod from llo fIov conlroI buffors lo llo rouling
Iogic is consuIlod lo dolormino llo ogross porl.
3. Transaclions aro roulod lo llo ogross porl (3) vloro TC/VC mapping dolor-
minos inlo vlicl VC buffor llo lransaclions slouId bo pIacod.
4. A sol of VC buffors is associalod vill oacl of llo ogross porls. Nolo llal llo
ingross porl numbor is lracIod unliI lransaclions aro pIacod in lloir VC
buffor.
5. Iorl arbilralion Iogic dolorminos llo ordor in vlicl lransaclions aro sonl
from oacl group of VC buffors.
-
Chapter 6: QoS/TCs/VCs and Arbitration
277
The Port Arbitration Mechanisms
Tlo acluaI porl arbilralion moclanisms dofinod by llo spocificalion aro simiIar
lo llo modoIs usod for VC arbilralion and incIudo:
- Non-configurabIo lardvaro-fixod arbilralion sclomo
- Woigllod Round Robin (WRR) arbilralion vill 32 plasos
- WRR arbilralion vill 64 plasos
- WRR arbilralion vill 128 plasos
- Timo-basod WRR arbilralion vill 128 plasos
- WRR arbilralion vill 256 plasos
Configuralion soflvaro musl dolormino llo porl arbilralion capabiIily for a
svilcl or RCRB and soIocl llo porl arbilralion sclomo lo bo usod for oacl
onabIod VC. Iiguro 6-19 on pago 278 iIIuslralos llo rogislors and fioIds invoIvod
in dolormining porl arbilralion capabiIilios and soIocling llo porl arbilralion
sclomo lo bo usod by oacl VC.

PCI Express System Architecture
278
Tlis porl arbilralion
moclanism doos nol roquiro configuralion of llo porl arbilralion labIo.
Onco soIoclod by soflvaro, llo moclanism is managod soIoIy by lardvaro.
Tlo acluaI arbilralion sclomo is basod on a round-robin or simiIar approacl
vloro oacl porl las llo samo priorily. Tlis lypo of moclanism onsuros a
lypo of fairnoss and onsuros llal aII lransaclions can maIo forvard
- - - -
Chapter 6: QoS/TCs/VCs and Arbitration
279
progross. Hovovor, il doos nol sorvico llo goaIs of difforonlialod sorvicos
and doos nol supporl isoclronous lransaclions.
IiIo llo voigllod round robin
moclanism usod for VC arbilralion, soflvaro Ioads llo porl arbilralion
labIo sucl llal somo porls can rocoivo liglor priorily llan ollors basod on
llo numbor of plasos in llo round robin llal aro aIIocalod for oacl porl.
Tlis approacl aIIovs soflvaro lo faciIilalo difforonlialod sorvicos by assign-
ing difforonl voiglls lo lraffic coming from difforonl porls.
As llo labIo is scannod oacl labIo plaso spocifios a porl numbor llal idonli-
fios llo VC buffor from vlicl llo noxl lransaclion is sonl. Onco llo lransac-
lion is doIivorod arbilralion conlroI Iogic immodialoIy procoods lo llo noxl
plaso. Ior a givon porl, if no lransaclion is ponding lransmission llo arbilor
advancos immodialoIy lo llo noxl plaso.
Tlo spocificalion dofinos four labIo Ionglls for WRR porl arbilralion, dolor-
minod by llo numbor of plasos usod by llo labIo. Tlo labIo Iongll soIoc-
lions incIudo:
- 32 plasos
- 64 plasos
- 128 plasos
- 256 plasos
- Tlo limo-basod
WRR moclanism is roquirod for supporling isoclronous lransaclions. Con-
soquonlIy, oacl svilcl ogross porl and RCRB llal supporls isoclronous
lransaclions musl impIomonl limo-basod WRR porl arbilralion.
Timo-basod voigllod round robin adds llo oIomonl of a virluaI limosIol for
oacl arbilralion plaso. }usl as in WRR llo porl arbilor doIivors ono lransac-
lion from llo Ingross Iorl VC buffor indicalod by llo Iorl Numbor of llo
curronl plaso. Hovovor, rallor llan immodialoIy advancing lo llo noxl
plaso, llo limo-basod arbilor vails unliI llo curronl virluaI limosIol
oIaspsos boforo advancing. Tlis onsuros llal lransaclions aro accoplod from
llo ingross porl buffor al roguIar inlorvaIs. Nolo llal llo limosIol doos nol
govorn llo duralion of llo lransfor, bul rallor llo inlorvaI bolvoon lrans-
fors. Tlo maximum duralion of a lransaclion is llo limo il laIos lo compIolo
llo round robin and rolurn lo llo originaI limosIol. Iacl limosIol is dofinod
as 100ns.
PCI Express System Architecture
280
AIso, il is possibIo llal no lransaclion is doIivorod during a limosIol, rosuIl-
ing in an idIo limosIol. Tlis occurs vlon:
- no lransaclion is ponding for llo soIoclod ingross porl during llo cur-
ronl plaso, or
- llo plaso conlains llo porl numbor of llis ogross porl
Timo-basod WRR arbilralion supporls a maximum labIo Iongll of 128
plasos. Tlo acluaI numbor of plasos impIomonlod is roporlod via llo
fioId of oacl virluaI clannoI llal supporls Timod WRR arbi-
lralion. Soo llo Iiguro 6-20 on pago 280 vlicl iIIuslralo llo
- IioId villin llo VCn Rosourco CapabiIily rogislor. Soo MindSlaros
vobsilo for a vlilo papor on oxampIo appIicalions of Timo-Basod WRR.
Loading the Port Arbitration TabIes
A porl arbilralion labIo is roquirod for oacl VC supporlod by llo ogross porl.
Tlo acluaI sizo and formal of llo Iorl Arbilralion TabIos aro a funclion of llo
numbor of plasos and llo numbor of ingross porls supporlod by llo Svilcl,
RCRB, or Rool Iorl llal supporls poor-lo-poor lransfors. Tlo maximum numbor
of ingross porls supporlod by llo Iorl Arbilralion TabIo is 256 porls. Tlo acluaI
numbor of bils villin oacl labIo onlry is dosign dopondonl and govornod by llo
numbor of ingross porls vloso lransaclions can bo doIivorod lo llo ogross porl.
Tlo sizo of oacl labIo onlry is roporlod in llo 2-bil
fioId of Iorl VC CapabiIily Rogislor 1. Tlo pormissibIo vaIuos aro:
- 00b 1 bil
- 01b 2 bils
- 10b 4 bils
- 11b 8 bils
- -
Chapter 6: QoS/TCs/VCs and Arbitration
281
- - - -
- - - -
- -
-- - - -

01b
PCI Express System Architecture
282
Switch Arbitration ExampIe
Tlis soclion providos an oxampIo of a llroo-porl svilcl vill boll Iorl and VC
arbilralion iIIuslralod. Tlo oxampIo prosumos llal pacIols arriving on ingross
porls 0 and 1 aro moving in llo upslroam diroclion and porl 2 is llo ogross porl
facing llo Rool CompIox. Tlis oxampIo sorvos lo summarizo porl and VC arbi-
lralion and iIIuslralo lloir uso villin a ICI Ixpross svilcl. Rofor lo Iiguro 6-22
on pago 283 during llo foIIoving discussion.
1. IacIols arrivo al ingross porl 0 and aro pIacod in a rocoivor fIov conlroI
buffor basod on TC/VC mapping associalod vill porl 0. As indicalod, TIIs
carrying lraffic cIass TC0 or TC1 aro sonl lo llo VC0 rocoivor fIov conlroI
buffors. TIIs carrying lraffic cIass TC3 or TC5 aro sonl lo llo VC1 rocoivor
fIov conlroI buffors. No ollor TCs aro pormillod on llis IinI.
2. IacIols arrivo al ingross porl 1 and aro pIacod in a rocoivor fIov conlroI
buffor basod on porl 1 TC/VC mapping. As indicalod, TIIs carrying lraffic
cIass TC0 aro sonl lo llo VC0 rocoivor fIov conlroI buffors. TIIs carrying
lraffic cIass TC2-TC4 aro sonl lo llo VC3 rocoivor fIov conlroI buffors. NO
OTHIR TCs aro pormillod on llis IinI.
3. Tlo largol ogross porl is dolorminod from rouling informalion in oacl
pacIol. Addross rouling is appIiod lo momory or IO roquosl TIIs, ID roul-
ing is appIiod lo configuralion or compIolion TIIs, olc.
4. AII pacIols doslinod for ogross porl 2 aro subjoclod lo llo TC/VC mapping
for llal porl. As slovn, TIIs carrying lraffic cIass TC0-TC2 aro managod as
virluaI clannoI 0 (VC0) lraffic, TIIs carrying lraffic cIass TC3-TC7 aro man-
agod as VC1 lraffic.
5. Indopondonl Iorl Arbilralion is appIiod lo pacIols villin oacl VC. Tlis
may bo a fixod or voigllod round robin arbilralion usod lo soIocl pacIols
from aII possibIo difforonl ingross porls. Iorl arbilralion uIlimaloIy rosuIls
in aII VCs of a givon lypo boing roulod lo llo samo VC buffor.
6. IoIIoving Iorl Arbilralion, VC arbilralion dolorminos llo ordor in vlicl
lransaclions ponding lransmission villin llo individuaI VC buffors viII bo
lransforrod across llo IinI. Tlo arbilralion aIgorillm may bo fixod or
voigllod round robin. Tlo arbilor soIocls lransaclions from llo load of oacl
VC buffor basod on llo priorily sclomo impIomonlod.
7. Nolo llal llo VC arbilor soIocls pacIols for lransmission onIy if sufficionl
fIov conlroI crodils oxisl.
Chapter 6: QoS/TCs/VCs and Arbitration
283

The Previous Chapter
Tlis provious claplor discussod Traffic CIassos, VirluaI ClannoIs, and Arbilra-
lion llal supporls QuaIily of Sorvico concopls in ICI Ixpross impIomonlalions.
Tlo concopl of QuaIily of Sorvico in llo conloxl of ICI Ixpross is an allompl lo
prodicl llo bandvidll and Ialoncy associalod vill llo fIov of difforonl lransac-
lion slroams lravorsing llo ICI Ixpross fabric. Tlo uso of QoS is basod on appIi-
calion-spocific soflvaro assigning Traffic CIass (TC) vaIuos lo lransaclions,
vlicl dofino llo priorily of oacl lransaclion as il lravoIs bolvoon llo Roquoslor
and CompIolor dovicos. Iacl TC is mappod lo a VirluaI ClannoI (VC) llal is
usod lo manago lransaclion priorily via lvo arbilralion sclomos caIIod porl and
VC arbilralion.
This Chapter
Tlis claplor discussos llo purposos and dolaiIod oporalion of llo IIov ConlroI
IrolocoI. Tlis prolocoI roquiros oacl dovico lo impIomonl crodil-basod IinI fIov
conlroI for oacl virluaI clannoI on oacl porl. IIov conlroI guaranloos llal
lransmillors viII novor sond Transaclion Iayor IacIols (TIIs) llal llo rocoivor
canl accopl. Tlis provonls rocoivo buffor ovor-runs and oIiminalos llo nood for
inofficionl disconnocls, rolrios, and vail-slalos on llo IinI. IIov ConlroI aIso
loIps onabIo compIianco vill ICI Ixpross ordoring ruIos by mainlaining sopa-
ralo virluaI clannoI IIov ConlroI buffors for llroo lypos of lransaclions: Ioslod
(I), Non-Ioslod (NI) and CompIolions (CpI).
The Next Chapter
Tlo noxl claplor discussos llo ordoring roquiromonls for ICI Ixpross dovicos,
as voII as ICI and ICI-X dovicos llal may bo allaclod lo a ICI Ixpross fabric.
Tlo discussion doscribos llo Iroducor/Consumor programming modoI upon
vlicl llo fundamonlaI ordoring ruIos aro basod. Il aIso doscribos llo polonliaI
porformanco probIoms llal can omorgo vlon slrong ordoring is ompIoyod,
doscribos llo voaI ordoring soIulion, and spocifios llo ruIos dofinod for doad-
IocI avoidanco.
-- -

FIow ControI Concept

Tlo porls al oacl ond of ovory ICI Ixpross IinI musl impIomonl IIov ConlroI.
Boforo a lransaclion pacIol can bo sonl across a IinI lo llo rocoiving porl, llo
lransmilling porl musl vorify llal llo rocoiving porl las sufficionl buffor spaco
lo accopl llo lransaclion lo bo sonl. In many ollor arclilocluros incIuding ICI
and ICI-X, lransaclions aro doIivorod lo a largol dovico villoul Inoving if il
can accopl llo lransaclion. If llo lransaclion is rojoclod duo lo insufficionl buffor
spaco, llo lransaclion is rosonl (rolriod) unliI llo lransaclion compIolos. Tlis
procoduro can sovoroIy roduco llo officioncy of a bus, by vasling bus band-
vidll vlon ollor lransaclions aro roady lo bo sonl.
Bocauso ICI Ixpross is a poinl-lo-poinl impIomonlalion, llo IIov ConlroI
moclanism vouId bo inoffoclivo, if onIy ono lransaclion slroam vas ponding
lransmission across a IinI. Tlal is, if llo rocoivo buffor vas lomporariIy fuII, llo
lransmillor vouId bo provonlod from sonding a subsoquonl lransaclion duo lo
lransaclion ordoring roquiromonls, lloroby bIocIing any furllor lransfors. ICI
Ixpross improvos IinI officioncy by impIomonling muIlipIo fIov-conlroI buffors
for soparalo lransaclion slroams (virluaI clannoIs). Bocauso IIov ConlroI is
managod soparaloIy for oacl virluaI clannoI impIomonlod for a givon IinI, if
llo IIov ConlroI buffor for ono VC is fuII, llo lransmillor can advanco lo
anollor VC buffor and sond lransaclions associalod vill il.
Tlo IinI IIov ConlroI moclanism usos a crodil-basod moclanism llal aIIovs
llo lransmilling porl lo clocI buffor spaco avaiIabiIily al llo rocoiving porl.
During iniliaIizalion oacl rocoivor roporls llo sizo of ils rocoivo buffors (in IIov
ConlroI crodils) lo llo porl al llo opposilo ond of llo IinI. Tlo rocoiving porl
conlinuos lo updalo llo lransmilling porl roguIarIy by lransmilling llo numbor
of crodils llal lavo boon frood up. Tlis is accompIislod via IIov ConlroI
DIIIs.
IIov conlroI Iogic is Iocalod in llo lransaclion Iayor of llo lransmilling and
rocoiving dovicos. Boll lransmillor and rocoivor sidos of oacl dovico aro
invoIvod in fIov conlroI. Rofor lo Iiguro 7-1 on pago 287 during llo foIIoving
doscriplions.
- - Tlo rocoivor of oacl nodo con-
lains llo IIov ConlroI buffors. Iacl dovico musl roporl llo amounl of fIov
conlroI buffor spaco lloy lavo avaiIabIo lo llo dovico on llo opposilo ond of
llo IinI. Buffor spaco is roporlod in unils caIIod IIov ConlroI Crodils
(ICCs). Tlo numbor of IIov ConlroI Crodils villin oacl buffor is for-
vardod from llo lransaclion Iayor lo llo lransmil sido of llo IinI Iayor as

iIIuslralod in Iiguro 7-1. Tlo IinI croalos a IIov ConlroI DIII llal carrios
llis crodil informalion lo llo rocoivor al llo opposilo ond of llo IinI. Tlis is
dono for oacl IIov ConlroI Buffor.
- - Nolico llal llo rocoivor in Iiguro 7-1 aIso rocoivos
IIov ConlroI DIIIs from llo dovico al llo opposilo ond of llo IinI. Tlis
informalion is lransforrod lo llo lransaclion Iayor lo updalo llo IIov Con-
lroI Counlors llal lracI llo amounl of IIov ConlroI Buffor spaco in llo
ollor dovico.
- - Iacl lransmillor clocI consuIls llo IIov ConlroI
Counlors lo clocI avaiIabIo crodils. If sufficionl crodils aro avaiIabIo lo
rocoivo llo lransaclion ponding doIivory llon llo lransaclion is forvardod
lo llo IinI Iayor and is uIlimaloIy sonl lo llo opposilo dovico. If onougl
crodils aro nol avaiIabIo llo lransaclion is lomporariIy bIocIod unliI addi-
lionaI IIov ConlroI crodils aro roporlod by llo rocoiving dovico.

-- -

FIow ControI Buffers

IIov conlroI buffors aro impIomonlod for oacl VC rosourco supporlod by a ICI
Ixpross porl. RocaII llal dovicos al oacl ond of llo IinI may nol supporl llo
samo numbor of VC rosourcos, lloroforo llo maximum numbor of VCs config-
urod and onabIod by soflvaro is llo groalosl numbor of VCs in common
bolvoon llo lvo porls.
VC FIow ControI Buffer Organization
Iacl VC IIov ConlroI buffor al llo rocoivor is managod for oacl calogory of
lransaclion fIoving llrougl llo virluaI clannoI. Tloso calogorios aro:
- Ioslod Transaclions Momory Wrilos and Mossagos
- Non-Ioslod Transaclions Momory Roads, Configuralion Roads and
Wrilos, and I/O Roads and Wrilos
- CompIolions Road CompIolions and Wrilo CompIolions
In addilion, oacl of lloso calogorios is soparalod inlo loador and dala porlions
of oacl lransaclion. IIov conlroI oporalos indopondonlIy for oacl of llo six
buffors Iislod boIov (aIso soo Iiguro 7-2 on pago 289).
- Ioslod Hoador
- Ioslod Dala
- Non-Ioslod Hoador
- Non-Ioslod Dala
- CompIolion Hoador
- CompIolion Dala
Somo lransaclions consisl of a loador onIy (o.g., road roquosls) vliIo ollors con-
sisl of a loador and dala (o.g., vrilo roquosls). Tlo lransmillor musl onsuro llal
boll loador and dala buffor spaco is avaiIabIo as roquirod for oacl lransaclion
boforo llo lransaclion can bo sonl. Nolo llal vlon a lransaclion is rocoivod inlo
a VC IIov ConlroI buffor llal ordoring musl bo mainlainod vlon llo lransac-
lions aro forvardod lo soflvaro or lo an ogross porl in llo caso of a svilcl. Tlo
llo rocoivor musl aIso lracI llo ordor of loador and dala compononls villin llo
IIov ConlroI buffor.

FIow ControI Credits

Buffor spaco is roporlod by llo rocoivor in unils caIIod IIov ConlroI crodils. Tlo
unil vaIuo of IIov ConlroI crodils (ICCs) may diffor bolvoon loador and dala
as Iislod boIov:
- Hoador ICCs maximum loador sizo + digosl
o 4 DWs for compIolions
o 5 DWs for roquosls
- Dala ICCs 4 DWs (aIignod 16 bylos)
IIov conlroI crodils aro passod villin llo loador of llo IinI Iayor IIov ConlroI
IacIols. Nolo llal DIIIs do nol roquiro IIov ConlroI crodils bocauso lloy orig-
inalo and lorminalo al llo IinI Iayor.

-- -

Maximum FIow ControI Buffer Size

Tlo maximum buffor sizo llal can bo roporlod via llo IIov ConlroI IniliaIiza-
lion and Updalo pacIols for llo loador and dala porlions of a lransaclion aro as
foIIovs:
- -
- 2,560 bylos Roquosl Hoadors 20 bylos/crodil
- 2048 bylos for compIolion loadors 16 bylos/crodil
-
- 32KB 16 bylos/crodil
Tlo roason for lloso Iimils is discussod in llo soclion onlilIod Slago 1 IIov
ConlroI IoIIoving IniliaIizalion pago 296, slop 2.
Introduction to the FIow ControI Mechanism
Tlo spocificalion dofinos llo roquiromonls of llo IIov ConlroI moclanism by
doscribing concopluaI rogislors and counlors aIong vill procoduros and mocla-
nisms for roporling, lracIing, and caIcuIaling vlollor a lransaclion can bo sonl.
Tloso oIomonls dofino llo funclionaI roquiromonls, lovovor, llo acluaI impIo-
monlalion may vary from llo concopluaI modoI. Tlis soclion inlroducos llo
spocifiod modoI llal sorvos lo oxpIain llo concopl and dofino llo roquiromonls.
Tlo approacl laIon focusos on a singIo fIov conlroI oxampIo for a non-poslod
loador. Tlo concopls discussod appIy lo aII IIov ConlroI buffor lypos.
The FIow ControI EIements
Iiguro 7-3 idonlifios and iIIuslralos llo oIomonls usod by llo lransmillor and
rocoivor vlon managing fIov conlroI. Tlis diagram iIIuslralos lransaclions
fIoving in a singIo diroclion across a IinI, bul of courso anollor sol of lloso oIo-
monls is usod lo supporl lransfors in llo opposilo diroclion. Tlo primary func-
lion of oacl oIomonl villin llo lransmilling and rocoiving dovicos is Iislod
boIov. Nolo llal for a singIo diroclion lloso IIov ConlroI oIomonls aro dupIi-
calod for oacl IIov ConlroI rocoivo buffor, yioIding six sols of oIomonls. Tlis
oxampIo doaIs vill non-poslod loador fIov conlroI.

Transmitter EIements
- - loIds lransaclions llal aro ponding lransfor
villin llo samo virluaI clannoI.
- - lracIs llo sizo of aII lransaclions sonl from
llo VC buffor (of llo spocifiod lypo, o.g., non-poslod loadors) in IIov Con-
lroI crodils. Tlis counl is abbrovialod CC.
- - llis rogislor is iniliaIizod by llo rocoiving dovico
vlon il sonds IIov ConlroI iniliaIizalion pacIols lo roporl llo sizo of llo
corrosponding IIov ConlroI rocoivo buffor. IoIIoving iniliaIizalion, IIov
ConlroI updalo pacIols aro sonl poriodicaIIy lo add moro IIov ConlroI
crodils as lloy bocomo avaiIabIo al llo rocoivor. Tlis vaIuo is abbrovialod
CI.
- porforms llo caIcuIalions lo dolormino if llo
rocoivor las sufficionl IIov ConlroI crodils lo rocoivo llo ponding TII
(ITII). In ossonco, llis clocI onsuros llal llo lolaI CRIDITS_CONSUMID
(CC) pIus llo crodil roquirod for llo noxl pacIol ponding lransmission
(ITII) doos nol oxcood llo CRIDIT_IIMIT (CI). Tlis spocificalion dofinos
llo foIIoving oqualion for porforming llo clocI, vill aII vaIuos ropro-
sonlod in crodils:
Ior an oxampIo appIicalion of llis oqualion, Soo Slago 1 IIov ConlroI IoI-
Ioving IniliaIizalion on pago 294.
Receiver EIements
- sloros incoming loador or dala informa-
lion.
- Tlis counlor lracIs llo lolaI IIov ConlroI crodils llal
lavo boon aIIocalod (mado avaiIabIo) sinco iniliaIizalion. Il is iniliaIizod by
lardvaro lo rofIocl llo sizo of llo associalod IIov ConlroI buffor. As llo
buffor fiIIs llo amounl of avaiIabIo buffor spaco docroasos unliI lransaclions
aro romovod from llo buffor. Tlo numbor of IIov ConlroI crodils associalod
vill oacl lransaclion romovod from llo buffor is addod lo llo
CRIDIT_AIIOCATID counlor, lloroby Iooping a running counl of nov
crodils mado avaiIabIo.
- - llis counlor Ioops lracI of llo lolaI
sizo of aII dala rocoivod from llo lransmilling dovico and pIacod inlo llo
IIov ConlroI buffor (in IIov ConlroI crodils). Wlon fIov conlroI is func-
lioning proporIy, llo CRIDITS_RICIIVID counl slouId bo llo samo as
CL CC PTLP mod2
FieldSize
2
FieldSize
2
-- -

CRIDITS_CONSUMID counl al llo lransmillor and bo oquaI lo or Ioss

llan llo CRIDIT_AIIOCATID counl. If llis is nol lruo, llon a fIov conlroI
buffor ovorfIov las occurrod and orror is doloclod. AIllougl oplionaI llo
spocificalion rocommonds ils uso.
IIov conlroI managomonl is basod on Iooping lracI of IIov ConlroI crodils
using moduIo counlors. ConsoquonlIy, llo counlors aro dosignod lo roIo ovor
vlon llo counl saluralos. Tlo vidll of llo counlors dopond on vlollor fIov
conlroI is lracIing lransaclion loadors or dala:
- Hoador fIov conlroI usos moduIo 256 counlors (8-bils vido)
- Dala fIov conlroI usos moduIo 4096 counlors (12-bils vido)
In addilion, aII caIcuIalions aro mado using unsignod arillmolic. Tlo oporalion
of llo counlors and llo caIcuIalions aro oxpIainod by oxampIo on pago 290.
-
FC Gating Logic

FIow ControI Packets

Tlo lransmil sido of a dovico roporls fIov conlroI crodil informalion from ils
rocoivo buffors lo llo opposilo dovico. Tlo spocificalion dofinos llroo lypos of
IIov ConlroI pacIols:
- IIov ConlroI Inil1 usod lo roporl llo sizo of llo IIov ConlroI buffors for
a givon virluaI clannoI
- IIov ConlroI Inil2 samo as IIov ConlroI Inil1 oxcopl il is usod lo vorify
compIolion of fIov conlroI iniliaIizalion al oacl ond of llo IinI (rocoiving
dovico ignoros fIov conlroI crodil informalion)
- IIov ConlroI Updalo usod lo updalo Crodil Iimil poriodicaIIy
Iacl IIov ConlroI pacIol conlains llo loador and dala fIov conlroI crodil
informalion for oacl virluaI clannoI and lypo of IIov ConlroI pacIol. Tlo
pacIol fioIds llal carry llo loador and dala IIov ConlroI crodils rofIocl llo
counlor vidll as discussod in llo provious soclion. Iiguro 7-4 picluros llo for-
mal and conlonl of lloso pacIols.
- -
-- -

Operation of the FIow ControI ModeI - An ExampIe

Tlo purposo of llis oxampIo is lo oxpIain llo oporalion of llo IIov ConlroI
moclanism basod on llo concopluaI modoI prosonlod by llo spocificalion. Tlo
oxampIo usos llo non-poslod loador IIov ConlroI buffor lypo, and spans four
slagos lo capluro llo nuancos of llo fIov conlroI impIomonlalion:
ImmodialoIy foIIoving iniliaIizalion, llo sovoraI lransaclions aro
lracIod lo oxpIain llo basic oporalion of llo counlors and rogislors as lloy lracI
lransaclions as lloy aro sonl across llo IinI. In llis slago, dala is accumuIaling
villin llo IIov ConlroI buffor, bul no lransaclions aro boing romovod.
If llo lransmillor sonds non-poslod lransaclions al a ralo sucl llal
llo IIov ConlroI buffor is fiIIod faslor llan llo rocoivor can forvard lransac-
lions from llo buffor, llo buffor viII fiII. Slago lvo doscribos llis circumslanco.
Tlo moduIo counlors aro dosignod lo roII ovor and conlinuo
counling from zoro. Tlis slago doscribos llo fIov conlroI oporalion al llo poinl
of llo CRIDITS_AIIOCATID counl roIIing ovor lo zoro.
Tlo spocificalion doscribos llo oplionaI orror clocI llal can bo
mado by llo rocoivor in llo ovonl of a IIov ConlroI buffor ovorfIov. Tlis orror
clocI is doscribod in llis soclion.
Stage 1 FIow ControI FoIIowing InitiaIization
Tlo assumplion mado in llis oxampIo is llal fIov conlroI iniliaIizalion las jusl
compIolod and llo dovicos aro roady for normaI oporalion. Tlo IIov ConlroI
buffor is prosumod lo bo 2KB in sizo, vlicl roprosonls 102d (66l) IIov ConlroI
unils vill 20 bylos/loador. Iiguro 7-5 on pago 295 iIIuslralos llo oIomonls
invoIvod vill llo vaIuos llal vouId bo in oacl counlor and rogislor foIIoving
fIov conlroI iniliaIizalion.

Tlo lransmillor musl clocI IIov ConlroI crodil prior lo sonding a lransaclion.
In llo caso of loadors llo numbor of IIov ConlroI unils roquirod is aIvays ono.
Tlo lransmillor laIos llo foIIoving slops lo dolormino if llo lransaclion can bo
sonl. Ior simpIicily, llis oxampIo ignoros llo possibiIily of dala boing incIudod
in llo lransaclion.
Tlo crodil clocI is mado using unsignod arillmolic (2s compIomonl) in ordor
lo salisfy llo foIIoving formuIa:
Subsliluling vaIuos from Iiguro 7-5 yioIds:
-
CL CC PTLP mod2
FieldSize
2
FieldSize
2
66h 00h 01h mod2
8
2
8
2
66h 01 h mod256 80h

-- -

1. Tlo curronl CRIDITS_CONSUMID counl (CC) is addod lo llo ITII crod-

ils roquirod, lo dolormino llo CUMUIATIVI_CRIDITS_RIQUIRID (CR),
or 00l + 01l =01l. Sufficionl crodils oxisl if llis vaIuo is oquaI lo or Ioss llan
llo crodil Iimil.
2. Tlo CUMUIATIVI_CRIDITS_RIQUIRID counl is sublraclod from llo
CRIDIT_IIMIT counl (CI) lo dolormino if sufficionl crodils aro avaiIabIo.
Tlo foIIoving doscriplion incorporalos a briof roviov of 2s compIomonl
sublraclion. Wlon porforming sublraclion using 2s compIomonl llo num-
bor lo bo sublraclod is compIomonlod (1s compIomonl) and 1 is addod (2s
compIomonl). Tlis vaIuo is llon addod lo llo numbor boing sublraclod
from. Any carry duo lo llo addilion is simpIy ignorod.
- -

- - -
(1s compIomonl)
(1s compIomonl +1 = 2s compIomonl)
- -

(add)

- -
- (sond lransaclion)
Tlo rosuIl of llo sublraclion musl bo oquaI lo or Ioss llan 1/2 llo maximum
vaIuo llal can bo lracIod vill a moduIo 256 counlor (128). Tlis approacl is
laIon lo onsuro uniquo rosuIls from llo unsignod arillmolic. Ior oxampIo,
unsignod 2s-compIomonl sublraclion yioIds llo samo rosuIls for boll 0-128 and
255-127, as slovn boIov.


-



-

To onsuro llal confIicls sucl as llo ono abovo do nol occur, llo maximum num-
bor of unusod crodils llal can bo roporlod is Iimilod lo 2
8
/2 (128) crodils for
loadors and 2
12
/2 (2048) crodils for dala. Tlis moans llal llo
CRIDITS_AIIOCATID counl musl novor oxcood llo CRIDITS_CONSUMID
counl by moro llan 128 for loadors and 2048 for dala. Tlis onsuros llal any
rosuIl < 1/2 llo maximum rogislor counl is a posilivo numbor and roprosonls
crodils avaiIabIo, and rosuIls > 1/2 llo maximum counl aro nogalivo numbors
llal indicalo crodils nol avaiIabIo.
3. Tlo CRIDITS_CONSUMID counl incromonls by ono vlon llo lransaclion
is forvardod lo llo IinI Iayor.
4. Wlon llo lransaclion arrivos al llo rocoivor, llo lransaclion loador is
pIacod inlo llo IIov ConlroI buffor and llo CRIDITS_RICIIVID counlor
(oplionaI) incromonls by ono. Nolo llal CRIDIT_AIIOCATID doos nol
clango.
Iiguro 7-6 on pago 297 iIIuslralos llo IIov ConlroI oIomonls foIIoving lransfor
of llo firsl lransaclion.
- - -
-- -

Stage 2 FIow ControI Buffer FiIIs Up

Tlis oxampIo prosumos llal llo rocoiving dovico las boon unabIo lo movo
lransaclions from llo IIov ConlroI buffor sinco iniliaIizalion. Tlis couId bo
causod if llo dovico coro vas lomporariIy busy and unabIo lo procoss lransac-
lions. ConsoquonlIy, llo IIov ConlroI buffor las compIoloIy fiIIod. Iiguro 7-7 on
pago 299 iIIuslralos llis sconario.
Again llo lransmillor clocIs IIov ConlroI crodils lo dolormino if llo noxl pond-
ing TII can bo sonl. Tlo unsignod arillmolic is porformod lo sublracl llo Crod-
ils Roquirod from llo CRIDIT_IIMIT:

(if yos, sond lransaclion)

(add 2s compIomonl of 67l)
(nol lruo, donl sond pacIol)
Nol unliI llo rocoivor movos ono or moro lransaclions from llo IIov ConlroI
buffor can llo ponding lransaclion bo sonl. Wlon llo firsl lransaclion is movod
from llo IIov ConlroI buffor, llo CRIDIT_AIIOCATID counl is incroasod lo
67l. Wlon llo Updalo IIov ConlroI pacIol is doIivorod lo llo lransmillor, llo
nov CRIDIT_IIMIT viII bo Ioadod inlo llo CI rogislor. Tlo rosuIling clocI
viII pass llo losl, lloroby pormilling llo pacIol lo bo sonl.
(67)
add 2s compIomonl of 67
(sond lransaclion)

Stage 3 The Credit Limit count RoIIs Over

Tlo rocoivors CRIDIT_IIMIT (CI) aIvays runs aload of (or is oquaI lo) llo
CRIDITS_CONSUMID (CC) counl. Iacl limo llo lransmillor porforms a crodil
clocI, il adds llo crodils roquirod (CR) for a TII lo llo curronl
CRIDITS_CONSUMID counl and sublracls llo rosuIl from llo curronl
CRIDIT_IIMIT lo dolormino if onougl crodils aro avaiIabIo lo sond llo TII.
Bocauso boll llo CI counl and llo CC counl onIy indox up, lloy aro aIIovod lo
roII ovor from maximum counl bacI lo 0. A probIom appoars lo ariso vlon llo
CI counl (vlicl, again, is running aload) las roIIod ovor and llo CC las nol.
Iiguro 7-8 slovs llo CI and CR counls boforo and aflor CI roIIovor.
-
-- -

If a simpIo sublraclion is porformod in llo roIIovor caso, llo rosuIl is nogalivo.

Tlis indicalos llal crodils aro nol avaiIabIo. Hovovor, bocauso unsignod arill-
molic is usod llo probIom doos nol ariso. Soo boIov:
(08l)
(I8l) > = 2s compIomonl
(08l)
(add 2s compIomonl)

Stage 4 FC Buffer OverfIow Error Check
Tlo spocificalion rocommonds impIomonlalion of llo oplionaI IC buffor ovor-
fIov orror clocIing moclanism. Tloso oplionaI oIomonls incIudo:
- CRIDITS_RICIIVID counlor
- Irror ClocI Iogic
Tloso oIomonls pormil llo rocoivor lo lracI IIov ConlroI crodils in llo samo
mannor as llo lransmillor. Tlal is, llo lransmillor CRIDIT_IIMIT counl slouId

bo llo samo as llo rocoivors CRIDITS_AIIOCATID counl (aflor an Updalo

DIII is sonl) and llo rocoivors CRIDITS_RICIIVID counl slouId bo llo
samo as llo lransmillors CRIDITS_CONSUMID counl. If fIov conlroI is
vorIing corroclIy llo foIIoving viII bo lruo:
- llo lransmillors CRIDITS_CONSUMID counl slouId aIvays bo ils
CRIDIT_IIMIT
- llo rocoivors CRIDITS_RICIIVID counl (CR) slouId aIvays bo ils
CRIDITS_AIIOCATID counl (CA)
An ovorfIov condilion is doloclod vlon llo foIIoving formuIa is salisfiod. Nolo
llal llo fioId sizo is oillor 8 (loadors) or 12 (dala):
If llo formuIa is lruo, llon llo rosuIl is nogalivo, llus, moro crodils lavo boon
sonl lo llo IC buffor llan voro avaiIabIo and an ovorfIov las occurrod. Nolo
llal llo 1.0a vorsion of llo spocificalion dofinos llo oqualion as rallor llan >
as slovn abovo. Tlis appoars lo bo an orror, bocauso vlon CA=CR no ovorfIov
condilion oxisls. Ior oxampIo, for llo caso rigll aflor iniliaIizalion vloro llo
rocoivor advorlisos llal il las 128 crodils for llo lransmillor lo uso, CA = 128,
and CR = 0 bocauso il lasn'l rocoivod anylling yol, llon llis oqualion ovaIualos
lruo. Wlicl moans il las ovorfIovod, vlon acluaIIy aII vo lavo dono is advor-
liso our max aIIovod numbor of crodils. If llo oqualion ovaIualos for onIy > and
nol , llon ovorylling sooms lo vorI.
Infinite FIow ControI Advertisement
ICI Ixpross dofinos an infinilo IIov ConlroI crodil vaIuo. A dovico llal advor-
lisos infinilo IIov ConlroI crodils nood nol sond IIov ConlroI Updalo pacIols
foIIoving iniliaIizalion and llo lransmillor viII novor bo bIocIod from sonding
lransaclions. During fIov conlroI iniliaIizalion, a dovico advorlisos infinilo
crodils by doIivoring a zoro in llo crodil fioId of llo IC_INIT1 DIII.
Who Advertises Infinite FIow ControI Credits?
Ils inlorosling lo nolo llal llo minimum IIov ConlroI crodils llal musl bo
advorlisod incIudos infinilo crodils for compIolion lransaclions in corlain silua-
lions. Soo TabIo 7-1 on pago 303. Tloso roquiromonls invoIvo dovicos llal origi-
nalo roquosls for vlicl compIolions aro oxpoclod lo bo rolurnod (i.o., Indpoinls
CA CR mod2
FieldSize
2
FieldSize
2
-- -

and rool porls llal do nol supporl poor-lo-poor lransfors). Il doos nol incIudo
dovicos llal moroIy forvard compIolions (svilclos and rool porls llal supporl
poor-lo-poor lransfors). Tlis impIios a roquiromonl llal any dovico inilialing a
roquosl musl commil buffor spaco for llo oxpoclod compIolion loador and dala
(if appIicabIo). Tlis guaranloos llal no llrollIing vouId ovor occur vlon com-
pIolions cross llo finaI IinI lo llo originaI roquoslor. Tlis lypo of ruIo is roquirod
of ICI-X dovicos llal inilialo spIil lransaclions. MuIlipIo soarclos of llo spocifi-
calion faiIod lo rovoaI llis roquiromonl oxpIicilIy slalod for ICI Ixpross dovicos,
lovovor, il is impIiod by llo roquiromonl lo advorliso infinilo IIov ConlroI
crodils.
Nolo aIso llal infinilo fIov conlroI crodils can onIy bo advorlisod during iniliaI-
izlion. Tlis musl bo lruo, bocauso llo CA counlor in llo rocoivor couId roIIovor
lo 00l and sond an Updalo IC pacIol vill llo crodil fioId sol lo 00l. If llo IinI
is in llo DI_Inil slalo, llis moans infinilo crodils, bul if llo IinI is in llo
DI_Aclivo slalo, llis doos nol moan infinilo crodils.
SpeciaI Use for Infinite Credit Advertisements.
Tlo spocificalion poinls oul a spociaI considoralion for dovicos llal do nol nood
lo impIomonl aII llo IC buffor lypos for aII VCs. Ior oxampIo, llo onIy
Non-Ioslod vrilos aro I/O Wrilos and Configuralion Wrilos boll of vlicl aro
pormillod onIy on VC0. Tlus, Non-Ioslod dala buffors aro nol noodod for VC1 -
VC7. Bocauso no IIov ConlroI lracIing is noodod, a dovico can simpIy advorliso
infinilo IIov ConlroI crodils during iniliaIizalion, lloroby oIiminaling llo nood
lo sond noodIoss IC_Updalo pacIols.
Header and Data Advertisements May ConfIict
An infinilo IIov ConlroI advorlisomonl migll bo sonl for oillor llo Dala or
loador buffors (vill samo IC lypo) bul nol boll. In llis caso, Updalo DIIIs aro
roquirod for ono buffor bul nol llo ollor. Tlis simpIy moans llal llo dovico
roquiring crodils viII sond an Updalo DIII vill llo corrosponding fioId con-
laining llo CRIDITS_AIIOCATID crodil informalion, and llo ollor fioId
musl bo sol lo zoro (consislonl vill ils advorlisomonl).

The Minimum FIow ControI Advertisement

Tlo minimum numbor of crodils llal can bo roporlod for llo difforonl IIov
ConlroI buffor lypos is Iislod in TabIo 7-1 on pago 303.

--
Crodil Typo Minimum Advorlisomonl
Ioslod Roquosl Hoador
(IH)
1 unil. Crodil VaIuo = ono 4DW HDR + Digosl = 5DW.
Ioslod Roquosl Dala
(ID)
Iargosl possibIo solling of llo Max_IayIoad_Sizo, for llo
compononl dividod by IC Unil Sizo (4DW).
IxampIo: If llo Iargosl Max_IayIoad_Sizo vaIuo sup-
porlod is 1024 bylos, llo smaIIosl pormillod iniliaI crodil
vaIuo vouId bo 040l.
Non-Ioslod Roquosl
HDR (NIH)
1 unil. Crodil VaIuo = ono 4 DW HDR + Digosl = 5DW.
Non-Ioslod Roquosl
Dala (NID)
1 unil. Crodil VaIuo = 4DW.
CompIolion HDR
(CIIH)
1 unil. Crodil VaIuo = ono 3DW HDR + Digosl = 4DW,
for Rool CompIox vill poor-lo-poor supporl and
Svilclos.
Infinilo unils. IniliaI Crodil VaIuo = aII 0s for Rool Com-
pIox vill no poor-lo-poor supporl and Indpoinls.
CompIolion Dala
(CIID)
n unils. VaIuo of Iargosl possibIo solling of
Max_IayIoad_Sizo or sizo of Iargosl Road Roquosl
(vlicl ovor is smaIIor) dividod by IC Unil Sizo (4DW),
for Rool CompIox vill poor-lo-poor supporl and
Svilclos.
Infinilo unils. IniliaI Crodil VaIuo = aII 0s, for Rool Com-
pIox vill no poor-lo-poor supporl and Indpoinls.
-- -

FIow ControI InitiaIization

Irior lo sonding any lransaclions, fIov conlroI iniliaIizalion musl bo porformod.
IniliaIizalion occurs for oacl IinI in llo syslom and invoIvos a landslaIo
bolvoon llo dovicos allaclod lo llo samo IinI. TIIs associalod vill llo virluaI
clannoI boing iniliaIizod cannol bo forvardod across llo IinI unliI IIov ConlroI
IniliaIizalion is porformod succossfuIIy.
Onco inilialod, llo fIov conlroI iniliaIizalion procoduro is fundamonlaIIy llo
samo for aII VirluaI ClannoIs. Tlo smaII difforoncos llal oxisl aro discussod
Ialor. IniliaIizalion of VC0 (dofauIl VC) musl bo dono in lardvaro so llal con-
figuralion lransaclions can lravorso llo ICI Ixpross fabric. Ollor VCs iniliaIizo
onco configuralion soflvaro las sol up and onabIod llo VCs al boll onds of llo
IinI. InabIing a VC lriggors lardvaro lo porform fIov conlroI iniliaIizalion for
llis VC.
Iiguro 7-9 picluros llo IIov ConlroI counlors villin llo dovicos al boll onds of
llo IinI, aIong vill llo slalo of fIag bils usod during iniliaIizalion.
-

The FC InitiaIization Sequence

ICI Ixpross dofinos lvo slagos in fIov conlroI iniliaIizalion: IC_INIT1 and
IC_INIT2. Iacl slago of courso invoIvos llo uso of llo IIov ConlroI pacIols
(ICIs).
- IIov ConlroI Inil1 roporls llo sizo of llo IIov ConlroI buffors for a givon
virluaI clannoI
- IIov ConlroI Inil2 vorifios llal llo dovico lransmilling llo Inil2 pacIol
las compIolod llo fIov conlroI iniliaIizalion for llo spocifiod VC and buffor
lypo.
FC Init1 Packets Advertise FIow ControI Credits AvaiIabIe
During llo IC_INIT1 slalo, a dovico conlinuousIy oulpuls a soquonco of 3
InilIC1 IIov ConlroI pacIols advorlising ils poslod, non-poslod, and compIo-
lion rocoivor buffor sizos. (Soo Iiguro 7-10.) Iacl dovico aIso vails lo rocoivo a
simiIar soquonco from ils noiglbor. Onco a dovico las rocoivod llo compIolo
soquonco and sonl ils ovn, il iniliaIizos lransmil counlors, sols an inlornaI fIag
II1, and oxils IC_INIT1. Tlis procoss is iIIuslralod in Iiguro 7-11 on pago 306
and doscribod boIov. Tlo oxampIo slovs Dovico A roporling Non-Ioslod
Buffor Crodils and Dovico B roporling Ioslod Buffor Crodils. Tlis iIIuslralos llal
llo dovicos nood nol bo in synclronizalion rogarding vlal lloy aro roporling.
In facl, llo lvo dovico viII lypicaIIy nol slarl llo fIov conlroI iniliaIizalion pro-
coss al llo samo limo.
-
-- -

1. Iacl dovico sonds InilIC1 lypo IIov ConlroI pacIols (ICIs) lo advorliso
llo sizo of ils rospoclivo rocoivo buffors. A soparalo ICI for poslod roquosls
(I), non-poslod roquosls (NI) and compIolion (CII) pacIol lypos is
roquirod. Tlo ordor in vlicl llis soquonco of llroo ICIs is sonl is:
- Hoador and Dala buffor crodil unils for Ioslod Roquosls (I).
- Hoador and Dala buffor crodil unils for Non-Ioslod Roquosls (NI)
- Hoador and Dala buffor crodil unils for CompIolions (CII)
Tlo soquonco of ICIs is ropoalod conlinuousIy unliI a dovico Ioavos llo
IC_INIT1 iniliaIizalion slalo.
2. In llo moanlimo, dovicos laIo llo crodil informalion and iniliaIizo llo lrans-
mil crodil Iimil rogislors. In llis oxampIo, Dovico A Ioads ils IH lransmil
Crodil Iimil rogislor vill a vaIuo of 4, vlicl vas roporlod by Dovico B for
ils poslod roquosl loador IC buffor. Il aIso Ioads ils ID Crodil Iimil rogislor
vill a vaIuo of 64d crodils (1024 bylos vorll of dala) for accompanying
poslod dala. SimiIarIy, Dovico B Ioads ils NIH lransmil Crodil Iimil
counlor vill a vaIuo of 2 for non-poslod roquosl loadors and ils NID lrans-
mil counlor vill a vaIuo of 32d crodils (512 bylos vorll of dala) for accom-
panying non-poslod dala.
- --

3. Nolo llal vlon llis procoss is compIolo, llo Crodils AIIocalod counlor in
llo rocoivors and llo corrosponding Crodil Iimil counlors in llo lransmil-
lors viII bo oquaI.
4. Onco a dovico rocoivos Inil1 IC vaIuos for a givon buffor lypo (o.g., Ioslod)
and las rocordod llom, llo IC_INIT1 slalo is compIolo for llal IIov Con-
lroI buffor. Onco aII IC buffors for a givon VC lavo compIolod llo IC_INIT1
slalo, IIag 1 (II1) is sol and llo dovico coasos lo sond ICInil1 DIIIs and
advancos lo IC Inil2 slalo. Nolo llal rocoipl of an Inil2 IC pacIols may aIso
causo II1 lo bo sol. Tlis can occur if llo noiglboring dovico las aIroady
advancod lo llo IC Inil2 slalo.
FC Init2 Packets Confirm SuccessfuI FC InitiaIization
ICI Ixpross dofinos llo InilIC2 slalo llal is usod for foodbacI lo vorify llo IIov
ConlroI iniliaIizalion las boon succossfuI for a givon VC. During IC_INIT2,
oacl dovico conlinuousIy oulpuls a soquonco of 3 InilIC2 IIov ConlroI pacIols,
lovovor, crodil vaIuos aro discardod during llo IC_INIT2 slalo. Nolo llal
dovicos aro pormillod lo sond TIIs upon onloring llo IC_INIT2 slalo. Iiguro
7-12 iIIuslralos InilIC2 bolavior, vlicl is doscribod foIIoving llo iIIuslralion.
-
-- -

1. Al llo slarl of iniliaIizalion slalo IC_INIT2, oacl dovico commoncos sond-

ing InilIC2 lypo IIov ConlroI pacIols (ICIs) lo indicalo il las compIolod
llo IC_INIT1 slalo. Dovicos uso llo samo ropolilivo soquonco vlon sonding
ICIs in llis slalo as boforo:
- Hoador and Dala buffor crodil aIIocalion for Ioslod Roquosls (I)
- Hoador and Dala buffor crodil aIIocalion for Non-Ioslod Roquosls (NI)
- Hoador and Dala buffor crodil aIIocalion for CompIolions (CII)
2. AII crodils roporlod in InilIC2 ICIs may bo discardod, as llo lransmillor
Crodil Iimil counlors voro aIroady sol up in IC_INIT1.
3. Onco a dovico rocoivos an IC_INIT2 pacIol for any buffor lypo, il sols an
inlornaI fIag (II2). (Il doosn'l vail lo rocoivo an IC_Inil2 for oacl lypo.) Nolo
llal II2 is aIso sol upon rocoipl of an UpdaloIC pacIol or TII.
Rate of FC_INIT1 and FC_INIT2 Transmission
Tlo spocificalion dofinos llo Ialoncy bolvoon sonding IC_INIT DIIIs as foI-
Iovs:
- . Hardvaro inilialod fIov conlroI of VC0 roquiros llal IC_INIT1 and
IC_INIT2 pacIols bo lransmillod conlinuousIy al llo maximum ralo possi-
bIo. Tlal is, llo rosond limor is sol lo a vaIuo of zoro.
- . Wlon soflvaro inilialos fIov conlroI iniliaIizalion, llo IC_INIT
soquonco is ropoalod vlon no ollor TIIs or DIIIs aro avaiIabIo for lrans-
mission. Hovovor, llo Ialoncy bolvoon llo boginning of ono soquonco lo
llo noxl can bo no groalor llan 17s.
VioIations of the FIow ControI InitiaIization ProtocoI
A vioIalion of llo fIov conlroI iniliaIizalion prolocoI can bo oplionaIIy clocIod
by a dovico. An orror doloclod can bo roporlod as a Dala IinI Iayor prolocoI
orror. Soo IinI IIov ConlroI-RoIalod Irrors on pago 363.
FIow ControI Updates FoIIowing FC_INIT
Tlo rocoivor musl conlinuaIIy updalo ils noiglboring dovico lo roporl addi-
lionaI IIov ConlroI crodils llal lavo accumuIalod as a rosuIl of moving lransac-
lions from llo IIov ConlroI buffor. Iiguro 7-13 on pago 309 iIIuslralos an
oxampIo vloro llo lransmillor vas proviousIy bIocIod from sonding loador
lransaclions bocauso llo IIov ConlroI buffor vas fuII. In llo oxampIo, llo
rocoivor las jusl romovod llroo loadors from llo IIov ConlroI buffor. Moro
spaco is nov avaiIabIo, bul llo noiglboring dovico las no InovIodgo of llis. As
oacl loador is romovod from llo IIov ConlroI buffor, llo

CRIDITS_AIIOCATID counl incromonls. Tlo nov counl is doIivorod lo llo

CRIDIT_IIMIT rogislor of llo noiglboring dovico via an updalo IIov ConlroI
pacIol. Tlo updalod crodil Iimil aIIovs lransmission of addilionaI lransaclions.
FC_Update DLLP Format and Content
RocaII llal updalo IIov ConlroI pacIols, IiIo llo IIov ConlroI iniliaIizalion
pacIols conlain lvo updalo fioIds, ono for loador and ono for dala for llo
soIoclod crodil lypo (I, NI, and CpI). Iiguro 7-14 on pago 310 dopicls llo conlonl
of llo updalo pacIol. Tlo rocoivors CRIDITS_AIIOCATID counls llal aro
roporlod in llo HdrIC and DalaIC fioIds may lavo boon updalod many limos
or nol al aII sinco llo Iasl updalo pacIol sonl.

-- -

FIow ControI Update Frequency

Tlo spocificalion dofinos a varioly of ruIos and suggoslod impIomonlalions llal
govorn vlon and lov oflon IIov ConlroI Updalo DIIIs slouId bo sonl. Tlo
molivalion incIudos:
- Nolifying llo lransmilling dovico as oarIy as possibIo aboul nov crodils
aIIocalod, vlicl aIIovs proviousIy bIocIod lransaclions lo conlinuo.
- IslabIisling vorsl-caso Ialoncy bolvoon IC IacIols.
- BaIancing llo roquiromonls and variabIos associalod vill fIov conlroI
oporalion. Tlis invoIvos:
o llo nood lo roporl crodils avaiIabIo oflon onougl lo provonl lransaclion
bIocIing
o llo dosiro lo roduco llo IinI bandvidll roquirod lo sond IC_Updalo
DIIIs
o soIocling llo oplimum buffor sizo
o llo maximum dala payIoad sizo
- Dolocling vioIalion of llo maximum Ialoncy bolvoon IIov ConlroI pacIols.
Tlo updalo froquoncy Iimils spocifiod assumo llal llo IinI is in llo aclivo slalo
(I0 or IOs (s=slandby). AII ollor IinI slalos roprosonl moro aggrossivo povor
managomonl vill Iongor rocovory Ialoncios llal roquiro IinI rocovory prior lo
sonding pacIols.
-

Immediate Notification of Credits AIIocated

Wlon a IIov ConlroI buffor las fiIIod lo llo oxlonl llal maximum-sizod pacIols
cannol bo sonl, llo spocificalion roquiros immodialo doIivory of an IC_Updalo
DIII vlon llo doficil is oIiminalod. SpocificaIIy, vlon addilionaI crodils aro
aIIocalod by a rocoivor llal guaranloo sufficionl spaco nov oxisls lo accopls
anollor maximum-sizod pacIol, an Updalo pacIol musl bo sonl. Tvo casos
oxisl:
Wlon pacIol lransmission is bIocIod
duo lo a buffor fuII condilion for non-infinilo NIH, NID, IH, and CIIH
buffor lypos, an UpdaloIC pacIol musl bo scloduIod for Transmission
vlon ono or moro crodils aro mado avaiIabIo (aIIocalod) for llal buffor lypo.
- IIov ConlroI buffor spaco
may docroaso lo llo oxlonl llal a maximum-sizod pacIol cannol bo sonl for
non-infinilo ID and CIID crodil lypos. In llis caso, vlon ono or moro
addilionaI crodils aro aIIocalod, an Updalo ICI musl bo scloduIod for
lransmission.
Maximum Latency Between Update FIow ControI DLLPs
Tlo lransmission froquoncy of Updalo ICIs for oacl IC crodil lypo (non-infi-
nilo) musl bo scloduIod for lransmission al Ioasl onco ovory 30 s (-0/+50).
If llo Ixlondod Sync bil villin llo ConlroI IinI rogislor is sol, Updalos musl bo
scloduIod no Ialor llan ovory 120 s (-0/+50). Nolo llal Updalo ICIs may
bo scloduIod for lransmission moro froquonlIy llan is roquirod.
CaIcuIating Update Frequency Based on PayIoad Size and
Link Width
Tlo spocificalion offors a formuIa for caIcuIaling llo froquoncy al vlicl updalo
pacIols nood lo bo sonl for maximum dala payIoads sizos and IinI vidlls. Tlo
formuIa, slovn boIov, dofinos IC Updalo doIivory inlorvaIs in symboI limos
(4ns).
vloro:
- = Tlo vaIuo in llo Max_IayIoad_Sizo fioId of llo Dovico
ConlroI rogislor
- = llo conslanl vaIuo (28 symboIs) roprosonling llo addi-
MaxPayloadSize TLPOverhead UpdateFactor
LinkWidth
InternalDelay
-- -

lionaI TII compononls llal consumo IinI bandvidll (loador, ICRC,

framing SymboIs)
- = llo numbor of maximum sizo TIIs sonl during llo inlorvaI
bolvoon UpdaloIC IacIols rocoivod. Tlis numbor baIancos IinI bandvidll
officioncy and rocoivo buffor sizos llo vaIuo varios vill
Max_IayIoad_Sizo and IinI vidll
- = Tlo oporaling vidll of llo IinI nogolialod during iniliaIiza-
lion
- = a conslanl vaIuo of 19 symboI limos llal roprosonls llo
inlornaI procossing doIays for rocoivod TIIs and lransmillod DIIIs
Tlo simpIo roIalionslip dofinod by llo formuIa slov llal for a givon dala pay-
Ioad and buffor sizo, llo froquoncy of updalo pacIol doIivory bocomos liglor as
llo IinI vidll incroasos. Tlis roIalivoIy simpIo approacl suggosls a limor
impIomonlalion llal lriggors scloduIing of updalo pacIols. Nolo llal llis for-
muIa doos nol accounl for doIays associalod vill llo rocoivor or lransmillor
boing in llo I0s povor managomonl slalo.
Tlo spocificalion rocognizos llal llo formuIa viII bo inadoqualo for many appIi-
calions sucl as lloso llal slroam Iargo bIocIs of dala. Tloso appIicalions may
roquiro buffor sizos Iargor llan llo minimum spocifiod, as voII as a moro
soplislicalod updalo poIicy in ordor lo oplimizo porformanco and roduco
povor consumplion. Bocauso a givon soIulion is dopondonl on llo parlicuIar
roquiromonls of an appIicalion, no dofinilion for sucl poIicios is providod.
Error Detection Timer A Pseudo Requirement
Tlo spocificalion dofinos an oplionaI limo-oul moclanism llal is liglIy rocom-
mondod. So mucl so, llal llo spocificalion poinls oul llal il is oxpoclod lo
bocomo a roquiromonl in fuluros vorsions of llo spoc. Tlis moclanism dolocls
proIongod absoncos of IIov ConlroI pacIols. Tlo maximum Ialoncy bolvoon
IC pacIols for a givon IIov ConlroI crodil lypo is spocifiod lo bo no groalor llan
120s. Tlis orror doloclion limor las a maximum Iimil of 200s, and il gols rosol
any limo a IIov ConlroI pacIol of any lypo is rocoivod. If a limo-oul occurs, llis
suggosls a sorious probIom vill a dovicos abiIily lo roporl IIov ConlroI crod-
ils. ConsoquonlIy, a limo-oul lriggors llo IlysicaI Iayor lo onlor ils Rocovory
slalo vlicl rolrains llo IinI and lopofuIIy cIoars llo orror condilion. Claraclor-
islics of llis limor incIudo:
- oporalionaI onIy vlon llo IinI is in ils aclivo slalo (I0 or I0s)
- maximum counl Iimilod lo 200 s (-0/+50)

- limor is rosol vlon any Inil or Updalo ICI is rocoivod, or oplionaIIy llo
limor may bo rosol by llo rocoipl of any lypo of DIII
- vlon limor oxpiros IlysicaI Iayor onlors llo IinI Training Soquonco Slalo
Maclino (ITSSM) Rocovory slalo

The Previous Chapter

Tlo provious claplor discussod llo purposos and dolaiIod oporalion of llo
IIov ConlroI IrolocoI. Tlis prolocoI roquiros oacl dovico lo impIomonl crodil-
basod IinI fIov conlroI for oacl virluaI clannoI on oacl porl. IIov conlroI guar-
anloos llal lransmillors viII novor sond Transaclion Iayor IacIols (TIIs) llal
llo rocoivor canl accopl. Tlis provonls rocoivo buffor ovor-runs and oIiminalos
llo nood for inofficionl disconnocls, rolrios, and vail-slalos on llo IinI. IIov
ConlroI aIso loIps onabIo compIianco vill ICI Ixpross ordoring ruIos by main-
laining soparalo VirluaI ClannoI IIov ConlroI buffors for llroo lypos of lransac-
lions: Ioslod (I), Non-Ioslod (NI) and CompIolions (CpI).
This Chapter
Tlis claplor discussos llo ordoring roquiromonls for ICI Ixpross dovicos as
voII as ICI and ICI-X dovicos llal may bo allaclod lo a ICI Ixpross fabric. Tlo
discussion doscribos llo Iroducor/Consumor programming modoI upon vlicl
llo fundamonlaI ordoring ruIos aro basod. Il aIso doscribos llo polonliaI porfor-
manco probIoms llal can omorgo vlon slrong ordoring is ompIoyod and spoci-
fios llo ruIos dofinod for doadIocI avoidanco.
The Next Chapter
Nalivo ICI Ixpross dovicos llal roquiro inlorrupl supporl musl uso llo Mos-
sago SignaIod Inlorrupl (MSI) moclanism dofinod originaIIy in llo ICI 2.2 spoc-
ificalion. Tlo noxl claplor dolaiIs llo MSI moclanism and aIso doscribos llo
Iogacy supporl llal pormils virluaIizalion of llo ICI INTx signaIs roquirod by
dovicos sucl as ICI Ixpross-lo-ICI Bridgos.
-- -

Introduction
As vill ollor prolocoIs, ICI Ixpross imposos ordoring ruIos on lransaclions
moving llrougl llo fabric al llo samo limo. Tlo roasons for llo ordoring ruIos
incIudo:
- Insuring llal llo compIolion of lransaclions is dolorminislic and in llo
soquonco inlondod by llo programmor.
- Avoiding doadIocIs condilions.
- Mainlaining compalibiIily vill ordoring aIroady usod on Iogacy busos (o.g.,
ICI, ICI-X, and AGI).
- Maximizo porformanco and llrouglpul by minimizing road Ialoncios and
managing road/vrilo ordoring.
ICI Ixpross ordoring is basod on llo samo Iroducor/Consumor modoI as ICI.
Tlo spIil lransaclion prolocoI and roIalod ordoring ruIos aro fairIy slraigll for-
vard vlon roslricling llo discussion lo lransaclions invoIving onIy nalivo ICI
Ixpross dovicos. Hovovor, ordoring bocomos moro compIox vlon incIuding
supporl for llo Iogacy busos monlionod in buIIol llroo abovo.
Rallor llan prosonling llo ordoring ruIos dofinod by llo spocificalion and
allompling lo oxpIain llo ralionaIo for oacl ruIo, llis claplor laIos llo buiIding
bIocI approacl. Iacl major ordoring concorn is inlroducod ono al a limo. Tlo
discussion bogins vill llo mosl consorvalivo (and safosl) approacl lo ordoring,
progrossos lo a moro aggrossivo approacl (lo improvo porformanco), and cuImi-
nalos vill llo ordoring ruIos prosonlod in llo spocificalion. Tlo discussion is
sogmonlod inlo llo foIIoving soclions:
1. Tlo Iroducor/Consumor programming modoI upon vlicl llo fundamon-
laI ordoring ruIos aro basod.
2. Tlo fundamonlaI ICI Ixpross dovico ordoring roquiromonls llal onsuro llo
Iroducor/Consumor modoI funclions corroclIy.
3. Tlo RoIaxod Ordoring foaluro llal pormils vioIalion of llo Iroducor/Con-
sumor ordoring vlon llo dovico issuing a roquosl Inovs llal llo lransac-
lion is nol parl of a Iroducor/Consumor programming soquonco.
4. Modificalion of llo slrong ordoring ruIos lo improvo porformanco.
5. Avoiding doadIocI condilions and supporl for ICI Iogacy impIomonlalions.
-

Producer/Consumer ModeI
Roadors famiIiar vill llo Iroducor/Consumor programming modoI may
clooso lo sIip llis soclion and procood diroclIy lo Nalivo ICI Ixpross Ordor-
ing RuIos on pago 318.
Tlo Iroducor/Consumor modoI is a common mollodoIogy llal lvo roquoslor-
capabIo dovicos migll uso lo communicalo vill oacl ollor. Considor llo foI-
Ioving oxampIo sconario:
1. A nolvorI adaplor bogins lo rocoivo a slroam of comprossod vidoo dala
ovor llo nolvorI and porforms a sorios of momory vrilo lransaclions lo
doIivor llo slroam of comprossod vidoo dala inlo a in momory
(in ollor vords llo nolvorI adaplor is llo of llo dala).
2. Aflor llo movos llo dala lo momory, il porforms a momory vrilo
lransaclion lo sol an indicalor (or ) in a momory Iocalion (or a rogislor)
lo indicalo llal llo dala is roady for procossing.
3. Anollor roquoslor (roforrod lo as llo -) poriodicaIIy porforms a
momory road from llo Iocalion lo soo if lloros any dala lo bo pro-
cossod. In llis oxampIo, llis roquoslor is a vidoo docomprossor llal viII
docompross and dispIay llo dala.
4. Wlon il soos llal llo las boon sol by llo , il porforms a mom-
ory vrilo lo cIoar llo foIIovod by a bursl momory road lransaclion lo
road llo comprossod dala (il consumos llo dala, lonco llo namo
-) from llo in momory.
5. Wlon il is dono consuming llo , llo - vrilos llo compIolion
slalus inlo llo - Iocalion. Il llon rosumos poriodicaIIy roading llo
Iocalion lo dolormino vlon moro dala noods lo bo procossod.
6. In llo moanlimo, llo las boon roading poriodicaIIy from llo
- Iocalion lo soo if dala procossing las boon compIolod by llo ollor
roquoslor (llo -). Tlis Iocalion lypicaIIy conlains zoro unliI llo
ollor roquoslor compIolos llo dala procossing and vrilos llo compIolion
slalus inlo il. Wlon llo roads llo - and soos llal llo
- las compIolod procossing llo , llo llon porforms a
momory vrilo lo cIoar llo - Iocalion.
7. Tlo procoss llon ropoals vlonovor llo las moro dala lo bo pro-
cossod.
Ordoring ruIos aro roquirod lo onsuro llal llo Iroducor/Consumor modoI
vorIs corroclIy no mallor vloro llo , llo -, llo buffor,
llo Iocalion, and llo - Iocalion aro Iocalod in llo syslom (in ollor
vords, no mallor lov lloy aro dislribulod on various IinIs in llo syslom).
-- -

Native PCI Express Ordering RuIes

ICI Ixpross lransaclion ordoring for nalivo dovicos can bo summarizod vill
four simpIo ruIos:
1. ICI Ixpross roquiros slrong ordoring of lransaclions (i.o., porforming lrans-
aclions in llo ordor issuod by soflvaro) fIoving llrougl llo fabric llal lavo
llo samo TC assignmonl (soo ilom 4 for llo oxcoplion lo llis ruIo). Bocauso
aII lransaclions llal lavo llo samo TC vaIuo assignod lo llom aro mappod
lo a givon VC, llo samo ruIos appIy lo lransaclions villin oacl VC.
2. No ordoring roIalionslip oxisls bolvoon lransaclions vill difforonl TC
assignmonls.
3. Tlo ordoring ruIos appIy in llo samo vay lo aII lypos of lransaclions: mom-
ory, IO, configuralion, and mossagos.
4. Undor Iimilod circumslancos, lransaclions vill llo RoIaxod Ordoring
allribulo bil sol can bo ordorod aload of ollor lransaclions vill llo samo
TC.
Tloso fundamonlaI ruIos onsuro llal lransaclions aIvays compIolo in llo ordor
inlondod by soflvaro. Hovovor, lloso ruIos aro oxlromoIy consorvalivo and do
nol nocossariIy rosuIl in oplimum porformanco. Ior oxampIo, vlon lransaclions
from many dovicos morgo villin svilclos, lloro may bo no ordoring roIalion-
slip bolvoon lransaclions from lloso difforonl dovicos. In sucl casos, moro
aggrossivo ruIos can bo appIiod lo improvo porformanco as discussod in Modi-
fiod Ordoring RuIos Improvo Iorformanco on pago 322.
Producer/Consumer ModeI with Native Devices
Bocauso llo Iroducor/Consumor modoI doponds on slrong ordoring, vlon llo
foIIoving condilions aro mol nalivo ICI Ixpross dovicos supporl llis modoI
villoul addilionaI ordoring ruIos:
1. AII oIomonls associalod vill llo Iroducor/Consumor modoI rosido villin
nalivo ICI Ixpross dovicos.
2. AII lransaclions associalod vill llo oporalion of llo Iroducor/Consumor
modoI lransvorso onIy ICI Ixpross IinIs villin llo samo fabric.
3. AII associalod lransaclions lavo llo samo TC vaIuos. If difforonl TC vaIuos
aro usod, llon llo slrong ordoring roIalionslip bolvoon llo lransaclions is
no Iongor guaranlood.
4. Tlo RoIaxod Ordoring (RO) allribulo bil of llo lransaclions musl bo cIoarod
lo avoid roordoring llo lransaclions llal aro parl of llo Iroducor/Con-
sumor lransaclion sorios.
-

Wlon ICI Iogacy dovicos rosido villin a ICI Ixpross syslom, llo ordoring ruIos
bocomo moro invoIvod. ConsoquonlIy, addilionaI ordoring ruIos appIy bocauso
of ICIs doIayod lransaclion prolocoI. Willoul ordoring ruIos, llis prolocoI
couId pormil Iroducor/Consumor lransaclions lo compIolo oul of ordor and
causo llo programming modoI lo broaI.
ReIaxed Ordering
ICI Ixpross supporls llo RoIaxod Ordoring moclanism inlroducod by ICI-X,
lovovor, ICI Ixpross inlroducos somo clangos (discussod Ialor in llis claplor).
Tlo concopl of RoIaxod Ordoring in llo ICI Ixpross onvironmonl aIIovs
svilclos in llo pall bolvoon llo Roquoslor and CompIolor lo roordor somo
lransaclions jusl rocoivod boforo ollors llal voro proviousIy onquouod.
Tlo ordoring ruIos llal oxisl lo supporl llo Iroducor/Consumor modoI may
rosuIl in lransaclions boing bIocIod, vlon in facl llo bIocIod lransaclions aro
compIoloIy unroIalod lo any Iroducor/Consumor lransaclion soquonco. Conso-
quonlIy, in corlain circumslancos, a lransaclion vill ils RoIaxod Ordoring (RO)
allribulo bil sol can bo ro-ordorod aload of ollor lransaclions.
Tlo RoIaxod Ordoring bil may bo sol by llo dovico if ils dovico drivor las
onabIod il lo do so (by solling llo InabIo RoIaxod Ordoring bil in llo Dovico
ConlroI rogislorsoo TabIo 24 - 3 on pago 906). RoIaxod ordoring givos svilclos
and llo Rool CompIox pormission lo movo llis lransaclion aload of ollors,
vloroas llo aclion is normaIIy prolibilod.
RO Effects on Memory Writes and Messages
ICI Ixpross Svilclos and llo Rool CompIox aro affoclod by momory vrilo and
mossago lransaclions llal lavo lloir RO bil sol. Momory vrilo and Mossago
lransaclions aro lroalod llo samo in mosl rospoclsboll aro landIod as poslod
oporalions, boll aro rocoivod inlo llo samo Ioslod buffor, and boll aro subjocl
lo llo samo ordoring roquiromonls. Wlon llo RO bil is sol, svilclos landIo
lloso lransaclions as foIIovs:
- Svilclos aro pormillod lo roordor momory vrilo lransaclions jusl poslod
aload of proviousIy poslod momory vrilo lransaclions or mossago lransac-
lions. SimiIarIy, mossago lransaclions jusl poslod may bo ordorod aload of
proviousIy poslod momory vrilo or mossago lransaclions. Svilclos musl
aIso forvard llo RO bil unmodifiod. Tlo abiIily lo roordor lloso lransac-
lions villin svilclos is nol supporlod by ICI-X bridgos. In ICI-X, aII
-- -

poslod vrilos musl bo forvardod in llo oxacl ordor rocoivod. Anollor dif-
foronco bolvoon llo ICI-X and ICI Ixpross impIomonlalions is llal mos-
sago lransaclions aro nol dofinod for ICI-X.
- Tlo Rool CompIox is pormillod lo ordor a jusl-poslod vrilo lransaclion
aload of anollor vrilo lransaclion llal vas rocoivod oarIior in limo. AIso,
vlon rocoiving vrilo roquosls (vill RO sol), llo Rool CompIox is roquirod
lo vrilo llo dala payIoad lo llo spocifiod addross Iocalion villin syslom
momory, bul is pormillod lo vrilo oacl bylo lo momory in any addross
ordor.
RO Effects on Memory Read Transactions
AII road lransaclions in ICI Ixpross aro landIod as spIil lransaclions. Wlon a
dovico issuos a momory road roquosl vill llo RO bil sol, llo roquosl may
lravorso ono or moro svilclos on ils journoy lo llo CompIolor. Tlo CompIolor
rolurns llo roquoslod road dala in a sorios of ono or moro spIil compIolion lrans-
aclions, and usos llo samo RO solling as in llo roquosl. Svilcl bolavior for llo
oxampIo slalod abovo is as foIIov:
1. A svilcl llal rocoivos a momory road roquosl vill llo RO bil sol musl for-
vard llo roquosl in llo ordor rocoivod, and musl nol roordor il aload of
momory vrilo lransaclions llal voro proviousIy poslod. Tlis aclion guar-
anloos llal aII vrilo lransaclions moving in llo diroclion of llo road roquosl
aro puslod aload of llo road. Sucl aclions aro nol nocossariIy parl of llo
Iroducor/Consumor programming soquonco, bul soflvaro may dopond on
llis fIusling aclion laIing pIaco. AIso, llo RO bil musl nol bo modifiod by
llo svilcl.
2. Wlon llo CompIolor rocoivos llo momory road roquosl, il folclos llo
roquoslod road dala and doIivors a sorios of ono or moro momory road Com-
pIolion lransaclions vill llo RO bil sol (bocauso il vas sol in llo roquosl).
3. A svilcl rocoiving llo momory road CompIolion(s) dolocls llo RO bil sol
and Inovs llal il is aIIovod lo ordor llo road CompIolion(s) aload of provi-
ousIy poslod momory vrilos moving in llo diroclion of llo CompIolion. If
llo momory vrilo lransaclion voro bIocIod (duo lo fIov conlroI), llon llo
momory road CompIolion vouId aIso bo bIocIod if llo RO vas nol sol.
RoIaxod ordoring in llis caso improvos road porformanco.

TabIo 8-1 summarizos llo roIaxod ordoring bolavior aIIovod by svilclos.
-

Summary of Strong Ordering RuIes

Tlo ICI Ixpross spocificalion dofinos slrong ordoring ruIos associalod vill
lransaclions llal aro assignod llo samo TC vaIuo, and furllor dofinos a RoIaxod
Ordoring allribulo llal can bo usod vlon a dovico Inovs llal a lransaclion las
no ordoring roIalionslip lo ollor lransaclions vill llo samo TC vaIuo. TabIo 8-2
on pago 322 summarizos llo ICI Ixpross ordoring ruIos llal salisfy llo Iro-
ducor/Consumor modoI and aIso providos for RoIaxod Ordoring. Tlo labIo rop-
rosonls a draconian approacl lo ordoring and doos nol considor issuos of
porformanco, provonling doadIocIs, olc.
Tlo labIo appIios lo lransaclions vill llo samo TC assignmonl llal aro moving
in llo samo diroclion. Tloso ruIos onsuro llal lransaclions viII compIolo in llo
inlondod program ordor and oIiminalos llo possibiIily of doadIocIs in a puro
ICI Ixpross impIomonlalion (i.o., sysloms vill no ICI Bridgos). CoIumns 2 - 6
roprosonl lransaclions llal lavo proviousIy Ialclod by a ICI Ixpross dovico,
vliIo coIumn 1 roprosonls subsoquonlIy-Ialclod lransaclions. Tlo ordoring
roIalionslip bolvoon llo lransaclion in coIumn 1 lo ollor lransaclions provi-
ousIy onquouod is oxprossod in llo labIo on a rov-by-rov basis. Nolo llal lloso
ruIos appIy uniformIy lo aII lransaclion lypos (Momory, Mossagos, IO, and Con-
figuralion). Tlo labIo onlrios aro dofinod as foIIovs:
Tlo lransaclion in coIumn 1 musl nol bo pormillod lo procood aload of
llo proviousIy onquouod lransaclion in llo corrosponding coIumns (2-6).
(Yos/No) Tlo lransaclion in coIumn 1 is aIIovod lo procood aload of llo
proviousIy onquouod lransaclion bocauso ils RoIaxod Ordoring bil is sol (1), bul
il is nol roquirod lo do so.
--
- -- -- - --
Momory Wrilo Roquosl Momory Wrilo Roquosl
Mossago Roquosl Momory Wrilo Roquosl
Momory Wrilo Roquosl Mossago Roquosl
Mossago Roquosl Mossago Roquosl
Road CompIolion Momory Wrilo Roquosl
Road CompIolion Mossago Roquosl
-- -

Nolo llal llo sladod aroa roprosonls llo ordoring roquiromonls llal onsuro llo
Iroducor/Consumor modoI funclions corroclIy and is consislonl vill llo basic
ruIos associalod vill slrong ordoring. Tlo lransaclion ordoring associalod vill
coIumns 3 - 6 pIay no roIo in llo Iroducor/Consumor modoI.
Modified Ordering RuIes Improve Performance
Tlis soclion doscribos lov lomporary lransaclion bIocIing can occur vlon llo
slrong ordoring ruIos Iislod in TabIo 8-2 aro rigorousIy onforcod. Modificalion of
slrong ordoring bolvoon lransaclions llal do nol vioIalo llo Iroduco/Con-
sumor programming modoI can oIiminalo many bIocIing condilions and
improvo IinI officioncy.
Strong Ordering Can ResuIt in Transaction BIocking
Mainlaining llo slrong ordoring roIalionslip bolvoon lransaclions vouId IiIoIy
rosuIl in inslancos vloro aII lransaclions vouId bo bIocIod duo lo a singIo
rocoivo buffor boing fuII. Tlo slrong ordoring roquiromonls lo supporl llo Iro-
ducor/Consumor modoI cannol bo modifiod (oxcopl in llo caso of roIaxod
- -
-

ordoring doscribod proviousIy). Hovovor, lransaclion soquoncos llal do nol

occur villin llo Iroducor/Consumor programming modoI can bo modifiod lo
a voaIIy ordorod sclomo llal can Ioad lo improvod porformanco.
The ProbIem
Considor llo foIIoving oxampIo iIIuslralod in Iiguro 8-1 on pago 323 vlon
slrong ordoring is mainlainod for aII lransaclion soquoncos. Tlis oxampIo
dopicls lransmillor and rocoivor buffors associalod vill llo doIivory of lransac-
lions in a singIo diroclion (from Iofl lo rigll) for a singIo VirluaI ClannoI (VC),
and llo lransmil and rocoivo buffors aro organizod in llo samo vay. AIso, rocaII
llal oacl of llo lransaclion lypos (Ioslod, Non-Ioslod, and CompIolions) lavo
indopondonl fIov conlroI villin llo samo VC. Tlo numbors villin llo lransmil
buffors slov llo ordor in vlicl lloso lransaclions voro issuod lo llo lransmil-
lor. In addilion, llo non-poslod rocoivo buffor is curronlIy fuII. Considor llo foI-
Ioving soquonco.
1. Transaclion 1 (a momory roadnon-poslod oporalion) is llo noxl lransac-
lion llal musl bo sonl (basod on slrong ordoring). Tlo fIov conlroI mocla-
nism dolocls llal insufficionl crodils aro avaiIabIo, so Transaclion 1 cannol
bo sonl.
2. Transaclion 2 (a poslod momory vrilo) is llo noxl lransaclion ponding.
Wlon consuIling TabIo 8-2 (basod on slrong ordoring), onlry A3 spocifios
llal a momory vrilo musl nol pass a proviousIy poslod road lransaclion.
3. Bocauso aII onlrios in TabIo 8-2 aro No, aII lransaclions aro bIocIod duo lo
llo non-poslod rocoivo buffor boing fiIIod.
-- --
-- -

The WeakIy Ordered SoIution

As discussod proviousIy, slrong ordoring is roquirod lo supporl llo Iroducor/
Consumor modoI. Tlis roquiromonl is salisfiod onliroIy by llo sladod aroa in
TabIo 8-2. Tlo non-sladod aroa doaIs vill lransaclion soquoncos llal do nol
occur in llo Iroducor/Consumor programming modoI, and lloroforo can bo
modifiod. TabIo 8-3 on pago 326 Iisls lloso onlrios as voaIIy ordorod. Tlo modi-
fiod onlrios aro dofinod as:
(Yos/No) Tlo lransaclion in coIumn 1 is aIIovod lo procood aload of llo
proviousIy onquouod lransaclion bocauso llo onlry is nol roIalod lo llo Iro-
ducor/Consumor slrong ordoring roquiromonls and can bo voaIIy ordorod lo
improvo porformanco.
Considor llo sconario in Iiguro 8-1 vill voaI ordoring ompIoyod:
1. Transaclion 1 (a momory roadnon-poslod oporalion) is llo noxl lransac-
lion llal musl bo sonl. Tlo fIov conlroI moclanism dolocls llal insufficionl
crodils aro avaiIabIo, so Transaclion 1 cannol bo sonl.
2. Tlo noxl lransaclion ponding (2) is a poslod momory vrilo oporalion. Wlon
consuIling TabIo 8-3 on pago 326, onlry A3 (Y/N) aIIovs llo lransmillor lo
roordor lransaclion 2 aload of lransaclion 1. No bIocIing occurs!
3. Tlo romaining lransaclions ponding viII aIso compIolo aload of lransaclion
1 if llo non-poslod buffor romains fuII. Wlon fIov conlroI crodils aro
rolurnod for llo non-poslod oporalions, lransaclion 1 viII bo llo noxl lrans-
aclion sonl.
In summary, lloso oxampIos iIIuslralo lov slrong ordoring can lomporariIy
bIocI aII lransaclions ponding doIivory, and llal voaI ordoring ruIos can bo
usod lo improvo IinI officioncy villoul vioIaling llo Iroducor/Consumor
modoI.
Order Management AccompIished with VC Buffers
As llo provious oxampIo iIIuslralod, lransaclion ordoring is managod villin llo
VirluaI ClannoI buffors. Tloso buffors aro groupod inlo Ioslod, Non-Ioslod,
and CompIolion lransaclions and fIov conlroI is managod indopondonlIy for
oacl group. Tlis maIos il mucl oasior lo impIomonl llo modifiod (voaI) ordor-
ing doscribod in llo provious oxampIo. Soo Claplor 7, onlilIod "IIov ConlroI,"
on pago 285 for dolaiIs.
-

RocaII llal lransaclions aro mappod lo VirluaI ClannoIs using llo lransaclion's
TC. If oacl TC is mappod lo a soparalo VC, llon oacl VC buffor viII conlain
lransaclions vill a singIo TC assignmonl. In llis silualion, VC fIov conlroI por-
mils oplimum fIov of lransaclions.
Summary of Modified Ordering RuIes
TabIo 8-3 on pago 326 Iisls and liglIiglls llo modifiod ordoring ruIos llal aIIov
svilclos lo movo somo lransaclions aload of ollors llal may bo slaIIod duo lo a
rocoivo buffor fuII condilion. Dofinilion of llo onlrios aro llo samo as llo provi-
ous labIo:
Tlo lransaclion in coIumn 1 musl nol bo pormillod lo procood aload of llo
proviousIy onquouod lransaclion in llo corrosponding coIumns (2-6).
(Yos/No)Tlo lransaclion in coIumn 1 is aIIovod lo procood aload of llo
proviousIy onquouod lransaclion bocauso:
- ils RoIaxod Ordoring bil is sol (1), bul il is nol roquirod lo do so.
- llo onlry is nol subjocl lo llo Iroducor/Consumor slrong ordoring roquiro-
monls and is voaIIy ordorod lo improvo porformanco.
: Tlo No onlry in Rov D, CoIumn 5 (D5) appIios lo casos vloro a CompI-
olor rolurns muIlipIo CompIolions in rosponso lo a singIo road roquosl. Tloso
CompIolions musl rolurn in ordor (i.o., CompIolions vill llo samo lransaclion
ID).
Upon oxaminalion of llo labIo, somo roadors may quoslion vlollor programs
viII oporalo corroclIy vlon voaI ordoring is ompIoyod. Ior oxampIo, nolo llal
a vrilo lransaclion is pormillod lo bo roordorod aload of a proviousIy Ialclod
road roquosl (onlry A3). A programmor vlo roads from a Iocalion foIIovod by a
vrilo lo llo samo Iocalion musl nol oxpocl lloso oporalions lo compIolo in pro-
gram ordor. Nolo llal llo ordoring ruIos onIy guaranloo propor oporalion of llo
Iroducor/Consumor programming modoI. If a programmor roquiros a road
oporalion lo compIolo aload of a vrilo lransaclion, llon llo vrilo musl nol bo
issuod unliI llo road lransaclion compIolos.
-- -

Support for PCI Buses and DeadIock Avoidance

Bocauso llo ICI bus ompIoys doIayod lransaclions, sovoraI doadIocI sconarios
can dovoIop. Tloso doadIocI avoidanco ruIos aro incIudod in ICI Ixpross ordor-
ing lo onsuro llal no doadIocIs occur rogardIoss of lopoIogy. Adloring lo llo
ordoring ruIos provonl probIoms vlon boundary condilions dovoIop duo lo
unanlicipalod lopoIogios (o.g., lvo ICI Ixpross lo ICI bridgos connoclod across
llo ICI Ixpross fabric). Rofor lo llo MindSlaro booI onlilIod -
pubIislod by Addison-WosIoy) for a dolaiIod oxpIanalion
of llo sconarios llal aro llo basis for llo ICI ordoring ruIos roIalod lo doadIocI
avoidanco. TabIo 8-4 on pago 327 Iisls and liglIiglls llo doadIocI avoidanco
ordoring ruIos. Nolo llal avoiding llo doadIocIs invoIvos Yos onlrios in oacl
caso. If bIocIing occurs, llo lransaclion in coIumn 1 musl bo movod aload of
llo lransaclion spocifiod in llo coIumn vloro llo Yos onlry oxisls. Nolo aIso
llal llo Yos onlrios in A5b and A6b appIy onIy lo ICI Ixpross lo ICI Bridgos
and ICI Ixpross lo ICI-X Bridgos.
-
-

Tlo spocificalion providos llo foIIoving oxpIanalion of llo labIo onlrios:

- A Momory Wrilo or Mossago Roquosl vill llo RoIaxod Ordoring
Allribulo bil cIoar (0b) musl nol pass any ollor Momory Wrilo or Mossago
Roquosl.
- A Momory Wrilo or Mossago Roquosl vill llo RoIaxod Ordoring
Allribulo bil sol (1b) is pormillod lo pass any ollor Momory Wrilo or Mos-
sago Roquosl.
- A Momory Wrilo or Mossago Roquosl musl bo aIIovod lo pass
Road Roquosls and I/O or Configuralion Wrilo Roquosls lo avoid doad-
IocIs.
- Indpoinls, Svilclos, and Rool CompIoxos may oillor aIIov
Momory Wrilo and Mossago Roquosls lo pass CompIolions or lo bo bIocIod
by CompIolions.
- ICI Ixpross lo ICI Bridgos and ICI Ixpross lo ICI-X Bridgos
(vlon oporaling in ICI modo), musl aIIov Momory Wrilo and Mossago
Roquosls lo pass CompIolions lravoIing in llo ICI Ixpross lo ICI diroclion
(Irimary sido of Bridgo lo Socondary sido of Bridgo) lo avoid doadIocI.
- -
-- -

- Tloso Roquosls cannol pass a Momory Wrilo or Mossago Roquosl.

Tlis prosorvos slrong vrilo ordoring roquirod lo supporl llo Iroducor/
Consumor modoI.
- Road Roquosls and I/O or Configuralion Wrilo Roquosls
aro pormillod lo bo bIocIod by or lo pass ollor Road Roquosls and I/O or
Configuralion Wrilo Roquosls.
- Tlo Roquosls spocifiod aro pormillod lo bo bIocIod by or
lo pass CompIolions.
- If llo RoIaxod Ordoring allribulo bil is nol sol, llon a Road CompIo-
lion cannol pass a proviousIy onquouod Momory Wrilo or Mossago Roquosl.
- If llo RoIaxod Ordoring allribulo bil is sol, llon a Road CompIolion
is pormillod lo pass a proviousIy onquouod Momory Wrilo or Mossago
Roquosl.
- CompIolions musl bo aIIovod lo pass Road and I/O or
Configuralion Wrilo Roquosls lo avoid doadIocIs.
- Road CompIolions associalod vill difforonl Road Roquosls aro
aIIovod lo bo bIocIod by or lo pass oacl ollor.
- Wlon muIlipIo compIolions aro rolurnod in rosponso lo a singIo
Road Roquosl, llo compIolions musl rolurn llo roquoslod road dala in llo
propor addross ordor. Nolo llal llo dala rolurnod in oacl compIolion is
doIivorod in asconding addross ordor. Svilclos can rocognizo llis condilion
bocauso oacl compIolion viII lavo llo samo Transaclion ID. CompIolions
vill difforonl lransaclion IDs can bo roordorod villoul concorn.
- CompIolions aro pormillod lo bo bIocIod by or lo pass I/O or
Configuralion Wrilo CompIolions.
- I/O or Configuralion Wrilo CompIolions aro pormillod lo bo bIocIod
by or lo pass Momory Wrilo and Mossago Roquosls. Sucl lransaclions aro
acluaIIy moving in llo opposilo diroclion, and lavo no ordoring roIalion-
slip.
- I/O or Configuralion Wrilo CompIolions aro pormillod lo bo
bIocIod by or lo pass Road CompIolions and ollor I/O or Configuralion
Wrilo CompIolions.
Tlo spocificalion aIso slalos llo foIIoving addilionaI ruIos:
- Ior Rool CompIox and Svilcl, Momory Wrilo combining (as dofinod in llo
ICI Spocificalion) is prolibilod. Nolo: Tlis is roquirod so llal dovicos can bo
pormillod lo oplimizo lloir rocoivo buffor and conlroI Iogic for Momory
Wrilo sizos malcling lloir naluraI oxpoclod sizos, rallor llan boing
roquirod lo supporl llo maximum possibIo Momory Wrilo payIoad sizo.
- Combining of Momory Road Roquosls, and/or CompIolions for difforonl
Roquosls is prolibilod.
- Tlo No Snoop bil doos nol affocl llo roquirod ordoring bolavior.

-
The Previous Chapter
Tlis claplor discussos llo ordoring roquiromonls for ICI Ixpross dovicos as
voII as ICI and ICI-X dovicos llal may bo allaclod lo a ICI Ixpross fabric. Tlo
discussion doscribos llo Iroducor/Consumor programming modoI upon vlicl
llo fundamonlaI ordoring ruIos aro basod. Il aIso doscribos llo polonliaI porfor-
manco probIoms llal can omorgo vlon slrong ordoring is ompIoyod and spoci-
fios llo ruIos dofinod for doadIocI avoidanco.
This Chapter
Nalivo ICI Ixpross dovicos llal roquiro inlorrupl supporl musl uso llo Mos-
sago SignaIod Inlorrupl (MSI) moclanism dofinod originaIIy in llo ICI 2.2 vor-
sion of llo spocificalion. Tlis claplor dolaiIs llo MSI moclanism and aIso
doscribos llo Iogacy supporl llal pormils virluaIizalion of llo ICI INTx signaIs
roquirod by dovicos sucl as ICI Ixpross-lo-ICI Bridgos.
The Next Chapter
To llis poinl il las boon prosumod llal lransaclions lravorsing llo fabric lavo
nol oncounlorod any orrors llal cannol bo corroclod by lardvaro. Tlo noxl
claplor discussos boll corroclabIo and non-corroclabIo orrors and discussos llo
moclanisms usod lo roporl llom. Tlo ICI Ixpross arclilocluro providos a ricl
sol of orror doloclion, roporling, and Iogging capabiIilios. ICI Ixpross orror
roporling cIassifios orrors inlo llroo cIassos: corroclabIo, non-falaI, and falaI.
Irior lo discussing llo ICI Ixpross orror roporling capabiIilios, incIuding ICI-
compalibIo moclanisms, a briof roviov of llo ICI orror landIing is incIudod as
bacIground informalion.
-- -

Two Methods of Interrupt DeIivery

Inlorrupl doIivory is condilionaIIy oplionaI for ICI Ixpross dovicos. Wlon a
nalivo ICI Ixpross funclion doos dopond upon doIivoring inlorrupls lo caII ils
dovico drivor, Mossago SignaIod Inlorrupls (MSI) musl bo usod. Hovovor, in llo
ovonl llal a dovico connocling lo a ICI Ixpross IinI cannol uso MSIs (i.o., Iogacy
dovicos), an aIlornalo moclanism is dofinod. Boll moclanisms aro summarizod
boIov:
-- ICI Ixpross oIiminalos llo nood for
sidoband signaIs by using llo Mossago SignaIod Inlorrupl (MSI), firsl dofinod
by llo 2.2 vorsion of llo ICI Spocificalion (as an oplionaI moclanism) and Ialor
roquirod by ICI-X dovicos. Tlo lorm Mossago SignaIod Inlorrupl can bo mis-
Ioading in llo conloxl of ICI Ixpross bocauso of possibIo confusion vill ICI
Ixprosss Mossago lransaclions. A Mossago SignaIod Inlorrupl is nol a ICI
Ixpross Mossago, insload il is simpIy a Momory Wrilo lransaclion. A momory
vrilo associalod vill an MSI can onIy bo dislinguislod from ollor momory
vrilos by llo addross Iocalions lloy largol, vlicl aro rosorvod by llo syslom for
Inlorrupl doIivory.
Tlis moclanism supporls dovicos llal musl
uso ICI-CompalibIo inlorrupl signaIing (i.o., INTA#, INTB#, INTC#, and
INTD#) dofinod for llo ICI bus. Iogacy funclions uso ono of llo inlorrupl Iinos
lo signaI an inlorrupl. An INTx# signaI is assorlod lo roquosl inlorrupl sorvico
and doassorlod vlon llo inlorrupl sorvico accossos a dovico-spocific rogislor,
lloroby indicaling llo inlorrupl is boing sorvicod. ICI Ixpross dofinos in-band
mossagos llal acl as virluaI INTx# viros, vlicl largol llo inlorrupl conlroIIor
Iocalod lypicaIIy villin llo Rool CompIox.
Iiguro 9-1 iIIuslralos llo doIivory of inlorrupls from llroo lypos of dovicos:
- Nalivo ICI Ixpross dovico musl uso MSI doIivory
- Iogacy ondpoinl dovico musl supporl MSI and oplionaIIy supporl INTx
mossagos. Sucl dovicos may bo bool dovicos llal musl uso Iogacy inlorrupls
during bool, bul onco ils drivor Ioads MSIs aro usod.
- ICI Ixpross-lo-ICI (X) Bridgo musl supporl INTx mossagos
-

Message SignaIed Interrupts

Mossago SignaIod Inlorrupls (MSIs) aro doIivorod lo llo Rool CompIox via
momory vrilo lransaclions. Tlo MSI CapabiIily rogislor providos aII llo infor-
malion llal llo dovico roquiros lo signaI MSIs. Tlis rogislor is sol up by configu-
ralion soflvaro and incIudos llo foIIoving informalion:
- Targol momory addross
- Dala VaIuo lo bo vrillon lo llo spocifiod addross Iocalion
- Tlo numbor of mossagos llal can bo oncodod inlo llo dala
--
-- -

Soo Doscriplion of 3DW And 4DW Momory Roquosl Hoador IioIds on

pago 176 for a roviov of llo Momory Wrilo Transaclion Hoador. Nolo llal MSIs
aIvays lavo a dala payIoad of 1DW.
The MSI CapabiIity Register Set
A ICI Ixpross funclion indicalos ils supporl for MSI via llo MSI CapabiIily rog-
islors. Iacl nalivo ICI Ixpross funclion musl impIomonl a singIo MSI rogislor
sol villin ils ovn configuralion spaco. Nolo llal llo ICI Ixpross spocificalion
dofinos lvo rogislor formals:
1. 64-bil momory addrossing formal (Iiguro 9-2 on pago 332) roquirod by
aII nalivo ICI Ixpross dovicos and oplionaIIy impIomonlod by Iogacy ond-
poinls.
2. 32-bil momory addrossing formal (Iiguro 9-3 on pago 332) oplionaIIy
supporlod by Iogacy ondpoinls.
Tlo foIIoving soclions doscribo oacl fioId villin llo MSI rogislors.
CapabiIity ID
Tlo CapabiIily ID llal idonlifios llo MSI rogislor sol is . Tlis is a lardvirod,
road-onIy vaIuo.
-
-
-

Pointer To Next New CapabiIity

Tlo socond bylo of llo rogislor sol oillor poinls lo llo noxl Nov CapabiIilys
rogislor sol or conlains 00l if llis is llo ond of llo Nov CapabiIilios Iisl. Tlis is a
lardvirod, road-onIy vaIuo. If non-zoro, il musl bo a dvord-aIignod vaIuo.
Message ControI Register
Iiguro 9-4 on pago 333 and TabIo 9-1 on pago 333 iIIuslralo llo Iayoul and usago
of llo Mossago ConlroI rogislor.
-- -
- -- -
- -
15:8 Rosorvod Road-OnIy. AIvays zoro.
7 64-bil Addross
CapabIo
Road-OnIy.
- 0 = Iunclion doos nol impIomonl llo uppor 32-
bils of llo Mossago Addross rogislor and is inca-
pabIo of gonoraling a 64-bil momory addross.
- 1 = Iunclion impIomonls llo uppor 32-bils of llo
Mossago Addross rogislor and is capabIo of gon-
oraling a 64-bil momory addross.
-- -

6:4 MuIlipIo Mossago

InabIo
Road/Wrilo. Aflor syslom soflvaro roads llo MuI-
lipIo Mossago CapabIo fioId (soo noxl rov in llis
labIo) lo dolormino lov many mossagos aro
roquoslod by llo dovico, il programs a 3-bil vaIuo
inlo llis fioId indicaling llo acluaI numbor of mos-
sagos aIIocalod lo llo dovico. Tlo numbor aIIocalod
can bo oquaI lo or Ioss llan llo numbor acluaIIy
roquoslod. Tlo slalo of llis fioId aflor rosol is 000b.
Tlo fioId is oncodod as foIIovs:
--- -
000b 1
001b 2
010b 4
011b 8
100b 16
101b 32
110b Rosorvod
111b Rosorvod
3:1 MuIlipIo Mossago
CapabIo
Road-OnIy. Syslom soflvaro roads llis fioId lo
dolormino lov many mossagos llo dovico vouId
IiIo aIIocalod lo il. Tlo roquoslod numbor of mos-
sagos is a povor of lvo, lloroforo a dovico llal
vouId IiIo llroo mossagos musl roquosl llal four
mossagos bo aIIocalod lo il. Tlo fioId is oncodod as
foIIovs:
--- -
000b 1
001b 2
010b 4
011b 8
100b 16
101b 32
110b Rosorvod
111b Rosorvod
- -- -
- -
-

Message Address Register

Tlo Iovor lvo bils of llo 32-bil Mossago Addross rogislor aro lardvirod lo zoro
and cannol bo clangod. In ollor vords, llo addross assignod by syslom sofl-
varo is aIvays aIignod on a dvord addross boundary.
Tlo uppor 32-bils of llo Mossago Addross rogislor aro roquirod for nalivo ICI
Ixpross dovicos and oplionaI for Iogacy ondpoinls. Tlis rogislor is prosonl if Bil
7 of llo Mossago ConlroI rogislor is sol. If prosonl, il is a road/vrilo rogislor and
il is usod in conjunclion vill llo Mossago Addross rogislor lo assign a 32-bil or
a 64-bil momory addross lo llo dovico:
- If llo uppor 32-bils of llo Mossago Addross rogislor aro sol lo a non-zoro
vaIuo by llo syslom soflvaro, llon a 64-bil mossago addross las boon
assignod lo llo dovico using boll llo uppor and Iovor laIvos of llo rogislor.
- If llo uppor 32-bils of llo Mossago Addross rogislor aro sol lo zoro by llo
syslom soflvaro, llon a 32-bil mossago addross las boon assignod lo llo
dovico using boll llo uppor and Iovor laIvos of llo rogislor.
Message Data Register
Tlo syslom soflvaro assigns llo dovico a baso mossago dala pallorn by vriling
il inlo llis 16-bil, road/vrilo rogislor. Wlon llo dovico musl gonoralo an inlor-
rupl roquosl, il vrilos a 32-bil vaIuo lo llo momory addross spocifiod in llo
Mossago Addross rogislor. Tlo dala vrillon las llo foIIoving formal:
- Tlo uppor 16 bils aro aIvays sol lo zoro.
- Tlo Iovor 16 bils aro suppIiod from llo Mossago Dala rogislor. If moro llan
ono mossago las boon assignod lo llo dovico, llo dovico modifios llo Iovor
bils (llo numbor of modifiabIo bils doponds on lov many mossagos lavo
boon assignod lo llo dovico by llo configuralion soflvaro) of llo dala from
0 MSI InabIo Road/Wrilo. Slalo aflor rosol is 0, indicaling llal
llo dovicos MSI capabiIily is disabIod.
- = Iunclion is - from using . Il
musl uso INTX Mossagos lo doIivor inlorrupls
(Iogacy ondpoinl or bridgo).
- = Iunclion is lo uso lo roquosl
sorvico and is forbiddon lo uso ils inlorrupl
pin.
- -- -
- -
-- -

llo Mossago Dala rogislor lo form llo approprialo mossago for llo ovonl il
vislos lo roporl lo ils drivor. Ior an oxampIo, rofor lo llo oxampIo cilod in
Basics of Gonoraling an MSI Inlorrupl Roquosl on pago 338.
Basics of MSI Configuration
Tlo foIIoving Iisl spocifios llo slops laIon by soflvaro lo configuro MSI inlor-
rupls for a ICI Ixpross dovico. Rofor lo Iiguro 9-5 on pago 337.
1. Al slarlup limo, llo configuralion soflvaro scans llo ICI bus(os) (roforrod
lo as bus onumoralion) and discovors dovicos (i.o., il porforms configuralion
roads for vaIid Vondor IDs).Wlon a ICI Ixpross funclion is discovorod, llo
configuralion soflvaro roads llo CapabiIilios Iisl Ioinlor lo oblain llo Ioca-
lion of llo firsl CapabiIily rogislor villin llo clain of rogislors.
2. Tlo soflvaro llon soarclos llo capabiIily rogislor sols unliI il discovors llo
MSI CapabiIily rogislor sol (CapabiIily ID of 05l).
3. Soflvaro assigns a dvord-aIignod momory addross lo llo dovicos Mossago
Addross rogislor. Tlis is llo doslinalion addross of llo momory vrilo usod
vlon doIivoring an inlorrupl roquosl.
4. Soflvaro clocIs llo MuIlipIo Mossago CapabIo fioId in llo dovicos Mos-
sago ConlroI rogislor lo dolormino lov many ovonl-spocific mossagos llo
dovico vouId IiIo assignod lo il.
5. Tlo soflvaro llon aIIocalos a numbor of mossagos oquaI lo or Ioss llan vlal
llo dovico roquoslod. Al a minimum, ono mossago viII bo aIIocalod lo llo
dovico.
6. Tlo soflvaro vrilos llo baso mossago dala pallorn inlo llo dovicos Mos-
sago Dala rogislor.
7. IinaIIy, llo soflvaro sols llo MSI InabIo bil in llo dovicos Mossago ConlroI
rogislor, lloroby onabIing il lo gonoralo inlorrupls using MSI momory
vrilos.
-

--
-- -

Basics of Generating an MSI Interrupt Request

Wlon a ICI Ixpross funclion gonoralos an inlorrupl roquosl lo llo procossor il
porforms a momory vrilo lransaclion. Tlo associalod dala is pIalform spocific
and is aIvays 1DW in sizo, and is vrillon lo a pro-dofinod momory addross
Iocalion. As doscribod oarIior, llo configuralion soflvaro is rosponsibIo for
priming llo funclions MSI Addross and Dala rogislors vill llo approprialo
momory addross and llo dala lo bo vrillon lo llal addross vlon gonoraling a
roquosl. Il aIso primos a fioId in llo Mossago ConlroI rogislor vill llo numbor
of mossagos llal lavo boon aIIocalod lo llo dovico.
Memory Write Transaction (MSI)
Wlon llo dovico musl gonoralo an inlorrupl roquosl, il vrilos llo Mossago Dala
rogislor conlonls lo llo momory addross spocifiod in ils Mossago Addross rogis-
lor. Iiguro 9-6 on pago 339 iIIuslralos llo conlonls of llo Momory Wrilo Transac-
lion Hoador and Dala fioId. Koy poinls incIudo:
- Iormal fioId musl bo 11b, indicaling a 4DW loador vill Dala (nalivo func-
lions) and may bo 10b for Iogacy Indpoinls.
- Hoador Allribulo bils (No Snoop and RoIaxod Ordoring) musl bo zoro.
- Iongll fioId musl bo 01l lo indicalo maximum dala payIoad of 1DW.
- Iirsl BI fioId musl bo 0011b, indicaling vaIid dala in Iovor 16 bils.
- Iasl BI fioId musl bo 0000b, indicaling a singIo DW lransaclion.
- Addross fioIds villin llo loador como diroclIy from llo addross fioIds
villin llo MSI CapabiIily rogislors.
- Iovor 16 bils of llo Dala payIoad como diroclIy from llo dala fioId villin
llo MSI CapabiIily rogislors.
-

MuItipIe Messages
-- - -- -
- -- -- -
-- - - -

-
MSI Message Data 0000h
-- -

As an oxampIo, assumo llo foIIoving:

- Iour mossagos lavo boon aIIocalod lo a dovico.
- A dala vaIuo of 0500l las boon assignod lo llo dovicos Mossago Dala rogis-
lor.
- Momory addross 0A000000l las boon vrillon inlo llo dovicos Mossago
Addross rogislor.
Wlon any ono of four difforonl dovico-spocific ovonls occurs, llo dovico gonor-
alos a roquosl by porforming a dvord vrilo lo momory addross 0A000000l vill
a dala vaIuo of 00000500l, 00000501l, 00000502l, or 00000503l. In ollor vords,
llo dovico aulomalicaIIy apponds llo vaIuo 0000l lo llo uppor parl of ils
assignod mossago dala vaIuo (lo maIo a 32-bil vaIuo) and modifios llo Iovor
lvo bils of llo vaIuo lo indicalo llo spocific mossago lypo.
Memory Synchronization When Interrupt HandIer
Entered
The ProbIem
Assumo llal a ICI Ixpross dovico porforms ono or moro momory vrilo lransac-
lions lo doIivor dala (appIicalion dala) inlo main momory, foIIovod by an MSI
(vlicl nolifios soflvaro llal nov appIicalion dala las boon movod lo momory).
AIso assumo llo foIIoving:
- appIicalion dala lransaclions lavo a Traffic CIass of Zoro (TC0) and viII
aIvays fIov llrougl VC0 buffors.
- llo MSI lransaclion usos TC1, and il fIovs llrougl llo VC1 buffors.
- Tloso lransaclions lravorso ono or moro svilclos on lloir vay lo llo Rool
CompIox and momory.
- VC arbilralion is sol up so llal VC1 lransaclions lavo a mucl liglor prior-
ily llan VC0 lransaclions.
IIov ConlroI and VC arbilralion associalod vill llo doIivory of llo dala and
llo MSI may rosuIl in llo MSI lransaclion boing movod aload of llo appIicalion
dala lransaclions basod on llo goaIs of difforonlialod sorvicos. Tlis is possibIo
bocauso lloro is no ordoring roIalionslip mainlainod bolvoon lransaclions llal
lavo difforonl TC vaIuos and VC assignmonls. ConsoquonlIy, llo MSI may
arrivo al llo Rool CompIox voII aload of llo corrosponding appIicalion dala.
Wlon llo CIU is inlorruplod by llo MSI, llo curronlIy-oxoculing program is
suspondod and llo procossor oxoculos llo inlorrupl landIor villin llo
-

Roquoslors dovico drivor. Tlo drivor may immodialoIy road dala from llo lar-
gol momory buffor in main momory. If somo of llo appIicalion dala lransaclions
llal aro sliII maIing lloir vay upslroam, llo drivor viII folcl and procoss oId
dala.
SoIving the ProbIem
Tlo probIom can bo soIvod in lvo vays:
1. Insuro llal llo TC numbors of llo Momory Wrilo dala and llo MSI aro llo
samo. Tlo MSI musl aIso lavo ils roIaxod ordoring bil cIoarod.
2. Tlo drivor can soIvo llis probIom by porforming a dummy road (Momory
Road Dvord vill aII Bylo InabIos doassorlod) from a Iocalion villin ils
dovico boforo procossing llo dala. Tlo road musl aIso lavo llo samo TC
numbor as llo Momory Wrilo dala. Tlo road compIolion rolurnod lo llo
Rool CompIox viII lravoI in llo samo VC as llo Momory Wrilo dala, lloroby
onsuring llal llo vrilo dala viII bo puslod aload of llo road compIolion
and inlo momory prior lo llo compIolion boing rocoivod by llo drivor.
RocaII llal llo ordoring ruIos roquiro llal aII lransaclions vill llo samo TC
musl bo porformod in ordor. Tlo onIy oxcoplion is a lransaclion vill llo
roIaxod ordoring bil sol.
Interrupt Latency
Tlo limo from signaIing an inlorrupl roquosl unliI soflvaro sorvicos llo dovico
is roforrod lo as ils inlorrupl Ialoncy. As vill llo ollor inlorrupl roquosl doIiv-
ory moclanisms llo MSI capabiIily doos nol provido inlorrupl Ialoncy guaran-
loos.
MSI ResuIts In ECRC Error
Bocauso MSIs aro doIivorod as Momory Wrilo lransaclions, and orror associalod
vill doIivory of an MSI is lroalod llo samo as any ollor Momory Wrilo orror
condilion. Soo ICRC Gonoralion and ClocIing on pago 361 for lroalmonl of
ICRC orrors.
Some RuIes, Recommendations, etc.
1. Il is llo spocificalions inlonlion llal muluaIIy-oxcIusivo mossagos viII bo
assignod lo dovicos by llo syslom soflvaro and llal oacl mossago viII bo
convorlod lo an oxcIusivo inlorrupl IovoI upon doIivory lo llo procossor.
-- -

2. Moro llan ono MSI capabiIily rogislor sol por funclion is prolibilod.
3. A road from llo Mossago Addross rogislor producos undofinod rosuIls.
4. Rosorvod rogislors and bils aro road-onIy and aIvays rolurn zoro vlon
road.
5. Syslom soflvaro can modify Mossago ConlroI rogislor bils, bul llo dovico is
prolibilod from doing so. In ollor vords, ils nol pormillod lo modify llo
bils via llo "bacI door."
6. Al a minimum, a singIo mossago viII bo assignod lo oacl dovico.
7. Syslom soflvaro musl nol vrilo lo llo uppor laIf of llo dvord llal conlains
llo Mossago Dala rogislor.
8. If llo dovico vrilos llo samo mossago muIlipIo limos, onIy ono of lloso
mossagos is guaranlood lo bo sorvicod. If aII of llom musl bo sorvicod, llo
dovico musl nol gonoralo llo samo mossago again unliI llo drivor sorvicos
llo oarIior ono.
9. If a dovico las moro llan ono mossago assignod, and il vrilos a sorios of dif-
foronl mossagos, il is guaranlood llal aII of llom viII bo sorvicod.
Legacy PCI Interrupt DeIivery
Tlis soclion providos bacIground informalion rogarding llo slandard ICI
inlorrupl doIivory using INTx signaIs. Tlis is foIIovod by a dolaiIod discussion
of lov ICI Ixpross supporls virluaI INTx signaIing. Roadors famiIiar vill ICI
inlorrupl landIing may visl lo procood lo VirluaI INTx SignaIing on
pago 347.
Background PCI Interrupt SignaIing
ICI dovicos llal uso inlorrupls lavo lvo oplions:
1. INTx# aclivo Iov-IovoI signaIs llal can bo slarod. Tloso signaIs voro
dofinod in llo originaI spocificalion.
2. Mossago SignaIod Inlorrupls inlroducod vill llo 2.2 vorsion of llo spocifi-
calion aro oplionaI for ICI dovicos. Tloso MSIs aro compalibIo vill ICI
Ixpross and roquiro no modificalion by dovicos or by ICI Ixpross-lo-ICI
Bridgos.
Device INTx# Pins
Iacl plysicaI ICI compononl can impIomonl up lo 4 INTx# signaIs (INTA#,
INTB#, INTC#, and INTD#). Bocauso ICI dovicos (IiIo ICI Ixpross dovicos) can
supporl up lo 8 funclions, four inlorrupl pins aro supporlod. Hovovor, if a max-
imum of oigll funclions aro impIomonlod and aII roquirod inlorrupls llon llo
-

-- - - - -
- -
Determining if a Function Uses INTx# Pins
- - - -
- -
- -
-- - - - - -
-
-
INTD#
-- -

Interrupt Routing
Tlo syslom dosignor dolorminos llo rouling of INTx pins from dovicos. Tlo
INTx signaIs usod by oacl dovico can bo roulod in a varioly of vays so llal uIli-
maloIy llo oacl INTx pin viII go lo an inpul of llo inlorrupl conlroIIor. Iiguro 9-
8 on pago 344 iIIuslralos a varioly of ICI dovicos using INTx pins lo signaI inlor-
rupls. As is lypicaI, aII ICI INTx signaIs aro roulod lo ono of four inpuls. AII
INTx signaIs roulod lo a givon inpul viII bo diroclod lo a spocific inpul lo llo
inlorrupl conlroIIor, llus oacl of llo INTx roulod lo llo common inlorrupl inpul
viII aIso lavo llo samo inlorrupl Iino numbor assignod lo il by pIalform sofl-
varo. Ior oxampIo, IRQ15 las llroo ICI INTx inpuls from difforonl dovicos
INTB#, INTA#, and INTA#. ConsoquonlIy, llo funclions using lloso INTx Iinos
viII slaro IRQ15 and ils associalod inlorrupl voclor.
-
-

Associating the INTx# Line to an IRQ Number

Basod on llo rouling of llo INTx pin associalod vill oacl funclion, llo Inlor-
rupl Iino numbor is roporlod by configuralion soflvaro (aIso piclurod in Iiguro
9-7 on pago 343). Tlo vaIuo uIlimaloIy loIIs llo funclions dovico drivor vlicl
inlorrupl voclor viII bo roporlod vlon an inlorrupl occurs from llis funclion.
Tloroforo, vlon llis funclion gonoralos an inlorrupl llo CIU viII rocoivo llo
voclor numbor llal corrosponds lo llo IRQ spocifiod in llo Inlorrupl Iino rogis-
lor. Tlo CIU usos llis voclor lo indox inlo llo inlorrupl sorvico labIo lo folcl llo
onlry poinl of llo inlorrupl sorvico roulino associalod vill llo funclions dovico
drivor. Tlo mollod usod lo communicalo llis informalion is oporaling onviron-
monl spocific (o.g., llo Windovs XI or Iinux).
Nolo llal bocauso llo INTx# Iinos can bo viro ORod from difforonl dovicos, llo
inlorrupl Iino numbor assignmonl viII bo llo samo for lloso dovicos vloso
INTx# Iinos aro virod logollor. In lloso casos, an inlorrupl signaIod by any of
llo dovicos slaring llo samo IRQ viII causo llo samo voclor lo bo sonl lo llo
CIU. Soflvaro musl onsuro llal aII sorvico roulinos llal slaro llo samo IRQ
inpul clain llo sorvico roulinos logollor so llal aII dovicos can bo clocIod lo
dolormino vlicl ono(s) causod llo inlorrupl roquosl. Onco again llo mocla-
nism usod for claining llo sorvico roulinos is oporaling onvironmonl spocific.
INTx# SignaIing
Tlo INTx# Iinos aro aclivo Iov signaIs impIomonlod as opon-drain vill a puI-
Iup rosislor providod on oacl Iino by llo syslom. MuIlipIo dovicos connoclod lo
llo samo ICI inlorrupl roquosl signaI Iino can assorl il simuIlanoousIy villoul
damago.
Wlon a dovico signaIs an inlorrupl il aIso sols a bil villin a dovico-spocific rog-
islor lo indicalo llal an inlorrupl is ponding. Tlis rogislor can bo mappod inlo
momory or I/O addross spaco and is road by dovico-spocific soflvaro lo vorify
llal an inlorrupl is ponding compIolion. Wlon llis bil is cIoarod, llo INTx sig-
naI is doassorlod.
Tlo dovico musl aIso sol llo Inlorrupl Slalus bil Iocalod in llo Configuralion
Slalus rogislor. Tlis bil can bo road by syslom soflvaro lo soo if an inlorrupl is
curronlIy ponding compIolion. (Soo Iiguro 9-10 on pago 347.)
-- -

- Tlo 2.3 spocificalion addod an inlorrupl disabIo bil (Bil

10) lo llo configuralion command rogislor. Soo Iiguro 9-9 on pago 346. Tlo bil is
cIoarod al rosol pormilling gonoralion of INTx signaI gonoralion. Soflvaro may
sol llis bil lloroby inlibiling gonoralion of INTx signaIing. Nolo llal llo Inlor-
rupl DisabIo bil las no offocl on Mossago SignaIIod Inlorrupls (MSI). MSIs aro
onabIod via llo MSI capabiIily command rogislor.
- Tlo ICI 2.3 spocificalion addod an inlorrupl slalus bil lo
llo configuralion slalus rogislor (piclurod in Iiguro 9-10 on pago 347). A func-
lion musl sol llis slalus bil vlon an inlorrupl is ponding. In addilion, if llo
Inlorrupl DisabIo bil in llo configuralion command rogislor is cIoarod (i.o. inlor-
rupls onabIod), llon llo funclions INTx# signaI is assorlod, bul onIy aflor llo
inlorrupl slalus bil is sol. Tlis bil is unaffoclod by llo slalo of llo inlorrupl dis-
abIo bil, and il las no offocl on llo MSI moclanism. Nolo aIso llal llo bil is road
onIy.
- -
-

VirtuaI INTx SignaIing

Wlon circumslancos maIo il impossibIo lo uso MSIs slandard compalibIo INTx
signaIing may bo usod. IoIIoving aro lvo oxampIos of dovicos llal cannol uso
MSI:
-- - ICI dovicos viII IiIoIy uso llo INTx signaIs
lo doIivor an inlorrupl roquosl (MSI is oplionaI). Bocauso ICI Ixpross doos nol
supporl sidoband inlorrupl signaIing, an INTx virluaI viro mossago is usod lo
signaI llo inlorrupl conlroIIor (Iocalod in llo Rool CompIox). Tlo inlorrupl con-
lroIIor in lurn doIivors an inlorrupl roquosl lo llo CIU, incIuding llo voclor
numbor llal idonlifios llo onlry poinl of llo inlorrupl sorvico roulino.
- Slandard IC sysloms lypicaIIy uso llo Iogacy inlorrupl sub-
syslom (8259 inlorrupl conlroIIor and roIalod signaIs) during llo bool soquonco.
Iurllormoro, llo MSI subsyslom cannol bo usod bocauso il lypicaIIy iniliaIizos
aflor llo Oporaling Syslom (OS) Ioads and dovico drivors iniliaIizo. ICI Ixpross
dovicos invoIvod in iniliaIizing llo syslom and Ioading llo OS (o.g., vidoo, lard
drivo, and Ioyboard) aro caIIod bool dovicos. Bool dovicos musl uso Iogacy
inlorrupl supporl unliI llo OS and dovico drivors for lloir dovicos inslaII, aflor
vlicl lloy uso MSI.
- - -
-- -

VirtuaI INTx Wire DeIivery

-- -- --
- --
-- - - - - --
- -
- - - --- -
-- -- - -
- - - - -
---
-- --- - -
-
-- --- - -
-
- -- -- - -- -
- - --
- -
- - --- --
-

CoIIapsing INTx SignaIs within a Bridge

Svilclos llal lavo muIlipIo dovnslroam porls lo vlicl Iogacy dovicos allacl
musl onsuro llal INTx lransaclions aro doIivorod upslroam in llo corrocl fasl-
ion. Tlo spocific roquiromonl is lo onsuro llal llo inlorrupl conlroIIor rocoivos
INTx mossagos llal roprosonl llo viro-ORod bolavior of Iogacy ICI impIomon-
lalions. As iIIuslralod in Iiguro 9-8 on pago 344, INTx Iinos may bo slarod vlon
ono or moro INTx Iinos aro liod logollor (viro-ORod). ConsoquonlIy, vlon
moro llan ono dovicos signaIs an inlorrupl al rouglIy llo samo limo onIy llo
firsl assorlion is soon by llo inlorrupl conlroIIor. SimiIarIy, vlon ono of lloso
dovicos doassorls ils INTx Iino, llo Iino romains assorlod and onIy llo Iasl doas-
sorlion viII bo soon by llo inlorrupl conlroIIor.
Tvo or moro Iogacy ICI Ixpross dovicos sonding llo samo INTx mossago on
difforonl porls of llo samo svilcl, musl bo lroalod as viro-ORod mossagos. Tlis
onsuros llal llo inlorrupl conlroIIor obsorvos llo corrocl lransilions. Iiguro 9-12
on pago 350 iIIuslralos lvo Iogacy dovicos issuing INTA mossagos lo llo Svilcl.
Nolo llal bocauso llo INTA mossagos ovorIap, llo socond Assorl_INTA is
bIocIod bocauso an Assorl_INTA mossago las boon rogislorod and no doassor-
lion las yol occurrod. SimiIarIy llo firsl Doassorl_INTA mossago is bIocIod
bocauso lvo Assorl_INTAs aro oulslanding and llis is llo firsl doassorl mos-
sago, so anollor viII foIIov. Tlis onsuros llal llo inlorrupl conlroIIor viII novor
rocoivo lvo Assorl_INTx mossagos of llo samo lypo nor lvo Doassorl_INTX
mossagos of llo samo lypo.
As doscribod abovo, svilclos musl lracI llo slalo of oacl of llo INTx mossagos
al oacl porl and lransfor onIy lloso llal roprosonl a vaIid clango in llo virluaI
signaIing.
-- -

-- -- --
-

INTx Message Format

Iiguro 9-13 on pago 351 dopicls llo formal of llo INTx mossago loador and
dofinos llo mossago lypos supporlod. INTx mossagos aro aIvays doIivorod from
upslroam porls of Indpoinls, Bridgos, and Svilclos. Tlo rouling ompIoyod is
IocaI-Torminalo al Rocoivor, vill llo inlorrupl conlroIIor as llo uIlimalo dos-
linalion. Tlo mossago codo fioId idonlifios llo mossago lypo and oigll codos aro
usod by llo INTx mossagos as Iislod in TabIo 9-2.
-- -
-- -
--- --
Assorl_INTA 0010 0000
Assorl_INTB 0010 0001
Assorl_INTC 0010 0010
Assorl_INTD 0010 0011
Doassorl_INTA 0010 0100
Doassorl_INTB 0010 0101
Doassorl_INTC 0010 0110
Doassorl_INTD 0010 0111
-- -

Tlo ruIos associalod vill llo doIivory of INTx mossagos aro consislonl vill
ollor mossago lypos, bul lavo somo uniquo claraclorislics. Tlo INTx mossago
ruIos aro summarizod boIov:
- Assorl_INTx and Doassorl_INTx aro onIy issuod in llo upslroam diroclion
by Iogacy Indpoinl or Bridgo dovicos. Nolo llal an ollorviso nalivo ICI
Ixpross ondpoinl is aIIovod lo sond INTx mossagos prior lo ils dovico driv-
ors boing Ioadod, bocauso il is a bool dovico.
- Svilclos musl issuo INTx mossagos upslroam vlon lloro is a clango of llo
coIIapsod inlorrupl duo lo ono of llo dovnslroam porls rocoiving an
assorl or doassorl mossago. (Soo CoIIapsing INTx SignaIs villin a Bridgo
on pago 349.)
- Dovicos on oillor sido of a IinI musl lracI llo curronl slalo of INTA-INTD
assorlion.
- A Svilcl lracIs llo slalo of llo four virluaI viros for oacl of ils dovnslroam
porls, and prosonls a coIIapsod sol of virluaI viros on ils upslroam porl.
- Tlo Rool CompIox musl lracI llo slalo of llo four virluaI viros (A-D) for
oacl dovnslroam porl.
- INTx signaIing may bo disabIod vill llo Inlorrupl DisabIo bil in llo Com-
mand Rogislor.
- If any INTx virluaI viros aro aclivo and dovico inlorrupls aro llon disabIod,
a corrosponding Doassorl_INTx mossago musl bo sonl.
- If a svilcl dovnslroam porl goos lo DI_Dovn slalus, any aclivo INTx vir-
luaI viros musl bo doassorlod, and llo upslroam porl updalod accordingIy
(Doassorl_INTx mossago roquirod if llal INTx vas in aclivo slalo).
Devices May Support Both MSI and Legacy Interrupts
Wlon a ICI Ixpross dovico supporls boll INTx mossagos and MSI, onIy ono of
llo moclanism viII bo onabIod al any givon limo. Tlo mosl IiIoIy lypo of dovico
llal vouId supporl boll capabiIilios is a bool dovico. A syslom in vlicl a bool
dovico rosidos may nol supporl MSI during llo bool soquonco. ConsoquonlIy
configuralion soflvaro viII iniliaIizo inlorrupls by Ioading a Iino rogislor vaIuo
and onabIing llo dovico for Iogacy oporalion jusl as is dono for ICI dovicos.
Onco llo OS Ioads, llo dovicos MSI rogislor sol is Ioadod and llo MSI onabIo bil
is sol. Solling llis bil disabIos llo dovicos abiIily lo uso INTx mossagos and
onabIos llo doIivory of MSIs.
Nolo aIso llal solling llo Inlorrupl DisabIo bil in llo Configuralion Command
rogislor aIso inlibils llo gonoralion of INTx mossagos.
-

SpeciaI Consideration for Base System PeripheraIs

Inlorrupls may aIso originalo in omboddod Iogacy lardvaro, sucl as an I/O
ConlroIIor Hub or Supor I/O dovico. Somo of llo lypicaI Iogacy dovicos
roquirod in sucl sysloms incIudo:
- SoriaI porls
- IaraIIoI porls
- Koyboard and Mouso ConlroIIor
- Syslom Timor
- IDI conlroIIors
Tloso dovicos lypicaIIy roquiro a vory spocific IRQ Iino, vlicl aIIovs Iogacy
soflvaro lo inloracl vill llom corroclIy.
Using llo INTx mossagos doos nol guaranloo llal llo dovicos viII rocoivo llo
IRQ assignmonl llal lloy roquiro. Many difforonl approaclos and slralogios
may bo ompIoyod lo onsuro lloy gol llo IRQs roquirod. IoIIoving is an oxampIo
syslom llal supporls Iogacy inlorrupl assignmonl.
ExampIe System
Iiguro 9-14 on pago 354 iIIuslralos a ICI Ixpross syslom llal incIudos an oxisl-
ing I/O ConlroIIor Hub (ICH) llal allaclos lo llo Rool CompIox via a propri-
olary IinI. Tlo inlorrupl conlroIIor llal is omboddod villin llo ICH is an
IOAIIC llal can gonoralo an MSI vlon il rocoivos an inlorrupl roquosl al ils
inpuls. In sucl an impIomonlalion, soflvaro can assign llo Iogacy voclor num-
bor lo oacl inpul, lo onsuro llo corrocl Iogacy soflvaro is caIIod.
Tlo advanlago lo llis approacl is llal oxisling lardvaro can bo usod lo supporl
llo Iogacy roquiromonls villin a ICI Ixpross pIalform. Tlis syslom aIso
roquiros llal llo MSI subsyslom bo configurod for uso during llo bool
soquonco. Tlo oxampIo iIIuslralod oIiminalos llo nood for INTx mossagos,
unIoss a ICI Ixpross oxpansion dovico incorporalos a ICI Ixpross-lo-ICI
Bridgo.
-- -

-- - -
355


The Previous Chapter
Nalivo ICI Ixpross dovicos llal roquiro inlorrupl supporl musl uso llo Mos-
sago SignaIod Inlorrupl (MSI) moclanism dofinod originaIIy in llo ICI 2.2 vor-
sion of llo spocificalion. Tlo provious claplor dolaiIod llo MSI moclanism and
aIso doscribod llo Iogacy supporl llal pormils virluaIizalion of llo ICI INTx
signaIs roquirod by dovicos sucl as ICI Ixpross-lo-ICI Bridgos.
This Chapter
To llis poinl il las boon prosumod llal lransaclions lravorsing llo fabric lavo
nol oncounlorod any orrors llal cannol bo corroclod by lardvaro. Tlis claplor
discussos boll corroclabIo and non-corroclabIo orrors and discussos llo mocla-
nisms usod lo roporl llom. Tlo ICI Ixpross arclilocluro providos a ricl sol of
orror doloclion, roporling, and Iogging capabiIilios. ICI Ixpross orror roporling
cIassifios orrors inlo llroo cIassos: corroclabIo, non-falaI, and falaI. ICI Ixpross
orror roporling capabiIilios incIudo ICI-compalibIo moclanisms, llus a briof
roviov of llo ICI orror landIing is incIudod as bacIground informalion.
The Next Chapter
Tlo noxl claplor doscribos llo IogicaI IlysicaI Iayor coro Iogic. Il doscribos
lov an oulbound pacIol is procossod boforo cIocIing llo pacIol oul difforon-
liaIIy. Tlo claplor aIso doscribos lov an inbound pacIol arriving from llo IinI
is procossod and sonl lo llo Dala IinI Iayor. Sub-bIocI funclions of llo IlysicaI
Iayor sucl as Bylo Slriping and Un-Slriping Iogic, ScrambIor and Do-ScrambIor,
8b/10b Incodor and Docodor, IIaslic Buffors aro discussod, and moro.
PCI Express System Architecture
356
Background
Tlo originaI ICI bus impIomonlalion providos for basic parily clocIs on oacl
lransaclion as il passos bolvoon lvo dovicos rosiding on llo samo bus. Wlon a
lransaclion crossos a bridgo, llo bridgo is invoIvod in llo parily clocIs al boll
llo originaling and doslinalion bussos. Any orror doloclod is rogislorod by llo
dovico llal las doloclod llo orror and oplionaIIy roporlod. Tlo ICI arclilocluro
providos a mollod for roporling llo foIIoving lypos of orrors:
- dala parily orrors roporlod via llo IIRR# (Iarily Irror) signaI
- dala parily orrors during muIlicasl lransaclions (spociaI cycIos) roporlod
via llo SIRR# (Syslom Irror) signaI
- addross and command parily orrors roporlod via llo SIRR# signaI
- ollor lypos of orrors (o.g. dovico spocific) roporlod via SIRR#
Irrors roporlod via IIRR# aro considorod polonliaIIy rocovorabIo, vloroas,
orrors roporlod via SIRR# aro considorod unrocovorabIo. Hov llo orrors
roporlod via IIRR# aro landIod is Iofl up lo llo impIomonlor. Irror landIing
may invoIvo onIy lardvaro, dovico-spocific soflvaro, or syslom soflvaro.
Irrors signaIod via SIRR# aro roporlod lo llo syslom and landIod by syslom
soflvaro. (Soo MindSlaros ICI Syslom Arclilocluro booI for dolaiIs.)
ICI-X usos llo samo orror roporling signaIs as ICI, bul dofinos spocific orror
landIing roquiromonls doponding on vlollor dovico-spocific orror landIing
soflvaro is prosonl. If a dovico-spocific orror landIor is nol prosonl, llon aII par-
ily orrors aro roporlod via SIRR#.
ICI-X 2.0 adds Iimilod supporl for Irror Corroclion Codos (ICC) dosignod lo
aulomalicaIIy dolocl and corrocl singIo-bil orrors villin llo addross or dala.
(Soo MindSlaros ICI-X Syslom Arclilocluro booI for dolaiIs.)
Introduction to PCI Express Error Management
ICI Ixpross dofinos a varioly of moclanisms usod for clocIing orrors, roporling
lloso orrors and idonlifying llo approprialo lardvaro and soflvaro oIomonls
for landIing lloso orrors.
PCI Express Error Checking Mechanisms
ICI Ixpross orror clocIing focusos on orrors associalod vill llo ICI Ixpross
inlorfaco and llo doIivory of lransaclions bolvoon llo roquoslor and compIolor
funclions. Iiguro 10-1 on pago 357 iIIuslralos llo scopo of llo orror clocIing llal
Chapter 10: Error Detection and Handling
357
is llo focus of llis claplor. Irrors villin a funclion llal do nol porlain lo a
givon lransaclion aro nol roporlod llrougl llo orror landIing procoduros
dofinod by llo ICI Ixpross spocificalion, and il is rocommondod llal sucl
orrors bo landIod using propriolary mollods llal aro roporlod via dovico-spo-
cific inlorrupls. Iacl Iayor of llo ICI Ixpross inlorfaco incIudos orror clocIing
capabiIily as doscribod in llo foIIoving soclions.
--
PCI Express System Architecture
358
Transaction Layer Errors
Tlo lransaclion Iayor clocIs aro porformod onIy by llo Roquoslor and CompI-
olor. IacIols lravorsing svilclos do nol porform any lransaclion Iayor clocIs.
ClocIs porformod al llo lransaclion Iayor incIudo:
- ICRC clocI faiIuro (oplionaI clocI basod on ond-lo-ond CRC)
- MaIformod TII (orror in pacIol formal)
- CompIolion Timo-ouls during spIil lransaclions
- IIov ConlroI IrolocoI orrors (oplionaI)
- Unsupporlod Roquosls
- Dala Corruplion (roporlod as a poisonod pacIol)
- CompIolor Aborl (oplionaI)
- Unoxpoclod CompIolion (compIolion doos nol malcl any Roquosl ponding
compIolion)
- Rocoivor OvorfIov (oplionaI clocI)
Data Link Layer Errors
IinI Iayor orror clocIs occur villin a dovico invoIvod in doIivoring llo lransac-
lion bolvoon llo roquoslor and compIolor funclions. Tlis incIudos llo roquosl-
ing dovico, inlormodialo svilclos, and llo compIoling dovico. ClocIs
porformod al llo IinI Iayor incIudo:
- ICRC clocI faiIuro for TIIs
- Soquonco Numbor clocI for TII s
- ICRC clocI faiIuro for DIIIs
- RopIay Timo-oul
- RopIay Numbor RoIIovor
- Dala IinI Iayor IrolocoI orrors
PhysicaI Layer Errors
IlysicaI Iayor orror clocIs aro aIso porformod by aII dovicos invoIvod in doIiv-
oring llo lransaclion, incIuding llo roquosling dovico, inlormodialo svilclos,
and llo compIoling dovico. ClocIs porformod al llo plysicaI Iayor incIudo:
- Rocoivor orrors (oplionaI)
- Training orrors (oplionaI)
Chapter 10: Error Detection and Handling
359
Error Reporting Mechanisms
ICI Ixpross providos llroo moclanisms for oslabIisling llo orror roporling poI-
icy. Tloso moclanisms aro conlroIIod and roporlod llrougl configuralion rogis-
lors mappod inlo llroo dislincl rogions of configuralion spaco. (Soo Iiguro 10-2
on pago 360.) Tlo various orror roporling foaluros aro onabIod as foIIovs:
- ICI-compalibIo Rogislors (roquirod) llis orror roporling moclanism pro-
vidos bacIvard compalibiIily vill oxisling ICI compalibIo soflvaro and is
onabIod via llo ICI configuralion -. Tlis approacl roquiros
llal ICI Ixpross orrors bo mappod lo ICI compalibIo orror rogislors.
- ICI Ixpross CapabiIily Rogislors (roquirod) llis moclanism is avaiIabIo
onIy lo soflvaro llal las InovIodgo of ICI Ixpross. Tlis roquirod orror
roporling is onabIod via llo ICI Ixpross - mappod
villin ICI-compalibIo configuralion spaco.
- ICI Ixpross Advancod Irror Roporling Rogislors (oplionaI) llis mocla-
nism invoIvos rogislors mappod inlo llo oxlondod configuralion addross
spaco. ICI Ixpross compalibIo soflvaro onabIos orror roporling for individ-
uaI orrors via llo - -
Tlo spocificalion rofors lo basoIino (roquirod) orror roporling capabiIilios and
advancod (oplionaI) orror roporling capabiIilios. Tlo basoIino orror roporling
moclanisms roquiro accoss lo llo ICI-compalibIo rogislors and ICI Ixpross
CapabiIily rogislors (buIIols 1 and 2 abovo), vliIo advancod orror roporling
(buIIol 3) roquiros accoss lo llo Advancod Irror Roporling rogislors llal aro
mappod inlo oxlondod configuralion addross spaco as iIIuslralod in Iiguro 10-2.
Tlis claplor dolaiIs aII orror roporling moclanisms.
PCI Express System Architecture
360
Error HandIing Mechanisms
Irrors aro calogorizod inlo llroo cIassos llal spocify llo sovorily of an orror as
Iislod boIov. Nolo aIso llo spocificalion dofinos llo onlily llal slouId landIo
llo orror basod on ils sovorily:
- CorroclabIo orrors landIod by lardvaro
- UncorroclabIo orrors-nonfalaI landIod by dovico-spocific soflvaro
- UncorroclabIo orrors-falaI landIod by syslom soflvaro
-- --
Chapter 10: Error Detection and Handling
361
By dofining orrors inlo lloso cIassos, orror landIing soflvaro can bo parlilionod
inlo soparalo landIors lo porform llo aclions roquirod for a givon pIalform. Tlo
aclions laIon basod on sovorily of an orror migll rango from moniloring llo
offocls of corroclabIo orrors on syslom porformanco lo simpIy rosolling llo sys-
lom or ICI Ixpross sub-syslom in llo ovonl of a falaI orror.
Nolo llal rogardIoss of llo sovorily of a givon orror, soflvaro can oslabIisl a poI-
icy vloroby any orror can bo roporlod lo llo syslom (via llo Rool CompIox) for
llo purposo of lracIing and Iogging. (Soo pago 390 for dolaiIs.)
Sources of PCI Express Errors
Tlis soclion providos a moro dolaiIod doscriplion of llo orror clocIs mado by
ICI Ixpross inlorfacos vlon landIing lransaclions.
ECRC Generation and Checking
ICRC gonoralion and clocIing is oplionaI and onIy supporlod by dovicos and
sysloms llal impIomonl Advancod Irror Roporling. Dovicos llal supporl ICRC
musl impIomonl llo Advancod Irror CapabiIilios and ConlroI Rogislor. Config-
uralion soflvaro clocIs llis rogislor lo dolormino if ICRC is supporlod, and lo
onabIo ICRC supporl.
A ICI Ixpross dovico llal originalos a lransaclion (Roquosl or CompIolion) can
croalo and appond a 32-bil CRC (villin llo digosl fioId) llal covors llo loador
and dala porlions of llo lransaclion. Tlis CRC is lormod ond-lo-ond (ICRC)
and is lypicaIIy clocIod and roporlod by llo uIlimalo rocipionl of llo lransac-
lion. Svilclos in llo pall bolvoon llo originaling and rocoiving dovicos may
oplionaIIy clocI and roporl ICRC orrors, or moroIy forvard llo pacIol villoul
clocIing llo ICRC. If a Svilcl dolocls an ICRC orror il musl sliII forvard llo
pacIol unaIlorod as il vouId any ollor pacIol. Svilclos may aIso bo llo origina-
lor or rocipionl of a lransaclion in vlicl caso lloy can parlicipalo in ICRC gon-
oralion and clocIing in llis roIo.
Tlo aclions laIon vlon an ICRC orror is doloclod is considorod boyond llo
scopo of llo spocificalion. Hovovor, llo possibIo aclions laIon viII IiIoIy
dopond on vlollor llo ICRC orror occurs in a Roquosl or CompIolion:
- - compIolors llal dolocl an ICRC orror may simpIy
drop llo lransaclion villoul forvarding il lo llo rocoiving funclion and as
a rosuIl nol rolurn a compIolion. Tlis uIlimaloIy viII rosuIl in a compIolion
limo-oul villin llo roquosling dovico. Tlo roquoslor couId llon roscloduIo
llo lransaclion undor soflvaro conlroI.
PCI Express System Architecture
362
- roquoslors llal dolocl an ICRC orror may drop llo
pacIol and roporl llo orror lo llo funclions dovico drivor via a funclion-
spocific inlorrupl. Tlo drivor vouId clocI llo slalus bils in llo
- - lo dolocl llo naluro of llo orror and polonliaIIy rosclod-
uIo llo lransaclion in llo ovonl llal a profolclabIo addross Iocalion vas
boing accossod.
Nolo llal ICRC orrors may aIso rosuIl in orror mossagos boing sonl lo llo losl
for landIing or Iogging.
Data Poisoning (OptionaI)
Dala poisoning providos a vay of indicaling llal dala associalod vill a lransac-
lion is corruplod. Wlon a TII is rocoivod llal conlains a dala fioId, llo rocipionl
viII Inov llal dala is corruplod if llo poisonod bil is sol. Iiguro 10-3 iIIuslralos
llo Irror/Ioisonod bil (II) Iocalod villin llo firsl Dvord of a pacIol.
Tlo spocificalion incIudos llroo oxampIos of dala corruplion llal couId rosuIl in
dala poisoning boing usod. In oacl of lloso casos, llo orror can bo forvardod lo
llo rocipionl via llo dala poisoning bil in llo lransaclion loador.
- Wlon a Roquoslor vislos lo porform a Momory Wrilo lransaclion il musl
firsl folcl llo dala il vislos lo sond lo llo compIolor from IocaI momory. In
llo ovonl of a parily orror vlon roading llo dala, llo dala can bo marIod as
poisonod.
- Wlon a CompIolor musl rolurn dala in rosponso lo a Momory Road roquosl,
llo dala il folclos from momory may incur a parily orror.
- Dala llal is slorod in a caclo or buffor llal las orror clocIing may aIso
rosuIl in dala corruplion boing doloclod. Tlo spocificalion doos nol indicalo
vloro lloso caclos or buffors may bo Iocalod, bul il is concoivabIo llal any
dovico llal originalos a lransaclion or forvards il may indicalo llal llo dala
las boon poisonod.
- -
Chapter 10: Error Detection and Handling
363
Tlo spocificalion slalos llal dala poisoning appIios lo dala associalod vill boll
poslod and non-poslod vrilos and road compIolions. Tloroforo dala poisoning
can bo usod in conjunclion vill Momory, I/O, and Configuralion lransaclions
llal lavo a dala payIoad.
Dala poisoning can onIy bo dono al llo lransaclion Iayor of a dovico. Tlo IinI
Iayor doos nol procoss or in any vay affocl llo conlonls of llo TII loador. Tlo
lransaclion Iayor indicalos llal dala is corruplod by solling llo Dala Irror/Ioi-
sonod bil (I/I) in llo Wrilo roquosl or Road CompIolion lransaclion loador.
Dala poisoning orrors aro onabIod and roporlod via llo UncorroclabIo Irror
Rogislors.
TC to VC Mapping Errors
AII ICI Ixpross porls llal impIomonl llo oxlondod VC capabiIily (ondpoinls,
svilclos, and rool porls) musl clocI lo vorify llal llo TC of oacl inbound
pacIol is mappod lo an aclivo VC. IacIols vill TC's llal faiI llis clocI aro
lroalod as maIformod TIIs. SimiIarIy, vlon svilclos forvard pacIols, lloy
musl aIso vorify llal llo largol oulbound porl of llo svilcl aIso supporls llo
pacIol's TC. If nol, llo pacIol is lroalod as a maIformod TII.
A roquoslor or compIolor may impIomonl moro llan ono VirluaI ClannoI (VC)
and onabIo moro llan ono Traffic CIass (TC). If llo dovico coro issuos a roquosl
lo sond a lransaclion vill a TC numbor llal is nol onabIod (poinling lo an
aclivo VC) villin llo TC lo VC mapping labIos, llo lransaclion is rojoclod and a
maIformod TII is indicalod. If llo dovico las impIomonlod llo ICI Ixpross Vir-
luaI ClannoI CapabiIily slrucluro (supporls muIlipIo VCs and/or TC fiIloring),
llon llo maIformod TII orror is doloclod al llo lransmilling dovico. Hovovor,
if llo dovico onIy supporls llo dofauIl TC0/VC0 configuralion, llon llis orror
vouId bo doloclod al llo firsl rocoiving dovico aIong llo pacIol's pall llal
impIomonls llo oxlondod VC capabiIily and appIios TC fiIloring.
Nolo aIso llal llo TC lo VC mapping is a lransaclion Iayor funclion. (Soo
Assigning TCs lo oacl VC TC/VC Mapping on pago 262 for dolaiIs).
Link FIow ControI-ReIated Errors
Irior lo forvarding llo pacIol lo llo IinI Iayor for lransmission across llo IinI,
llo lransaclion Iayor musl clocI fIov conlroI crodils lo onsuro llal llo rocoivo
buffors in llo adjaconl nodo (svilcl or compIolor) lavo sufficionl room lo loId
PCI Express System Architecture
364
llo lransaclion. IIov conlroI prolocoI orrors may occur llal viII IiIoIy provonl
lransaclions from boing sonl. Tloso orrors can bo roporlod lo llo Rool CompIox
and aro considorod uncorroclabIo. Tlo uncorroclabIo orror rogislors aro usod lo
onabIo and clocI slalus for IIov ConlroI (IC) orrors. - -
- -
AII fivo condilions llal causo fIov conlroI roIalod orrors (fIov conlroI prolocoI
orrors and rocoivor ovorfIov orrors) aro doloclod by and associalod vill llo
porl rocoiving llo fIov conlroI informalion. Tloso orror condilions aro:
- Tlo spocificalion dofinos llo minimum crodil sizo llal can bo iniliaIIy
roporlod for oacl IIov ConlroI lypo. During IC iniliaIizalion for any Vir-
luaI ClannoI, if a rocoivor faiIs lo advorliso VC crodil vaIuo oquaI lo or
groalor llan lloso pormillod, il is considorod an IC prolocoI orror.
- Tlo maximum numbor of dala payIoad crodils llal can bo roporlod is
roslriclod lo 2048 unusod crodils and 128 unusod crodils for loadors.
Ixcooding lloso Iimils is considorod an IC prolocoI orror.
- During IC iniliaIizalion rocoivors aro aIIovod lo roporl infinilo IC crodils.
IC updalos aro roquirod foIIoving iniliaIizalion. IC updalos aro aIIovod
providing llal llo crodil vaIuo fioId is sol lo zoro, vlicl is ignorod by llo
rocipionl. If llo dala fioId conlains any vaIuo ollor llan zoro, il is consid-
orod an IC prolocoI orror.
- During IC iniliaIizalion oillor llo Dala or loador IC advorlisomonl (bul
nol boll) for a givon IC lypo may bo infinilo. IC updalo pacIols aro
roquirod lo roporl crodils for llo buffor llal advorlisod Iimilod IC crodils.
Hovovor llo updalo crodil vaIuo for llo buffor advorlisod as infinilo musl
bo sol lo zoro and ignorod by llo rocoivor. A non-zoro crodil vaIuo couId
causo an IC prolocoI orror.
- A spocific clocI can bo mado al llo rocoiving porl lo dolormino if a fIov
conlroI rocoivo buffor las ovorfIovod, rosuIling in Iosl dala. Tlis clocI is
oplionaI and considorod an IC prolocoI orror.
IIov ConlroI IrolocoI orrors aro roporlod as uncorroclabIo orrors, if supporlod
and onabIod.
MaIformed Transaction Layer Packet (TLP)
Wlon llo uIlimalo rocipionl of a lransaclion rocoivos a roquosl or compIolion
pacIol inlo llo lransaclion Iayor, llo pacIol formal is clocIod for vioIalions of
llo TII formalling ruIos. Tlo spocificalion dofinos llo foIIoving iloms llal
causo a maIformod pacIol:
Chapter 10: Error Detection and Handling
365
- Dala payIoad oxcoods Max payIoad sizo.
- Tlo acluaI dala Iongll doos nol malcl dala Iongll spocifiod in llo loador.
- Slarl Momory DW addross and Iongll fioId rosuIls in llo lransaclion cross-
ing a 4KB boundary.
- TD fioId =1 (indicaling Digosl incIudod) bul no digosl fioId is prosonl.
- Bylo InabIo vioIalion doloclod.
- IacIols vlicl uso an undofinod Typo fioId vaIuos.
- MuIlipIo compIolion pacIols aro usod lo sond road dala bacI lo llo
roquoslor and llo dala sizo rolurnod in any of llo compIolion pacIols vio-
Ialos llo Road CompIolion Boundary (RCB) vaIuo.
- CompIolions vill a Configuralion Roquosl Rolry Slalus in rosponso lo a
Roquosl ollor llan a Configuralion Roquosl.
- Traffic CIass fioId (TC) conlains a vaIuo nol assignod lo an onabIod VirluaI
ClannoI (VC) villin llo TC - VC mapping for llo rocoiving dovico.
- Transaclion lypo roquiring uso of TC0 las TC vaIuo ollor llan zoro:
o I/O Road or Wrilo roquosls and compIolions
o Configuralion Road or Wrilo roquosls and compIolions
o Irror mossagos
o INTx mossagos
o Iovor Managomonl mossagos
o UnIocI mossagos
o SIol Iovor mossagos
- Rouling is incorrocl for lransaclion lypo (o.g., lransaclions roquiring rouling
lo Rool CompIox doloclod moving avay from Rool CompIox).
SpIit Transaction Errors
A varioly of faiIuros can occur during a spIil lransaclion. Wlon a lransaclion
roquosl is sonl lo a doslinalion dovico a compIolion lransaclion is oxpoclod in
rosponso (oxcopl for Momory Wrilo and Mossago lransaclions vlicl aro poslod
lransaclions). Tlo various faiIuro modos llal can occur aro discussod in llo foI-
Ioving soclions.
Unsupported Request
Wlon a rocipionl of a lransaclion roquosl dolocls llal il doos nol supporl llis
lransaclion, il rolurns a compIolion lransaclion vill unsupporlod roquosl (UR)
spocifiod in llo compIolion slalus fioId. Tlo spocificalion dofinos a numbor of
spocific condilions llal causo UR lo bo rolurnod in llo compIolion slalus fioId:
- Roquosl lypo nol supporlod.
- Mossago roquosl rocoivod vill unsupporlod or undofinod mossago codo.
PCI Express System Architecture
366
- Roquosl doos nol roforonco addross spaco mappod villin dovico.
- Roquosl conlains an addross llal cannol bo roulod lo any ogross porl of a
bridgo or a svilcl (i.o., addross is nol mappod lo any porls baso and Iimil
rogislors).
- Ioisonod Wrilo Roquosl addrossos an I/O or Momory mappod conlroI
spaco in llo CompIolor. Sucl lransaclions musl bo discardod by llo CompI-
olor and roporlod as a UR.
- ICI Ixpross ondpoinl dovico rocoivos a MRdII (IocI) lransaclion. (RocaII
llal IocI is nol supporlod by ondpoinl dovicos.)
- Tlo dovnslroam porl of llo Rool CompIox or Svilcl rocoivos a configura-
lion roquosl vill a Dovico numbor of 1-31. Tlo porl musl lorminalo llo
lransaclion and nol inilialo a configuralion lransaclion on llo dovnslroam
IinI. Insload a compIolion lransaclion is rolurnod vill UR slalus.
- A configuralion accoss llal largols an un-impIomonlod Bus, Dov, or Iunc-
lion rosuIls in lorminalion of llo lransaclion, and a compIolion lransaclion
is rolurnod vill UR slalus.
- Typo 1 configuralion roquosl rocoivod al ondpoinl.
- A compIolion is rocoivod al llo roquoslor vill a rosorvod compIolion codo.
Tlis musl bo inlorprolod as a UR.
- A funclion is in llo D1 or D2 povor managomonl slalos and a roquosl ollor
llan a configuralion roquosl is rocoivod.
- A configuralion accoss llal largols a bus llal is nol in llo rango of busos
dovnslroam of llal porl according lo llo socondary and subordinalo rogis-
lor vaIuos.
- A configuralion roquosl passing llrougl a ICI Ixpross - ICI Bridgo for
vlicl llo Ixlondod Rogislor Addross fioId is non-zoro llal is diroclod
lovard a ICI bus llal doos nol supporl Ixlondod Configuralion Spaco.
- A lransaclion loadod for a porl vill llo Rojocl Snoop Transaclions fioId sol
in llo VC Rosourco CapabiIily rogislor llal doos nol lavo llo No Snoop bil
sol in llo TII loador.
- A lransaclion is largoling a dovico on a ICI bus bul is Maslor Aborlod aflor
llo roquosl vas accoplod by llo bridgo.
CompIeter Abort
Tloso lypo of orror clocIs aro oplionaI. Tlroo circumslancos can occur llal
couId rosuIl in a CompIolor rolurning an aborl lo llo Roquoslor:
1. A CompIolor rocoivos a roquosl llal il cannol compIolo bocauso llo roquosl
vioIalos llo programming ruIos for llo dovico. As an oxampIo, somo dovicos
may bo dosignod lo pormil accoss lo a singIo Iocalion villin a spocific
DWord, vliIo any allompl lo accoss llo ollor Iocalions villin llo samo
DWord vouId faiI. Sucl roslriclions aro nol vioIalions of llo spocificalion,
Chapter 10: Error Detection and Handling
367
bul rallor IogaI roslriclions associalod vill an impIomonlalion-spocific pro-
gramming inlorfaco for llis funclion. Accossos lo sucl dovicos aro basod
upon llo oxpoclalion llal onIy llo dovico-drivor for llis dovico undor-
slands lov lo accoss ils funclion.
2. A compIolor rocoivos a roquosl llal il cannol procoss bocauso of somo por-
manonl orror condilion associalod vill llo dovico. Ior oxampIo, a ICI
Ixpross viroIoss IAN card llal is nol accopling ICI Ixpross lransaclions
bocauso il viII nol lransmil or rocoivo dala ovor ils radio unIoss lloro is an
approvod anlonna allaclod.
3. A ICI Ixpross lo ICI Bridgo may rocoivo a roquosl llal largols a ICI or ICI-
X bus. Tloso busos supporl a signaIing convonlion llal aIIovs llo largol
dovico lo indicalo llal il las aborlod llo roquosl (largol aborl) bocauso il
cannol compIolo llo roquosl duo lo somo pormanonl condilion or vioIalion
of llo funclions programming ruIos. Tlo bridgo in lurn vouId rolurn a ICI
Ixpross compIolion lransaclion indicaling CA slalus.
A CompIolor llal aborls a roquosl may roporl llo orror lo llo Rool CompIox as a
Non-IalaI Irror mossago. Iurllor, if llo aborlod roquosl roquiros a compIolion,
llo compIolion slalus vouId bo roporlod as CA.
Unexpected CompIetion
A compIolion lransaclion llal arrivos al a Roquoslor usos llo lransaclion
doscriplor (Roquoslor ID and Tag) lo malcl llo roquosl lo vlicl llis compIolion
appIios. In raro circumslancos llo lransaclion doscriplor may nol malcl a
roquosl llal is ponding compIolion. Tlo lypicaI roason for llis unoxpoclod com-
pIolion is llal llo compIolion vas mis-roulod on ils journoy bacI lo llo
inlondod roquoslor. ConsoquonlIy, lvo roquoslors viII bo surprisod:
1. llo roquoslor llal las rocoivod llo unoxpoclod compIolion, and
2. llo roquoslor llal faiIs lo rocoivo llo compIolion (lloroby causing a compIo-
lion limo-oul)
A Non-IalaI Irror mossago can bo sonl by llo dovico llal rocoivos llo unox-
poclod compIolion.
CompIetion Time-out
Tlo provious discussion poinls oul llal a compIolion lransaclion can bo roulod
lo llo vrong dovico. ConsoquonlIy, llo ponding roquosl viII novor rocoivo ils
compIolion. Tlo spocificalion dofinos llo compIolion limo-oul moclanism lo
idonlify llis silualion and roporl llo orror lo roquoslor soflvaro for possibIo
rocovory. Tlo spocificalion cIoarIy dofinos llal llo inlonl of llo compIolion limo-
PCI Express System Architecture
368
oul is lo dolocl vlon a compIolion las no roasonabIo clanco of rolurning and
nol roIalod lo oxpoclod Ialoncios associalod vill spIil lransaclions.
Tlo compIolion limo-oul moclanism musl bo impIomonlod by any dovico llal
inilialos roquosls llal roquiro compIolions lo bo rolurnod. An oxcoplion is
aIIovod for dovicos llal onIy inilialo configuralion lransaclions. Tlo spocifica-
lion dofinos llo pormissibIo rango of llo limo-oul vaIuo as foIIovs:
- Il is slrongIy rocommondod llal a dovico nol limo-oul oarIior llan 10ms
aflor sonding a roquosl, lovovor, if llo dovico roquiros groalor granuIarily a
limo-oul can occur as oarIy as 50s.
- Dovicos musl limo-oul no Ialor llan 50ms.
Nolo llal for Momory Road roquosls a roquosl may roquiro lvo or moro com-
pIolions lo rolurn aII of llo roquoslod dala. AII of llo dala musl bo rolurnod
prior lo llo limo-oul. If somo bul nol aII of llo dala las boon rolurnod vlon llo
limo-oul occurs, llo roquoslor may oillor discardod or Ioop llo dala.
Error CIassifications
Irrors aro calogorizod inlo llroo cIassos llal spocify llo sovorily of an orror as
Iislod boIov. Nolo aIso llo spocificalion dofinos llo onlily llal slouId landIo
llo orror basod on ils sovorily:
- CorroclabIo orrors landIod by lardvaro
- UncorroclabIo orrors-nonfalaI landIod by dovico-spocific soflvaro
- UncorroclabIo orrors-falaI landIod by syslom soflvaro
By dofining orrors inlo lloso cIassos, orror landIing soflvaro can bo parlilionod
inlo soparalo landIors lo porform llo aclions roquirod of a givon pIalform. Tlo
aclions laIon basod on sovorily of an orror migll rango from moniloring llo
offocls of corroclabIo orrors on syslom porformanco lo simpIy rosolling llo sys-
lom in llo ovonl of a falaI orror.
Nolo llal rogardIoss of llo sovorily of a givon orror, soflvaro can oslabIisl a poI-
icy vloroby llo syslom is nolifiod of aII orrors for llo purposo of lracIing and
Iogging oacl calogory.
Chapter 10: Error Detection and Handling
369
CorrectabIe Errors
Tlo spocificalion dofinos corroclabIo orrors as lloso orrors llal aro corroclod
soIoIy by lardvaro. Sucl orrors may lavo an impacl on porformanco (i.o.,
Ialoncy and bandvidll), bul no informalion is Iosl as a rosuIl of llo orror. Tloso
lypos of orror can bo roporlod lo soflvaro, vlicl can laIo a varioly of aclions,
IncIuding:
- Iog llo orror
- updalo caIcuIalions of ICI Ixpross porformanco
- lracI orrors lo projocl possibIo voaInossos villin llo fabric. Tlis can sug-
gosl aroas vloro groalor polonliaI oxisls for falaI orrors in llo fuluro.
UncorrectabIe Non-FataI Errors
Non-falaI orrors moan llal llo inlogrily of llo ICI Ixpross fabric is nol affoclod,
bul llal informalion las boon Iosl. Non-falaI orrors lypicaIIy moan llal a lrans-
aclion las boon corruplod, and llo ICI Ixpross lardvaro cannol corrocl llo
orror. Hovovor, llo ICI Ixpross fabric conlinuos lo funclion corroclIy and ollor
lransaclions aro unaffoclod. Rocovory from a non-falaI orror may or may nol bo
possibIo. Tlo possibiIily of rocovory rosls in llo lands of llo dovico-spocific
soflvaro associalod vill llo roquoslor llal inilialod llo lransaclion.
UncorrectabIe FataI Errors
IalaI orrors indicalo llal a IinI in llo ICI Ixpross fabric is no Iongor roIiabIo.
Dala las boon Iosl and ovory allompl lo rocovor dala undor soflvaro conlroI
viII IiIoIy faiI aIso. Sucl condilions affocl aII lransaclions llal lravorso a givon
IinI. In somo casos, llo orror condilion Ioading lo llo falaI orrors may bo
rosoIvod by rosolling llo IinI. AIlornalivoIy, llo spocificalion invilos impIomon-
lalion-spocific approaclos, in vlicl soflvaro may allompl lo Iimil llo offocls of
llo faiIuro. Tlo spocificalion doos nol dofino any parlicuIar aclions llal slouId
or couId bo laIon by soflvaro.
PCI Express System Architecture
370
How Errors are Reported
ICI Ixpross incIudos lvo mollods of roporling orrors:
- orror mossago lransaclions usod lo roporl orrors lo llo losl
- compIolion slalus usod by llo compIolor lo roporl orrors lo llo roquoslor
Iacl roporling moclanism is doscribod boIov.
Error Messages
As discussod proviousIy, ICI roporls orrors via llo IIRR# and SIRR# signaIs.
Bocauso ICI Ixpross oIiminalos llosos orror-roIalod signaIs, orror mossagos
lavo boon dofinod lo ropIaco lloso signaIs by acling as virluaI viros. Iurllor-
moro, lloso mossagos provido addilionaI informalion llal couId nol bo con-
voyod diroclIy via llo IIRR# and SIRR# signaIs. Tlis incIudos idonlificalion of
llo dovico llal doloclod llo orror and an indicalion of llo sovorily of oacl orror.
Iiguro 10-4 iIIuslralos llo formal of llo orror mossagos. Nolo llal lloso pacIols
aro roulod lo llo Rool CompIox for landIing by syslom soflvaro. Tlo mossago
codo dofinos llo lypo of mossago boing signaIod. As ono migll guoss, llo spoci-
ficalion dofinos llroo basic lypos of orror mossagos slovn in TabIo 10-1.
- ---
Chapter 10: Error Detection and Handling
371
CompIetion Status
ICI Ixpross dofinos a -- fioId villin llo compIolion loador llal
onabIos llo lransaclion compIolor lo roporl orrors bacI lo llo roquoslor. Iiguro
10-5 iIIuslralos llo Iocalion of llo compIolion fioId and TabIo 10-2 dofinos llo
compIolion vaIuos. Nolo llal llo sladod slalus onlrios roprosonl orror condi-
lions llal can bo roporlod via orror mossagos.
-- - -
--

-
30l IRR_COR usod vlon a ICI Ixpross dovico dolocls a cor-
roclabIo orror
31l IRR_NONIATAI usod vlon a dovico dolocls a non-falaI, uncor-
roclabIo orror
33l IRR_IATAI usod vlon a dovico dolocls a falaI, uncorrocl-
abIo orror
-
PCI Express System Architecture
372
BaseIine Error Detection and HandIing
Tlis soclion dofinos llo roquirod supporl for dolocling and roporling ICI
Ixpross orrors. Iacl ICI Ixpross compIianl dovicos musl incIudo:
- ICI-CompalibIo supporl roquirod lo supporl oporaling onvironmonls
llal lavo no InovIodgo of ICI Ixpross.
- ICI Ixpross Irror roporling avaiIabIo lo oporaling onvironmonls llal do
lavo InovIodgo of ICI Ixpross.
PCI-CompatibIe Error Reporting Mechanisms
Iacl ICI Ixpross musl map roquirod ICI Ixpross orror supporl lo llo ICI-
roIalod orror rogislors. Tlis invoIvos onabIing orror roporling and solling slalus
bils llal can bo road by ICI-compIianl soflvaro. To undorsland llo foaluros
avaiIabIo from llo ICI-compalibIo poinl of viov considor llo orror-roIalod bils
of llo Command and Slalus rogislors Iocalod villin llo Configuralion loador.
WliIo llo command and slalus rogislor bils lavo llo ICI namo, somo of llo
fioId dofinilions lavo boon modifiod lo rofIocl llo roIalod ICI Ixpross orror con-
dilions and roporling moclanisms. Tlo ICI Ixpross orrors lracIod by llo ICI-
compalibIo rogislors aro:
- Transaclion Ioisoning/Irror Iorvarding (oplionaI)
- CompIolor Aborl (CA) doloclod by a compIolor
- UnrocognizabIo Roquosl (UR) doloclod by a compIolor
-
- -
000b SuccossfuI CompIolion (SC)
001b Unsupporlod Roquosl (UR)
010b Configuralion Roquosl Rolry Slalus (CRS)
011b CompIolor Aborl (CA)
100b - 111b Rosorvod
Chapter 10: Error Detection and Handling
373
Tlo ICI moclanism for roporling orrors is llo assorlion of IIRR# (dala parily
orrors) and SIRR# (unrocovorabIo orrors). Tlo ICI Ixpross moclanisms for
roporling lloso ovonls aro via llo spIil lransaclion moclanism (lransaclion com-
pIolions) and virluaI SIRR# signaIing via orror mossagos.
Configuration Command and Status Registers
Iiguro 10-6 iIIuslralos llo command rogislor and llo Iocalion of llo orror-roIalod
fioIds. Tloso bils aro sol lo onabIo basoIino orror roporling undor conlroI of ICI-
compalibIo soflvaro. TabIo 10-3 dofinos llo spocific offocls of oacl bil.
-
- -
-
SIRR# InabIo Solling llis bil (1) onabIos llo gonoralion of llo approprialo ICI
Ixpross orror mossagos lo llo Rool CompIox. Irror mossagos aro
sonl by llo dovico llal las doloclod oillor a falaI or non-falaI orror.
PCI Express System Architecture
374
Iiguro 10-7 iIIuslralos llo configuralion slalus rogislor and llo Iocalion of llo
orror-roIalod bil fioIds. TabIo 10-4 on pago 374 dofinos llo circumslancos undor
vlicl oacl bil is sol and llo aclions laIon by llo dovico vlon orror roporling is
onabIod.
Iarily Irror
Rosponso
Tlis bil onabIos poisonod TII roporling. Tlis orror is lypicaIIy
roporlod as an Unsupporlod Roquosl (UR) and may aIso rosuIl in a
non-falaI orror mossago if SIRR# onabIo=1b. Nolo llal roporling in
somo casos is dovico-spocific.
- - -
- - - - -
-
Doloclod Iarily Irror Sol by llo inlorfaco llal rocoivos a Wrilo Roquosl or
Road CompIolion lransaclion vill llo poisonod bil sol.
Tlis aclion porlains lo llo roquoslors, compIolors, and
svilclos. (Tlis bil is updalod rogardIoss of llo slalo of
llo Iarily Irror onabIo bil.)
- -
-
Chapter 10: Error Detection and Handling
375
PCI Express BaseIine Error HandIing
Tlo BasoIino capabiIily aIso roquiros uso of llo ICI Ixpross capabiIily rogislors.
Tloso rogislors incIudo orror doloclion and landIing bil fioIds llal provido finor
granuIarily rogarding llo naluro of an orror llal is suppIiod vill slandard ICI
orror landIing.
Iiguro 10-8 on pago 376 iIIuslralos llo ICI Ixpross capabiIily rogislor sol. Tloso
rogislors provido supporl for:
- InabIing/disabIing orror roporling (Irror Mossago Gonoralion)
- Iroviding orror slalus
- Iroviding slalus for IinI lraining orrors
- Inilialing IinI ro-lraining
SignaIIod Syslom Irror Tlis bil is sol by a dovico llal las doloclod an uncorrocl-
abIo orror and roporlod il via an orror mossago (roquiros
SIRR# onabIo bil lo bo sol in llo Command rogislor lo
sond orror mossago).
Rocoivod Maslor Aborl Sol by a roquoslor llal rocoivos a compIolion lransaclion
vill Unsupporlod Roquosl (UR) in llo compIolion sla-
lus fioId.
Rocoivod Targol Aborl Sol by a roquoslor llal rocoivos a compIolion lransaclion
vill CompIolor Aborl (CA) in llo compIolion slalus
fioId.
SignaIIod Targol Aborl Sol by a compIolor vlon aborling a roquosl llal vioIalos
llo dovicos programming ruIos.
Maslor Dala Iarily Irror Sol by a lransmillor llal inilialos or forvards a lransac-
lion vill llo poisonod bil sol and lo a rocoivor dovico
llal rocoivod a compIolion vill llo poisonod bil sol.
Tlis bil is sol by a dovico llal oillor:
- rocoivos a compIolion pacIol llal las boon poisonod
- lransmils a vrilo pacIol llal las boon poisonod
- - - - -
-
PCI Express System Architecture
376
EnabIing/DisabIing Error Reporting
Tlo Dovico ConlroI and Dovico Slalus rogislors pormil soflvaro lo onabIo gonor-
alion of Irror Mossagos for four orror-roIalod ovonls and lo clocI slalus infor-
malion lo dolormino vlicl lypo of orror las boon doloclod:
- CorroclabIo Irrors
- Non-IalaI Irrors
- IalaI Irrors
- Unsupporlod Roquosl Irrors
Nolo llal llo onIy spocific lypo of orror condilion idonlifiod is llo unsupporlod
roquosl (UR). No granuIarily is providod for dolormining ollor lypos of orror
condilions llal occur. OnIy llo cIassificalion of llo orror is roporlod villin llo
dovico slalus rogislor. TabIo 10-5 on pago 377 Iisls oacl orror lypo and ils associ-
alod orror cIassificalion.
-- -
Chapter 10: Error Detection and Handling
377
- Solling llo
corrosponding bil in llo Dovico ConlroI Rogislor onabIos llo gonoralion of
llo corrosponding Irror Mossago vlicl roporls orrors associalod vill oacl
cIassificalion. (Rofor lo Iiguro 10-9 on pago 378.) Unsupporlod Roquosl
orrors aro spocifiod as Non-IalaI orrors and aro roporlod via a Non-IalaI
Irror Mossago, bul onIy vlon llo bil is sol.
-- -
--
CorroclabIo Rocoivor Irror IlysicaI
CorroclabIo Bad TII IinI
CorroclabIo Bad DIII IinI
CorroclabIo RopIay Timo-oul IinI
CorroclabIo RopIay Numbor RoIIovor IinI
UncorroclabIo - Non IalaI Ioisonod TII Rocoivod Transaclion
UncorroclabIo - Non IalaI ICRC ClocI IaiIod Transaclion
UncorroclabIo - Non IalaI Unsupporlod Roquosl Transaclion
UncorroclabIo - Non IalaI CompIolion Timo-oul Transaclion
UncorroclabIo - Non IalaI CompIolion Aborl Transaclion
UncorroclabIo - Non IalaI Unoxpoclod CompIolion Transaclion
UncorroclabIo - IalaI Training Irror IlysicaI
UncorroclabIo - IalaI DII IrolocoI Irror IinI
UncorroclabIo - IalaI Rocoivor OvorfIov Transaclion
UncorroclabIo - IalaI IIov ConlroI IrolocoI Irror Transaclion
UncorroclabIo - IalaI MaIformod TII Transaclion
PCI Express System Architecture
378
- - - Soo Iiguro 10-10 on pago 379.
An orror slalus bil is sol any limo an orror associalod vill ils cIassificalion is
doloclod. Tloso bils aro sol irrospoclivo of llo solling of llo Irror Roporling
InabIo bils villin llo Dovico ConlroI Rogislor. Bocauso Unsupporlod
Roquosl orrors aro by dofauIl considorod Non-IalaI Irrors, vlon lloso
orrors occur boll llo -- bil and llo - -
slalus bil viII bo sol. Nolo llal lloso bils aro cIoarod by soflvaro vlon vril-
ing a ono (1) lo llo bil fioId.
- -
Chapter 10: Error Detection and Handling
379
Link Errors
Tlo plysicaI IinI connocling lvo dovicos may faiI causing a varioly of orrors.
IinI faiIuros aro lypicaIIy doloclod villin llo plysicaI Iayor and communicalod
lo llo Dala IinI Iayor. Bocauso llo IinI las incurrod orrors, llo orror cannol bo
roporlod lo llo losl via llo faiIod IinI. Tloroforo, IinI orrors musl bo roporlod
via llo upslroam porl of svilclos or by llo Rool Iorl ilsoIf. AIso llo roIalod
fioIds in llo ICI Ixpross IinI ConlroI and Slalus rogislors aro onIy vaIid in
Svilcl and Rool dovnslroam porls (novor villin ondpoinl dovicos or svilcl
upsloam porls). Tlis pormils syslom soflvaro lo accoss IinI-roIalod orror rogis-
lors on llo porl llal is cIososl lo llo losl.
If soflvaro can isoIalo ono or moro orrors lo a givon IinI, ono mollod of
allompling lo cIoar a non-corroclabIo orror is lo rolrain llo IinI. Tlo IinI Con-
lroI Rogislor incIudos a bil llal vlon sol forcos llo Rool or Svilcl porl lo rolrain
llo IinI. If lransaclion (upon compIolion of llo rolraining) can onco again
lravorso llo IinI villoul orrors, llo probIom viII lavo boon soIvod. Iiguro 10-11
iIIuslralos llo IinI ConlroI Rogislor and liglIiglls llo fioId llal
soflvaro sols lo inilialo rolaining.
- - -
PCI Express System Architecture
380
Soflvaro can monilor llo bil in llo IinI Slalus Rogislor lo dolor-
mino vlon rolraining las compIolod. Soflvaro can aIso clocI llo
bil lo vorify llal IinI lraining vas succossfuI. IinI Training orrors aro
roporlod via llo IalaI Irror Mossago. Iiguro 10-12 liglIiglls lloso slalus bils.
- -
- - - -
Chapter 10: Error Detection and Handling
381
Roots Response to Error Message
Wlon a mossago is rocoivod by llo Rool CompIox llo aclion llal il laIos vlon
roporling llo orror mossago lo llo losl syslom is dolorminod in parl by llo Rool
ConlroI Rogislor sollings. Iiguro 10-13 dopicls llis rogislor and liglIiglls llo
llroo bil fioIds llal spocify vlollor an orror slouId bo roporlod as a falaI Sys-
lom Irror (SIRR sol onabIos gonoralion of a syslom orror). In x86 sysloms il is
IiIoIy llal a Non-MasIabIo Inlorrupl (NMI) viII bo signaIod if llo orror is lo bo
roporlod as a SIRR.
Tlo IMI Inlorrupl InabIo bil (3) aIIovs soflvaro lo onabIo and disabIo inlor-
rupl gonoralion upon llo Rool CompIox dolocling a IMI Mossago lransaclion.
Ollor oplions for roporling orror mossagos aro nol configurabIo via slandard
rogislors. Tlo mosl IiIoIy sconario is llal a syslom inlorrupl viII bo signaIod lo
llo procossor llal viII caII an Irror HandIor, vlicl may allompl lo cIoar llo
orror condilion and/or simpIy Iog llo orror.
-
PCI Express System Architecture
382
Advanced Error Reporting Mechanisms
Advancod Irror Roporling roquiros impIomonlalion of llo Advancod Irror
Roporling rogislors iIIuslralod in Iiguro 10-14 on pago 382. (Nolo llal llo Iigllor
fioIds al llo bollom of llo CapabiIily rogislor diagram aro usod onIy for rool
porls, discussod Ialor.) Tloso rogislors provido sovoraI addilionaI orror roporl-
ing foaluros:
- finor granuIarily in dofining llo acluaI lypo of orror llal las occurrod
villin oacl cIassificalion.
- abiIily lo spocify llo sovorily of oacl uncorroclabIo orror lypo lo dolormino
vlollor il slouId bo roporlod as a falaI or non-falaI orror.
- supporl for Iogging orrors.
- onabIo/disabIo Rool CompIox lo roporl orrors lo llo syslom.
- idonlify sourco of llo orror.
- abiIily lo masI roporling individuaI lypos of orrors.
--
Chapter 10: Error Detection and Handling
383
ECRC Generation and Checking
Ind-lo-Ind CRC (ICRC) gonoralion and clocIing can bo onabIod onIy if llo
Advancod Irror Roporling CapabiIily rogislors aro impIomonlod. SpocificaIIy,
llo Advancod Irror CapabiIily and ConlroI rogislor providos conlroI ovor
ICRC gonoralion and clocIing as iIIuslralod in Iiguro 10-15 on pago 383.
Tlis rogislor roporls vlollor llis dovico supporls ICRC gonoralion and clocI-
ing. If so, configuralion soflvaro can onabIo ono or boll foaluros.
In somo casos, muIlipIo uncorroclabIo orrors may bo doloclod prior lo soflvaro
roading and cIoaring llo rogislor. Tlo Iirsl Irror Ioinlor fioId idonlifios llo bil
posilion villin llo Advancod UncorroclabIo Slalus rogislor corrosponding lo
llo orror llal occurrod firsl. (Soo Iiguro 10-18 on pago 387.)
Tlo Iirsl Irror Ioinlor and llo ICRC ClocI and Gonoralion InabIo bils musl
bo impIomonlod as slicIy bils.
HandIing Sticky Bits
SovoraI of llo Advancod Configuralion Irror Rogislors ompIoy slicIy fioIds.
Many of lloso fioIds aro singIo bils. Tlo dosignalions of slicIy fioIds aro as foI-
Iovs:
- ROS Road OnIy/SlicIy
- RWS Road/Wrilo/SlicIy
- RW1CS Road/Wrilo 1 lo CIoar/SlicIy
-
PCI Express System Architecture
384
SlicIy orror rogislor fioIds bolavo difforonlIy in llal a Hol Rosol las no affocl on
llo conlonls of lloso fioIds. Ior aII ollor rogislor fioIds, Hol Rosol forcos dofauIl
vaIuos inlo llo fioIds. SlicIy bils aro imporlanl in orror landIing lo onsuro llal
Irror-roIalod conlroI and slalus informalion is nol Iosl duo lo a Hol Rosol. Sofl-
varo may inilialo a Hol Rosol in an allompl lo cIoar orrors.
Advanced CorrectabIe Error HandIing
Advancod orror roporling providos llo abiIily lo pinpoinl spocific corroclabIo
orrors. Tloso orrors can soIoclivoIy causo llo gonoralion of a CorroclabIo Irror
Mossago boing sonl lo llo losl syslom:
- Rocoivor Irrors (oplionaI) causod vlon llo IlysicaI Iayor dolocls an
orror in llo incoming pacIol (TII or DIII). Tlo IlysicaI Iayor discards
llo pacIol, froos buffor spaco aIIocalod lo llo pacIol, and signaIs llo IinI
Iayor llal a rocoivo orror las occurrod. Tlis orror is roporlod by solling a
slalus bil and musl nol rosuIl in llo IinI Iayor aIso roporling an orror for
llis pacIol (o.g., llo IinI Iayor musl nol roporl a Bad TII or Bad DIII).
- Bad TIIs causod vlon llo IinI Iayor dolocls a pacIol vill a bad CRC
clocI, an incorroclIy nuIIifiod pacIol, or an incorrocl IacIol Soquonco
Numbor (nol a dupIicalo). In oacl caso, llo IinI Iayor discards llo pacIol
and roporls a NAK DIII lo llo lransmillor, vlicl lriggors a lransaclion
rolry.
- Bad DIIIs causod by a CRC clocI faiIuro. Tlis lypo of orror may bo cor-
roclod by a subsoquonl DIII or a limo-oul llal rosuIls uIlimaloIy in DIII
rolry. Tlo oxacl corroclivo aclion doponds on llo lypo of DIII llal las
faiIod and llo circumslancos associalod vill pacIol lransmission.
- RIIIAY_NUM RoIIovor llo RIIIAY_NUM is a counl mainlainod
villin llo lransmilling sido of llo IinI Iayor llal Ioops lracI of llo numbor
of limos llal a lransaclion lad boon rolransmillod villoul succossfuI doIiv-
ory. Wlon llo counl roIIs ovor, lardvaro aulomalicaIIy rolrains llo IinI in
an allompl lo cIoar llo fauIl condilion.
- RopIay Timor Timo-oul llis limor is mainlainod villin llo lransmilling
sido of llo IinI Iayor and is inlondod lo lriggor a rolry vlon forvard
progross in sonding TIIs las sloppod. A limo-oul occurs vlon unacInovI-
odgod TIIs lavo nol rocoivod an acInovIodgomonl villin llo limo-oul
poriod. A limo-oul rosuIls in a rolry of aII unacInovIodgod TIIs.
KnovIodgo of vlicl orror las occurrod can loIp syslom soflvaro lo maIo bol-
lor prodiclions of compononls llal aro IiIoIy lo faiI compIoloIy in llo fuluro.
Soflvaro may aIso clooso lo masI rocognilion of somo corroclabIo orrors vliIo
roporling ollors.
Chapter 10: Error Detection and Handling
385
Advanced CorrectabIe Error Status
Wlon a corroclabIo orror occurs llo corrosponding bil villin llo Advancod
CorroclabIo Irror Slalus rogislor is sol. (Soo Iiguro 10-16.) Tloso bils aro aulo-
malicaIIy sol by lardvaro and aro cIoarod by soflvaro vlon vriling a 1 lo llo
bil posilion. Tloso bils aro sol vlollor or nol llo orror is roporlod via an Irror
Mossago. Iacl slalus bil in llis rogislor is dosignalod RW1CS.
Advanced CorrectabIe Error Reporting
Wlollor a parlicuIar corroclabIo orror is roporlod lo llo losl is spocifiod by llo
CorroclabIo MasI rogislor iIIuslralod in Iiguro 10-17. Tlo dofauIl slalo of llo
masI bils aro cIoarod (0), lloroby causing a CorroclabIo Irror mossago lo bo
doIivorod vlon any of llo corroclabIo orrors aro doloclod. Soflvaro may clooso
lo sol ono or moro bils lo provonl a CorroclabIo Irror Mossago from boing sonl
vlon llo soIoclod orror is doloclod. Iacl bil in llis rogislor is dosignalod RWS.
- -
PCI Express System Architecture
386
Advanced UncorrectabIe Error HandIing
Advancod orror roporling providos llo abiIily lo pinpoinl vlicl uncorroclabIo
orror las occurrod. Iurllormoro soflvaro can spocify llo sovorily of oacl orror
and soIocl vlicl orrors viII rosuIl in an Irror Mossago boing sonl lo llo losl
syslom (Rool CompIox).
- Training Irrors (oplionaI) causod by faiIuro in llo IinI lraining soquonco
al llo IlysicaI Iayor.
- Dala IinI IrolocoI Irrors causod by IinI Iayor prolocoI orrors incIuding
llo ACK/NAK rolry moclanism. - --
- -
- - - -- - -
- -
-
- Ioisonod TII Irrors causod by dala corruplion slorago orror villin
momory or dala buffors.
- IIov ConlroI IrolocoI Irrors (oplionaI) orrors associalod vill faiIuros of
llo fIov conlroI moclanism villin llo lransaclion Iayor.
- CompIolion Timo-oul Irrors causod by oxcossivo doIays in llo rolurn of
llo oxpoclod compIolion. Tlis orror is doloclod by llo Roquoslor.
- CompIolor Aborl Irrors (oplionaI) occurs vlon llo CompIolor cannol
fuIfiII llo lransaclion roquosl duo lo a varioly of possibIo probIoms vill llo
roquosl or faiIuro of llo compIolor dovico.
- Unoxpoclod CompIolion Irrors occurs vlon a roquoslor rocoivos a com-
pIolion lransaclion llal doos nol malcl an roquosl ponding compIolion.
- Rocoivor OvorfIov Irrors (oplionaI) causod by a fIov-conlroI buffor
ovorfIov condilion.
- -
Chapter 10: Error Detection and Handling
387
- MaIformod TIIs causod by procossing orrors associalod vill llo lrans-
aclion loador. Tlis orror is doloclod villin llo Transaclion Iayor of llo
dovico rocoiving llo TII.
- ICRC Irrors (oplionaI) causod by an Ind-lo-Ind CRC (ICRC) clocI
faiIuro villin llo lransaclion Iayor of llo rocoiving dovico.
- Unsupporlod Roquosl Irrors occurs vlon llo CompIolor doos nol sup-
porl llo roquosl. Tlo roquosl is corroclIy formod and las nol incurrod any
doloclod orror during lransporl, lovovor llo lransaclion cannol bo fuIfiIIod
by llo compIolor duo lo a varioly of roasons incIuding iIIogaI accoss and
invaIid command for llis dovico.
Tlo orrors nolod as oplionaI in llo Iisl abovo may nol bo impIomonlod in llo
Advancod UncorroclabIo rogislor sol.
Advanced UncorrectabIe Error Status
Wlon an uncorroclabIo orror occurs llo corrosponding bil villin llo Advancod
UncorroclabIo Irror Slalus rogislor is sol. (Soo Iiguro 10-18 on pago 387.) Tloso
bils aro aulomalicaIIy sol by lardvaro and aro cIoarod by soflvaro vlon vril-
ing a 1 lo llo bil posilion. Tloso bils aro sol vlollor or nol llo orror is
roporlod via an Irror Mossago. Iacl slalus bil in llis rogislor is dosignalod
RW1CS.
- -
PCI Express System Architecture
388
SeIecting the Severity of Each UncorrectabIe Error
Advancod orror landIing pormils soflvaro lo soIocl llo sovorily of oacl orror
villin llo Advancod UncorroclabIo Irror Sovorily rogislor. Tlis givos soflvaro
llo opporlunily lo lroal orrors according lo llo sovorily associalod vill a givon
appIicalion. Ior oxampIo, Ioisonod TII dala associalod vill audio dala boing
sonl lo a spoaIor, vliIo nol corroclabIo las no sorious sido offocls roIalivo lo llo
inlogrily of llo syslom. Hovovor, if roaI-limo slalus informalion is boing
rolriovod llal viII loIp maIo crilicaI docisions, any orrors in llis dala can bo
vory sorious. Iiguro 10-19 iIIuslralos llo Irror Sovorily rogislor. Tlo dofauIl vaI-
uos aro iIIuslralod in llo individuaI bil fioIds. Tloso roprosonl llo dofauIl sovor-
ily IovoIs for oacl lypo of orror (1 = IalaI, 0 = Non-IalaI).
Tloso uncorroclabIo orrors llal aro soIoclod lo bo non falaI viII rosuIl in a Non-
IalaI Irror Mossago boing doIivorod and lloso soIoclod as IalaI orrors viII rosuIl
in a IalaI Irror Mossago doIivorod. Hovovor, vlollor or nol an Irror Mossago
is gonoralod for a givon orror is spocifiod in llo Advancod UncorroclabIo MasI
rogislor.
UncorrectabIe Error Reporting
Soflvaro can masI oul spocific orrors so llal lloy novor causo an Irror Mossago
lo bo gonoralod. Tlo dofauIl condilion is lo gonoralo Irror Mossagos for oacl
lypo of orror (aII bils aro cIoarod). Iiguro 10-20 on pago 389 dopicls llo
Advancod UncorroclabIo Irror MasI rogislor.
-
Chapter 10: Error Detection and Handling
389
Error Logging
A four DWord porlion of llo Advancod Irror Rogislors bIocI is rosorvod for
sloring llo loador of llo lransaclion llal las incurrod a faiIuro. OnIy a soIocl
group of Transaclion Iayor orrors rosuIl in llo lransaclion loador boing Ioggod.
TabIo 10-6 Iisls llo lransaclions llal aro Ioggod.
Tlo formal of llo loador is prosorvod vlon caplurod and pIacod inlo llo rogis-
lor. Tlal is, llo iIIuslralion of loador formal in llis booI is oxaclIy lov llo
loadors viII appoar villin llo Irror Iogging rogislor. Nolo aIso llal llo con-
lonls of llis rogislor aro dosignalod ROS.
- -
- -
--
Ioisonod TII Rocoivod UncorroclabIo - Non IalaI
ICRC ClocI IaiIod UncorroclabIo - Non IalaI
Unsupporlod Roquosl UncorroclabIo - Non IalaI
CompIolion Aborl UncorroclabIo - Non IalaI
Unoxpoclod CompIolion UncorroclabIo - Non IalaI
MaIformod TII UncorroclabIo - IalaI
PCI Express System Architecture
390
Root CompIex Error Tracking and Reporting
Tlo Rool CompIox is llo largol of aII Irror Mossagos issuod by dovicos villin
llo ICI Ixpross fabric. Irrors rocoivod by llo Rool CompIox rosuIl in slalus rog-
islors boing updalod and llo orror boing condilionaIIy roporlod lo llo appropri-
alo soflvaro landIor or landIors.
Root CompIex Error Status Registers
Wlon llo Rool CompIox rocoivos an Irror Mossago, il sols slalus bils villin llo
Rool Irror Slalus rogislor (Iiguro 10-21 on pago 391). Tlis rogislor indicalos llo
lypos of orrors rocoivod and aIso indicalos vlon muIlipIo orrors of llo samo
lypo lavo boon rocoivod. Nolo llal an orror doloclod al llo rool porl is lroalod as
if llo porl sonl ilsoIf an Irror Mossago.
Tlo Advancod Rool Irror Slalus rogislor lracIs llo occurronco of orrors as foI-
Iovs:
-
- Sols llo Rocoivod CorroclabIo Irror bil upon rocoipl of llo firsl IRR_COR
Mossago, or doloclion of a rool porl corroclabIo orror.
- Sols llo MuIlipIo CorroclabIo Irror Mossago Rocoivod bil upon rocoipl of
an IRR_COR Mossago, or doloclion of a rool porl corroclabIo orror vlon
llo Rocoivod CorroclabIo Irror bil is aIroady sol.
U -
- Sols llo Rocoivod UncorroclabIo Irror bil upon rocoipl of llo firsl
IRR_IATAI or IRR_NONIATAI Irror Mossago, or doloclion of a rool porl
uncorroclabIo orror.
- Sol llo MuIlipIo UncorroclabIo Irror Mossago Rocoivod bil upon rocoipl
of an IRR_IATAI or IRR_NONIATAI Mossago, or doloclion of a rool porl
corroclabIo orror vlon llo Rocoivod UncorroclabIo Irror bil is aIroady
sol.
- -- -
If llo syslom vislos lo impIomonl soparalo soflvaro orror landIors for Corrocl-
abIo, Non-IalaI, and IalaI orrors. Tlo Rool Irror Slalus rogislor incIudos bils lo
difforonlialo CorroclabIo from UncorroclabIo Irrors bul noods addilionaI bils lo
aIso dolormino vlollor UncorroclabIo orrors aro falaI or non-falaI:
Chapter 10: Error Detection and Handling
391
- If llo firsl UncorroclabIo Irror Mossago rocoivod is IATAI llo Iirsl Uncor-
roclabIo IalaI bil is aIso sol aIong vill llo IalaI Irror Mossago Rocoivod
bil.
- If llo firsl UncorroclabIo Irror Mossago rocoivod is NONIATAI llo Non-
IalaI Irror Mossago Rocoivod bil is sol. (If a subsoquonl UncorroclabIo
Irror is IalaI, llo IalaI Irror Mossago Rocoivod bil viII bo sol, bul
bocauso llo Iirsl UncorroclabIo IalaI romains cIoarod, soflvaro Inovs
llal llo firsl UncorroclabIo Irror rocoivod vas Non-IalaI.)
Advanced Source ID Register
Soflvaro orror landIors may nood lo road and cIoar orror slalus rogislors villin
llo dovico llal doloclod and roporlod llo orror. Tlo Irror Mossagos conlain llo
ID of llo dovico roporling llo orror. Tlo Sourco ID rogislor capluros llo Irror
Mossago ID associalod vill llo firsl IalaI and firsl Non-IalaI Irror mossago
rocoivod by llo Rool CompIox. Tlo formal of llis rogislor is slovn in Iiguro 10-
22 on pago 391.
- -
-
PCI Express System Architecture
392
Root Error Command Register
Tlo Rool Irror Slalus rogislor sols slalus bils llal dolorminos vlollor a Corrocl-
abIo, IalaI, or Non-IalaI orror las occurrod. In conjunclion vill lloso slalus bils
llo Rool CompIox can aIso gonoralo soparalo inlorrupls llal caII landIors for
oacl of llo orror calogorios. Tlo Rool Irror Command rogislor onabIos inlorrupl
gonoralion for aII llroo calogorios as piclurod in Iiguro 10-23 on pago 392.
Reporting Errors to the Host System
Soflvaro orror landIors viII iniliaIIy road Rool CompIox slalus rogislors lo
dolormino llo naluro of llo orror, and may aIso nood lo road dovico-spocific
orror rogislors of llo dovico llal roporlod llo orror.
Summary of Error Logging and Reporting
Tlo aclions laIon by a funclion vlon an orror is doloclod is govornod by llo
lypo of orror and llo sollings of llo orror-roIalod configuralion rogislors. Tlo
spocificalion incIudos llo fIov clarl in Iiguro 10-24 on pago 393 llal spocifios
llo aclions laIon by a dovico upon dolocling an orror. Tlis fIov clarl prosumos
llal ICI Ixpross compalibIo soflvaro is boing usod and doos nol covor llo caso
of orror landIing vlon onIy Iogacy ICI soflvaro is usod.
-
Chapter 10: Error Detection and Handling
393

Iarl Tlroo
Tlo IlysicaI Iayor
397
-

The Previous Chapter

Tlo provious claplor discussod boll corroclabIo and non-corroclabIo orrors and
llo moclanisms usod lo Iog and roporl llom. Irior lo discussing llo ICI
Ixpross orror roporling capabiIilios, a briof roviov of llo ICI orror landIing vas
incIudod as bacIground informalion.
This Chapter
Tlis claplor doscribos llo IogicaI claraclorislics of llo IlysicaI Iayor coro
Iogic. Il doscribos lov an oulbound pacIol is procossod boforo cIocIing llo
pacIol oul difforonliaIIy. Tlo claplor aIso doscribos lov an inbound pacIol
arriving from llo IinI is procossod and sonl lo llo Dala IinI Iayor. Tlo claplor
doscribos sub-bIocI funclions of llo IlysicaI Iayor sucl as Bylo Slriping and
Un-Slriping Iogic, ScrambIor and Do-ScrambIor, 8b/10b Incodor and Docodor,
IIaslic Buffors and moro.
The Next Chapter
Tlo noxl claplor doscribos llo oIoclricaI claraclorislics of llo IlysicaI Iayor. Il
doscribos llo anaIog claraclorislics of llo difforonliaI drivors and rocoivors llal
connocl a ICI Ixpross dovico lo llo IinI.
PhysicaI Layer Overview
Tlo IlysicaI Iayor slovn in Iiguro 11-1 on pago 398 connocls lo llo IinI on
ono sido and inlorfacos lo llo Dala IinI Iayor on llo ollor sido. Tlo IlysicaI
Iayor procossos oulbound pacIols boforo lransmission lo llo IinI and pro-
cossos inbound pacIols rocoivod from llo IinI. Tlo lvo soclions of llo IlysicaI
Iayor associalod vill lransmission and rocoplion of pacIols aro roforrod lo as
llo lransmil Iogic and llo rocoivo Iogic llrougloul llis claplor.
PCI Express System Architecture
398
Tlo lransmil Iogic of llo IlysicaI Iayor ossonliaIIy procossos pacIols arriving
from llo Dala IinI Iayor, llon convorls llom inlo a soriaI bil slroam. Tlo bil
slroam is cIocIod oul al 2.5 Gbils/s/Iano onlo llo IinI.
Tlo rocoivo Iogic cIocIs in a soriaI bil slroam arriving on llo Ianos of llo IinI
vill a cIocI llal is rocovorod from llo incoming bil slroam. Tlo rocoivo Iogic
convorls llo soriaI bil sloam inlo a paraIIoI symboI slroam, procossos llo incom-
ing symboIs, assombIos pacIols and sonds llom lo llo Dala IinI Iayor.
In llo fuluro, dala ralos por Iano aro oxpoclod lo go lo 5 Gbils/s, 10 Gbils/s and
boyond. Wlon llis lappons, an oxisling dosign can bo adaplod lo llo liglor
dala ralos by rodosigning llo IlysicaI Iayor vliIo maximizing rouso of llo
Dala IinI Iayor, Transaclion Iayor and Dovico Coro/Soflvaro Iayor. Tlo Ilys-
-
Port
Link
Memory, I/O, Configuration R/W Requests or Message Requests or Completions
(Software layer sends / receives address/transaction type/data/message index)
Software layer
Transaction layer
Header Data Payload ECRC
Receive
Buffers
per VC
Transmit
Buffers
per VC
Data Link layer
Physical layer
Serial-to-Parallel Parallel-to-Serial
Differential Receiver Differential Driver
Link Packet Start End Link Packet Start End
Decode Encode
Transaction Layer Packet (TLP)
TLP Error
Check
TLP Replay
Buffer
Physical Packet Physical Packet
Link Packet
Sequence TLP LCRC ACK/NAK
DLLPs e.g.
CRC
Header Data Payload ECRC
Transaction Layer Packet (TLP)
Link Packet
Sequence TLP LCRC
De-mux
Mux
Transmit Receive
Flow Control
Virtual Channel
Management
Ordering
Link
Training
ACK/NAK
DLLPs
CRC
Chapter 11: Physical Layer Logic
399
icaI Iayor may bo dosignod as a slandaIono onlily soparalo from llo Dala IinI
Iayor and Transaclion Iayor. Tlis aIIovs a dosign lo bo migralod lo liglor dala
ralos or ovon lo an oplicaI impIomonlalion if sucl a IlysicaI Iayor is supporlod
in llo fuluro.
Tvo sub-bIocIs maIo up llo IlysicaI Iayor. Tloso aro llo IogicaI IlysicaI
Iayor and llo oIoclricaI IlysicaI Iayor as slovn in Iiguro 11-2. Tlis claplor
doscribos llo IogicaI sub-bIocI, and llo noxl claplor doscribos llo oIoclricaI sub-
bIocI. Boll sub-bIocIs aro spIil inlo lransmil Iogic and rocoivo Iogic (indopon-
donl of oacl ollor) vlicl aIIov duaI simpIox communicalion.
- -
Logical
Electrical
Physical Layer
Logical
Electrical
Physical Layer
Link
C
TX
C
TX
Tx
Tx
Tx
Tx
Rx
Rx
Rx
Rx
Tx+ Tx+ Tx- Tx- Rx+ Rx- Rx- Rx+
PCI Express System Architecture
400
DiscIaimer
To faciIilalo doscriplion of llo IlysicaI Iayor funclionaIily, an oxampIo impIo-
monlalion is doscribod llal is nol nocossariIy llo impIomonlalion assumod by
llo spocificalion nor is a dosignor compoIIod lo impIomonl a IlysicaI Iayor in
sucl a mannor. A dosignor may impIomonl llo IlysicaI Iayor in any mannor
llal is compIianl vill llo funclionaIily oxpoclod by llo ICI Ixpross spocifica-
lion.
Transmit Logic Overview
Iiguro 11-3 on pago 401 slovs llo oIomonls llal maIo up llo lransmil Iogic:
- a muIlipIoxor (mux),
- bylo slriping Iogic (onIy nocossary if llo IinI impIomonls moro llan ono
dala Iano),
- scrambIors,
- 8b/10b oncodors,
- and paraIIoI-lo-soriaI convorlors.
TIIs and DIIIs from llo Dala IinI Iayor aro cIocIod inlo a Tx (lransmil)
Buffor. Will llo aid of a muIlipIoxor, llo IlysicaI Iayor framos llo TIIs or
DIIIs vill Slarl and Ind claraclors. Tloso claraclors aro framing symboIs
vlicl llo rocoivor dovico usos lo dolocl slarl and ond of pacIol.
Tlo framod pacIol is sonl lo llo vlicl muIlipIoxos llo
bylos of llo pacIol onlo llo Ianos. Ono bylo of llo pacIol is lransforrod on ono
Iano, llo noxl bylo on llo noxl Iano and so on for llo avaiIabIo Ianos.
Tlo usos an aIgorillm lo psoudo-randomIy scrambIo oacl bylo of
llo pacIol. Tlo Slarl and Ind framing bylos aro nol scrambIod. ScrambIing
oIiminalos ropolilivo pallorns in llo bil slroam. Ropolilivo pallorns rosuIl in
Iargo amounls of onorgy conconlralod in discrolo froquoncios vlicl Ioads lo sig-
nificanl IMI noiso gonoralion. ScrambIing sproads onorgy ovor a froquoncy
rango, lonco minimizing avorago IMI noiso gonoralod.
Tlo scrambIod 8-bil claraclors (8b claraclors) aro oncodod inlo 10-bil symboIs
(10b symboIs) by llo Iogic. And yos, lloro is a 25 Ioss in lrans-
mission porformanco duo lo llo oxpansion of oacl bylo inlo a 10-bil claraclor. A
is dofinod as llo 8-bil un-oncodod bylo of a pacIol. A is
dofinod as llo 10-bil oncodod oquivaIonl of llo 8-bil claraclor. Tlo purposo of
Chapter 11: Physical Layer Logic
401
8b/10b Incoding llo pacIol claraclors is primariIy lo croalo sufficionl 1-lo-0
and 0-lo-1 lransilion donsily in llo bil slroam so llal llo rocoivor can ro-croalo a
rocoivo cIocI vill llo aid of a - . Nolo llal llo
cIocI usod lo cIocI llo soriaI dala bil slroam oul of llo lransmillor is nol ilsoIf
lransmillod onlo llo viro. Rallor, llo rocoivo cIocI is usod lo cIocI in an
inbound pacIol.
Tlo 10b symboIs aro convorlod lo a soriaI bil slroam by llo
. Tlis Iogic usos a 2.5 GHz cIocI lo soriaIIy cIocI llo pacIols oul on
oacl Iano. Tlo soriaI bil slroam is sonl lo llo oIoclricaI sub-bIocI vlicl
-- llo pacIol onlo oacl Iano of llo IinI.
- -
Tx
Buffer
8
8
Scrambler
8b/10b
Encoder
Parallel-to-Serial
Byte Striping
Scrambler
8b/10b
Encoder
Parallel-to-Serial
Lane 1, ..,N-1
Tx Clk
Lane 0 Lane N Lane 1, ..,N-1
8
8
8
8
10
8
8
10
Transmit
From Data Link Layer
Control
Control
Mux
START/END/
IDLE/PAD
Code
Tx Tx
Tx Local
PLL
Control
Lane N (N=0,1,3,7,11,15, 31) Lane 0
Receive
To Data Link Layer
Rx Rx
Lane 0 Lane N Lane 1, ..,N-1
Serial-to-Parallel
and Elastic Buffer
Serial-to-Parallel
and Elastic Buffer
Rx
Buffer
De-Scrambler
8b/10b
Decoder
Byte Un-Striping
De-Scrambler
Lane 0 Lane N (N=0,1,3,7,11,15,31)
Lane 1, ..,N-1
8
8
8
8
8
8
Control
10 10
8
Control
START / END / IDLE / PAD Character Removal and
Packet Alignment Check
Error
Detect
8b/10b
Decoder
Error
Detect
Rx Local
PLL
Rx Clk Rx Clk
D/K#
D/K#
D/K#
D/K#
D/K#
D/K#
D/K#
D/K#
D/K#
D/K#
Throttle
PCI Express System Architecture
402
Receive Logic Overview
Iiguro 11-3 slovs llo oIomonls llal maIo up llo rocoivor Iogic:
- rocoivo III,
- soriaI-lo-paraIIoI convorlor,
- oIaslic buffor,
- 8b/10b docodor,
- do-scrambIor,
- bylo un-slriping Iogic (onIy nocossary if llo IinI impIomonls moro llan ono
dala Iano),
- conlroI claraclor romovaI circuil,
- and a pacIol rocoivo buffor.
As llo dala bil slroam is rocoivod, llo is synclronizod lo llo cIocI
froquoncy vill vlicl llo pacIol vas cIocIod oul of llo romolo lransmillor
dovico. Tlo lransilions in llo incoming soriaI bil slroam aro usod lo ro-synclro-
nizo llo III circuilry and mainlain bil and symboI IocI vliIo gonoraling a
cIocI rocovorod from llo dala bil slroam. Tlo soriaI-lo-paraIIoI convorlor is
cIocIod by llo rocovorod cIocI and oulpuls 10b symboIs.
Tlo 10b symboIs aro cIocIod inlo llo - using llo rocovorod cIocI
associalod vill llo rocoivor III. Tlo IIaslic Buffor is usod for cIocI loIoranco
componsalion, i.o. llo IIaslic Buffor is usod lo adjusl for minor cIocI froquoncy
varialion bolvoon llo rocovorod cIocI usod lo cIocI llo incoming bil slroam
inlo llo IIaslic Buffor and llo IocaIIy-gonoralod cIocI associalod llal is usod lo
cIocI dala oul of llo IIaslic Buffor.
Tlo 10b symboIs aro convorlod bacI lo 8b claraclors by llo .
Tlo Slarl and Ind claraclors llal framo a pacIol aro oIiminalod. Tlo 8b/10b
Docodor aIso IooIs for orrors in llo incoming 10b symboIs. Ior oxampIo, orror
doloclion Iogic can clocI for invaIid 10b symboIs or dolocl a missing Slarl or
Ind claraclor.
Tlo roproducos llo do-scrambIod pacIol slroam from llo incom-
ing scrambIod pacIol slroam. Tlo Do-ScrambIor impIomonls llo invorso of llo
aIgorillm impIomonlod in llo lransmillor ScrambIor.
Tlo bylos from oacl Iano aro - lo form a soriaI bylo slroam llal is
Ioadod inlo llo lo food lo llo Dala IinI Iayor.
Chapter 11: Physical Layer Logic
403
PhysicaI Layer Link Active State Power Management
Tlo fuII-on povor slalo of llo IlysicaI Iayor and IinI is caIIod llo I0 slalo.
Dovicos supporl lvo Iovor povor slalos, I0s (I0 suspond) and I1 Aclivo llal
aro aclivoIy and aulomalicaIIy managod by llo IlysicaI Iayor. I1 Aclivo povor
slalo is a Iovor povor slalo llan I0s and is oplionaIIy supporlod. Tlo I0s
povor slalo is managod by llo IlysicaI Iayor. Tlo I1 Aclivo povor slalo is
managod by a combinalion of Dala IinI Iayor and IlysicaI Iayor.
A IinI can bo pIacod in llo I0s povor slalo in ono diroclion indopondonl of llo
ollor diroclion vliIo a IinI in llo I1 Aclivo povor slalo is in llis slalo in boll
diroclions.
Soflvaro onabIos supporl of llo I0s and I1 Aclivo povor slalos via configura-
lion rogislors. Aflor rosol, lloso rogislors aro in a slalo llal disabIos Iovor povor
slalo funclionaIily. Tlo IlysicaI Iayor aulomalicaIIy managos onloring lloso
Iovor povor slalos upon doloclion of a poriod of inaclivily on llo IinI. Onco a
dovico is in I0s or I1 Aclivo and il inlonds lo lransmil pacIols, il can lransilion
ils IinI povor slalo bacI lo I0. Tlo oxil Ialoncy from I1 Aclivo is groalor llan
llo oxil Ialoncy from I0s.
AddilionaI dolaiIs on IinI Aclivo Slalo Iovor Managomonl aro covorod in
IinI Training and Slalus Slalo Maclino (ITSSM) on pago 508 on IinI Train-
ing and IinI Aclivo Slalo Iovor Managomonl on pago 608.
Link Training and InitiaIization
Tlo IlysicaI Iayor is rosponsibIo for llo IinI IniliaIizalion and Training. Tlo
procoss is doscribod in IinI IniliaIizalion and Training Ovorviov on
pago 500.
Transmit Logic DetaiIs
Iiguro 11-4 on pago 406 slovs llo lransmil Iogic of llo IogicaI IlysicaI Iayor.
Tlis soclion doscribos pacIol procossing from llo limo pacIols aro rocoivod
from llo Dala IinI Iayor unliI llo pacIol is cIocIod oul of llo IlysicaI Iayor
onlo llo IinI.
PCI Express System Architecture
404
Tx Buffer
Tlo Tx Buffor rocoivos TIIs and DIIIs from llo Dala IinI Iayor. AIong vill
llo pacIols, llo Dala IinI Iayor indicalos llo slarl and ond of llo pacIol using
a ConlroI signaI so llal llo IlysicaI Iayor can appond Slarl and Ind framing
claraclors lo llo pacIol. Tlo Tx Buffor usos a llrollIo signaI lo llrollIo llo fIov
of pacIols from llo Dala IinI Iayor in caso llo Tx Buffor fiIIs up.
MuItipIexer (Mux) and Mux ControI Logic
GeneraI
Tlo Mux slovn in Iiguro 11-5 on pago 407 primariIy galos pacIol claraclors
from llo Tx Buffor lo llo Bylo Slriping Iogic (onIy nocossary if llo IinI impIo-
monls moro llan ono dala Iano). Hovovor, undor corlain circumslancos, llo
Mux may galo ollor inpuls lo llo Bylo Slriping Iogic. Horo is a summary of llo
four Mux inpuls and vlon lloy aro galod:
- - . Wlon llo Dala IinI Iayor suppIios a pacIol lo bo
lransmillod, llo Mux galos llo pacIols claraclor slroam llrougl lo llo
Bylo Slriping Iogic. Claraclors villin llo Tx Buffor aro Dala or D clarac-
lors. Honco llo D/K# signaI is drivon Higl vlon Tx Buffor conlonls aro
galod. Soo Dofinilion of Claraclors and SymboIs on pago 405.
- - Tloso ConlroI claraclors aro appondod lo llo
slarl and ond of ovory TII and DIII as slovn in Iiguro 11-6 on pago 408.
Tloso framing claraclors aIIov a rocoivor lo oasiIy dolocl llo slarl and ond
of a pacIol. Tloro aro lvo lypos of Slarl claraclors, ono is llo slarl TII clar-
aclor (STI) and llo ollor is llo slarl DIII claraclor (SDI). Tloro aro lvo
lypos of ond claraclors, llo Ind Good TII or DIII claraclor (IND), and
llo Ind Bad TII claraclor (IDB). Soo TabIo 11-5 on pago 432 for a Iisl of
ConlroI claraclors. A conlroI signaI from llo Dala IinI Iayor in combina-
lion vill llo pacIol lypo dolormino vlal lypo of framing claraclor lo galo.
Slarl and Ind claraclors aro ConlroI or K claraclors, lonco llo D/K# sig-
naI is drivon Iov vlon llo Slarl and Ind claraclors aro galod oul al llo
slarl and ond of a pacIol, rospoclivoIy.
Chapter 11: Physical Layer Logic
405
- -. Ordorod-Sols aro muIlipIos of 4 claraclor soquoncos llal
slarls vill a comma (COM) conlroI claraclor foIIovod by ollor claraclors.
Tloy aro lransmillod during spociaI ovonls as doscribod boIov:
During IinI lraining, ( )
- aro lransmillod ovor llo IinI. IinI lraining occurs aflor
fundamonlaI rosol, lol rosol, or aflor corlain orror condilions occur.
Rofor lo Ordorod-Sols Usod During IinI Training and IniliaIizalion
on pago 504 for dolaiIod usago of TS1 and TS2 Ordorod-Sols.
Al poriodic inlorvaIs, llo Mux galos llo pallorn
llrougl lo llo Bylo Slriping Iogic lo faciIilalo cIocI loIoranco componsa-
lion in llo rocoivor circuil of llo porl al llo ollor ond of llo IinI. Ior a
dolaiIod doscriplion, rofor lo Insorling CIocI Componsalion Zonos on
pago 436 and Rocoivor CIocI Componsalion Iogic on pago 442.
Wlon a dovico vanls lo pIaco ils lransmillor in llo oIoclricaI IdIo slalo, il
musl inform llo romolo rocoivor al llo ollor ond of llo IinI. Tlo dovico
galos an lo do so.
Wlon a dovico vanls lo clango llo IinI povor slalo from I0s Iov
povor slalo lo llo I0 fuII-on povor slalo, il lransmils -
- lo llo rocoivor. Tlo rocoivor usos llis
Ordorod-Sol lo ro-synclronizo ils III lo llo lransmillor cIocI.
- Ordorod-Sols bogin vill a K claraclor and, doponding on llo lypo of sol,
may conlain D or K claraclors. Honco, during lransmission of an Ordorod-
Sol, llo D/K# signaI is drivon Iov for a cIocI and llon may bo drivon Higl
or Iov lloro aflor.
- Wlon lloro aro no pacIols lo lransmil on llo IinI
(roforrod lo as IogicaI IdIo IinI), rallor llan Ioavo llo IinI in a fIoaling
slalo or drivo nolling, IogicaI IdIo claraclors aro galod. Doing so guaranloos
signaI lransilions on llo IinI llus aIIoving llo rocoivors III lo mainlain
cIocI synclronizalion vill llo lransmil cIocI. In addilion, llo rocoivor is
abIo lo mainlain bil and symboI IocI. Tlo IogicaI IdIo soquonco consisls of
lransmilling 00l claraclors. Il lloroforo consisls of D lypo claraclors, lonco,
llo D/K# signaI is ligl vliIo llo Mux is galing IogicaI IdIo soquoncos.
Definition of Characters and SymboIs
Iacl claraclor is 8-bils in sizo. Tloy can bo groupod inlo lvo calogorios, Con-
lroI or K claraclors, and Dala or D claraclors. Irom llo slandpoinl of 8b/10b
Incoding, D claraclors aro oncodod inlo a difforonl 10-bil symboI llan K clar-
aclors of llo samo 8-bil vaIuo. Iacl 10-bil oncodod claraclor is roforrod lo as a
symboI.
PCI Express System Architecture
406
- - -
Tx
Buffer
8
8
Scrambler
8b/10b
Encoder
Parallel-to-Serial
Byte Striping
Scrambler
8b/10b
Encoder
Parallel-to-Serial
Lane 1, ..,N-1
Tx Clk
Lane 0 Lane N Lane 1, ..,N-1
8
8
8
8
10
8
8
10
Transmit
From Data Link Layer
Control
Control
Mux
START/END/
IDLE/PAD
Code
Tx Tx
Tx Local
PLL
Control
Lane N (N=0,1,3,7,11,15,31) Lane 0
D/K#
D/K#
D/K#
D/K#
D/K#
Throttle
Chapter 11: Physical Layer Logic
407
-
Lane 0
Tx
Buffer
8
8
Scrambler
8b/10b
Encoder
Parallel-to-Serial
Byte Striping
Scrambler
8b/10b
Encoder
Parallel-to-Serial
Lane 1, ..,N-1
Tx Clk
Lane N Lane 1, ..,N-1
8
8
8
8
10
8
8
10
Transmit
From Data Link Layer
Control
Control
Mux
START/END/
IDLE/PAD
Code
Tx Tx
Tx Local
PLL
Control
Lane N (N=0,1,3,7,11,15,31) Lane 0
D/K#
D/K#
D/K#
D/K#
D/K#
Throttle
Mux
Tx
Buffer
8
8
Throttle
Control
TLP or
DLLP
STP, SDP,
END, EDB
8 8
8
D/K#
Logical Idle
Sequence
8
Link Training/
Mux Control
TS1,TS2,SKIP,
Electrical Idle,
and FTS
Ordered-Set
D D K K
PCI Express System Architecture
408
Byte Striping (OptionaI)
Wlon a porl impIomonls moro llan ono dala Iano (i.o., moro llan ono soriaI
dala pall on llo oxlornaI IinI), llo pacIol dala is slripod across llo 2, 4, 8, 12,
16, or 32 Ianos by llo Bylo Slriping Iogic. Slriping moans llal oacl consoculivo
oulbound claraclor in a claraclor slroam is muIlipIoxod onlo llo consoculivo
Ianos. IxampIos of Bylo Slriping aro iIIuslralod in Iiguro 11-7 on pago 409, Iig-
uro 11-8 on pago 410, Iiguro 11-9 on pago 411. Tlo numbor of Ianos usod is con-
figurod during llo IinI lraining procoss.
- Tlis oxampIo assumos llal llo Bylo Slriping Iogic is impIomonlod
boforo llo ScrambIor and 8b/10b Incodor. Ivory Iano impIomonls a ScrambIor
and an 8b/10b Incodor. Tlis pormils a rocoivor IlysicaI Iayor lo dolocl orrors
on any Iano indopondonl of llo ollor Ianos. Ior oxampIo, an orror llal may
lavo occurrod in llo lransmillor ScrambIor or 8b/10b Incodor is doloclabIo if a
rocoivor dolocls an invaIid 10b claraclor on a givon Iano. Wlon an orror is
doloclod on a Iano and cannol bo cIoarod, llo Iano couId bo disabIod and llo
IinI ro-lrainod and ro-iniliaIizod vill fovor Ianos. Tlis orror rocovory foaluro
is suggoslod and nol roquirod by spocificalion.
-
Header Data Payload ECRC
Transaction Layer Packet (TLP)
Sequence LCRC
DLLP Type CRC
Data Link Layer Packet (DLLP)
Misc. SDP END
STP END
K Character
K Character
K Character
K Character
D Character
D Character
Chapter 11: Physical Layer Logic
409
On llo ollor land, lo simpIify and roduco llo sizo of llo IlysicaI Iayor Iogic, a
dosignor may clooso lo pIaco llo Bylo Slriping Iogic aflor llo ScrambIor and
8b/10b Incodor bul boforo llo IaraIIoI-lo-SoriaI convorlor. Tlis roducos llo
numbor of ScrambIors and 8b/10b Incodors lo ono. If llo rocoivor dolocls an
orror in llo incoming bil slroam lovovor, il cannol isoIalo llo orror lo a parlicu-
Iar Iano.

Character 7
Character 6
Character 5
Character 4
Character 3
Character 2
Character 1
Character 0
D/K#
Character 2
Character 1
Character 0
x1 Byte Striping
D/K#
8
8
8
To Scrambler
Packet byte stream from Mux block
D/K#
PCI Express System Architecture
410

Character 0
Character 1
Character 2
Character 3
Character 4
Character 5
Character 6
Character 7
Character 1
Character 5
Character 9
x4 Byte Striping
Character 2
Character 6
Character 10
Character 0
Character 4
Character 8
Character 3
Character 7
Character 11
Packet byte stream from Mux block
D/K#
To Lane 0
Scrambler
To Lane 1
Scrambler
To Lane 2
Scrambler
To Lane 3
Scrambler
8
8 8 8 8
D/K# D/K# D/K# D/K#
Chapter 11: Physical Layer Logic
411
Packet Format RuIes
Aflor passing llrougl llo Bylo Slriping Iogic, a TII or DIII claraclor slroam
is slripod across llo Ianos. Tlis soclion doscribos llo ruIos usod lo bylo slripo
pacIols so llal llo pacIols aro corroclIy slripod across llo Ianos of llo IinI.
- Tlo foIIoving aro llo gonoraI pacIol for-
mal ruIos:
- Tlo lolaI pacIol Iongll (incIuding Slarl and Ind claraclors) of oacl
pacIol musl bo a muIlipIo of four claraclors.
- TIIs aIvays slarl vill llo STI claraclor.
- DIIIs aIvays slarl vill SDI and aro 8 claraclors Iong (6 claraclors +
SDI + IND)

Character 0
Character 1
Character 2
Character 3
Character 4
Character 5
Character 6
Character 7
Character 1
Character 9
Character 17
x8 Byte Striping
Character 0
Character 8
Character 16
Character 7
Character 15
Character 23
Packet byte stream from Mux block
D/K#
To Lane 0
Scrambler
To Lane 1
Scrambler
To Lane 7(or 11/15/31)
Scrambler
D/K# D/K# D/K#
8
8 8 8
PCI Express System Architecture
412
- AII TIIs lorminalo vill oillor an IND or IDB claraclor.
- DIIIs lorminalo vill llo IND claraclor.
- STI and SDI claraclors musl bo pIacod on Iano 0 vlon slarling llo
lransmission of a pacIol aflor llo lransmission of IogicaI IdIos. If nol
slarling a pacIol lransmission from IogicaI IdIo (i.o. bacI-lo-bacI lrans-
mission of pacIols), llon STI and SDI musl slarl on a Iano numbor
divisibIo by 4.
- Any vioIalion of lloso ruIos may bo roporlod as a Rocoivor Irror lo llo
Dala IinI Iayor.
Iiguro 11-10 on pago 413 iIIuslralos llo for-
mal of pacIols lransmillod ovor a x1 IinI (i.o., a IinI vill onIy ono Iano
oporalionaI). Tlo iIIuslralion slovs llo foIIoving soquonco of pacIols:
1. Ono TII.
2. Ono 8-bylo DIII.
3. Ono cIocI componsalion pacIol consisling of a SKII Ordorod-Sol (i.o., a
COM foIIovod by llroo SKI claraclors).
4. Tvo TIIs.
5. Ono 8-bylo DIII.
6. Ono TII.
7. A IIov ConlroI IacIol.
8. IogicaI IdIos lransmillod bocauso lloro aro no moro pacIols lo lransmil.
- Tlo foIIoving ruIos appIy vlon a pacIol is
lransmillod ovor a x4 IinI (i.o., a IinI vill four Ianos):
- STI and SDI claraclors aro aIvays lransmillod on Iano 0.
- IND and IDB claraclors aro aIvays lransmillod on Iano 3.
- Wlon an Ordorod-Sol sucl as llo SKII Ordorod-Sol is lransmillod (for
cIocI componsalion in llo rocoivor), il musl bo sonl on aII four Ianos
simuIlanoousIy.
- Wlon IogicaI IdIo soquoncos aro lransmillod, lloy musl bo lransmillod
on aII Ianos.
- Any vioIalion of lloso ruIos may bo roporlod as a Rocoivor Irror lo llo
Dala IinI Iayor.
Iiguro 11-11 on pago 414 iIIuslralos llo for-
mal of pacIols lransmillod ovor a x4 IinI (i.o., a IinI vill four dala Ianos
oporalionaI). Tlo iIIuslralion slovs llo foIIoving soquonco of pacIols:
1. Ono TII.
2. A SKII Ordorod-Sol lransmillod on aII Ianos for poriodic rocoivor cIocI
componsalion.
Chapter 11: Physical Layer Logic
413
3. A DIII.
4. IogicaI IdIos on aII Ianos bocauso lloro aro no moro pacIols lo lrans-
mil.
- Tlo foIIoving ruIos appIy
vlon a pacIol is lransmillod ovor a x8, x12, x16, or x32 IinI:
- STI/SDI claraclors aro aIvays lransmillod on Iano 0 vlon lransmis-
sion slarls aflor a poriod during vlicl IogicaI IdIos aro lransmillod.
- STI/SDI claraclors may onIy bo lransmillod on Iano numbors divisi-
bIo by 4 vlon lransmilling bacI-lo-bacI pacIols.
- IND/IDB claraclors aro lransmillod on Iano numbors divisibIo by 4
Ioss 1.
- If a pacIol doosnl ond on llo Iasl Iano and lloro aro no moro pacIol
lransmissions, IAD symboIs aro lransmillod on llo Ianos abovo llo
Iano on vlicl llo IND/IDB claraclor is lransmillod. Tlis Ioops llo
IinI aIignod so llal lransmission of llo IogicaI IdIo soquonco can slarl
on aII Ianos al llo samo limo.

Lane
0
STP
TLP
END
SDP
DLLP
END
COM
SKP
SKP
SKP
STP
END
TLP
IDLE
IDLE
IDLE
IDLE
STP
END
TLP
STP
TLP
END
SDP
DLLP
END
PCI Express System Architecture
414
- Wlon an Ordorod-Sol sucl as llo SKII Ordorod-Sol is lransmillod (for
cIocI componsalion in llo rocoivor), il musl bo sonl on aII four Ianos
simuIlanoousIy.
- Wlon IogicaI IdIo soquoncos aro lransmillod, lloy musl bo lransmillod
on aII Ianos.
- Any vioIalion of lloso ruIos may bo roporlod as a Rocoivor Irror lo llo
Dala IinI Iayor.

Note: There are no PAD characters to transmit on
a x4 Link because all packets are multiples of 4 Bytes
SKIP Ordered-Set
Logical Idle
Lane
0
Lane
1
Lane
2
Lane
3
STP SequenceSequence
COM
SKP
SKP
SKP
COM COM COM
SKP
SKP
SKP
SKP
SKP
SKP
SKP
SKP
SKP
LCRC
LCRC LCRC LCRC END
TLP
IDLE
IDLE
IDLE
IDLE
IDLE
IDLE
IDLE
IDLE
IDLE
IDLE
IDLE
IDLE
IDLE
IDLE
IDLE
IDLE
SDP
END
DLLP
Chapter 11: Physical Layer Logic
415
--
- - -
- -- - -

- -
-

- - -
- - ---
- - - - -

PAD characters are transmitted to maintain packet framing alignment
Lane
0
Lane
1
Lane
2
Lane
3
Lane
4
Lane
5
Lane
7
STP SequenceSequence
LCRC LCRC LCRC LCRC
END
TLP
COM
SKP
SKP
SKP
COM COM COM COM COM COM COM
SKP
SKP
SKP
SKP
SKP
SKP
SKP
SKP
SKP
SKP
SKP
SKP
SKP
SKP
SKP
SKP
SKP
SKP
SKP
SKP
SKP
STP SequenceSequence
LCRC
LCRC LCRC LCRC PAD PAD PAD PAD END
TLP
IDLE
IDLE
IDLE
IDLE
IDLE
IDLE
IDLE
IDLE
IDLE
IDLE
IDLE
IDLE
IDLE
IDLE
IDLE
IDLE
IDLE
IDLE
IDLE
IDLE
IDLE
IDLE
IDLE
IDLE
IDLE
IDLE
IDLE
IDLE
IDLE
IDLE
IDLE
IDLE
SDP
END
DLLP
PCI Express System Architecture
416
ScrambIer
Aflor bylo slriping, llo oulbound pacIols aro lransmillod across llo Ianos. As
slovn in Iiguro 11-4 on pago 406, oacl Iano in llo IlysicaI Iayor dosign incor-
poralos a ScrambIor.
Purpose of ScrambIing Outbound Transmission
Tlo ScrambIor oIiminalos gonoralion of ropolilivo pallorns on a lransmillod dala
slroam. As an oxampIo, vlon scrambIod, a slroam of 0s viII rosuIl in a psoudo-
random bil pallorn.
Ropolilivo pallorns rosuIl in Iargo amounl of onorgy conconlralod in discrolo fro-
quoncios vlicl rosuIls in significanl IMI noiso gonoralod. By scrambIing llo
lransmillod dala, ropolilivo pallornssucl as 10101010aro oIiminalod. As a
rosuIl, no singIo froquoncy compononl of llo signaI is lransmillod for significanl
poriods of limo. Tlus llo radialod IMI onorgy of a lransmission is sproad ovor a
rango in llo froquoncy spoclrum. Tlis loclniquo roforrod lo as sproad spoc-
lrum offoclivoIy vlilons llo froquoncy conlonl of a signaI and roducos llo
radialod povor al any parlicuIar froquoncy.
On a baro syslomboard vill llo viros of llo IinI un-slioIdod and ligl fro-
quoncy lransmission of 2.5 Gbils/s, IMI noiso gonoralion is significanl. Scram-
bIing maIos llo radialod povor from llo IinI offoclivoIy IooI IiIo vlilo noiso.
Tlis loIps mool ICC roquiromonls.
AIso, on a muIli-Iano IinI vill viros roulod in cIoso proximily, a scrambIod
lransmission on ono Iano gonoralos vlilo noiso vlicl doos nol inlorforo or cor-
roIalo vill anollor Ianos dala lransmission. Tlis spaliaI froquoncy do-corroIa-
lion or roduclion of crosslaII noiso assisls llo rocoivor on oacl Iano lo
dislinguisl llo dosirod signaI from llo bacIground vlilo noiso.
ScrambIer AIgorithm
Tlo ScrambIor in Iiguro 11-13 on pago 418 is impIomonlod vill a 16-bil Iinoar
IoodbacI Slifl Rogislors (IISR) llal impIomonls llo poIynomiaI:
G(x) = X
16
+ X
5
+ X
4
+ X
3
+1
Tlo IISR is cIocIod al llo bil lransfor ralo. Tlo IISR oulpul is soriaIIy cIocIod
inlo an 8-bil rogislor llal is XORod vill llo 8-bil claraclors lo form llo scram-
bIod dala.
Chapter 11: Physical Layer Logic
417
Tlo IISR bil ralo cIocI is 8 limos llo froquoncy (2GHz) of
llo bylo cIocI (250MHz) llal foods llo ScrambIor oulpul.
Some ScrambIer impIementation ruIes:
- On a muIli-Iano IinI impIomonlalion, ScrambIors associalod vill oacl
Iano musl oporalo in concorl, mainlaining llo samo simuIlanoous vaIuo in
oacl IISR.
- ScrambIing is appIiod lo D claraclors associalod vill TII and DIIIs,
incIuding llo IogicaI IdIo (00l) soquonco. D claraclors villin llo TS1 and
TS2 Ordorod-Sol aro nol scrambIod.
- K claraclors and claraclors villin Ordorod-Solssucl as TS1, TS2, SKII,
ITS and IIoclricaI IdIo Ordorod-Solsaro nol scrambIod. Tloso claraclors
bypass llo scrambIor Iogic.
- CompIianco Iallorn roIalod claraclors aro nol scrambIod.
- Wlon a COM claraclor oxils llo ScrambIor, (COM doos nol gol scrambIod)
il iniliaIizos llo IISR. Tlo iniliaIizod vaIuo of llo 16-bil IISR is IIIIl. Sim-
iIarIy on llo rocoivor sido, vlon a COM claraclor onlors llo Do-ScrambIor,
il is iniliaIizod.
- Will ono oxcoplion, llo IISR soriaIIy advancos oigll limos for ovory clar-
aclor (D or K claraclor) lransmission. Tlo IISR doos NOT advanco on SKI
claraclors associalod vill llo SKII Ordorod-Sol. Tlo roason llo IISR is nol
advancod for SKIs is bocauso a rocoivor of inbound pacIols may add or
doIolo SKI symboIs lo porform cIocI loIoranco componsalion. Clanging llo
numbor of claraclors in llo rocoivor from llo numbor of claraclors lrans-
millod viII causo llo vaIuo in llo rocoivor IISR lo Ioso synclronizalion
vill llo lransmillor IISR vaIuo. Ior a dolaiIod doscriplion, rofor lo Insorl-
ing CIocI Componsalion Zonos on pago 436 and Rocoivor CIocI Compon-
salion Iogic on pago 442.
- By dofauIl, ScrambIing is aIvays onabIod. AIllougl llo spocificalion doos
aIIov llo ScrambIor lo bo disabIod for losl and dobug purposos, il doos nol
provido a slandard soflvaro or configuralion rogislor-roIalod mollod lo
disabIo llo ScrambIor.
PCI Express System Architecture
418
DisabIing ScrambIing
- - - - -
- - - -
- - -
- - - - - -
- - -
- - - -
- -- -
- - - - -
- -
-- - - - -
- - - - -

X
0
X
1
X
2
X
3
X
4
X
12
X
13
X
14
X
15
k+7 k+6 k+5 k+4 k+3 k+2 k+1 k
k+7 k+6 k+5 k+4 k+3 k+2 k+1 k
Byte Clock
Scrambler Output Scr[k+7:k]
Operates at Bit Rate
(2 GHz)
Operates at Byte Rate
(250 MHz)
XOR XOR XOR XOR XOR XOR XOR XOR
H G F E D C B A
H G F E D C B A
XOR
[H,G,F,E,D,C,B,A] =
[H,G,F,E,D,C,B,A] XOR [Scr(k+7:k)]
X
5
XOR XOR
Chapter 11: Physical Layer Logic
419
8b/10b Encoding
GeneraI
Iacl Iano of a dovicos lransmillor impIomonls an 8-bil lo 10-bil Incodor llal
oncodos 8-bil dala or conlroI claraclors inlo 10-bil symboIs. Tlo coding sclomo
vas invonlod by IBM in 1982 and is documonlod in llo ANSI X3.230-1994 docu-
monl, cIauso 11 (and aIso IIII 802.3z, 36.2.4) and US Ialonl Numbor 4,486,739
onlilIod Bylo Orionlod DC BaIancod 8b/10b Iarlilionod BIocI Transmission
Codo. 8b/10b coding is nov vidoIy usod in arclilocluros sucl as Gigabil
Illornol, Iibro ClannoI, SorvorNol, IICON, IIII1394b, InfiniBand, olc.
Purpose of Encoding a Character Stream
Tlo primary purposo of llis sclomo is lo ombod a cIocI inlo llo soriaI bil
slroam lransmillod on aII Ianos. No cIocI is lloroforo lransmillod aIong vill
llo soriaI dala bil slroam. Tlis oIiminalos llo nood for a ligl froquoncy 2.5GHz
cIocI signaI on llo IinI vlicl vouId gonoralo significanl IMI noiso and vouId
bo a claIIongo lo roulo on a slandard IR4 board. IinI viro rouling bolvoon lvo
porls is mucl oasior givon llal lloro is no cIocI lo roulo, romoving llo nood lo
malcl cIocI Iongll lo Iano signaI lraco Ionglls. Tvo dovicos aro connoclod by
simpIy viring lloir Ianos logollor.
BoIov is a summary of llo - of 8b/10b oncoding sclomo:
- Croalos sufficionl 0-lo-1 and 1-lo-0 lransilion donsily
(i.o., signaI clangos) lo faciIilalo ro-croalion of llo rocoivo cIocI on llo
rocoivor ond using a III (by guaranlooing a Iimilod run Iongll of consocu-
livo onos or zoros). Tlo rocovorod rocoivo cIocI is usod lo cIocI inbound 10-
bil symboIs inlo an oIaslic buffor. Iiguro 11-14 on pago 420 iIIuslralos llo
oxampIo caso vloroin 00l is convorlod lo 1101000110b, vloro an 8-bil clar-
aclor vill no lransilions las 5 lransilions vlon convorlod lo a 10b symboI.
Tloso lransilions Ioop llo rocoivor III synclronizod lo llo lransmil circuil
cIocI:
Iimilod run Iongll moans llal llo oncoding sclomo onsuros llo signaI
Iino viII nol romain in a ligl or Iov slalo for an oxlondod poriod of
limo. Tlo run Iongll doos nol oxcood fivo consoculivo 1s or 0s.
1s and 0s aro cIocIod oul on llo rising-odgo of llo lransmil cIocI. Al llo
rocoivor, a III can rocroalo llo cIocI by syncing lo llo Ioading odgos of
1s and 0s.
Iimilod run Iongll onsuros minimum froquoncy drifl in llo rocoivors
III roIalivo lo llo IocaI cIocI in llo lransmil circuil.
PCI Express System Architecture
420
- Koops llo numbor of 1s and 0s lransmillod as cIoso lo oquaI as
possibIo, llus mainlaining DC baIanco on llo lransmillod bil slroam lo an
avorago of laIf llo signaI llrosloId voIlago. Tlis is vory imporlanl in capac-
ilivo- and lransformor-coupIod circuils.
Mainlains a baIanco bolvoon llo numbor of 1s and 0s on llo signaI Iino,
lloroby onsuring llal llo rocoivod signaI is froo of any DC compononl.
Tlis roducos llo possibiIily of inlor-bil inlorforonco. Inlor-bil inlorfor-
onco rosuIls from llo inabiIily of a signaI lo svilcl proporIy from ono
Iogic IovoI lo llo ollor bocauso llo Iano coupIing capacilor or inlrinsic
viro capacilanco is ovor-clargod.
- - Iormils llo oncoding of spociaI
conlroI (K) claraclors sucl as llo Slarl and Ind framing claraclors al llo
slarl and ond of TIIs and DIIIs.
- A socondary bonofil of llo oncoding sclomo is llal il faciI-
ilalos llo doloclion of mosl lransmission orrors. A rocoivor can clocI for
running disparily orrors, or llo rocoplion of invaIid symboIs. Via llo run-
ning disparily moclanism (soo Disparily on pago 423), llo dala bil slroam
lransmillod mainlains a baIanco of 1s and 0s. Tlo rocoivor clocIs llo diffor-
onco bolvoon llo lolaI numbor of 1s and 0s lransmillod sinco IinI iniliaIiza-
lion and onsuros llal il is as cIoso lo zoro as possibIo. If il isnl, a disparily
orror is doloclod and roporlod, impIying llal a lransmission orror occurrod.
Tlo - of 8b/10b oncoding sclomo is llal, duo lo llo oxpansion of
oacl 8-bil claraclor inlo a 10-bil symboI prior lo lransmission, llo acluaI lrans-
mission porformanco is dogradod by 2 or said anollor vay, llo lransmission
ovorload is incroasod by 25 (ovorylling good las a prico lag).

0
1 1 0 1 0 0 0 1 1 0
8b Value
00h
10b Encoded
Value
Chapter 11: Physical Layer Logic
421
Properties of 10-bit (10b) SymboIs
- Ior 10-bil symboI lransmissions, llo avorago numbor of 1s lransmillod ovor
limo is oquaI lo llo numbor of 0s lransmillod, no mallor vlal llo 8-bil clar-
aclor lo bo lransmillod is, i.o., llo symboI lransmission is DC baIancod.
- Tlo bil slroam novor conlains moro llan fivo conlinuous 1s or 0s (Iimilod-
run Iongll).
- Iacl 10-bil symboI conlains:
Iour 0s and six 1s (nol nocossariIy conliguous), or
Six 0s and four 1s (nol nocossariIy conliguous), or
Iivo 0s and fivo 1s (nol nocossariIy conliguous).
- Iacl 10-bil symboI is subdividod inlo lvo sub-bIocIs: llo firsl is six bils
vido and llo socond is four bils vido.
Tlo 6-bil sub-bIocI conlains no moro llan four 1s or four 0s.
Tlo 4-bil sub-bIocI conlains no moro llan llroo 1s or llroo 0s.
- Any symboI vill ollor llan llo abovo proporlios is considorod invaIid and
a rocoivor considor llis an orror.
- An 8-bil claraclor is submillod lo llo 8b/10b oncodor aIong vill a signaI
indicaling vlollor llo claraclor is a Dala (D) or ConlroI (K) claraclor. Tlo
oncodor oulpuls llo oquivaIonl 10-bil symboI aIong vill a curronl running
disparily (CRD) llal roprosonls llo sum of 1s and 0s for llis lransmission
IinI sinco IinI iniliaIizalion. Soo Disparily on pago 423 for moro informa-
lion.
- Tlo ICI Ixpross spocificalion dofinos ConlroI claraclors llal oncodo inlo
llo foIIoving ConlroI symboIs: STI, SDI, IND, IDB, COM, IAD, SKI, ITS,
and IDI (soo ConlroI Claraclor Incoding on pago 430).
PCI Express System Architecture
422
Preparing 8-bit Character Notation
8b/10b convorsion IooIup labIos rofor lo aII 8-bil claraclors using a spociaI
nolalion (roprosonlod by Dxx.y for Dala claraclors and Kxx.y. for ConlroI clar-
aclors). Iiguro 11-15 on pago 422 iIIuslralos llo nolalion oquivaIonl for any 8-bil
D or K claraclor. BoIov aro llo slops lo covorl llo 8-bil numbor lo ils nolalion
oquivaIonl.
In Iiguro 11-15 on pago 422, llo oxampIo claraclor is llo Dala claraclor, 6Al.
1. Tlo bils in llo claraclor aro idonlifiod by llo capilaIizod aIpla dosignalors
A llrougl H.
2. Tlo claraclor is parlilionod inlo lvo sub-bIocIs: ono 3-bils vido and llo
ollor 5-bils vido.
3. Tlo lvo sub-bIocIs aro fIippod.
4. Tlo claraclor laIos llo vrillon form Zxx.y, vloro:
5. Z = D or K for Dala or ConlroI,
6. xx = llo docimaI vaIuo of llo 5-bil fioId,
7. y = llo docimaI vaIuo of llo 3-bil fioId.
8. Tlo oxampIo claraclor is roprosonlod as D10.3 in llo 8b/10b IooIup labIos.

8b Character
8b Designation
Partition into sub-blocks
Flip sub-blocks
Add decimal values of
each sub-block
Final Notation
D/K xx . y
D/Kxx.y
Example Data (6Ah)
D 01101010
D 011 01010
D 10 . 3
D10.3
D 01010 011
H G F E D C B A
H G F E D C B A
7 6 5 4 3 2 1 0
D/
K#
D/
K#
D/
K#
Chapter 11: Physical Layer Logic
423
Disparity
Claraclor disparily rofors lo llo difforonco bolvoon llo num-
bor of 1s and 0s in a 10-bil symboI:
- Wlon a symboI las moro 0s llan 1s, llo symboI las nogalivo () dispar-
ily (o.g., 0101000101b).
- Wlon a symboI las moro 1s llan 0s, llo symboI las posilivo (+) dispar-
ily (o.g., 1001101110b).
- Wlon a symboI las an oquaI numbor of 1s and 0s, llo symboI las nou-
lraI disparily (o.g., 0110100101b).
- Iacl 10-bil symboI conlains ono of llo foIIoving numbors of onos and
zoros (nol nocossariIy conliguous):
- Iour 0s and six 1s (+ disparily).
- Six 0s and four 1s ( disparily).
- Iivo 0s and fivo 1s (noulraI disparily).
- - Tloro aro lvo calogorios of 8-bil
claraclors:
- Tloso llal oncodo inlo 10-bil symboIs vill + or disparily.
- Tloso llal oncodo inlo 10-bil symboIs vill noulraI disparily.
- Tlo CRD rofIocls llo lolaI numbor
of 1s and 0s lransmillod ovor llo IinI sinco IinI iniliaIizalion and las llo
foIIoving claraclorislics:
- Ils curronl slalo indicalos llo baIanco of 1s and 0s lransmillod sinco IinI
iniliaIizalion.
- Tlo CRDs iniliaI slalo (boforo any claraclors aro lransmillod) can bo +
or .
- Tlo CRDs curronl slalo can bo oillor posilivo (if moro 1s llan 0s lavo
boon lransmillod) or nogalivo (if moro 0s llan 1s).
- Iacl claraclor is convorlod via a labIo IooIup vill llo curronl slalo of
llo CRD faclorod in.
- As oacl nov claraclor is oncodod, llo CRD oillor romains llo samo (if
llo novIy gonoralod 10-bil claraclor las noulraI disparily) or il fIips lo
llo opposilo poIarily (if llo novIy gonoralod claraclor las + or dis-
parily).
PCI Express System Architecture
424
8b/10b Encoding Procedure
Rofor lo Iiguro 11-16 on pago 425. Tlo oncodo is accompIislod by porforming
lvo labIo IooIups in paraIIoI (nol slovn soparaloIy in llo iIIuslralion):
- Iirsl TabIo IooIup: Tlroo oIomonls aro submillod lo a 5-bil lo 6-bil labIo for
a IooIup (soo TabIo 11-1 on pago 427 and TabIo 11-2 on pago 429):
Tlo 5-bil porlion of llo 8-bil claraclor (bils A llrougl I).
Tlo Dala/ConlroI (D/K#) indicalor.
Tlo curronl slalo of llo CRD (posilivo or nogalivo).
Tlo labIo IooIup yioIds llo uppor 6-bils of llo 10-bil symboI (bils
).
- Socond TabIo IooIup: Tlroo oIomonls aro submillod lo a 3-bil lo 4-bil labIo
for a IooIup (soo TabIo 11-3 on pago 429 and TabIo 11-4 on pago 430):
Tlo 3-bil porlion of llo 8-bil claraclor (bils I llrougl H).
Tlo samo Dala/ConlroI (D/K#) indicalor.
Tlo curronl slalo of llo CRD (posilivo or nogalivo).
Tlo labIo IooIup yioIds llo Iovor 4-bils of llo 10-bil symboI (bils ).
Tlo 8b/10b oncodor compulos a nov CRD basod on llo rosuIlanl 10-bil symboI
and suppIios llis CRD for llo 8b/10b oncodo of llo noxl claraclor. If llo rosuIl-
anl 10-bil symboI is noulraI (i.o., il las an oquaI numbor of 1s and 0s), llo poIar-
ily of llo CRD romains unclangod. If llo rosuIlanl 10-bil symboI is + or , llo
CRD fIips lo ils opposilo slalo. Il is an orror if llo CRD is curronlIy + or and llo
noxl 10-bil symboI producod las llo samo poIarily as llo CRD (unIoss llo noxl
symboI las noulraI disparily, in vlicl caso llo CRD romains llo samo).
Tlo 8b/10b oncodor foods a IaraIIoI-lo-SoriaI convorlor vlicl cIocIs 10-bil
symboIs oul in llo bil ordor abcdoifglj (slovn in Iiguro 11-16 on pago 425).
- Iiguro 11-17 on pago 426 iIIuslralos somo oxampIo
8-bil lo 10-bil oncodings. Tlo foIIoving is an oxpIanalion of llo convorsion
of llo 8-bil Dala claraclor 6Al:
- Tlo 8-bil claraclor is broIon dovn inlo ils lvo sub-bIocIs: 011b and
01010b.
- Tlo lvo sub-bIocIs aro fIippod and roprosonlod as llo D10.3 claraclor.
Tlo binary-voigllod vaIuo of llo 5-bil bIocI is 10d and llo vaIuo of llo
3-bil fioId is 3d.
- Tlo lvo bIocIs aro submillod lo llo dala claraclor IooIup labIos
(TabIo 11-1 on pago 427 and TabIo 11-3 on pago 429 aro for D IooIups)
aIong vill llo curronl slalo of llo CRD).
Chapter 11: Physical Layer Logic
425
- Tlo Iasl lvo coIumns slov llo 10-bil symboI producod by llo lvo par-
aIIoI labIo IooIups (TabIo 11-1 on pago 427 and TabIo 11-3 on pago 429)
vlon llo CRD is nogalivo or posilivo.
--- Iiguro 11-18 on pago 427 iIIuslralos llo oncodo
and lransmission of llroo claraclors: llo firsl ono is llo conlroI claraclor
BCl (K28.5), llo socond claraclor is aIso BCl (K28.5) and llo llird clarac-
lor is llo dala claraclor 6Al (D10.3):
- If llo iniliaI CRD is nogalivo al llo limo of llo oncodo, llo K28.5 is
oncodod inlo 001111 1010b (posilivo disparily), fIipping llo CRD from
nogalivo lo posilivo.
- If llo CRD is posilivo al llo limo of llo oncodo, llo K28.5 is oncodod
inlo 110000 0101b (nogalivo disparily), fIipping llo CRD from posilivo
lo nogalivo.

PCI Express System Architecture
426
- Tlo D10.3 is oncodod inlo 010101 1100b (noulraI disparily). Tlo CRD
lloroforo romains unclangod (nogalivo) for llo noxl oncoding (nol
slovn).
- Nolico llal llo rosuIlanl symboI slroam is DC baIancod.
-
000101 0111 111010 1000 K23.7 111 10111 F7 Control (K)
110000 0101 001111 1010 K28.5 101 11100 BC Control (K)
000101 1110 111010 0001 D23.7 111 10111 F7 Data (D)
Data (D)
Data (D)
D or K
Character
001001 1011 110110 0100 D27.0 000 11011 1B
010101 0011 010101 1100 D10.3 011 01010 6A
CRD +
abcdei fghj
CRD
abcdei fghj
Byte
Name
Binary Bits
HGF EDCBA
Hex
Byte
000101 0111 111010 1000 K23.7 111 10111 F7 Control (K)
110000 0101 001111 1010 K28.5 101 11100 BC Control (K)
000101 1110 111010 0001 D23.7 111 10111 F7 Data (D)
Data (D)
Data (D)
D or K
Character
001001 1011 110110 0100 D27.0 000 11011 1B
010101 0011 010101 1100 D10.3 011 01010 6A
CRD +
abcdei fghj
CRD
abcdei fghj
Byte
Name
Binary Bits
HGF EDCBA
Hex
Byte
If character encode yields neutral disparity, then CRD remains unchanged, else it flips
This is 8-bit character
Encode to this if CRD is negative
Encode to this if CRD is positive
Chapter 11: Physical Layer Logic
427
The Lookup TabIes
Tlo foIIoving four labIos dofino llo labIo IooIup for llo lvo sub-bIocIs of 8-bil
Dala and ConlroI claraclors.
---
-

-

D0 00000 100111 011000

D1 00001 011101 100010
D2 00010 101101 010010
D3 00011 110001 110001
D4 00100 110101 001010
D5 00101 101001 101001
110000 0101 001111 1010 K28.5 101 11100 BC Control (K)
Data (D)
D/K#
010101 0011 010101 1100 D10.3 011 01010 6A
CRD +
abcdei fghj
CRD
abcdei fghj
Byte
Name
Binary Bits
HGF EDCBA
Hex
Byte
110000 0101 001111 1010 K28.5 101 11100 BC Control (K)
Data (D)
D/K#
010101 0011 010101 1100 D10.3 011 01010 6A
CRD +
abcdei fghj
CRD
abcdei fghj
Byte
Name
Binary Bits
HGF EDCBA
Hex
Byte
- Yields
010101 1100
CRD is neutral
- Yields
110000 0101
CRD is -
+ Yields
001111 1010
CRD is +
- Bit stream
transmitted
D10.3 (6Ah) K28.5 (BCh) K28.5 (BCh) Character to
be transmitted
CRD Character CRD Character CRD Character CRD
- Yields
010101 1100
CRD is neutral
- Yields
110000 0101
CRD is -
+ Yields
001111 1010
CRD is +
- Bit stream
transmitted
D10.3 (6Ah) K28.5 (BCh) K28.5 (BCh) Character to
be transmitted
CRD Character CRD Character CRD Character CRD
Initialized value of CRD is dont care. Receiver can determine from incoming bit stream
Use these two characters in the example below:
Example Transmission
PCI Express System Architecture
428
D6 00110 011001 011001
D7 00111 111000 000111
D8 01000 111001 000110
D9 01001 100101 100101
D10 01010 010101 010101
D11 01011 110100 110100
D12 01100 001101 001101
D13 01101 101100 101100
D14 01110 011100 011100
D15 01111 010111 101000
D16 10000 011011 100100
D17 10001 100011 100011
D18 10010 010011 010011
D19 10011 110010 110010
D20 10100 001011 001011
D21 10101 101010 101010
D22 10110 011010 011010
D23 10111 111010 000101
D24 11000 110011 001100
D25 11001 100110 100110
D26 11010 010110 010110
D27 11011 110110 001001
D28 11100 001110 001110
-

-

Chapter 11: Physical Layer Logic

429
D29 11101 101110 010001
D30 11110 011110 100001
D31 11111 101011 010100
-

-

K28 11100 001111 110000

K23 10111 111010 000101
K27 11011 110110 001001
K29 11101 101110 010001
K30 11110 011110 100001
-

-

--.0 000 1011 0100

--.1 001 1001 1001
--.2 010 0101 0101
--.3 011 1100 0011
--.4 100 1101 0010
--.5 101 1010 1010
-

-

PCI Express System Architecture

430
ControI Character Encoding
TabIo 11-5 on pago 432 slovs llo oncoding of llo ICI Ixpross-dofinod ConlroI
claraclors. Tloso claraclors aro nol scrambIod by llo lransmillor Iogic, bul aro
oncodod inlo 10-bil symboIs. Bocauso lloso ConlroI claraclors aro nol scram-
bIod, llo rocoivor Iogic can oasiIy dolocl lloso symboIs in an incoming symboI
slroam.
--.6 110 0110 0110
--.7 111 1110/0111 0001/1000
-

-

--.0 000 1011 0100

--.1 001 0110 1001
--.2 010 1010 0101
--.3 011 1100 0011
--.4 100 1101 0010
--.5 101 0101 1010
--.6 110 1001 0110
--.7 111 0111 1000
-

-

Chapter 11: Physical Layer Logic

431
Tloso ConlroI claraclors lavo llo foIIoving proporlios
- (comma) claraclor. Tlo COM claraclor is usod as llo firsl claraclor
of any Ordorod-Sol. Ordorod-Sols aro a coIIoclion of muIlipIos of 4 clarac-
lors llal aro usod for spociaIizod purposos (soo Ordorod-Sols on
pago 433). Tlo 10-bil oncoding of llo COM (K28.5) claraclor conlains lvo
bils of ono poIarily foIIovod by fivo bils of llo opposilo poIarily (001111
1010 or 110000 0101). Tlo COM (and ITS) symboIs aro llo onIy lvo symboIs
llal lavo llis proporly, lloroby maIing il oasy lo dolocl al llo rocoivors
IlysicaI Iayor. A rocoivor dolocls llo COM pallorn lo dolocl llo slarl of an
Ordorod-Sol. In parlicuIar, llo COM claraclor associalod vill TS1, TS2, or
ITS Ordorod-Sols aro usod by a rocoivor lo acliovo bil and symboI IocI on
llo incoming symboI slroam. Soo IinI Training and IniliaIizalion on
pago 403 for moro dolaiIs.
- claraclor. On a muIli-Iano IinI, assumo llo lransmillor lransmils llo
IND claraclor associalod vill a pacIol ond on an inlormodialo Iano sucl
as Iano 3 of a x8 IinI. If llo IinI goos lo llo IogicaI IdIo slalo aflor llo
lransmission of llo pacIols IND claraclor, llon llo IAD claraclor is usod
lo fiII in llo romaining Ianos. Tlis is dono so pacIols as voII as IogicaI IdIo
soquoncos aIvays bogin on Iano 0. Ior moro informalion, soo x8, x12, x16
or x32 IacIol Iormal RuIos on pago 413 and x8 IacIol Iormal IxampIo
on pago 415.
- (sIip) claraclor. Tlo SKI claraclor is usod as parl of llo SKII
Ordorod-Sol. Tlo SKII Ordorod-Sol is lransmillod for cIocI loIoranco com-
ponsalion. Ior a dolaiIod doscriplion, rofor lo Insorling CIocI Componsa-
lion Zonos on pago 436 and Rocoivor CIocI Componsalion Iogic on
pago 442.
- (Slarl TII) claraclor. Tlis claraclor is insorlod lo idonlify llo slarl of a
TII.
- (Slarl DIII) claraclor. Tlis claraclor is insorlod lo idonlify llo slarl of
a DIII.
- claraclor. Tlis claraclor is insorlod lo idonlify llo ond of a TII or
DIII llal las nol oxporioncod any CRC orrors on proviousIy-lravorsod
IinIs.
- (InD Bad pacIol) claraclor. Tlis claraclor is insorlod lo idonlify llo
ond of a TII llal a forvarding dovico (sucl as a svilcl) vislos lo nuIIify.
Cul-llrougl modo is a modo in vlicl llo svilcl forvards a pacIol from ils
ingross porl lo an ogross porl vill minimaI Ialoncy villoul laving lo buffor
llo incoming pacIol firsl. A svilcl may lavo slarlod forvarding a pacIol in
cul-llrougl modo and llon discovorod llal llo pacIol is corruplod. Il
lloroforo musl inslrucl llo rocoivor of llis pacIol lo discard il. To nuIIify a
TII, llo svilcl onds llo pacIol vill llo IDB claraclor and invorls llo
ICRC from ils caIcuIalod vaIuo. A rocoivor llal rocoivos sucl a nuIIifiod
PCI Express System Architecture
432
pacIol discards il and doos nol rolurn an ACK or NAK. AIso soo llo claplor
on AcI/NaI for a dolaiIod doscriplion of llo svilcl cul-llrougl modo.
- (Iasl Training Soquonco) claraclor. Tlis claraclor is usod as parl of llo
ITS Ordorod-Sol. ITS Ordorod-Sols aro lransmillod by a dovico in ordor lo
lransilion a IinI from llo Iov povor I0s Iov povor slalo bacI lo llo fuII-
on I0 slalo.
- (IdIo) claraclor. Tlis claraclor is usod as parl of llo IIoclricaI IdIo
Ordorod-Sol. Tlo Ordorod-Sol is lransmillod lo inform llo rocoivor llal llo
IinI is aboul lo lransilion lo llo I0s Iov povor slalo (aIso roforrod lo as llo
IIoclricaI IdIo slalo of llo IinI).

-
COM K28.5 (BCl) 001111 1010 110000 0101 Iirsl claraclor in any
Ordorod-Sol. Doloclod by
rocoivor and usod lo
acliovo symboI IocI dur-
ing TS1/TS2 Ordorod-Sol
rocoplion al rocoivor
IAD K23.7 (I7l) 111010 1000 000101 0111 IacIol Iadding claraclor
SKI K28.0 (1Cl) 001111 0100 110000 1011 Usod in SKII Ordorod-
Sol. Tlis Ordorod-Sol is
usod for CIocI ToIoranco
Componsalion
STI K27.7 (IBl) 110110 1000 001001 0111 Slarl of TII claraclor
SDI K28.2 (5Cl) 001111 0101 110000 1010 Slarl of DIII claraclor
IND K29.7 (IDl) 101110 1000 010001 0111 Ind of Good IacIol
claraclor
IDB K30.7 (IIl) 011110 1000 100001 0111 Claraclor usod lo marI
llo ond of a nuIIifiod
TII.
Chapter 11: Physical Layer Logic
433
Ordered-Sets
Ordorod-Sols aro IlysicaI Iayor IacIols (IIIs) consisling of a
sorios of claraclors slarling vill llo COM claraclor and consisling a lolaI
of four claraclors. Wlon lransmillod, lloy aro lransmillod on aII Ianos.
Ordorod-Sols aro usod for spociaI funclions sucl as:
- IinI Training. Soo IinI Training and IniliaIizalion on pago 403 for a
dolaiIod doscriplion.
- CIocI ToIoranco Componsalion. Soo Insorling CIocI Componsalion
Zonos on pago 436 and Rocoivor CIocI Componsalion Iogic on
pago 442.
- IIacing llo IinI inlo llo Iov povor I0s slalo (aIso roforrod lo as llo
IIoclricaI IdIo IinI slalo).
- Clanging llo IinI slalo from llo Iov povor I0s slalo (aIso roforrod lo
as IIoclricaI IdIo slalo) lo llo fuII-on I0 slalo.
Tlo ICI Ixpross spocificalion dofinos fivo Ordorod-Sols:
- Training Soquonco 1 (TS1),
- Training Soquonco 2 (TS2),
- SKII,
- Iasl Training Soquonco (ITS)
- and IIoclricaI IDII Ordorod-Sols.
A briof doscriplion of oacl Ordorod-Sol foIIovs.
ITS K28.1 (3Cl) 001111 1001 110000 0110 Usod in ITS Ordorod-Sol.
Tlis Ordorod-Sol usod lo
oxil from I0s Iov povor
slalo lo I0
IDI K28.3 (7Cl) 001111 0011 110000 1100 Usod in IIoclricaI IdIo
Ordorod-Sol. Tlis
Ordorod-Sol usod lo
pIaco IinI in IIoclricaI
IdIo slalo

-
PCI Express System Architecture
434
- Tloso lvo Ordorod-Sols aro usod during
IinI lraining. Tloy aro lransmillod by a porls lransmillor lo llo ollor
porls rocoivor, vloro lloy aro usod lo acliovo bil and symboI IocI. Tloy aro
aIso usod by llo porls al opposilo onds of a IinI lo numbor lloir IinIs and
Ianos. Tloso Ordorod-Sols aro usod during IinI spood and vidll nogolia-
lion.
In a muIli-Iano impIomonlalion, llo SKII Ordorod-Sol
is poriodicaIIy lransmillod on aII Ianos lo aIIov llo rocoivor cIocI loIoranco
componsalion Iogic lo componsalo for cIocI froquoncy varialions bolvoon
llo cIocI usod by llo lransmilling dovico lo cIocI oul llo soriaI bil slroam
and llo rocoivor dovicos IocaI cIocI. Tlo rocoivor adds a SKI symboI lo a
SKII Ordorod-Sol in llo rocoivor oIaslic buffor lo provonl a polonliaI buffor
undorfIov condilion from occurring duo lo llo lransmillor cIocI boing
sIovor llan llo IocaI rocoivor cIocI. AIlornaloIy, llo rocoivor doIolos a SKI
symboI from llo SKII Ordorod-Sol in llo rocoivor oIaslic buffor lo provonl a
polonliaI buffor ovorfIov condilion from occurring duo lo llo lransmillor
cIocI boing faslor llan llo IocaI rocoivor cIocI. Ior a dolaiIod doscriplion,
rofor lo Insorling CIocI Componsalion Zonos on pago 436 and Rocoivor
CIocI Componsalion Iogic on pago 442.
A lransmillor dovico llal vislos lo pIaco
llo IinI in llo IIoclricaI IdIo slalo (aIa llo I0s Iov povor slalo) lransmils
llis Ordorod-Sol lo a rocoivor. Upon rocoipl, llo difforonliaI rocoivors pro-
paro for llis Iov povor slalo during vlicl llo lransmillor drivor can bo in
llo Iov- or ligl-impodanco slalo and pacIol lransmission slops. Tlo diffor-
onliaI rocoivor romains in llo Iov-impodanco slalo vliIo in llis slalo.
ITS Ordorod-Sols aro lransmillod by a dovico lo lransi-
lion a IinI from llo Iov povor I0s slalo bacI lo llo fuII-on I0 slalo. Tlo
rocoivor dolocls llo ITS Ordorod-Sol and usos il lo acliovo bil and symboI
IocI as voII as lo ro-synclronizo ils rocoivor III lo llo lransmillor cIocI
usod lo lransmil llo soriaI bil slroam. Soo llo IinI Training and Iovor
Managomonl claplors for moro dolaiIs on ITS Ordorod-Sol usago.
ParaIIeI-to-SeriaI Converter (SeriaIizer)
Tlo 8b/10b Incodor on oacl Iano foods llo IaraIIoI-lo-SoriaI convorlor associ-
alod vill llal Iano. Tlo IaraIIoI-lo-SoriaI convorlor cIocIs 10-bil symboIs oul in
llo bil ordor abcdoifglj, vill llo Ioasl significanl bil (a) sliflod oul firsl and
llo mosl significanl bil (j) sliflod oul Iasl (as slovn in Iiguro 11-16 on pago
425). Tlo symboIs suppIiod by llo 8b/10b Incodor aro cIocIod inlo llo con-
Chapter 11: Physical Layer Logic
435
vorlor al 250MHz. Tlo soriaI bil slroam is cIocIod oul of llo IaraIIoI-lo-SoriaI
convorlor al 2.5GHz.
DifferentiaI Transmit Driver
Tlo difforonliaI drivor llal acluaIIy drivos llo soriaIizod bil slroam onlo llo
viro (or fibor) usos NRZ oncoding and drivos llo soriaI bil slroam al llo
2.5Gbil/s lransfor ralo. Tlo difforonliaI drivor oulpul por Iano consisls of lvo
signaIs (D+ and D-). A IogicaI ono is signaIod by driving llo D+ signaI ligl and
llo D- signaI Iov, llus croaling a posilivo voIlago difforonco bolvoon llo D+
and D- signaIs. A IogicaI zoro is signaIod by driving llo D+ signaI Iov and llo
D- signaI ligl, llus croaling a nogalivo voIlago difforonco bolvoon llo D+ and
D- signaIs.
DifforonliaI poaI-lo-poaI voIlago drivon by llo lransmillor is bolvoon 800mV
(min.) and 1200mV (max).
- IogicaI 1 is signaIIod vill a posilivo difforonliaI voIlago.
- IogicaI 0 is signaIIod vill a nogalivo difforonliaI voIlago.
During llo IinIs oIoclricaI IdIo slalo, llo lransmillor drivos a difforonliaI poaI
voIlago bolvoon 0mV and 20mV (llo lransmillor may bo in llo Iov- or ligl-
impodanco slalo).
DolaiIs rogarding llo oIoclricaI claraclorislics of llo drivor aro discussod in
Transmillor Drivor Claraclorislics on pago 477
Transmit (Tx) CIock
Tlo soriaI oulpul of llo IaraIIoI-lo-SoriaI convorlor on oacl Iano is cIocIod oul
lo llo difforonliaI drivor by llo Tx CIocI signaI (soo Iiguro 11-16 on pago 425).
Tx cIocI froquoncy is 2.5GHz and il musl bo accuralo lo +/300ppm from a con-
lor froquoncy of 2.5GHz (or 600ppm lolaI). Tlo cIocI can sIov by ono cIocI
ovory 1666 cIocI cycIos. Nolo llal llis Tx CIocI is difforonl from llo IocaI cIocI
of llo IlysicaI Iayor vlicl is a mucl sIovor cIocI. Tlo IlysicaI Iayor rocoivos
a cIocI from an oxlornaI sourco. ICI Ixpross dovicos on poriploraI cards as voII
as syslom boards may uso a 100MHz cIocI suppIiod by llo syslom board. Tlis
cIocI is muIlipIiod by a faclor vill llo aid of a III inlornaI lo llo IlysicaI
Iayor. Tlo rosuIlanl IocaI cIocI, vlicl runs al a mucl sIovor froquoncy llan
2.5GHz, cIocIs IlysicaI Iayor Iogic sucl as llo Bylo Slriping Iogic, llo Scram-
bIor, llo 8b/10b Incodor, llo buffors, olc. Tlo III aIso producos llo 2.5GHz Tx
cIocI usod lo food llo IaraIIoI-lo-SoriaI convorlors.
PCI Express System Architecture
436
Other MisceIIaneous Transmit Logic Topics
LogicaI IdIe Sequence
In ordor lo Ioop llo rocoivors III syncd up (i.o., lo Ioop il from drifling),
somolling musl bo lransmillod during poriods vlon lloro aro no TIIs, DIIIs
or IIIs lo lransmil. Tlo IogicaI IdIo soquonco is lransmillod during lloso limos.
Tlo IdIo soquonco is galod lo llo Mux as doscribod in llo soclion MuIlipIoxor
(Mux) and Mux ConlroI Iogic on pago 404. Somo proporlios of llo IogicaI IdIo
soquonco aro:
- Tlo IogicaI IdIo soquonco consisls of llo 8-bil Dala claraclor vill a vaIuo of
00l.
- Wlon lransmillod, il is simuIlanoousIy lransmillod on aII Ianos. Tlo IinI is
said lo bo in llo IogicaI IdIo slalo (nol lo bo confusod vill oIoclricaI IdIo
llo slalo vlon llo IinI is nol drivon and lloro aro no pacIol lransmissions
and llo rocoivor III Iosos synclronizalion).
- Tlo IogicaI IdIo soquonco is scrambIod. Tlis impIios llal, on llo IinI, llo
IogicaI IdIo soquonco las a psoudo-random vaIuo. A rocoivor can dislin-
guisl llo IogicaI IdIo soquonco from ollor pacIol lransmissions bocauso il
occurs oulsido llo pacIol framing conloxl (i.o., llo IogicaI IdIo soquonco
occurs aflor an IND or IDB ConlroI symboI, bul boforo an STI or SDI Con-
lroI symboI).
- Tlo IogicaI IdIo Soquonco is 8b/10b oncodod.
- During IogicaI IdIo soquonco lransmission, SKII Ordorod-Sols aro aIso
lransmillod poriodicaIIy.
Inserting CIock Compensation Zones
Wlon llo rocoivor Iogic rocoivos a symboI slroam, il somo-
limos noods lo add or romovo a symboI from llo rocoivod symboI slroam lo
componsalo for lransmillor vorsos rocoivor cIocI froquoncy varialions (for
bacIground, rofor lo Rocoivor CIocI Componsalion Iogic on pago 442).
Il slouId bo obvious llal llo rocoivor Iogic canl arbilrariIy picI a symboI lo
add or doIolo. Tlis moans llal, on a poriodic basis, llo lransmil Iogic musl
lransmil a spociaI ConlroI claraclor soquonco llal can bo usod for llis pur-
poso. Tlis soquonco is roforrod lo as llo SKII Ordorod-Sol (soo Iiguro 11-19)
vlicl consisls of a COM claraclor foIIovod by llroo SKI claraclors.
Chapter 11: Physical Layer Logic
437
- - A lransmillor is roquirod lo lrans-
mil SKII Ordorod-Sols on a poriodic basis. Tlo foIIoving ruIos appIy:
- Tlo sol musl bo scloduIod for insorlion al mosl onco ovory 1180 symboI
cIocIs (i.o., symboI limos) and al Ioasl onco ovory 1538 symboI cIocIs.
- Wlon ils limo lo insorl a SKII Ordorod-Sol, il is insorlod al llo noxl
pacIol boundary (nol in llo middIo of a pacIol). SKII Ordorod-Sols aro
insorlod bolvoon pacIols simuIlanoousIy on aII Ianos. If a Iong pacIol
lransmission is aIroady in progross, llo SKII Ordorod-Sols aro accumu-
Ialod and llon insorlod consoculivoIy al llo noxl pacIol boundary.
- In a muIli-Iano onvironmonl, llo SKII Ordorod-Sol musl bo lransmil-
lod on aII Ianos simuIlanoousIy (soo Iiguro 11-11 on pago 414 and Iig-
uro 11-12 on pago 415). Wlon nocossary, llo IinI is paddod so as lo
aIIov aII llo lransmission of llo SKII Ordorod-Sols lo slarl on llo samo
cIocI (soo Iiguro 11-12 on pago 415).
- During aII Iovor povor IinI slalos, any counlor(s) usod lo scloduIo
SKII Ordorod-Sols musl bo rosol.
- SKII Ordorod-Sols musl nol bo lransmillod vliIo llo CompIianco Ial-
lorn is in progross.
Receive Logic DetaiIs
Iiguro 11-20 slovs llo rocoivor Iogic of llo IogicaI IlysicaI Iayor. Tlis soclion
doscribos pacIol procossing from llo limo llo dala is rocoivod soriaIIy on oacl
Iano unliI llo pacIol bylo slroam is cIocIod lo llo Dala IinI Iayor.

COM
SKP
SKP
SKP
Encoding
K28.5
K28.0
K28.0
K28.0
PCI Express System Architecture
438
- -
Receive
To Data Link Layer
Rx Rx
Lane 0 Lane N Lane 1, ..,N-1
Serial-to-Parallel
and Elastic Buffer
Serial-to-Parallel
and Elastic Buffer
Rx
Buffer
De-Scrambler
8b/10b
Decoder
Byte Un-Striping
De-Scrambler
Lane 0 Lane N (N=0,1,3,7,11,15,31)
Lane 1, ..,N-1
8
8
8
8
8
8
Control
10 10
8
Control
START / END / IDLE / PAD Character Removal and
Packet Alignment Check
Error
Detect
8b/10b
Decoder
Error
Detect
Rx Local
PLL
Rx Clk Rx Clk
D/K#
D/K#
D/K#
D/K#
D/K#
Chapter 11: Physical Layer Logic
439
Iiguro 11-21 iIIuslralos llo rocoivor Iogics fronl ond on oacl Iano. Tlis is com-
prisod of:
- Tlo difforonliaI rocoivor.
- Tlo Rx CIocI rocovory Iogic.
- Tlo COM symboI and Ordorod-Sol doloclor.
- Tlo SoriaI-lo-IaraIIoI convorlor (DosoriaIizor).
- Tlo Iano-lo-Iano Do-SIov Iogic (doIay circuil).
- Tlo IIaslic Buffor and CIocI ToIoranco Componsalion Iogic.
DifferentiaI Receiver
Rofor lo Iiguro 11-21. Tlo difforonliaI rocoivor on oacl Iano sonsos difforonliaI
poaI-lo-poaI voIlago difforoncos > 175 mV bul < 1200 mV:
- + difforonco = IogicaI 1.
- difforonco = IogicaI 0.
-
Differential
Receiver
D+
D-
Elastic
Buffer
Serial Bit
Stream
10b
Symbols
To 8b/10b
Decoder
Serial-to-Parallel
Converter
SKIP,TS1,
TS2,FTS
Detection
Lane
De-Skew
Delay
Circuit
Rx Clock
Recovery
PLL
Rx
Clock
10
Control
Local
Clock PLL
Rx
Clock/10
Local
Clock
Symbol
Lock
Serial
Symbol
Stream
PCI Express System Architecture
440
A signaI poaI-lo-poaI difforonco < 65 mV is considorod a signaI absonl condi-
lion and llo IinI is in llo oIoclricaI IdIo slalo. During llis limo, llo rocoivor do-
galos ils inpul lo provonl llo orror circuil from dolocling an orror. A signaI poaI-
lo-poaI difforonliaI voIlago bolvoon 65mV and 175mV sorvos as noiso guard
band.
Rx CIock Recovery
GeneraI
Using a III (Ilaso-IocIod Ioop), llo rocoivor circuil gonoralos llo Rx CIocI
from llo dala bil lransilions in llo inpul dala slroam. Tlis rocovorod cIocI las
llo samo froquoncy (2.5GHz) as llal of llo Tx CIocI usod by llo lransmilling
dovico lo cIocI llo dala bil slroam onlo llo viro (or fibor). Tlo Rx CIocI is usod
lo cIocI llo inbound soriaI symboI slroam inlo llo SoriaI-lo-IaraIIoI convorlor
(DosoriaIizor). Tlo 10-bil symboI slroam producod by llo DosoriaIizor is cIocIod
inlo llo oIaslic buffor vill a divido by 10 vorsion of llo Rx CIocI. Tlo Rx CIocI
is difforonl from llo IocaI CIocI llal is usod lo cIocI symboIs oul of llo IIaslic
Buffor lo llo 10b/8b docodor. Tlo IocaI CIocI musl bo accuralo lo villin +/
300ppm from conlor froquoncy.
Achieving Bit Lock
RocoIIocl llal llo inbound soriaI symboI slroam is guaranlood lo lavo froquonl
1-lo-0 and 0-lo-1 lransilions duo lo llo 8b/10b oncoding sclomo. A lransilion is
guaranlood al Ioasl ovory 5 bil-limos. Tlo rocoivor III usos llo lransilions in
llo rocoivod bil-slroam lo synclronizo llo Rx CIocI vill llo Tx CIocI llal vas
usod al llo lransmillor lo cIocI oul llo soriaIizod bil slroam. Wlon llo rocoivor
III IocIs on lo llo Tx CIocI froquoncy, llo rocoivor is said lo lavo acliovod
.
During IinI lraining, llo lransmillor dovico sonds a Iong sorios of bacI-lo-bacI
TS1 and TS2 Ordorod-Sols lo llo rocoivor and llo rocoivor usos llo bil lransi-
lions in lloso Ordorod-Sols lo acliovo Bil IocI. Onco llo IinI is in llo fuII-on I0
slalo, lransilions on llo IinI occur on a roguIar basis and llo rocoivor III is
abIo lo mainlain Bil IocI.
Chapter 11: Physical Layer Logic
441
Losing Bit Lock
If llo IinI is pul in a Iov povor slalo (sucl as I0s) vloro pacIol lransmission
coasos, llo rocoivors III graduaIIy Iosos synclronizalion. Tlo lransmillor
sonds an oIoclricaI IdIo Ordorod-Sol lo loII llo rocoivor lo do-galo ils inpul lo
provonl llo orror circuil from dolocling an orror.
Regaining Bit Lock
Wlon llo IinI is in llo I0s slalo, llo lransmillor sonds a fov ITS Ordorod-sols
(on llo ordor of four ITSs) lo llo rocoivor and llo rocoivor usos lloso lo rogain
Bil IocI. OnIy a fov ITSs aro noodod by llo rocoivor in ordor lo acliovo Bil
IocI (llus llo vaIo up Ialoncy is of slorl duralion). Bocauso llo IinI is in llo
I0s slalo for a slorl limo, llo rocoivor III doos nol compIoloIy Ioso synclroni-
zalion vill llo Tx CIocI boforo il rocoivos llo ITSs.
SeriaI-to-ParaIIeI converter (DeseriaIizer)
Tlo incoming soriaI dala on oacl Iano is cIocIod inlo llal Ianos DosoriaIizor
(llo soriaI-lo-paraIIoI convorlor) by llo Rx cIocI (soo Iiguro 11-21 on pago 439).
Tlo 10-bil symboIs producod aro cIocIod inlo an IIaslic Buffor using a divido-
by-10 vorsion of llo Rx CIocI.
SymboI Boundary Sensing (SymboI Lock)
Wlon llo rocoivo Iogic slarls rocoiving a bil slroam, il is }ABOB (jusl a buncl of
bils) vill no marIors lo difforonlialo ono symboI from anollor. Tlo rocoivo
Iogic musl lavo somo vay lo dolormino llo slarl and ond of a 10-bil symboI.
Tlo Comma (COM) symboI sorvos llis purposo.
Tlo 10-bil oncoding of llo COM (K28.5) symboI conlains lvo bils of ono poIar-
ily foIIovod by fivo bils of llo opposilo poIarily (0011111010b or 1100000101b).
UnIoss an orror occurs, no ollor claraclor las llis proporly, lloroby maIing il
oasiIy doloclabIo. RocoIIocl llal llo COM ConlroI claraclor, IiIo aII ollor Con-
lroI claraclors, is nol scrambIod by llo lransmillor. Tlis maIos llo COM oasiIy
doloclabIo by llo COM doloclor vlicl IooIs for lvo consoculivo 0s or lvo con-
soculivo 1s foIIovod by a slring of fivo 1s or fivo 0s, rospoclivoIy. Upon doloclion
of llo COM symboI, llo COM Doloclor Inovs llal llo noxl bil rocoivod aflor
llo COM symboI is llo firsl bil of a vaIid 10-bil symboI. Tlo DosoriaIizor is llon
iniliaIizod so llal il can loncoforll gonoralo vaIid 10-bil symboIs. Tlo DosoriaI-
izor is said lo acliovo .
PCI Express System Architecture
442
Tlo COM symboI is uliIizod lo acliovo SymboI IocI undor llo foIIoving cir-
cumslancos:
- During IinI lraining vlon llo IinI is firsl oslabIislod, TS1 and TS2
Ordorod-Sols aro lransmillod (and oacl sol bogins vill a COM symboI).
- During IinI rolraining inilialod duo lo a probIom on llo IinI, TS1 and TS2
Ordorod-Sols aro lransmillod (and oacl sol bogins vill a COM symboI).
- ITS Ordorod-Sols aro sonl by a lransmillor lo inform llo rocoivor lo rogain
Bil IocI and SymboI IocI and clango llo slalo of llo IinI from I0s lo I0.
Receiver CIock Compensation Logic
Background
Considor a lransmillor al ono ond of a IinI and llo rocoivor al llo opposilo ond.
Tlo lransmil cIocI accuracy musl bo 2.5GHz +/ 300 ppm (parls por miIIion).
Onco llo IinI is lrainod, llo rocoivo cIocI (Rx CIocI) in llo rocoivor is llo samo
as llo lransmil cIocI (Tx CIocI) al llo ollor ond of llo IinI (bocauso llo rocoivo
cIocI is dorivod from llo bil slroam llal vas lransmillod al llo romolo onds
lransmil cIocI froquoncy). If llo lransmillors Tx CIocI al ono ond of llo IinI
oporalos al +300 ppm and llo IocaI CIocI (slovn in Iiguro 11-21 on pago 439
nol llo Rx CIocI) al llo rocoivor al llo ollor ond oporalos al 300 ppm, llis
rosuIls in a vorsl-caso 600 ppm difforonco bolvoon llo lvo cIocIs.
In llis sconario, llo lransmillor al ono ond of llo IinI is oporaling al 2.5GHz
+300 ppm, vliIo llo rocoivors IocaI cIocI is oporaling al a froquoncy of 2.5GHz
300ppm. Tlo Tx CIocI of llo lransmillor and IocaI CIocI of llo rocoivor can
lloroforo slifl ono cIocI ovory 1666 cIocIs.
The EIastic Buffers RoIe in the Receiver
Il is a common dosign praclico lo cIocI mosl of llo rocoivo pall Iogic using llo
IlysicaI Iayors IocaI cIocI. To componsalo for llo froquoncy difforonco
bolvoon llo Rx CIocI (vlicl is dorivod from llo romolo porls lransmil fro-
quoncy) and llo IocaI CIocI (vlicl is dorivod from llo IocaI porls lransmil fro-
quoncy), an oIaslic buffor (soo Iiguro 11-21 on pago 439) is incorporalod in llo
vory oarIy slagos of llo rocoivo pall.
Chapter 11: Physical Layer Logic
443
SymboIs arrivo al llo difforonliaI rocoivor as a bil slroam and aro prosonlod lo
llo DosoriaIizor. Tlo rocoivo III rocovors llo cIocI (Rx CIocI) omboddod in llo
bil slroam and llo DosoriaIizor convorls llo incoming bil slroam inlo a sorios of
10-bil symboIs. Tlo symboIs aro cIocIod inlo llo inpul sido of llo IIaslic Buffor
using llo Rx CIocI rocovorod from llo incoming bil slroam and aro cIocIod oul
of llo buffor using llo rocoivors IocaI cIocI. As proviousIy cilod, lloso lvo
cIocIs can bo as mucl as 600ppm oul of sync vill oacl ollor.
Tlo IIaslic Buffor componsalos for llo difforonco bolvoon llo lvo cIocIs by
oillor doIoling a SKI symboI from or insorling a SKI symboI inlo llo symboIs
conlainod in llo IIaslic Buffor:
- If llo lransmil cIocI froquoncy is groalor llan llo rocoivo cIocI froquoncy by
up lo 600ppm, a SKI symboI is doIolod from llo buffor.
- If llo lransmil cIocI froquoncy is Ioss llan llo rocoivo cIocI froquoncy by up
lo 600ppm, a SKI symboI is addod lo llo buffor.
Tlo lransmillor on llo ollor ond poriodicaIIy lransmils a spociaI symboI
soquonco caIIod llo SKII Ordorod-Sol (soo Iiguro 11-19 on pago 437 and Insorl-
ing CIocI Componsalion Zonos on pago 436) from vlicl llo donl caro SKI
symboI can bo doIolod or lo vlicl a donl caro SKI symboI can bo addod. Tlo
SKII Ordorod-Sol consisls of four conlroI symboIs (a COM and llroo SKIs, llo
SIips aro llo donl caro claraclors, lonco llo namo SIip). DoIoling or add-
ing a SKI symboI lo llo SKII Ordorod-Sol in llo IIaslic Buffor provonls a buffor
ovorfIov or undorfIov condilion, rospoclivoIy.
Ioss of symboI(s) causod by IIaslic Buffor ovorfIov or undorfIov lriggors a
Rocoivor Irror indicalion lo llo Dala IinI Iayor and rosuIls in llo aulomalic
inilialion of IinI orror rocovory.
Tlo lransmillor scloduIos a SKII Ordorod-Sol lransmission onco ovory 1180 lo
1538 symboI limos. Hovovor, if llo lransmillor slarls a maximum sizod TII
lransmission rigll al llo 1538 symboI limo boundary vlon a SKII Ordorod-Sol
is scloduIod lo bo lransmillod, llo SKII Ordorod-Sol lransmission is doforrod.
Rocoivors musl bo loIoranl lo rocoivo and procoss SKII Ordorod-Sols llal lavo a
maximum soparalion dopondonl on llo maximum pacIol payIoad sizo a dovico
supporls. Tlo formuIa for llo maximum numbor of SymboIs () bolvoon SKII
Ordorod-Sols is:
= 1538 + (maximum pacIol payIoad sizo + 28)
28 is llo numbor of symboIs associalod vill llo loador (16 bylos), llo oplionaI
ICRC (4 bylos), llo ICRC (4 bylos), llo soquonco numbor (2 bylos) and framing
symboIs STI and IND (2 bylos).
PCI Express System Architecture
444
Lane-to-Lane De-Skew
Not a ProbIem on a SingIe-Lane Link
Tlo probIom of Iano-lo-Iano sIov is obviousIy onIy an issuo on muIli-Iano
IinIs.
FIight Time Varies from Lane-to-Lane
SymboIs aro lransmillod simuIlanoousIy on aII Ianos using llo samo lransmil
cIocI, bul lloy cannol bo oxpoclod lo arrivo al llo rocoivor al llo samo limo (i.o.,
villoul Iano-lo-Iano sIov). A muIli-Iano IinI may lavo many sourcos of
Iano-lo-Iano sIov. Tloso sourcos incIudo bul aro nol Iimilod lo:
- Clip difforonliaI drivors and rocoivors.
- Irinlod viring board impodanco varialions.
- Iano viro Iongll miss-malclos.
- DoIays injoclod by llo soriaIizalion and do-soriaIizalion Iogic.
Wlon llo bylo-slripod soriaI bil slroams associalod vill a pacIol arrivo on aII
Ianos al llo rocoivor, il musl romovo llis Iano-lo-Iano sIov in ordor lo rocoivo
and procoss llo dala corroclIy. Tlis procoss is roforrod lo as IinI dosIov.
Rocoivors uso TS1 or TS2 Ordorod-Sols during IinI lraining or ITS Ordorod-
Sols during I0s oxil lo porform IinI do-sIov funclions.
If Lane Data Is Not AIigned, Byte Unstriping WouIdnt Work
Havoc vouId onsuo if llo symboIs lransmillod on oacl Iano simuIlanoousIy
voro lo arrivo al oacl Iano rocoivor al difforonl limos and voro llon do-soriaI-
izod and fod lo llo Bylo Unslriping Iogic. Gibborisl vouId bo fod lo llo IinI
Iayor as pacIol dala.
TS1/TS2 or FTS Ordered-Sets Used to De-Skew Link
Tlo uniquo slrucluro and Iongll of llo TS1/TS2 and ITS sols, and llo facl llal
lloy aro lransmillod simuIlanoousIy on aII Ianos, aro usod by llo rocoivors Do-
SIov Iogic lo dolormino llo amounl of misaIignmonl bolvoon Ianos. Tlo spoci-
ficalion doosnl dofino llo mollod usod lo acliovo muIli-Iano aIignmonl. As an
oxampIo, llo rocoivor Iogic couId componsalo for llo misaIignmonl by luning an
aulomalic doIay circuil in oacl Ianos rocoivor (soo Iiguro 11-21 on pago 439 and
Iiguro 11-22 on pago 445).
Chapter 11: Physical Layer Logic
445
Tlo rocoivor musl bo capabIo of do-sIoving up lo 20ns of Iano-lo-Iano sIov as
dofinod by llo I
RX-SKIW
paramolor slovn in TabIo 12-2 on pago 480.
De-Skew During Link Training, Retraining and L0s Exit
TS1 and TS2 Ordorod-Sols aro onIy lransmillod during iniliaI IinI lraining or
during IinI rolraining (i.o., rocovory). ITS Ordorod-Sols aro lransmillod during
I0s oxil. Do-sIov is lloroforo onIy porformod by llo rocoivor al lloso limos and
is nol dono on a poriodic basis.
Lane-to-Lane De-Skew CapabiIity of Receiver
Tlo Iano-lo-Iano do-sIov paramolor I
RX-SKIW
slovn in TabIo 12-2 on
pago 480 roquiros llal llo rocoivor bo capabIo of do-sIoving Iano doIays of up
lo 20ns. Tlo lransmillor is aIIovod lo inlroduco a minimaI Iano-lo-Iano sIov al
llo oulpul pad dofinod by llo I
TX-SKIW
paramolor (soo TabIo 12-1 on pago 477)
of 1.3ns.
-
Lane 0
Lane 1
Lane 2
Lane 3
Rx
Rx
Rx
Rx

TS1/TS2
TS1/TS2
TS1/TS2
TS1/TS2
TS1/TS2
TS1/TS2
TS1/TS2
TS1/TS2
FTS
FTS
FTS
FTS
FTS
FTS
FTS
FTS
PCI Express System Architecture
446
8b/10b Decoder
GeneraI
Rofor lo Iiguro 11-23 on pago 447. Iacl rocoivor Iano incorporalos a 10b/8b
Docodor vlicl is fod from llo IIaslic Buffor. Tlo 8b/10b Docodor usos lvo
IooIup labIos (llo D and K labIos) lo docodo llo 10-bil symboI slroam inlo 8-bil
Dala (D) or ConlroI (K) claraclors pIus llo D/K# signaI. Tlo slalo of llo D/K#
signaI indicalos llal llo rocoivod symboI is:
- A Dala (D) claraclor if a malcl for llo rocoivod symboI is discovorod in llo
D labIo. D/K# is drivon Higl.
- A ConlroI (K) claraclor if a malcl for llo rocoivod symboI is discovorod in
llo K labIo. D/K# is drivon Iov.
Disparity CaIcuIator
Tlo docodor dolorminos llo iniliaI disparily vaIuo basod on llo disparily of llo
firsl symboI rocoivod. Aflor llo firsl symboI, onco llo disparily is iniliaIizod in
llo docodor, il oxpocls llo caIcuIalod disparily for oacl subsoquonl symboI
rocoivod lo loggIo bolvoon + and - unIoss llo symboI rocoivod las noulraI dis-
parily in vlicl caso llo disparily romains llo samo vaIuo.
Code VioIation and Disparity Error Detection
Tlo orror doloclion Iogic of llo 8b/10b Docodor dolocls orrors in
llo rocoivod symboI slroam. Il slouId bo nolod llal il doosnl calcl aII pos-
sibIo lransmission orrors. Tlo spocificalion roquiros llal lloso orrors bo
doloclod and roporlod as a Rocoivor Irror indicalion lo llo Dala IinI Iayor.
Tlo lvo lypos of orrors doloclod aro:
- Codo vioIalion orrors (i.o., a 10-bil symboI couId nol bo docodod inlo a
vaIid 8-bil Dala or ConlroI claraclor).
- Disparily orrors.
Tloro is no aulomalic lardvaro orror corroclion for lloso orrors al llo Ilys-
icaI Iayor.
- Tlo foIIoving condilions roprosonl codo vioIalions:
- Any 6-bil sub-bIocI conlaining moro llan four 1s or four 0s is in orror.
- Any 4-bil sub-bIocI conlaining moro llan llroo 1s or llroo 0s is in orror.
Chapter 11: Physical Layer Logic
447
- Any 10-bil symboI conlaining moro llan six 1s or six 0s is in orror.
- Any 10-bil symboI conlaining moro llan fivo consoculivo 1s or fivo con-
soculivo 0s is in orror.
- Any 10-bil symboI llal doosnl docodo inlo an 8-bil claraclor is in orror.
Disparity Errors
A claraclor llal oncodos inlo a 10-bil symboI vill disparily ollor llan noulraI
is oncodod inlo a 10-bil symboI vill poIarily opposilo lo llal of llo CRD.
If llo noxl symboI doos nol lavo noulraI disparily and ils disparily is llo samo
as llo CRD, a disparily orror is doloclod.
- Somo disparily orrors may nol bo doloclabIo unliI llo subsoquonl symboI is
procossod (soo Iiguro 11-24 on pago 448).
- If lvo bils in a symboI fIip in orror, llo orror may nol bo doloclod (and llo
symboI may docodo inlo a vaIid 8-bil claraclor). Tlo orror goos undoloclod
al llo IlysicaI Iayor.

8b Character
CRD Calculator
Bytes to De-Scrambler
D/
K#
D/K#
7 6 5 4 3 2 1 0
H G F A B C D E
j h g f i e d c b a
From Elastic Buffer
To Error Reporting
Current
Running
Disparity
(CRD)
8b/10b Look-Up Table For K Characters
8b/10b Look-Up Table For D Characters
10b Symbol
PCI Express System Architecture
448
De-ScrambIer
Tlo Do-ScrambIor is fod by llo 8b/10b Docodor bIocI. Tlo Do-ScrambIor onIy
do-scrambIos Dala (D) claraclors associalod vill a TII or DIII (D/K# is
ligl). Il doos nol do-scrambIo ConlroI (K) claraclors or Ordorod-Sols. K clarac-
lors and Ordorod-Sols sourcod from llo 8b/10b docodor aro vaIid as is.
Some De-ScrambIer ImpIementation RuIes:
- On a muIli-Iano IinI, Do-ScrambIors associalod vill oacl Iano musl opor-
alo in concorl, mainlaining llo samo simuIlanoous vaIuo in oacl IISR.
- Do-scrambIing is appIiod lo D claraclors associalod vill TII and DIIIs
incIuding llo IogicaI IdIo (00l) soquonco. D claraclors villin llo TS1 and
TS2 Ordorod-Sol aro nol do-scrambIod.
- K claraclors and Ordorod-Sol claraclors aro nol do-scrambIod. Tloso clar-
aclors bypass llo do-scrambIor Iogic.
- CompIianco Iallorn roIalod claraclors aro nol do-scrambIod.
- Wlon a COM claraclor onlors llo Do- ScrambIor, il iniliaIizos llo IISR. Tlo
iniliaIizod vaIuo of llo 16-bil IISR is IIIIl.
- Will ono oxcoplion, llo IISR soriaIIy advancos oigll limos for ovory clar-
aclor (D or K claraclor) rocoivod. Tlo IISR doos NOT advanco on SKI
claraclors associalod vill llo SKII Ordorod-Sols rocoivod. Tlo roason llo
-
+ Invalid + D10.2 + D21.0 - Decoded
Character Stream
+ 111010 1010 + 010101 0101 + 101010 1011 - Bit Stream After
Error
+ 111010 1010 - 010101 0101 - 101010 1001 - Transmitted Bit
Stream
+ D23.5 - D10.2 - D21.1 - Transmitted
Character Stream
CRD Character CRD Character CRD Character CRD
+ Invalid + D10.2 + D21.0 - Decoded
Character Stream
+ 111010 1010 + 010101 0101 + 101010 1011 - Bit Stream After
Error
+ 111010 1010 - 010101 0101 - 101010 1001 - Transmitted Bit
Stream
+ D23.5 - D10.2 - D21.1 - Transmitted
Character Stream
CRD Character CRD Character CRD Character CRD
Error occurs here
Error detected here
Chapter 11: Physical Layer Logic
449
IISR is nol advancod on dolocling SKIs is bocauso lloro may bo a diffor-
onco bolvoon llo numbor of SKI claraclors lransmillod and llo SKI clar-
aclors oxiling llo IIaslic Buffor (as discussod in Rocoivor CIocI
Componsalion Iogic on pago 442).
- By dofauIl, llo Do-ScrambIor is aIvays onabIod. Tlo spocificalion doos
aIIov llo Do-ScrambIor lo bo disabIod for losl and dobug purposos. Hov-
ovor llo spocificalion doos nol provido a slandard soflvaro mollod or con-
figuralion rogislor-roIalod mollod for disabIing llo Do-ScrambIor.
DisabIing De-ScrambIing
If llo rocoivor Do-ScrambIor rocoivos al Ioasl lvo TS1/TS2 Ordorod-Sols vill
llo disabIo scrambIing bil sol from llo romolo dovico on aII of ils configurod
Ianos, il disabIos ils Do-ScrambIor.
Byte Un-Striping
Iiguro 11-25 on pago 449 iIIuslralos an oxampIo of oigll docodod 8-bil claraclor
slroams from llo oigll Do-ScrambIors of a x8 IinI boing un-slripod inlo a singIo
bylo slroam vlicl is fod lo llo IiIlor Iogic (soo llo noxl soclion).

Packet byte stream from Multiplexer block
De-Scrambler De-Scrambler De-Scrambler
Character 0
Character 1
Character 2
Character 3
Character 4
Character 5
Character 6
Character 7
Character 1
Character 9
Character 17
From Lane 1
Byte Un-Striping
Character 0
Character 8
Character 16
From Lane 0
Character 7
Character 15
Character 23
From Lane 7
Data Stream D/K#
PCI Express System Architecture
450
FiIter and Packet AIignment Check
Tlo soriaI bylo slroam suppIiod by llo bylo un-slriping Iogic conlains TIIs,
DIIIs, IogicaI IdIo soquoncos, ConlroI claraclors sucl as STI, SDI, IND, IDB,
and IADs, as voII as llo lypos of Ordorod-Sols. Of lloso claraclors, llo IogicaI
IdIo soquonco, llo conlroI claraclors and Ordorod-Sols aro doloclod and oIimi-
nalod. Wlal romains aro TIIs and DIIIs vlicl aro sonl lo llo Rx Buffor aIong
vill boundary claraclors indicaling llo slarl and ond of oacl TII and DIII.
Receive Buffer (Rx Buffer)
Tlo Rx Buffor loIds rocoivod TIIs and DIIIs aflor llo slarl and ond claraclors
lavo boon oIiminalod. Tlo rocoivod pacIols aro roady lo sond lo llo Dala IinI
Iayor.
Tlo inlorfaco bolvoon llo IlysicaI Iayor and Dala IinI Iayor is unspocifiod.
Honco, llo dosignor is froo lo docido vlal dala bus vidll inlorfaco lo impIo-
monl. As an oxampIo, vo can assumo llo inlorfaco cIocI lo bo 250MHz. In llal
caso, llo vidll of llo dala bus connocling llo Dala IinI Iayor lo llo IlysicaI
Iayor inlorfaco can = llo numbor of Ianos supporlod by llo dovico x oigll bils.
PhysicaI Layer Error HandIing
Wlon llo IlysicaI Iayor Iogic dolocls an orror, il sonds a Rocoivor Irror indica-
lion lo llo Dala IinI Iayor. Tlo spocificalion Iisls a fov of lloso orrors, bul il is
far from boing an oxlauslivo orror Iisl. Il is up lo llo dosignor lo dolormino vlal
IlysicaI Iayor orrors lo dolocl and roporl.
Somo of lloso orrors incIudo:
- 8b/10b Docodor-roIalod disparily orrors (doscribod in Disparily Irrors on
pago 447). Tlis clocI is roquirod.
- 8b/10b Docodor-roIalod codo vioIalion orrors (doscribod in Codo VioIa-
lions on pago 446). Tlis clocI is roquirod.
- IIaslic Buffor ovorfIov or undorfIov causod by Ioss of symboI(s) (doscribod
in Tlo IIaslic Buffors RoIo in llo Rocoivor on pago 442).
- Tlo pacIol rocoivod is nol consislonl vill llo pacIol formal ruIos doscribod
in GonoraI IacIol Iormal RuIos on pago 411. Tlis condilion is oplionaIIy
clocIod.
Chapter 11: Physical Layer Logic
451
- Ioss of SymboI IocI (soo SymboI Boundary Sonsing (SymboI IocI) on
pago 441).
- Ioss of Iano-lo-Iano do-sIov (soo Iano-lo-Iano Do-SIov on pago 444).
Response of Data Link Layer to Receiver Error Indication
If llo IlysicaI Iayor indicalos a Rocoivor Irror lo llo Dala IinI Iayor, llo Dala
IinI Iayor discards llo TII curronlIy boing rocoivod and froos any slorago aIIo-
calod for llo TII. Tlo Dala IinI Iayor scloduIos a NAK DIII for lransmission
bacI lo llo lransmillor of llo TII. Doing so aulomalicaIIy causos llo lransmillor
dovico lo ropIay TIIs from llo RopIay Buffor, rosuIling in possibIo aulo-corroc-
lion of llo orror. Tlo Dala IinI Iayor may aIso dirocl llo IlysicaI Iayor lo ini-
lialo IinI ro-lraining (i.o., IinI rocovory).
Doloclod IinI orrors may aIso rosuIl in llo IlysicaI Iayor inilialing llo IinI
rolraining (rocovory) procoss.
In addilion, llo dovico llal dolocls a Rocoivor Irror sols llo Rocoivor Irror Sla-
lus bil in llo CorroclabIo Irror Slalus rogislor (soo Iiguro 24-20 on pago 936) of
llo ICI Ixpross Ixlondod Advancod Irror CapabiIilios rogislor sol. If onabIod lo
do so, llo dovico sonds an IRR_COR (corroclabIo orror) mossago lo llo Rool
CompIox (Soo Advancod UncorroclabIo Irror HandIing on pago 386 for
dolaiIs on orror Iogging and roporling).
453

-
The Previous Chapter
Tlo provious claplor doscribod:
- Tlo IogicaI IlysicaI Iayor coro Iogic and lov an oulbound pacIol is pro-
cossod boforo cIocIing llo pacIol oul difforonliaIIy.
- Hov an inbound pacIol arriving from llo IinI is procossod and sonl lo llo
Dala IinI Iayor.
- Sub-bIocI funclions of llo IlysicaI Iayor sucl as Bylo Slriping and un-
slriping Iogic, ScrambIor and Do-ScrambIor, 8b/10b Incodor and docodor,
IIaslic Buffors and moro.
This Chapter
Tlis claplor doscribos llo IlysicaI Iayors oIoclricaI inlorfaco lo llo IinI. Il
doscribos llo anaIog claraclorislics of llo difforonliaI drivors and rocoivors llal
connocl a ICI Ixpross dovico lo llo IinI. Timing and drivor/rocoivor paramo-
lors aro documonlod loro.
The Next Chapter
Tlo noxl claplor doscribos llo llroo lypos of rosol, namoIy: coId rosol, varm
rosol and lol rosol. Il aIso doscribos llo usago of a sido-band rosol signaI caIIod
IIRST#. Tlo offocl of rosol on dovicos and llo syslom is doscribod.
EIectricaI PhysicaI Layer Overview
Tlo oIoclricaI sub-bIocI associalod vill oacl Iano (soo Iiguro 12-1 on pago 454)
providos llo plysicaI inlorfaco lo llo IinI. Tlis sub-bIocI conlains difforonliaI
drivors (lransmillors) and difforonliaI rocoivors (rocoivors). Tlo lransmillor sori-
aIizos oulbound symboIs on oacl Iano and convorls llo bil slroam lo oIoclricaI
PCI Express System Architecture
454
signaIs llal lavo an omboddod cIocI. Tlo rocoivor dolocls oIoclricaI signaIing on
oacl Iano and gonoralos a soriaI bil slroam llal il do-soriaIizos inlo symboIs,
and suppIios llo symboI slroam lo llo IogicaI IlysicaI Iayor aIong vill llo
cIocI rocovorod from llo inbound soriaI bil slroam.
In llo fuluro, llis sub-bIocI couId bo rodosignod lo supporl a cabIo inlorfaco or
an oplicaI (i.o., fibor) inlorfaco.
In addilion, llo oIoclricaI IlysicaI Iayor conlains a Ilaso IocI Ioop (III) llal
drivos llo SoriaIizor in llo lransmillor and a rocoivor III llal is syncd lo llo
lransilions in llo incoming soriaI symboI slroam.
Wlon llo IinI is in llo I0 fuII-on slalo, llo difforonliaI drivors drivo llo diffor-
onliaI voIlago associalod vill a IogicaI 1 and IogicaI 0 vliIo driving llo corrocl
DC common modo voIlago. Tlo rocoivors sonso difforonliaI voIlagos llal indi-
calo a IogicaI 1 or 0 and, inaddilion, can sonso llo oIoclricaI idIo slalo of llo IinI.
An oyo diagram cIoarIy iIIuslralos llo oIoclricaI claraclorislics of a drivor and
rocoivor and addrossos signaIing voIlago IovoIs, sIov and jillor issuos.
-
Logical
Electrical
Physical Layer
Logical
Electrical
Physical Layer
Link
C
TX
C
TX
Tx
Tx
Tx
Tx
Rx
Rx
Rx
Rx
Tx+ Tx+ Tx- Tx- Rx+ Rx- Rx- Rx+
Chapter 12: Electrical Physical Layer
455
Tlo oIoclricaI IlysicaI Iayor is rosponsibIo for pIacing llo difforonliaI drivors,
difforonliaI rocoivors, and llo IinI in llo corrocl slalo vlon llo IinI is pIacod in
a Iov povor slalo sucl as I0s, I1, or I2. WliIo in llo I2 Iov povor slalo, a
dovico can signaI a vaIo-up ovonl upslroam via a Boacon signaIing moclanism.
Tlo difforonliaI drivors supporl signaI do-omplasis (or pro-omplasis, soo Do-
Implasis (or Iro-Implasis) on pago 466) lo loIp roduco llo bil orror ralo
(BIR)ospociaIIy on a Iossy IinI.
Tlo drivors and rocoivors aro slorl-circuil loIoranl, maIing llom idoaIIy suilod
for lol insorlion and romovaI ovonls. Tlo IinI connocling lvo dovicos is AC
coupIod. A capacilor al llo lransmillor sido of llo IinI DC do-coupIos il from
llo rocoivor. As a rosuIl, lvo dovicos al opposilo onds of a IinI can lavo lloir
ovn ground and povor pIanos. Soo Iiguro 12-1 on pago 454 for llo capacilor
(C
TX
) pIacomonl on llo IinI.
High Speed EIectricaI SignaIing
Rofor lo Iiguro 12-2. Higl-spood IVDS (Iov-VoIlago DifforonliaI SignaIing)
oIoclricaI signaIing is usod in drivor and rocoivor impIomonlalions. Drivors and
rocoivors from difforonl manufaclurors musl bo inlor-oporabIo and may bo
dosignod lo bo lol-pIuggabIo. A slandard IR4 board can bo usod lo roulo llo
IinI viros. Tlo foIIoving soclions doscribo llo oIoclricaI claraclorislics of llo
drivor, rocoivor, and llo IinI roprosonlod in llo Iiguro.
-
+
-
Receiver Transmitter
C
TX
C
TX
Z
TX
Z
RX
Z
RX
Z
TX
Z
TX
Z
TX
Lane in
one
direction
Clock
Source
Clock
Source
V
CM
V
TX-CM
= 0 - 3.6 V
Z
TX
= Z
RX
= 50 Ohms
C
TX
= 75 200 nF
Detect
V
RX-CM
= 0 V
D+
D-
D+
D-
PCI Express System Architecture
456
CIock Requirements
GeneraI
Tlo lransmillor cIocIs dala oul al 2.5Gbils/s. Tlo cIocI usod lo do so musl bo
accuralo lo +/- 300 ppm of llo conlor froquoncy. Il is aIIovod lo sIov a maxi-
mum of 1 cIocI ovory 1666 cIocIs. Tlo lvo dovicos al llo opposilo onds of a
IinI couId lavo lloir lransmil cIocIs oul of plaso by as mucl as 600 ppm.
A dovico may dorivo ils cIocI from an oxlornaI cIocI sourco. Tlo syslom board
suppIios a 100 MHz cIocI llal is mado avaiIabIo lo dovicos on llo syslom board
as voII as lo add-in cards via llo connoclor. Will llo aid of IIIs, a dovico may
gonoralo ils roquirod cIocIs from llis 100 MHz cIocI.
Spread Spectrum CIocking (SSC)
Sproad spoclrum cIocIing is a loclniquo usod lo moduIalo llo cIocI froquoncy
sIovIy so as lo roduco IMI radialod noiso al llo conlor froquoncy of llo cIocI.
Will SSC, llo radialod onorgy doos nol produco a noiso spiIo al 2.5GHz
bocauso llo radialod onorgy is sproad ovor a smaII froquoncy rango around
2.5GHz.
SCC is nol roquirod by llo spocificalion. Hovovor, if supporlod, llo foIIoving
ruIos appIy:
- Tlo cIocI can bo moduIalod by +0 lo -0.5 from nominaI a froquoncy of
2.5GHz.
- Tlo moduIalion ralo musl bo bolvoon 30KHz and 33KHz.
- Tlo +/- 300 ppm roquiromonl for cIocI froquoncy accuracy sliII loIds. Iur-
llor, llo maximum of 600 ppm froquoncy varialion bolvoon llo lvo
dovicos al opposilo onds of a IinI aIso romains lruo. Tlis aImosl corlainIy
imposos a roquiromonl llal llo lvo dovicos al opposilo onds of llo IinI bo
drivon from llo samo cIocI sourco vlon llo cIocI is moduIalod vill SSC.
Impedance and Termination
Tlo claraclorislic impodanco of llo IinI is 100 Olms difforonliaI (nominaI),
vliIo singIo-ondod DC common modo impodanco is 50 Olms. Tlis impodanco
is malclod lo llo lransmillor and rocoivor impodancos.
Chapter 12: Electrical Physical Layer
457
Transmitter Impedance Requirements
Transmillors musl mool llo Z
TX-DIII-DC
(soo TabIo 12-1 on pago 477) paramolors
anylimo difforonliaI signaIs aro lransmillod during llo fuII-on I0 povor slalo.
Wlon a difforonliaI signaI is nol drivon (o.g., in llo Iovor povor slalos), llo
lransmillor may Ioop ils oulpul impodanco al a minimum Z
TX-DC
(soo TabIo 12-
1 on pago 477) of 40 Olms, bul may aIso pIaco llo drivor in a ligl impodanco
slalo. IIacing a drivor in llo ligl impodanco slalo may bo loIpfuI vliIo in I0s
or I1 Iov povor slalos lo loIp roduco povor drain in lloso slalos.
Receiver Impedance Requirements
Tlo rocoivor is roquirod lo mool llo Z
RX-DIII-DC
(soo TabIo 12-2 on pago 480)
paramolor of 100 Olms anylimo difforonliaI signaIs aro lransmillod during llo
fuII-on I0 povor slalo, as voII as in aII ollor Iovor povor slalos vloroin ado-
qualo povor is providod lo llo dovico. A rocoivor is oxcIudod from llis impod-
anco roquiromonl vlon llo dovico is povorod dovn (o.g., in llo I2 and I3
povor slalos and during IundamonlaI Rosol).
Wlon a rocoivor is povorod dovn lo llo I2 or I3 slalo, or during IundamonlaI
Rosol, ils rocoivor goos lo llo ligl impodanco slalo and musl mool llo Z
RX-
HIGH-IMI-DC
paramolor of 200 KOlms minimum (soo TabIo 12-2 on pago 480).
DC Common Mode VoItages
Transmitter DC Common Mode VoItage
Onco drivon aflor povor-on and during llo Dolocl slalo of IinI lraining, llo
lransmillor DC common modo voIlago V
TX-DC-CM
(soo TabIo 12-1 on pago 477)
musl romain al llo samo voIlago. Tlo common modo voIlago is lurnod off onIy
vlon llo lransmillor is pIacod in llo I2 or I3 Iov povor slalo, during vlicl
main povor lo llo dovico is romovod. A dosignor can clooso any common
modo voIlago in llo rango of 0V lo 3.6V.
Receiver DC Common Mode VoItage
Tlo rocoivor is DC do-coupIod from llo lransmillor by a capacilor. Tlis aIIovs
llo rocoivor lo lavo ils ovn DC common modo voIlago. Tlis voIlago is spocifiod
al 0V. Tlo spocificalion is uncIoar aboul llo moaning of llis 0V rocoivor DC
common modo voIlago roquiromonl and doos nol roquiro llo common modo
voIlago lo bo 0V al llo inpul lo llo rocoivor difforonliaI ampIifior. Rallor, a sim-
pIo bias voIlago nolvorI aIIovs llo rocoivor lo oporalo al oplimaI common
modo. Soo Iiguro 12-3 on pago 458.
PCI Express System Architecture
458
ESD and Short Circuit Requirements
-- - - -
- - -
- - -
-
- - -
- - -- - - --
- - - -
- -- - -

-
- -

+
-
Receiver Transmitter
C
TX
C
TX
Z
TX
Z
RX
Z
RX
Z
TX
Z
TX
Z
TX
Lane in
one
direction
Clock
Source
Clock
Source
V
CM
V
TX-CM
= 0 - 3.6 V
Z
TX
= Z
RX
= 50 Ohms
C
TX
= 75 200 nF
Detect
V
RX-CM
= 0 V
Big
Big
Big
Big
Ratio of resistors
sets DC common
mode voltage
Small
Small
Big
Big
Chapter 12: Electrical Physical Layer
459
Receiver Detection
GeneraI
Tlo Dolocl bIocI in llo lransmillor slovn in Iiguro 12-2 on pago 455 is roquirod
lo dolocl llo prosonco or absonco of a rocoivor al llo ollor ond of llo IinI aflor
coming oul of rosol or povor-on. Tlo Dolocl slalo of llo IinI Training slalo
maclino is rosponsibIo for maIing llis dolorminalion.
Doloclion is accompIislod vlon llo lransmillor clangos llo DC common modo
voIlago from ono vaIuo lo anollor. By dosign, llo lransmillor dolocl Iogic las
InovIodgo of llo ralo al vlicl llo Iinos clargo vill or villoul a rocoivor.
With a Receiver Attached
Will a rocoivor allaclod al llo ollor ond of llo IinI, llo clargo limo (RC limo
conslanl) is roIalivoIy Iong duo lo llo Iargo coupIing capacilor (C
TX
). Soo llo
Iovor laIf of Iiguro 12-4 on pago 460.
Timo Conslanl lo Clargo -= Z
TX
(C
TX
+ C
inlorconnocl
+ C
pad
) => Iargo vaIuo
Without a Receiver Attached
Willoul a rocoivor allaclod al llo ollor ond of llo IinI, llo clargo limo (RC
limo conslanl) is roIalivoIy slorl bocauso llo Iargo coupIing capacilor (C
TX
) doos
NOT como inlo pIay. Soo llo uppor laIf of Iiguro 12-4 on pago 460.
Timo Conslanl lo Clargo -= Z
TX
(C
inlorconnocl
+ C
pad
) => SmaII vaIuo
Procedure To Detect Presence or Absence of Receiver
1. Aflor rosol or povor-up, llo lransmillor drivos a slabIo voIlago on llo D+
and D- lorminaIs. Tlis can bo V
DD
(3.6 V), Ground or any common modo
voIlago in-bolvoon V
DD
and Ground.
2. Transmillor clangos llo common modo voIlago:
If llo iniliaI common modo voIlago is V
DD
, llon il drivos llo voIlago
lovards Ground.
If llo iniliaI common modo voIlago is Ground, llon il drivos llo voIlago
lovards V
DD
.
If llo iniliaI common modo voIlago is bolvoon V
DD
and Ground, llo
lransmillor drivos llo voIlago in llo opposilo diroclion (llo diroclion il
musl bo drivon lo allain lo llo iniliaI common modo voIlago).
PCI Express System Architecture
460
3. Tlo lransmillor dolocls llo prosonco of a rocoivor by dolormining llo clargo
limo:
A Rocoivor is prosonl if llo clargo limo is Iong.
A Rocoivor is absonl if llo clargo limo is slorl.
-
+
-
Receiver Transmitter
C
TX
C
TX
Z
TX-LINE
Z
RX
Z
RX
Z
TX-LINE
Z
TX
Z
TX
Lane in
one
direction
V
CM
Detect
V
RX-CM
= 0 V
C
pad
C
pad
C
interconnect
C
interconnect
Charge Time Constant ~= Z
TX
* (C
pad
+ C
interconnect
) Small Time
+
-
Receiver Transmitter
C
TX
C
TX
Z
RX
Z
RX
Z
TX
Z
TX
Lane in
one
direction
V
CM
Detect
V
RX-CM
= 0 V
C
pad
C
pad
C
interconnect
C
interconnect
Charge Time Constant ~= Z
TX
* (C
TX
+ C
pad
+ C
interconnect
) Large Time
C
TX
= 75 200 nF >> C
pad
+ C
interconnect
Receiver Absent
Receiver Present
Z
TX-LINE
Z
TX-LINE
Chapter 12: Electrical Physical Layer
461
DifferentiaI Drivers and Receivers
DifforonliaI signaIing (as opposod lo llo singIo-ondod signaIing ompIoyod in
ICI and ICI-X) is idoaI for ligl froquoncy signaIing.
Advantages of DifferentiaI SignaIing
Somo of llo advanlagos of difforonliaI signaIing (vorsus singIo-ondod signaIing)
aro:
- Can acliovo liglor froquoncy lransmission ralo bocauso llo signaI sving is
smaIIor.
- Ioss IMI noiso omillod duo lo noiso cancoIIalion of D+ signaI omission vill
D- signaI omission.
- Noiso immunily, bocauso any noiso llal coupIos inlo ono signaI viII aIso
coupIo inlo llo ollor signaI.
- Can signaI llroo signaI slalos: IogicaI 1, IogicaI 0 and oIoclricaI IdIo.
- SmaIIor signaI sving moans Ioss povor consumplion on llo IinI.
DifferentiaI VoItages
Tlo difforonliaI drivor usos NRZ oncoding lo drivo llo soriaI bil slroam. Tlo dif-
foronliaI drivor oulpul consisls of lvo signaIs, D+ and D-. A IogicaI ono is sig-
naIod by driving llo D+ signaI ligl and llo D- signaI Iov, croaling a posilivo
voIlago difforonco bolvoon llo D+ and D- signaIs. A IogicaI Zoro is signaIod by
driving llo D+ signaI Iov and llo D- signaI ligl, croaling a nogalivo voIlago
difforonco bolvoon llo D+ and D- signaIs.
Tlo difforonliaI poaI-lo-poaI voIlago drivon by llo lransmillor V
TX-DIIIp-p
(soo
TabIo 12-1 on pago 477) is bolvoon 800 mV (minimum) and 1200 mV (max).
- IogicaI 1 is signaIod vill a posilivo difforonliaI voIlago.
- IogicaI 0 is signaIod vill a nogalivo difforonliaI voIlago.
During llo IinI oIoclricaI IdIo slalo, llo lransmillor drivos a difforonliaI poaI
voIlago V
TX-IDII-DIIIp
(soo TabIo 12-1 on pago 477) of bolvoon 0 mV and 20 mV.
In llis slalo, llo lransmillor may bo in llo Iov- or ligl-impodanco slalo.
Tlo rocoivor is abIo lo sonso a IogicaI 1, a IogicaI 0, as voII as llo oIoclricaI idIo
slalo of llo IinI by dolocling llo voIlago on llo IinI via a difforonliaI rocoivor
ampIifior. Duo lo signaI Ioss aIong llo IinI al ligl froquoncy, llo rocoivor musl
bo dosignod lo sonso an allonualod vorsion of llo difforonliaI signaI drivon by
PCI Express System Architecture
462
llo lransmillor. Tlo rocoivor sonsilivily is dofinod by llo difforonliaI poaI-lo-
poaI voIlago V
RX-DIIIp-p
(soo TabIo 12-2 on pago 480) of bolvoon 175 mV and
1200 mV.
DifferentiaI VoItage Notation
A difforonliaI signaI voIlago is dofinod by laIing llo difforonco in
llo voIlago on llo lvo conduclors, D+ and D-. Tlo voIlago vill rospocl lo
ground on oacl conduclor is V
D+
and V
D-
. Tlo difforonliaI voIlago is V
DIII
= V
D+
- V
D-
. Tlo Common Modo voIlago, V
CM
, is dofinod as llo moan voIl-
ago of D+ and D-. V
CM
= (V
D+
+ V
D-
) / 2.
In dofining difforonliaI voIlagos, llo spocificalion usos lvo paramolors: 1)
Tlo difforonliaI poaI-lo-poaI voIlago, and 2) llo DifforonliaI poaI voIlago.
Tloso voIlagos aro dofinod by llo foIIoving oqualions and aro iIIuslralod in
Iiguro 12-5 on pago 463.
- DifforonliaI IoaI VoIlago => V
DIIIp
= (max |V
D+
- V
D-
|). Assumo sym-
molric signaI sving.
- DifforonliaI IoaI-lo-IoaI VoIlago => V
DIIIp-p
= (2 max |V
D+
- V
D-
|).
Assumo symmolric signaI sving.
- IoaI Common Modo VoIlago => V
CMp
= (max |V
D+
+ V
D-
| / 2).
Tlo difforonliaI poaI voIlago is oasiIy ropro-
sonlod in a diagram as llo difforonliaI voIlago associalod vill signaIing a
IogicaI 1 or IogicaI 0.
Tlo difforonliaI poaI-lo-poaI voIl-
ago is nol oasiIy roprosonlod in a diagram. Ono can llinI of llo difforonliaI
poaI-lo-poaI voIlago as llo sum lolaI of llo difforonliaI voIlago for signaI-
ing a IogicaI 1 and for signaIing a IogicaI 0. Ono can llinI of llis voIlago as
llo lolaI voIlago sving a rocoivor oxporioncos bolvoon rocoiving a IogicaI 1
and rocoiving a IogicaI 0.
Tlo common modo voIlago is llo conlor voIl-
ago vill rospocl lo ground vlon llo D+ and D- signaIs cross-ovor ono
anollor, assuming lloso lvo signaIs aro symmolric. Wlon a difforonliaI
drivor doos nol drivo a difforonliaI voIlago, il drivos a common modo voIl-
ago vill boll D+ and D- signaIs al llo samo voIlago (llo signaIs do nol
sving).
Chapter 12: Electrical Physical Layer
463
- -
D+
D-
V
D+
V
D-
V
DIFFp
= max | V
D+
- V
D-
|
V
CM
= max | V
D+
- V
D-
| / 2
0 V
0 V
D-
0 V
V
DIFFp
V
CMp
D+
(Logical 1)
V
DIFFp
(Logical 0)
V
DIFFp-p
= 2 * max | V
D+
- V
D-
| = V
DIFFp (Logical 1)
+ V
DIFFp (Logical 0)
+
PCI Express System Architecture
464
EIectricaI IdIe
Tlo oIoclricaI idIo slalo of llo IinI is llo slalo vloroin llo lransmillor D+ and
D- voIlagos aro loId al a sloady, conslanl voIlago (llo common modo voIlago).
Tlis slalo is usod in povor savings slalos sucl as I0s and I1, as voII as llo IinI
Inaclivo or IinI DisabIo slalos.
Transmitter ResponsibiIity
A lransmillor llal vislos lo pIaco a IinI in llo oIoclricaI IdIo slalo musl firsl
lransmil llo oIoclricaI IdIo Ordorod-Sol slovn in Iiguro 12-6. Aflor doing so, llo
lransmillor musl go lo llo oIoclricaI IdIo slalo villin T
TX-IDII-SIT-TO-IDII
limo
(soo TabIo 12-1 on pago 477) vlicl is Ioss llal 20 UI (Unil InlorvaIs = 400ps, 20
UI = 8 ns). Tlo difforonliaI poaI voIlago drivon by llo lransmillor in llo oIoclri-
caI IdIo slalo is V
TX-IDII-DIIIp
(soo TabIo 12-1 on pago 477) vlicl is Ioss llan a
20mV poaI.
Tlo lransmillor can llon romain in llo Iov impodanco slalo or go lo llo ligl
impodanco slalo. Onco in llo oIoclricaI IdIo slalo, llo lransmillor musl romain in
llis slalo for a minimum of T
TX-IDII-MIN
(soo TabIo 12-1 on pago 477) vlicl is
50 UI (20ns).
To oxil oIoclricaI IdIo and rolurn llo IinI lo llo fuII-on I0 slalo vlon lransmis-
sion rosumos, llo lransmillor musl do so villin T
TX-IDII-TO-DIII-DATA
(soo
TabIo 12-1 on pago 477) vlicl is Ioss llal 20 UI (8ns). Tlo lransmillor sonds ITS
Ordorod-Sols or TS1/TS2 Ordorod sols lo lransilion llo IinI slalo from llo I0s
or I1 slalo, rospoclivoIy, bacI lo I0 fuII-on slalo.

COM
IDL
IDL
IDL
Encoding
K28.5
K28.3
K28.3
K28.3
Chapter 12: Electrical Physical Layer
465
Receiver ResponsibiIity
A rocoivor dolorminos llal llo IinI is going lo onlor oIoclricaI IdIo slalo vlon il
soos lvo oul of llo llroo IDIs of llo Ordorod-Sol. Tlo rocoivor do-galos llo
orror roporling Iogic lo provonl roporling orrors duo lo unroIiabIo aclivily on llo
IinI and aIso immodialoIy arms ils oIoclricaI IdIo Ixil doloclor.
A rocoivor is abIo lo dolocl an oxil from llo oIoclricaI IdIo slalo vlon il dolocls a
difforonliaI poaI-lo-poaI voIlago on llo IinI of groalor llan V
RX-IDII-DIT-DIIIpp
(soo TabIo 12-2 on pago 480) of 65mV. In llo oIoclricaI IdIo slalo, llo rocoivor III
viII ovor limo, Ioso cIocI synclronizalion bocauso llo rocoivor inpul is al a
sloady slalo voIlago. To oxil llo oIoclricaI IdIo slalo, a lransmillor sonds ITS or
TS1/TS2 Ordorod-Sols llal llo rocoivor usos lo acliovo Bil IocI and SymboI
IocI and lo rosync llo rocoivor III vill llo lransmillor.
Power Consumed When Link Is in EIectricaI IdIe State
In llo oIoclricaI IdIo slalo, llo IinI consumos Ioss povor bocauso lloro aro no
IinI voIlago lransilions llal occur and llo lransmillor can do-galo ils oulpul
slago. Tlo IinI is in oillor llo I0s, I1, or llo DisabIod slalo vliIo il romains in
llo oIoclricaI IdIo slalo. Tlo rocommondod povor consumod in I0s is Ioss llan
20mW/Iano, vliIo il is Ioss llan 5mW/Iano in llo I1 slalo. Tlo rocommondod
povor consumod por Iano in I0 is on llo ordor of 80mW.
EIectricaI IdIe Exit
A rocoivor dolocls oIoclricaI IdIo oxil vlon il rocoivos a vaIid difforonliaI voIlago
villin llo V
RX-DIIIp-p
of 175 mV - 1200 mV. A lransmillor lypicaIIy sonds TS1
Ordorod-Sols lo signaI oIoclricaI IdIo oxil lo a rocoivor.
Transmission Line Loss on Link
Tlo lransmillor drivos a minimum difforonliaI poaI-lo-poaI voIlago V
TX-DIIIp-p
of 800mV. Tlo rocoivor sonsilivily is dosignod for a minimum difforonliaI poaI-
lo-poaI voIlago (V
RX-DIIIp-p
) of 175 mV. Tlis lransIalos lo a 13.2dB Ioss budgol
llal a IinI is dosignod for. AIllougl a board dosignor can dolormino llo allon-
ualion Ioss budgol of a IinI pIollod againsl various froquoncios, llo lransmillor
and rocoivor oyo diagram moasuromonl aro llo uIlimalo dolorminanl of Ioss
budgol for a IinI. Iyo diagrams aro doscribod in IVDS Iyo Diagram on
pago 470. A lransmillor llal drivos up lo llo maximum aIIovod difforonliaI
poaI-lo-poaI voIlago of 1200mV can componsalo for a Iossy IinI llal las
vorsl-caso allonualion claraclorislics.
PCI Express System Architecture
466
AC CoupIing
ICI Ixpross roquiros AC coupIing capacilors bo pIacod in cIoso proximily lo llo
lransmillor on oacl Ianos difforonliaI signaI pair. Tlo AC coupIing capacilor,
C
TX
(soo TabIo 12-2 on pago 480), is of a vaIuo bolvoon 75nI and 200nI. Tlo
capacilors can bo inlogralod onlo llo syslom board, or inlogralod inlo llo dovico
ilsoIf. An add-in card vill a ICI Ixpross dovico on il musl oillor pIaco llo
capacilors on llo card in cIoso proximily lo llo lransmillor, or inlogralo llo
capacilors inlo llo ICI Ixpross siIicon.
Tlo AC coupIing capacilors oIiminalo DC common modo voIlago slaring
bolvoon lvo dovicos al opposilo onds of llo IinI. Tlis simpIifios llo dovico
dosign by aIIoving oacl dovico lo oporalo vill ils ovn lransmillor DC common
voIlago. Iacl dovico can oporalo vill ils ovn povor and ground pIano, indo-
pondonl of llo romolo dovico al llo opposilo ond of llo IinI.
De-Emphasis (or Pre-Emphasis)
ICI Ixpross ompIoys llo concopl of -- lo loIp roduco llo offocl of llo
inlor-symboI inlorforonco llal may occur, ospociaIIy on moro Iossy IinI lrans-
mission Iinos. Supporling llis mandalory foaluro roducos llo Bil Irror Ralo
(BIR).
What is De-Emphasis?
A lransmillod difforonliaI signaI is do-omplasizod vlon muIlipIo bils of llo
samo poIarily aro lransmillod bacI-lo-bacI as slovn in Iiguro 12-7 on pago 467.
Tlo Iiguro slov a lransmission of 1000010000. Somo ruIos roIalod lo signaI do-
omplasis aro:
- An individuaI bil (llal las llo opposilo poIarily of llo procoding bil) is nol
do-omplasizod. Il lransmillod al llo poaI-lo-poaI difforonliaI voIlago as
spocifiod by V
TX-DIIIp-p
(soo TabIo 12-1 on pago 477).
- Tlo firsl bil of a sorios of samo poIarily bils is aIso nol do-omplasizod.
- OnIy subsoquonl bils of llo samo poIarily aflor llo firsl bil (of llo samo
poIarily) aro do-omplasizod.
- Tlo do-omplasizod voIlago is 3.5dB nominaI (acluaIIy, llo 3dB - 4dB rango
is fino) Ioss llan llo pro-omplasizod voIlago V
TX-DIIIp-p-MIN
(soo TabIo 12-1
on pago 477). Tlo do-omplasizod voIlago lransIalos lo aboul 300mV diffor-
onliaI poaI-lo-poaI Ioss llan 800mV.
566mV (3dB) >= V
TX-DIIMIH-DIIIp-p-MIN
>= 505 mV (4 dB) (soo TabIo 12-1
on pago 477).
Chapter 12: Electrical Physical Layer
467
- Tlo Boacon signaI is do-omplasizod according lo a sIigllIy difforonl ruIo.
Soo Boacon SignaIing on pago 469.
What is the ProbIem Addressed By De-emphasis?
As bil lransmission froquoncios incroaso, llo bil-limo or Unil InlorvaI (UI)
docroasos. Al llo 2.5GBil/s lransmission ralo, llo Unil InlorvaI is a vory smaII
(400ps). Tlo capacilivo offocls on llo IinI lransmission Iino bocomo moro
apparonl. Tlo Iino capacilors (C
pad
+ C
inlorconnocl
+ C
TX
) sloro clargo. Wlon a
signaI las boon loId al a conslanl difforonliaI voIlago (as in lransmission of suc-
cossivo bils of llo samo poIarily), llo Iino capacilors clargo up. Tlo Iino doos
nol oasiIy clango voIlago vlon llo signaI poIarily las lo fIip immodialoIy lo llo
opposilo vaIuo. Tlis rosuIls in vlal is roforrod lo as - .
Considor llo oxampIo in Iiguro 12-8 on pago 468 vloroin a lransmillor sonds
llo bil pallorn 111101111. Tlo slring of llo firsl four IogicaI 1s clargos llo Iino
capacilors. Wlon llo lransmillor foIIovs llis slring vill a IogicaI 0, llo capaci-
lors cannol disclargo fasl onougl and llon clargo lo llo opposilo poIarily, so
llal llo rocoivor viII rogislor llo IogicaI 0. Tlo rosuIl is inlor-symboI inlorfor-
onco al llo rocoivor. A rocoivor oyo diagram vouId slov llo IonoIy IogicaI 0
vill a narrovor oyo.
--- --
1 0 0 0 0 1 0 0 0 0
=1 V
1.3V
0.7 V
3.5 dB
3.5 dB
1.225
0.775
=600mV =450mV
V
TX-DIFFp
De-emphasized Voltage Level
D-
D+
1 UI = 400 ps
De-emphasized
V
TX-DIFFp
V
TX-CMp
PCI Express System Architecture
468
SoIution
Rallor llan llinIing llal oacl subsoquonl bil lransmillod aflor llo firsl bil of
llo samo poIarily musl bo do-omplasizod by 3.5dB (llo ICI Ixpross spocifica-
lion profors lo uso llo lorm do-omplasis), llinI of llo firsl bil of a slring of samo
poIarily bils as boing pro-omplasizod by 3.5dB.
Considor llo soIulion in Iiguro 12-9. By pro-omplasizing llo IonoIy IogicaI 0
bil, llo lransmillor is givon sufficionl addilionaI drivo slrongll lo ovorcomo llo
capacilivo offocl of llo provious slring of IogicaI 1s.

- --
1 1 1 0? 1 1 1 1
Received Signal
Inter-Symbol Interference results in lost bit
D-
D+
1
?
1 1 1 0 1 1 1 1
D-
D+
1
Transmitted Signal
1 1 1 0 1 1 1 1
D-
D+
1 1 1 1 0 1 1 1 1
D-
D+
1
Transmitted Signal
De-emphasized (or Pre-emphasized)
Received Signal
Pre-emphasis of single 0 compensates for
line capacitance effect
Chapter 12: Electrical Physical Layer
469
ICI Ixpross dovico rocoivors aro dosignod lo dolocl difforonliaI signaIs llal aro
allonualod by llo IinI lransmission Iino by as mucl as 11-13.2dB from llo
lransmillod vaIuo. Tlo do-omplasis roquiromonl for llo lransmillod signaI is
dosignod lo accommodalo sysloms vill IinI lransmission Iinos llal lavo llis
vorsl-caso Ioss budgol. Of courso, for Iovor Ioss sysloms, lloro is moro voIlago
margin al a rocoivor llal rocoivos a do-omplasizod signaI.
Beacon SignaIing
GeneraI
A ICI Ixpross dovico llal is in llo I2 Iov povor slalo can gonoralo a vaIo up
ovonl lo inform llo syslom llal il vislos lo movo lo llo fuII-on I0 slalo. Tlo
Boacon signaIing moclanism is ono of lvo mollods a dovico may ompIoy lo
accompIisl llis. Tlo ollor mollod (soo WAKI# on pago 696) is via llo assor-
lion of llo WAKI# signaI (if il is supporlod by llo dovico).
WliIo a dovico is in llo I2 povor slalo, ils main povor sourco and cIocI aro
lurnod off (as doscribod in on pago 484). Hovovor, an auxiIiary povor sourco
(V
aux
) Ioops a Iimilod porlion of llo dovico povorod, incIuding llo vaIo up
signaIing Iogic.
Wlon in llo I2 Iov povor slalo, a dovnslroam dovico signaIs a vaIo
up signaI upslroam lo slarl llo I2 oxil soquonco. If a svilcl or bridgo rocoivos
llo Boacon signaI on ils dovnslroam porl, il musl forvard llo vaIo up ovonl lo
ils upslroam porl. Tlis can bo dono by oillor forvarding llo Boacon signaI lo
llo upslroam porl or by using WAKI# assorlion lo llo povor managomonl
Iogic. Soo WAKI# (AUX Iovor) on pago 643.
Wlon a dovicos IinI povor slalo is I2, ovon llougl llo main povor lo llo
dovico is povorod off, a Iimilod porlion of llo dovico is povorod by V
aux
. Tlo
povorod porlion of llo dovico aIIovs llo dovico lo signaI llo vaIo up ovonl via
llo Boacon. An upslroam dovico sucl as a svilcl, bridgo or Rool CompIox llal
is aIso in I2 povor slalo is abIo lo sonso llo Boacon bocauso llo rocoivor Boacon
signaI doloclion Iogic is aIso povorod by V
aux
.
Properties of the Beacon SignaI
- Il is a roIalivoIy Iov froquoncy, DC baIancod difforonliaI signaI consisling of
poriodic arbilrary dala vloroin llo puIso vidll of llo signaI is al Ioasl 2ns
bul no groalor llan 16s. A Iov froquoncy difforonliaI sino vavo may suf-
fico.
- Tlo maximum limo bolvoon puIsos can bo no Iargor llan 16s.
PCI Express System Architecture
470
- Tlo lransmillod Boacon signaI musl mool llo oIoclricaI voIlago spocifica-
lions documonlod in TabIo 12-1 on pago 477.
- Tlo signaI musl bo DC baIancod villin a maximum limo of 32s.
- Boacon signaIing, IiIo normaI difforonliaI signaIing, musl bo dono vill llo
lransmillor in llo Iov impodanco modo (50 Olm singIo-ondod, 100 Olms
difforonliaI impodanco).
- Wlon signaIod, llo Boacon signaI musl bo lransmillod on Iano 0, bul doos
nol lavo lo bo lransmillod on ollor Ianos.
- Will ono oxcoplion, llo lransmillod Boacon signaI musl bo do-omplasizod
according lo llo ruIos dofinod in llo provious soclion. Ior Boacon puIsos
groalor llan 500ns, llo Boacon signaI voIlago musl bo 6db do-omplasizod
from llo V
TX-DIIIp-p
spocificalion. Tlo Boacon signaI voIlago may bo do-
omplasizod by up lo 3.5dB for Boacon puIsos smaIIor llan 500ns.
LVDS Eye Diagram
Jitter, Noise, and SignaI Attenuation
As llo bil slroam lravoIs from llo lransmillor on ono ond of a IinI lo llo rocoivor
on llo ollor ond, il is subjocl lo llo foIIoving disruplivo infIuoncos:
- Dolorminislic (i.o., prodiclabIo) jillor inducod by llo IinI lransmission Iino.
- Dala-dopondonl jillor inducod by llo dynamic dala pallorns on llo IinI.
- Noiso inducod inlo llo signaI pair.
- SignaI allonlualion duo lo llo impodanco offocl of llo lransmission Iino.
The Eye Test
Rofor lo Iiguro 12-10 on pago 472. In ordor lo onsuro llal llo difforonliaI
rocoivor rocoivos an in-spocificalion signaI, an oyo losl is porformod. Tlo foIIov-
ing doscriplion of llo oyo diagram vas providod by }amos Idvards from an
arlicIo lo aullorod for . Tlo aullor of llis booI las addod somo
addilionaI commonls |in bracIols].
Tlo mosl common limo domain moasuromonl for a lransmission syslom is
llo oyo diagram. Tlo oyo diagram is a pIol of dala poinls ropolilivoIy sam-
pIod from a psoudo-random bil soquonco and dispIayod by an osciIIoscopo.
Tlo limo vindov of obsorvalion is lvo dala poriods vido. Ior a |ICI
Ixpross IinI running al 2.5Gbils/s], llo poriod is 400ps, and llo limo vin-
Chapter 12: Electrical Physical Layer
471
dov is sol lo 800ps. Tlo osciIIoscopo svoop is lriggorod by ovory dala cIocI
puIso. An oyo diagram aIIovs llo usor lo obsorvo syslom porformanco on a
singIo pIol.
To obsorvo ovory possibIo dala combinalion, llo osciIIoscopo musl oporalo
IiIo a muIlipIo-oxposuro camora. Tlo digilaI osciIIoscopo's dispIay porsis-
lonco is sol lo infinilo. Will oacl cIocI lriggor, a nov vavoform is moasurod
and ovorIaid upon aII provious moasurod vavoforms. To onlanco llo inlor-
prolalion of llo composilo imago, digilaI osciIIoscopos can assign difforonl
coIors lo convoy informalion on llo numbor of occurroncos of llo vavo-
forms llal occupy llo samo pixoI on llo dispIay, a procoss Inovn as coIor-
grading. Modorn digilaI sampIing osciIIoscopos incIudo llo abiIily lo maIo
a Iargo numbor of aulomalod moasuromonls lo fuIIy claraclorizo llo vari-
ous oyo paramolors.
Tlo osciIIoscopo is sol for infinilo-porsislonco and a pallorn gonoralor is sol up
lo gonoralo a psoudo-random dala pallorn.
OptimaI Eye
Tlo mosl idoaI roading vouId painl an oyo pallorn sucl as llal slovn in llo
conlor of Iiguro 12-10 on pago 472 (IaboIIod OplimaI Iyo Oponing). Il slouId
bo nolod, lovovor, llal as Iong as llo pallorn painlod rosidos lolaIIy villin llo
rogion nolod as NormaI, llo lransmillor and IinI aro villin loIoranco. Nolo
llal in lloso oyo diagrams, llo difforonliaI voIlago paramolors and vaIuos
slovn aro poaI difforonliaI voIlagos as opposod lo poaI-lo-poaI voIlagos docu-
monlod in llo spocificalion. Tlis is dono bocauso poaI difforonliaI voIlagos can
bo roprosonlod in an oyo diagram vloroas poaI-lo-poaI difforonliaI voIlagos
cannol bo roprosonlod in an oyo diagram. Soo Iiguro 12-13 on pago 475 for an
oxampIo osciIIoscopo scroon capluro of an oplimaI oyo.
Jitter Widens or Narrows the Eye Sideways
Rofor lo Iiguro 12-11 on pago 473. }illor viII causo a cIocI puIso lo occur oillor
boforo or aflor llo OplimaI Iyo Oponing rosuIling in an oyo oponing vidor or
narrovor lorizonlaIIy llan llo oplimaI vidll. Onco again, as Iong as llo
amounl of jillor doosnl causo llo vindov lo vidon boyond llo normaI zono, il
is sliII villin loIoranco. Tlo jillor spocificalion }
T
(soo TabIo 12-1 on pago 477) is
a maximum of 3 UIs. Soo Iiguro 12-14 on pago 476 for an oxampIo osciIIoscopo
scroon capluro of an Iyo Diagram sloving lov oul-of-spoc jillor causos lori-
zonlaI vidoning or narroving of llo oyo.
PCI Express System Architecture
472
Noise and SignaI Attenuation Heighten the Eye
Rofor lo Iiguro 12-12 on pago 474. Noiso or signaI allonualion viII causo llo sig-
naIs voIlago IovoI lo ovorslool or undorslool llo OplimaI Iyo Oponing
zono. As Iong as llo amounl of undorslool or ovorslool doosnl causo llo vin-
dov loigll lo dip boIov or oxlond abovo llo normaI zono, il is sliII villin loIor-
anco. Soo Iiguro 12-14 on pago 476 for an oxampIo osciIIoscopo scroon capluro of
an oyo diagram sloving lov significanl noiso or signaI allonualion causos llo
vorlicaI vidoning or narroving of llo oyo.
-
Overshoot
Undershoot
Eye Opening
Time
UI = 400ps, UI = Unit Interval
Normal
Normal
De-emphasized Eye
T
TX-EYE
J
T/2
J
T/2
3.5 dB
3.5 dB
Minimum Eye
Chapter 12: Electrical Physical Layer
473
-
3.5 dB
3.5 dB
Minimum Eye
Overshoot
Undershoot
Eye Opening
Time
UI = 400ps, UI = Unit Interval
Normal
Normal
De-emphasized Eye
T
TX-EYE
J
T/2
J
T/2
Horizontal eye closure or widening caused by jitter
PCI Express System Architecture
474
- -
3.5 dB
3.5 dB
Minimum Eye
Overshoot
Undershoot
Eye Opening
Time
UI = 400ps, UI = Unit Interval
Normal
Normal
De-emphasized Eye
T
TX-EYE
J
T/2
J
T/2
Vertical eye closure or widening caused by noise or signal attenuation
Chapter 12: Electrical Physical Layer
475
--
PCI Express System Architecture
476
-
--
Chapter 12: Electrical Physical Layer
477
Transmitter Driver Characteristics
GeneraI
TabIo 12-1 on llis pago Iisls llo lransmillor drivor claraclorislics.
--
- -
UI 400.12 399.88 ps Unil InlorvaI = llo bil limo. 400
ps nominaI.
T
TX-IYI
0.7 UI Minimum oyo vidll from
vlicl maximum jillor can bo
dorivod.
}
T
= 1 - T
TX-IYI
}
T
0.3 UI Maximum jillor spoc slovn in
Iiguro 12-11 on pago 473.
T
TX-RISI
T
TX-IAII
0.125 UI Riso and IaII limo for difforon-
liaI signaI moasurod al llo
20/80 voIlago poinl.
V
TX-DIIIp-p
1200 800 mV IoaI-lo-poaI difforonliaI voIl-
ago.
V
TX-DIIIp
600 400 mV HaIf of V
TX-DIIIp-p.
V
TX-DC-CM
3.6 0 V DC common modo voIlago.
V
TX-DIIMIH-DIIIp-p-MIN
566 505 mV Rango of minimum difforonliaI
poaI-lo-poaI voIlagos for do-
omplasizod bils. Tlis is a 3dB -
4dB do-omplasis from pro-
omplasizod V
TX-DIIIp-p-MIN
of
800mV.
I
TX-SHORT
90 mA TolaI curronl lransmillor can
provido vlon slorlod lo
ground.
PCI Express System Architecture
478
V
TX-IDII-DIIIp
20 0 mV IoaI difforonliaI voIlago undor
oIoclricaI IdIo slalo of IinI.
T
TX-IDII-MIN
50 UI Minimum limo a lransmillor
musl bo in oIoclricaI IdIo.
T
TX-IDII-SIT-TO-IDII
20 UI Timo aIIovod for lransmillor lo
mool oIoclricaI IdIo lransmillor
spocificalion aflor sonding oIoc-
lricaI IdIo Ordorod-Sol.
T
TX-IDII-TO-DIII-DATA
20 UI Maximum limo aIIovod for
lransmillor lo mool difforonliaI
lransmission spocificalion aflor
oIoclricaI IdIo oxil.
Z
TX-DIII-DC
120 80 Olms Transmillor difforonliaI modo
Iov impodanco. TypicaI vaIuo
is 100 Olms.
Z
TX-DC
40 Olms Roquiros minimum D+ and D-
Iino impodanco during aII
povor slalos.
C
TX
200 75 nI AC coupIing capacilor on oacl
Iano pIacod in cIoso proximily
lo lransmillor.
I
TX-SKIW
1.3 ns Maximum Iano-lo-Iano sIov
al lransmillor bolvoon any lvo
Ianos.
--
- -
Chapter 12: Electrical Physical Layer
479
Transmit Driver CompIiance Test and Measurement
Load
Tlo AC liming and voIlago paramolors slovn in TabIo 12-1 on pago 477 is moa-
surod villin 0.2 inclos from llo pacIago pins inlo llo losl Ioad slovn in Iiguro
12-15.
A 50 Olm probo, or a rosislor allaclod lo ground, vlon allaclod lo llo lransmil
signaI pair causos llo dovico lo go inlo llo CompIianco slalo of llo IinI Train-
ing and Slalus Slalo Maclino (ITSSM) (soo IoIIing.Configuralion SubSlalo on
pago 517). During llis slalo, llo dovico oulpuls llo compIianco pallorn vlicl
can bo usod for inloroporabiIily losling, IMI noiso losling, Iano-lo-Iano inlor-
foronco losling, Bil Irror Ralo dolorminalion, Transmil and Rocoivo Iyo moa-
suromonls, olc.
--
D+
D-
Transmitter
Silicon
C
TX
C
TX
50 Ohms
50 Ohms
Measurement at
Package Pins
Test Fixture
PCI Express System Architecture
480
Input Receiver Characteristics
TabIo 12-2 on llis pago Iisls llo inpul rocoivor claraclorislics. Tlo rocoivor Iyo
Diagram in Iiguro 12-16 on pago 481 iIIuslralos somo of llo paramolors Iislod in
TabIo 12-2.
--
- -
UI 400.12 399.88 ps Unil InlorvaI =llo bil limo. 400ps nom-
inaI.
T
RX-IYI
0.4 UI Minimum oyo vidll from vlicl max-
imum jillor is dorivod.
}
T
= 1 - T
RX-IYI
}
T
0. UI Maximum jillor spoc.
V
RX-DIIIp-p
1200 175 mV IoaI-lo-poaI difforonliaI voIlago son-
silivily of rocoivor.
V
RX-DIIIp
600 88 mV HaIf of V
RX-DIIIp-p.
V
RX-IDII-DIT-
DIIIp-p
175 65 mV Tlis is llo oIoclricaI IdIo dolocl llrosl-
oId voIlago. Any voIlago Ioss llan
65mV poaI-lo-poaI impIios llal llo
IinI is in oIoclricaI IdIo.
Z
RX-DIII-DC
120 80 Olms Rocoivor DC difforonliaI modo impod-
anco. 100 Olms nominaI.
Z
RX--DC
60 40 Olms Roquiros minimum D+ and D- Iino
impodanco during aII povor slalos.
Z
RX--HIGH-IMI-DC
200I Olms Roquiros minimum D+ and D- Iino
impodanco vlon llo rocoivor lormina-
lions do nol lavo povor (o.g., in llo I2
Iov povor slalo, or during Iundamon-
laI Rosol).
I
RX-SKIW
20 ns Iano-lo-Iano sIov llal a rocoivor
musl bo abIo lo componsalo for.
Chapter 12: Electrical Physical Layer
481
EIectricaI PhysicaI Layer State in Power States
Iiguro 12-17 on pago 482 llrougl Iiguro 12-21 on pago 486 iIIuslralo llo oIoclri-
caI slalo of llo IlysicaI Iayor vliIo llo IinI is in various povor managomonl
slalos.

T
RX-EYE-MIN
= 0.4 UI
V
RX-DIFFp-MIN
= 88 mV
V
RX-CM-DC
= 0 V
PCI Express System Architecture
482

+
-
Receiver
ON
Transmitter
ON
C
TX
C
TX
Z
TX
Z
RX
Z
RX
Z
TX
Z
TX
Z
TX
Lane in
one
direction
Clock
Source
Clock
Source
V
CM
Detect
V
RX-CM
= 0 V
D+
D-
D+
D-
2.5 Gbits/s transmission reception in progress
Recommended Power Budget <= 80 mW per Lane
Only one direction of the Link need be in L0
Transmitter and Receiver clock PLL are ON
Transmitter is On, Receiver is ON
Low impedance termination at transmitter
ON
ON
Low impedance
termination
Low impedance
termination
Chapter 12: Electrical Physical Layer
483
-
+
-
Receiver
ON
Transmitter
ON
C
TX
C
TX
Z
TX
Z
RX
Z
RX
Z
TX
Z
TX
Z
TX
Lane in
one
direction
Clock
Source
Clock
Source
V
CM
Detect
V
RX-CM
= 0 V
D+
D-
D+
D-
Transmitter holds line at Electrical Idle state. V
TX-DIFFp
< 20 mV
Transmitter holds line at DC common mode voltage V
TX-CM-DC
0 3.6 V
Recommended Power Budget <= 20 mWper Lane
Recommended L0s -> L0 exit latency < 50 ns
Only one direction of the Link need be in L0s
Transmitter and Receiver clock PLL are ON but Rx Clock loses sync
Transmitter is On, Receiver is ON
High or Low impedance termination at transmitter
ON
ON
High or Low
impedance termination
Low impedance
termination
Held at 0 - 3.6 V DC common mode voltage
PCI Express System Architecture
484

+
-
Receiver
ON
Transmitter
ON
C
TX
C
TX
Z
TX
Z
RX
Z
RX
Z
TX
Z
TX
Z
TX
Lane in
one
direction
Clock
Source
Clock
Source
V
CM
Detect
V
RX-CM
= 0 V
D+
D-
D+
D-
Transmitter holds line at Electrical Idle state. V
TX-DIFFp
< 20 mV
Transmitter holds line at DC common mode voltage V
TX-CM-DC
0 3.6 V
Recommended Power Budget <= 5 mWper Lane
Recommended L1 -> L0 exit latency < 10 microsecond
Both directions of the Link in L1
Transmitter and Receiver clock PLL may be OFF, but clock to device ON
Transmitter is On, Receiver is ON
High or Low impedance termination at transmitter
May be OFF
High or Low
impedance termination
Low impedance
termination
Held at 0 - 3.6 V DC common mode voltage
May be OFF
Chapter 12: Electrical Physical Layer
485

+
-
Receiver
OFF
Transmitter
OFF
C
TX
C
TX
Z
TX
Z
RX
Z
RX
Z
TX
Z
TX
Z
TX
Lane in
one
direction
Clock
Source
Clock
Source
V
CM
Detect
V
RX-CM
= 0 V
D+
D-
D+
D-
Transmitter holds line at Electrical Idle state. V
TX-DIFFp
< 20 mV
Transmitter not required to hold DC common mode voltage. Most likely OFF
Recommended Power Budget <= 1 mWper Lane
Recommended L2 -> L0 exit latency < 12 - 50 millisecond
Both directions of the Link in L2
Transmitter and Receiver clock PLL OFF, and clock to device OFF
Low frequency clock for Beacon in transmitter ON
Main power to device OFF, but Vaux ON
Transmitter is OFF, Receiver is OFF
High or Low impedance termination at transmitter
High impedance termination at receiver
OFF
Low frequency
for Beacon ON
High or Low
impedance termination
High impedance
termination
DC common mode voltage not required
Most likely OFF
OFF
PCI Express System Architecture
486

+
-
Receiver
OFF
Transmitter
OFF
C
TX
C
TX
Z
TX
Z
RX
Z
RX
Z
TX
Z
TX
Z
TX
Lane in
one
direction
Clock
Source
Clock
Source
V
CM
Detect
V
RX-CM
= 0 V
D+
D-
D+
D-
Transmitter does not hold DC common mode voltage
Recommended Power Budget : 0 mW per Lane
Recommended L3 -> L0 exit latency < 12 - 50 millisecond after power turned ON
No automatic device initiated wake up mechanism
Both directions of the Link in L3
Transmitter and Receiver clock PLL OFF, and clock to device OFF
Low frequency clock for Beacon in transmitter OFF
Main power to device OFF, Vaux OFF
Transmitter is OFF, Receiver is OFF
High impedance termination at transmitter and receiver
OFF
Low frequency
for Beacon OFF
High impedance
termination
High impedance
termination
DC common mode voltage OFF
OFF

- -
The Previous Chapter
Tlo provious claplor doscribos llo IIoclricaI IlysicaI Iayor. Il doscribos llo
anaIog claraclorislics of llo difforonliaI drivors and rocoivors llal connocl a ICI
Ixpross dovico lo llo IinI. Timing and drivor/rocoivor paramolors aro docu-
monlod in llal claplor.
This Chapter
Tlis claplor doscribos 3 lypos of syslom rosol gonoralion capabiIilios: coId rosol,
varm rosol and lol rosol. Tlo claplor aIso doscribos llo usago of a sido-band
rosol signaI caIIod IIRST#. Il doscribos llo usago of llo TS1 Ordorod-Sol lo gon-
oralo an in-band Hol Rosol. Tlo offocl of rosol on a dovico and syslom is
doscribod.
The Next Chapter
Tlo noxl claplor doscribos llo funclion of llo IinI Training and Slalus Slalo
Maclino (ITSSM) of llo IlysicaI Iayor. Tlo claplor doscribos llo iniliaIizalion
procoss of llo IinI from Iovor-On or Rosol, unliI llo fuII-on I0 slalo, vloro
lraffic on llo IinI can bogin. In addilion, llo claplor doscribos llo Iovor povor
managomonl slalos I0s, I1, I2, I3 and briofIy doscribos onlry and oxil proco-
duro lo/from lloso slalos.
Two Categories of System Reset
Tlo ICI Ixpross spocificalion doscribos lvo rosol gonoralion moclanisms. Tlo
firsl moclanism is a syslom gonoralod rosol roforrod lo as -.
Tlo socond moclanism is an In-band Rosol (communicalod dovnslroam via llo
IinI from ono dovico lo anollor) roforrod lo as llo -.
-- -

FundamentaI Reset
IundamonlaI Rosol causos a dovicos slalo maclinos, lardvaro Iogic, porl slalos
and configuralion rogislors (oxcopl slicIy rogislors of a dovico llal can drav
vaIid V
aux
) lo iniliaIizo lo lloir dofauIl condilions.
Tloro aro lvo lypos of IundamonlaI Rosol:
- -. Tlis is a rosol gonoralod as a rosuIl of appIicalion of main
povor lo llo syslom.
- - Triggorod by lardvaro villoul llo romovaI and ro-appIica-
lion of main povor. A Warm Rosol couId bo lriggorod duo lo loggIing of llo
syslom IOWIRGOOD signaI vill llo syslom povor slabIo. Tlo mocla-
nism for gonoraling a Warm Rosol is nol dofinod by spocificalion. Il is up lo
llo syslom dosignor lo oplionaIIy provido a moclanism lo gonoralo a Warm
Rosol.
Wlon IundamonlaI Rosol is assorlod:
- Tlo rocoivor lorminalions aro roquirod lo mool llo Z
RX-HIGH-IMI-DC
param-
olor of 200 IOlms minimum (soo TabIo 12-2 on pago 480).
- Tlo lransmillor lorminalions aro roquirod lo mool llo oulpul impodanco al
minimum Z
TX-DC
(soo TabIo 12-1 on pago 477) of 40 Olms, bul may pIaco
llo drivor in a ligl impodanco slalo.
- Tlo lransmillor loIds a conslanl DC common modo voIlago bolvoon 0 V
and 3.6 V.
Aflor IundamonlaI Rosol Ixil:
- Tlo rocoivor musl ro-onabIo ils rocoivor lorminalions Z
RX-DIII-DC
(soo
TabIo 12-2 on pago 480) of 100 Olms villin 5 ms of IundamonlaI Rosol oxil.
Tlo rocoivor is nov roady lo dolocl oIoclricaI signaIing on llo IinI.
- Aflor IundamonlaI Rosol oxil, llo IinI Training slalo maclino onlors llo
Dolocl slalo and llo lransmillor is roady lo dolocl llo prosonco of a rocoivor
al llo ollor ond of llo IinI.
- Tlo lransmillor loIds a conslanl DC common modo voIlago bolvoon 0 V
and 3.6 V.
- -

Methods of SignaIing FundamentaI Reset

IundamonlaI Rosol may bo signaIod via an auxiIiary sido-band signaI caIIod
IIRST# (ICI Ixpross Rosol, assorlod Iov). Wlon IIRST# is nol providod lo an
add-in card or compononl, IundamonlaI Rosol is gonoralod aulonomousIy by
llo compononl or add-in card.
BoIov is a doscriplion of llo lvo moclanisms of IundamonlaI Rosol gonoralion.
- A conlraI rosourco
dovico, o.g. a clipsol, in llo ICI Ixpross syslom providos llis sourco of rosol.
Ior oxampIo, llo IO ConlroIIor Hub (ICH) clip in Iiguro 13-1 on pago 490 may
gonoralo IIRST#. Tlo syslom povor suppIy (nol slovn in figuro) gonoralos a
IOWIRGOOD signaI onco main povor is lurnod on and slabIo. Tlo ICH Rosol
Iogic in-lurn usos llis signaI lo assorl IIRST# vlon IOWIRGOOD (assorlod
Higl) is doassorlod. If povor is cycIod, IOWIRGOOD loggIos and causos
IIRST# lo assorl and doassorl. Tlis is llo CoId Rosol. If llo syslom providos a
mollod of loggIing IOWIRGOOD villoul cycIing llrougl povor (as via a
bullon on llo classis) llon aIso IIRST# assorls and doassorls. Tlis is llo Warm
Rosol.
Tlo IIRST# signaI foods aII ICI Ixpross dovicos on llo mollorboard incIuding
llo connoclors and graplics conlroIIor. Dovicos may clooso lo uso IIRST# bul
aro nol roquirod lo uso il as llo sourco of rosol.
Tlo IIRST# signaI aIso foods llo ICI Ixpross-lo-ICI-X bridgo slovn in llo fig-
uro. Tlo bridgo forvards llis rosol lo llo ICI-X bus as ICI-X bus RST#. ICH
aIso gonoralos IRST# for llo ICI bus.
- - A dovico
can bo dosignod lo gonoralo ils ovn IundamonlaI Rosol upon doloclion of
appIicalion (or ro-appIicalion) of main povor. Tlo spocificalion doos nol
doscribo llo moclanism for doing so. Tlo soIf rosol gonoralion moclanism can
bo buiIl inlo llo dovico or may bo dosignod as oxlornaI Iogic, for oxampIo, on a
add-in card llal dolocls Iovor-On and gonoralos a IocaI rosol lo llo dovico.
Tlo dovico musl aIso gonoralo an aulonomous IundamonlaI Rosol if il dolocls
ils povor go oulsido of llo Iimils spocifiod.
A dovico slouId supporl llo aulonomous mollod of lriggoring a IundamonlaI
Rosol givon llal llo spocificalion is nol cIoar aboul roquiromonl of syslom
IIRST# supporl.
-- -

Processor
Root Complex
DDR
SDRAM
IO Controller Hub
(ICH)
IEEE
1394
PCI Express
GFX
PCI
PCI Express
Add-In Add-In
GFX
FSB
PCI Express
Link
Switch
PCI Express
to-PCI-X
PCI-X
SCSI
Gigabit
Ethernet
PERST#
PRST#
PRST#
POWERGOOD
- -

In-Band Reset or Hot Reset

Hol Rosol is propagalod in-band via llo lransmission of TS1 Ordorod-Sols
(slovn in Iiguro 13-2) vill bil 0 of symboI 5 in llo TS1 Ordorod-Sol assorlod.
Tlo TS1 Ordorod-Sol is lransmillod on aII Ianos vill llo corrocl IinI # and
Iano# symboIs. Tloso TS1 Ordorod-Sols aro conlinuousIy lransmillod for 2 ms.
Boll lransmillor and rocoivor of Hol Rosol ond up in llo dolocl slalo (soo Hol
Rosol Slalo on pago 544). Hol Rosol, in gonoraI, is a soflvaro gonoralod rosol.
Hol Rosol is propagalod dovnslroam. Hol Rosol is nol propagalod upslroam.
Tlis moans llal onIy llo Rool CompIox and Svilclos aro abIo lo gonoralo Hol
Rosol. Indpoinls do nol gonoralo Hol Rosol. A svilcl llal rocoivos a Hol Rosol
TS1 Ordorod-Sol on ils upslroam porl musl pass il lo aII ils dovnslroam porls.
In addilion, llo svilcl rosols ilsoIf. AII dovicos dovnslroam of a svilcl llal
rocoivo llo Hol Rosol TS1 Ordorod-Sol viII rosol llomsoIvos.
Response to Receiving a Hot Reset Command
Wlon a dovico rocoivos a Hol Rosol command:
- Il goos lo llo Dolocl IinI Slalo (via llo Rocovory and Hol Rosol slalo) of
llo IinI Training slalo maclino and slarls llo IinI lraining procoss, foI-
Iovod by iniliaIizalion of VC0.
- Ils slalo maclinos, lardvaro Iogic, porl slalos and configuralion rogislors
(oxcopl slicIy rogislors) iniliaIizo lo lloir dofauIl condilions.
-
K28.5
D0.0-D31.7, K23.7 (0-255)
D0.0-D31.0, K23.7 (0-31)
D2.0 = 2.5 Gbit/s
TS ID
TS ID
TS ID
Train Ctl
Rate ID
# FTS
Lane #
Link #
COM
# of FTSs required by receiver to
obtain bit and symbol lock
D10.2 for TS1
D10.2 for TS1
D10.2 for TS1
0
1
2
3
4
5
6
14
15
13
Reserved Bit 4:7
0 = De-assert Disable Scrambling
1 = Assert Disable Scrambling
Bit 3
0 = De-assert Loopback
1 = Assert Loopback
Bit 2
0 = De-assert Disable Link
1 = Assert Disable Link
Bit 1
0 = De-assert Hot Reset
1 = Assert Hot Reset
Bit 0
Training Control
Reserved Bit 4:7
0 = De-assert Disable Scrambling
1 = Assert Disable Scrambling
Bit 3
0 = De-assert Loopback
1 = Assert Loopback
Bit 2
0 = De-assert Disable Link
1 = Assert Disable Link
Bit 1
0 = De-assert Hot Reset
1 = Assert Hot Reset
Bit 0
Training Control
-- -

Switches Generate Hot Reset on Their Downstream Ports

Tlo foIIoving aro a Iisl of buIIols llal indicalo vlon a svilcl gonoralos a Hol
Rosol on AII ils dovnslroam porls:
- Svilcl rocoivos a Hol Rosol on ils upslroam porl
- Tlo Dala IinI Iayor of llo svilcl upslroam porl roporls a DI_Dovn slalo.
Tlis slalo occurs vlon llo upslroam porl las boon disconnoclod or vlon
llo upslroam porl las Iosl connoclion vill an upslroam dovico duo lo an
orror llal is nol rocovorabIo by llo IlysicaI Iayor and Dala IinI Iayor.
- Soflvaro sols llo Socondary Bus Rosol bil of llo Bridgo ConlroI configura-
lion rogislor associalod vill llo upslroam porl.
Bridges Forward Hot Reset to the Secondary Bus
If a bridgo sucl as a ICI Ixpross-lo-ICI(-X) bridgo dolocls a Hol Rosol on ils
upslroam porl, il musl assorl llo IRST# signaI on ils socondary ICI(-X) bus.
How Does Software TeII a Device (e.g. Switch or Root Com-
pIex) to Generate Hot Reset?
Soflvaro loIIs a rool compIox or svilcl lo gonoralo a Hol Rosol on a spocific porl
by vriling a 1 foIIovod by 0 lo llo Socondary Bus Rosol bil in llo Bridgo Con-
lroI rogislor of llal associalod porls configuralion loador. Soo Iiguro 13-3 on
pago 493 for llo Iocalion of llis bil. Considor llo oxampIo slovn in Iiguro 13-4
on pago 494. Soflvaro vrilos a 1 lo llo Socondary Bus Rosol rogislor of Svilcl
As dovnslroam Iofl sido porl. Svilcl A gonoralos a Hol Rosol on llal porl by
forvarding TS1 Ordorod-Sols vill llo Hol Rosol bil sol. Svilcl A doos nol gon-
oralo a Hol Rosol on ils rigll sido porl. Svilcl B rocoivos llis Hol Rosol on ils
upslroam porl and forvards il on aII dovnslroam porls lo llo lvo ondpoinls.
If soflvaro vrilos lo llo Socondary Bus Rosol bil of llo svilcls upslroam porl,
llon llo svilcl gonoralos a Hol Rosol on AII ils dovnslroam porls. Considor
llo oxampIo slovn in Iiguro 13-5 on pago 495. Soflvaro vrilos a 1 lo llo Soc-
ondary Bus Rosol rogislor of Svilcl Cs upslroam porl. Svilcl C gonoralos a
Hol Rosol on AII dovnslroam porls by forvarding TS1 Ordorod-Sols vill llo
Hol Rosol bil sol on boll porls. Tlo ICI Ixpross-lo-ICI bridgo rocoivos llis Hol
Rosol and forvards il on lo llo ICI bus by assorling IRST#.
A dovico is in llo I0 slalo vlon llo Socondary Bus Rosol bil is sol. Tlo dovico
(upslroam dovico) llon goos llrougl llo Rocovory slalo of llo ITSSM (soo
Rocovory Slalo on pago 532) boforo il gonoralos llo TS1 Ordorod-Sols vill llo
Hol Rosol bil sol and llon onlors llo Hol Rosol slalo (soo Hol Rosol Slalo on
- -

pago 544). Tlo Hol Rosol TS1 Ordorod-Sols aro gonoralod conlinuousIy for 2 ms
and llon llo dovico oxils lo llo Dolocl slalo vloro il is roady lo slarl llo IinI
lraining and iniliaIizalion procoss.
Tlo rocoivor (dovnslroam dovico) of llo Hol Rosol TS1 Ordorod-Sols viII onlor
llo Hol Rosol slalo llrougl llo Rocovory slalo. Il oxils lo llo Dolocl slalo if il
rocoivos al Ioasl lvo Hol Rosol TS1 Ordorod-Sols. Boll upslroam and dovn-
slroam dovicos aro iniliaIizod and ond up in llo Dolocl slalo from vlicl lloy aro
roady lo boing IinI lraining and iniliaIizalion. If llo dovnslroam dovico is a
svilcl or bridgo, il passos on llo Hol Rosol lo ils dovnslroam porls or bus.
- - - -
Reserved
Prefetchable Base
Upper 32 Bits
Prefetchable Limit
Upper 32 Bits
Header
Type
Expansion ROM Base Address
Base Address 0
Base Address 1
Vendor
ID
Device
ID
Latency
Timer
00
01
02
03
04
05
06
07
08
09
10
11
12
13
14
15
Revision
ID
Class Code
Interrupt
Line
Interrupt
Pin
BIST
Status
Register
Command
Register
Required configuration registers
Doubleword
Number
(in decimal)
I/O Base
Upper 16 Bits
I/O Limit
Upper 16 Bits
Primary
Bus Number
Secondary
Bus Number
Subordinate
Bus Number
Secondary
Latency Timer
I/O
Base
I/O
Limit
Memory
Base
Memory
Limit
Prefetchable
Memory Base
Prefetchable
Memory Limit
Secondary
Status
Bridge
Control
Cache
Line
Size
0 1 2 3
Byte
Capability
Pointer
15 0 1 2 3 4 5 6 7 8
SERR# Enable
Parity Error Response
Fast Back-to-Back Enable
Secondary Bus Reset
Master Abort Mode
VGA Enable
ISA Enable
Primary Discard Timeout
Secondary Discard Timeout
Discard Timer Status
Discard Timer SERR# Enable
12 11 10 9
2.2 2.2 2.2 2.2 Reserved
-- -

- - -
Processor Processor
Root Complex
GFX
DDR
SDRAM
10Gb
Ethernet
PCI Express
to-PCI
PCI
SCSI
IEEE
1394
Gb
Ethernet
Switch A Switch C
Switch B
PCI Express
GFX
FSB
S
IO
COM1
COM2
S
IO
COM1
COM2
Add-In
Slots
1
Secondary Bus Reset
Bit Set
- -

- - - -
Processor Processor
Root Complex
GFX
DDR
SDRAM
10Gb
Ethernet
PCI Express
to-PCI
PCI
SCSI
IEEE
1394
Gb
Ethernet
Switch A Switch C
Switch B
PCI Express
GFX
FSB
S
IO
COM1
COM2
S
IO
COM1
COM2
Add-In
Slots
1
Secondary Bus Reset
Bit is Set
PRST#
-- -

Reset Exit
Aflor oxiling llo rosol slalo, IinI lraining and iniliaIizalion musl bogin villin
80 ms. Dovicos may oxil llo rosol slalo al difforonl limos, sinco rosol signaIing is
asynclronous. Tlis moans llal in facl lvo dovicos on opposilo onds of llo IinI
vlo aro rosol may nol slarl llo IinI lraining procoss al llo samo limo.
Aflor IinI Training and IniliaIizalion oacl dovico procoods llrougl IIov Con-
lroI iniliaIizalion for VC0, maIing il possibIo for TIIs and DIIIs lo bo lrans-
forrod across llo IinI.
To aIIov compononls vlo lavo boon rosol lo porform inlornaI iniliaIizalion,
syslom soflvaro musl vail for al Ioasl 100 ms from llo ond of a rosol (coId/
varm/lol) boforo issuing Configuralion Roquosls lo ICI Ixpross dovicos. To bo
soflvaro visibIo, dovicos musl bo roady lo rocoivo configuralion roquosl aflor
100 ms from llo ond of Rosol. Tlo spocificalion doos nol addross lov soflvaro
moasuros llis vail limo of 100 ms. Il couId bo as simpIo as soflvaro slarls a sofl-
varo Ioop al llo ond of vlicl llo firsl configuralion roquosl is inilialod.
If soflvaro inilialos a configuralion roquosl lo a dovico aflor llo 100 ms vail
limo from llo ond of Rosol and llo dovico is nol dono vill ils inlornaI iniliaIiza-
lion, il musl al Ioasl rolurn a compIolion TII, vill a compIolion slalus of Con-
figuralion Roquosl Rolry Slalus (CRRS). Tlo compIolion is rolurnod lo llo rool
compIox vlo inilialod llo configuralion roquosl on llo bolaIf of llo CIU. Tlo
compIolion TII lorminalos llo configuralion roquosl. Iillor llo rool compIox
may ro-issuo llo configuralion roquosl or lavo llo CIU rolry llo roquosl again.
Tlo Rool CompIox and/or syslom soflvaro musl aIIov 1.0 socond (+50/-0)
aflor a rosol boforo il may dolormino llal a dovico vlicl faiIs lo rolurn a suc-
cossfuI CompIolion slalus for a vaIid Configuralion Roquosl is broIon. Tlis
doIay is anaIogous lo llo Trlfa paramolor spocifiod for ICI/ICI-X, and is
inlondod lo aIIov sufficionl limo for dovicos lo compIolo soIf iniliaIizalion.
- -

Link Wakeup from L2 Low Power State

Wlon a dovicos IinI is in llo I2 Iov povor slalo, ils main povor is lurnod off
llougl V
aux
is sliII appIiod. A dovico rolurns lo llo fuII-on I0 povor slalo by
ono of lvo mollods. Iillor llo dovico signaIs a vaIoup ovonl or Iovor Man-
agomonl soflvaro lriggors llo vaIoup procoduro WaIing Non-Communical-
ing IinIs on pago 642.
Device SignaIs Wakeup
Tlo povorod dovn dovico (dovico(s) aro in D3
CoId
vill V
aux
vaIid) vloso IinI
is in I2 slalo, is abIo lo signaI a vaIoup ovonl oillor llrougl signaIing a Boacon
(soo Boacon SignaIing on pago 469) upslroam lovards llo rool compIox or by
assorling WAKI#. Tlo vaIoup ovonl uIlimaloIy rosuIls in llo povor conlroIIor
ro-appIying povor and cIocI lo llo dovico (or group of dovicos) vlo signaIod
llo vaIoup. Tlo povor conlroIIor aIso causos (oillor aulonomousIy or undor
soflvaro conlroI) a IIRST# Rosol lo llo dovico or group of dovicos vloso
povor and cIocI las boon ro-appIiod. If llo dovico doos nol supporl IIRST#, il
musl aulonomousIy gonoralo ils ovn IundamonlaI Rosol vlon il sonsos main
povor ro-appIiod lo il. Upon oxil from IundamonlaI Rosol, llo dovico procoods
vill IinI lraining and iniliaIizalion. Tlo dovico, vlicl is nov in llo
D0
uninliaIizod
slalo, can nov sond a IM_IMI TII mossago upslroam lo llo rool
compIox lo inform Iovor Managomonl soflvaro of llo vaIoup ovonl.
Power Management Software Generates Wakeup Event
Iovor Managomonl soflvaro can vaIo up a dovico or group of dovicos
(dovico(s) aro in D3
CoId
) vloso IinI is in I2 slalo. Iovor Managomonl soflvaro
causos llo povor conlroIIor lo ro-appIy povor and cIocI lo llo dovico or group
of dovicos. Tlo povor conlroIIor aIso causos (oillor aulonomousIy or undor
soflvaro conlroI) a IIRST# Rosol. If llo dovico doos nol supporl IIRST#, il
musl aulonomousIy gonoralo ils ovn IundamonlaI Rosol vlon il sonsos main
povor ro-appIiod lo il. Upon oxil from IundamonlaI Rosol, llo dovico procoods
vill IinI lraining and iniliaIizalion. Tlo dovico is nov in llo D0
uninliaIizod
slalo. Il viII lavo lo bo configurod lo bring il lo llo D0 slalo.
499


The Previous Chapter
Tlo provious claplor doscribod llroo lypos of syslom rosol gonoralion capabiIi-
lios: coId rosol, varm rosol and lol rosol. Tlo claplor aIso doscribod llo usago
of llo sido-band rosol signaI IIRST#. Tlo offocl of rosol on a dovico and syslom
vas doscribod.
This Chapter
Tlis claplor doscribos llo funclion of llo IinI Training and Slalus Slalo
Maclino (ITSSM) of llo IlysicaI Iayor. Tlo claplor doscribos llo iniliaIizalion
procoss of llo IinI from Iovor-On or Rosol, unliI llo fuII-on I0 slalo, vloro
lraffic on llo IinI can bogin. In addilion, llo claplor doscribos llo Iovor povor
managomonl slalos I0s, I1, I2, I3 and briofIy doscribos onlry and oxil proco-
duro lo/from lloso slalos.
The Next Chapter
Tlo noxl claplor doscribos llo moclanicaI form faclor for llo ICI Ixpross con-
noclor and add-in card. Difforonl sIol form faclors aro dofinod lo supporl x1, x4,
x8 and x16 Iano vidlls. In addilion, llo noxl claplor doscribos llo Mini ICI
Ixpross form faclor vlicl largols llo mobiIo marIol, Sorvor IO ModuIo (SIOM)
form faclor vlicl largols llo vorIslalion and sorvor marIol, and llo NIW-
CARD form faclor vlicl largols boll mobiIo and dosIlop marIols.
PCI Express System Architecture
500
Link InitiaIization and Training Overview
GeneraI
IinI iniliaIizalion and lraining is a IlysicaI Iayor conlroI procoss llal config-
uros and iniliaIizos a dovicos IlysicaI Iayor, porl, and associalod IinI so llal
normaI pacIol lraffic can procood on llo IinI. Tlis procoss is aulomalicaIIy ini-
lialod aflor rosol villoul any soflvaro invoIvomonl. A sub-sol of llo IinI lrain-
ing and iniliaIizalion procoss, roforrod lo as IinI ro-lraining, is inilialod
aulomalicaIIy as a rosuIl of a vaIoup ovonl from a Iov povor modo, or duo lo
an orror condilion llal rondors llo IinI inoporabIo. Tlo IinI Training and Sla-
lus Slalo Maclino (ITSSM) is llo IlysicaI Iayor sub-bIocI rosponsibIo for llo
IinI lraining and iniliaIizalion procoss (soo Iiguro 14-1).X
A rocoivor may oplionaIIy clocI for vioIalions of llo IinI lraining and iniliaI-
izalion prolocoI. If sucl an orror occurs, il may bo roporlod as a IinI Training
Irror lo llo orror roporling Iogic (soo IinI Irrors on pago 379).
Tlo foIIoving aro configurod during llo IinI lraining and iniliaIizalion pro-
coss:
- is oslabIislod and sol. Tvo dovicos vill a difforonl numbor of
porl Ianos may bo connoclod. Ior oxampIo, ono dovico vill a x2 porl may
bo connoclod lo a dovico vill a x4 porl. During IinI lraining and iniliaIiza-
lion, llo IlysicaI Iayor of boll dovicos dolorminos and sols llo IinI vidll
lo llo minimum Iano vidll of llo lvo (i.o., x2). Ollor IinI nogolialod
bolaviors incIudo Iano rovorsaI, spIilling of porls inlo muIlipIo IinIs, and
llo configuralion of a cross-IinI.
- - on a muIli-Iano dovicos porl (if rovorsaI is roquirod). Tlo
Ianos on a dovicos porl aro numborod by dosign. Wlon viring up a IinI lo
connocl lvo dovicos, a board dosignor slouId malcl up llo Iano numbors of
oacl dovicos porl so llal Iano 0 of ono dovicos porl connocls lo Iano 0 of
llo romolo dovicos porl, Iano lo Iano of llo romolo dovicos porl, and
so on.
Chapter 14: Link Initialization & Training
501
Duo lo llo vay llo Ianos aro organizod on llo pins of llo dovicos pacIago,
il may nol bo possibIo lo malcl up llo Ianos of llo lvo dovicos villoul
crisscrossing llo viros (soo Iiguro 14-2 on pago 502). Crisscrossod viros
viII inlroduco inlorforonco inlo llo IinI. If lovovor, ono or boll of llo
dovicos supporl Iano RovorsaI, llo dosignor couId viro llo Ianos in paraI-
IoI faslion. During llo IinI lraining and iniliaIizalion procoss, ono dovico
rovorsos llo Iano numboring so llo Iano numbors of llo lvo porls vouId
malcl up (Iiguro 14-2 on pago 502). UnforlunaloIy, llo spocificalion doos
nol roquiro dovicos lo supporl llo Iano RovorsaI foaluro. Honco, llo
-
Port
Memory, I/O, Configuration R/W Requests or Message Requests or Completions
(Software layer sends / receives address/transaction type/data/message index)
Software layer
Transaction layer
Header Data Payload ECRC
Receive
Buffers
per VC
Transmit
Buffers
per VC
Data Link layer
Physical layer
Serial-to-Parallel Parallel-to-Serial
Differential Receiver Differential Driver
Link Packet Start End Link Packet Start End
Decode Encode
Transaction Layer Packet (TLP)
TLP Error
Check
TLP Replay
Buffer
Physical Packet Physical Packet
Link Packet
Sequence TLP LCRC ACK/NAK
DLLPs e.g.
CRC
Header Data Payload ECRC
Transaction Layer Packet (TLP)
Link Packet
Sequence TLP LCRC
De-mux
Mux
Transmit Receive
Flow Control
Virtual Channel
Management
Ordering
Link
Training
(LTSSM)
ACK/NAK
DLLPs
CRC
PCI Express System Architecture
502
dosignor musl vorify llal al Ioasl ono of llo lvo dovicos connoclod via a
IinI supporls llis foaluro boforo viring llo Ianos of llo lvo porls in
rovorso ordor. If llo dovico supporls llis foaluro, llo Iano RovorsaI procoss
may pormil a muIli-Iano IinI lo bo spIil inlo muIlipIo IinIs llal connocl lo
muIlipIo dovicos. Moro on llis foaluro Ialor.
- - may bo nocossary. Tlo D+ and D- difforonliaI pair lormi-
naIs for lvo dovicos may nol bo connoclod corroclIy, or may bo inlonlionaIIy
rovorsod so llal llo signaIs do nol crisscross vlon viring llo IinI. If Ianos
aro virod vill D+ and D- of ono dovico virod lo D- and D+ of llo romolo
dovico, rospoclivoIy, llo IoIarily Invorsion foaluro rovorsos llo D+ and D-
signaI poIarilios of llo rocoivor difforonliaI lorminaI. Iiguro 14-3 iIIuslralos
llo bonofil of llis foaluro on a x1 IinI. Supporl for IoIarily Invorsion is
mandalory.
-
Device A
(Upstream Device)
Device B
(Downstream Device)
0 1 2 3 0 1 2 3
0 1 2 3 0 1 2 3
Device A
(Upstream Device)
Device B
(Downstream Device)
0 1 2 3 0 1 2 3
3 2 1 0 3 2 1 0
Neither device A nor B
supports Lane Reversal
Device B
supports Lane Reversal
3 2 1 0 3 2 1 0 Before Lane
Reversal
After Lane
Reversal
Board designer has to crisscross
Lanes to wire Link correctly. Link
introduces signal interference
Board designer can wire Link with
parallel wires. Lane Reversal reverses
order of Bs Lane numbers so that Lane
Numbers now match up
Example 1 Example 2
Chapter 14: Link Initialization & Training
503
-
- --
- - - -
-- - - -
- - -
- - -
-- - -

- - - -
- - -

- -
--
- - -
- - -- -
-
- -
--
-- - - --
- -
- - - - -
- - --
- - -
- - - --
-
Device A
(Upstream Device)
Device B
(Downstream Device)
D+D- D+D-
D- D+ D- D+
Before and After Polarity Inversion
Before Polarity
Inversion
After Polarity
Inversion D+D-
D+ D-
After Polarity
Inversion
PCI Express System Architecture
504
llo dosignors lasI of viring up llo ligl spood IinI.
Ordered-Sets Used During Link Training and InitiaIization
IlysicaI Iayor IacIols (IIIs), roforrod lo as Ordorod-Sols, aro oxclangod
bolvoon noiglboring dovicos during llo IinI lraining and iniliaIizalion pro-
coss. Tloso pacIols voro briofIy doscribod in llo soclion on Ordorod-Sols on
pago 433. Tlo fivo Ordorod-Sols aro:
- Training Soquonco 1 and 2 (TS1 and TS2),
- IIoclricaI IdIo,
- Iasl Training Soquonco (ITS), and
- SIip (SKII) Ordorod-Sols.
Tloir claraclor slrucluro is summarizod in Iiguro 14-4 on pago 504.
- - --
TS1 or TS2
K28.5
D0.0-D31.7, K23.7 (0-255)
D0.0-D31.0, K23.7 (0-31)
D2.0 = 2.5 Gbit/s
TS ID
TS ID
TS ID
Train Ctl
Rate ID
N_FTS
Lane #
Link #
COM
Number of FTSs required by receiver
to obtain bit and symbol lock
D10.2 for TS1, D5.2 for TS2
D10.2 for TS1, D5.2 for TS2
D10.2 for TS1, D5.2 for TS2
0
1
2
3
4
5
6
14
15
13
COM
IDL
IDL
IDL
Electrical IDLE
K28.5
K28.3
K28.3
K28.3
COM
FTS
FTS
FTS
FTS
K28.5
K28.1
K28.1
K28.1
COM
SKP
SKP
SKP
K28.5
K28.0
K28.0
K28.0
SKIP
Reserved Bit 4:7
0 = De-assert Disable Scrambling
1 = Assert Disable Scrambling
Bit 3
0 = De-assert Loopback
1 = Assert Loopback
Bit 2
0 = De-assert Disable Link
1 = Assert Disable Link
Bit 1
0 = De-assert Hot Reset
1 = Assert Hot Reset
Bit 0
Training Control
Reserved Bit 4:7
0 = De-assert Disable Scrambling
1 = Assert Disable Scrambling
Bit 3
0 = De-assert Loopback
1 = Assert Loopback
Bit 2
0 = De-assert Disable Link
1 = Assert Disable Link
Bit 1
0 = De-assert Hot Reset
1 = Assert Hot Reset
Bit 0
Training Control
Chapter 14: Link Initialization & Training
505
TS1 and TS2 Ordered-Sets
Tlo TS1 and TS2 Ordorod-Sols aro oacl comprisod up of 16 symboIs. Slruclur-
aIIy, lloro is nol mucl difforonco bolvoon a TS1 and TS2 Ordorod-Sol, ollor
llan llo TS Idonlifior (symboIs 6-15) vlicl conlains a D10.2 for TS1 and D5.2
for llo TS2 Ordorod-Sol. Tloy aro oxclangod during llo IoIIing, Configuralion
and Rocovory slalos of llo ITSSM doscribod in IinI Training and Slalus Slalo
Maclino (ITSSM) on pago 508. Tlo TS1 and TS2 symboIs consisl of:
- Tlo K28.5 claraclor idonlifios llo slarl of an Ordorod-Sol.
Tlo rocoivor usos llis claraclor lo acliovo Bil IocI and SymboI IocI as
doscribod in Aclioving Bil IocI on pago 440 and SymboI Boundary
Sonsing (SymboI IocI) on pago 441. By Iocaling llis claraclor on a syn-
clronizod lransmission of TS1 or TS2 Ordorod-Sols on a muIli-Iano IinI,
llo rocoivor can do-sIov llo Ianos.
- In llo oarIy slagos of IinI lraining, vlon llo TS1 and
TS2 Ordorod-Sols aro oxclangod, llis fioId conlains llo IAD symboI (lrans-
millod as a nuII symboI). During llo configuralion slalo of llo ITSSM, llis
fioId conlains an assumod IinI Numbor. TS1 and TS2 Ordorod-Sols drivon
from difforonl porls of a svilcl conlain difforonl IinI Numbors.
- In llo oarIy slagos of IinI lraining vlon llo TS1 and
TS2 Ordorod-Sols aro oxclangod, llis fioId conlains llo IAD symboI (lrans-
millod as a nuII symboI). During llo configuralion slalo of llo ITSSM, llis
fioId conlains an assumod Iano Numbor for oacl Iano of a IinI. Tlo TS1
and TS2 Ordorod-Sols drivon on oacl Iano of a givon IinI conlain difforonl
numbors.
- Conlains llo numbor of Iasl Training Soquoncos. Tlo
oxclango of ITS Ordorod-Sols is usod lo acliovo Bil IocI and SymboI IocI
vlon oxiling from llo I0s lo llo I0 povor slalo. During IinI lraining al
IinI iniliaIizalion, vlon TS1 or TS2 Ordorod-Sols aro oxclangod, llo
rocoivor sonds llo romolo lransmillor llo N_ITS fioId lo indicalo lov many
ITS Ordorod-Sols il musl rocoivo lo roIiabIy oblain Bil and SymboI IocI.
Armod vill llis informalion, llo lransmillor sonds al Ioasl llal many ITS
Ordorod-Sols during oxil from llo I0s slalo. A lypicaI vaIuo is bolvoon lvo
and four. Tlis impIios llal llo lransmillor musl sond al Ioasl llal many ITS
Ordorod-Sols during oxil from llo I0s slalo. Ior oxampIo, N_ITS = 4 lrans-
Ialos lo 4 ITS Ordorod-Sols = 4 x 4 symboIs = 16 x 4ns/symboI = 64ns, llo
poriod of limo il laIos llo rocoivors III lo acliovo Bil and SymboI IocI
during oxil from llo I0s slalo. Wlon llo Ixlondod Syncl bil is sol in llo
lransmillor dovico, 4096 ITS Ordorod-Sols musl bo sonl in ordor lo provido
oxlornaI IinI moniloring looIs vill onougl limo lo acliovo Bil and SymboI
PCI Express System Architecture
506
IocI synclronizalion. During llo ITS Ordorod sol oxclango, if llo N_ITS
poriod of limo oxpiros and llo Rocoivor las nol yol oblainod Bil IocI, Sym-
boI IocI, and Iano-lo-Iano do-sIov on aII Ianos of llo configurod IinI,
llo Rocoivor musl lransilion lo llo Rocovory slalo of llo ITSSM.
- Iacl dovico informs ils noiglbor vlal dala lransfor
ralo il supporls. A vaIuo of D2.0 indicalos a 2.5Gbils/s lransfor ralo, vliIo
ollor vaIuos aro curronlIy rosorvod.
- A dovico llal sonds TS1 and TS2 Ordorod-
Sols usos llis symboI lo communicalo addilionaI informalion sucl as:
Bil 0, vlon sol, indicalos Hol Rosol.
Bil 1, vlon sol, indicalos IinI DisabIo.
Bil 2, vlon sol, indicalos InabIo IoopbacI.
Bil 3, vlon sol, indicalos disabIo scrambIing.
Tlo romaindor of llo bils aro rosorvod.
OnIy ono bil can bo sol in llis fioId por Ordorod-Sol.
- Drivon vill D10.2 for TS1 Ordorod-
Sols and D5.2 for TS2 Ordorod-Sols.
Soo TabIo 14-1 for a summary of llis informalion.
-

-
0 Comma K28.5 Tlis is llo COM (Comma) symboI.
1 0-255 D0.0 - D31.7,
K23.7 (IAD)
IinI Numbor. Usos llo IAD symboI
vlon lloro is no IinI Numbor lo
communicalo.
2 0-31 D0.0 - D31.0,
K23.7 (IAD)
Iano Numbor. Uso llo IAD symboI
vlon no lloro is no Iano Numbor lo
communicalo.
3 0-255 D0.0 - D31.7 N_ITS. Tlis is llo numbor of ITS
Ordorod-Sols roquirod by rocoivor lo
oblain Bil and SymboI IocI during
oxil from llo I0s slalo.
Chapter 14: Link Initialization & Training
507
EIectricaI IdIe Ordered-Set
Tlo IIoclricaI IdIo Ordorod-Sol consisls of four symboIs, slarling vill llo COM
symboI and foIIovod by llroo IDI symboIs. Tlis Ordorod-Sol is lransmillod lo a
rocoivor prior lo llo lransmillor pIacing ils lransmil laIf of llo IinI in llo IIoc-
lricaI IdIo slalo. Tlo rocoivor dolocls llis Ordorod-Sol, do-galos ils orror doloc-
lion Iogic and proparos for llo IinI lo go lo llo IIoclricaI IdIo slalo. SlorlIy aflor
lransmilling llo IIoclricaI IdIo Ordorod-Sol, llo lransmillor drivos a difforonliaI
voIlago of Ioss llan 20mV poaI. Ior moro dolaiIs on IIoclricaI IdIo Ordorod-Sol
usago and llo IIoclricaI IdIo IinI slalo, soo IIoclricaI IdIo on pago 464 .
FTS Ordered-Set
Tlo ITS Ordorod-Sol consisls of four symboIs, slarling vill llo COM symboI
and foIIovod by llroo ITS symboIs. A lransmillor llal vislos lo lransilion llo
slalo of ils IinI from llo I0s Iov povor slalo (IIoclricaI IdIo) lo llo I0 slalo
sonds a dofinod numbor of ITS Ordorod-Sols lo llo rocoivor. Tlo minimum
numbor of ITS Ordorod-Sols llal llo lransmillor musl sond lo llo rocoivor is
sonl lo llo lransmillor by llo rocoivor during IinI lraining and iniliaIizalion.
Soo TS1 and TS2 Ordorod-Sols on pago 505, SymboI 3.
4 2 D2.0 Dala Ralo Idonlifior:
- Bil 0 = Rosorvod.
- Bil 1 = 1, Gonoralion1 (2.5Gbils/s).
- Bils 7:2 = Rosorvod.
5 Bil 0 = 0,1
Bil 1 = 0,1
Bil 2 = 0,1
Bil 3 = 0,1
Bil 4:7 = 0
D0.0, D1.0, D2.0,
D4.0, D8.0
Training ConlroI. 0=Do-assorl, 1 =
Assorl:
- Bil 0 - Hol Rosol,
- Bil 1 - DisabIo IinI
- Bil 2 - InabIo IoopbacI
- Bil 3 - DisabIo ScrambIing
- Bil 4:7 - Rosorvod, Sol lo 0
6-15 D10.2 for TS1 ID
D5.2 for TS2 ID
TS1/TS2 Ordorod-Sol Idonlifior.
-

-
PCI Express System Architecture
508
SKIP Ordered-Set
Tlo SIip Ordorod-Sol consisls of four symboIs, slarling vill llo COM symboI
and foIIovod by llroo SKI symboIs. Il is lransmillod al roguIar inlorvaIs from
llo lransmillor lo llo rocoivor and is usod for CIocI ToIoranco Componsalion as
doscribod in Insorling CIocI Componsalion Zonos on pago 436 and Rocoivor
CIocI Componsalion Iogic on pago 442.
Link Training and Status State Machine (LTSSM)
GeneraI
Iiguro 14-5 on pago 510 iIIuslralos llo lop-IovoI slalos of llo IinI Training and
Slalus Slalo Maclino (ITSSM). Iacl slalo consisls of subslalos llal, laIon
logollor, compriso llal slalo. Tlo firsl ITSSM slalo onlorod aflor oxiling Iunda-
monlaI Rosol (CoId or Warm Rosol) or Hol Rosol is llo Dolocl slalo.
Tlo ITSSM consisls of 11 lop-IovoI slalos: Dolocl, IoIIing, Configuralion, Rocov-
ory, I0, I0s, I1, I2, Hol Rosol, IoopbacI, and DisabIo. Tloso slalos can bo
groupod inlo fivo calogorios:
1. Tlo IinI Training slalos.
2. A IinI Ro-Training Slalo.
3. Tlo Iovor Managomonl slalos.
4. Tlo Aclivo Iovor Managomonl slalos, and
5. Ollor slalos.
Upon any lypo of Rosol oxil, llo fIov of llo ITSSM is llrougl llo foIIoving
--:
Dolocl => IoIIing => Configuralion => I0
Chapter 14: Link Initialization & Training
509
If a IinI orror occurs vliIo in llo I0 slalo and il rondors llo IinI inoporabIo,
llo ITSSM lransilions lo llo - (llo Rocovory slalo). In llis
slalo, llo IinI is rolrainod and rolurnod lo normaI oporalion (i.o., llo I0 slalo).
A IinI llal is pIacod in a Iov povor slalo (sucl as I1 or I2), rolurns lo llo I0
slalo via llo Rocovory slalo.
Willoul any ligl-IovoI soflvaro invoIvomonl, if lloro aro no pacIols lransmil-
lod on llo IinI (i.o., if llo IogicaI IdIo Soquonco is lransmillod) and a limo-oul
occurs, llo dovico may pIaco ils IinI inlo a Iov povor slalo sucl as I0s or I1.
Tloso aro llo slalos.
Iovor managomonl soflvaro may pIaco a dovico inlo ono of llo Iovor dovico
povor slalos sucl as D1, D2, D3
Hol
or D3
CoId
. Doing so causos llo IinI lo lran-
silion from I0 lo ono of llo Iovor -- sucl as I1 or I2.
WliIo in llo Configuralion or llo Rocovory slalo, a IinI can bo diroclod lo onlor
llo DisabIo slalo or llo IoopbacI slalo. WliIo in llo Rocovory slalo, a dovico
llal rocoivos llo IIoclricaI IdIo Ordorod-Sol lransils llrougl llo Hol Rosol slalo
boforo going lo llo Dolocl slalo. Tlo llroo slalosDisabIo, IoopbacI, and Hol
Rosolaro parl of llo -- group.
PCI Express System Architecture
510
-
Chapter 14: Link Initialization & Training
511
Overview of LTSSM States
BoIov is a briof doscriplion of llo 11 ITSSM slalos:
- Tlis is llo iniliaI slalo aflor rosol. WliIo llo spoc slalos llal llo
ITSSM may aIso onlor llo Dolocl slalo as diroclod by llo Dala IinI Iayor, il
doos nol indicalo undor vlal circumslancos llis vouId occur. In llis slalo, a
dovico dolocls llo prosonco or absonco of a dovico connoclod al llo far ond
of llo IinI. Tlo Dolocl slalo may aIso bo onlorod from a numbor of ollor
ITSSM slalos as doscribod Ialor in llis claplor.
- Tlo foIIoving condilions aro oslabIislod during llo IoIIing slalo:
Bil IocI.
SymboI IocI.
Iano IoIarily.
Iano Dala Ralo.
CompIianco losling aIso occurs in llis slalo.
During compIianco losling, llo lransmillor oulpuls a spocifiod compIi-
anco pallorn. Tlis is inlondod lo bo usod vill losl oquipmonl lo vorify
llal aII of llo voIlago, noiso omission and liming spocificalions aro
villin loIoranco. During llo IoIIing slalo, a dovico lransmils TS1 and
TS2 Ordorod-Sols and rosponds lo rocoivod TS1 and TS2 Ordorod-Sols.
Higlor bil ralo supporl is advorlisod via llo oxclango of TS1 and TS2
Ordorod-Sols vill llo Ralo ID fioId = llo liglosl supporlod ralo.
- Tlo foIIoving condilions aro oslabIislod during llo Config-
uralion slalo:
IinI vidll.
IinI Numbor.
Iano rovorsaI.
IoIarily invorsion (if nocossary).
Iano-lo-Iano do-sIov is porformod.
Boll lransmillor and rocoivor aro communicaling al llo nogolialod dala
ralo (as of 6/16/03, llo gonoralion 1 dala ralo of 2.5Gb/s). During llis
slalo, scrambIing can bo disabIod, llo DisabIo and IoopbacI slalos can
bo onlorod, and llo numbor of ITS Ordorod-Sols roquirod lo lransilion
from llo I0s slalo lo llo I0 slalo is oslabIislod.
- Tlis is llo normaI, fuIIy aclivo slalo of a IinI during vlicl TIIs,
DIIIs and IIIs can bo lransmillod and rocoivod.
- Tlis slalo is onlorod from llo I0 slalo duo lo an orror llal rondors
llo IinI inoporabIo. Rocovory is aIso onlorod from llo I1 slalo vlon llo
IinI noods ro-lraining boforo il lransilions lo llo I0 slalo. In Rocovory, Bil
IocI and SymboI IocI aro ro-oslabIislod in a mannor simiIar lo llal usod in
PCI Express System Architecture
512
llo IoIIing slalo. Hovovor, llo limo lo lransilion llrougl llis slalo is mucl
slorlor llan laving lo go llrougl llo IoIIing slalo and llon lransilioning lo
llo I0 slalo. Iano-lo-Iano do-sIov is porformod. Tlo numbor of ITS
Ordorod-Sols roquirod lo lransilion from llo I0s slalo lo llo I0 slalo is ro-
oslabIislod.
- - Tlis is a Iov povor, Aclivo Iovor Managomonl slalo. Il laIos a vory
slorl limo (in llo ordor of 50ns) lo lransil from llo I0s slalo bacI lo llo I0
slalo (bocauso llo ITSSM doos nol lavo lo go llrougl llo Rocovory slalo).
Tlis slalo is onlorod aflor a lransmillor sonds and llo romolo rocoivor
rocoivos IIoclricaI IdIo Ordorod-Sols vliIo in llo I0 slalo. Ixil from llo I0s
slalo lo llo I0 slalo invoIvos sonding and rocoiving ITS Ordorod-Sols.
Wlon lransilioning from I0s oxil lo I0, Iano-lo-Iano do-sIov musl bo por-
formod, and Bil and SymboI IocI musl bo ro-oslabIislod.
- Tlis is an ovon Iovor povor slalo llan I0s. I1 oxil Ialoncy (via Rocov-
ory) is Iongor comparod lo I0s oxil Ialoncy (soo IIoclricaI IlysicaI Iayor
Slalo in Iovor Slalos on pago 481). Inlry inlo I1 can occur in ono of lvo
vays:
Tlo firsl is aulomalic and doos nol invoIvo liglor-IovoI soflvaro. A
dovico vill no scloduIod TIIs or DIIIs lo lransmil can aulomalicaIIy
pIaco ils IinI in llo I1 slalo aflor firsl boing in llo I0 slalo (vliIo llo
dovico romains in llo D0 povor slalo).
Tlo socond is as a rosuIl of commands rocoivod from llo povor man-
agomonl soflvaro pIacing a dovico inlo a Iovor povor dovico slalo (D1,
D2, or D3
Hol
). Tlo dovico aulomalicaIIy pIacos ils IinI in llo I1 slalo.
- Tlis is llo Iovosl povor slalo. Mosl of llo lransmillor and rocoivor Iogic
is povorod dovn (vill llo oxcoplion of llo rocoivor lorminalion, vlicl
musl bo povorod for llo rocoivor lo bo in a Iov impodanco slalo). Main
povor and llo cIocI aro nol guaranlood, llougl V
aux
povor is avaiIabIo.
Wlon Boacon supporl is roquirod by llo associalod syslom or form faclor
spocificalion, an upslroam porl llal supporls llis vaIoup capabiIily musl
bo abIo lo sond llo Boacon signaI and a dovnslroam porl musl bo abIo lo
dolocl llo Boacon signaI (soo Boacon SignaIing on pago 469). Boacon sig-
naIing or llo WAKI# signaI is usod by a dovico in llo D3
CoId
slalo lo lriggor
a syslom vaIoup ovonl (i.o., a roquosl for main povor suppIy ro-aclivalion).
Anollor povor slalo dofinod by llo spocificalion is llo I3 slalo, bul llis
slalo doos nol roIalo lo llo ITSSM slalos. Tlo I3 IinI slalo is llo fuII-off
slalo vloro llo V
aux
povor signaI is nol avaiIabIo. A dovico in I3 cannol
lriggor a vaIoup ovonl unIoss povor is ro-appIiod lo llo dovico llrougl
somo ollor moclanism.
- Tlis slalo is usod as a losl and fauIl isoIalion slalo. OnIy onlry
and oxil of llis slalo is spocifiod. Tlo dolaiIs of vlal occurs in llis slalo aro
unspocifiod. Tosling can occur on a por Iano basis or on llo onliro config-
Chapter 14: Link Initialization & Training
513
urod IinI. Tlo IoopbacI Maslor dovico sonds TS1 Ordorod-Sols lo llo
IoopbacI SIavo vill llo IoopbacI bil sol in llo TS1 Training ConlroI fioId.
Tlo IoopbacI SIavo onlors IoopbacI vlon il rocoivos lvo consoculivo TS1
Ordorod-Sols vill llo IoopbacI bil sol. Hov llo IoopbacI Maslor onlors
inlo llo IoopbacI slalo is dovico spocific. Onco in llo IoopbacI slalo, llo
Maslor can sond any pallorn of symboIs, as Iong as llo 8b/10b oncoding
ruIos aro foIIovod.
- - Tlis slalo aIIovs a configurod IinI lo bo disabIod (o.g., duo lo a
surpriso romovaI of llo romolo dovico). In llis slalo, llo lransmillor drivor
is in llo oIoclricaI ligl impodanco slalo and llo rocoivor is onabIod and in
llo Iov impodanco slalo. Soflvaro commands a dovico lo onlor llo DisabIo
slalo by solling llo DisabIo bil in llo IinI ConlroI rogislor. Tlo dovico llon
lransmils 16 TS1 Ordorod-Sols vill llo DisabIo IinI bil sol in llo TS1 Train-
ing ConlroI fioId. A connoclod rocoivor is DisabIod vlon il rocoivos TS1
Ordorod-Sols vill llo DisabIo IinI bil sol.
- - Tlis slalo is onlorod vlon diroclod lo do so by a dovicos liglor
Iayor, or vlon a dovico rocoivos lvo, consoculivo TS1 Ordorod-Sols vill llo
Hol Rosol bil sol in llo TS1 Training ConlroI fioId (soo In-Band Rosol or
Hol Rosol on pago 491).
DetaiIed Description of LTSSM States
Tlo subsoclions llal foIIov provido a doscriplion of oacl of llo ITSSM slalos.
Mosl of llo 11 ITSSM slalos aro dividod inlo lvo or moro subslalos. SubSlalo
diagrams aro usod in llo dicussions llal foIIov lo iIIuslralo llo subslalos.
Detect State
Tlis slalo is llo iniliaI slalo al povor-on limo aflor a IundamonlaI Rosol or aflor
a Hol Rosol command gonoralod by llo Soflvaro Iayor. Inlry inlo llis slalo
musl occur villin 80ms of Rosol as doscribod in Rosol Ixil on pago 496. Tlo
Dolocl slalo can aIso bo onlorod from llo DisabIo, IoopbacI or I2 slalos. Tlo
Dolocl slalo is onlorod if llo Configuralion, Rocovory or IoIIing slalos do nol
compIolo sucossfuIIy. Iiguro 14-6 slovs llo Dolocl subslalo maclino.
Detect.Quiet SubState

Irom IundamonlaI Rosol or Hol Rosol. AIso from I2, IoopbacI, DisabIo, IoII-
ing, Configuralion and Rocovory slalos.
PCI Express System Architecture
514

- Tlo lransmillor is in llo IIoclricaI IdIo slalo. Tlo IIoclricaI IdIo Ordorod-Sol
doos nol lavo lo bo lransmillod boforo pIacing llo IinI in llo IIoclricaI IdIo
slalo.
- Tlo lransmillor drivos a DC common modo voIlago (il doos nol lavo lo
mool llo 0 - 3.6 V spocificalion).
- 2.5Gbil/s (Gonoralion 1) lransfor ralo is iniliaIizod (bul llis is nol llo ralo
llal viII nocossariIy bo advorlisod via llo TS1 and TS2 Ordorod-Sols).
- Tlo Dala IinI Iayor is sonl IinIUp = 0.

Aflor 12 ms limooul or vlon IinI oxils llo IIoclricaI IdIo slalo.
Detect.Active SubState

Tlis slalo is onlorod aflor 12ms or vlon llo IinI oxils llo IIoclricaI IdIo
slalo.

Tlo lransmillor dovico dolocls if rocoivors aro connoclod on aII Ianos of llo
IinI. Tlo lransmillor slarls al a slabIo DC common modo voIlago on aII
Ianos. Tlis voIlago can bo V
DD
, GND, or somo ollor slabIo voIlago in-
bolvoon. Tlo lransmillor llon drivos a DC common modo voIlago ollor
llan llo ono curronlIy prosonlod. A rocoivor is doloclod basod on llo ralo al
vlicl llo D+ and D- Iinos clargo lo llo nov voIlago. Al dosign limo, llo
dovico is dosignod vill InovIodgo of llo clargo limo lo clango llo voIl-
ago (basod on llo assumod Iino impodanco and lransmillor impodanco
villoul rocoivor lorminalion). Will a rocoivor allaclod al llo ollor ond, llo
clargo limo viII bo Iongor llan if lloro is no connoclod rocoivor. Ior moro
dolaiIs on llo rocoivor doloclion procoss, soo Rocoivor Doloclion on
pago 459.

Occurs if a rocoivor is nol doloclod. Tlo Ioop from Dolocl.Quiol lo
Dolocl.Aclivo is ropoalod ovory 12ms, as Iong as no rocoivor is allaclod. Tlo
noxl slalo is IoIIing if a Rocoivor is doloclod on aII unconfigurod Ianos.

If llo dovico dolocls a rocoivor allaclod. Tlo Dovico musl nov drivo a DC
common voIlago villin llo 0 - 3.6 V V
TX-CM-DC
spocificalion.
-
If aII Ianos of a dovico aro nol connoclod lo a rocoivor. Ior oxampIo, a x4
dovico is connoclod lo a x2 dovico. In llal caso, llo dovico dolocls llal somo
Ianos (lvo Ianos) aro connoclod lo a rocoivor, vliIo ollors aro nol. Tloso
Ianos connoclod lo a rocoivor boIong lo ono ITSSM.Tloro aro lvo cloicos al
llis poinl:
Chapter 14: Link Initialization & Training
515
- Tloso Ianos nol connoclod lo a rocoivor boIong lo anollor ITSSM (if
lloy can oporalo as a soparalo IinIsoo Dosigning Dovicos vill
IinIs llal can bo Morgod on pago 522). Tlo ollor ITSSM conlinuos lo
ropoal llo rocoivor doloclion soquonco doscribod abovo.
- Tloso Ianos llal aro nol connoclod lo a rocoivor and cannol bocomo
parl of anollor IinI and ITSSM musl lransilion llo unconnoclod Ianos
lo llo IIoclricaI IdIo slalo.
PoIIing State
Introduction
Tlis slalo is llo firsl limo in llo IinI lraining and iniliaIizalion procoss llal
IIIs (sucl as TS1 and TS2 Ordorod-Sols) aro oxclangod bolvoon llo lvo con-
noclod dovicos. Iiguro 14-7 slovs llo subslalos of llo IoIIing slalo maclino.

Detect.Quiet Detect.Active
Exit to
Polling
Entry from Reset.
Also from Disabled,
Loopback, L2, Polling,
Configuration or
Recovery
No Electrical
Idle on Link or
12 ms timeout
No Detect
Receiver
Detected
12 ms Charge or
DC common mode
voltage stable
PCI Express System Architecture
516
PoIIing.Active SubState

Transmillors drivo a DC common modo voIlago villin llo spoc Iimils on aII
Ianos on vlicl il doloclod a rocoivor.

If IIoclricaI IdIo oxil is doloclod al llo rocoivor on AII Ianos llal doloclod a
rocoivor during Dolocl, llo Transmillor oxils IoIIing.CompIianco by lrans-
milling 1024 TS1 Ordorod-Sols.

WliIo in IoIIing.Spood, llo Transmillor onlors llo IIoclricaI IdIo slalo for a
minimum of T
TX-IDII-MIN
and no Iongor llan 2ms. An IIoclricaI IdIo
ordorod sol is sonl prior lo onloring llo IIoclricaI IdIo slalo. Tlo DC com-
mon modo voIlago doos nol lavo lo bo villin spocificalion. Tlo Dala ralo is
clangod on aII Ianos lo llo liglosl common dala ralo supporlod on boll
sidos of llo IinI indicalod by llo lraining soquonco.

Bil/SymboI IocI aro oblainod as doscribod in llo noxl buIIol (soo Sym-
boI Boundary Sonsing (SymboI IocI) on pago 441 and Aclioving Bil
IocI on pago 440 for furllor dolaiIs).
Tlo lransmillors of llo lvo connoclod dovicos lransmil a minimum of
1024 consoculivo TS1 Ordorod-Sols on aII connoclod Ianos. Tlo lvo
dovicos como oul of llo Dolocl slalo al difforonl limos, lonco llo TS1
Ordorod-Sol oxclango of llo lvo dovicos aro nol synclronizod vill ono
anollor. Tlo IAD symboI is usod in llo Iano and IinI Numbors fioIds
of llo TS1 Ordorod-Sols. 1024 TS1 Ordorod-Sols amounls lo 64s of limo
lo acliovo Bil and SymboI IocI.

Tlo noxl slalo viII bo IoIIing.Configuralion if ono of llo foIIoving condi-
lions is lruo:
If a dovico rocoivos oigll consoculivo TS1 or TS2 Ordorod-Sols (or lloir
compIomonl duo lo poIarily invorsion) vill Iano and IinI sol lo llo
IAD symboI on AII Ianos and al Ioasl 1024 TS1 Ordorod Sols aro lrans-
millod, or
Aflor a 24ms limooul, if:
- A dovico rocoivos oigll consoculivo TS1 or TS2 Ordorod-Sols (or
lloir compIomonl) vill llo Iano and IinI numbors sol lo IAD
symboI on ANY Ianos llal doloclod a rocoivor during Dolocl, AND
- al Ioasl 1024 TS1 Ordorod-Sols voro lransmillod, AND
- aII Ianos llal doloclod a rocoivor doloclod an oxil from IIoclricaI
IdIo al Ioasl onco sinco onloring IoIIing.Aclivo (llis provonls ono or
moro bad lransmillors or rocoivors from loIding up IinI configura-
lion).
Chapter 14: Link Initialization & Training
517

If al Ioasl ono Iano llal doloclod a rocoivor during Dolocl las novor doloclod
an oxil from IIoclricaI IdIo sinco onloring IoIIing.Aclivo (a passivo losl Ioad
sucl as a rosislor on al Ioasl ono Iano forcos aII Ianos inlo IoIIing.CompIi-
anco).

If no TS1 or TS2 Ordorod-Sols aro rocoivod vill llo IinI and Iano numbor
fioIds sol lo llo IAD symboI on any Iano. AIso, llo liglosl advorlisod
spood musl bo Iovorod lo gonoralion 1 (if nol aIroady advorlisod as sucl).
PoIIing.Configuration SubState

Inlors IoIIing.Configuralion if of llo foIIoving lvo condilions aro
lruo:
If a dovico rocoivos oigll consoculivo TS1 or TS2 Ordorod-Sols (or lloir
compIomonl duo lo poIarily invorsion) vill llo Iano and IinI num-
bors sol lo llo IAD symboI on AII Ianos and al Ioasl 1024 TS1 Ordorod
Sols aro lransmillod,
Aflor a 24ms limooul, if a dovico rocoivos oigll consoculivo TS1 or TS2
Ordorod-Sols (or lloir compIomonl) vill llo Iano and IinI numbors
sol lo llo IAD symboI on ANY Ianos llal doloclod a rocoivor vliIo in
llo Dolocl slalo, and al Ioasl 1024 TS1 Ordorod-Sols voro lransmillod,
AND aII Ianos llal doloclod a rocoivor doloclod an oxil from IIoclricaI
IdIo al Ioasl onco sinco onloring IoIIing.Aclivo (provonls ono or moro
bad lransmillors or rocoivors from loIding up IinI configuralion).

If a rocoivor soos llo compIomonl of llo TS1/TS2 Ordorod-Sols, il las lo
invorl llo poIarily of ils difforonliaI inpul pair lorminaIs. BasicaIIy, if
D21.5 rallor llan D10.2 is rocoivod in llo TS1 Ordorod-Sol, or if D26.5
rallor llan D5.2 is rocoivod for llo TS2 Ordorod-Sol, llon llo rocoivor
(nol llo lransmillor) musl invorl ils signaI poIarily. IoIarily Invorsion is
a mandalory foaluro (soo IinI IniliaIizalion and Training Ovorviov
on pago 500 for oxampIo of IoIarily Invorsion) and musl bo impIo-
monlod on aII Ianos indopondonlIy.
Tlo Transmillor sonds moro llan oigll TS2 Ordorod-Sols.

Assumos llal no spood > 2.5Gbils/s is idonlifiod in llo Dala Ralo Idonlifior
fioId of llo TS2 Ordorod-Sol. Aflor rocoiving oigll consoculivo TS2 Ordorod-
Sols and lransmilling 16 TS2 Ordorod-Sols aflor rocoiving ono TS2 Ordorod-
Sol, oxil lo Configuralion.
PCI Express System Architecture
518

Tlo noxl slalo is IoIIing.Spood aflor oigll consoculivo TS2 Ordorod Sols,
vill IinI and Iano numbors sol lo llo IAD symboI (K23.7), aro rocoivod on
any Ianos llal doloclod a Rocoivor during Dolocl, 16 TS2 Ordorod Sols aro
lransmillod aflor rocoiving ono TS2 ordorod sol, and al Ioasl ono of lloso
samo Ianos is lransmilling and rocoiving a Dala Ralo Idonlifior groalor llan
2.5Gb/s.

If noillor of llo lvo oxil condilions aro mol, oxil lo Dolocl aflor a 48ms limo-
oul.
PoIIing.CompIiance SubState

Tlo noxl subslalo is IoIIing.CompIianco if al Ioasl ono Iano llal doloclod a
rocoivor during Dolocl las novor doloclod an oxil from llo IIoclricaI IdIo
slalo on ils rocoivor sinco onloring IoIIing.Aclivo (a passivo losl Ioad, sucl
as a rosislor, on al Ioaso ono Iano forcos aII Ianos inlo IoIIing.CompIianco).

A losl probo (of 50 Olms impodanco) or a 50 Olm impodanco lo ground
looIod lo llo lransmil pair on any Iano causos llo dovico lo onlor IoII-
ing.CompIianco (soo Transmil Drivor CompIianco Tosl and Moasuromonl
Ioad on pago 479). In llis slalo, llo dovico (a pallorn gonoralor) is
roquirod lo gonoralo llo compIianco pallorn on llo IinI. Tlo compIianco
pallorn soIoclod producos llo vorsl caso inlorforonco bolvoon noiglboring
Ianos and rosuIls in llo vorsl caso IMI . Tosl oquipmonl looIod lo llo IinI
is usod lo losl for IMI noiso, cross-laII, Bil Irror Ralo (BIR), olc.
Tlo Transmillor oulpuls llo compIianco pallorn on aII Ianos llal
doloclod a rocoivor during Dolocl. Tlo pallorn consisls of llo 8b/10b
symboIs K28.5, D21.5, K28.5, and D10.2. Curronl running disparily
(CRD) musl bo sol lo nogalivo boforo sonding llo firsl symboI.
No SIip Ordorod-Sols aro lransmillod during IoIIing.CompIianco.

Tlo compIianco slalo is oxilod vlon an IIoclricaI IdIo oxil is doloclod on aII
llo Ianos llal doloclod a rocoivor during Dolocl. Tlo lransmillor oxils IoII-
ing.CompIianco by lransmilling 1024 TS1 Ordorod-Sols.
PoIIing.Speed SubState

IoIIing.Spood is onlorod if:
Iigll consoculivo TS2 Ordorod-Sols aro rocoivod, and
16 TS2 Ordorod-Sols aro lransmillod aflor rocoiving ono TS2, and
al Ioasl ono of llo Ianos is lransmilling and rocoiving vill a Dala Ralo
Idonlifior in llo TS2 Ordorod-Sol llal is liglor llan 2.5Gb/s.
Chapter 14: Link Initialization & Training
519
Polling.Active
Bit/Symbol Lock
Polling.Configuration
(Polarity Inversion)
Exit to
Configuration
Entry from
Detect
No exit from Electrical
Idle on at least 1 Lane
Polling.Speed
(Electrical Idle,
Change Speed)
8 TS2 Rx. Tx 16 TS2
No Higher Speed ID
exchanged
TS2
Received with
Higher Speed
8 TS1, TS2 (or complement) Rx on ALL
Lanes or 24 ms timeout and ANY
Lane Rx 8 TS1, TS2 and ALL Lanes
detect exit from Electrical Idle
Polling.Compliance
Electrical
Idle Exit
Exchange
1024 TS1s
Exit to
Detect
48 ms
TS1s/TS2s with
Lane# and Link# set
to a value other
than PAD

- - - - - -
- - - -
-

- -
- - - - -
- -

- -
Configuration State
GeneraI
- - - -- -
- - - -
- - -

PCI Express System Architecture
520
An upslroam dovico sonds TS1 Ordorod-Sols on aII dovnslroam Ianos. Tlis
slarls llo IinI numboring and Iano numboring procoss. If llo vidll dolormina-
lion and Iano numboring is compIolod succossfuIIy, llon TS2 Ordorod-Sols aro
lransmillod lo llo noiglboring dovico lo confirm llo IinI Widll, IinI Numbor
and Iano Numbor for oacl IinI connoclod lo a difforonl dovico.
WliIo in llo Configuralion slalo, llo IinI Training bil in llo IinI Slalus rogislor
is sol by lardvaro (soo Iiguro 14-22 on pago 552). Tlis bil is sol on Rool Com-
pIox porls and on dovnslroam Svilcl porls. Il is nol sol in Indpoinls or a
Svilcl upslroam porls.

Config.RcvrCfg
(Lane Width and
Lane Reversal)
Config.Idle
(Idle Symbols
sent/received)
Exit to
L0
Entry from
Polling or Recovery
Link
Configured
2 ms
timeout
Exit to
Detect
8 Idle Rx,
Tx 16 Idle
Full-On Power State
Packet transmission/
reception begins
Exit to
Disable
Exit to
Loopback
Directed
Directed
2 ms timeout or
Rx 2 TS1 with
Link/Lane#=PAD
Chapter 14: Link Initialization & Training
521
Configuration.RcvrCfg SubState

Tlis slalo is onlorod aflor llo normaI compIolion of llo IoIIing slalo (as
doscribod in IoIIing.Configuralion SubSlalo on pago 517). Il is aIso
onlorod if llo Rocovory slalo faiIs lo compIolo succossfuIIy (as doscribod
inRocovory Slalo on pago 532).

Tlo IinI Numbor of oacl IinI connoclod lo a uniquo dovico is nogoli-
alod.
Tlo Ianos of oacl uniquo IinI aro numborod slarling vill Iano 0. If
nocossary, llo Iano Numbors aro rovorsod.
Tloso Ianos llal aro nol parl of a nov IinI aro disabIod and onlor llo
IIoclricaI IdIo slalo. DisabIod Ianos aro ro-onabIod if llo dovico onlors
llo Dolocl slalo again.
Iacl dovico advorlisos ils N_ITS vaIuo in llo TS1/TS2 Ordorod-Sols il
sonds lo llo romolo dovico.
A rocoivor usos llo COM symboI in llo rocoivod TS1 and TS2 Ordorod-
Sols lo do-sIov llo Ianos of llo IinI (soo Iano-lo-Iano Do-SIov on
pago 444).
Rallor llan go llrougl a lodious procoss lo oxpIain llo Configura-
lion.RcvrCfg funclion, llroo oxampIos aro prosonlod in IxampIos Tlal
Domonslralo Configuralion.RcvrCfg Iunclion on pago 524. Tlal soclion
doscribos llo IinI Numboring and Iano Numboring procoduro.

Wlon llo IinI Numboring and Iano Numboring procoss las compIolod
succossfuIIy.

Tlo noxl slalo is Dolocl if, aflor a 2ms limooul, no IinI or Ianos couId bo
configurod, or if aII Ianos rocoivo lvo consoculivo TS1 Ordorod-Sols vill
llo IinI and Iano Numbor fioIds sol lo llo IAD symboI.
-
If diroclod lo onlor llo DisabIo or IoopbacI slalo by liglor Iayors:
Soflvaro can inform a IoopbacI Maslor connoclod lo llo IinI lo onlor
llo IoopbacI slalo in an impIomonlalion spocific mannor. Tlo Ioop-
bacI Maslor dovico conlinuousIy sonds TS1 Ordorod-Sols lo llo Ioop-
bacI SIavo vill llo IoopbacI bil sol in llo TS1 Training ConlroI fioId
unliI llo IoopbacI sIavo rolurns TS1 Ordorod-Sols vill llo IoopbacI
bil sol. Tlo IoopbacI SIavo onlors IoopbacI vlon il rocoivos lvo con-
soculivo TS1 Ordorod-Sols vill llo IoopbacI bil sol.
PCI Express System Architecture
522
SimiIarIy, soflvaro can command a dovico lo onlor llo DisabIo slalo by
solling llo DisabIo bil in llo IinI ConlroI rogislor (soo Iiguro 14-23 on
pago 553). Tlis dovico (a dovnslroam porl) llon lransmils 16 TS1
Ordorod-Sols vill llo DisabIo IinI bil sol in llo TS1 Training ConlroI
fioId. A connoclod rocoivor (on an upslroam porl) is disabIod vlon il
rocoivos TS1 Ordorod-Sols vill llo DisabIo IinI bil sol.
Configuration.IdIe SubState

Wlon llo IinI Numboring and Iano Numboring procoss las compIolod
succossfuIIy.

Tlo IinI is fuIIy configurod. Bil IocI and SymboI IocI lavo boon acliovod.
Tlo IinI dala ralo las boon soIoclod. Tlo IinI and Iano Numbors lavo
boon assignod.
Tlo Transmillor sonds IogicaI IdIo soquoncos (soo IogicaI IdIo
Soquonco on pago 436) on aII configurod Ianos. Al Ioasl 16 IogicaI IdIo
soquoncos aro sonl.
Tlo Rocoivor vails for llo rocoipl of llo IogicaI IdIo dala.
Tlo rocoivors Dala IinI Iayor IinIUp slalus bil is sol lo 1.

Occurs vlon oigll IogicaI IdIo symboIs aro rocoivod on aII configurod
Ianos and 16 IogicaI IdIos aro sonl aflor rocoiving 1 IogicaI IdIo. I0 is llo
fuII-on povor slalo during vlicl normaI pacIol lransmission and rocoplion
can occur. Tlo difforonliaI lransmillors and rocoivors aro onabIod in llo Iov
impodanco slalo.

Occurs vlon, aflor a 2ms limooul, no IogicaI IdIo symboIs lavo boon
oxclangod.
Designing Devices with Links that can be Merged
A dosignor docidos lov many Ianos lo impIomonl on a givon
IinI basod on porformanco roquiromonls for llal IinI. Tlo spocificalion
roquiros llal a dovico llal impIomonls a muIli-Iano IinI musl bo dosignod
lo oporalo as a ono-x1 IinI aIso. Tlis aIIovs sucl a muIli-Iano IinI dovico
lo oporalo vlon and if il connocls lo a x1 IinI dovico (IinI porformanco is
Iovor, lovovor).
An oplionaI foaluro aIIovs lvo or moro dovnslroam IinIs (associalod vill
difforonl porls) of a svilcl lo bo combinod lo form a vidor IinI llal is con-
noclod lo ono dovico. Iiguro 14-9 on pago 524 slovs a Svilcl vill ono
upslroam porl and four dovnslroam porls. Tlo Svilcl supporls oigll
Chapter 14: Link Initialization & Training
523
upslroam Ianos and oigll dovnslroam Ianos. On llo dovnslroam sido, llo
Svilcl supporls four porls. Il is lloroforo four-x2 capabIo. By combining
lvo porls, il is aIso lvo-x4 capabIo. As roquirod by llo spocificalion, oacl
porl musl bo x1 capabIo.
Tlo Svilcl is capabIo of supporling up lo four
dovnslroam porls, vill oacl porl a x2 porl (four-x2 capabIo on llo dovn-
slroam sido) llal connocls lo four dovicos (Iofl sido of Iiguro 14-9 on pago
524). Tlo bridgo inlornaIIy consisls of ono upslroam IogicaI bridgo and four
dovnslroam IogicaI bridgos.
During IinI Training, vliIo in llo Configuralion.RcvrCfg subslalo, llo
ITSSM of oacl svilcl dovnslroam porl oslabIislos llal il is connoclod lo
four dovicos vill x2 IinIs oacl. IssonliaIIy, llo svilcl consisls of four
porls, four ITSSMs, four IlysicaI Iayors, four Dala IinI Iayors and four
Transaclion Iayors.
Tlis svilcl dosign aIso aIIovs ils dovnslroam
Ianos lo bo combinod inlo lvo dovnslroam x4 porls (rigll sido of Iiguro
14-9). In ollor vords, llo oigll dovnslroam Ianos may bo virod lo lvo,
indopondonl x4 dovicos. In lliso caso, llo svilcl consisls of ono upslroam
IogicaI bridgo and lvo dovnslroam IogicaI bridgos.
During IinI Training, vliIo in llo Configuralion.RcvrCfg subslalo, llo
ITSSM of oacl svilcl dovnslroam porl oslabIislos llal il is connoclod lo
lvo dovnslroam dovicos vill x4 IinIs oacl. IssonliaIIy, llo svilcl in llis
configuralion las lvo dovnslroam porls and llo four svilcl ITSSMs aro
morgod inlo lvo ITSSMs. Tlo svilcl las lvo IlysicaI Iayors, lvo Dala
IinI Iayors and lvo Transaclion Iayors on llo dovnslroam sido.
Tlo svilcl is capabIo of four-x2 IinIs on llo dovnslroam sido (Iofl) or lvo-
x4 IinIs (rigll), doponding on lov llo dosignor cloosos lo viro up llo
dovnslroam svilcl Ianos.
During llo Configuralion.RcvrCfg slalo, llo ITSSM discovors lov llo
dovnslroam Ianos aro virod. Iacl IinI llal connocls lo a uniquo dovico is
numborod uniquoIy and oacl Iano of a IinI is aIso numborod. Dosigning a
svilcl vill llis capabiIily is no lriviaI lasI, so llo foaluro llal pormils llo
combining or spIilling of IinIs lo form a vidor or narrovor IinI is
oplionaI.
Il is a roquiromonl llal oacl muIli-Iano porl bo abIo lo oporalo as a x1 porl
vlon connoclod lo a x1 dovico.
PCI Express System Architecture
524
ExampIes That Demonstrate Configuration.RcvrCfg Function
Tlo IinI numboring and Iano numboring procoss is inilialod by an upslroam
dovico during llo Configuralion.RcvrCfg subslalo. A Rool CompIox or a Svilcl
dovnslroam porl vouId inilialo llo Configuralion.RcvrCfg procoss. Indpoinls
and upslroam porls aro dovnslroam dovicos and do nol inilialo llis procoss.
TS1 and TS2 Ordorod-Sols aro lransmillod and rocoivod during llis subslalo.
Upon oxil from llo Configuralion.RcvrCfg subslalo, oacl IinI las boon iniliaI-
izod vill a IinI numbor (llis indiroclIy oslabIislos llo numbor of porls a
dovico supporls). Iacl Iano las aIso boon iniliaIizod vill a Iano numbor (llis
indiroclIy oslabIislos llo IinI vidll).
Tlroo oxampIos aro covorod in llo noxl llroo soclions.
RcvrCfg ExampIe 1
Considor Iiguro 14-10 on pago 527. Dovico A is ono-x4 capabIo, ono-x2 capabIo
and ono-x1 capabIo (Ono-x1 supporl is roquirod by llo spoc). Dovico B is ono-x4
capabIo, ono-x2 capabIo and ono-x1 capabIo (il is roquirod lo supporl llis capa-
biIily by llo spoc). Tlo dovico pins associalod vill oacl Iano aro plysicaIIy
- -
Switch
Virtual
PCI
Bridge 1
Virtual
PCI
Bridge 2
Virtual
PCI
Bridge 3
Virtual
PCI
Bridge 0
Virtual
PCI
Bridge 4
x8
x2 x2 x2 x2
Switch
Virtual
PCI
Bridge 1
Virtual
PCI
Bridge 0
Virtual
PCI
Bridge 2
x8
x4 x4
OR
Chapter 14: Link Initialization & Training
525
numborod 0, 1, 2 and 3 (slovn in llo Iiguro 14-10), llougl llo assignod IogicaI
Iano numbors may lavo boon clangod vliIo in Configuralion.RcvrCfg sub-
slalo (in llis oxampIo, llo IogicaI Iano Numbor romains llo samo as llo plysi-
caI Iano Numbor).

1. -: Upslroam Dovico A lransmils TS1 Ordorod-Sols vill llo
IinI Numbor for oacl group of connoclod Ianos sol lo a dovico-spocific
iniliaI vaIuo. As an oxampIo, a svilcl vill four dovnslroam porls may
iniliaIIy sol llo IinI numbors lo 0, 1, 2, and 3. Tlo Iano Numbor fioId is
iniliaIIy sol lo llo IAD symboI (K23.7).
- : Tlis impIios llal Dovico A sonds four TS1 Ordorod-Sols
on llo four Ianos. Tlo four TS1 Ordorod-Sols oacl conlain a IinI Num-
bor , , and llo Iano Numbor fioIds aro sol lo llo IAD symboI.
Ivon llougl Dovico A is aIso capabIo of Ono-x1 and Ono-x2 oporalion,
Dovico A slarls by assuming llo capabiIily llal maximizos llo uso of aII
connoclod Ianos.
2. -: Dovnslroam Dovico B rolurns TS1 Ordorod-Sols on aII
connoclod Ianos llal rocoivod TS1 Ordorod-Sols vill llo assignod com-
mon IinI Numbor for Ianos il can supporl as ono IinI. Tlo Iano Num-
bors aro inilaiIIy sol lo llo IAD symboI (K23.7).
- : Dovico B rolurns a TS1 Ordorod-Sol on aII four Ianos.
Tlo TS1 Ordorod-Sols on oacl Iano conlains IinI Numbor . Tlo Iano
Numbor fioId conlains llo IAD symboI. Dovico A soos llo TS1
Ordorod-Sol vill IinI numbors of on oacl Iano. Dovico A oslabIislos
llal ils four Ianos aro connoclod lo ono dovnslroam dovico and llal llo
IinI is numborod as . Dovico A las rocoivod confirmalion from Dovico
B llal ils IinI can bo numborod vloro is a numbor bolvoon 0 and
255. Tlo IinI is configurod as a Ono-x4 IinI.
Tlo IinI Numbor of is a IogicaI IinI Numbor llal is nol slorod in a
dofinod configuralion rogislor. Tlis numbor is lard-virod by dosign, and
nol roIalod lo llo Iorl Numbor fioId of llo IinI CapabiIily Rogislor.
AIso, llo Nogolialod IinI Widll fioId in llo IinI Slalus rogislor of boll llo
upslroam and dovnslroam dovicos aro updalod vill 000100, indicaling a
x4 IinI (soo Iiguro 14-22 on pago 552).
PCI Express System Architecture
526

3. -: Upslroam Dovico A sonds TS1 Ordorod-Sols on aII con-
noclod Ianos vill llo configurod IinI Numbor and uniquo Iano Num-
bors slarling vill 0 for oacl Iano. IAD symboIs aro no Iongor sonl in
llo Iano Numbor fioId.
- : Dovico A sonds four TS1 Ordorod-Sols vill IinI Num-
bor of and Iano Numbors of 0, 1, 2 and 3, rospoclivoIy, on oacl con-
noclod Iano.
4. -: Dovnslroam Dovico B rolurns TS1 Ordorod-Sols on aII
connoclod Ianos vill llo samo IinI Numbor as conlainod in llo
rocoivod TS1 Ordorod-Sols and llo samo Iano Numbors for oacl Iano
as indicalod in llo rocoivod TS1 Ordorod-Sols.
If llo dovnslroam dovicos Ianos aro looIod in llo rovorso mannor and
il doos nol supporl llo Iano RovorsaI foaluro, il rolurns llo TS1
Ordorod-Sols vill llo Iano Numbor fioId indicaling llo mannor in
vlicl il vanls llo Ianos lo bo numborod. HopofuIIy, llo upslroam
dovico supporls Iano RovorsaI and accopls llo rovorso ordor in vlicl
llo dovnslroam dovico vanls llo Ianos numborod.
- : Dovico B rolurns four TS1 Ordorod-Sols vill a IinI
Numbor of and Iano Numbors of 0, 1, 2 and 3, rospoclivoIy, on oacl
connoclod Iano.

5. -: Dovico A and B confirm llo IinI Numbor
and Iano Numbors nogolialod by oxclanging TS2 Ordorod-Sols.
- : Dovico A and B oxclango TS2 Ordorod-Sols vill llo
IinI Numbor sol lo and llo Iano Numbors sol lo 0, 1, 2 and 3, rospoc-
livoIy, for oacl of llo four Ianos. In llis oxampIo, llo IogicaI Iano
Numbors of boll dovicos romain llo samo as llo plysicaI Iano Num-
bors.
Chapter 14: Link Initialization & Training
527
RcvrCfg ExampIe 2
Considor Iiguro 14-11 on pago 529. Tlis is an oxampIo in vlicl upslroam
dovico A is capabIo of ono-x4, or lvo-x2, or lvo-x1. Tlo narrovosl IinI capabiI-
ily llal usos AII Ianos is lvo-x2. Tlo lvo porls of Dovico A aro oacl x2 capa-
bIo and llo plysicaI Iin Numbor (Iano numbor) of oacl porl is 0 and 1. Dovico
B and C oacl lavo ono porl llal is x2 capabIo and llo plysicaI Iin Numbor
(Iano numbor) of oacl porl is 0 and 1.
Using a slrapping oplion on Dovico A (or by dofauIl), il slarls llo Configura-
lion.RcvrCfg subslalo by roporling ils lvo-x2 capabiIily vlon lransmilling TS1
Ordorod-Sols lo llo dovnslroam dovicos.

1. - Upslroam Dovico A lransmils TS1 Ordorod-Sols vill an
assumod IinI Numbor vaIuo for oacl group of Ianos capabIo of acling
as uniquo IinIs. Ior nov, llo Iano Numbor is sol lo llo IAD symboI
(K23.7)

PCI Express System Architecture
528
- : Dovico A sonds TS1 Ordorod-Sols on aII four Ianos. Tlo
TS1 Ordorod-Sol on oacl Iano conlains IinI numbor +1, and +1.
Tlo Iano Numbor fioId conlains llo IAD symboI.
2. - Dovnslroam Dovicos B and C rolurn TS1 Ordorod-Sols
conlaining llo IinI numbor for Ianos il can supporl as ono IinI. Tlo
Iano Numbor is iniliaIIy sol lo llo IAD symboI (K23.7).
- : Dovico B and C rolurn TS1 Ordorod-Sols on oacl Iano,
oacl conlaining a IinI Numbor of for Dovico B and a IinI Numbor of
+1 for Dovico C. Tlo Iano Numbor fioId is iniliaIIy sol lo llo IAD
symboI. Dovico A rocoivos TS1 Ordorod-Sols on lvo of llo Ianos vill a
IinI Numbor of and TS1 Ordorod-Sols on llo ollor lvo Ianos vill a
IinI Numbor of +1.
Tlo IinI Numbor of and n+1 is a IogicaI IinI Numbor llal is nol slorod in
a dofinod configuralion rogislor. Tlis numbor is nol roIalod lo llo Iorl
Numbor fioId of llo IinI CapabiIily Rogislor of upslroam Dovico As porl
or Dovico B's or Dovico C's porl.
AIso, llo Nogolialod IinI Widll fioId in llo IinI Slalus rogislor of boll
upslroam porls and dovnslroam porls aro updalod vill 000010, indical-
ing a x2 IinI (soo Iiguro 14-22 on pago 552).

3. - Dovico A roaIizos llal ils Ianos aro dividod inlo lvo IinIs
and sonds TS1 Ordorod-Sols on aII connoclod Ianos vill IinI Numbor
on lvo Ianos and IinI Numbor +1 on llo ollor lvo Ianos. IAD
symboIs aro no Iongor sonl in llo Iano Numbor fioId.
- : Dovico A sonds a TS1 Ordorod-Sol on lvo Ianos vill a
IinI Numbor of in boll of llo TS1s, a Iano Numbor of 0 in ono of llo
TS1s, and a Iano Numbor of 1 in llo ollor TS1. Dovico A aIso sonds a
TS1 on oacl of llo ollor lvo Ianos vill a IinI Numbor of +1 in boll
of llo TS1s, a Iano Numbor of 0 in ono TS1, and a Iano Numbor of 1 in
llo ollor TS1.
4. - Dovnslroam Dovico B and C rolurns TS1s on aII connoclod
Ianos vill llo samo IinI Numbor as conlainod in llo rocoivod TS1
Ordorod-Sols and llo samo Iano Numbors for oacl Iano as in llo
rocoivod TS1 Ordorod-Sols.
If llo dovnslroam dovicos Ianos aro looIod in llo rovorso mannor and
lloy do nol supporl llo Iano RovorsaI foaluro, lloy rolurn llo TS1
Ordorod-Sols vill llo Iano Numbor fioIds rovorsod. HopofuIIy, llo
upslroam dovico supporls Iano RovorsaI and accopls llo rovorso ordor
llal llo dovnslroam dovicos vanl llo Ianos numborod.
Chapter 14: Link Initialization & Training
529
- : Dovico B rolurns TS1s on oacl Iano vill IinI Numbor
of and a Iano Numbor of 0 in ono TS1 Ordorod-Sol and a Iano Num-
bor of 1 in llo ollor. Dovico C rolurns a TS1 on oacl Iano vill a IinI
Numbor of +1 and a Iano Numbor of 0 in ono TS1 Ordorod-Sol and a
Iano Numbor of 1 in llo ollor.

5. - Dovico A and B/C confirm llo IinI Num-
bors and Iano Numbors nogolialod by oxclanging TS2 Ordorod-Sols.
- : Dovico A and B oxclango a TS2 Ordorod-Sol on oacl
Iano vill llo IinI Numbor sol lo and llo Iano Numbors sol lo 0 and
1, rospoclivoIy, for oacl of llo lvo Ianos on llo firsl IinI. Dovico A and
C oxclango a TS2 Ordorod-Sol on oacl Iano vill llo IinI Numbor sol
lo +1 and llo Iano Numbors sol lo 0 and 1, rospoclivoIy, for oacl of llo
lvo Ianos of llo socond IinI. Iacl Iano of llo lvo IinIs in llis oxam-
pIo aro IogicaIIy numborod 0 and 1, malcling llo plysicaI Iin numbor
(Iano numbor) of oacl Iano.

PCI Express System Architecture
530
RcvrCfg ExampIe 3
Considor Iiguro 14-12 on pago 532. Tlis is an oxampIo in vlicl upslroam
dovico A is capabIo of ono-x4, or lvo-x2, or lvo-x1 (llo samo as Dovico A in llo
provious oxampIo). Tlo narrovosl IinI capabiIily llal usos AII Ianos is lvo-
x2. Iacl Iano of Dovico As lvo porls aro plysicaIIy numborod 0 and 1.
Via a slrapping oplion on Dovico A (or by dofauIl), il roporls ils lvo-x2 capabiI-
ily vlon lransmilling TS1 Ordorod-Sols lo llo dovnslroam dovico. In llis
oxampIo, Dovico A iniliaIIy assumos llal il las lvo-x2 dovnslroam IinIs. AIso,
boll of Dovico As IinIs aro connoclod lo dovnslroam Dovico B. Dovico B is x4
capabIo. Ils pins (or Ianos) aro plysicaIIy numborod 3, 2, 1, 0, rospoclivoIy. In
llis oxampIo, assumo llal Dovico B doos supporl Iano RovorsaI, bul Dovico
A doos supporl Iano RovorsaI.

1. - Upslroam Dovico A lransmils TS1 Ordorod-Sols vill an
assumod IinI Numbor fioId for oacl group of Ianos capabIo of boing
uniquo IinIs llal uso up aII llo Ianos. Ior nov, llo Iano Numbor is sol
lo llo IAD symboI (K23.7).
- : Dovico A sonds four TS1 Ordorod-Sols on llo four
Ianos. Iacl TS1 Ordorod-Sol conlains llo rospoclivo IinI numbor (
. Tlo Iano Numbor fioId is iniliaIIy sol lo llo IAD symboI.
2. - Dovnslroam Dovico B rolurns TS1 Ordorod-Sols vill an
assignod common IinI numbor for Ianos il can supporl as ono IinI.
Tlo Iano Numbor is iniliaIIy sol lo llo IAD symboI (K23.7).
- : Dovico B rolurns TS1 Ordorod-Sols on oacl Iano, oacl
conlaining a IinI Numbor of . Tlo Iano Numbor fioId is iniliaIIy sol lo
llo IAD symboI. Dovico A soos TS1 Ordorod-Sols on four Ianos vill a
IinI Numbor of , loIIing Dovico A llal ils four Ianos aro connoclod lo
ono dovnslroam dovico and llal llo IinI slouId bo numborod .
Tlo IinI Numbor of is a IogicaI IinI Numbor llal is nol slorod in a
dofinod configuralion rogislor. Tlis numbor is nol roIalod lo llo Iorl Num-
bor fioId of llo IinI CapabiIily Rogislor.
AIso, llo Nogolialod IinI Widll fioId in llo IinI Slalus rogislor of boll llo
upslroam porl and llo dovnslroam porl aro updalod vill 000100, indi-
caling a x4 IinI (soo Iiguro 14-22 on pago 552).
Chapter 14: Link Initialization & Training
531

3. - Dovico A roaIizos llal ils four Ianos aro combinod inlo ono
IinI (Ono-x4) and sonds TS1 Ordorod-Sols on aII connoclod Ianos vill
ono assumod IinI Numbor, and a uniquo Iano Numbor is assignod
lo oacl Iano of llo IinI. IAD symboIs aro no Iongor sonl in llo Iano
Numbor fioId.
- : Dovico A sonds TS1 Ordorod-Sols on four Ianos vill a
IinI Numbor of n and Iano Numbors 0, 1, 2, and 3, rospoclivoIy, num-
borod Iofl lo rigll.
4. - Dovnslroam Dovico B rolurns a TS1 on aII connoclod
Ianos vill llo samo IinI Numbor as conlainod in llo rocoivod TS1
Ordorod-Sol. Assumo llal llo Ianos aro looIod up in rovorso mannor
as slovn in Iiguro 14-12 on pago 532 and llal Dovico B doos nol sup-
porl llo Iano RovorsaI foaluro.
If llo dovnslroam dovicos Ianos aro rovorsod and il doos nol supporl
Iano RovorsaI, il rolurns llo TS1 Ordorod-Sols vill llo Iano Numbor
fioIds rovorsod. HopofuIIy, llo upslroam dovico supporls Iano RovorsaI
and accopls llo rovorso ordoring of llo Ianos.
- : Dovico B rolurns a TS1 Ordorod-Sol on oacl Iano vill a
IinI Numbor of and Iano Numbors of 3, 2, 1 and 0, rospoclivoIy,
numborod from Iofl lo rigll.

5. - Dovico A and B confirm llo IinI Numbor
and llo Iano Numbors nogolialod by oxclanging of TS2 Ordorod-Sols.
- : Dovico A and B oxclango a TS2 Ordorod-Sol on oacl
Iano vill llo IinI Numbor sol lo and llo Iano Numbors sol lo 3, 2, 1
and 0 (Ianos rovorsod), rospoclivoIy, for oacl of llo four Ianos.
Dovico As plysicaI Iin Numbors (Iano numbors) for llo four Ianos from
Iofl lo rigll aro 0, 1, and 0, 1 (llo samo numbors ropoalodbocauso Dovico
A is lvo-x2 porl capabIo). Hovovor, Dovico A onds up vill IogicaI Iano
Numbors of 3, 2, 1, 0, from Iofl lo rigll. Dovico Bs plysicaI Iin Numbors aro
3, 2, 1 and 0, from Iofl lo rigll. Tlo IogicaI Iano Numbors romain llo samo
as llo plysicaI Iano Numbors: 3, 2, 1 and 0.
Considor vlal vouId lappon if Dovico A did nol supporl Iano RovorsaI
(Iano RovorsaI is an oplionaI foaluro). In Slop 4, Dovico B rolurns four TS1
Ordorod-Sols vill Iano Numbors of 3, 2, 1 and 0. Dovico A vouId nol bo
abIo lo rovorso llo plysicaI Iano numbors of 0, 1, 2 and 3 llal il proposod in
Slop 3. Tlo IinI lraining procoss froozos al llis poinl. Tlis is a IinI lraining
PCI Express System Architecture
532
orror and is roporlod by llo upslroam dovico (Dovico A) via llo IinI Train-
ing Irror bil in llo IinI Slalus rogislor (soo Iiguro 14-22 on pago 552). A
syslom dosignor vouId bo vrong lo looI llo Ianos of lvo dovicos llal do
nol supporl Iano RovorsaI in a rovorsod mannor.
Recovery State
Tlo Rocovory slalo is aIso roforrod lo as llo Ro-Training slalo. Il is nol onlorod
during IinI lraining (vlicl occurs vlon a dovico comos oul of rosol). Tlo
Rocovory slalo is onlorod vlon a rocoivor noods lo rogain Bil and SymboI IocI,
or if an orror occurs vliIo in I0 llal rondors llo IinI inoporabIo. Rallor llan
going llrougl llo IoIIing and Configuralion slalos (vlicl lavo Iongor Ialon-
cios associalod vill llom), llo Rocovory slalo las a mucl slorlor Ialoncy (llo
IIIs aro aIroady oporalionaI and may onIy nood lo bo syncd). Tlo numbor of

Device A (Switch)
(Upstream Device)
One-x4 capable
Two-x2 capable
Two-x1 capable
One-x4 capable
One-x2 capable
One-x1 capable
Device B
(Downstream Device)
0 1 0 1 0 1 0 1
3 2 1 0 3 2 1 0
Physical Lane Numbers
Physical Lane Numbers
Logical Lane Numbers
After Link Training
3 2 3 2 1 0 1 0
3 2 3 2 1 0 1 0
Chapter 14: Link Initialization & Training
533
ITS Ordorod-Sols (N_ITS) roquirod for I0s oxil is ro-oslabIislod in Rocovory
and llo IinI is do-sIovod. Tlo IinI Numbor, Iano Numbors and bil lransfor
ralo (2.5Gbils/s) romain unclangod. If any of lloso llroo variabIos lavo
clangod sinco llo limo llo IinI vas in llo Configuralion slalo, llo ITSSM lran-
silions from llo Rocovory slalo lo llo Configuralion slalo.
Reasons that a Device Enters the Recovery State
- Ixil from I1 (roquiros llal llo rocoivor bo ro-lrainod).
- Ixil from I0s vlon llo rocoivor is unabIo lo acliovo Bil/SymboI IocI duo
lo llo rocoplion of an insufficionl numbor of ITS Ordorod-Sols.
- In caso of an orror llal rondors llo IinI unroIiabIo, soflvaro sols llo Rolrain
IinI bil in llo IinI ConlroI Rogislor (soo Iiguro 14-23 on pago 553).
- An orror condilion llal occurs in llo I0 slalo llal rondors llo IinI unroIi-
abIo may aulomalicaIIy causo llo Dala IinI Iayor or IlysicaI Iayor Iogic lo
inilialo a ro-lrain cycIo.
- Rocoplion of TS1 or TS2 Ordorod-Sols on any configurod Iano from a
romolo lransmillor signaIs llo rocoivor lo rolrain llo IinI.
- A rocoivor dolocls llal llo IinI las lransilionod lo llo IIoclricaI IdIo slalo
on aII configurod Ianos villoul firsl rocoiving llo IIoclricaI IdIo Ordorod-
Sols from llo lransmillor.
Initiating the Recovery Process
Boll dovicos on a IinI go llrougl Rocovory logollor. Ono of llo lvo dovicos
inilialos llo Rocovory procoss, lransmilling TS1 Ordorod-Sols lo ils noiglbor.
Tlo noiglbor goos llrougl Rocovory and rolurns llo favor by rolurning TS1
Ordorod-Sols llal llo inilialors rocoivor usos lo go llrougl Rocovory. In lrans-
milling and rocoiving TS1 Ordorod-Sols, boll llo rocoivor and llo lransmillor of
llo Ordorod-Sols rogains Bil/SymboI IocI, and llon rolurns lo llo I0 slalo.
Rofor lo Iiguro 14-13 on pago 537 for llo dolaiIod slops invoIvod in compIoling
llo Rocovory procoss doscribod boIov.
Recovery.RcvrLock SubState

A dovico onlors Rocovory for llo roasons silod in Roasons llal a Dovico
Inlors llo Rocovory Slalo on pago 533.

Tlo Rocoivor dolocls IIoclricaI IdIo oxil, or vlon diroclod by liglor-IovoI
soflvaro. IIoclricaI IdIo oxil moans llal llo rocoivor doloclod a vaIid diffor-
onliaI voIlago and slarls sooing TS1 Ordorod-Sols.
-
PCI Express System Architecture
534
Tlo Rocoivor onlors inlo Rocovory vlon il dolocls an N_ITS limooul (i.o., if
llo rocoivor is unabIo lo ro-oblain Bil/SymboI IocI aflor rocoiving N_ITS
ITS Ordorod-Sols, or if il rocoivos an insufficionl numbor of ITS Ordorod-
Sols, llon insload of going lo I0, il goos lo Rocovory).

Tlo lransmillor sonds TS1 Ordorod-Sols on aII configurod Ianos (vill
llo samo IinI and Iano Numbors as sol during llo Configuralion
slalo). Tlo spocificalion is uncIoar aboul lov many TS1 Ordorod-Sols
llo lransmillor slouId sond, bul llo aullor vonluros lo guoss llal il
slouId sond TS1 Ordorod-Sols unliI llis subslalo is oxilod.
If llo Ixlondod Sync bil is sol by soflvaro in llo IinI ConlroI rogislor
(soo Iiguro 14-23 on pago 553), llo lransmillor musl sond a minimum of
1024 TS1 Ordorod-Sols lo aIIov an oxlornaI moniloring dovico (i.o., a
looI), if connoclod, lo sync (oblain Bil/SymboI IocI).
Tlo rocoivor usos llo rocoivod TS1 Ordorod-Sols lo oblain Bil/SymboI
IocI.
A dovico advorlisos ils N_ITS vaIuo via llo TS1 Ordorod-Sols il sonds lo
llo romolo dovico. Tlis numbor can clango from vlal il vas during llo
Configuralion slalo.
A rocoivor usos llo COM symboI in llo rocoivod TS1 and TS2 Ordorod-
Sols lo do-sIov llo Ianos of llo IinI (soo Iano-lo-Iano Do-SIov on
pago 444).

A rocoivor movos lo Rocovor.RcvrCfg if oigll consoculivo TS1 or TS2
Ordorod-Sols aro rocoivod villoul IinI and Iano Numbor clangos.

Aflor 24ms, if llo rocoivor dolocls al Ioasl ono TS1 (bul nol oigll consoculivo
TS1 Ordorod-Sols) on ANY configurod Ianos and llo IinI Numbor and
Iano Numbor aro llo samo as llo numbors Transmillod in llo TS1 Ordorod-
Sols, llon il oxils lo Configuralion.

Aflor a 24ms limooul, if llo rocoivor doos nol dolocl TS1 or TS2 Ordorod-
Sols, or il dolocls TS1 or TS2 Ordorod-Sols vill llo IinI or Iano Numbor
difforonl from llo numbors in llo lransmillod TS1 or TS2 Ordorod-Sols,
llon il oxils lo Dolocl.
Recovery.RcvrCfg SubState

A rocoivor movos lo Rocovor.RcvrCfg if oigll consoculivo TS1 or TS2
Ordorod-Sols aro rocoivod villoul IinI and Iano Numbor clangos.
Chapter 14: Link Initialization & Training
535

Tlo Transmillor sonds TS2s on aII configurod Ianos (vill llo samo
IinI and Iano Numbors configurod oarIior). Again, llo spocificalion is
uncIoar aboul lov many TS2 Ordorod-Sols llo lransmillor slouId sond,
bul llo aullor vonluros lo guoss llal il slouId sond TS2 Ordorod-Sols
unliI llis subslalo is oxilod.
If llo N_ITS vaIuo clangos, llo dovico musl nolo llo nov vaIuo.
If llo IinI vas nol do-sIovod in llo Rocovory.RcvrIocI subslalo, a
rocoivor usos llo COM symboI in llo rocoivod TS1 and TS2 Ordorod-
Sols lo do-sIov llo Ianos of llo IinI (soo Iano-lo-Iano Do-SIov on
pago 444).

If oigll consoculivo TS2 Ordorod-Sols aro rocoivod vill no IinI/Iano
Numbor clangos and 16 TS2 Ordorod-Sols aro sonl aflor rocoiving ono TS1
or TS2 Ordorod-Sol, llon oxil lo Rocovory.IdIo.

If oigll consoculivo TS1 Ordorod-Sols aro rocoivod on ANY Iano vill IinI
or Iano Numbors llal do nol malcl vlal is boing lransmillod, llon oxil lo
Configuralion slalo.

Ixil lo Dolocl aflor a 48ms limooul and llo slalo maclino las nol oxilod lo
Rocovory.IdIo or Configuralion slalo.
Recovery.IdIe SubState

Inlor from Rocovory.RcvrCfg if oigll consoculivo TS2 Ordorod-Sols aro
rocoivod vill no IinI/Iano Numbor clangos and 16 TS2 Ordorod-Sols aro
sonl aflor rocoiving ono TS1 or TS2 Ordorod-Sol.

Tlo Transmillor sonds IogicaI IdIo symboIs on aII configurod Ianos
unIoss oxiling lo DisabIo, Hol Rosol, Configuralion, or IoopbacI.
Tlo Rocoivor vails for llo rocoipl of IogicaI IdIo symboIs on aII Ianos.
- -
If diroclod by liglor Iayors lo onlor llo DisabIo, IoopbacI or Hol Rosol
slalo. Tlo dovico lransmils TS1 or TS2 (TS2 nol vaIid for Hol Rosol caso)
vill llo DisabIo, IoopbacI or Hol Rosol bils sol.
If a dovico rocoivos lvo consoculivo TS1s or TS2s (TS2 nol vaIid for Hol
Rosol caso) vill llo DisabIo, IoopbacI or Hol Rosol bil sol, il oxils lo llo
DisabIo, IoopbacI or Hol Rosol slalo rospoclivoIy.
Soflvaro can inform a IoopbacI Maslor connoclod lo llo IinI lo onlor llo
IoopbacI slalo using an impIomonlalion spocific moclanism. Tlo Ioop-
bacI Maslor dovico conlinuousIy sonds TS1 Ordorod-Sols lo llo IoopbacI
PCI Express System Architecture
536
SIavo vill llo IoopbacI bil sol in llo TS1 Training ConlroI fioId unliI llo
IoopbacI sIavo rolurns TS1 Ordorod-Sols vill llo IoopbacI bil sol. Tlo
IoopbacI SIavo onlors IoopbacI vlon il rocoivos lvo consoculivo TS1s
vill llo IoopbacI bil sol.
SimiIarIy, soflvaro can command a dovico lo onlor llo DisabIo slalo by sol-
ling llo DisabIo bil in llo IinI ConlroI rogislor (soo Iiguro 14-23 on pago
553). Tlis dovico (a dovnslroam porl) llon lransmils 16 TS1 Ordorod-Sols
vill llo DisabIo IinI bil sol in llo TS1 Training ConlroI fioId. A connoclod
rocoivor (on llo upslroam porl) is disabIod vlon il rocoivos a TS1 vill llo
DisabIo IinI bil sol.
SimiIarIy, soflvaro can command a dovico lo onlor llo Hol Rosol slalo by
solling llo Socondary Bus Rosol bil in llo Bridgo ConlroI rogislor (soo In-
Band Rosol or Hol Rosol on pago 491). Tlis dovico (a dovnslroam porl)
llon lransmils TS1 Ordorod-Sols conlinuousIy for 2ms vill llo Hol Rosol
bil sol in llo TS1 Training ConlroI fioId. A rocoivor (in llo upslroam porl)
dolocls llo Hol Rosol vlon il rocoivos al Ioasl lvo TS1 Ordorod-Sols vill
llo Hol Rosol bil sol.

Ixils lo llo Configuralion slalo if diroclod by a liglor Iayor lo ro-configuro
llo IinI, or if lvo consoculivo TS1s aro rocoivod vill Iano numbors sol lo
llo IAD symboI.

If oigll IogicaI IdIo symboIs aro rocoivod on aII configurod Ianos.

Ixil lo Dolocl aflor a 2ms limooul if llo ITSSM doos nol oxil lo any of llo
ollor slalos abovo.
Chapter 14: Link Initialization & Training
537


- - - --
-- - - -


- - - --
-- -
-
- - - - -
- -

- - -
---
-- -
-


- -- - --
-

Recovery.RcvrLock
(bit/symbol re-lock)
Recovery.RcvrCfg
Exit to L0
Entry from
L1, L0, L0s
Rx TS2 with
Link/Lane change
Recovery.Idle
(Send idle data)
48 ms
timeout
Exit to
Detect
Exit to
Configuration
Exit to
Detect
2 ms
timeout
or directed
8 Idle
Symbols
24 ms timeout or
TS1/TS2 Rx with
Link/Lane change
8 consecutive
TS1s/TS2s received and
no Link/Lane change
8 consecutive
TS2s received
No Link/Lane
change
Exit to Hot
Reset
Exit to
Configuration
Exit to
Disabled
Exit to
Loopback
Send TS1s
on all lanes
Send TS2s
on all lanes
Directed
Directed
Or 2 TS1s
With Lane#
PAD
Directed
After 24 ms timeout, < 8
TS1/TS2 Rx with
no Link/Lane change on
ANY Lane
Directed
PCI Express System Architecture
538
-
Tlo Transmillor onlors I0s vlon diroclod lo do so by ils liglor Iayors. A
Rocoivor onlors I0s vlon il rocoivos an IIoclricaI IdIo Ordorod-Sol and llo
IinI lransilions lo llo IIoclricaI IdIo slalo.

Soo I1 Slalo on pago 541 for a dolaiIod doscriplion.

Soo I2 Slalo on pago 543 for a dolaiIod doscriplion.
L0s State
Tlis is a Iovor povor slalo llal las llo slorlosl oxil Ialoncy lo I0. Dovicos man-
ago onlry and oxil from llis slalo aulomalicaIIy villoul any liglor IovoI sofl-
varo invoIvomonl.
L0s Transmitter State Machine
Iiguro 14-14 on pago 539 slovs llo lransmillor slalo maclino associalod vill
I0s slalo onlry and oxil.
-

Tlo I0s slalo maclino is onlorod vlon llo dovico is diroclod lo do so by an
uppor Iayor. Tlis may occur via a limooul moclanism lriggorod duo lo pori-
ods of inaclivily (no TII, DIII or III lransmission aclivily) on llo IinI.
-
Tlo Transmillor sonds an IIoclricaI IdIo Ordorod-Sol and llo IinI
onlors llo IIoclricaI IdIo slalo.
Tlo Transmillor drivos a DC common modo voIlago bolvoon 0 - 3.6 V.
-
Ixil lo Tx_I0s.IdIo aflor 50 UI (20ns) vliIo llo lransmillor drivos a slabIo
DC common modo voIlago.
-
-Inlor Tx_I0s.IdIo aflor 50 UI (20 ns) vliIo llo
lransmillor drivos a slabIo DC common modo voIlago.
-
Tlo IinI is in llo IIoclricaI IdIo slalo.
Tlo lransmillors oulpul impodanco couId bo Iov or ligl.
-
Ixil lo Tx_I0s.ITS if diroclod lo do so by a liglor Iayor. Ior oxampIo, vlon
il is limo for a dovico lo rosumo pacIol lransmission, il viII oxil llis slalo.
Chapter 14: Link Initialization & Training
539
-
-
Inlor Tx_I0s.ITS if diroclod lo do so by a liglor Iayor.
-
To oxil llo IIoclricaI IdIo subslalo, llo lransmillor sonds llo numbor of
ITS Ordorod-Sols spocifiod by N_ITS. Tlo N_ITS numbor is dofinod
during IinI Training (Configuralion and Rocovory slalos) during
vlicl oacl dovico advorlisos llo numbor of ITS sols il roquiros lo
acliovo IocI.
If llo Ixlondod Syncl bil is sol (soo Iiguro 14-23 on pago 553), llo lrans-
millor sonds 4096 ITS Ordorod-Sols insload of N_ITS numbor of ITS
Ordorod-Sols.
IoIIov llis by ono SIip Ordorod-Sol. No SKII Ordorod-Sols aro lrans-
millod during llo lransmission of ITS Ordorod-Sols.

Ixil lo I0 slalo aflor llo SIip Ordorod-Sol lransmission.
- -
Tx_L0s.Entry
Tx_L0s.Idle
(Tx in Electrical
Idle low power)
Tx_L0s.FTS
Exit to
L0
Entry
from L0
T
TX-IDLE-MIN
= 50 UI
Directed
Transmitter sends
Electrical IDLE
ordered-set
Transmitter sends
N_FTSs on all Lanes
Transmitter sends
One SKIP ordered set
PCI Express System Architecture
540
L0s Receiver State Machine
Iiguro 14-15 on pago 541 slovs llo rocoivor slalo maclino associalod vill I0s
slalo onlry and oxil.
-

Tlis Iovor povor slalo is onlorod if a rocoivor rocoivos an IIoclricaI IdIo
Ordorod-Sol.
-
Wail in llo slalo for minimum of 50 UI (20ns).
Tlo rocoivors inpul impodanco romains Iov.
-
Ixil lo Rx_I0s.IdIo aflor 50 UI (20ns).
-
-
Inlor Rx_I0s.IdIo aflor 50 UI (20ns).
-
Wail unliI llo rocoivor dolocls an IIoclricaI IdIo oxil (i.o., a vaIid difforonliaI
voIlago is soon on llo rocoivors).
-
Tlo noxl slalo is Rx_I0s.ITS if llo rocoivor dolocls IIoclricaI IdIo oxil on any
configurod Iano.
-
-
Inlor llis slalo from Rx_I0s.IdIo if llo rocoivor dolocls IIoclricaI IdIo oxil on
any configurod Iano.
-
Rocoivor oblains Bil/SymboI IocI if a sufficionl numbor of ITS
Ordorod-Sols aro rocoivod.
Tlo rocoivor musl bo abIo lo rocoivo pacIols aflor llis slalo.

Ixil lo I0 slalo aflor SIip Ordorod-Sol rocoplion and a sufficionl numbor of
ITS Ordorod-Sols aro rocoivod (as advorlisod during llo Configuralion or
Rocovory slalos via llo N_ITS fioId of llo TS1/TS2 Ordorod-Sol).

Rocovory slalo is onlorod if an N_ITS limooul occurs (i.o., if llo rocoivor
rocoivos an insufficionl ITS Ordorod-Sols lo ro-oblain Bil/SymboI IocI).
Chapter 14: Link Initialization & Training
541
L1 State
Tlis is a Iovor povor slalo llan I0s and las a Iongor oxil Ialoncy llan llo I0s
oxil Ialoncy. Dovicos can manago onlry and oxil from llis slalo aulomalicaIIy
villoul any liglor IovoI soflvaro invoIvomonl. In addilion, Iovor manago-
monl soflvaro may dirocl a dovico lo pIaco ils upslroam IinI inlo I1 (boll
diroclions of llo IinI go lo I1) vlon llo dovico is pIacod in a Iovor povor
dovico slalo sucl as D1, D2, or D3.
Iiguro 14-16 on pago 542 slovs llo I1 onlry and Ixil slalo maclino. Tlis slalo
maclino is doscribod in llo subsoclions llal foIIov.
L1.Entry SubState

Tlo I0s slalo maclino is onlorod vlon a dovicos liglor Iayor dirocls llo dovico
lo do so.

- Tlo Transmillor sonds an IIoclricaI IdIo Ordorod-Sol and llo IinI onlors llo
IIoclricaI IdIo slalo.
-
Rx_L0s.Entry
Rx_L0s.Idle
(Rx in Electrical
Idle low power)
Rx_L0s.FTS
Exit to
L0
Entry
from L0
T
TX-IDLE-MIN
= 50 UI
Electrical
Idle Exit
N_FTS
timeout
Exit to
Recovery
Receiver detects
Electrical IDLE
ordered-set
SKIP
Ordered
Set
PCI Express System Architecture
542
- Tlo Transmillor drivos a DC common modo voIlago bolvoon 0 - 3.6 V.

Ixil lo I1.IdIo aflor 50 UI (20ns), vliIo llo lransmillor drivos a slabIo DC com-
mon modo voIlago.
L1.IdIe SubState

Inlor I1.IdIo aflor 50 UI (20ns), vliIo llo lransmillor drivos a slabIo DC com-
mon modo voIlago.

- Tlo IinI is in llo IIoclricaI IdIo slalo.
- Tlo lransmillors oulpul impodanco couId bo Iov or ligl, vliIo llo
rocoivors romains in llo Iov impodanco slalo.
- Romain in llis slalo unliI llo rocoivor dolocls IIoclricaI IdIo oxil (a vaIid dif-
foronliaI voIlago associalod vill llo rocoplion of a TS1 Ordorod-Sol usod lo
signaI I1 oxil).

Ixil lo Rocovory aflor llo rocoivor dolocls llo IIoclricaI IdIo oxil condilion, or if
llo dovico is diroclod lo do so.

L1.Entry
L1.Idle
(Electrical
Idle low power)
Exit to
Recovery
Entry
from L0
Directed or
Electrical Idle Exit
T
TX-IDLE-MIN=
50 UI
Directed and
Electrical Idle
Ordered set
Received and
Transmitted
Tx in Electrical Idle
Remain in
Electrical Idle
Chapter 14: Link Initialization & Training
543
L2 State
Tlis is ovon Iovor povor slalo llan I1 and las a Iongor oxil Ialoncy llan I1 oxil
Ialoncy. Iovor Managomonl soflvaro dirocls a dovico lo pIaco ils upslroam IinI
inlo I2 (boll diroclions of llo IinI go lo I2) vlon llo dovico is pIacod in a
Iovor povor dovico slalo sucl as D3
CoId
.
Iiguro 14-17 on pago 544 slovs llo I2 onlry and Ixil slalo maclino. Tlis slalo
maclino is doscribod noxl.
L2.IdIe SubState

Tlis slalo is onlorod vlon diroclod lo do so by liglor Iayors and an IIoclricaI
IdIo Ordorod-Sol is oxclangod bolvoon noiglbors across a IinI.

- Tlo Rocoivor romains in llo Iov impodanco slalo.
- Tlo Transmillor musl romain in llo IIoclricaI IdIo slalo for a minimum of 50
UI (20ns).
- Tlo Rocoivor slarls IooIing for llo IIoclricaI oxil condilion.
- DC common modo voIlago doosnl lavo lo bo in spoc. May bo lurnod off.
-
Wlon an upslroam porl is diroclod lo sond llo Boacon signaI duo lo a vaIoup
ovonl. AIso, vlon a Boacon is rocoivod on al Ioasl Iano 0 of a svilcl dovn-
slroam porl.

Wlon a Boacon is rocoivod on al Ioasl Iano 0 of a Rool CompIox dovnslroam
porl or if a Rool Iorl is diroclod by a liglor Iayor lo go lo llo Dolocl slalo. AIso,
oxil lo Dolocl if an upslroam Iano dolocls llo IIoclricaI IdIo oxil condilion.
L1.TransmitWake SubState

Inlor inlo I2.TransmilWaIo vlon an upslroam porl is diroclod lo sond llo Boa-
con signaI duo lo a vaIoup ovonl. AIso, oxil lo I2.TransmilWaIo vlon a Boacon
signaI is rocoivod on al Ioasl Iano 0 of a svilcl dovnslroam porl.
-
Transmil llo Boacon signaI on al Ioasl Iano 0 of llo upslroam porl in llo diroc-
lion of llo Rool CompIox.
Go lo Dolocl if an upslroam porl dolocls IIoclricaI IdIo oxil condi-
lion.
PCI Express System Architecture
544
Hot Reset State
Hol Rosol is an in-band signaIod rosol lriggorod by soflvaro as oxpIainod in In-
Band Rosol or Hol Rosol on pago 491. Tlo slalo maclino in Iiguro 14-18 on
pago 545 doscribos onlry lo and oxil from llo Hol Rosol slalo.

IinIs llal aro diroclod lo do so by liglor Iayors onlor Hol Rosol llrougl llo
Rocovory slalo.
-
- On aII Ianos, llo lransmillor (on a dovnslroam porl) conlinuousIy lrans-
mils TS1s vill llo Hol Rosol bil sol and conlaining llo configurod IinI and
Iano Numbors. Tlo Hol Rosol inilialor aIso rosols ilsoIf.
- A rocoivor dolocls Hol Rosol vlon il dolocls al Ioasl lvo TS1s vill llo Hol
Rosol bil sol. Il onlors llo Hol Rosol slalo llrougl rocovory.
- IinIUp = 0.

Ixil lo dolocl aflor a 2ms limooul.

L2.Idle
(Electrical Idle low
power. No DC CMV)
L2.TransmitWake
Exit to
Detect
Entry
from L0
Send Beacon
(Upstream ports only)
Exit from
Electrical Idle
Detected
Directed and
Electrical Idle
Ordered set
Received and
Transmitted
Rx terminations
Enabled
Rx looking for exit
Directed or
Beacon detected
(Downstream Root ports)
Exit from Elec. Idle
(Upstream Lanes)
Beacon detected
(Downstream Switch ports)
Directed to send Beacon
(Upstream ports)
Chapter 14: Link Initialization & Training
545
DisabIe State
A DisabIod IinI is a IinI llal is off and doos nol lavo lo lavo llo DC common
modo voIlago drivon. If, for oxampIo, soflvaro vislos lo lurn off a fauIly IinI, il
can do so by solling llo IinI DisabIo bil (soo Iiguro 14-23 on pago 553) in llo
IinI ConlroI rogislor of a dovico. Tlal dovico lransmils TS1s vill llo IinI Dis-
abIo bil assorlod. Tlo slalo maclino in Iiguro 14-19 on pago 546 doscribos onlry
lo and oxil from llo DisabIo slalo.

AII Ianos lransmil 16 TS1 Ordorod-Sols vill llo IinI DisabIo bil assorlod and
llon lransilion lo IIoclricaI IdIo aflor lransmilling llo IIoclricaI IdIo Ordorod-
Sol. If no IIoclricaI IdIo Ordorod-Sol is lransmillod, llon llo rocoivor lransilions
lo llo Dolocl slalo aflor 2ms. Tlo DC common modo voIlago doos nol lavo lo bo
villin spoc vliIo in Dolocl.
-
- Romain in DisabIo slalo unliI llo DisabIo oxil condilion is doloclod.
- Tlo DC common modo voIlago doos nol lavo lo bo villin spoc.
- IinIUp = 0.
-
Hot Reset
Exit to
Detect
Recovery
Tx for 2 ms TS1s w/ Hot Reset bit 0 of symbol 5 set
Or Rx two TS1s with Hot Reset bit set
Directed
Timeout
2 ms
PCI Express System Architecture
546

Ixil lo dolocl aflor a 2ms limooul vloroin no IIoclricaI IdIo Ordorod-sol is
rocoivod, or DisabIo onlry, or an IIoclricaI IdIo oxil is sonsod, or as diroclod by
liglor Iayors.
-
Disabled
(Electrical Idle)
Exit to
Detect
Entry
From Configuration
Or Recovery
Directed or
Electrical Idle Exit or
No Electrical Idle
ordered set after 2 ms
Tx 16 TS1s w/ Disable bit 1 of Symbol 5 set
And Tx Electrical Idle ordered set
Chapter 14: Link Initialization & Training
547
Loopback State
Tlo IoopbacI foaluro is a losl and dobug foaluro and is nol usod in normaI
oporalion. A IoopbacI maslor dovico (sucl as a loslor) vlon connoclod lo a
dovicos IinI (llo dovico undor losl is llo IoopbacI sIavo vlon in llo Ioop-
bacI slalo) can pIaco llo IinI and IoopbacI sIavo inlo llo IoopbacI slalo by
lransmilling TS1 Ordorod-Sols vill llo IoopbacI bil assorlod. Tlo IoopbacI
maslor can sorvo as llo BIST (BuiIl In SoIf Tosl) ongino.
Onco in llis slalo, llo IoopbacI maslor sonds vaIid 8b/10b oncodod symboIs lo
llo IoopbacI sIavo. Tlo IoopbacI sIavo lurns around and foods bacI llo sym-
boI slroam. Tlo IoopbacI sIavo conlinuos lo porform cIocI loIoranco componsa-
lion, so llo maslor musl onsuro llal il insorls SIip Ordorod-Sols al llo corrocl
inlorvaIs. To porform cIocI loIoranco componsalion, llo IoopbacI sIavo may
lavo lo add or doIolo SKI symboIs lo llo SIip Ordorod-Sol llal il foods bacI
vill llo symboI slroam lo llo IoopbacI maslor. If SKI symboIs aro addod by
llo IoopbacI sIavo, lloy lavo lo bo of llo samo disparily as llo rocoivod SKI
symboIs.
Tlo IoopbacI slalo is oxilod vlon llo IoopbacI maslor lransmils llo IIoclricaI
IdIo Ordorod-Sol and llo rocoivor dolocls llal llo IinI las lransilionod lo llo
IIoclricaI IdIo slalo.
Soo Iiguro 14-20 on pago 549 for a doscriplion of IoopbacI onlry and oxil proco-
duro.
Loopback.Entry SubState

As diroclod by liglor Iayors, a IoopbacI maslor can lransmil TS1 Ordorod-Sols

vill llo IoopbacI bil sol.

- Tlo IoopbacI Maslor conlinuousIy lransmils TS1 Ordorod-Sols vill llo
IoopbacI bil sol.
- Tlo IoopbacI SIavo rolurns llo idonlicaI TS1 Ordorod-Sols.
- IinIUp = 0.

Wlon llo maslor rocoivos TS1 Ordorod-Sols, llo sIavo las onlorod llo Ioop-
bacI.Aclivo subslalo.

If llo maslor doos nol rocoivo idonlicaI TS1 Ordorod-Sols, or doos nol rocoivo
TS1 Ordorod-Sols for 100ms, il lransilions lo llo IoopbacI.Ixil slalo.
PCI Express System Architecture
548
Loopback.Active SubState

If llo maslor rocoivos TS1s idonlicaI lo lloso il lransmillod, llo sIavo las onlorod
llo IoopbacI.Aclivo subslalo.

- Tlo IoopbacI maslor lransmils vaIid 8b/10b symboIs vill vaIid disparily.
- Tlo IoopbacI SIavo rolurns llo idonlicaI 8b/10b symbos vill vaIid dispar-
ily vliIo porforming poriodicaIIy porforming cIocI loIoranco componsa-
lion.

Tlo IoopbacI maslor lransmils al Ioasl 1ms of IIoclricaI IdIo Ordorod-Sols. A
rocoivor dolocls IoopbacI oxil vlon il rocoivos llo IIoclricaI IdIo Ordorod-Sol,
or sonsos llo IIoclricaI IdIo slalo of llo IinI.
Loopback.Exit SubState

Tlo IoopbacI maslor lransmils al Ioasl 1ms of IIoclricaI IdIo Ordorod-Sols and
llon onlors llo IIoclricaI IdIo slalo. A rocoivor dolocls IoopbacI oxil vlon il
rocoivos llo IIoclricaI IdIo Ordorod-Sol, or sonsos llo IIoclricaI IdIo slalo of llo
IinI.

- Tlo IoopbacI maslor lransmils IIoclricaI IdIo Ordorod-Sols for al Ioasl 2ms.
- Tlo IoopbacI SIavo musl onlor IIoclricaI IdIo on aII Ianos for 2ms. Boforo
onloring IoopbacI.Ixil, llo sIavo musl oclo bacI aII symboIs il rocoivod
from llo maslor.
Tlo dovico llon oxils lo llo Dolocl slalo.
Chapter 14: Link Initialization & Training
549
LTSSM ReIated Configuration Registers
OnIy lloso bils associalod vill llo IinI Training and IniliaIizalion slalo aro
doscribod loro.
Link CapabiIity Register
Tlo IinI CapabiIily Rogislor is piclurod in Iiguro 14-21 on pago 550 and oacl
bil fioId is doscribod in llo subsoclions llal foIIov.
Maximum Link Speed[3:0]
Tlis bil musl curronlIy bo lard-virod lo 0001b, indicaling llal ils supporlod
spood is llo Gonoralion 1 IinI spood of 2.5Gbils/s. AII ollor oncodings aro
rosorvod.

Loopback.Entry Loopback.Active Loopback.Exit
Exit to
Detect
Entry
from Configuration
Or Recovery
Slave: Electrical Idle
Detected or Electrical
Idle order set received
for 1 ms
Master: Directed
Timeout less than
100 ms
Master Tx
TS1s w/Loopback
Bit set
Master receives
Identical TS1s;
Slave has
entered
Loopback
Master sends valid
8B/10B data
Slave required to
retransmit exactly
Slave: Enter Electrical
Idle for 2 ms
Master: Tx an
Electrical Idle order
set and enter
Electrical Idle for 2 ms
PCI Express System Architecture
550
Maximum Link Width[9:4]
Tlis fioId indicalos llo maximum vidll of llo ICI Ixpross IinI. Tlo vaIuos
llal aro dofinod aro:
- 000000b: Rosorvod.
- 000001b: x1.
- 000010b: x2.
- 000100b: x4.
- 001000b: x8.
- 001100b: x12.
- 010000b: x16.
- 100000b: x32.
- AII ollors aro rosorvod.
Tlis rogislor is oillor lard-virod or is aulomalicaIIy updalod by lardvaro aflor
passing llrougl llo Dolocl slalo of llo ITSSM. Tlis bil cannol bo cIoarod or
vrillon by soflvaro.
- -
Chapter 14: Link Initialization & Training
551
Link Status Register
Tlo IinI Slalus Rogislor is piclurod in Iiguro 14-22 on pago 552 and oacl bil
fioId is doscribod in llo subsoclions llal foIIov.
Link Speed[3:0]:
Tlis fioId is road-onIy and indicalos llo nogolialod IinI spood of llo ICI
Ixpross IinI. Il is updalod during llo IoIIing slalo of llo ITSSM. CurronlIy, llo
onIy dofinod oncoding is 0001b, indicaling a IinI spood of 2.5Gbils/s.
Negotiate Link Width[9:4]
Tlis fioId indicalos llo rosuIl of IinI vidll nogolialion. Tloro aro sovon possibIo
vidlls, aII ollor oncodings aro rosorvod. Tlo dofinod oncodings aro:
- 000001b: for x1.
- 000010b for x2.
- 000100b for x4.
- 001000b for x8.
- 001100b for x12.
- 010000b for x16.
- 100000b for x32.
Training Error[10]
Tlis bil is sol by lardvaro vlon a IinI Training orror las occurrod. Il is cIoarod
by llo lardvaro upon succossfuI lraining of llo IinI vlon llo IinI las onlorod
llo I0 (aclivo) slalo. Tlis bil is onIy supporlod in upslroam dovicos sucl as a
Rool CompIox or Svilcl dovn slroam porls.
Link Training[11]
Tlis bil is sol by llo lardvaro vliIo IinI Training is in progross and is cIoarod
vlon IinI Training compIolos. Tlo ITSSM is oillor in llo Configuralion or
Rocovory slalo vlon llis bil is sol.
PCI Express System Architecture
552
Link ControI Register
Tlo IinI ConlroI Rogislor is piclurod in Iiguro 14-23 on pago 553 and oacl bil
fioId is doscribod in llo subsoclions llal foIIov.
Link DisabIe
Wlon sol lo ono, llo IinI is disabIod. Il is nol appIicabIo lo and is rosorvod for
Indpoinl dovicos and for an upslroam porl on a Svilcl. Wlon llis bil is vril-
lon, any road immodialoIy rofIocls llo vaIuo vrillon, rogardIoss of llo slalo of
llo IinI. Wriling llis bil causos llo dovico lo lransmil 16 TS Ordorod-Sols vill
llo IinI DisabIo bil assorlod.
Retrain Link
Tlis bil aIIovs soflvaro lo inilialo IinI ro-lraining. Tlis couId bo usod in orror
rocovory. Tlo bil is nol appIicabIo lo and is rosorvod for Indpoinl dovicos and
llo upslroam porls of a Svilcl. Wlon sol lo ono, llis dirocls llo ITSSM lo llo
Rocovory slalo boforo llo compIolion of llo Configuralion vrilo roquosl is
rolurnod.
Extended Synch
Tlis bil is usod lo forco llo lransmission of 4096 ITS (Iasl Training Soquonco)
Ordorod-Sols in I0s foIIovod by a singIo SIip Ordorod-Sol prior lo onloring I0.
Il aIso forcos llo lransmission of 1024 TS1 Ordorod-Sols in I1 prior lo onloring
- -
Chapter 14: Link Initialization & Training
553
llo Rocovory slalo. Tlis oxlondod sync pormils oxlornaI looIs moniloring llo
IinI limo lo acliovo Bil and SymboI IocI boforo llo IinI onlors llo I0 or Rocov-
ory slalos and rosumos normaI communicalion.
-
Iarl Iour
Iovor-RoIalod
Topics

The Previous Chapter
Tlo provious claplor doscribod llo funclion of llo IinI Training and Slalus
Slalo Maclino (ITSSM) of llo IlysicaI Iayor. Il aIso doscribod llo iniliaIizalion
procoss of llo IinI from Iovor-On or Rosol, unliI llo fuII-on I0 slalo, vloro
lraffic on llo IinI can bogin. In addilion, llo claplor doscribod llo Iovor povor
managomonl slalos I0s, I1, I2, I3 and briofIy discussos onlry and oxil proco-
duro lo/from lloso slalos.
This Chapter
Tlis claplor doscribos llo moclanisms llal soflvaro can uso lo dolormino
vlollor llo syslom can supporl an add-in card basod on llo amounl of povor
and cooIing capacily il roquiros.
The Next Chapter
Tlo noxl claplor providos a dolaiIod doscriplion of ICI Ixpross povor manago-
monl, vlicl is compalibIo vill rovision 1.1 of llo -
and llo rovision 2.0 (ACII). In
addilion ICI Ixpross dofinos oxlonsions llal aro orllogonaI lo llo ICI-IM
spocificalion. Tloso oxlonsions focus primariIy on IinI Iovor and IM ovonl
managomonl. Tlis claplor aIso providos an ovoraII conloxl for llo discussion of
povor managomonl, by incIuding a doscriplion of llo OnNov Inilialivo, ACII,
and llo invoIvomonl of llo Windovs OS is aIso providod.
Introduction to Power Budgeting
Tlo primary goaI of llo ICI Ixpross povor budgoling capabiIily is lo aIIocalo
povor for ICI Ixpross lol pIug dovicos, vlicl can bo addod lo llo syslom dur-
ing runlimo. Tlis capabiIily onsuros llal llo syslom can aIIocalo llo propor
amounl of povor and cooIing for lloso dovicos.
-- -

Tlo spocificalion slalos llal povor budgoling capabiIily is oplionaI for ICI
Ixpross dovicos impIomonlod in a form faclor vlicl doos nol roquiro lol pIug,
or llal aro inlogralod on llo syslom board. Nono of llo form faclor spocifica-
lions roIoasod al llo limo of llis vriling roquirod supporl for lol pIug and did
nol roquiro llo povor budgoling capabiIily. Hovovor, form faclor spocificalions
undor dovoIopmonl viII roquiro lol pIug supporl and may aIso roquiro povor
budgoling capabiIily.
Syslom povor budgoling is aIvays roquirod lo supporl aII syslom board dovicos
and add-in cards. Tlo nov povor budgoling capabiIily providos moclanisms
for managing llo budgoling procoss. Iacl form faclor spocificalion dofinos llo
minimum and maximum povor for a givon oxpansion sIol. Ior oxampIo, llo
IIoclromoclanicaI spocificalion Iimils llo amounl of povor an oxpansion card
can consumo prior lo and during configuralion, bul aflor a card is configurod
and onabIod, il can consumo llo maximum amounl of povor spocifiod for llo
sIol. Claplor 18, onlilIod "Add-in Cards and Connoclors," on pago 685. Conso-
quonlIy, in llo absonco of llo povor budgoling capabiIily rogislors, llo syslom
dosignor is rosponsibIo for guaranlooing llal povor las boon budgolod cor-
roclIy and llal sufficionl cooIing is avaiIabIo lo supporl any compIianl card
inslaIIod inlo llo connoclor.
Tlo spocificalion dofinos llo configuralion rogislors llal aro dosignod lo sup-
porl llo povor budgoling procoss, bul doos nol dofino llo povor budgoling
mollods and procossos. Tlo noxl soclion doscribos llo lardvaro and soflvaro
oIomonls llal vouId bo invoIvod in povor budgoling, incIuding llo spocifiod
configuralion rogislors.
The Power Budgeting EIements
Iiguro 15-2 iIIuslralos llo concopl of Iovor Budgoling for lol pIug cards. Tlo
roIo of oacl oIomonl invoIvod in llo povor budgoling, aIIocalion, and roporling
procoss is Iislod and doscribod boIov:
- Syslom Iirmvaro Iovor Managomonl (usod during bool limo)
- Iovor Budgol Managor (usod during run limo)
- Ixpansion Iorls (porls lo vlicl card sIols aro allaclod)
- Add-in Dovicos (Iovor Budgol CapabIo)
- Syslom firmvaro, laving InovIodgo of llo syslom dosign,
is rosponsibIo for roporling syslom povor informalion. Tlo spocificalion rocom-
monds llo foIIoving povor informalion bo roporlod lo llo ICI Ixpross povor
budgol managor, vlicl aIIocalos and vorifios povor consumplion and dissipa-

lion during runlimo:

- TolaI syslom povor avaiIabIo.
- Iovor aIIocalod lo syslom dovicos by firmvaro
- Numbor and lypo of sIols in llo syslom.
Iirmvaro may aIso aIIocalo povor lo ICI Ixpross dovicos llal supporl llo
povor budgoling capabiIily configuralion rogislor sol (o.g., a lol-pIug dovico
usod during bool limo). Tlo Iovor Budgoling CapabiIily rogislor (soo Iiguro
15-1) conlains a Syslom AIIocalod bil llal is inlondod lo bo sol by firmvaro lo
nolify llo povor budgol managor llal povor for llis dovico las boon incIudod
in llo syslom povor aIIocalion. Nolo llal llo povor managor musl road and
savo povor informalion for lol-pIug dovicos llal aro aIIocalod by llo syslom, in
caso lloy aro romovod during runlimo.
Tlo povor managor iniliaIizos vlon llo OS inslaIIs, al
vlicl limo il rocoivos povor-budgol informalion from syslom firmvaro. Tlo
spocificalion doos nol dofino llo mollod for communicaling llis informalion.
Tlo povor budgol managor is rosponsibIo for aIIocaling povor for aII ICI
Ixpross dovicos. Tlis aIIocalion incIudos:
- ICI Ixpross dovicos llal lavo nol aIroady boon aIIocalod by llo syslom
(incIudos omboddod dovicos llal supporl povor budgoling).
- Hol-pIuggod dovicos inslaIIod al bool limo.
- Nov dovicos addod during runlimo.
-
-- -

- - Iiguro 15-2 on pago 561 iIIuslralos a lol pIug porl llal musl
lavo llo SIol Iovor Iimil and SIol Iovor ScaIo fioIds villin llo SIol CapabiIi-
lios rogislor impIomonlod. Tlo firmvaro or povor budgol managor musl Ioad
lloso fioIds vill a vaIuo llal roprosonls llo maximum amounl of povor sup-
porlod by llis porl. Wlon soflvaro vrilos lo lloso fioIds llo porl doIivors llo
Sol_SIol_Iovor_Iimil mossago lo llo dovico. Tloso fioIds aro aIso vrillon vlon
soflvaro configuros a card llal las boon addod during a lol pIug inslaIIalion.
Tlo ICI Ixpross spocificalion roquiros llal:
- Any dovnslroam porl of a Svilcl or a Rool CompIox llal las a sIol
allaclod (i.o., llo SIol ImpIomonlod bil villin ils ICI Ixpross CapabiIilios
rogislor is sol) musl impIomonl llo SIol CapabiIilios rogislor.
- Soflvaro musl iniliaIizo llo SIol Iovor Iimil VaIuo and ScaIo fioIds of llo
SIol CapabiIilios rogislor of llo Svilcl or Rool CompIox Dovnslroam Iorl
llal is connoclod lo an add-in sIol.
- Tlo Upslroam Iorl of an Indpoinl, Svilcl, or a ICI Ixpross-ICI Bridgo
musl impIomonl llo Dovico CapabiIilios rogislor.
- Wlon a card is inslaIIod in a sIol, and soflvaro updalos llo povor Iimil and
scaIo vaIuos in llo Dovnslroam porl of llo Svilcl or Rool CompIox, llal
porl viII aulomalicaIIy lransmil llo Sol_SIol_Iovor_Iimil mossago lo llo
Upslroam Iorl of llo Indpoinl, Svilcl, or a ICI Ixpross-ICI Bridgo on llo
inslaIIod card.
- Tlo rocipionl of llo Mossago musl uso llo vaIuo in llo Mossago dala pay-
Ioad lo Iimil usago of llo povor for llo onliro card/moduIo, unIoss llo
card/moduIo viII novor oxcood llo Iovosl vaIuo spocifiod in llo corro-
sponding oIoclromoclanicaI spocificalion.
-Ixpansion cards llal supporl llo povor budgoling capabiIily
musl incIudo llo:
- SIol Iovor Iimil VaIuo and SIol Iimil ScaIo fioIds villin llo Dovico Capa-
biIilios rogislor.
- Iovor Budgoling CapabiIily rogislor sol for roporling povor-roIalod infor-
malion.
Tloso dovicos musl nol consumo moro povor llan llo Iovosl povor spocifiod
by llo form faclor spocificalion. Onco povor budgoling soflvaro aIIocalos addi-
lionaI povor via llo Sol_SIol_Iovor_Iimil mossago, llo dovico can consumo
llo povor spocifiod, bul nol unliI il las boon configurod and onabIod.

Tlo dovicos soflvaro drivor is rosponsibIo for vorifying llal

sufficionl povor is avaiIabIo for propor dovico oporalion prior lo onabIing il. If
llo povor is Iovor llan llal roquirod by llo dovico, llo dovico drivor is rospon-
sibIo for roporling llis lo a liglor soflvaro aullorily.
-
-- -

SIot Power Limit ControI

Soflvaro is rosponsibIo for dolormining llo maximum amounl of povor llal an
oxpansion dovico is aIIovod lo consumo. Tlis povor aIIocalion is basod on llo
povor parlilioning villin llo syslom, llormaI capabiIilios, olc. KnovIodgo of
llo sysloms povor and llormaI Iimils comos from syslom firmvaro. Tlo firm-
varo or povor managor (vlicl rocoivos povor informalion from firmvaro) is
rosponsibIo for roporling llo povor Iimils lo oacl oxpansion porl.
Expansion Port DeIivers SIot Power Limit
Soflvaro vrilos lo llo and fioIds of
llo SIol CapabiIily rogislor lo spocify llo maximum povor llal can bo con-
sumod by llo dovico. Soflvaro is roquirod lo spocify a povor vaIuo llal rofIocls
ono of llo maximum vaIuos dofinod by llo spocificalion. Ior oxampIo, llo oIoc-
lromoclanicaI spocificalion dofinos maximum povor Iislod in TabIo 15-1.
Wlon lloso rogislors aro vrillon by povor budgol soflvaro, llo oxpansion porl
sonds a Sol_SIol_Iovor_Iimil mossago lo llo oxpansion dovico. Tlis procoduro
is iIIuslralod in Iiguro 15-3 on pago 563.
- - - -

Slandard Hoigll 10W
(max)
25W
(max)
25W (max) 25W
(max)
40W
(max)
Iov IrofiIo Card 10W (max) 10W (max) 25W (max)

-- -

Expansion Device Limits Power Consumption

Tlo dovico drivor roads llo vaIuos from llo SIol Iovor Iimil and ScaIo fioIds lo
vorify llal llo povor avaiIabIo is sufficionl lo oporalo llo dovico. SovoraI condi-
lions may oxisl:
- Tlo povor avaiIabIo is llo povor roquirod lo oporalo llo dovico al fuII
capabiIily. In llis caso, llo drivor onabIos llo dovico by vriling lo llo con-
figuralion Command rogislor, pormilling llo dovico lo consumo up lo llo
amounl of povor spocifiod in llo Iovor Iimil fioIds.
- Tlo povor avaiIabIo is sufficionl lo oporalo llo dovico bul nol al fuII capa-
biIily. In llis caso, llo drivor is roquirod lo configuro llo dovico sucl llal il
consumos no moro povor llan spocifiod in llo Iovor Iimil fioIds.
- Tlo povor avaiIabIo is < llo povor roquirod lo oporalo llo dovico. In llis
caso, llo drivor musl nol onabIo llo card and musl roporl llo inadoqualo
povor condilion lo llo uppor soflvaro Iayors, vlicl idoaIIy vouId inform
llo ond usor of llo povor-roIalod probIom.
- Tlo povor avaiIabIo oxcoods llo maximum povor spocifiod by llo form
faclor spocificalion. Tlis condilion slouId nol occur. Hovovor, if il doos, llo
dovico is nol pormillod lo consumo povor boyond llo maximum pormillod
by llo form faclor.
- Tlo povor avaiIabIo is < llo Iovosl vaIuo spocifiod by llo form faclor spoc-
ificalion. Tlis is a vioIalion of llo spocificalion, vlicl slalos llal llo oxpan-
sion porl musl nol lransmil a Sol_SIol_Iovor_Iimil Mossago vlicl
indicalos a Iimil llal is Iovor llan llo Iovosl vaIuo spocifiod in llo oIoclro-
moclanicaI spocificalion for llo sIol's form faclor. Soo TabIo 15-1 on
pago 562.
Somo dovicos impIomonlod on oxpansion dovicos may consumo Ioss povor
llan llo Iovosl Iimil spocifiod for llo form faclor. Sucl dovicos aro pormillod lo
discard llo informalion doIivorod in llo Sol_SIol_Iovor_Iimil Mossagos. Wlon
llo SIol Iovor Iimil VaIuo and ScaIo fioIds aro road, lloso dovicos rolurn zoros.
The Power Budget CapabiIities Register Set
Tloso rogislors pormil povor budgoling soflvaro lo aIIocalo povor moro offoc-
livoIy basod on informalion providod by llo dovico llrougl ils povor budgol
dala soIocl and dala rogislor. Tlis foaluro is simiIar lo llo dala soIocl and dala
fioIds villin llo povor managomonl capabiIily rogislors. Hovovor, llo povor
budgol rogislors provido moro dolaiIod informalion llal is usofuI lo soflvaro

vlon dolormining llo offocls of oxpansion cards llal aro addod during runlimo
on llo syslom povor budgol and cooIing roquiromonls. Tlrougl llis capabiIily,
a dovico can roporl llo povor il consumos:
- from oacl povor raiI
- in various povor managomonl slalos
- in difforonl oporaling condilions
Tloso rogislors aro nol roquirod for dovicos impIomonlod on llo syslom board
or on oxpansion dovicos llal do nol supporl lol pIug. Iiguro 15-4 on pago 565
iIIuslralos llo povor budgol capabiIilios rogislor sol and slovs llo dala soIocl
and dala fioId llal provido llo mollod for accossing llo povor budgol informa-
lion.
Tlo povor budgol informalion is mainlainod villin a labIo llal consisls of ono
or moro 32-bil onlrios. Iacl labIo onlry conlains povor budgol informalion for
llo difforonl oporaling modos supporlod by llo dovico. Iacl labIo onlry is
soIoclod via llo dala soIocl fioId, and llo soIoclod onlry is llon road from llo
dala fioId. Tlo indox vaIuos slarl al zoro and aro impIomonlod in soquonliaI
ordor. Wlon a soIoclod indox rolurns aII zoros in llo dala fioId, llo ond of llo
povor budgol labIo las boon Iocalod. Iiguro 15-5 on pago 566 iIIuslralos llo for-
mal and lypos of informalion avaiIabIo from llo dala fioId.
--
-- -

The Previous Chapter

Tlo provious claplor doscribod llo moclanisms llal soflvaro can uso lo dolor-
mino vlollor llo syslom can supporl an add-in card basod on llo amounl of
povor and cooIing capacily il roquiros.
This Chapter
Tlis claplor providos a dolaiIod doscriplion of ICI Ixpross povor manago-
monl, vlicl is compalibIo vill rovision 1.1 of llo -
and llo rovision 2.0 (ACII). In
addilion ICI Ixpross dofinos oxlonsions llal aro orllogonaI lo llo ICI-IM
spocificalion. Tloso oxlonsions focus primariIy on IinI Iovor and IM ovonl
managomonl. Tlis claplor aIso providos an ovoraII conloxl for llo discussion of
povor managomonl, by incIuding a doscriplion of llo OnNov Inilialivo, ACII,
and llo invoIvomonl of llo Windovs OS is aIso providod.
The Next Chapter
ICI Ixpross incIudos nalivo supporl for lol pIug impIomonlalions. Tlo noxl
claplor discussos lol pIug and lol romovaI of ICI Ixpross dovicos. Tlo spocifi-
calion dofinos a slandard usago modoI for aII dovico and pIalform form faclors
llal supporl lol pIug capabiIily. Tlo usago modoI dofinos, as an oxampIo, lov
pusl bullons and indicalors (IIDs) bolavo, if impIomonlod on llo classis,
add-in card or moduIo. Tlo dofinilions assignod lo llo indicalors and pusl bul-
lons, doscribod in llis claplor, appIy lo aII modoIs of lol pIug impIomonlalions.
-- -

Introduction
ICI Ixpross povor managomonl (IM) dofinos lvo major aroas of supporl:
- . ICI Ixpross povor managomonl is
basod upon lardvaro and soflvaro compalibIo vill llo -
Rovision 1.1 (aIso roforrod lo as ICI-IM)
and llo Rovision 2.0
(commonIy Inovn as ACII). Tlis supporl roquiros llal aII ICI Ixpross
funclions incIudo llo ICI Iovor Managomonl CapabiIily rogislors, vlicl
pormils lransilions bolvoon funclion IM slalos.
- -- --. Tloso oxlonsions dofino aulonomous lard-
varo-basod IinI Iovor Managomonl, moclanisms for vaIing llo syslom,
a Mossago lransaclion lo roporl Iovor Managomonl Ivonls (IMI), and Iov
povor lo aclivo slalo Ialoncy roporling and caIcuIalion.
Tlis claplor is sogmonlod inlo fivo major soclions:
1. Tlo firsl soclion is inlondod as a primor for llo discussion of povor man-
agomonl, by rovioving llo roIo of syslom soflvaro in conlroIIing povor
managomonl foaluros. Tlis soclion roslricls llo discussion lo llo
povor-managomonl soflvaro from llo Windovs Oporaling Syslom por-
spoclivo.
2. Tlo socond soclion Iunclion Iovor Managomonl on pago 585 discussos
ICI-IM roquirod by ICI Ixpross for pIacing funclions inlo lloir Iov povor
slalos. Tlis soclion aIso documonls llo ICI-IM capabiIily rogislors usod in
ICI Ixpross. Nolo llal somo of llo rogislor dofinilions aro modifiod or nol
usod by ICI Ixpross funclions.
3. Noxl, IinI Aclivo Slalo Iovor Managomonl on pago 608 doscribos llo
aulonomous IinI povor managomonl llal occurs vlon a dovico is in ils
aclivo slalo (D0). Aclivo Slalo Iovor Managomonl (ASIM) is a lard-
varo-basod IinI povor consorvalion moclanism. Soflvaro onabIos ASIM
and roads Ialoncy vaIuos lo dolormino llo IovoI of ASIM approprialo, bul
doos nol inilialo lransilions inlo ASIM.
4. Tlo llird soclion Soflvaro Inilialod IinI Iovor Managomonl on
pago 629 discussos llo IinI povor managomonl, vlicl is lriggorod by
ICI-IM soflvaro vlon il clangos llo povor slalo of a dovico. ICI Ixpross
dovicos aro roquirod lo aulomalicaIIy consorvo IinI povor vlon soflvaro
pIacos a dovico inlo a Iov povor slalo, incIuding D3coId, (causod by llo rof-
oronco cIocI and main povor boing compIoloIy romovod from a dovico).
5. IinaIIy, IinI WaIo IrolocoI and IMI Gonoralion on pago 638 covors
Iovor Managomonl Ivonls (IMI) and vaIoup signaIing. Dovicos may

roquosl llal soflvaro rolurn llom lo llo aclivo slalo so lloy can landIo an
ovonl llal las occurrod. Tlis is dono by sonding IMI mossagos. Wlon
povor las boon romovod from a dovico, auxiIiary povor is roquirod lo
monilor ovonls and lo signaI WaIoup for roaclivaling llo IinI. Onco a
dovico las boon ro-povorod and llo IinI las boon ro-lrainod llo IMI mos-
sago can bo sonl.
Primer on Configuration Software
Tlo - doscribos lov lo impIomonl llo ICI IM
rogislors llal aro roquirod in ICI Ixpross. Tloso rogislors pormil llo OS lo man-
ago llo povor onvironmonl of boll ICI and ICI Ixpross funclions.
Rallor llan immodialoIy diving inlo a dolaiIod nuls-and-boIls doscriplion of
llo - , ils a good idoa lo bogin by doscribing
vloro il fils villin llo ovoraII conloxl of llo OS and llo syslom. Ollorviso, llis
vouId jusl bo a disconnoclod discussion of rogislors, bils, signaIs, olc. vill no
framo of roforonco.
Basics of PCI PM
Tlo mosl popuIar OSs curronlIy in uso on IC-compalibIo maclinos aro Win-
dovs 98/NT/2000/XI. Tlis soclion providos an ovorviov of lov llo OS inlor-
acls vill ollor major soflvaro and lardvaro oIomonls lo manago llo povor
usago of individuaI dovicos and llo syslom as a vloIo. TabIo 16-1 on pago 569
inlroducos llo major oIomonls invoIvod in llis procoss and providos a vory
basic doscriplion of lov lloy roIalo lo oacl ollor. Il slouId bo nolod llal noillor
llo ICI Iovor Managomonl spoc nor llo ACII spoc (Advancod Configuralion
and Iovor Inlorfaco) diclalo llo poIicios llal llo OS usos lo manago povor. Il
doos, lovovor, dofino llo rogislors (and somo dala slrucluros) llal aro usod lo
conlroI llo povor usago of ICI and ICI Ixpross funclions.
-
--
OS Dirocls llo -- .To accompIisl llis goaI,
llo OS issuos roquosls lo llo ACII Drivor, WDM (Windovs Drivor
ModoI) dovico drivors, and lo llo ICI Ixpross Bus Drivor. AppIicalion
programs llal aro povor consorvalion-avaro inloracl vill llo OS lo
accompIisl dovico povor managomonl.
-- -

ACII Drivor Managos configuralion, povor managomonl, and llormaI conlroI of

- --
- - -. IxampIos couId bo
clipsol-spocific rogislors, syslom board-spocific rogislors llal conlroI
povor pIanos, olc. Tlo IM rogislors villin ICI Ixpross funclions
(omboddod or ollorviso) aro dofinod by llo ICI IM spoc and aro lloro-
foro nol managod by llo ACII drivor, bul rallor by llo ICI Ixpross Bus
Drivor (soo onlry in llis labIo).
WDM Dovico
Drivor
Tlo WDM drivor is a -- llal can vorI vill any dovico llal
faIIs villin llo CIass of dovicos llal il vas vrillon lo conlroI. Tlo facl
llal ils nol vrillon for a spocific dovico from a spocific vondor moans
llal il doosnl lavo rogislor and bil-IovoI InovIodgo of llo dovicos
inlorfaco. Wlon il noods lo issuo a command lo or clocI llo slalus of
llo dovico, il issuos a roquosl lo llo drivor suppIiod by llo
vondor of llo spocific dovico.
Tlo WDM aIso doosnl undorsland dovico claraclorislics llal aro pocu-
Iiar lo a spocific bus impIomonlalion of llal dovico lypo. As an oxampIo,
llo WDM doosnl undorsland a ICI Ixpross dovicos configuralion rog-
islor sol. Il doponds on llo -- - lo communicalo
vill ICI Ixpross configuralion rogislors.
Wlon il rocoivos roquosls from llo OS lo conlroI llo povor slalo of ils
ICI Ixpross dovico, il passos llo roquosl lo llo ICI Ixpross Bus Drivor:
Wlon a roquosl lo povor dovn ils dovico is rocoivod from llo OS, llo
WDM savos llo conlonls of ils associalod ICI Ixpross funclions
dovico-spocific rogislors (in ollor vords, il porforms a conloxl savo) and
llon passos llo roquosl lo llo ICI Ixpross Bus Drivor lo clango llo
povor slalo of llo dovico.
ConvorsoIy, vlon a roquosl lo ro-povor llo dovico is rocoivod from llo
OS, llo WDM passos llo roquosl lo llo ICI Ixpross Bus Drivor lo
clango llo povor slalo of llo dovico. Aflor llo ICI Ixpross Bus Drivor
las ro-povorod llo dovico, llo WDM llon rosloros llo conloxl lo llo
ICI Ixpross funclions dovico-spocific rogislors.
Miniporl Drivor , il rocoivos roquosls from llo WDM
CIass drivor and convorls llom inlo llo propor sorios of accossos lo llo
dovicos rogislor sol.
-
--

OnNow Design Initiative Scheme Defines OveraII PM

A vlilopapor on Microsofls vobsilo cIoarIy dofinos llo goaIs of llo OnNov
Dosign Inilialivo and llo probIoms il addrossos. Tlo aullor las laIon llo Iiborly
of roproducing llo loxl vorbalim from llo - soclion of llal papor.
ICI Ixpross Bus
Drivor
Tlis drivor is -- -. Il -
-- --, bul doos nol lavo
InovIodgo of a ICI Ixpross funclions dovico-spocific rogislor sol (llal
InovIodgo is possossod by llo Miniporl Drivor llal llo WDM drivor
usos lo communicalo vill llo dovicos rogislor sol). Il rocoivos roquosls
from llo dovicos WDM lo clango llo slalo of llo dovicos povor man-
agomonl Iogic:
Wlon a roquosl is rocoivod lo povor dovn llo dovico, llo ICI Ixpross
Bus Drivor is rosponsibIo for saving llo conloxl of llo funclions ICI
Ixpross configuralion Hoador rogislors and any Nov CapabiIily rogis-
lors llal llo dovico impIomonls. Using llo dovicos ICI Ixpross config-
uralion Command rogislor, il llon disabIos llo abiIily of llo dovico lo
acl as a Roquoslor or lo rospond as llo largol of lransaclions. IinaIIy, il
vrilos lo llo ICI Ixpross funclions IM rogislors lo clango ils slalo.
ConvorsoIy, vlon llo dovico musl bo ro-povorod, llo ICI Ixpross Bus
Drivor vrilos lo llo ICI Ixpross funclions IM rogislors lo clango ils
slalo. Il llon rosloros llo funclions ICI Ixpross configuralion Hoador
rogislors lo lloir originaI slalo.
ICI Ixpross IM
rogislors villin
oacl ICI Ixpross
funclions ICI
Ixpross configura-
lion spaco.
- - -- -
-- -. Tlo ICI Ixpross Bus Drivor undorslands llis spoc
and lloroforo is llo onlily rosponsibIo for accossing a funclions IM rog-
islors vlon roquoslod lo do so by llo funclions dovico drivor (i.o., ils
WDM).
Syslom Board
povor pIano and
bus cIocI conlroI
Iogic
Tlo impIomonlalion and conlroI of llis Iogic is lypicaIIy syslom board
dosign-spocific and is lloroforo (undor
llo OSs diroclion).
-
--
-- -

GoaIs
Tlo OnNov Dosign Inilialivo roprosonls llo ovoraII guiding spiril bolind llo
sougll-aflor IC dosign. Tlo foIIoving aro llo major goaIs as slalod in an
OnNov documonl:
- Tlo IC is roady for uso immodialoIy vlon llo usor prossos llo On bullon.
- Tlo IC is porcoivod lo bo off vlon nol in uso bul is sliII capabIo of rospond-
ing lo vaIo-up ovonls. WaIo-up ovonls migll bo lriggorod by a dovico
rocoiving inpul sucl as a plono ringing, or by soflvaro llal las roquoslod
llo IC lo vaIo up al somo prodolorminod limo.
- Soflvaro adjusls ils bolavior vlon llo IC's povor slalo clangos. Tlo opor-
aling syslom and appIicalions vorI logollor inloIIigonlIy lo oporalo llo IC
lo doIivor offoclivo povor managomonl in accordanco vill llo usor's cur-
ronl noods and oxpoclalions. Ior oxampIo, appIicalions viII nol inadvorl-
onlIy Ioop llo IC busy vlon il is nol nocossary, and insload viII
proaclivoIy parlicipalo in slulling dovn llo IC lo consorvo onorgy and
roduco noiso.
- AII dovicos parlicipalo in llo dovico povor managomonl sclomo, vlollor
originaIIy inslaIIod in llo IC or addod Ialor by llo usor. Any nov dovico can
lavo ils povor slalo clangod as syslom uso diclalos.
System PM States
TabIo 16-2 on pago 572 dofinos llo possibIo slalos of llo ovoraII syslom vill rof-
oronco lo povor consumplion. Tlo WorIing, SIoop, and Sofl Off slalos
aro dofinod in llo OnNov Dosign Inilialivo documonls.
- - - -

-
WorIing Tlo syslom is compIoloIy usabIo and llo OS is porforming povor
managomonl on a dovico-by-dovico basis. As an oxampIo, llo modom
may bo povorod dovn during poriods vlon il isnl boing usod.

Device PM States
Tlo OnNov Dosign Inilialivo aIso dofinos llo IM slalos al llo dovico IovoI.
Tloy aro Iislod and dofinod in TabIo 16-4 on pago 574. TabIo 16-3 on pago 573
prosonls llo samo informalion in a sIigllIy difforonl form.
SIooping Tlo syslom appoars lo bo off and povor consumplion las boon
roducod. Tlo sIoop IovoIs a syslom may impIomonl is syslom
dosign-spocific. Tlo amounl of limo il laIos lo rolurn lo llo WorI-
ing slalo is invorsoIy proporlionaI lo llo soIoclod IovoI of povor con-
sorvalion. Horo aro somo oxampIos:
- Tlo syslom may Ioop povor appIiod lo main momory, lloroby pro-
sorving llo OS and appIicalion programs in momory. Tlo procos-
sors rogislor sol conlonls may aIso bo prosorvod. In llis caso,
program oxoculion can bo rosumod vory quicIIy.
- Tlo syslom may copy llo compIolo conlonls of main momory and
llo procossors rogislor sol conlonls lo disI, and llon romovo
povor from llo procossor and main momory. In llis caso, llo
roslarl limo viII bo Iongor bocauso momory musl rosloro boll
boforo rosuming program oxoculion.
Sofl Off Tlo syslom appoars lo bo off and povor consumplion las boon
groalIy roducod. Il roquiros a fuII robool lo rolurn lo llo WorIing
slalo (bocauso llo conlonls of momory lavo boon Iosl).
No Iovor Tlis slalo isnl Iislod in llo OnNov Dosign Inilialivo documonls. Tlo
syslom las boon disconnoclod from ils povor sourco.
-
-
D0 - . Slalo in vlicl dovico is on and running. Il is
rocoiving fuII povor from llo syslom and is doIivoring fuII funclionaIily lo
llo usor. Tlis is llo iniliaI slalo onlorod aflor a dovico compIolos rosol.
- - - -

-
-- -

Definition of Device Context

During normaI oporalion, llo oporalionaI slalo of a dovico is con-
slanlIy clanging. Soflvaro oxlornaI lo llo dovico (o.g., ils dovico drivor, llo ICI
Ixpross Bus Drivor, olc.) vrilos vaIuos inlo somo of ils rogislors, roads ils slalus,
olc. In addilion, llo dovico may conlain a procossor llal oxoculos dovico-spocific
codo lo conlroI llo dovicos inloraclion vill llo syslom as voII as vill an oxlor-
naI oIomonl sucl as a nolvorI. Tlo slalo of llo dovico al a givon inslanl in limo
is dofinod by (bul nol Iimilod lo) llo foIIoving:
D1 - . CIass-spocific Iov-povor slalo (rofor lo
Dovico CIass-Spocific IM Spocificalions on pago 576) in vlicl dovico
conloxl (soo Dofinilion of Dovico Conloxl on pago 574) may or may nol
bo Iosl.
D2 - . CIass-spocific Iov-povor slalo (Dovico
CIass-Spocific IM Spocificalions on pago 576) in vlicl dovico conloxl
(soo Dofinilion of Dovico Conloxl on pago 574) may or may nol bo Iosl.
Allains groalor povor savings llan D1. A dovico in llo D2 slalo can causo
dovicos lo Ioso somo conloxl.
D3 - . Slalo in vlicl dovico is off. Dovico conloxl is
Iosl. Iovor can bo romovod from llo dovico.
- - -
-

D0 Higlosl NA
D1 < D0 Iaslor llan D2
D2 < D1 Iaslor llan D3
D3 Ior aII inlonls and purposos, ,
aIllougl lloro migll bo somo nogIi-
gibIo consumplion.
SIovosl
-
-

- Tlo conlonls of llo dovicos ICI Ixpross configuralion rogislors.

- Tlo slalo of llo dovicos IO rogislors llal ils dovico drivor inloracls vill.
- If llo dovico conlains a procossor, ils curronl program poinlor as voII as llo
conlonls of somo of llo procossors ollor rogislors.
Tlis is roforrod lo as llo curronl . Somo or aII of llis informalion
migll bo Iosl if llo dovicos IM slalo is clangod lo a moro aggrossivo povor
consorvalion IovoI:
- If llo dovico is pIacod in llo D1 or D2 slalo, il may or may nol Ioso somo of
llis conloxl informalion.
- If llo dovico is pIacod in llo D3 slalo, il viII Ioso ils conloxl informalion.
Assumo llal a dovico is pIacod in a moro aggrossivo povor consorvalion slalo
llal causos il lo Ioso somo or aII of ils conloxl informalion. If llo dovicos conloxl
informalion is nol roslorod vlon llo dovico is pIacod bacI in llo D0 slalo (i.o.,
fuIIy-oporalionaI), il viII no Iongor funclion corroclIy.
Assumo llal llo OS sols up a modom lo vaIo
up llo syslom if llo plono rings (in ollor vords, on a Ring Dolocl) and llal llo
syslom is llon commandod lo povor dovn by llo OS (o.g., in rosponso lo llo
usor doprossing llo povor svilcl). Romombor llal povor dovn is a roIalivo
lorm villin llo conloxl of povor managomonl. Tlo clipsol las povor appIiod
and monilors llo IMI# signaI. To supporl llis foaluro, llo modom musl impIo-
monl:
- A IMI (Iovor Managomonl Ivonl) Mossago capabiIily.
- A IMI onabIo/disabIo conlroI bil.
- A IMI slalus bil llal indicalos vlollor or nol llo dovico las sond a IMI
mossago.
- Ono or moro dovico-spocific conlroI bils llal aro usod lo soIoclivoIy onabIo/
disabIo llo various dovico-spocific ovonls (sucl as Ring Dolocl) llal can
causo llo dovico lo sond a IMI mossago.
- Corrosponding dovico-spocific slalus bils llal indicalo vly llo dovico
issuod a IMI mossago.
Il slouId bo obvious llal llo modom couId nol vaIo llo syslom (by sonding a
IMI mossago) if llo Iogic doscribod in llo buIIol Iisl aIso Iosl povor vlon llo
dovico is commandod lo onlor llo D3 (off) slalo. Il vouIdnl romombor llal il
vas supposod lo do so or vly, vouId nol bo onabIod lo do so, olc. In ollor
vords, for llo Ring Dolocl lo succossfuIIy vaIo llo syslom, llo dovicos IMI
conloxl informalion musl nol bo Iosl vlon llo dovico is pIacod in llo D3 slalo.
-- -

Device CIass-Specific PM Specifications

-- As monlionod oarIior in llis clap-
lor, llo OnNov Dosign Inilialivo providos a basic dofinilion of llo four possibIo
povor slalos (D0 - llrougl - D3). Il aIso dofinos llo minimum IM slalos llal aII
dovico lypos musl impIomonl. Tlo documonl llal providos llis dofinilion is llo
-- -. Tlis documonl mandalos llal aII
dovicos, irrospoclivo of dovico calogory, musl impIomonl llo IM slalos dofinod
in TabIo 16-5 on pago 576.
-- - Abovo and boyond llo
povor slalos mandalod by llo -- , corlain calogo-
rios (i.o., CIassos) of dovicos may roquiro:
- llo impIomonlalion of llo inlormodialo povor slalos (D1 and/or D2)
- llal dovicos villin a cIass oxlibil corlain common claraclorislics vlon in a
parlicuIar povor slalo.
Tlo ruIos associalod vill a parlicuIar dovico cIass aro found in a sol of docu-
monls roforrod lo as -- -. CurronlIy,
Dovico CIass Iovor Managomonl Spocificalions oxisl for llo foIIoving dovico
cIassos:
- Audio
- Communicalions
-- -
-
D0 Dovico is on and running. Il is rocoiving fuII povor from llo syslom and is
doIivoring fuII funclionaIily lo llo usor.
D1 Tlis slalo is nol dofinod and nol usod.
D2 Tlis slalo is nol dofinod and nol usod.
D3 Dovico is off and nol running. Dovico conloxl is assumod Iosl, and lloro is
no nood for any of il lo bo prosorvod in lardvaro. Tlis slalo slouId con-
sumo llo minimum povor possibIo. Ils onIy roquiromonl is lo rocognizo a
bus-spocific command lo ro-onlor D0. Iovor can bo romovod from llo
dovico vliIo in D3. If povor is romovod, llo dovico viII rocoivo a bus-spo-
cific lardvaro rosol upon roappIicalion of povor, and slouId iniliaIizo
ilsoIf as in a normaI povor on.

- DispIay
- Inpul
- NolvorI
- IC Card
- Slorago
Tloy aro avaiIabIo on Microsofls Hardvaro DovoIopors vob silo.
Power Management PoIicy Owner
A dovicos IM poIicy ovnor is dofinod as llo soflvaro moduIo
llal maIos docisions rogarding llo IM slalo of a dovico.
- In a Windovs onvironmonl, llo poIicy
ovnor is llo cIass-spocific drivor (i.o., llo WDM) associalod vill dovicos of llal
cIass.
PCI Express Power Management vs. ACPI
PCI Express Bus Driver Accesses PCI Express Configuration
and PM Registers
As indicalod in TabIo 16-1 on pago 569 and Iiguro 16-1 on pago 578, llo ICI
Ixpross Bus Drivor undorslands llo Iocalion, formal and usago of llo IM rogis-
lors dofinod in llo ICI Iovor Managomonl spoc. Il lloroforo is llo soflvaro
onlily llal is caIIod vlonovor llo OS noods lo clango llo povor slalo of a ICI
Ixpross dovico (or lo dolormino ils curronl povor slalo and capabiIilios), or lo
accoss ils configuralion rogislors. IiIoviso,
- Tlo IIII 1394 Bus Drivor undorslands llo Iocalion, formal and usago of llo
IM rogislors dofinod in llo 1394 Iovor Managomonl spoc.
- Tlo USB Bus Drivor undorslands llo Iocalion, formal and usago of llo IM
rogislors dofinod in llo USB Iovor Managomonl spoc.
Nolo llal a discussion of llo 1394 and USB Bus drivors is oulsido llo scopo of
llis booI.
ACPI Driver ControIs Non-Standard Embedded Devices
Tloro aro dovicos omboddod on llo syslom board vloso rogislor sols do nol
adloro lo any parlicuIar induslry slandard spoc. Al bool limo, llo BIOS roporls
lloso dovicos lo llo OS via a sol of labIos (llo -, aIso roforrod lo as
llo -, ACII slands for Advancod Configuralion and Iovor Inlorfaco).
-- -

Wlon llo OS noods lo communicalo vill any of lloso dovicos, il caIIs llo ACII
Drivor. Tlo ACII Drivor oxoculos a landIor (roforrod lo as a )
associalod vill llo dovico. Tlo landIor is found in llo ACII labIos llal voro
passod lo llo OS by llo BIOS al bool limo. Tlo landIor is vrillon by llo syslom
board dosignor in a spociaI inlorprolivo Ianguago roforrod lo as ACII Sourco
Ianguago, or . Tlo formal of ASI is dofinod in llo ACII spoc. Tlo ASI
sourco is llon compiIod inlo ACII Maclino Ianguago, or . Nolo llal AMI
is nol a procossor-spocific maclino Ianguago. Il is a loIonizod (i.o., comprossod)
vorsion of llo ASI sourco codo. Tlo ACII Drivor incorporalos an AMI loIon
inlorprolor llal onabIos il lo oxoculo a ConlroI Mollod.
A discussion of ACII is oulsido llo scopo of llis booI. Il is onIy monlionod
bocauso llo OS usos a combinalion of ACII and Bus Drivor sorvicos (sucl as llo
ICI Ixpross (ICI-XI) Bus Drivor) lo manago llo sysloms povor and configura-
lion.
- - - -- --

Some ExampIe Scenarios

Iiguro 16-2 on pago 581, Iiguro 16-3 on pago 583, and Iiguro 16-4 on pago 584
iIIuslralo somo oxampIo IM sconarios. - - --
-- - -
Tlo oxampIos focus on lurning a ICI Ixpross funclion Off (from a povor por-
spoclivo), or lurning il On. Tlis impIios lvo possibIo slalos for a dovico (D0 and
D3). WliIo ils possibIo a funclion onIy las lvo slalos, a funclion may addilion-
aIIy impIomonl ollor oplionaI, inlormodialo povor slalos (D1 and/or D2). Tlo
possibIo povor slalos aro discussod Ialor in llis claplor.
Tlo foIIoving aro somo of llo lorms usod in llo iIIuslralions:
- - . Tlo OS communicalos a roquosl lo a Windovs
dovico drivor by issuing an IRI lo il. Tloro aro difforonl calogorios of IRIs,
for oxampIo, a Iovor IRI is usod lo roquosl a clango in llo IM slalo of a
dovico lo or gol ils curronl IM slalo.
- - . A dovico drivor vrillon for llo Win-
dovs onvironmonl llal conlroIs a dovico or a group of simiIar dovicos (o.g.,
nolvorI adaplors).
- - . ACII-roIalod ovonls. Tlo clipsol impIo-
monls a GII rogislor vlicl is usod lo soIoclivoIy onabIo or disabIo rocogni-
lion of various GIIs. Wlon rocognilion of a spocific GII is onabIod (sucl
as a IM ovonl) and llal ovonl occurs, llo clipsol gonoralos an SCI (Syslom
ConlroI Inlorrupl) lo llo procossor. Tlis invoIos llo GII landIor villin llo
ACII Drivor vlicl llon roads llo GII Slalus rogislors in llo clipsol lo
dolormino vlicl GII causod llo inlorrupl.
- - . A syslom inlorrupl usod by lardvaro lo
nolify llo OS of ACII ovonls. Tlo SCI is an aclivo Iov, slaroabIo, IovoI-son-
silivo inlorrupl.
- . A ConlroI Mollod is a dofinilion of lov llo OS can por-
form a simpIo lardvaro lasI. Ior oxampIo, llo OS invoIos a ConlroI
Mollod lo road llo lomporaluro of a llormaI zono. Soo llo dofinilion of
ASI. An ACII-compalibIo syslom musl provido a minimaI sol of common
ConlroI Mollods in llo ACII labIos. Tlo OS providos a sol of voII-dofinod
ConlroI Mollods llal ACII labIo dovoIopors can roforonco in lloir ConlroI
Mollods. OIMs can supporl difforonl rovisions of clipsols vill ono BIOS
by oillor incIuding ConlroI Mollods in llo BIOS llal losl configuralions
and rospond as noodod or by incIuding a difforonl sol of ConlroI Mollods
for oacl clipsol rovision.
-- -

- . ConlroI Mollods aro vrillon in a Ianguago

caIIod ASI vlicl is llon compiIod inlo .
AMI is comprisod of a liglIy-comprossod sorios of - llal roprosonl
llo ASI codo. Tlo AMI codo is inlorprolod and oxoculod by an AMI inlor-
prolor incorporalod villin llo ACII Drivor.
-- -- - Iig-
uro 16-2 on pago 581 iIIuslralos llo basic sorios of aclions roquirod vlon llo OS
vislos lo povor dovn aII ICI Ixpross dovicos and associalod IinIs in llo fabric
(i.o., romovo llo roforonco cIocI and Vcc) lo consorvo maximum povor. Boforo
doing llis, il musl firsl onsuro llal aII funclions villin aII ICI Ixpross dovicos
lavo boon povorod dovn.
1. If aII of llo ICI funclions villin aII ICI Ixpross dovicos aro aIroady pov-
orod dovn, sIip lo slop 11.
2. Tlo OS issuos a Iovor IRI lo llo dovico drivor (WDM) lo lransilion aII
dovico funclions lo llo Iovosl povor slalo.
3. Tlo WDM savos llo curronl conlonl of llo funclions dovico-spocific rogis-
lors.
4. Tlo WDM disabIos llo dovicos abiIily lo gonoralo inlorrupl roquosls by
cIoaring ils inlorrupl onabIo bil in ils funclion-spocific rogislor sol.
5. Tlo WDM passos llo Iovor IRI lo llo ICI Ixpross Bus Drivor.
6. Tlo Bus Drivor savos llo curronl conlonl of llo funclions configuralion
Hoador rogislors and any Nov CapabiIily rogislor sols llal il may impIo-
monl, aIong vill oxlondod configuralion rogislors.
7. Tlo ICI Ixpross Bus Drivor disabIos llo funclions abiIily lo acl as a
Roquoslor and CompIolor by cIoaring llo approprialo bils in ils configura-
lion Command rogislor.
8. Tlo ICI Ixpross Bus Drivor vrilos lo llo funclions ICI IM rogislors lo sol
llo Iovosl povor slalo (off).
9. Tlo ICI Ixpross Bus Drivor passos an IRI compIolion nolico lo llo WDM.
10. Tlo WDM passos llo IRI compIolion nolico lo llo OS. Slops 2-llrougl-10
aro ropoalod unliI aII ICI funclions villin aII dovicos lavo boon pIacod in
llo povorod dovn slalo.
11. Tlo OS issuos a Iovor IRI lo llo ACII drivor roquosling llal il lurn off llo
roforonco cIocI and Vcc.
12. Tlo ACII drivor runs llo approprialo AMI ConlroI Mollod lo lurn off llo
cIocI and povor.
13. Tlo ACII drivor passos llo IRI compIolion nolico lo llo OS.

- -- -
- --
-- -

- - Iiguro 16-3
on pago 583 iIIuslralos llo basic sorios of aclions roquirod vlon llo OS vislos
lo povor up a ICI Ixpross funclion llal vas pIacod in llo povorod dovn slalo
oarIior.
1. Ils possibIo llal llo OS lad romovod povor lo aII ICI Ixpross dovicos and
lurnod off llo ICI Ixpross roforonco cIocI as in llo provious oxampIo. To
rosloro funclion bacI lo lloir oporaling condilion, llo OS issuos a Iovor
(i.o., Iovor Managomonl) IRI lo llo ACII Drivor roquosling llal llo IinIs
bo lurnod bacI on. In rosponso, llo ACII Drivor vouId oxoculo llo AMI
codo nocossary lo lurn on llo ICI Ixpross roforonco cIocI gonoralor and
ro-appIy povor lo llo dovicos. Il slouId bo obvious llal ICI-XI dovicos
cIososl lo llo Hosl Bridgo/Rool CompIox musl bo povorod up firsl. Wlon
llo ACII Drivor las compIolod llis oporalion, il issuos an IRI compIolion
nolico bacI lo llo OS. If llo roforonco cIocI and povor lad nol boon lurnod
off oarIior, llis slop can bo sIippod.
2. Tlo OS issuos a Iovor IRI lo llo ICI Ixpross dovicos WDM roquosling
llal llo dovico bo roslorod lo llo fuII povor slalo. Tlo WDM passos llo IRI
lo llo ICI Ixpross Bus Drivor.
3. Tlo ICI Ixpross Bus Drivor vrilos lo llo dovicos ICI Ixpross IM rogislors
lo povor up dovico.
4. Tlo ICI Ixpross Bus Drivor rosloros llo conlonls of llo dovicos ICI
Ixpross configuralion Hoador rogislors and any Nov CapabiIily rogislor
sols llal llo dovico impIomonls. Tlis aulomalicaIIy rosloros llo dovicos
ICI Ixpross configuralion Command rogislor onabIo bils lo lloir originaI
slalos.
5. Tlo ICI Ixpross Bus Drivor passos an IRI compIolion nolico bacI lo llo
WDM.
6. Tlo WDM rosloros llo conlonl of llo dovicos dovico-spocific IO or mom-
ory-mappod IO rogislors. Tlis causos llo dovicos inlorrupl onabIo bil lo bo
roslorod, ro-onabIing llo dovicos abiIily lo gonoralo inlorrupl roquosls. Tlo
dovico is nov roady lo rosumo normaI oporalion.
7. Tlo WDM rolurns an IRI compIolion nolico lo llo OS.

- Iig-
uro 16-4 on pago 584 iIIuslralos llo OS proparing a ICI Ixpross dovico so llal il
viII vaIo up llo syslom (sond a IMI mossago) vlon a parlicuIar dovico-spo-
cific ovonl occurs.
1. Tlo OS issuos a Iovor IRI lo llo dovico drivor (WDM) lo onabIo llo dovico
lo vaIo up llo syslom on a spocifiod ovonl.
2. Tlo WDM vrilos lo dovico-spocific rogislors villin llo dovico lo onabIo llo
ovonl llal viII causo llo syslom lo vaIo up.
3. Tlo WDM passos llo IRI lo llo ICI Ixpross Bus drivor.
- --
-- -

4. Tlo ICI Ixpross Bus Drivor vrilos lo llo funclions IM rogislors lo onabIo
ils IMI# Iogic.
5. Tlo ICI Ixpross Bus Drivor rolurns llo IRI compIolion nolico lo llo WDM.
6. Tlo WDM rolurns llo IRI compIolion nolico lo llo OS.
7. Tlo OS issuos a Iovor IRI lo llo ACII drivor roquosling llal llo ICI
Ixpross Iovor Managomonl Ivonl (IMI) moniloring Iogic bo onabIod lo
gonoralo an ACII inlorrupl (roforrod lo as an SCI, or Syslom ConlroI Inlor-
rupl).
8. Tlo ACII drivor onabIos llo clipsols GII Iogic lo gonoralo an SCI vlon
IMI# is doloclod assorlod.
9. Tlo ACII drivor rolurns llo IRI compIolion nolico lo llo OS.
- - -

Function Power Management

ICI Ixpross dovicos aro roquirod lo supporl povor managomonl. ConsoquonlIy,
sovoraI rogislors and roIalod bil fioIds musl bo impIomonlod as discussod boIov.
The PM CapabiIity Register Set
Tlo ICI-IM spocificalion dofinos llo IM CapabiIily rogislor sol llal is Iocalod
in ICI-compalibIo configuralion spaco abovo llo configuralion loador. Tlo rog-
islor is ono in polonliaIIy many CapabiIily rogislors llal aro IinIod logollor via
poinlors. Tlo CapabiIily ID of llo IM rogislor sol is 01l. To dolormino llo Ioca-
lion of llo IM rogislors soflvaro can porform llo foIIoving clocIs. Tlo rogis-
lors doscribod boIov musl bo impIomonlod by ICI Ixpross dovicos:
1. Soflvaro - bil 4 (- - ) of llo funclions
- -. A ono indicalos llal llo CapabiIilios Ioinlor rogislor is
impIomonlod in llo firsl bylo of dvord 13d of llo funclions configuralion
Hoador spaco.
2. Tlo programmor llon - llo dvord-aIignod poinlor from llo
- - and usos il lo road llo indicalod dvord from llo func-
lions configuralion spaco. Tlis is llo firsl dvord of llo firsl Nov
CapabiIily rogislor sol.
3. Rofor lo Iiguro 16-5 on pago 586. If llo firsl (i.o., Ioasl-significanl) bylo of llo
dvord road conlains , llis idonlifios il as llo IM rogislor
sol usod lo conlroI llo funclions povor slalo. If llo ID is somolling ollor
llan 01l, llon llis is llo rogislor sol for a Nov CapabiIily ollor llan IM
(o.g., ICI Ixpross CapabiIily rogislors). Tlo bylo immodialoIy foIIoving llo
CapabiIily ID bylo is llo fioId llal spocifios llo
slarl Iocalion (villin llo funclions configuralion spaco) of llo rogislor sol
for llo noxl Nov CapabiIily (if lloro aro any addilionaI Nov CapabiIilios).
00l indicalos lloro isnl any, vliIo a non-zoro vaIuo is a vaIid poinlor. As
- -- - of llo funclions Nov CapabiIilios, ils
IM rogislor sol viII bo Iocalod. A dolaiIod doscriplion of llo IM rogislors
can bo found in DolaiIod Doscriplion of ICI-IM Rogislors on pago 596.
-- -

Device PM States
-- - - -
- -- -
-- -- - -- --
- --
D0 StateFuII On
- - - -
- -- - - - -
--- - -
- - - - --
-- - -
- -
- - - --
- -
- -
-
- - -
-

- -

- -- -
- - - --
- - -
- - - --
-- -- --
- - - --
--
- --
-

Onco llo funclion las boon configurod and onabIod by sofl-

varo, il is in llo D0 Aclivo IM slalo and is fuIIy funclionaI.
Aclivo Slalo Iovor Managomonl
If IMI supporlod in llis slalo.
Tlis combinalion of Bus/Iunclion IM slalos nol aIIovod.
D1 StateLight SIeep
. Tlis is a Iigll sIoop povor consorvalion slalo. Tlo funclion cannol:
- inilialo TIIs (oxcopl IMI Mossago TII, if onabIod)
- acl as llo largol of lransaclions ollor llan ICI Ixpross configuralion lrans-
aclions. Tlo funclions IM rogislors aro impIomonlod in ils configuralion
spaco and soflvaro musl bo abIo lo accoss lloso rogislors vliIo llo dovico is
in llo D1 slalo.
Ollor claraclorislics of llo D1 slalo aro:
- IinI aulomalicaIIy onlors llo I1 povor consorvalion slalo vlon IM sofl-
varo pIacos llo funclion inlo llo D1 slalo.
- Tlo funclion may roaclivalo llo IinI and sond a IMI mossago lo nolify IM
soflvaro llal llo funclion las oxporioncod an ovonl llal roquiros il bo
rolurnod lo fuII povor (assuming llal il supporls llo gonoralion of IM
ovonls vliIo in llo D1 slalo and las boon onabIod lo do so).
- Tlo funclion may or may nol Ioso ils conloxl in llis slalo. If il doos and llo
dovico supporls IMI, il musl mainlain ils IMI conloxl (soo IM Ivonl
(IMI) Conloxl on pago 575) vliIo in llis slalo.
- Tlo funclion musl bo rolurnod lo llo D0 Aclivo IM slalo in ordor lo bo
fuIIy-funclionaI.
-

--

-

I0 D0 unini-
liaIizod
IMI con-
loxl
< 10W ICI Ixpross
config lransac-
lions.
Nono
I0
I0s (roquirod)
I1 (oplionaI)
D0 aclivo aII fuII Any ICI
Ixpross lrans-
aclion.
Any lransac-
lion, inlorrupl,
or IMI.
I2/I3 D0 aclivo N/A
-- -

TabIo 16-7 Iisls llo IM poIicios vliIo in llo D1 slalo.

Tlis combinalion of Bus/Iunclion IM slalos nol aIIovod.
If IMI supporlod in llis slalo.
-

--

-

I1
D1
I2-I3 NA

- - - -
- --

-
- --
- -- -- -
- - -- -
- - - -- - -- -
-
-- -
-- - - - -
- -
- -- - -
- -
-- -- - -
- -
- - - -
-- -- --- - -
- -
-
- -

-- - -
-- -

If IMI supporlod in llis slalo.

Tlis combinalion of Bus/Iunclion IM slalos nol aIIovod.
D3FuII Off
. AII funclions musl supporl llo D3 IM slalo. Tlis is llo IM slalo in
vlicl povor consorvalion is maximizod. Tloro aro lvo vays llal a funclion
can bo pIacod inlo llo D3 IM slalo:
- RomovaI of povor (Vcc) from llo dovico. Tlis is roforrod lo as llo

IM slalo. Tlo funclion couId lransilion inlo llo D3

coId
slalo for ono of lvo
roasons: if llo IinI il rosidos on is pIacod in llo I2 or I3 slalo, or llo syslom
is unpIuggod.
- Iovor is sliII appIiod lo llo funclion and soflvaro commands llo funclion
lo onlor llo D3 slalo. Tlis is roforrod lo as llo

IM slalo.
Tlo foIIoving lvo soclions doscribo llo D3
lol
and D3
coId
IM slalos.
-

--

-

I1
D2
I2/I3 N/A

- - -
-

-
- -

- --
--
- -- -- -
- -- - --
- - - - --
- -- -

-
--

-
-- - - - -
-

-
- -- - -
- -- --
-

- - -
- -- - - - -
-- ---

-
- - -
- -
- -

- --
- -- --

-
- -
- -

-
- - - -
-- -- -

-
-- -

- - --
- - -
- - -

-- -

- -
- - - - -- -
- --

- - -
- - - -
- - -
-

-
-

- -
- -- --
-
-- -

-
-

--

-

--

--

-

-

-
- -

If IMI supporlod in llis slalo.

Tlo mollod usod lo signaI a vaIo lo rosloro cIocI and povor doponds on form faclor.
Function PM State Transitions
Iiguro 16-6 on pago 594 iIIuslralos llo pormissibIo IM slalo lransilions for a ICI
Ixpross funclion. TabIo 16-11 on pago 594 providos a doscriplion of oacl lransi-
lion.
TabIo 16-12 on pago 596 iIIuslralos llo doIays invoIvod in lransilioning from ono
slalo lo anollor from boll a lardvaro and a soflvaro porspoclivo.

-
-

--

-

I0
D3
coId
I1
I2
AUX
Iovor
Bus rosol onIy
SignaI Boacon
or
WAKI#
I3 Nono Nono
-- -

-- --
- --
-
D0
UniniliaIizod
D0 Aclivo Occurs undor program conlroI vlon funclion las
boon compIoloIy configurod and onabIod by ils
drivor.
D0 Aclivo
D1 Occurs vlon soflvaro vrilos lo llo IovorSlalo
fioId in llo funclions IMCSR rogislor and sols llo
slalo lo D1.
D2 Occurs vlon soflvaro vrilos lo llo IovorSlalo
fioId in llo funclions IMCSR rogislor and sols llo
slalo lo D2.
D3
lol
Occurs vlon soflvaro vrilos lo llo IovorSlalo
fioId in llo funclions IMCSR rogislor and sols llo
slalo lo D3
lol
.

D1
D0 Aclivo Occurs vlon soflvaro vrilos lo llo IovorSlalo
fioId in llo funclions IMCSR rogislor and sols llo
slalo lo D0.
D2 Occurs vlon soflvaro vrilos lo llo IovorSlalo
fioId in llo funclions IMCSR rogislor and sols llo
slalo lo D2.
D3
lol
Occurs vlon soflvaro vrilos lo llo IovorSlalo
fioId in llo funclions IMCSR rogislor and sols llo
slalo lo D3
lol
.
D2
D0 Aclivo Occurs vlon soflvaro vrilos lo llo IovorSlalo
fioId in llo funclions IMCSR rogislor and sols llo
slalo lo D0.
D3
lol
Occurs vlon soflvaro vrilos lo llo IovorSlalo
fioId in llo funclions IMCSR rogislor and sols llo
slalo lo D3
lol
.
D3
lol
D3
coId
Occurs vlon llo Iovor ConlroI Iogic romovos
Iovor from llo funclion.
D0
UniniliaIizod
Occurs vlon soflvaro vrilos lo llo IovorSlalo
fioId in llo funclions IMCSR rogislor and sols llo
slalo lo D0.
D3
coId
D0
UniniliaIizod
WaIo ovonl causos povor (Vcc) lo bo roslorod, Iun-
damonlaI Rosol aIso bocomos aclivo. Tlis causos llo
funclion lo rolurn lo llo D0 UniniliaIizod slalo.
If vaIo nol supporlod, IundamonlaI Rosol causos
llo lransilion lo llo D0 UniniliaIizod slalo.
- --
-
-- -

DetaiIed Description of PCI-PM Registers

Tlo - - dofinos llo IM rogislors (soo Iiguro 16-7 on pago
596) llal aro impIomonlod in boll ICI and ICI Ixpross funclions. Tloso rogis-
lors provido soflvaro vill informalion rogarding llo funclions IM capabiIilios
and pormil soflvaro lo conlroI llo IM proporlios of llo funclion. Sinco llo IM
rogislors aro impIomonlod in llo ICI Ixpross funclions configuralion spaco,
soflvaro usos ICI configuralion accossos lo road and vrilo llo IM rogislors.
Tlo soclions llal foIIov provido a dolaiIod doscriplion of lloso rogislors.
- -

- -
D0 D1 0
D0 or D1 D2 200ks from nov slalo solling lo firsl accoss lo
funclion (incIuding config accossos).
D0, D1, or D2 D3
lol
10ms from nov slalo solling lo firsl accoss lo
funclion (incIuding config accossos).
D1 D0 0
D2 D0 200ks from nov slalo solling lo firsl accoss lo
funclion (incIuding config accossos).
D3
lol
D0 10ms from nov slalo solling lo firsl accoss lo
funclion (incIuding config accossos).
D3
coId
D0
- --

PM CapabiIities (PMC) Register

- . Tlis 16-bil road-onIy rogislor is
inlorrogalod by soflvaro lo dolormino llo IM capabiIilios of llo funclion. Iig-
uro 16-8 on pago 597 iIIuslralos llo rogislor and TabIo 16-13 on pago 597
doscribos oacl bil fioId.
- -
- ---
- -
15:11 fioId. Indicalos llo IM slalos villin vlicl llo funclion is
capabIo of sonding a IMI mossago (Iovor Managomonl Ivonl). 0 in a bil
indicalos IMI nolificalion is nol supporlod in llo rospoclivo IM slalo.
--
11 D0
12 D1
13 D2
14 D3
lol
15 D3
coId
(funclion roquiros aux povor for IMI Iogic
and WaIo signaIing via boacon or WAKI# pin)
Sysloms llal supporl vaIo from D3
coId
musl aIso supporl aux povor.
SimiIarIy, compononls llal supporl vaIo musl uso aux povor lo signaI
llo vaIoup.
Bils 31, 30, and 27 musl bo sol lo 1b for virluaI ICI-ICI Bridgos impIo-
monlod villin Rool and Svilcl Iorls. Tlis is roquirod for porls llal for-
vard IMI Mossagos.
10 bil. 1 = Iunclion supporls llo D2 IM slalo.
-- -

9 bil. 1 = Iunclion supporls llo D1 IM slalo.

8:6 fioId. Ior a funclion llal supporls gonoralion of llo IMI
mossago from llo D3
coId
slalo, llis fioId roporls llo curronl domand mado
upon llo 3.3Vaux povor sourco (soo AuxiIiary Iovor on pago 645) by
llo funclions Iogic llal rolains llo IMI conloxl informalion. Tlis infor-
malion is usod by soflvaro lo dolormino lov many funclions can simuIla-
noousIy bo onabIod for IMI gonoralion (basod on llo lolaI amounl of
curronl oacl dravs from llo syslom 3.3Vaux povor sourco and llo povor
sourcing capabiIily of llo povor sourco).
- If llo funclion doos nol supporl IMI nolificalion from villin llo
D3
coId
IM slalo, llis fioId is nol impIomonlod and aIvays rolurns zoro
vlon road. AIlornalivoIy, a nov foaluro dofinod by ICI Ixpross por-
mils dovicos llal do nol supporl IMIs lo roporl llo amounl of Aux
curronl lloy drav vlon onabIod by llo bil
villin llo Dovico ConlroI rogislor.
- If llo funclion impIomonls llo Dala rogislor (soo Dala Rogislor on
pago 603), llis fioId is nol impIomonlod and aIvays rolurns zoro vlon
road. Tlo Dala rogislor llon laIos procodonco ovor llis fioId in roporl-
ing llo 3.3Vaux curronl roquiromonls for llo funclion.
- If llo funclion supporls IMI nolificalion from llo D3
coId
slalo and
doos nol impIomonl llo Dala rogislor, llon llo Aux_Curronl fioId
roporls llo 3.3Vaux curronl roquiromonls for llo funclion. Il is
oncodod as foIIovs:


1 1 1 375mA
1 1 0 320mA
1 0 1 270mA
1 0 0 220mA
0 1 1 160mA
0 1 0 100mA
0 0 1 55mA
0 0 0 0mA
- ---
- -

PM ControI/Status (PMCSR) Register

Mandalory for aII ICI Ixpross Dovicos. Tlis rogislor is usod for llo foIIoving
purposos:
- If llo funclion impIomonls IMI capabiIily, llis rogislor conlains a IMI Sla-
lus bil llal rofIocls vlollor or nol a proviousIy-onabIod IMI las occurrod
or nol.
- If llo funclion impIomonls IMI capabiIily, llis rogislor conlains a IMI
InabIo bil llal pormils soflvaro lo onabIo or disabIo llo funclions abiIily lo
assorl llo IMI mossago or WAKI# signaI.
- If llo oplionaI Dala rogislor is impIomonlod (soo Dala Rogislor on
pago 603), llis rogislor conlains lvo fioIds llal:
- pormil soflvaro lo soIocl llo informalion llal can bo road llrougl llo
Dala rogislor,
- and provido llo scaIing faclor llal llo Dala rogislor vaIuo musl bo muI-
lipIiod by.
- Tlo rogislors IovorSlalo fioId can bo usod by soflvaro lo dolormino llo
curronl IM slalo of llo funclion and lo pIaco llo funclion inlo a nov IM
slalo.
5 bil. A ono in llis bil indicalos llal
immodialoIy aflor onlry inlo llo D0 UniniliaIizod slalo, llo funclion
roquiros addilionaI configuralion abovo and boyond solup of ils ICI con-
figuralion Hoador rogislors boforo llo CIass drivor can uso llo funclion.
Microsofl OSs do nol uso llis bil. Rallor, llo dolorminalion and iniliaIiza-
lion is mado by llo CIass drivor.
4 Rosorvod.
3 bil. Doos nol appIy lo ICI Ixpross. Musl bo lardvirod lo 0.
2:0 - fioId. Tlis fioId indicalos llo vorsion of llo ICI Bus IM Inlorfaco
spoc llal llo funclion compIios vill.

- -
0 0 1 1.0
0 1 0 1.1 (roquirod by ICI Ixpross)
- ---
- -
-- -

Iiguro 16-9 on pago 600 and TabIo 16-14 on pago 600 provido a doscriplion of
llo IMCSR bil fioIds. Nolo llal IMI is llo abbrovialion for Iovor Managomonl
Ivonl.
- -
- - ---
-


-

-
31:24
aII
zoros
Road-
onIy
Soo Dala Rogislor on pago 603.
23
zoro Road-
onIy
Nol usod in ICI Ixpross
22
zoro Road-
onIy
Nol usod in ICI Ixpross
21:16
aII
zoros
Road-
onIy
Rosorvod

15
- bil. . OnIy impIomonlod if llo
funclion supporls IMI nolificalion, ollorviso llis bil is
aIvays zoro.
If llo funclion supporls IMI, llis bil rofIocls vlollor llo
funclion las oxporioncod a IMI (ovon if llo IMI_In bil
in llis rogislor las disabIod llo funclions abiIily lo sond
a IMI mossago). If sol lo ono, llo funclion las oxpori-
oncod a IMI. Soflvaro cIoars llis bil by vriling a ono lo
il.
Aflor rosol, llis bil is zoro if llo funclion doosnl supporl
IMI from D3
coId
. If llo funclion supporls IMI from
D3
coId
:
- llis bil is indolorminalo al iniliaI OS bool limo.
- ollorviso, il rofIocls vlollor llo funclion las oxpori-
oncod a IMI.
If llo funclion supporls IMI from D3
coId
, llo slalo of
llis bil musl porsisl (is slicIy) vliIo llo funclion romains
in llo D3
coId
slalo and during llo lransilion from D3
coId
lo llo D0 UniniliaIizod slalo. Tlis impIios llal llo IMI
Iogic musl uso an aux povor sourco lo povor llis Iogic
during lloso condilions (soo AuxiIiary Iovor on
pago 645).
14:13
Dovico-
spocific
Road-
onIy
fioId. . If llo funclion doos nol
impIomonl llo Dala rogislor (soo Dala Rogislor on
pago 603), llis fioId is lardvirod lo rolurn zoros.
If llo Dala rogislor is impIomonlod, llo Dala_ScaIo fioId
is mandalory and musl bo impIomonlod as a road-onIy
fioId. Tlo vaIuo road from llis fioId roprosonls llo scaIing
faclor llal llo vaIuo road from llo Dala rogislor musl bo
muIlipIiod by. Tlo vaIuo and inlorprolalion of llo
Dala_ScaIo fioId doponds on llo dala ilom soIoclod lo bo
viovod llrougl llo Dala rogislor by llo Dala_SoIocl fioId
(soo doscriplion in llo noxl rov of llis labIo).
- - ---
-


-

-
-- -

12:9 0000b
fioId. . If llo funclion doos nol
impIomonl llo Dala rogislor (soo Dala Rogislor on
pago 603), llis fioId is lardvirod lo rolurn zoros.
If llo Dala rogislor is impIomonlod, llo Dala_SoIocl fioId
is mandalory and is impIomonlod as a road/vrilo fioId.
Tlo vaIuo pIacod in llis rogislor soIocls llo dala vaIuo lo
bo viovod llrougl llo Dala rogislor. Tlal vaIuo musl
llon bo muIlipIiod by llo vaIuo road from llo Dala_ScaIo
fioId (soo provious rov in llis labIo).
8
bil. .
1 = onabIo funclions abiIily lo sond IMI mossagos
vlon an ovonl occurs.
0 = disabIo.
If llo funclion doos nol supporl llo gonoralion of IMIs
from any povor slalo, llis bil is lardvirod lo aIvays
rolurn zoro vlon road.
Aflor rosol, llis bil is zoro if llo funclion doosnl supporl
IMI from D3
coId
. If llo funclion supporls IMI from
D3
coId
:
- llis bil is indolorminalo al iniliaI OS bool limo.
- ollorviso, il onabIos or disabIos vlollor llo funclion
can sond a IMI mossago in caso a IMI occurs.
If llo funclion supporls IMI from D3
coId
, llo slalo of
llis bil musl porsisl vliIo llo funclion romains in llo
D3
coId
slalo and during llo lransilion from D3
coId
lo llo
D0 UniniliaIizod slalo. Tlis impIios llal llo IMI Iogic
musl uso an aux povor sourco lo povor llis Iogic during
lloso condilions.
7:2
aII
zoros
Road-
onIy
Rosorvod
- - ---
-


-

Data Register
. Rofor lo Iiguro 16-10 on pago 605. Tlo Dala rogislor is an
oplionaI, 8-bil, road-onIy rogislor. If impIomonlod, llo Dala rogislor providos llo
programmor vill llo foIIoving informalion:
- Iovor consumod in llo soIoclod IM slalo. Tlis informalion is usofuI in
povor budgoling.
- Iovor dissipalod in llo soIoclod IM slalo.Tlis informalion is usofuI in man-
aging llo llormaI onvironmonl.
- Ollor, dovico-spocific informalion rogarding llo funclions oporalionaI
claraclorislics. CurronlIy, llo spoc onIy dofinos povor consumplion and
povor dissipalion informalion lo bo roporlod llrougl llis rogislor.
If llo Dala rogislor is impIomonlod,
- llo Dala_SoIocl and Dala_ScaIo fioIds of llo IMCSR rogislors musl aIso bo
impIomonlod
- llo Aux_Curronl fioId of llo IMC rogislor musl nol bo impIomonlod.
1:0 00b R/W
fioId. . Soflvaro usos llis fioId lo
dolormino llo curronl IM slalo of llo funclion (by road-
ing llis fioId) or lo pIaco il inlo a nov IM slalo (by vril-
ing lo llis fioId). If soflvaro soIocls a IM slalo llal isnl
supporlod by llo funclion, llo vrilos musl compIolo nor-
maIIy, bul llo vrilo dala is discardod and no slalo clango
occurs.

0 0 D0
0 1 D1
1 0 D2
1 1 D3
lol
- - ---
-


-

-
-- -

- - Iorform llo foIIoving

procoduro lo dolormino llo prosonco of llo Dala rogislor:
1. Wrilo a vaIuo of 0000b inlo llo Dala_SoIocl fioId of llo IMCSR rogislor.
2. Road from oillor llo Dala rogislor or llo Dala_ScaIo fioId of llo IMCSR rog-
islor. A non-zoro vaIuo indicalos llal llo Dala rogislor as voII as llo
Dala_ScaIo and Dala_SoIocl fioIds of llo IMCSR rogislors aro impIomonlod.
If a vaIuo of zoro is road, go lo slop 3.
3. If llo curronl vaIuo of llo Dala_SoIocl fioId is a vaIuo ollor llan 1111b, go lo
slop 4. If llo curronl vaIuo of llo Dala_SoIocl fioId is 1111b, aII possibIo Dala
rogislor vaIuos lavo boon scannod and rolurnod zoro, indicaling llal noillor
llo Dala rogislor nor llo Dala_ScaIo and Dala_SoIocl fioIds of llo IMCSR
rogislors aro impIomonlod.
4. Incromonl llo conlonl of llo Dala_SoIocl fioId and go lo slop 2.
- Tlo informalion rolurnod is lypicaIIy a
slalic copy of llo funclions vorsl-caso povor consumplion and povor dissipa-
lion claraclorislics (oblainod from llo dovicos dala slool) in llo various IM
slalos. To uso llo Dala rogislor, llo programmor usos llo foIIoving soquonco:
1. Wrilo a vaIuo inlo llo Dala_SoIocl fioId (soo TabIo 16-15 on pago 605) of llo
IMCSR rogislor lo soIocl llo dala ilom lo bo viovod llrougl llo Dala rogis-
lor.
2. Road llo dala vaIuo from Dala rogislor.
3. MuIlipIy llo vaIuo by llo scaIing faclor road from llo Dala_ScaIo fioId of
llo IMCSR rogislor (soo IM ConlroI/Slalus (IMCSR) Rogislor on
pago 599).
- In a muIli-funclion ICI Ixpross dovico, oacl
funclion musl suppIy ils ovn povor-orionlod informalion and llo povor infor-
malion roIalod lo lloir common Iogic musl bo roporlod llrougl funclion zoros
Dala rogislor (soo Dala SoIocl VaIuo = 8 in TabIo 16-15 on pago 605).
Tlo spocificalion doos nol
ovorlIy slalo a roquiromonl for ICI-lo-ICI bridgo funclions llal aro parl of a
porl villin llo Rool CompIox or Svilcl rogarding dala fioId uso. Hovovor, lo
mainlain ICI-IM compalibiIily bridgos musl roporl llo povor informalion lloy
consumo. In llis samo faslion soflvaro couId road llo virluaI IIB Dala rogis-
lors al oacl porl of a svilcl lo dolormino llo povor consumod by llo svilcl in
oacl povor slalo. Basod on ICI-IM oacl ICI Ixpross funclion vouId bo
rosponsibIo for roporling ils ovn povor-roIalod dala.

--
-


-


-

00l
Iovor consumod in D0
slalo
00b = unInovn
01b = muIlipIy by 0.1
10b = muIlipIy by 0.01
11b = muIlipIy by 0.001
Walls
01l
Iovor consumod in D1
slalo
02l
Iovor consumod in D2
slalo
03l
Iovor consumod in D3
slalo
04l
Iovor dissipalod in D0
slalo
05l
Iovor dissipalod in D1
slalo
06l
Iovor dissipalod in D2
slalo
07l
Iovor dissipalod in D3
slalo
08l
In a muIli-funclion ICI
dovico, funclion 0 indi-
calos llo povor consumod
by llo Iogic llal is com-
mon lo aII of llo funclions
rosiding villin llis pacI-
ago.
-- -

Introduction to Link Power Management

ICI-IM compalibIo soflvaro pIacos dovicos inlo ono of four slalos as doscribod
in provious soclions. ICI Ixpross dofinos IinI povor managomonl llal roIalos lo
oacl of llo four dovico slalos. TabIo 16-16 on pago 607 Iisls llo Dovico slalos
(D-Slalos) and llo associalod IinI slalos (I-slalos) pormillod by llo spocifica-
lion. Iacl roIalionslip is doscribod boIov:
Wlon a dovico is in llo D0 slalo is il fuIIy povorod and fuIIy funclionaI
and llo IinI is lypicaIIy aclivo (o.g. in llo I0 slalo). ICI Ixpross dovicos aro
roquirod lo supporl Aclivo Slalo Iovor Managomonl (ASIM) llal pormils IinI
povor consorvalion ovon vlon llo dovico is in llo D0 slalo. Tvo Iov-povor
slalos aro dofinod:
- I0 slandby, or I0s (roquirod)
- I1 ASIM (oplionaI)
Boll of lloso slalos aro managod aulonomousIy by lardvaro and compIoloIy
invisibIo lo soflvaro. A crilicaI oIomonl associalod vill ASIM is rolurning lo
llo I0 slalo vill vory slorl Ialoncios. AddilionaI configuralion rogislors pormil
soflvaro lo caIcuIalo llo vorsl caso Ialoncios lo dolormino if ASIM viII vioIalo
Ialoncy roquiromonls of llo lransaclions.
Wlon soflvaro pIacos a dovico inlo oillor llo D1 or D2 slalo llo
IinI is roquirod lo lransilion lo llo I1 slalo. Tlo dovnslroam compononl signaIs
llo porl in llo upslroam dovico (rool or svilcl) lo vlicl il allaclos, lo onlor llo
09l-0Il. Spoc aclu-
aIIy slovs llis as
docimaI vaIuos 9-15.
Aullor las closon lo
roprosonl in lox.
Rosorvod for fuluro uso of
funclion 0 in a muIli-func-
lion dovico.
Rosorvod TBD
08l-0Il. Spoc aclu-
aIIy slovs llis as
docimaI vaIuos 8-15.
Aullor las closon lo
roprosonl in lox.
Rosorvod (singIo funclion
dovicos and ollor func-
lions (groalor llan func-
lion 0) villin a
muIli-funclion dovico
-


-


-

I1 slalo. During I1 llo roforonco cIocI and povor romain aclivo.

Wlon soflvaro pIacos a dovico inlo llo D3 slalo, llo dovico signaIs a
lransilion lo I1 jusl as dono in llo D1 and D2 slalos. Hovovor, bocauso llo
dovico is in llo D3
lol
slalo soflvaro may clooso lo romovo llo roforonco cIocI
and povor from llo dovico caIIod D3
coId
. Irior lo romoving llo cIocI and
povor, soflvaro inilialos a landslaIo procoss llal pIacos a dovico inlo llo I2/
I3 Roady slalo (i.o., povor and cIocI sliII on, bul roady for povor lo bo
romovod)

Tlis slalo indicalos llal llo cIocI and povor lavo boon romovod.
Hovovor, auxiIiary (AUX) Iovor may romain avaiIabIo aflor llo main povor
raiIs aro povorod dovn. In llis caso, llo IinI slalo is roforrod lo as I2. Wlon
main povor is romovod and no AUX povor is avaiIabIo il is roforrod lo as I3.
TabIo 16-17 on pago 608 providos addilionaI informalion rogarding llo IinI
povor slalos.
- -
-- -

Tlo I1 slalo is onlorod duo lo IM soflvaro pIacing a dovico inlo llo D1, D2,
or D3 slalos or oplionaIIy I1 is onlorod aulonomousIy undor lardvaro con-
lroI vlon Aclivo Slalo Iovor Managomonl is supporlod for I1.
Tlo spocificalion doscribos llo I2 slalo as boing soflvaro diroclod. Tlo
ollor I-slalos in llo labIo aro Iislod as soflvaro diroclod bocauso soflvaro
inilialos llo lransilion inlo lloso slalos. Ior oxampIo, vlon soflvaro inilial-
ing a dovico povor slalo clango lo D1, D2, or D3 dovicos musl rospond by
onloring llo I1 slalo. Soflvaro aIso causos llo lransilion lo llo I2/I3 Roady
slalo by inilialing a IMI_Turn_Off mossago. IinaIIy, soflvaro aIso inilialos
llo romovaI of povor from a dovico aflor llo dovico las lransilionod lo llo
I2/I3 Roady slalo. Tlis rosuIls in a lransilion lo oillor llo I2 or I3
psoudo-slalos (so caIIod bocauso povor is romovod from llo dovicos and
acluaI IinI slalo lransilions do nol appIy). Bocauso Vaux povor is avaiIabIo
in I2, a vaIoup ovonl can bo signaIod causing soflvaro lo bo nolifiod.
Link Active State Power Management
ICI Ixpross incIudos a foaluro llal roquiros IinI povor consorvalion ovon
llougl llo dovico las nol boon pIacod in a Iov-povor slalo by soflvaro. Conso-
quonlIy llis foaluro is caII Aclivo Slalo povor managomonl and funclions
onIy vlon llo dovico is in llo DO slalo. Transilions inlo and oul of Aclivo Slalo
Iovor Managomonl (ASIM) aro landIod soIoIy by Hardvaro.
--

Tvo Iov povor slalos aro dofinod for ASIM:

1. I0 slandby (I0s) llis slalo is roquirod by aII ICI Ixpross dovicos and
appIios lo a singIo diroclion on llo IinI. Tlo Ialoncy lo rolurn lo llo I0 slalo
is spocifiod lo bo vory slorl.
2. I1 ASIM llis slalo is oplionaI and can bo onlorod lo acliovo a groalor
dogroo of povor consorvalion llan I0s. Tlis slalo aIso rosuIls in boll diroc-
lions of llo IinI boing pIacod inlo llo I1 slalo.
Iiguro 16-11 iIIuslralos llo IinI slalo lransilions and liglIiglls llo lransilions
bolvoon I0, I0s, and I1. Nolo llal lransilions bolvoon I0s and I1 roquiro llo
IinI lo bo rolurnod lo llo I0 slalo.
Tlo IinI CapabiIily rogislor spocifios a dovicos supporl for Aclivo Slalo Iovor
Managomonl. Iiguro 16-12 on pago 610 iIIuslralos llo fioId
villin llis rogislor. Nolico llal llo onIy lvo combinalions aro supporlod via
llis rogislor:
- I0s onIy and
- I0s and I1.
--
-- -

Soflvaro can onabIo and disabIo ASIM via llo fioId of

llo IinI ConlroI Rogislor as iIIuslralod in Iiguro 16-13 on pago 611. Tlo possibIo
sollings aro Iislod in TabIo 16-18 on pago 610. Tlo foIIoving discussion of ASIM
prosumo llal llo roIalod foaluros aro onabIod.
Nolo: Tlo spocificalion rocommonds llal ASIM bo disabIod for aII compononls
in llo pall associalod vill Isoclronous lransaclions, if llo addilionaI Ialoncios
associalod vill ASIM oxcoods llo Iimils of llo isoclronous lransaclions.


-
00b I0s and I1 ASIM disabIod
01b I0s onabIod and I1 disabIod
10b I1 onabIod and I0s disabIod
11b I0s and I1 onabIod

L0s State
I0s is a IinI povor slalo llal can bo onlorod by any porl and appIiod lo a singIo
diroclion of llo IinI. Ior oxampIo, a Iargo voIumo of lraffic in convonlionaI
IC-basod sysloms rosuIls from ICI and ICI Ixpross dovicos sonding dala lo
main syslom momory. Tlis moans llal llo upslroam Ianos viII lavo loavy lraf-
fic, vliIo llo dovnslroam Ianos viII carry occasionaI ACK TIIs. Tloso dovn-
slroam Ianos can onlor llo I0s slalo lo consorvo povor during llo slrolclos of
idIo bus limo.
Entry into L0s
A lransmilling porl inilialos llo lransilion from I0 lo I0s aflor dolocling a
poriod of idIo limo on llo lransmil IinI. DolaiIs rogarding llo moaning of idIo,
lov I0s is onlorod, and llo rosuIling lransmillor and rocoivor slalos aflor I0s
las boon onlorod is discussod in llis soclion.
- Inlry inlo I0s is man-
agod for a singIo diroclion of llo IinI basod on dolocling a poriod of IinI idIo
limo. Iorls aro roquirod lo onlor I0s aflor dolocling idIo limo of no groalor
llan 7s. IdIo is dofinod by llo spocificalion difforonlIy for oacl calogory of
dovico. Iacl calogory musl salisfy llo buIIolod iloms Iislod lo bo considorod
in llo idIo slalo:

-- -

- :
o No TIIs aro ponding lransmission or IIov ConlroI crodils for a
ponding TII aro lomporariIy unavaiIabIo.
o No DIIIs aro ponding lransmission.
- - :
o Tlo rocoivo Iano of aII dovnslroam porls aro aIroady in llo I0s
slalo.
o No TIIs aro ponding lransmission, or no IC crodils aro avaiIabIo
for ponding TIIs.
o No DIIIs aro ponding lransmission.
- - :
o Tlo Svilcls Upslroam Iorls Rocoivo Ianos aro in llo I0s slalo
o No TIIs aro ponding lransmission, or no IC crodils aro avaiIabIo
for ponding TIIs.
o No DIIIs aro ponding for lransmission
Tlo Transaclion and Dala IinI Iayors lavo no InovIodgo of vlollor llo
lransmilling sido of llo IlysicaI Iayor las onlorod I0s, lovovor, llo condi-
lions llal lriggor a lransilion lo I0s musl bo conlinuousIy roporlod from llo
Transaclion and IinI Iayors lo llo IlysicaI Iayor.
Nolo llal llo rocoiving sido of a porl musl aIvays supporl onloring I0s
ovon if soflvaro las disabIod ASIM for llis porl. Tlis aIIovs a dovico al llo
ollor ond of llo IinI (llal is onabIod for ASIM) lo sliII lransilion ono sido of
llo IinI lo llo I0s slalo.
- - A ponding TII llal cannol
bo sonl duo lo insufficionl IC crodils salisfios ono of llo roquiromonls for an
idIo condilion for aII dovico calogorios Iislod abovo. ConsoquonlIy, if fIov
conlroI crodils aro rocoivod during I0s llal pormils doIivory of llo ponding
TII, llo lransmilling porl musl inilialo llo rolurn lo I0. AIso, if llo rocoivo
buffor (associalod vill llo lransmil sido llal is in I0s) maIos addilionaI
fIov conlroI crodils avaiIabIo, a lransmillor musl inilialo llo rolurn lo I0
and doIivor llo roIalod IC_Updalo DIII lo llo porl al llo opposilo ond of
llo IinI.
- - - Wlon sufficionl idIo limo las boon
obsorvod on llo lransmil sido of llo IinI, llo lransmillor forcos llo lransi-
lion from I0 lo I0s by laIing llo foIIoving slops. IoIIoving llo soquonco of
ovonls, boll llo lransmillor and rocoivor viII lavo lransilionod lo I0s:
1. Transmillor doIivors an oIoclricaI idIo ordorod sol lo llo rocoivor and
pIacos ils lransmillor inlo llo Hi-Z slalo.

2. Wlon llo rocoivor dolocls llo oIoclricaI idIo ordorod sol, il pIacos ils
rocoivor inlo llo Io-Z slalo.
Tlo lransmillor and rocoivor aro nov in lloir oIoclricaI idIo slalos and lavo
roducod povor consumplion. Synclronizalion bolvoon llo lransmillor and
rocoivor las boon Iosl and rolraining is roquirod. Tlo spocificalion roquiros
llal llo III in llo rocoivor musl romain aclivo lo aIIov quicI ro-synclroni-
zalion and rocovory from I0s bacI lo I0.
Exit from L0s State
If llo lransmillor dolocls llal llo idIo condilion las disappoarod, il musl inilialo
llo soquonco nocossary lo oxil I0s and a rolurn lo I0. Tlo spocificalion oncour-
agos dosignors lo monilor ovonls llal givo an oarIy indicalion llal I0s oxil is
imminonl and lo slarl llo rocovory procoss lo spood up llo lransilion bacI lo I0.
Ior oxampIo, if llo rocoiving sido of llo IinI rocoivos a non-poslod TII, llo
lransmillor sido Inovs llal il viII slorlIy rocoivo a roquosl lo sond a compIolion
lransaclion. ConsoquonlIy, llo lransmillor can slarl llo lransilion bacI lo I0
prior lo rocoiving llo compIolion roquosl.
- - - Wlon llo lransmillor vlollor in llo
upslroam or dovnslroam compononl rocognizos llal il musl lransilion llo
IinI from I0s lo I0, il inilialos a soquonco llal ro-oslabIislos llo connoclion
vill llo rocoivor:
1. Transmillor oxils Hi-Z slalo and issuos ono or moro Iasl Training
Soquonco (ITS) Ordorod Sols noodod by llo rocoivor. Tlo numbor of
ITS Ordorod Sols roquirod by llo rocoivor lo ro-synclronizo (N_ITS)
vas proviousIy communicalod during IinI lraining foIIoving funda-
monlaI rosol.
2. IoIIoving N_ITS ono SIip ordorod sol is doIivorod.
3. Tlo rocoivor rocoivos llo numbor of ITS (N_ITS) Ordorod Sols il noods
lo oslabIisl bil IocI (III), symboI IocI (aIignmonl of 10-bil symboIs),
and Iano-lo-Iano dosIov. Aflor rocoiving llo SIip ordorod sol llo
rocoivor is roady lo rosumo normaI oporalion.
- - - A svilcls rocoiv-
ing porl in llo I0s slalo llal rocoivos llo I0s lo I0 lransilion soquonco musl
aIso lransmil an I0s oxil lo ollor svilcl porls curronlIy in llo I0s slalo. Tvo
spocific casos musl bo considorod:
-- -

- - - - - Tlo
svilcl musl signaI an I0s lo I0 on llo upslroam porl if il is curronlIy in
llo I0s slalo. Tlis proparos llo IinI facing llo Rool CompIox for lrans-
mission of a lransaclion llal viII IiIoIy bo coming from llo ondpoinl or
dovnslroam svilcl llal signaIod llo lransilion.
- - - - - Tlo svilcl
musl signaI an I0s lo I0 lransilion on aII dovnslroam porls curronlIy in
llo I0s slalo.
Any svilcl porl in llo I1 slalo (nol I1 ASIM) las boon pIacod inlo I1 duo
lo soflvaro laving proviousIy lransilionod llo dovico lo a D1 or liglor
povor savings slalo. Tloso porls romains unaffoclod by I0s lo I0 lransi-
lions. Hovovor, onco llo upslroam IinI las compIolod llo lransilion lo I0, a
subsoquonl lransaclion may largol llis porl, causing a lransilion from I1 lo
I0.
L1 ASPM State
Tlo oplionaI I1 ASIM slalo providos povor savings groalor llan I0s, bul vill
llo cosl of mucl groalor rocovory Ialoncy. Tlis slalo aIso rosuIls in boll diroc-
lions of llo IinI boing pIacod inlo llo I1 slalo and rosuIls in IinI and Transac-
lion Iayor doaclivalion villin oacl dovico.
Inlry inlo llis slalo is inilialod onIy by llo dovnslroam compononl (an ond-
poinl or llo upslroam porl of a svilcl). Nolo llal a svilcl may supporl I1
ASIM on any combinalion of ils porls. Tlo porl al llo opposilo ond of llo IinI
can bo a rool porl or llo dovnslroam porl of a svilcl. In oillor caso, llo
upslroam compononl musl agroo lo onlor llo I1 slalo llrougl a nogolialion pro-
coss vill llo dovnslroam compononl. (Soo Iiguro 16-14 on pago 615) Nolo llal
oxiling llo I1 ASIM slalo can bo inilialod by oillor llo dovnslroam or
upslroam porl.

Downstream Component Decides to Enter L1 ASPM

Tlo spocificalion doos nol procisoIy dofino aII condilions undor vlicl an ond-
poinl or upslroam porl of a svilcl docidos lo allompl onlry inlo llo I1 ASIM
slalo. Tlo spocificalion doos suggosl llal ono roquiromonl migll bo llal boll
diroclions of llo IinI lavo onlorod I0s and lavo boon in llis slalo for a prosol
amounl of limo. Tlo roquiromonls spocifiod incIudo:
- ASIM I1 onlry is supporlod and onabIod
- Dovico-spocific roquiromonls for onloring I1 lavo boon salisfiod
- No TIIs aro ponding lransmission
- No DIIIs aro ponding lransmission
- --
-- -

- If llo dovnslroam compononl is a svilcl, llon aII of llo svilcls dovn-

slroam porls musl bo in llo I1 or liglor povor consorvalion slalo, boforo
llo upslroam porl can inilialo I1 onlry.
Negotiation Required to Enter L1 ASPM
Bocauso of llo Iong Ialoncy roquirod lo rocovor from I1 ASIM, a nogolialion
procoss is ompIoyod lo onsuro llal llo porl al llo ollor ond of llo IinI is
onabIod for I1 ASIM onlry and is proparod lo onlor il. Tlo nogolialion invoIvos
sonding sovoraI lransaclions:
- IM_ Aclivo_Slalo_Roquosl_I1 llis DIII is issuod by llo dovnslroam
porl lo slarl llo nogolialion procoss.
- IM_ Roquosl_AcI llis DIII is rolurnod by llo upslroam porl vlon aII
of ils roquiromonls lo onlor I1 ASIM lavo boon salisfiod.
- IM_Aclivo_Slalo_NaI llis TII is rolurnod by llo upslroam porl vlon il
is unabIo lo onlor llo I1 ASIM slalo.
Tlo upslroam compononl may or may nol accopl llo lransilion lo llo I1 ASIM
slalo. Tlo foIIoving sconarios doscribo a varioly of circumslancos llal rosuIl in
boll condilions.
Scenario 1: Both Ports Ready to Enter L1 ASPM State
Iiguro 16-15 on pago 618 summarizos llo soquonco of ovonls llal musl occur lo
onabIo lransilion lo llo I1 ASIM slalo. Tlis sconario assumos llal aII lransac-
lions lavo compIolod in boll diroclions and no nov lransaclion roquiromonls
omorgo during llo nogolialion.
- --- - Onco
llo dovnslroam compononl las fuIfiIIod aII llo roquiromonls lo lransilion
lo llo I1 slalo, il can issuo llo roquosl lo onlor I1 onco llo foIIoving slops
lavo compIolod:
1. TII scloduIing is bIocIod al llo Transaclion Iayor.
2. Tlo IinI Iayor las rocoivod acInovIodgomonl for llo Iasl TII il lad
proviousIy sonl (i.o., llo ropIay buffor is omply).
3. Sufficionl fIov conlroI crodils aro avaiIabIo lo aIIov lransmission of llo
Iargosl possibIo pacIol for any IC lypo. Tlis onsuros llal llo compo-
nonl can issuo a TII immodialoIy upon oxiling llo I1 slalo.
Tlo dovnslroam compononl doIivors llo IM_ Aclivo_Slalo_Roquosl_I1
DIII lo nolify llo upslroam compononl of llo roquosl lo onlor llo I1 slalo.
Tlis lransaclion is sonl ropoalodIy unliI llo upslroam compononl rolurns a

rosponso oillor a IM_Roquosl_ACK DIII or a IM_Aclivo_Slalo_NAK

TII.
- - As iIIus-
lralod in Iiguro 16-14 on pago 615 llo upslroam compononl may bo oillor a
Rool CompIox Iorl, or a Svilcl Dovnslroam Iorl. Tloso porls musl accopl
a roquosl lo onlor a Iov povor I1 slalo if aII of llo foIIoving condilions aro
lruo:
- Tlo Iorl supporls ASIM I1 onlry and is onabIod lo do so
- No TII is scloduIod for lransmission
- No AcI or NaI DIII is scloduIod for lransmission
- - - Tlo
upslroam compononl sonds a IM_Roquosl_ACK DIII lo nolify llo dovn-
slroam compononl of ils agroomonl lo onlor llo I1 ASIM slalo. Irior lo
sonding llis acInovIodgomonl, il musl compIolo llo foIIoving:
1. BIocI scloduIing of any TIIs.
2. Tlo Upslroam compononl musl lavo rocoivod acInovIodgomonl for
llo Iasl TII proviousIy sonl (i.o., ils ropIay buffor is omply).
3. Sufficionl fIov conlroI crodils aro avaiIabIo lo aIIov lransmission of llo
Iargosl possibIo pacIol for any IC lypo. Tlis onsuros llal llo compo-
nonl can issuo a TII immodialoIy upon oxiling llo I1 slalo.
Tlo Upslroam compononl llon sonds a IM_Roquosl_AcI DIII and conlin-
uos sonding llo lransaclion conlinuousIy unliI il rocoivos llo IIoclricaI IdIo
ordorod sol on ils rocoivo Ianos.
- - Wlon llo
Dovnslroam compononl dolocls a IM_Roquosl_AcI DIII, il Inovs llal
llo upslroam dovico las accoplod llo roquosl. In rosponso, llo dovnslroam
compononl slops sonding llo IM_Aclivo_Slalo_Roquosl_I1 DIII, disabIos
DIII and TII lransmission, and pIacos ils lransmil (upslroam) Ianos inlo
llo IIoclricaI IdIo slalo.
- - Wlon llo Upslroam
compononl rocoivos an IIoclricaI IdIo ordorod sol on ils Rocoivo Ianos (sig-
naIing llal llo Dovnslroam compononl las onlorod llo I1 slalo), il llon
slops sonding llo IM_Roquosl_AcI DIII, disabIos DIII and TII lrans-
mission, and pIacos ils lransmil (dovnslroam) Ianos inlo llo IIoclricaI IdIo
slalo.
-- -

Scenario 2: Upstream Component Transmits TLP Just Prior to

Receiving L1 Request
Tlis sconario prosumos llal llo upslroam compononl las jusl rocoivod a
roquosl lo sond a TII lo llo dovnslroam compononl as il proparos lo roquosl
onlry in lo llo I1 slalo. CurronlIy, llo dovnslroam dovico is unavaro of llo TII
boing sonl and llo upslroam dovico is unavaro of llo roquosl lo onlry I1. Sov-
oraI nogolialion ruIos dofino llo aclions llal onsuro llal llis silualion is man-
agod corroclIy.

- - Nolo llal aflor

llo dovnslroam dovico sonds llo IM_Aclivo_Slalo_I1 DIII il musl vail
for a rosponso from llo upslroam compononl. WliIo vailing, llo rocoivo
sido of llo dovnslroam compononl musl bo abIo lo accopl TIIs and DIIIs
from llo upslroam dovico. Iurllormoro, il musl aIso bo abIo lo sond a DIII
as roquirod. In llis oxampIo llo dovnslroam compononl musl rospond lo
llo TII. Tvo possibiIilios oxisl:
- an ACK DIII is rolurnod lo vorify succossfuI rocoipl of llo TII.
- a NAK DIII is rolurnod if a TII lransmission orror is doloclod. Tlis
rosuIls in a lransaclion rolry of llo TII from llo upslroam compononl.
Rolrios aro pormillod during nogolialion.
In summary, llo spocificalion roquiros llal aII TIIs bo acInovIodgod prior
lo onloring llo I1 slalo.
- - - Tlo spocifica-
lion roquiros llal llo upslroam compononl immodialoIy accopl or rojocl llo
roquosl lo onlor llo I1 slalo. Hovovor, il furllor slalos llal prior lo sonding
a IM_Roquosl_ACK DIII il musl:
1. BIocI scloduIing of nov TIIs
2. Wail for acInovIodgomonl of llo Iasl TII proviousIy sonl, if nocossary.
Tlo spocificalion furllor slalos llal llo upslroam compononl may issuo
rolrios in llo ovonl llal a NAK DIII is rocoivod from llo dovnslroam
compononl, or a IinI AcInovIodgomonl limooul condilion occurs.
Onco aII oulslanding TIIs lavo boon acInovIodgod, and aII ollor condi-
lions aro salisfiod, llo upslroam dovico musl rolurn a IM_Roquosl_ACK
DIII.
Scenario 3: Downstream Component Receives TLP During
Negotiation
During llo nogolialion soquonco llo dovnslroam dovico may rocoivo a nov
TII largoling llo upslroam dovico. RocaII llal vlon a dovico bogins llo I1
ASIM nogolialion procoss, il musl bIocI nov TII scloduIing. Tlis provonls a
raco condilion bolvoon compIoling llo lransilion lo I1 and sonding a nov TII
llal vouId ollorviso provonl onlry inlo I1 ASIM. ConsoquonlIy, onco aII
roquiromonls lo onlor I1 lavo boon salisfiod and llo dovnslroam dovico las
scloduIod doIivory of llo IM_Roquosl_I1 DIII il musl compIolo llo lransilion
lo llo I1 slalo (if a IM_Roquosl_ACK is rocoivod). Tlon il can inilialo llo lransi-
lion from I1 ASIM lo I0 and sond llo TII.
-- -

Scenario 4: Upstream Component Receives TLP During

Negotiation
Nolo llal in llo ovonl llal llo upslroam compononl noods lo lransfor a TII or
DIII aflor sonding llo IM_Roquosl_AcI DIII, il is roquirod lo compIolo llo
lransilion lo I1. Il musl llon inilialo a lransilion from I1 lo I0, aflor vlicl llo
TII or DIII can bo sonl.
Scenario 5: Upstream Component Rejects L1 Request
Iiguro 16-16 on pago 621 summarizos llo nogolialion soquonco vlon llo
upslroam compononl rojocls llo roquosl lo onlor llo I1 ASIM slalo.
Tlo nogolialion bogins normaIIy vill llo dovnslroam compononl sonding llo
roquosl DIII lo onlor I1. Hovovor, llo upslroam dovico rolurns a
IM_Aclivo_Slalo_NaI TII lo indicalo rojoclion of llo roquosl. Tlo roasons for
llo upslroam compononl rojocling llo roquosl lo onlor I1 incIudo:
- doos nol supporl I1 ASIM
- supporls I1 ASIM, bul soflvaro las nol onabIod llis foaluro villin llo
IinI ConlroI rogislor
- Ono or moro TIIs aro scloduIod for lransfor across llo IinI
- ACK or NAK DIIIs aro scloduIod for lransfor
Onco llo upslroam compononl sonds llo rojoclion mossago, il can sond TIIs
and DIIIs as roquirod.
If llo dovnslroam compononl rocoivos a rojoclion il musl lransilion lo I0s if
possibIo.

Exit from L1 ASPM State

Iillor compononl can inilialo llo lransilion from I1 lo I0 vlon il noods lo com-
municalo via llo IinI. Wlollor llo upslroam or dovnslroam compononl ini-
lialos llo oxil from I1, llo procoduro is llo samo and doos nol invoIvo any
nogolialion as doos I1 onlry. Wlon svilclos aro invoIvod in oxiling from I1 llo
spocificalion roquiros llal ollor svilcl porls in llo ASIM Iov povor slalos
musl aIso lransilion lo llo I0 slalo if lloy aro possibIy in llo pall of llo lransac-
lion causing llo oxil. Tloso issuos aro discussod in subsoquonl soclions.
Tlo spocificalion slalos llal oxil from I1 is
invoIod by oxiling oIoclricaI idIo, vlicl couId consisl of a varioly of sig-
naIod slalos. Hovovor, bocauso ro-lraining (rocovory) is roquirod lo lransi-
lion llo IinI bacI lo llo I0 slalo, il sooms roasonabIo llal oxil signaIing
-
-- -

vouId bogin by lransmilling llo TS1 ordorod sol lo llo opposilo porl. Tlo
rocoiving porl, in lurn inilialos rocovory by signaIing llo TS1 ordorod sol
bacI lo llo originaling dovicoss rocoivo porl. Tlo IlysicaI Iayors IinI
Training Slalo Maclino compIolos llo Rocovory slalo aflor vlicl llo IinI
viII bo rolurnod lo I0. Rofor loRocovory Slalo on pago 532 for dolaiIs.
- - Tlis soc-
lions doscribos llo svilcl bolavior vlon a dovnslroam compononl ini-
lialos oxil from I1 (TS1 ordorod sol) lo llo svilcl. As piclurod in Iiguro
16-17 on pago 623, llo Svilcl musl rospond lo I1 oxil signaIing by rolurn-
ing llo TS1 ordorod sol lo llo dovnslroam compononl, and villin 1s
(from signaI I1 Ixil dovnslroam) il musl aIso lransmil llo TS1 ordorod sol
on ils upslroam IinI (bul onIy vlon llo upslroam porl is aIso in llo I1
ASIM slalo).
Tlo oxpoclalion is llal llo dovnslroam compononl, laving inilialod I1
oxil, is proparing lo sond a TII lravoIing in llo upslroam diroclion. Bocauso
I1 oxil Ialoncios aro roIalivoIy Iong, llo spocificalion slalos llal a svilcl
musl nol vail unliI ils Dovnslroam Iorl IinI las fuIIy oxilod lo I0 boforo
inilialing an I1 oxil lransilion on ils Upslroam Iorl IinI. Tlis provonls
accumuIalod Ialoncios llal vouId ollorviso rosuIl if aII I1 lo I0 lransilions
occurrod in a Iinoar faslion.

- - Tlis soclion
doscribos llo svilcl bolavior vlon an upslroam compononl signaIs I1 Ixil
(TS1 ordorod sol) lo a svilcl. In llis caso, llo svilcl musl sond llo TS1
ordorod sol bacI upslroam, and villin 1s il musl aIso signaI llo TS1
ordorod sol lo forco aII dovnslroam porls llal aro in llo I1 ASIM slalo lo
aIso rolurn lo I0. Tlo goaI as in llo provious oxampIo is lo slorlon llo ovor-
aII Ialoncy in rolurning lo llo I0 slalo. Iiguro 16-18 on pago 624 summarizos
lloso roquiromonls. Nolo llal llo IinI allacling Svilcl I and IndIoinl (II)
I is in llo I1 slalo duo lo soflvaro laving proviousIy pIacod II I inlo llo
D1 slalo, vlicl causod llo IinI lo lransilion lo I1. OnIy IinIs in llo I1
ASIM slalo aro lransilionod lo I0 as a rosuIl of llo Rool CompIox (RC) inili-
aling llo oxil from I1 ASIM.
- -
-- -

ASPM Exit Latency

ICI Ixpross providos llo moclanisms lo onsuro llal llo ASIM oxil Ialoncios for
I0s and I1 do nol oxcood llo Ialoncy roquiromonls of llo ondpoinl dovicos.
Iacl dovico musl roporl ils I0s and I1 oxil Ialoncios from llo momonl ASIM
oxil is signaIod. Indpoinls aIso roporl llo lolaI accoplabIo Ialoncy llal lloy can
loIoralo vlon porforming accossos (lypicaIIy lo and from main momory). Tlis
Ialoncy is a funclion of llo dala buffor sizo villin llo dovico. If llo clain of
dovicos llal rosido bolvoon llo ondpoinl and largol dovico lavo a lolaI Ialoncy
- -

llal oxcoods llo accoplabIo Ialoncy roporlod by llo ondpoinl, soflvaro can dis-
abIo ASIM lo avoid unaccoplabIo Ialoncy for a givon ondpoinl.
Tlo oxil Ialoncios roporlod by a dovico viII clango doponding on vlollor llo
dovicos on oacl ond of a IinI slaro a common roforonco cIocI or nol. Conso-
quonlIy, llo IinI Slalus rogislor incIudos a bil caIIod llal spocifios
vlollor llo compononl usos an oxlornaI roforonco cIocI providod by llo pIal-
form, or an indopondonl roforonco cIocI (porlaps gonoralod inlornaIIy). Sofl-
varo clocIs lloso bils villin dovicos al boll onds of oacl IinI lo dolormino
vlollor lloy uso a common cIocI. If so, soflvaro sols llo bil lo
roporl llo common cIocI impIomonlalion lo boll dovicos. Iiguro 16-20 on pago
628 iIIuslralos llo rogislors and roIalod bil fioIds invoIvod in managing llo
ASIM oxil Ialoncy.
Reporting a VaIid ASPM Exit Latency
Bocauso llo cIocI configuralion affocls llo oxil Ialoncy llal a dovico viII oxpori-
onco, dovicos musl roporl llo sourco of lloir roforonco cIocI via llo
slalus bil villin llo IinI Slalus rogislor. Tlis bil is iniliaIizod by llo compononl
lo roporl llo sourco of ils roforonco cIocI. If llis bil is sol (1), llo cIocI usos llo
pIalform gonoralod roforonco cIocI and cIoarod (0) if il usos an indopondonl
cIocI.
If syslom firmvaro or soflvaro dolorminos llal llo compononls al oacl ond of
llo IinI uso llo pIalform cIocI llon llo roforonco cIocIs villin boll dovicos viII
bo in plaso. Tlis rosuIls in slorlor oxil Ialoncios from I0s and I1, and is
roporlod in llo fioId of llo IinI ConlroI rogislor. Compononls
musl llon updalo lloir roporlod oxil Ialoncios lo rofIocl llo corrocl vaIuo. Nolo
llal if llo cIocIs aro nol common llon llo dofauIl vaIuos viII bo corrocl and no
furllor aclion is roquirod.
- Ixil Ialoncy for I0s is roporlod in llo IinI
CapabiIily rogislor basod on llo dofauIl assumplion llal a common cIocI
impIomonlalion doos nol oxisl. I0s oxil Ialoncy is aIso roporlod during IinI
lraining (via llo TS1 Ordorod Sols) by spocifying llo numbor of ITS
Ordorod Sols (N_ITS) roquirod lo oxil I0s. ConsoquonlIy, if soflvaro dolocls
a common cIocI impIomonlalion, llo Common CIocI fioId is sol and Sys-
lom firmvaro or soflvaro musl vrilo lo llo bil in llo IinI Con-
lroI rogislor, lo forco rolraining. During rolraining nov N_ITS vaIuos aro
roporlod lo llo lransmillor al llo opposilo ond of llo IinI and nov vaIuos
aro aIso roporlod in - fioId of llo IinI CapabiIily rogislor.
-- -

IoIIoving IinI rolraining, nov vaIuos viII aIso

bo roporlod in llo fioId.
CaIcuIating Latency Between Endpoint to Root CompIex
Iiguro 16-19 on pago 627 iIIuslralos an ondpoinl vloso lransaclions musl lrans-
vorso 2 svilclos in llo pall bolvoon llo ondpoinls and Rool CompIox. Tlis
oxampIo prosumos llal aII IinIs in llo pall aro in llo I1 slalo.
1. Indpoinl B noods lo sond a pacIol lo main momory and bogins llo vaIo
soquonco by inilialing a TS1 ordorod sol on IinI B/C al limo T. Tlo I1 oxil
Ialoncy for II B is a maximum of 8, bul Svilcl C las a maximum oxil
Ialoncy of 16s. Tloroforo, llo oxil Ialoncy for llis IinI is 16s.
2. Willin 1s of dolocling llo I1 oxil on IinI B/C, Svilcl C signaIs I1 oxil on
IinI C/I al T+1s.
3. IinI C/I compIolos oxil from I1 in 16s, compIoling al T+17s.
4. Svilcl I signaIs oxil from I1 lo llo Rool CompIox villin 1s of dolocling
I1 oxil from Svilcl C (T+2s).
5. IinI I/RC compIolos oxil from I1 in 8s, compIoling al T+10s.
6. TolaI Ialoncy lo lransilion pall lo largol bacI lo I0 = T+17s.

-- -

-- -

Software Initiated Link Power Management

Wlon soflvaro inilialos configuralion vrilo lransaclions lo lransilion llo povor
slalo of a dovico lo consorvo povor, dovicos musl rospond by lransilioning lloir
IinI lo llo corrosponding Iov povor slalo.
D1/D2/D3
Hot
and the L1 State
Tlo spocificalion roquiros llal vlon aII funclions villin a dovico lavo boon
pIacod inlo any of llo Iov povor slalos (D1, D2, or D3
lol
) by soflvaro, llo
dovico musl inilialo a lransilion lo llo I1 slalo. A dovico rolurns lo I0 as a rosuIl
of soflvaro inlilialing a configuralion accoss lo llo dovico or duo lo a dovico ini-
lialod Iovor Managomonl Ivonl (IMI). Soo Iiguro 16-21.
Upon rocoiving a configuralion vrilo lransaclion lo llo fioId of llo
IMCSR rogislor a dovico inilialos llo lransilion from I0 lo I1 by sonding a
IM_Inlor_I1 DIII lo llo upslroam compononl. Iiguro 16-22 on pago 630 iIIus-
lralos llo soquonco of ovonls. In llo oxampIo, soflvaro pIacos llo IndIoinl (II)
dovico inlo llo D2 slalo.
- - -
-- -

Entering the L1 State

Tlo procoduro roquirod lo pIaco llo IinI inlo an I1 slalo is iIIuslralod in Iiguro
16-23 on pago 632. Iacl slop roforoncod in llo figuro is doscribod in groalor
dolaiI boIov:
1. Onco llo dovico rocognizos llal aII ils funclions aro in llo D2 slalo, llo
dovico musl proparo lo lransilion llo IinI inlo ils I1 slalo. Tlis procoss
bogins vill bIocIing nov TIIs from boing scloduIod.
2. A TII may lavo boon sonl by ondpoinl A prior lo rocoiving llo roquosl lo
onlor D2 llal las nol yol rocoivod a TII acInovIodgomonl. Tlo dovico
musl nol allompl lo signaI a IinI lransilion roquosl unliI aII oulslanding
TIIs lavo boon acInovIodgod. Tlis moans llal llo RopIay Buffor musl bo
omply boforo procooding lo llo I1 slalo.
- -

3. Bocauso of llo Iong Ialoncios roquirod lo rolurn llo dovico and IinI lo lloir
aclivo slalos, a dovico musl bo proparod lo sond a maximum-sizod TII
immodialoIy upon rolurn lo llo aclivo slalo. RocaII llal insufficionl IIov
ConlroI crodils rosuIl in TII lransmission boing bIocIod, lloroforo, boforo
onloring I1 llo ondpoinl musl lavo sufficionl crodils lo pormil lransmis-
sion of llo maximum-sizod pacIol supporlod for oacl IIov ConlroI lypo.
4. Wlon llo abovo iloms lavo boon compIolod llo dovico sonds a
IM_Inlor_I1 DIII lo llo upslroam dovico. Tlis DIII acls as a command
lo inslrucl llo upslroam compononl lo pIaco ils lransmil IinI inlo llo I1
slalo. Tlo IM_Inlor_I1 DIII is sonl conlinuousIy on llo IinI unliI a
IM_Roquosl_ACK DIII is rocoivod from llo upslroam dovico.
5. Tlo upslroam compononl upon rocoipl of llo IM_Inlor_I1 DIII, bogins
ils proparalion for onloring I1 by porforming slops 6, 7, and 8. Tlis is llo
samo proparalion as porformod by llo dovnslroam compononl prior lo sig-
naIing llo I1 lransilion.
6. AII nov TII scloduIing is bIocIod.
7. In llo ovonl llal a provious TII las nol yol boon acInovIodgod, llo
upslroam dovico viII vail unliI aII lransaclions in llo RopIay Buffor lavo
boon acInovIodgod boforo procooding.
8. IIov ConlroI crodils musl bo accumuIalod lo onsuro llal llo Iargosl TII
can bo lransmillod for oacl IIov ConlroI lypo boforo onloring I1.
9. Tlo upslroam compononl sonds a IM_Roquosl_ACK DIII lo confirm llal
ils roady lo onlor llo I1 slalo. Tlis DIII is sonl conlinuousIy unliI an IIoc-
lricaI IdIo ordorod sol is rocoivod, indicaling llal llo acInovIodgomonl las
boon accoplod.
10. Tlo dovnslroam compononl upon rocoiving llo acInovIodgomonl DIII
Inovs llal llo upslroam compononl is proparod lo onlor llo I1 slalo.
11. Tlo dovnslroam dovico sonds an IIoclricaI IdIo ordorod sol aflor vlicl il
pIacos ils lransmil Ianos inlo oIoclricaI idIo (lransmillor is in Hi-Z slalo).
12. Tlo upslroam compononl rocognizos llo IIoclricaI IdIo ordorod sol and
pIacos ils lransmil Ianos inlo oIoclricaI idIo. Tlo IinI las nov onlorod llo I1
slalo.
-- -

Exiting the L1 State

- - -
-- -
- - - - --- - - - -
- - -
- - -
- -
- --
- -
PCI-XP
PCI-XP

soflvaro musl issuo a configuralion vrilo lransaclion lo clango llo povor

slalo bacI lo D0. Wlon llo configuralion lransaclion arrivos al llo
upslroam compononl (a Rool Iorl or dovnslroam Svilcl Iorl) llo porl viII
oxil llo oIoclricaI idIo slalo vlicl inilialos ro-lraining and rolurn of llo IinI
lo llo I0 slalo.
Onco llo IinI is aclivo, llo configuralion vrilo lransaclion can bo doIivorod
lo llo dovico causing llo lransilion bacI lo D0. Tlo dovico is nov roady for
normaI oporalion again.
- - - Wlon a IinI
is in llo I1 slalo llo roforonco cIocI is sliII aclivo and povor is sliII appIiod
lo dovicos allaclod lo llo IinI. A dovnslroam dovico may bo dosignod lo
monilor oxlornaI ovonls llal vouId lriggor a Iovor Managomonl Ivonl
(IMI). In convonlionaI ICI, a IMI is roporlod via a signaI of llo samo
namo IMI#. Tlis signaI is roulod lo syslom board Iogic llal is rosponsi-
bIo for nolifying soflvaro (lypicaIIy via an inlorrupl) of llo nood lo oxil I1.
ICI Ixpross usos llo samo concopl bul oIiminalos llo sidoband signaI vill
a virluaI viro mossago llal roporls llo IMI. (Soo Tlo IMI Mossago on
pago 639 for dolaiIs.)
Wlon in llo I1 slalo boll diroclions of llo IinI aro
in llo oIoclricaI idIo slalo. A dovico signaIs an oxil from I1 by lransmilling
llo TS1 Ordorod Sols, lloroby causing llo oxil from oIoclricaI idIo. Wlon llo
dovico al llo ollor ond of llo IinI dolocls llo oxil from oIoclricaI idIo il
sonds llo TS1 Ordorod Sols bacI lo llo originaling dovico. Tlis soquonco
lriggors boll dovicos lo onlor ro-lraining (rocovory). IoIIoving rocovory
boll dovicos viII lavo rolurnod lo llo I0 slalo.
L2/L3 Ready Removing Power from the Link
Onco soflvaro las pIacod aII funclions villin a dovico inlo llo D3
lol
slalo
povor can bo romovod from llo dovico. A lypicaI appIicalion for llis vouId bo
lo pIaco aII dovicos in llo fabric inlo D3 and pul aII dovicos lo sIoop by romoving
povor lo aII dovicos. Doponding on llo syslom dosign povor can aIso bo
romovod from dovicos soIoclivoIy basod on llo impIomonlalion of soparalo
povor pIanos llal pormils povor lo bo romovod soIoclivoIy. Tlo spocificalion
doos nol spocify llo acluaI moclanism llal vouId bo usod lo romovo cIocI and
povor (main povor raiIs).
-- -

Tlo slalo lransilions roquirod lo proparo dovicos for romoving povor invoIvo
llo proIiminary slops of onloring I1 and llon via a landslaIo prolocoI rolurn-
ing lo I0 and llon lo llo I2/I3 Roady slalo as iIIuslralod in Iiguro 16-24.
L2/L3 Ready Handshake Sequence
Tlo spocificalion lovovor roquiros a landslaIo soquonco vlon lransilioning lo
llo I2/I3 Roady slalo. Tlis landslaIo las lvo purposos:
- lo onsuro llal aII dovicos aro roady for roforonco cIocI and povor romovaI.
- onsuro llal inband IMI mossagos boing sonl lo llo Rool CompIox aro nol
Iosl vlon povor is romovod.
BoIov is an oxampIo of llo landslaIo soquonco llal is roquirod boforo romov-
ing llo roforonco cIocI and povor from aII ICI Ixpross dovicos in llo fabric.
Tlis oxampIo assumos a syslom-vido povor dovn is boing inilialod. Hovovor
llo soquonco can aIso appIy lo smaIIor sogmonls of llo ICI Ixpross fabric or
individuaI dovicos. Tlo roquirod slops aro summarizod boIov and in Iiguro
16-25 on pago 636 (vlicl iIIuslralos a singIo Rool Iorl). Tlo ovoraII soquonco is
roprosonlod in lvo parls IaboIod A and B. Tlo IinI lransilions invoIvod in llo
compIolo soquonco incIudo:
- I0 --> I1 (causod by soflvaro pIacing a dovico inlo D3)
- I1 --> I0 (causod by soflvaro inilialing a IMI_Turn_Off mossago)
- I0 --> I2/I3 Roady (causod by compIolion of IMI_Turn_Off mossago
landslaIo soquonco, vlicl cuIminalos in a IM_Inlor_I23 DIII boing
sonl by llo dovico and llo IinI going lo oIoclricaI idIo)
- -- -- -

Tlo foIIoving slops dolaiI llo soquonco iIIuslralod in Iiguro 16-25.

1. Iovor Managomonl soflvaro musl firsl pIaco aII funclions villin ICI
Ixpross fabric inlo lloir D3 slalo.
2. AII dovicos inilialo lransilions of lloir IinIs lo llo I1 slalo upon onloring
D3.
3. Iovor Managomonl inilialos a IMI_Turn_Off TII mossago llal is broad-
casl from aII Rool CompIox porls lo aII dovicos. (Tlis provonls IMI Mos-
sagos from boing sonl upslroam vlon povor is romovod. Ollorviso a
mossago vouId bo Iosl if il is boing sonl vlon povor is cul.) Nolo llal doIiv-
ory of llis TII roquiros oacl IinI lo lransilion from I1 lo I0 as il is for-
vardod dovnslroam.
4. AII dovicos musl rocoivo and acInovIodgo llo IMI_Turn_Off mossago by
rolurning a IMI_TO_ACK TII mossago vliIo in llo D3 slalo.
5. Svilclos musl coIIocl llo IMI_TO_ACK mossagos from aII of lloir onabIod
dovnslroam porls and forvard an aggrogalo IMI_TO_ACK mossago
upslroam lovard llo Rool CompIox.
6. SubsoquonlIy, oacl dovico sonds a IM_Inlor_I23 DIII vlon il is roady lo
lavo llo roforonco cIocI and povor romovod. Tlis causos oacl IinI lo onlor
llo I2/I3 Roady slalo. Tlo spocificalion slalos llal llo IM_Inlor_I23
DIII musl bo sonl ropoalodIy unliI a IM_Roquosl_ACK DIII is rolurnod.
Tlo IinIs llal onlor llo I2/I3 Roady slalo Iasl aro lloso allaclod lo llo
dovico originaling llo IMI_Turn_Off mossago (llo Rool CompIox in llis
oxampIo).
7. Tlo roforonco cIocI and povor can finaIIy bo romovod vlon aII IinIs lavo
lransilionod lo llo I2/I3 slalo. Tlo spocificalion furllor roquiros llal cIocI
and povor cannol bo romovod soonor llan 100ns aflor aII IinIs allaclod
diroclIy lo llo Rool Iorl (i.o., poinl of origin) lavo lransilionod lo llo I2/I3
Roady slalo. If auxiIiary (AUX) povor is suppIiod lo llo dovicos, llo IinI
lransilions lo I2 and if no AUX povor is avaiIabIo llo dovicos aro roforrod
lo as boing in llo I3 slalo.
-- -

Exiting the L2/L3 Ready State CIock and Power Removed

As iIIuslralod in llo slalo diagram in Iiguro 16-26, a dovico may onIy oxil llo
I2/I3 Roady slalo vlon povor is romovod. Nolo llal vlon Vaux is avaiIabIo
llo lransilion is lo I2 and vlon aII povor is romovod llo lransilion is lo I3.
IinI slalo lransilions aro normaIIy undor conlroI of llo IinI Training Soquonco
Slalo Maclino (ITSSM) villin llo IlysicaI Iayor. Hovovor, lransilions lo llo
I2 and I3 slalos rosuIl from main povor boing romovod. Bocauso llo ITSSM
oporalos lypicaIIy on main povor onIy, llo spocificalion rofors lo llo I2 and I3
slalos as psoudo-slalos. Tloso slalos aro dofinod for oxpIaining llo rosuIling
condilion of a dovico vlon povor is romovod undor Iovor Managomonl sofl-
varo conlroI, and aro nol associalod vill ITSSM aclions.
The L2 State
Somo dovicos aro dosignod lo monilor oxlornaI ovonls and inilialo a vaIoup
soquonco so llal an oxlornaI ovonl can bo landIod normaIIy. Bocauso main
povor is romovod from llo dovico, lloso dovico may nood AUX povor lo moni-
lor llo ovonls and lo signaI vaIoup lo nolify soflvaro llal llo dovico noods lo
bo rovivod.
The L3 State
Wlon in llis slalo llo dovico las no povor and lloroforo no moans of commu-
nicalion. Rocovory from llis slalo roquiros llo syslom lo ro-oslabIisl povor and
roforonco cIocI and rocoivo fundamonlaI rosol.
-- -
-- -

Link Wake ProtocoI and PME Generation

Tlo vaIo prolocoI providos a mollod for dovicos lo roaclivalo llo upslroam
IinI and roquosl llal Iovor Managomonl soflvaro rolurn llo dovicos lo D0 so
lloy can porform roquirod oporalions. Tlo procoduros and signaIing mollods
usod in ICI Ixpross aro difforonl from llo ICI-IM spocifiod mollods. Hovovor,
ICI Ixpross IM is dosignod lo bo compalibIo vill ICI-IM soflvaro.
Rallor llan using llo ICI-dofinod IMI# sidoband signaI, ICI Ixpross dovicos
ompIoy an inband IMI mossago lo nolify IM soflvaro of a roquosl lo rolurn llo
dovico lo llo fuII povor slalo (D0). Tlo abiIily lo gonoralo IMI mossagos may
bo supporlod oplionaIIy villin any of llo Iov povor slalos. RocaII llal dovicos
roporl llo IM slalos lloy supporl and from vlicl of lloso slalos lloy can sond
a IMI mossago. Soo Iiguro 16-8 on pago 597.
IMI mossagos can onIy bo doIivorod onco llo IinI povor slalo lransilions lo I0.
Tlo IovoI of difficuIly and Ialoncy roquirod lo roaclivalo llo IinI so llal a IMI
mossago can bo sonl is a funclion of a dovicos IM and IinI slalo. ConsoquonlIy,
llo slops roquirod lo compIolo a vaIoup can incIudo llo foIIoving doponding
on llo curronl IinI slalo:
1. IinI is in non-communicaling (I2) slalo vlon a IinI is in llo I2 slalo il
cannol communicalo bocauso llo roforonco cIocI and main povor lavo
boon romovod. Tlus, a IMI mossago cannol bo sonl unliI cIocI and povor
aro roslorod, IundamonlaI Rosol is assorlod, and llo IinI is ro-lrainod. Tloso
ovonls aro lriggorod vlon a dovico signaIs a vaIoup. Tlis may rosuIl in aII
IinIs boing ro-avaIonod llal aro in llo pall bolvoon llo dovico nooding lo
communicalo and llo Rool CompIox.
2. IinI is in communicaling (I1) slalo vlon a IinI is in llo I1 slalo cIocI
and main povor aro sliII aclivo, llus, a dovico simpIy oxils llo I1 slalo,
ro-lrains llo IinI (via llo Rocovory slalo) and rolurns llo IinI lo I0. Tlis is
llo procoduro discussod oarIior in llis claplor (Soo Ixiling llo I1 Slalo on
pago 632.) Onco llo IinI is in I0 llo IMI mossago is doIivorod. Nolo llal
llo dovicos novor sond a IMI mossago vliIo in llo I2/I3 Roady slalo
bocauso onlry inlo llal slalo onIy occurs aflor IMI nolificalion las boon
lurnod off, in proparalion for cIocI and povor lo bo romovod. (Soo I2/I3
Roady HandslaIo Soquonco on pago 634.)
3. IMI is doIivorod (I0) Onco llo IinI is in llo I0 slalo, llo dovico lransfors
llo IMI mossago lo llo Rool CompIox, lloroby, nolifying Iovor Manago-
monl soflvaro llal llo dovico las obsorvod an ovonl llal roquiros llo
dovico bo pIacod bacI inlo ils D0 slalo. Nolo llal llo mossago conlains llo

- -
- - - - -
-
--
-- - - -
-- - - --
-

- -

--
PCI-XP
Endpoint
-- -

Tlo IMI mossago is a Transaclion Iayor IacIol llal las llo foIIoving clarac-
lorislics:
- TC and VC vaIuos aro zoro (000b)
- Roulod impIicilIy lo llo Rool CompIox
- HandIod as Ioslod Transaclion
- RoIaxod Ordoring is nol pormillod, forcing aII lransaclions in llo fabric
bolvoon llo signaIing dovico and llo Rool CompIox lo bo doIivorod lo llo
Rool CompIox aload of llo IMI mossago
The PME Sequence
Dovicos may supporl IMI in any of llo Iov povor slalos as spocifiod in llo IM
CapabiIilios rogislor. Tlis rogislor aIso spocifios llo amounl of AUX curronl
roquirod by llo dovico if il supporls vaIoup in llo D3
coId
slalo. Tlo basic
soquonco of ovonls associalod vill signaIing a IMI lo soflvaro is spocifiod
boIov and prosumos llal llo dovico and syslom aro onabIod lo gonoralo IMI
(Soo SconarioSolup a Iunclion-Spocific Syslom WaIoUp Ivonl on
pago 583.) and llo IinI las aIroady boon lransilionod lo llo I0 slalo:
1. Tlo dovico issuos llo IMI mossago on ils upslroam porl.
2. IMI mossagos aro impIicilIy roulod lo llo Rool CompIox. Any svilclos in
llo pall lransilion lloir upslroam porls lo I0 (if nocossary) and sond llo
pacIol upslroam.
3. A rool porl rocoivos llo IMI and forvards il lo llo Iovor Managomonl
ConlroIIor.
4. Tlo conlroIIor caIIs povor managomonl soflvaro (lypicaIIy via an inlor-
rupl). Soflvaro usos llo Roquoslor ID conlainod villin llo mossago lo
road and cIoar llo IMI_Slalus bil in llo IMCSR and rolurn llo dovico lo
llo D0 slalo. Doponding on llo dogroo of povor consorvalion, llo ICI
Ixpross drivor may aIso nood lo rosloro llo dovicos configuralion rogislors.
5. IM Soflvaro may aIso caII llo dovicos soflvaro drivor in llo ovonl llal
dovico conloxl vas Iosl as a rosuIl of llo dovico boing pIacod in a Iov povor
slalo. In llis caso, dovico soflvaro rosloros informalion villin llo dovico.
PME Message Back Pressure DeadIock Avoidance
Tlo spocificalion doscribos a polonliaI doadIocI sconario llal is soIvod by spoci-
fying a ICI Ixpross ruIo. Tlo probIom and soIulion aro doscribod boIov:

Background
Tlo Rool CompIox lypicaIIy sloros llo IMI mossagos il rocoivos in a quouo, and
caIIs IM soflvaro lo landIo oacl IMI. A IMI is loId in llis quouo unliI IM
soflvaro roads llo IMI_Slalus bil from llo roquosling dovicos IMCSR rogislor.
Onco llo configuralion road lransaclion compIolos, llis IMI mossago can bo
romovod from llo inlornaI quouo.
The ProbIem
DoadIocI can occur if llo foIIoving sconario dovoIops:
1. Incoming IMI Mossagos lavo fiIIod llo IMI mossago quouo. AddilionaI
IMI mossagos lavo boon issuod by ollor dovicos llal aro in llo samo lior-
arcly (dovnslroam from llo samo rool porl) as llo oIdosl mossago in llo
quouo.
2. IM soflvaro, inilialos a configuralion road roquosl from llo Rool CompIox
lo road IMI_Slalus from llo oIdosl IMI roquoslors IMCSR.
3. Tlo corrosponding spIil compIolion musl pusl aII proviousIy poslod
IM_IMI mossagos aload of il (basod on ordoring ruIos).
4. Tlo Rool CompIox cannol accopl llo incoming IMI mossagos bocauso llo
quouo is fuII, and llo road compIolion boing bolind llo IMI mossagos can-
nol roacl llo Rool CompIox lo cIoar an onlry from llo quouo.
5. No progross can bo mado, llus doadIocI occurs.
The SoIution
Tlo doadIocI is avoidod if llo Rool CompIox accopls any arriving IMI mos-
sagos, ovon vlon lloso mossago vouId ovorfIov llo quouo. Hovovor, llo Rool
CompIox in llis caso simpIy discards llo incoming IMI mossago, bocauso lloro
is no pIaco lo sloro il. ConsoquonlIy, llo IMI mossago is Iosl. Nolo llal accop-
lanco of a IMI mossago sliII roquiros sufficionl fIov conlroI crodils.
To provonl a discardod IMI mossago from boing Iosl pormanonlIy, llo dovico
llal sonds a IMI mossago is roquirod lo ro-sond il foIIoving a limo-oul inlorvaI,
caIIod llo IMI Sorvico Timo-oul. If aflor sonding a IMI mossago, llo dovicos
IMI_Slalus bil is nol cIoarod vill 100 ms (+ 50/- 5), il musl ro-issuo llo
mossago.
-- -

The PME Context

Dovicos llal gonoralo IMI musl conlinuo lo povor porlions of llo dovico llal
aro usod for dolocling, signaIing, and landIing IMI ovonls. Tloso iloms aro
caIIod llo IMI conloxl. Dovicos llal supporl IMI in llo D3
coId
slalo uso AUX
povor lo mainlain llo IMI conloxl vlon llo main povor is romovod. IoIIov-
ing is a Iisl of iloms llal aro lypicaIIy parl of llo IMI conloxl.
- llo funclions IMI_Slalus bil (roquirod) llis bil is sol vlon a dovico
sonds a IMI mossago and is cIoarod by IM soflvaro. Dovicos llal supporl
IMI in llo D3
coId
slalo musl impIomonl llo IMI_Slalus bil as slicIy,
moaning llal llo vaIuo is mainlainod across a fundamonlaI rosol.
- llo funclionss IMI_InabIo bil (roquirod) llis bil musl romain sol lo
conlinuo onabIing a funclions abiIily lo gonoralo IMI mossagos and signaI
vaIoup (if roquirod). Dovicos llal supporl IMI in llo D3
coId
slalo musl
impIomonl IMI_InabIo as slicIy, moaning llal llo vaIuo is mainlainod
across a fundamonlaI rosol.
- dovico-spocific slalus informalion for oxampIo, a dovico migll prosorvo
ovonl slalus informalion in casos vloro sovoraI difforonl lypos of ovonls can
lriggor a IMI.
- appIicalion-spocific informalion for oxampIo, modoms llal inilialo
vaIoup vouId prosorvo CaIIor ID informalion if supporlod.
Waking Non-Communicating Links
Wlon a dovico llal supporls IMI in llo D3coId slalo noods lo sond a IMI mos-
sago, il musl firsl inilialo llo soquonco of ovonls noodod lo lransilion llo IinI lo
llo I0 slalo so llal llo mossago can bo sonl. Tlis is lypicaIIy roforrod lo as
vaIoup. ICI Ixpross dofinos lvo mollods of lriggoring llo vaIoup of
non-communicaling IinIs:
- Boacon a signaIing loclniquo llal is drivon by AUX povor
- WAKI# SignaI a sidoband signaI llal is drivon by AUX povor
In boll casos, IM soflvaro musl bo nolifiod so llal il can ro-appIy main povor
and roslarl llo roforonco cIocI. Tlis aIso causos gonoralion of fundamonlaI rosol
llal forcos a dovico inlo llo D0
uniniliaIizod
slalo. Onco llo IinI lransilions lo llo
I0 slalo, llo dovico sonds llo IMI mossago. Bocauso rosol is roquirod lo ro-acli-
valo llo IinI so llal IMI can bo signaIod, dovicos musl mainlain IMI conloxl
across llo rosol soquonco doscribod abovo.

Beacon
ICI Ixpross incIudos a signaIing moclanism dosignod lo oporalo on AUX
povor llal doos nol roquiro llo difforonliaI drivors and rocoivors lo bo usod.
Tlo boacon is simpIy a vay of nolifying llo upslroam compononl llal soflvaro
slouId bo nolifiod of llo vaIoup roquosl. Svilclos upon rocoiving boacon on
ono of lloir dovnslroam porls signaI boacon on llo upslroam porl. UIlimaloIy,
llo boacon signaI roaclos llo rool compIox, causing an inlorrupl llal caIIs IM
soflvaro.
Somo form-faclor lypos roquiro supporl for llo boacon signaIIing for vaIing llo
syslom, vliIo ollors do nol. Tlo spocificalion roquiros compIianco vill llo spo-
cific form-faclor spocificalions, and doos nol roquiro boacon supporl for dovicos
usod in form-faclors nol roquiring llis supporl. Hovovor, for univorsaI ICI
Ixpross compononls (lloso dosignod for uso in a varioly of form-faclors) boacon
supporl is roquirod.
Soo Boacon SignaIing on pago 469 for dolaiIs.
WAKE# (AUX Power)
ICI Ixpross aIso providos a sidoband signaI caIIod WAKI#, as a aIlornalivo lo
boacon signaIing. Tlis signaI may bo roulod diroclIy lo llo Rool CompIox or
ollor mollorboard Iogic, lloroby causing an inlorrupl llal viII caII IM sofl-
varo. Ils aIso possibIo llal a lybrid impIomonlalion can bo usod. In llis caso,
WAKI# is sonl lo a svilcl, vlicl in lurn signaI boacon on ils upslroam porl.
Tlo oplions aro iIIuslralod in Iiguro 16-28 on pago 644 A and B. Nolo llal vlon
assorlod, llo WAKI# signaI romains Iov unliI llo IMI_Slalus bil is cIoarod by
soflvaro.
Tlis signaI musl bo impIomonlod by ATX or ATX-basod form faclor and by llo
minis. mollorboard connoclors and cards as voII as for llo mini-card form fac-
lor. No roquiromonl is spocifiod for omboddod dovicos lo uso llo WAKI# signaI.
-- -

AuxiIiary Power
Dovicos llal supporl IMI in llo D3
coId
slalo musl supporl llo vaIoup
soquonco (via boacon signaIing or llo sidoband WaIo# pin) and aro aIIovod lo
consumo llo maximum auxiIiary curronl of 375 mA (20mA maximum ollor-
viso). Tlo amounl of curronl llal lloy nood is roporlod via llo
fioId villin llo IM CapabiIily rogislors. AuxiIiary povor is onabIod vlon llo
bil is sol villin llo IMCSR rogislor. ICI-IM Iimils llo uso of Aux-
iIiary Curronl as spocifiod abovo.
ICI Ixpross oxlonds llo uso of auxiIiary povor boyond llo Iimilalions spocifiod
by ICI-IM. Nov dovicos llal lavo IMI disabIod or llal do nol supporl IMI
can aIso consumo llo maximum amounl of auxiIiary curronl aIIovod. Tlis nov
capabiIily is onabIod via soflvaro by solling llo bil in llo
Dovico ConlroI rogislor, iIIuslralod in Iiguro 16-29 on pago 645. Tlis capabiIily
pormils dovicos llo opporlunily lo supporl ollor funclions sucl as SM Bus
funclionaIily vliIo in a Iov povor slalo. As in ICI-IM llo amounl of curronl
consumod by a dovico is roporlod in llo fioId in llo IMC rogislor.
- -
Iarl Iivo
OplionaI Topics
649

The Previous Chapter
Tlo provious claplor providod a dolaiIod doscriplion of ICI Ixpross povor
managomonl, vlicl is compalibIo vill rovision 1.1 of llo -
and llo rovision 2.0
(ACII). In addilion ICI Ixpross dofinos oxlonsions llal aro orllogonaI lo llo
ICI-IM spocificalion. Tloso oxlonsions focus primariIy on IinI Iovor and IM
ovonl managomonl. Tlis claplor aIso providos an ovoraII conloxl for llo discus-
sion of povor managomonl, by incIuding a doscriplion of llo OnNov Inilialivo,
ACII, and llo invoIvomonl of llo Windovs OS is aIso providod.
This Chapter
ICI Ixpross incIudos nalivo supporl for lol pIug impIomonlalions. Tlis claplor
discussos lol pIug and lol romovaI of ICI Ixpross dovicos. Tlo spocificalion
dofinos a slandard usago modoI for aII dovico and pIalform form faclors llal
supporl lol pIug capabiIily. Tlo usago modoI dofinos, as an oxampIo, lov pusl
bullons and indicalors (IIDs) bolavo, if impIomonlod on llo classis, add-in
card or moduIo. Tlo dofinilions assignod lo llo indicalors and pusl bullons,
doscribod in llis claplor, appIy lo aII modoIs of lol pIug impIomonlalions.
The Next Chapter
Tlo noxl claplor providos an inlroduclion lo llo ICI Ixpross add-in card oIoc-
lromoclanicaI spocificalions. Il doscribos llo card form faclor, llo connoclor
dolaiIs, and llo auxiIiary signaIs vill a doscriplion of lloir funclion. Ollor card
form faclors aro aIso briofIy doscribod.
PCI Express System Architecture
650
Background
Somo sysloms llal ompIoy llo uso of ICI and ICI-X roquiro ligl avaiIabiIily or
non-slop oporalion. Ior oxampIo, many cuslomors roquiro compulor sysloms
llal oxporionco dovnlimos of jusl a fov minulos a yoar, or Ioss. CIoarIy, manu-
faclurors musl focus on oquipmonl roIiabiIily, and aIso provido a mollod of
idonlifying and ropairing oquipmonl faiIuros quicIIy. An imporlanl foaluro in
supporling lloso goaIs is llo Hol IIug/Hol Svap soIulions llal provido llroo
imporlanl capabiIilios:
1. a mollod of ropIacing faiIod oxpansion cards villoul lurning llo syslom off
2. Iooping llo O/S and ollor sorvicos running during llo ropair
3. slulling dovn and roslarling soflvaro associalod vill llo faiIod dovico
Irior lo llo vidosproad accoplanco of ICI many propriolary Hol IIug soIulions
voro avaiIabIo lo supporl llis lypo of romovaI and ropIacomonl of oxpansion
cards. Hovovor llo originaI ICI impIomonlalion vas nol dosignod lo supporl
lol romovaI and insorlion of cards, bul a slandardizod soIulion for supporling
llis capabiIily in ICI vas noodod. ConsoquonlIy, lvo major approaclos lo lol
ropIacomonl of ICI oxpansion dovicos lavo boon dovoIopod. Tloso approaclos
aro:
- Hol IIug ICI Card usod in IC Sorvor mollorboard and oxpansion clas-
sis impIomonlalions
- Hol Svap usod in CompaclICI sysloms basod on a passivo ICI bacI-
pIano impIomonlalion.
In boll soIulions, conlroI Iogic is impIomonlod lo isoIalo llo card Iogic from llo
ICI bus via oIoclronic svilclos. In conjunclion vill isoIalion Iogic, povor, rosol,
and cIocI aro conlroIIod lo onsuro an ordorIy povor dovn and povor up of
cards vlon lloy aro romovod and ropIacod. AIso, slalus and povor IIDs pro-
vido indicalions lo llo usor llal il is safo lo romovo or inslaII llo card.
Tlo nood lo oxlond lol pIug supporl lo ICI Ixpross cards is cIoar. Dosignors of
ICI Ixpross lavo incorporalod Hol romovaI and ropIacomonl of cards as a
nalivo foaluro. Tlo spocificalion dofinos configuralion rogislors, Hol IIug
Mossagos, and procoduros lo supporl Hol IIug soIulions.
Chapter 17: Hot Plug
651
Hot PIug in the PCI Express Environment
ICI Ixpross Hol IIug is dorivod from llo 1.0 rovision of llo Slandard Hol IIug
ConlroIIor spocificalion (SHIC 1.0) for ICI. Tlo goaIs of ICI Ixpross Hol IIug
aro lo:
- supporl llo samo Slandardizod Usago ModoI as dofinod by llo Slandard
Hol IIug ConlroIIor spocificalion. Tlis onsuros llal llo ICI Ixpross lol
pIug is idonlicaI from llo usor porspoclivo lo oxisling impIomonlalions
basod on llo SHIC 1.0 spocificalion
- supporl llo samo soflvaro modoI impIomonlod by oxisling oporaling sys-
loms. Hovovor, if llo OS incIudos a SHIC 1.0 compIianl drivor, il viII nol
vorI vill ICI Ixpross Hol IIug conlroIIors, vlicl lavo a difforonl pro-
gramming inlorfaco.
ICI Ixpross dofinos llo rogislors nocossary lo supporl llo inlogralion of a Hol
IIug ConlroIIor villin individuaI rool and svilcl porls. Undor Hol IIug sofl-
varo conlroI, lloso Hol IIug conlroIIors and llo associalod porl inlorfaco villin
llo rool or svilcl porl musl conlroI llo card inlorfaco signaIs lo onsuro ordorIy
povor dovn and povor up as cards aro romovod and ropIacod. Hol IIug con-
lroIIors musl:
- assorl and doassorl llo IIRST# signaI lo llo ICI Ixpross card connoclor
- romovo or appIy povor lo llo card connoclor.
- SoIoclivoIy lurn on or lurn off llo Iovor and Allonlion Indicalors associ-
alod vill a spocific card connoclor lo drav llo usors allonlion lo llo con-
noclor and advorliso vlollor povor is appIiod lo llo sIol.
- Monilor sIol ovonls (o.g. card romovaI) and roporl lloso ovonls lo soflvaro
via inlorrupls.
ICI Ixpross Hol-IIug (IiIo ICI) is dosignod as a no surprisos Hol-IIug moll-
odoIogy. In ollor vords, llo usor is nol pormillod lo inslaII or romovo a ICI
Ixpross card villoul firsl nolifying soflvaro. Syslom soflvaro llon proparos
boll llo card and sIol for llo cards romovaI and ropIacomonl, and finaIIy indi-
calos lo llo ond usor (via visuaI indicalors) slalus of llo lol pIug procoss and
nolificalion llal inslaIIalion or romovaI may bo porformod.
PCI Express System Architecture
652
Surprise RemovaI Notification
ICI Ixpross cards (unIiIo ICI) musl impIomonl llo odgo conlacls vill card
prosonco dolocl pins (IRSNT1# and IRSNT2#) llal broaI conlacl firsl (vlon llo
card is romovod from llo sIol). Tlis givos advancod nolico lo soflvaro of a sur-
priso romovaI and onougl limo lo romovo povor prior lo llo signaIs broaIing
conlacl.
Differences between PCI and PCI Express Hot PIug
Tlo oIomonls noodod lo supporl lol pIug aro ossonliaIIy llo samo bolvoon ICI
and ICI Ixpross lol pIug soIulions. Iiguro 17-1 on pago 653 dopicls llo ICI
lardvaro and soflvaro oIomonls roquirod lo supporl lol pIug. ICI soIulions
impIomonl a singIo slandardizod lol pIug conlroIIor on llo syslom board llal
pormils aII lol pIug sIols on llo bus lo bo conlroIIod by a singIo conlroIIor. AIso,
isoIalion Iogic is noodod in llo ICI onvironmonl lo oIoclricaIIy disconnocl a sin-
gIo card sIol from llo bus prior lo card romovaI.
ICI Ixpross Hol IIug diffors from llo ICI impIomonlalion duo lo poinl-lo-
poinl connoclions. (Soo Iiguro 17-2 on pago 654) Ioinl-lo-poinl connoclions
oIiminalo llo nood for isoIalion Iogic and pormil llo lol pIug conlroIIor lo bo
dislribulod lo oacl porl inlorfaco lo vlicl a connoclor is allaclod. A slandard-
izod soflvaro inlorfaco dofinod for oacl rool and svilcl porl pormils a slan-
dardizod soflvaro inlorfaco lo conlroI lol pIug oporalions. Nolo llal llo
programming inlorfaco for llo ICI Ixpross and ICI Hol IIug ConlroIIors vary
and roquiro difforonl soflvaro drivors.
Chapter 17: Hot Plug
653
-
PCI Express System Architecture
654
-- -
Chapter 17: Hot Plug
655
EIements Required to Support Hot PIug
Tlis soclion doscribos llo lardvaro and soflvaro oIomonls roquirod lo supporl
llo Hol IIug onvironmonl. Rofor lo Iiguro 17-2 on pago 654 during llis discus-
sion.
Software EIements
TabIo 17-1 on pago 655 doscribos llo major soflvaro oIomonls llal musl bo mod-
ifiod lo supporl Hol-IIug capabiIily. AIso rofor lo Iiguro 17-2 on pago 654.
-
-
Usor Inlorfaco OS vondor An OS-suppIiod uliIily llal pormils llo
ond-usor lo roquosl llal a card connoclor
bo lurnod off in ordor lo romovo a card
or lurnod on lo uso a card llal las jusl
boon inslaIIod.
Hol-IIug Sorvico OS vondor A sorvico llal procossos roquosls
(roforrod lo as Hol-IIug Irimilivos)
issuod by llo OS. Tlis incIudos roquosls
lo:
- provido sIol idonlifiors
- lurn card On or Off
- lurn Allonlion Indicalor On or Off
- rolurn curronl slalo of sIol (On or Off)
Tlo Hol-IIug Sorvico inloracls vill llo
Hol-IIug Syslom Drivor lo salisfy llo
roquosls. Tlo inlorfaco (i.o., AII) vill
llo Hol-IIug Syslom Drivor is dofinod
by llo OS vondor.
Slandardizod Hol-
IIug Syslom Drivor
Syslom Board
vondor or OS
Rocoivos roquosls (aIa Hol-IIug Irimi-
livos) from llo Hol-IIug Sorvico villin
llo OS. Inloracls vill llo lardvaro Hol-
IIug ConlroIIors lo accompIisl roquosls.
PCI Express System Architecture
656
A Hol-IIug-capabIo syslom may bo Ioadod vill an OS llal doosnl supporl
Hol-IIug capabiIily. In llis caso, aIllougl llo syslom BIOS vouId conlain Hol-
IIug-roIalod soflvaro, llo Hol-IIug Sorvico vouId nol bo prosonl. Assuming
llal llo usor doosnl allompl lol insorlion or romovaI of a card, llo syslom viII
oporalo as a slandard, non-Hol-IIug syslom.
- Tlo syslom slarlup firmvaro musl onsuro llal aII Allonlion Indicalors aro
Off.
- Tlo spoc aIso slalos: llo Hol-IIug sIols musl bo in a slalo llal vouId bo
approprialo for Ioading non-Hol-IIug syslom soflvaro.
Hardware EIements
TabIo 17-2 on pago 656 and Iiguro 17-2 on pago 654 iIIuslralo llo major lard-
varo oIomonls nocossary lo supporl ICI Ixpross Hol-IIug oporalion.
Dovico Drivor Adaplor card
vondor
Somo spociaI, Hol-IIug-spocific capabiIi-
lios musl bo incorporalod in a Hol-IIug
capabIo dovico drivor. Tlis incIudos:
- supporl for llo - command.
- oplionaI impIomonlalion of llo -
command.
- Supporl for command or
oplionaI - command.
-
-
Hol-IIug ConlroIIor Rocoivos and procossos commands issuod by llo
Hol-IIug - . Ono ConlroIIor is associ-
alod vill oacl rool or svilcl porl llal supporls
lol pIug oporalion. Tlo ICI Ixpross Spocificalion
dofinos a slandard soflvaro inlorfaco for llo Hol-
IIug ConlroIIor.
-
-
Chapter 17: Hot Plug
657

- - - -


-
- - - -- --
- - -

-
- - -
-
--
-
- - -


-- -
-
- - - --
- -
- - - --
-- -
- -
- - -
- - - -
--
-
-- --
-
- - -
- - - -
-

-
-
-
PCI Express System Architecture
658
Card RemovaI and Insertion Procedures
Tlo doscriplions of lypicaI card romovaI and insorlion llal foIIov aro inlondod
lo bo inlroduclory in naluro. AddilionaI dolaiI can bo found Ialor in llis claplor.
Il slouId bo nolod llal llo procoduros doscribod in llo foIIoving soclions
assumo llal llo OS, rallor llan llo Hol-IIug Syslom Drivor, is rosponsibIo for
configuring a novIy-inslaIIod dovico. If llo Hol-IIug Syslom Drivor las llis
rosponsibiIily, llo Hol-IIug Sorvico viII caII llo Hol-IIug Syslom Drivor and
inslrucl il lo configuro llo novIy-inslaIIod dovico.
On and Off States
Definition of On and Off
A sIol in llo On slalo las llo foIIoving claraclorislics:
- Iovor is appIiod lo llo sIol.
- RIICIK is on.
- Tlo IinI is aclivo or in llo slandby (I0s or I1 ) Iov povor slalo duo lo
Aclivo Slalo Iovor Managomonl.
- Tlo IIRST# signaI is doassorlod.
A sIol in llo Off slalo las llo foIIoving claraclorislics:
- Iovor lo llo sIol is lurnod off.
- RIICIK is off.
- Tlo IinI is inaclivo. (Drivor al llo rool of svilcl porl is in Hi Z slalo)
- Tlo IIRST# signaI is assorlod.
Turning SIot Off
Slops roquirod lo lurn off a sIol llal is curronlIy in llo On slalo:
1. Doaclivalo llo IinI. Tlis may invoIvo issuing a IIoclricaI IdIo ordorod sol (a
soquonco inilialod al llo IlysicaI Iayor llal forcos llo Cards drivor lo
onlor llo Hi Z slalo.
2. Assorl llo IIRST# signaI lo llo sIol.
3. Turn off RIICIK lo llo sIol.
4. Romovo povor from llo sIol.
Chapter 17: Hot Plug
659
Turning SIot On
Slops lo lurn on a sIol llal is curronlIy in llo off slalo:
1. AppIy povor lo llo sIol.
2. Turn on RIICIK lo llo sIol
3. Doassorl llo IIRST# signaI lo llo sIol. Tlo syslom musl mool llo solup and
loId liming roquiromonls (spocifiod in llo ICI Ixpross spoc) roIalivo lo llo
rising odgo of IIRST#.
Onco povor and cIocI lavo boon roslorod and IIRST# romovod, llo plysicaI
Iayors al boll porls viII porform IinI lraining and iniliaIizalion. Wlon llo IinI
is aclivo, llo dovicos viII iniliaIizo VC0 (incIuding fIov conlroI), maIing llo
IinI roady lo lransfor TIIs.
Card RemovaI Procedure
Wlon a card musl bo romovod, a numbor of slops musl occur lo nol onIy pro-
paro soflvaro and lardvaro for safo romovaI of llo card, bul aIso lo conlroI
indicalors llal provido visuaI ovidonco of llo roquosl lo romovo llo card boing
procossod. Tlo condilion of llo indicalors during normaI oporalion aro:
- Allonlion Indicalor (Ambor or YoIIov) Off during normaI oporalion.
- Iovor Indicalor (Groon) On during normaI oporalion
Soflvaro issuos Roquosls lo llo Hol IIug ConlroIIor via configuralion vrilo
lransaclions llal largol llo SIol ConlroI Rogislors impIomonlod by Hol-IIug
capabIo porls. Tloso roquosls conlroI povor lo llo sIol and llo slalo of llo indi-
calors.
Tlo oxacl soquonco of ovonls llal occur vlon porforming a Hol IIug card
romovaI vary sIigllIy doponding on vlollor llo Hol IIug oporalion is inilialod
by prossing llo Allonlion Bullon or via llo Usor Inlorfaco soflvaro uliIily. Iacl
soquonco is doscribod boIov.
Attention Button Used to Initiate Hot PIug RemovaI
Tlo soquonco of ovonls is as foIIovs:
1. Tlo oporalor inilialos llo card romovaI roquosl by doprossing llo sIols
allonlion bullon. Tlo Hol-IIug ConlroIIor dolocls llis ovonl and doIivors
an inlorrupl lo llo rool compIox. As a rosuIl of llo inlorrupl llo Hol IIug
PCI Express System Architecture
660
sorvico caIIs llo Hol IIug Syslom Drivor, vlicl roads sIol slalus informa-
lion and dolocls llo Allonlion Bullon roquosl.
2. Noxl, llo Hol-IIug Sorvico issuos a roquosl lo llo Hol-IIug Syslom Drivor
commanding llo Hol IIug ConlroIIor lo bIinI llo sIols Iovor Indicalor.
Tlo oporalor is granlod a 5 socond aborl inlorvaI, from llo limo llal llo
indicalors slarls lo bIinI, during vlicl llo oporalor may pross llo bullon a
socond limo lo aborl llo roquosl.
3. Tlo Iovor Indicalor conlinuos lo bIinI vliIo llo Hol IIug soflvaro vaIi-
dalos llo roquosl. Nolo llal soflvaro may faiI lo vaIidalo llo roquosl (o.g.,
llo card may curronlIy bo usod for somo crilicaI syslom oporalion).
4. If llo roquosl is vaIidalod, llo Hol-IIug Sorvico uliIily commands llo cards
dovico drivor lo quiosco. Tlal is, llo drivor musl slop issuing roquosls lo llo
card and compIolo or lorminalo aII oulslanding roquosls as voII as disabIo
ils abiIily lo gonoralo lransaclions (incIuding inlorrupl mossagos).
5. Soflvaro llon issuos a command lo disabIo llo cards IinI via llo IinI Con-
lroI rogislor villin llo rool or svilcl porl lo vlicl llo sIol is allaclod. Tlis
causos porls al boll onds of llo IinI lo bo disabIod.
6. Noxl, soflvaro commands llo Hol IIug ConlroIIor lo lurn llo sIol off.
7. IoIIoving succossfuI povor dovn soflvaro issuos llo Iovor Indicalor Off
Roquosl. Tlo oporalor Inovs llal llo card may bo romovod safoIy from llo
sIol vlon llo Iovor Indicalor is Off.
8. Tlo oporalor roIoasos llo MoclanicaI Rolonlion Ialcl, causing llo Hol IIug
ConlroIIor lo romovo aII svilclod signaIs from llo sIol (o.g., SMBus and
}TAG signaIs). Tlo card can nov bo romovod.
9. Tlo OS doaIIocalos llo momory spaco, IO spaco, inlorrupl Iino, olc. llal lad
boon assignod lo llo dovico and maIos lloso rosourcos avaiIabIo for assign-
monl lo ollor dovicos in llo fuluro.
If llo roquosl is nol vaIidalod, soflvaro viII dony llo roquosl and issuo a
command lo llo Hol IIug conlroIIor lo lurn llo Iovor Indicalor bacI ON.
Tlo spocificalion aIso rocommonds llal soflvaro nolify llo oporalor via a
mossago or by Iogging an onlry indicaling llo causo of llo roquosl doniaI.
Hot PIug RemovaI Request Issued via User Interface
Tlo soquonco of ovonls is as foIIovs:
1. Tlo oporalor inilialos llo card romovaI roquosl by soIocling llo IlysicaI
SIol numbor associalod vill llo card lo bo romovod. Soflvaro opons a vin-
dov or prosonls a mossago roquosling llo oporalor confirm llo roquosl.
Nolo llal llo Iovor Indicalor romains on during llis procoss.
2. Wlon llo oporalor confirms llo roquosl, llo Hol-IIug Sorvico issuos a
roquosl lo llo Hol-IIug Syslom Drivor commanding llo Hol IIug ConlroI-
Ior lo bIinI llo sIols Iovor Indicalor. During llis limo, soflvaro vaIidalos
Chapter 17: Hot Plug
661
llo Hol IIug roquosl. Nolo llal soflvaro may faiI lo vaIidalo llo roquosl
(o.g., llo card may curronlIy boing usod for somo crilicaI syslom opora-
lion).
3. If llo roquosl is vaIidalod, llo Hol-IIug Sorvico uliIily commands llo cards
dovico drivor lo quiosco. Tlal is, llo drivor musl slop issuing roquosls lo llo
card and compIolo or lorminalo aII oulslanding roquosls as voII as disabIo
ils abiIily lo gonoralo lransaclions (incIuding inlorrupl mossagos).
4. Soflvaro llon issuos a command lo disabIo llo cards IinI via llo IinI Con-
lroI rogislor Iocalod in llo rool or svilcl porl lo vlicl llo sIol connocls.
Tlis causos porls al boll onds of llo IinI lo bo disabIod.
5. Noxl, soflvaro commands llo Hol IIug ConlroIIor lo disabIo llo sIol.
6. IoIIoving succossfuI povor dovn soflvaro issuos llo Iovor Indicalor Off
Roquosl. Tlo oporalor Inovs llal llo card may bo romovod safoIy from llo
sIol vlon llo Iovor Indicalor is Off.
7. Tlo oporalor roIoasos llo ManuaI Rolonlion Ialcl (MRI), causing llo Hol
IIug ConlroIIor lo romovo aII svilclod signaIs from llo sIol (o.g., SMBus
and V
aux
signaIs). Tlo card can nov bo romovod.
8. Tlo OS doaIIocalos llo momory spaco, IO spaco, inlorrupl Iino, olc. llal lad
boon assignod lo llo dovico and maIos lloso rosourcos avaiIabIo for assign-
monl lo ollor dovicos in llo fuluro.
If llo roquosl is nol vaIidalod, soflvaro viII dony llo roquosl and issuo a
command lo llo Hol IIug conlroIIor lo lurn llo Iovor Indicalor bacI ON.
Tlo spocificalion aIso rocommonds llal soflvaro nolify llo oporalor via a
mossago or by Iogging an onlry indicaling llo causo of llo roquosl doniaI.
Card Insertion Procedure
Tlo procoduro for inslaIIing a nov card basicaIIy rovorsos llo slops Iislod for
card romovaI. Tlo foIIoving slops assumo llal llo card sIol vas Iofl in llo samo
slalo llal il vas in immodialoIy aflor a card vas romovod from llo connoclor (in
ollor vords, llo Iovor Indicalor is in llo Off slalo, indicaling llo sIol is roady
for card insorlion). Varialions bolvoon llo lvo mollods of inilialion aro
doscribod boIov.
Card Insertion Initiated by Pressing Attention Button
Tlo slops laIon lo Insorl and onabIo a card aro as foIIovs:
1. Tlo oporalor inslaIIs llo card and socuros llo MRI. If impIomonlod, llo
MRI sonsor viII signaI llo Hol-IIug ConlroIIor llal llo Ialcl is cIosod,
causing svilclod auxiIIary signaIs and V
aux
lo bo connoclod lo llo sIol.
PCI Express System Architecture
662
2. Noxl, llo oporalor nolifios llo Hol-IIug Sorvico llal llo card las boon
inslaIIod by prossing llo Allonlion Bullon. Tlis signaIs llo Hol IIug con-
lroIIor of llo ovonl, rosuIling in slalus rogislor bils boing sol and causing a
syslom inlorrupl lo bo sonl lo llo Rool CompIox. SubsoquonlIy, Hol IIug
soflvaro roads sIol slalus from llo porl and rocognizos llo roquosl.
3. Tlo Hol-IIug Sorvico issuos a roquosl lo llo Hol-IIug Syslom Drivor com-
manding llo Hol IIug ConlroIIor lo bIinI llo sIols Iovor Indicalor lo
inform llo oporalor llal llo card musl nol bo romovod. Tlo oporalor is
granlod a 5 socond aborl inlorvaI, from llo limo llal llo indicalors slarls lo
bIinI, lo aborl llo roquosl by prossing llo bullon a socond limo.
4. Tlo Iovor Indicalor conlinuos lo bIinI vliIo Hol IIug soflvaro vaIidalos
llo roquosl. Nolo llal soflvaro may faiI lo vaIidalo llo roquosl (o.g., llo
socurily poIicy sollings may prolibil llo sIol boing onabIod).
5. Tlo Hol-IIug Sorvico issuos a roquosl lo llo Hol-IIug Syslom Drivor com-
manding llo Hol IIug ConlroIIor lo lurn llo sIol on.
6. Onco povor is appIiod, soflvaro issuos a command lo lurn llo Iovor Indi-
calor ON.
7. Onco IinI lraining is compIolo, llo OS commands llo IIalform Configura-
lion Roulino lo configuro llo card funclion(s) by assigning llo nocossary
rosourcos.
8. Tlo OS Iocalos llo approprialo drivor(s) (using llo Vondor ID and Dovico
ID, or llo CIass Codo, or llo Subsyslom Vondor ID and Subsyslom ID con-
figuralion rogislor vaIuos as soarcl criloria) for llo funclion(s) villin llo
ICI Ixpross dovico and Ioads il (or llom) inlo momory.
9. Tlo OS llon caIIs llo drivors iniliaIizalion codo onlry poinl, causing llo
procossor lo oxoculo llo drivors iniliaIizalion codo. Tlis codo finislos llo
solup of llo dovico and llon sols llo approprialo bils in llo dovicos ICI
configuralion Command rogislor lo onabIo llo dovico.
If llo roquosl is nol vaIidalod, soflvaro viII dony llo roquosl and issuo a
command lo llo Hol IIug conlroIIor lo lurn llo Iovor Indicalor bacI OII.
Tlo spocificalion aIso rocommonds llal soflvaro nolify llo oporalor via a
mossago or by Iogging an onlry indicaling llo causo of llo roquosl doniaI.
Card Insertion Initiated by User Interface
Tlo slops laIon lo Ro-onabIo llo card aro as foIIovs:
1. Tlo oporalor inslaIIs llo card and socuros llo MRI. Tlo MRI sonsor signaIs
llo Hol IIug ConlroIIor lo connocl llo svilclod signaIs lo llo sIol.
2. Noxl, llo oporalor informs llo Hol-IIug Sorvico (via llo Hol IIug UliIily
program) llal llo card las boon inslaIIod and is roady lo bo ro-onabIod.
Soflvaro llon prompls llo usor lo vorify llal il is safo lo ro-onabIo llo sIol.
Chapter 17: Hot Plug
663
3. Aflor llo oporalor roquosls card insorlion, llo Hol-IIug Sorvico issuos a
roquosl lo llo Hol-IIug Syslom Drivor commanding llo Hol IIug ConlroI-
Ior lo bIinI llo sIols Iovor Indicalor lo inform llo oporalor llal llo card
musl nol bo romovod.
4. Tlo Iovor Indicalor conlinuos lo bIinI vliIo Hol IIug soflvaro vaIidalos
llo roquosl. Nolo llal soflvaro may faiI lo vaIidalo llo roquosl (o.g., llo
socurily poIicy sollings may bo prolibil llo sIol boing onabIod).
5. Tlo Hol-IIug Sorvico issuos a roquosl lo llo Hol-IIug Syslom Drivor com-
manding llo Hol IIug ConlroIIor lo roappIy povor lo llo sIol.
6. Onco povor is appIiod, soflvaro issuos a command lo lurn llo Iovor Indi-
calor ON.
7. Onco IinI lraining is compIolo, llo OS commands llo IIalform Configura-
lion Roulino lo configuro llo card funclion(s) by assigning llo nocossary
rosourcos.
8. Tlo OS Iocalos llo approprialo drivor(s) (using llo Vondor ID and Dovico
ID, or llo CIass Codo, or llo Subsyslom Vondor ID and Subsyslom ID con-
figuralion rogislor vaIuos as soarcl criloria) for llo funclion(s) villin llo
ICI Ixpross dovico and Ioads il (or llom) inlo momory.
9. Tlo OS llon caIIs llo drivors iniliaIizalion codo onlry poinl, causing llo
procossor lo oxoculo llo drivors iniliaIizalion codo. Tlis codo finislos llo
solup of llo dovico and llon sols llo approprialo bils in llo dovicos ICI
configuralion Command rogislor lo onabIo llo dovico.
If llo roquosl is nol vaIidalod, soflvaro viII dony llo roquosl and issuo a
command lo llo Hol IIug conlroIIor lo lurn llo Iovor Indicalor bacI OII.
Tlo spocificalion aIso rocommonds llal soflvaro nolify llo oporalor via a
mossago or by Iogging an onlry indicaling llo causo of llo roquosl doniaI.
Standardized Usage ModeI
Background
Sysloms basod on llo originaI 1.0 vorsion of llo ICI Hol IIug spocificalion
impIomonlod lardvaro and soflvaro dosigns llal variod vidoIy bocauso llo
spocificalion did nol dofino slandardizod rogislors or usor inlorfacos. Conso-
quonlIy, cuslomors vlo purclasod Hol IIug capabIo sysloms from difforonl
vondors voro confronlod vill a vido varialion in usor inlorfacos llal roquirod
rolraining oporalors vlon nov sysloms voro purclasod. Iurllormoro, ovory
board dosignor vas roquirod lo vrilo soflvaro lo manago lloir impIomonlalion-
spocific lol pIug conlroIIor. Tlo 1.0 rovision of llo ICI Hol-IIug ConlroIIor
(HIC) spocificalion dofinos:
PCI Express System Architecture
664
- a slandard usor inlorfaco llal oIiminalos rolraining of oporalors
- a slandard programming inlorfaco for llo lol pIug conlroIIor, vlicl por-
mils a slandardizod lol pIug drivor lo bo incorporalod inlo llo oporaling
syslom. ICI Ixpross impIomonls rogislors nol dofinod by llo HIC spocifica-
lion, lonco llo slandard Hol IIug ConlroIIor drivor impIomonlalions for
ICI and ICI Ixpross aro sIigllIy difforonl.
Tlo foIIoving soclions discuss llo slandard usor inlorfaco.
Standard User Interface
Tlo usor inlorfaco incIudos llo foIIoving foaluros:
- Allonlion Indicalor slovs llo allonlion slalo of llo sIol. Tlo indicalors
aro spocifiod lo bo on, off, or bIinIing. Tlo spocificalion dofinos llo bIinIing
froquoncy as 1 lo 2 Hz and 50 (+/- 5) duly cycIo. Tlo slalo of llis indica-
lor is slriclIy undor soflvaro conlroI.
- Iovor Indicalor (caIIod SIol Slalo Indicalor in ICI HI 1.1) slovs llo
povor slalus of llo sIol. Iovor indicalor slalos aro on, off, or bIinIing. Tlo
spocificalion dofinos llo bIinIing froquoncy as 1 lo 2 Hz and 50 (+/- 5)
duly cycIo. Tlis indicalor is conlroIIod by soflvaro, lovovor, llo spocifica-
lion pormils an oxcoplion in llo ovonl of a povor fauIl condilion.
- ManuaIIy Oporalod Rolonlion Ialcl and OplionaI Sonsor socuros card
villin sIol and nolifios llo syslom vlon llo Ialcl is roIoasod
- IIoclromoclanicaI InlorIocI (oplionaI) provonls card boing romovod
from a sIol vliIo povor is appIiod.
- Soflvaro Usor Inlorfaco aIIovs oporalor lo roquosl lol pIug oporalion
- Allonlion Bullon (oplionaI) aIIovs oporalor lo manuaIIy roquosl lol pIug
oporalion.
- SIol Numboring Idonlificalion providos visuaI idonlificalion of sIol on
llo board.
Attention Indicator
As monlionod in llo provious soclion, llo spocificalion roquiros llo syslom von-
dor lo incIudo an Allonlion Indicalor associalod vill oacl Hol-IIug sIol. Tlis
indicalor musl bo Iocalod in cIoso proximily lo llo corrosponding sIol and is
yoIIov or ambor in coIor. Tlis Indicalor dravs llo allonlion of llo ond usor lo
llo sIol duo lo llo lol pIug roquosl laving faiIod duo lo an oporalionaI probIom.
Tlo spocificalion maIos a cIoar dislinclion bolvoon oporalionaI and vaIidalion
orror and doos nol pormil llo allonlion indicalor lo roporl vaIidalion orrors. VaI-
idalion orrors aro probIoms doloclod and roporlod by soflvaro prior lo bogin-
Chapter 17: Hot Plug
665
ning llo lol pIug oporalion. Tlo bolavior of llo Allonlion Indicalor is Iislod in
TabIo 17-3 on pago 665.
Power Indicator
Tlo povor indicalor simpIy rofIocls llo slalo of main povor al llo sIol, and is
conlroIIod by Hol IIug soflvaro. Tlo coIor of llis indicalor is groon and is iIIu-
minalod vlon povor lo llo sIol is on.
Tlo spocificalion spocificaIIy prolibils Rool or svilcl porl lardvaro lo clango
llo povor indicalor slalo aulonomousIy as a rosuIl of povor fauIl or ollor
ovonls. A singIo oxcoplion lo llis ruIo aIIovs a pIalform impIomonlalion llal is
capabIo of dolocling slucI-on povor fauIls. A slucI-on fauIl is simpIy a condi-
lion in vlicl commands issuod lo romovo sIol povor aro inoffoclivo. If llo sys-
lom is dosignod lo dolocl llis condilion llo syslom may ovorrido llo rool or
svilcl porls command lo lurn llo povor indicalor off and forco il lo llo on
slalo. Tlis nolifios llo oporalor llal llo card slouId nol bo romovod from llo
sIol ovon llougl llo oporalor las roquoslod llo sIol lo bo povorod dovn. Tlo
spocificalion furllor slalos llal supporling slucI-on fauIls is oplionaI and if
landIod via syslom soflvaro llo pIalform vondor musl onsuro llal llis
oplionaI foaluro of llo Slandard Usago ModoI is addrossod via ollor soflvaro,
pIalform documonlalion, or by ollor moans.
Tlo bolavior of llo povor indicalor and llo roIalod povor slalos aro Iislod in
TabIo 17-4 on pago 666. Nolo llal V
aux
romains on and svilcl signaIs aro sliII
connoclod unliI llo rolonlion Ialcl is roIoasod or vlon llo card is romovod as
doloclod by llo Irsnl1# and Irsnl2# signaIs.


Off NormaI NormaI Oporalion
On Allonlion Hol IIug Oporalion IaiIod duo lo an opor-
alionaI probIom (o.g., probIoms vill oxlornaI cabIing,
add-in cards, soflvaro drivors, and povor fauIls)
BIinIing Iocalo SIol is boing idonlifiod al oporalors roquosl
PCI Express System Architecture
666
ManuaIIy Operated Retention Latch and Sensor
Tlo ManuaI Rolonlion Ialcl (MRI) is roquirod and il loIds ICI Ixpross cards
rigidIy in llo sIol. Iacl MRI can impIomonl an oplionaI sonsor llal nolifios llo
Hol-IIug ConlroIIor llal llo Ialcl las boon cIosod or oponod. Tlo spocificalion
aIso aIIovs a singIo Ialcl llal can loId dovn muIlipIo cards. Sucl impIomonla-
lions do nol supporl llo MRI sonsor.
An MRI Sonsor is a Svilcl, oplicaI dovico, or ollor lypo of sonsor. Tlo sonsor
roporls onIy lvo condilions: fuIIy cIosod and opon. If an unoxpoclod Ialcl
roIoaso is doloclod, llo porl aulomalicaIIy disabIos llo sIol and nolifios syslom
soflvaro. Nolo lovovor, llal llo spocificalion prolibils porls from clanging llo
slalo of llo Iovor or Allonlion indicalors aulonomousIy.
Tlo svilclod signaIs and auxiIIary povor (Vaux) musl bo aulomalicaIIy
romovod from llo sIol vlon llo MRI Sonsor indicalos llal llo MRI is opon and
musl bo roslorod lo llo sIol vlon llo MRI Sonsor indicalos llal llo Ialcl is ro-
oslabIislod. Tlo svilclod signaIs aro:
- V
aux
- SMBCIK
- SMBDAT
Tlo spocificalion aIso doscribos an aIlornalo mollod for romoving V
aux
and
SMBus povor vlon an MRI sonsor is nol prosonl. In llis caso, llo IRSNT#1
and IRSNT#2 pins, vlicl indicalo vlollor a card is inslaIIod inlo llo sIol, can
bo usod lo lriggor llo porl lo romovo llo svilclod signaIs.


Off Iovor Off il is safo lo romovo or insorl a card. AII povor
las boon romovod as roquirod for lol pIug oporalion. Vaux is
onIy romovod vlon llo ManuaI Rolonlion Ialcl is roIoasod.
On Iovor On romovaI or insorlion of a card is nol aIIovod.
Iovor is curronlIy appIiod lo llo sIol.
BIinIing Iovor Transilion card romovaI or insorlion is nol aIIovod.
Tlis slalo nolifios llo oporalor llal soflvaro is curronlIy
romoving or appIying sIol povor in rosponso lo a lol pIug
roquosl.
Chapter 17: Hot Plug
667
EIectromechanicaI InterIock (optionaI)
Tlo oplionaI oIoclromoclanicaI card inlorIocI moclanism providos a moro
soplislicalod mollod of onsuring llal a card is nol romovod vlon povor is sliII
appIiod lo llo sIol. Tlo spocificalion doos nol dofino llo spocific naluro of llo
inlorIocI, bul slalos llal il can plysicaIIy IocI llo add-in card or IocI llo MRI
in pIaco.
Tlo IocI moclanism is conlroIIod via soflvaro, lovovor, lloro is no spocific
programming inlorfaco dofinod lo conlroI llo oIoclromoclanicaI inlorIocI.
Insload an inlorIocI is conlroIIod by llo samo porl oulpul signaI llal onabIos
main povor lo llo sIol.
Software User Interface
An oporalor may uso a soflvaro inlorfaco lo roquosl card romovaI or insorlion.
Tlis inlorfaco is providod by syslom soflvaro, vlicl aIso monilors sIols and
roporls slalus informalion lo llo oporalor. Tlo spocificalion slalos llal llo usor
inlorfaco is impIomonlod by llo Oporaling Syslom and consoquonlIy is boyond
llo scopo of llo spocificalion.
Tlo oporalor musl bo abIo lo inilialo oporalions al oacl sIol indopondonl of aII
ollor sIols. ConsoquonlIy, llo oporalor may inilialo a lol-pIug oporalion on ono
sIol using llo soflvaro usor inlorfaco or allonlion bullon vliIo a lol-pIug opor-
alion on anollor sIol is in procoss. Tlis can bo dono rogardIoss of vlicl inlor-
faco llo oporalor usod lo slarl llo firsl Hol-IIug oporalion.
Attention Button
Tlo Allonlion Bullon is a momonlary-conlacl pusl-bullon svilcl, Iocalod noar
llo corrosponding Hol-IIug sIol or on a moduIo. Tlo oporalor prossos llis bul-
lon lo inilialo a lol-pIug oporalion for llis sIol (o.g., card romovaI or insorlion).
Onco llo Allonlion Bullon is doprossod, llo Iovor Indicalor slarls lo bIinI.
Irom llo limo llo bIinIing bogins llo oporalor las 5 soconds lo aborl llo Hol
IIug oporalion by doprossing llo bullon a socond limo.
Tlo spocificalion rocommonds llal if an oporalion inilialod by an Allonlion Bul-
lon faiIs, llo syslom soflvaro slouId nolify llo oporalor of llo faiIuro. Ior
oxampIo, a mossago oxpIaining llo naluro of llo faiIuro can bo roporlod or
Ioggod.
PCI Express System Architecture
668
SIot Numbering Identification
Soflvaro and oporalors musl bo abIo lo idonlify a plysicaI sIol basod on ils sIol
numbor. Iacl lol-pIug capabIo porl musl impIomonl rogislors llal soflvaro
usos lo idonlify llo plysicaI sIol numbor. Tlo rogislors incIudo a IlysicaI SIol
numbor and a classis numbor. Tlo main classis is aIvays IaboIod classis 0. Tlo
classis numbor for ollor classis musl bo a non-zoro vaIuo and aro assignod via
llo ICI-lo-ICI bridgos Classis Numbor rogislor (Inlroduclion To Classis/
SIol Numboring Rogislors on pago 859).
Standard Hot PIug ControIIer SignaIing Interface
Iiguro 17-3 on pago 669 roprosonls a moro dolaiIod viov of llo Iogic villin rool
and svilcl porls, aIong vill llo signaIs roulod bolvoon llo sIol and porl. Tlo
imporlanco of llo slandardizod Hol IIug ConlroIIor is llo common soflvaro
inlorfaco llal aIIovs llo dovico drivor lo bo inlogralod inlo oporaling sysloms.
Tlo ICI Ixpross spocificalion in conjunclion vill llo Card IIoclroMoclanicaI
(CIM) spocificalion dofino llo sIol signaIs and llo supporl roquirod for Hol
IIug ICI Ixpross. IoIIoving is a Iisl of roquirod and oplionaI porl inlorfaco sig-
naIs noodod lo supporl llo Slandard Usago ModoI:
- IWRIID# (roquirod) porl oulpul llal conlroIs slalo of Iovor Indicalor
- ATNIID# (roquirod) porl oulpul conlroIs slalo of Allonlion Indicalor
- IWRIN (roquirod, if roforonco cIocI is impIomonlod) porl oulpul llal
conlroIs main povor lo sIol
- RIICIKIN# (roquirod) porl oulpul llal conlroIs doIivory of roforonco
cIocI lo llo sIol
- IIRST# (roquirod) porl oulpul llal conlroIs IIRST# al sIol
- IRSNT1# (roquirod) Groundod al llo connoclor
- and IRSNT2# (roquirod) porl inpul indicalos prosonco of card in sIol.
AIso puIIod up on syslom board
- IWRIIT# (roquirod) porl inpul llal nolifios llo Hol-IIug conlroIIor of a
povor fauIl condilion doloclod by oxlornaI Iogic
- AUXIN#(roquirod, if AUX povor is impIomonlod) porl oulpul llal con-
lroIs svilclod AUX signaIs and AUX povor lo sIol vlon MRI is oponod
and cIosod. Tlo MRI# signaI is roquirod vill AUX povor is prosonl.
- MRI# (roquirod if MRI Sonsor is impIomonlod, ollorviso ils oplionaI)
porl inpul from llo MRI sonsor
- BUTTON# (roquirod if Allonlion Bullon is impIomonlod, ollorviso ils
oplionaI) porl inpul indicaling oporalor vislos lo porform a Hol-IIug
oporalion
Chapter 17: Hot Plug
669
-
PCI Express System Architecture
670
The Hot-PIug ControIIer Programming Interface
Tlo slandard programming inlorfaco lo llo Hol-IIug ConlroIIor is providod via
llo ICI Ixpross CapabiIily rogislor bIocI. Iiguro 17-4 on pago 670 iIIuslralos
lloso rogislors and liglIiglls llo rogislors llal aro impIomonlod by llo difforonl
lypos of dovicos. Hol IIug foaluros aro primariIy providod via SIol Rogislors
llal aro dofinod for rool and svilcl porls. Tlo Dovico CapabiIily rogislor is aIso
usod in somo impIomonlalions as doscribod Ialor in llis claplor.
SIot CapabiIities
Iiguro 17-5 on pago 671 iIIuslralos llo sIol capabiIily rogislor and bil fioIds.
Hardvaro musl iniliaIizo llo capabiIily rogislor fioIds lo rofIocl llo foaluros
impIomonlod by llis porl. Tlis rogislor appIios lo boll card sIols and racI
mounl impIomonlalions, oxcopl for llo indicalors and allonlion bullon. Sofl-
varo musl road from llo dovico capabiIily rogislor villin llo moduIo lo dolor-
mino if indicalors and allonlion bullons aro impIomonlod. TabIo 17-5 on
pago 671 Iisls and dofinos llo sIol capabiIily fioIds.
-- -- -
Chapter 17: Hot Plug
671
- - -
- - --
- - -
0 - vlon sol, indicalos llal an allonlion bullon is
Iocalod on llo classis adjaconl lo llo sIol.
1 - vlon sol, indicalos llal a povor conlroIIor is
impIomonlod for llis sIol.
2 - - vlon sol, indicalos llal a MRI Sonsor is Iocalod
on llo sIol.
3 - vlon sol, indicalos llal an allonlion indi-
calor is Iocalod on llo classis adjaconl lo llo sIol.
4 - vlon sol, indicalos llal a povor indicalor is
Iocalod on llo classis adjaconl lo llo sIol.
PCI Express System Architecture
672
SIot Power Limit ControI
Tlo spocificalion providos a mollod for soflvaro lo Iimil llo amounl of povor
consumod by a card inslaIIod inlo an oxpansion sIol or bacIpIano impIomonla-
lion. Tlo rogislors noodod lo supporl llis foaluro aro incIudod in llo lol pIug
capabIo porl villin llo SIol CapabiIily rogislor and villin llo oxpansion card
or moduIo villin llo dovico capabiIily rogislor.
SIot ControI
Soflvaro conlroIs llo Hol IIug ovonls via llo SIol ConlroI rogislor. Tlis rogislor
pormils soflvaro lo onabIo various Hol IIug foaluros and lo conlroI lol pIug
oporalions. Iiguro 17-6 on pago 673 dopicls llo sIol conlroI rogislor and bil
fioIds. TabIo 17-6 on pago 673 Iisls and doscribos oacl fioId. Tlis rogislor acls as
llo programming inlorfaco lo conlroI various Hol-IIug foaluros and lo onabIo
inlorrupl gonoralion as voII as onabIing llo sourcos of Hol-IIug ovonls llal can
rosuIl in inlorrupl gonoralion.
5 - vlon sol, indicalos llal il is possibIo llal llo usor
can romovo llo card from llo syslom villoul nolificalion.
6 vlon sol, indicalos llal llis sIol supporls lol pIug
oporalion.
14:7 spocifios llo maximum povor llal can bo sup-
pIiod by llis sIol. Tlis Iimil vaIuo is muIlipIiod by llo scaIo spocifiod in llo
noxl fioId.
16:15 spocifios llo scaIing faclor for llo SIol Iovor
Iimil VaIuo.
31:19 I- Indicalos llo plysicaI sIol numbor associalod
vill llis porl.
- - --
- - -
Chapter 17: Hot Plug
673
- -
- - --
- - -
0 -- Wlon sol, llis bil onabIos llo gonora-
lion of a lol-pIug inlorrupl (if onabIod) or assorlion of llo WaIo# mos-
sago, vlon llo allonlion bullon is prossod.
1 Wlon sol, onabIos gonoralion of a lol-pIug
inlorrupl (if onabIod) or WaIo# mossago upon doloclion of a povor fauIl.
2 - Wlon sol, onabIos gonoralion of a lol-
pIug inlorrupl or WaIo# (if onabIod) mossago upon doloclion of a MRI
sonsor clangod ovonl.
3 - Wlon sol llis bil onabIos llo gonora-
lion of llo lol-pIug inlorrupl or a WaIo mossago vlon llo prosonco
dolocl clangod bil in llo SIol Slalus rogislor is sol.
PCI Express System Architecture
674
SIot Status and Events Management
Tlo Hol IIug ConlroIIor monilors a varioly of ovonls and roporls lloso ovonls lo
llo Hol IIug Syslom Drivor. Soflvaro can uso llo doloclod bils lo dolormino
vlicl ovonl las occurrod, vliIo llo slalus bil idonlifios llal naluro of llo
clango. Tlo clangod bils musl bo cIoarod by soflvaro in ordor lo dolocl a subso-
quonl clango. Nolo llal vlollor lloso ovonls gol roporlod lo llo syslom (via a
syslom inlorrupl) is dolorminod by llo roIalod onabIo bils in llo SIol ConlroI
Rogislor.
4 Wlon sol, onabIos a Hol- IIug
inlorrupl lo bo gonoralod llal informs soflvaro llal llo lol-pIug conlroI-
Ior is roady lo rocoivo llo noxl command.
5 Wlon sol, onabIos llo gonoralion of Hol-IIug
inlorrupls.
6 Wrilos lo llo fioId conlroI llo slalo of llo
allonlion indicalor and roads rolurn llo curronl slalo, as foIIovs:
- 00b = Rosorvod
- 01b = On
- 10b = BIinI
- 11b = Off
7 Wrilos lo llo fioId conlroI llo slalo of llo povor
indicalor and roads rolurn llo curronl slalo, as foIIovs:
- 00b = Rosorvod
- 01b = On
- 10b = BIinI
- 11b = Off
8 Wrilos lo llo fioId svilcl main povor lo llo
sIol and roads rolurn llo curronl slalo, as foIIovs:
- 0b = Iovor On
- 1b = Iovor Off
- - --
- - -
Chapter 17: Hot Plug
675
- - -
- - - --

- -
0 -- sol vlon llo Allonlion Bullon is
prossod. Nolificalion of llo allonlion bullon boing puslod doponds
on llo form-faclor impIomonlod:
- slandard card sIols uso a signaI lraco lo roporl llo ovonl
- racI and bacIpIano impIomonlalions may roIy on llo
Allonlion_Bullon_Irossod mossago.
- rofor lo ollor form-faclor spocs for dolaiIs rogarding lloso
impIomonlalions.
1 sol vlon llo Iovor ConlroIIor dolocls a
povor fauIl al llis porl.
2 - sol vlon a MRI Sonsor slalo clango is
doloclod.
PCI Express System Architecture
676
Card SIot vs Server IO ModuIe ImpIementations
ICI Ixpross supporls lvo form faclors llal dolormino llo Iocalion of llo Hol-
IIug indicalors and allonlion bullon (Soo Iiguro 17-8 on pago 677):
- Slandard Cards llal rosido in ICI-IiIo sIols mollorboard or oxpansion
classis impIomonlalions pIaco Hol IIug indicalors, llo allonlion bullon,
and MRI sonsor adjaconl lo oacl sIol on llo board.
- Sorvor IO ModuIos (SIOMs) llal inslaII inlo racIs vlon moduIos aro
inslaIIod inlo a racI-mounlod syslom llo lol-pIug indicalors and allonlion
bullon may bo Iocalod moro convonionlIy on llo ICI Ixpross moduIos as
opposod lo a RacI. Hovovor llo spocificalion doos nol procIudo llo possi-
biIily of indicalors and bullons boing Iocalod on moduIo bays.
3 - sol vlon a clango las boon doloclod in
llo slalo of llo Irsnl1# or Irsnl2# signaIs.
4 sol vlon llo Hol IIug ConlroIIor com-
pIolos a soflvaro command.
5 - vlon sol, indicalos llo curronl slalo of llo
MRI sonsor, if impIomonlod.
0b = MRI CIosod
1b = MRI Opon
6 - llis bil rofIocls vlollor a card is inslaIIod
inlo a sIol or nol (sol if card prosonl, cIoar if card nol prosonl). Il is
roquirod for aII rool and svilcl porls llal lavo a sIol allaclod lo llo
IinI. Tlo spocificalion aIso slalos llal if a sIol is nol allaclod lo llo
IinI, llon llis bil slouId bo lardvirod lo 1.
- - - --

- -
Chapter 17: Hot Plug
677
In addilion lo Sorvor IO ModuIos, cards (or bIados) llal inslaII inlo bacIpIanos
may aIso lavo indicalors and llo allonlion bullon Iocalod on llo card. Tloso
impIomonlalions voro nol dofinod al llo limo of llis vriling. Hovovor, pro-
poslod SIOM impIomonlalions roulo llo allonlion bullon and allonlion indica-
lor signaIs llrougl llo connoclor.
Tlo spocificalion aIso dofinos mossagos llal acl as virluaI viros for conlroIIing
llo allonlion indicalors and for roporling vlon llo allonlion bullon las boon
prossod. Tlo approacl oIiminalos llo nood lo roulo signaIs bolvoon llo porl
and connoclor for llo allonlion indicalors and allonlion bullon, as dono vill
card sIols as iIIuslralod in Iiguro 17-3 on pago 669. Soo Hol IIug Mossagos on
pago 678.
-
PCI Express System Architecture
678
Detecting ModuIe and BIade CapabiIities
Hol-IIug porls llal allacl lo racI and bacIpIano connoclors may nol Inov
vlollor a givon moduIo or bIado incIudos indicalors or an allonlion bullon.
ConsoquonlIy, llo spocificalion incIudos llis informalion villin llo Dovico
CapabiIilios rogislor. Soo Iiguro 17-9 on pago 678.
Hot PIug Messages
Wlon llo Hol-IIug indicalors and allonlion bullon aro Iocalod on a moduIo or
bIado, mossagos can bo usod as virluaI viros lo conlroI llo indicalors and lo
roporl llal llo bullon las boon prossod.
--- As discussod in
TabIo 17-6 on pago 673, llo allonlion and povor indicalors oacl lavo llroo
slalos: on, off, and bIinIing. Tlo mossago lransaclions acl as virluaI viros lo
signaI llo allonlion indicalor slalo. Iiguro 17-10 on pago 680 iIIuslralos llo
Hol IIug Mossago formal and Iisls llo vaIuos associalod vill oacl of llo
mossagos.
- -
Chapter 17: Hot Plug
679
- Tlis mossago is issuod by llo Hol IIug Con-
lroIIor vlon soflvaro vrilos a vaIuo of 01b inlo llo Allonlion Indicalor
ConlroI fioId of llo SIol ConlroI Rogislor indicaling llal llo Allonlion
Indicalor is lo bo lurnod on. Tlo ondpoinl dovico llal rocoivos llo mos-
sago lorminalos il and causos llo cards allonlion indicalor lo lurn on.
- Tlis mossago is issuod by llo Hol IIug
ConlroIIor vlon soflvaro vrilos a vaIuo of 10b inlo llo Allonlion Indi-
calor ConlroI fioId of llo SIol ConlroI Rogislor indicaling llal llo Allon-
lion Indicalor is lo bIinI on and off. Tlo ondpoinl dovico llal rocoivos
llo mossago lorminalos il and causos llo card's allonlion indicalor lo
slarl bIinIing.
- . Tlis mossago is issuod by llo Hol IIug Con-
lroIIor vlon soflvaro vrilos a vaIuo of 11b inlo llo Allonlion Indicalor
ConlroI fioId of llo SIol ConlroI Rogislor indicaling llal llo Allonlion
Indicalor is lo bo lurnod off. Tlo ondpoinl dovico llal rocoivos llo mos-
sago lorminalos il and causos llo cards indicalor lo lurn off.
- . Tlis mossago is issuod by llo Hol IIug ConlroI-
Ior vlon soflvaro vrilos a vaIuo of 01b inlo llo Iovor Indicalor Con-
lroI fioId of llo SIol ConlroI Rogislor indicaling llal llo Iovor Indicalor
is lo bo lurnod on. Tlo ondpoinl dovico llal rocoivos llo mossago lor-
minalos il and causos llo cards povor indicalor lo lurn on.
- Tlis mossago is issuod by llo Hol IIug Con-
lroIIor vlon soflvaro vrilos a vaIuo of 10b inlo llo Iovor Indicalor
ConlroI fioId of llo SIol ConlroI Rogislor indicaling llal llo Iovor Indi-
calor is lo bIinI on and off. Tlo ondpoinl dovico llal rocoivos llo mos-
sago lorminalos il and causos llo povor indicalor lo bIinI.
- . Tlis mossago is issuod by llo Hol IIug ConlroI-
Ior vlon soflvaro vrilos a vaIuo of 11b inlo llo Iovor Indicalor Con-
lroI fioId of llo SIol ConlroI Rogislor indicaling llal llo Iovor Indicalor
is lo bo lurnod off. Tlo ondpoinl dovico llal rocoivos llo mossago lormi-
nalos il and causos llo cards povor indicalor lo lurn off.
-- -- A moduIo or bIado llal ompIoys an
allonlion bullon musl signaI llo Hol IIug ConlroIIor llal llo bullon las
boon prossod. Tlo moduIo gonoralos an Allonlion_Bullon_Irossod mossago
(Iiguro 17-10 on pago 680) llal largols llo upslroam dovico (rool or svilcl
porl). Tlo mossago rosuIls in an Allonlion Bullon Irossod Ivonl llal causos
llo -- slalus bil in llo SIol Slalus rogislor bil lo bo sol,
and may aIso rosuIl in an inlorrupl if onabIod.
- --- Nolo llal lloso foaluros func-
lion onIy vlon llo card is inslaIIod and oporalionaI. Tlus, indicalors can bo
conlroIIod prior lo card romovaI and simiIarIy llo card can roporl llal llo
PCI Express System Architecture
680
allonlion bullon las boon prossod (o.g., lo signaI a roquosl for card
romovaI). Hovovor, vlon a nov card is inslaIIod, llo allonlion bullon mos-
sago cannol bo sonl from llo card and allonlion indicalor mossagos cannol
bo rocoivod unliI llo card is ro-povorod, roconfigurod, and onabIod. Tlis
moans llal soflvaro viII lavo lo bo nolifiod llal a card is roady lo bo ro-
inslaIIod.
--
Chapter 17: Hot Plug
681
SIot Numbering
PhysicaI SIot ID
An oporalor vlo vislos lo proparo a sIol for card romovaI or insorlion musl
spocify llo IlysicaI SIol ID. Tlo plysicaI sIol numbor is dosignalod by llo sys-
lom dosignor and llis assignmonl musl bo communicalod lo llo Rool or Svilcl
porl. Tlis is roquirod bocauso lardvaro musl iniliaIizo llo IlysicaI SIol ID sla-
lus bil villin llo SIol Slalus Rogislor. Wlon configuralion accossos aro mado lo
road llo plysicaI sIol ID soflvaro maIos an associalion bolvoon llo IogicaI SIol
ID (Bus# and Dovico #) and plysicaI SIol ID.
Quiescing Card and Driver
GeneraI
Irior lo romoving a card from llo syslom, lvo llings musl occur:
1. Tlo dovicos drivor musl coaso accossing llo card.
2. Tlo card musl coaso gonoralion lransaclion and inlorrupls.
Hov llis is accompIislod is OS-spocific, bul llo foIIoving musl laIo pIaco:
- Tlo OS musl slop issuing nov roquosls lo llo dovicos drivor or musl
inslrucl llo drivor lo slop accopling nov roquosls.
- Tlo drivor musl lorminalo or compIolo aII oulslanding roquosls.
- Tlo card musl bo disabIod from gonoraling inlorrupls or lransaclions.
Wlon llo OS commands llo drivor lo quiosco ilsoIf and ils dovico, llo OS musl
nol oxpocl llo dovico lo romain in llo syslom (in ollor vords, il couId bo
romovod and nol ropIacod vill a simiIar card).
Pausing a Driver (OptionaI)
OplionaIIy, an OS couId impIomonl a Iauso capabiIily lo lomporariIy slop
drivor aclivily in llo oxpoclalion llal llo samo card or a simiIar card viII bo
roinsorlod. If llo card is nol roinslaIIod villin a roasonabIo amounl of limo,
lovovor, llo drivor musl bo quioscod and llon romovod from momory.
PCI Express System Architecture
682
A card may bo romovod and an idonlicaI card inslaIIod in ils pIaco. As an oxam-
pIo, llis couId bo bocauso llo curronlIy-inslaIIod card is bad or is boing ropIacod
vill a Ialor rovision as an upgrado. If il is inlondod llal llo oporalion appoar
soamIoss from a soflvaro and oporalionaI porspoclivo, llo drivor vouId lavo lo
quiosco, savo llo curronl dovicos conloxl (i.o., llo conlonls of aII of ils rogislors,
olc.). Tlo nov card vouId llon bo inslaIIod, llo conloxl roslorod, and normaI
oporalion vouId rosumo. Il slouId bo nolod llal if llo oId card lad faiIod, il
may or may nol bo possibIo lo lavo llo oporalion appoar soamIoss.
Quiescing a Driver That ControIs MuItipIe Devices
If a drivor conlroIs muIlipIo cards and il rocoivos a command from llo OS lo
quiosco ils aclivily vill rospocl lo a spocific card, il musl onIy quiosco ils acliv-
ily vill llal card as voII as quioscing llo card ilsoIf.
Quiescing a FaiIed Card
If a card las faiIod, il may nol bo possibIo for llo drivor lo compIolo roquosls
proviousIy issuod lo llo card. In llis caso, llo drivor musl dolocl llo orror and
musl lorminalo llo roquosls villoul compIolion and allompl lo rosol llo card.
The Primitives
Tlis soclion discussos llo lol-pIug soflvaro oIomonls and llo informalion
passod bolvoon llom. Ior a roviov of llo soflvaro oIomonls and lloir roIalion-
slips lo oacl ollor, rofor lo TabIo 17-1 on pago 655. Communicalions bolvoon
llo Hol-IIug Sorvico villin llo OS and llo Hol-IIug Syslom Drivor is in llo
form of roquosls. Tlo spoc doosnl dofino llo oxacl formal of lloso roquosls, bul
doos dofino llo basic roquosl lypos and lloir conlonl. Iacl roquosl lypo issuod
lo llo Hol-IIug Syslom Drivor by llo Hol-IIug Sorvico is roforrod lo as a
. Tloy aro Iislod and doscribod in TabIo 17-8 on pago 682.
-
- -
Quory Hol-IIug
Syslom Drivor
: Nono Roquosls llal llo Hol-IIug Syslom
Drivor rolurn a sol of IogicaI SIol
IDs for llo sIols il conlroIs.
: Sol of IogicaI SIol
IDs for sIols conlroIIod by
llis drivor.
Chapter 17: Hot Plug
683
Sol SIol Slalus -:
- IogicaI SIol ID
- Nov sIol slalo (on or
off).
- Nov Allonlion Indica-
lor slalo.
- Nov Iovor Indicalor
slalo.
Tlis roquosl is usod lo conlroI llo
sIols and llo Allonlion Indicalor
associalod vill oacl sIol. Good
compIolion of a roquosl is indicalod
by rolurning llo Slalus Clango Suc-
cossfuI paramolor. If a fauIl is
incurrod during an allomplod slalus
clango, llo Hol-IIug Syslom Drivor
slouId rolurn llo approprialo fauIl
mossago (soo middIo coIumn).
UnIoss ollorviso spocifiod, llo card
slouId bo Iofl in llo off slalo.
: Roquosl compIo-
lion slalus:
- slalus clango succossfuI
- fauIlvrong froquoncy
- fauIlinsufficionl
povor
- fauIlinsufficionl con-
figuralion rosourcos
- fauIlpovor faiI
- fauIlgonoraI faiIuro
Quory SIol
Slalus
: IogicaI SIol ID Tlis roquosl rolurns llo slalo of llo
indicalod sIol (if a card is prosonl).
Tlo Hol-IIug Syslom Drivor musl
rolurn llo SIol Iovor slalus infor-
malion.
:
- SIol slalo (on or off)
- Card povor roquiro-
monls.
Async Nolico of
SIol Slalus
Clango
: IogicaI SIol ID Tlis is llo onIy primilivo (dofinod
by llo spoc) llal is issuod lo llo
Hol-IIug Sorvico by llo Hol-IIug
Syslom Drivor. Il is sonl vlon llo
Drivor dolocls an unsoIicilod
clango in llo slalo of a sIol. Ixam-
pIos vouId bo a run-limo povor
fauIl or card inslaIIod in a provi-
ousIy-omply sIol vill no varning.
: nono
-
- -
685
-
-
The Previous Chapter
ICI Ixpross incIudos nalivo supporl for lol pIug impIomonlalions. Tlo provi-
ous claplor discussod lol pIug and lol romovaI of ICI Ixpross dovicos. Tlo
spocificalion dofinos a slandard usago modoI for aII dovico and pIalform form
faclors llal supporl lol pIug capabiIily. Tlo usago modoI dofinos, as an oxam-
pIo, lov pusl bullons and indicalors (IIDs) bolavo, if impIomonlod on llo
classis, add-in card or moduIo. Tlo dofinilions assignod lo llo indicalors and
pusl bullons, doscribod in llis claplor, appIy lo aII modoIs of lol pIug impIo-
monlalions.
This Chapter
Tlis claplor providos an inlroduclion lo llo ICI Ixpross add-in card oIoclromo-
clanicaI spocificalions. Il doscribos llo card form faclor, llo connoclor dolaiIs,
and llo auxiIiary signaIs vill a doscriplion of lloir funclion. Ollor card form
faclors aro aIso briofIy doscribod, bul il slouId bo slrossod llal somo of llom
lavo nol yol boon approvod by llo SIG as of llis vriling.
The Next Chapter
Tlo noxl claplor providos an inlroduclion lo configuralion in llo ICI Ixpross
onvionmonl. Il inlroducos llo configuralion spaco in vlicl a funclions config-
uralion rogislors aro impIomonlod, lov a funclion is discovorod, lov configu-
ralion lransaclions aro roulod, ICI-compalibIo spaco, ICI Ixpross oxlondod
configuralion spaco, and lov lo difforonlialo bolvoon a normaI funclion and a
bridgo.
PCI Express System Architecture
686
Introduction
Ono goaI of llo ICI Ixpross add-in card oIoclromoclanicaI spoc vas lo oncour-
ago migralion from llo ICI arclilocluro found in many dosIlop and mobiIo
dovicos loday by maIing llo migralion pall slraigllforvard and minimizing
llo roquirod lardvaro clangos. Tovards llis ond, ICI Ixpross add-in cards aro
dofinod lo bo vory simiIar lo llo curronl ICI add-in card form faclor, aIIoving
llom lo roadiIy cooxisl vill ICI sIols in syslom boards dosignod lo llo ATX or
micro-ATX slandard. ICI Ixpross foaluros IiIo aulomalic poIarily invorsion and
Iano rovorsaI aIso loIp roduco Iayoul issuos on syslom boards, so lloy can sliII
bo dosignod using llo four-Iayor IR4 board conslruclion commonIy usod loday.
As a rosuIl, mucl of an oxisling syslom board dosign can romain llo samo vlon
il is modifiod lo uso llo nov arclilocluro, and no clangos aro roquirod for oxisl-
ing classis dosigns.
Add-in Connector
Tlo ICI Ixpross add-in card connoclor (soo Iiguro 18-1 on pago 687 and Iiguro
18-2 on pago 688) is plysicaIIy vory simiIar lo llo Iogacy ICI connoclor, bul usos
a difforonl pinoul and doos nol suppIy -12V or 5V povor. Tlo plysicaI dimon-
sions of a card aro llo samo as llo ICI add-in cards and llo samo IO bracIol is
usod. TabIo 18-1 on pago 689 slovs llo pinoul for a connoclor llal supporls ICI
Ixpross cards up lo x16 (16 Ianos vido). SovoraI signaIs aro roforrod lo as auxiI-
iary signaIs in llo spoc, and lloso aro liglIigllod and doscribod in moro dolaiI
in llo soclion llal foIIovs llo labIo.
Nolo llal cards vill fovor Ianos can bo pIuggod inlo Iargor connoclors llal viII
accommodalo moro Ianos. Tlis is roforrod lo as . Tlo opposilo caso,
inslaIIing a Iargor card inlo a smaIIor sIol is caIIod and, unIiIo
ICI, is plysicaIIy provonlod in ICI Ixpross by llo connoclor Ioying.) Conso-
quonlIy, llo connoclor doscribod by llo labIo viII accommodalo a card llal is x1,
x4, x8, or x16. Tlis fIoxibiIily in llo connoclor is liglIigllod by nolos in llo labIo
llal indicalo oacl group of signaIs. Ior oxampIo, a x4 card pIuggod inlo llis sIol
vouId onIy maIo uso of pins 1 llrougl 32, and so llo nolo indicaling llo ond of
llo x4 group of signaIs appoars aflor pin 32. Tloso sogmonl indicalors do nol
roprosonl plysicaI spacos or Ioys, lovovor, bocauso lloro is onIy ono moclani-
caI Ioy on llo connoclor, Iocalod bolvoon pins 11 and 12.
Chapter 18: Add-in Cards and Connectors
687
--
PCI Express System Architecture
688
-- - -
Chapter 18: Add-in Cards and Connectors
689
--

- -
1 +12V 12V Iovor IRSNT1# Hol-IIug prosonco
dolocl
2 +12V 12V Iovor +12V 12V Iovor
3 RSVD Rosorvod +12V 12V Iovor
4 GND Ground GND Ground
5 SMCIK SMBus (Syslom Manago-
monl Bus) CIocI
}TAG2 TCK (Tosl CIocI),
cIocI inpul for }TAG
inlorfaco
6 SMDAT SMBus (Syslom Manago-
monl Bus) dala
}TAG3 TDI (Tosl Dala Inpul)
7 GND Ground }TAG4 TDO (Tosl Dala oul-
pul)
8 +3.3V 3.3 V Iovor }TAG5 TMS (Tosl Modo
SoIocl)
9 }TAG1 TRST# (Tosl Rosol) rosols
llo }TAG inlorfaco
+3.3V 3.3 V Iovor
10 3.3V
AUX
3.3 V AuxiIiary Iovor +3.3V 3.3 V Iovor
11 WAKI# SignaI for IinI roacliva-
lion
IIRST# IundamonlaI rosol
MoclanicaI Koy
12 RSVD Rosorvod GND Ground
13 GND Ground RIICIK+ Roforonco CIocI
(difforonliaI pair)
14 IITp0 Transmillor difforonliaI
pair, Iano 0
RIICIK-
15 IITn0 GND Ground
PCI Express System Architecture
690
16 GND Ground IIRp0 Rocoivor difforonliaI
pair, Iano 0
17 IRSNT2# Hol-IIug prosonco dolocl IIRn0
18 GND Ground GND Ground
Ind of llo x1 connoclor
19 IITp1 Transmillor difforonliaI
pair, Iano 1
RSVD Rosorvod
20 IITn1 GND Ground
21 GND Ground IIRp1 Rocoivor difforonliaI
pair, Iano 1
22 GND Ground IIRn1
23 IITp2 Transmillor difforonliaI
pair, Iano 2
GND Ground
24 IITn2 GND Ground
25 GND Ground IIRp2 Rocoivor difforonliaI
pair, Iano 2
26 GND Ground IIRn2
27 IITp3 Transmillor difforonliaI
pair, Iano 3
GND Ground
28 IITn3 GND Ground
29 GND Ground IIRp3 Rocoivor difforonliaI
pair, Iano 3
30 RSVD Rosorvod IIRn3
31 IRSNT2# Hol-IIug prosonco dolocl GND Ground
32 GND Ground RSVD Rosorvod
Ind of llo x4 connoclor
33 IITp4 Transmillor difforonliaI
pair, Iano 4
RSVD Rosorvod
34 IITn4 GND Ground
--

- -
Chapter 18: Add-in Cards and Connectors
691
35 GND Ground IIRp4 Rocoivor difforonliaI
pair, Iano 4
36 GND Ground IIRn4
37 IITp5 Transmillor difforonliaI
pair, Iano 5
GND Ground
38 IITn5 GND Ground
39 GND Ground IIRp5 Rocoivor difforonliaI
pair, Iano 5
40 GND Ground IIRn5
41 IITp6 Transmillor difforonliaI
pair, Iano 6
GND Ground
42 IITn6 GND Ground
43 GND Ground IIRp6 Rocoivor difforonliaI
pair, Iano 6
44 GND Ground IIRn6
45 IITp7 Transmillor difforonliaI
pair, Iano 7
GND Ground
46 IITn7 GND Ground
47 GND Ground IIRp7 Rocoivor difforonliaI
pair, Iano 7
48 IRSNT2# Hol-IIug prosonco dolocl IIRn7
49 GND Ground GND Ground
Ind of llo x8 connoclor
50 IITp8 Transmillor difforonliaI
pair, Iano 8
RSVD Rosorvod
51 IITn8 GND Ground
52 GND Ground IIRp8 Rocoivor difforonliaI
pair, Iano 8
53 GND Ground IIRn8
54 IITp9 Transmillor difforonliaI
pair, Iano 9
GND Ground
55 IITn9 GND Ground
--

- -
PCI Express System Architecture
692
56 GND Ground IIRp9 Rocoivor difforonliaI
pair, Iano 9
57 GND Ground IIRn9
58 IITp10 Transmillor difforonliaI
pair, Iano 10
GND Ground
59 IITn10 GND Ground
60 GND Ground IIRp10 Rocoivor difforonliaI
pair, Iano 10
61 GND Ground IIRn10
62 IITp11 Transmillor difforonliaI
pair, Iano 11
GND Ground
63 IITn11 GND Ground
64 GND Ground IIRp11 Rocoivor difforonliaI
pair, Iano 11
65 GND Ground IIRn11
66 IITp12 Transmillor difforonliaI
pair, Iano 12
GND Ground
67 IITn12 GND Ground
68 GND Ground IIRp12 Rocoivor difforonliaI
pair, Iano 12
69 GND Ground IIRn12
70 IITp13 Transmillor difforonliaI
pair, Iano 13
GND Ground
71 IITn13 GND Ground
72 GND Ground IIRp13 Rocoivor difforonliaI
pair, Iano 13
73 GND Ground IIRn13
74 IITp14 Transmillor difforonliaI
pair, Iano 14
GND Ground
75 IITn14 GND Ground
76 GND Ground IIRp14 Rocoivor difforonliaI
pair, Iano 14
77 GND Ground IIRn14
--

- -
Chapter 18: Add-in Cards and Connectors
693
AuxiIiary SignaIs
GeneraI
SovoraI signaIs liglIigllod in TabIo 18-1 as auxiIiary signaIs aro doscribod loro
in moro dolaiI. Tloso signaIs aro providod lo assisl vill corlain syslom IovoI
funclions and aro nol roquirod by llo gonoraI ICI Ixpross arclilocluro,
aIllougl somo aro roquirod for add-in cards. Ior roforonco, lloso signaIs aro
summarizod in TabIo 18-2.
78 IITp15 Transmillor difforonliaI
pair, Iano 15
GND Ground
79 IITn15 GND Ground
80 GND Ground IIRp15 Rocoivor difforonliaI
pair, Iano 15
81 IRSNT2# Hol-IIug prosonco dolocl IIRn15
82 RSVD Rosorvod GND Ground
-- -

RIICIK+ Roquirod Iov-voIlago
difforonliaI
cIocI
100MHz (+/- 300ppm) Rofor-
onco cIocI usod lo synclronizo
dovicos on boll onds of a IinI.
RIICIK-
IIRST# Roquirod Iov spood Indicalos vlon main povor is
villin loIoranco and slabIo.
IIRST# goos inaclivo aflor a
doIay of T
IVIIRI
onco povor is
slabIo.
--

- -
PCI Express System Architecture
694
Reference CIock
Tlis difforonliaI cIocI musl bo providod by llo syslom board (aIllougl ils uso is
oplionaI for add-in cards). Ils purposo is lo aIIov boll llo lransmillor and llo
rocoivor on a IinI lo dorivo lloir inlornaI cIocIs from llo samo sourco cIocI.
WliIo using llo roforonco cIocI is nol roquirod, il doos simpIify llo lasI of Ioop-
ing llo inlornaI cIocIs bolvoon dovicos on oillor ond of a IinI villin llo spoci-
fiod 600ppm of oacl ollor, sinco any lvo roforonco cIocIs aro roquirod lo bo
villin +/- 300ppm of lloir nominaI 100MHz froquoncy. In addilion, llo baso
spoc slalos llal minimizing llo I0s oxil Ialoncy (i.o., llo limo roquirod for llo
IinI lo lransilion from llo Iovor povor I0s slalo bacI lo I0) roquiros using a
common roforonco cIocI. IinaIIy, if Sproad Spoclrum CIocIing (SSC) is lo bo
usod, il gonoraIIy roquiros llal boll lransmillors and rocoivors on a IinI musl
uso llo samo roforonco cIocI. SSC aIIovs llo cIocI lo bo dovn-moduIalod, or
roducod in froquoncy, by as mucl as 0.5 and llon brougll bacI up lo ils nom-
inaI froquoncy al a ralo nol liglor llan 33KHz. Trying lo moduIalo llo cIocI fro-
quoncy among dovicos llal voro nol using llo samo roforonco cIocI vouId
cIoarIy bo vory difficuIl.
WAKI# Roquirod if
vaIoup
funclionaI-
ily is sup-
porlod.
Opon-drain Drivon Iov by a funclion lo
roquosl llal llo main povor and
roforonco cIocI bo roaclivalod.
SMBCIK OplionaI Opon-drain SMBus cIocI signaI.
SMBDAT OplionaI Opon-drain SMBus addross/dala signaI.
}TAG Group OplionaI Iov spood Tlis group of signaIs (TCIK,
TDI, TDO, TMS, and TRST#) can
oplionaIIy bo usod lo supporl llo
IIII 1149.1 boundary scan spoc.
IRSNT1# Roquirod Tloso signaIs aro usod lo indicalo
llal a card is inslaIIod inlo llo
connoclor.
IRSNT2#
-- -

Chapter 18: Add-in Cards and Connectors
695
PERST#
Tlis signaI, simiIar in funclion lo an invorlod vorsion of llo IOWIRGOOD sig-
naI in a lypicaI IC, is doassorlod 100ms aflor llo povor suppIy is slabIo and
villin loIoranco (soo Iiguro 18-3 on pago 695). IIRST# is aIso avaro of povor
managomonl aclivily and so can aIso bo usod lo givo ICI Ixpross dovicos somo
advanco nolico llal povor is aboul lo bo romovod as a rosuIl of a povor man-
agomonl oporalion (soo Iiguro 18-4 on pago 696). As Iong as IIRST# romains
assorlod, aII ICI Ixpross funclions aro loId in rosol.

PCI Express System Architecture
696
WAKE#
Tlis opon-drain signaI is drivon by a ICI Ixpross dovico llal supporls llo
vaIoup funclion lo roquosl roaclivalion of llo main povor and roforonco cIocI.
If an add-in card supporls llo vaIoup procoss, il musl impIomonl llis pin, and
a syslom board musl supporl llo funclion if il connocls lo llo WAKI# pin on
llo sIol. Tloro aro acluaIIy lvo dofinod vaIoup moclanisms, llo sido-band
WAKI# signaI and an in-band indicalor caIIod llo Boacon. Tlo Boacon is
roquirod for aII compononls vill llo oxcoplion of corlain form faclors, of vlicl
llo ICI Ixpross add-in card is ono oxampIo. Sysloms llal supporl vaIoup for
lloso form faclors aro roquirod lo supporl llo WAKI# signaI for llom aIllougl
-
Chapter 18: Add-in Cards and Connectors
697
lloy aro aIso oncouragod lo supporl llo Boacon. Add-in cards llal can gonoralo
a vaIoup ovonl aro aIso roquirod lo supporl llo Boacon oporalion. Il is nol cIoar
vly lvo moclanisms lavo boon dofinod. Ono omplasis in ICI Ixpross las
boon lo roduco sido-band signaIs, vlicl vouId arguo againsl adding a sido-
band vaIoup signaI. On llo ollor land, llo uso of llo WAKI# signaI may sorvo
lo roduco llo Ialoncy invoIvod in vaIing up llo syslom onougl lo juslify ils uso
for add-in cards.
If a sIol supporls WAKI#, llo signaI is roulod lo llo pIalform povor manago-
monl conlroIIor, vlicl migll rosido, for oxampIo, insido llo Rool CompIox. Tlo
WAKI# signaIs from aII llo sIols can bo bussod logollor inlo a singIo inpul or
lloy can oacl bo usod as soparalo inpuls lo llo conlroIIor. WAKI# musl lavo a
syslom board puIIup lo a roforonco voIlago llal viII bo prosonl vlon llo main
povor raiIs aro lurnod off, and llo puIIup musl bo a vaIuo llal viII aIIov il lo
puII WAKI# ligl in no moro llan 100ns. Nolo llal Hol pIug roquiros WAKI#
lo bo isoIalod (bolvoon connoclors) and drivon inaclivo during lol-add or lol-
romovo oporalions.
WAKI# funclions in a vay llal is simiIar lo IMI# in a convonlionaI ICI sys-
lom, bul il is nol llo samo and musl nol bo connoclod diroclIy lo llo IMI# sig-
naI. Tlo spoc aIso maIos il cIoar llal WAKI# musl nol diroclIy causo an
inlorrupl. As vas lruo of llo IMI# signaI in ICI, caro musl bo laIon lo onsuro
llal llo gonoralion of WAKI# in ono dovico doos nol damago llo WAKI# gon-
oralion circuilry in anollor dovico. Tlis couId prosonl a probIom if ono dovico
las 3.3V
AUX
suppIiod vliIo anollor doos nol, pormilling llo oulpul buffors of
llo dovico villoul povor lo bo rovorso-biasod by llo assorlion of WAKI# and
possibIy damagod. Ono soIulion lo llis probIom is lo add a circuil IiIo llo ono
slovn in Iiguro 18-5. As vouId bo oxpoclod, a card can onIy inilialo a vaIoup
ovonl if 3.3V
AUX
is suppIiod lo il, sinco llo ollor povor raiIs may bo lurnod off
vlon llo IinI is pul inlo a sIoop slalo.
PCI Express System Architecture
698
SMBus
Tlis oplionaI 2-viro bus providos a simpIo, inoxponsivo bus for syslom conlroI
and povor managomonl, roducing pin counl and improving fIoxibiIily. Ono
purposo for llis bus is lo roduco llo numbor of conlroI Iinos noodod for llo ICI
Ixpross bus, sinco il can bo usod lo sond SMBus mossagos bolvoon syslom
dovicos. Tloso mossagos can roporl manufacluror informalion, savo slalo for a
suspondod ovonl, roporl orrors, accopl conlroI paramolors, or suppIy slalus. Tlo

Chapter 18: Add-in Cards and Connectors
699
oporalion and roquiromonls of llo SMBus aro doscribod in dolaiI in llo -
- - .
JTAG
Tlis oplionaI inlorfaco providos a Tosl Accoss Iorl (TAI) lo faciIilalo losling of a
card llal impIomonls il. Tlo TAI pins oporalo al 3.3V, as do llo ollor singIo-
ondod IO signaIs of llo ICI Ixpross connoclor. }TAG slands for }oinl Tosl Aclion
Group and is commonIy usod lo rofor lo llo - --
.
PRSNT Pins
Rofor lo Iiguro 18-6 on pago 700. Tloso pins aro usod by llo syslom lo indicalo
vlollor a card las boon pIuggod inlo a connoclor. On llo add-in card, llo
IRSNT1# pin is virod lo llo farllosl avaiIabIo IRSNT2# pin on llo connoclor.
Ior oxampIo, a x4 card vouId viro pins 1A (IRSNT1#) and 31B (IRSNT2#)
logollor on llo card. On llo syslom board llo IRSNT1# pin on llo sIol is
groundod, vliIo aII llo IRSNT2# pins of llo sIol aro bussod logollor and
puIIod ligl, so llo syslom is abIo lo dolocl llal a card las boon inslaIIod in llo
sIol by obsorving llal llo IRSNT2# signaI las boon puIIod Iov.
Dolocling llal a card las boon addod is usofuI in a syslom llal impIomonls
oillor lol-pIug or lol-svap moclanisms, sinco a sIol couId bo Iofl povorod off
vlon no card is doloclod. Upon insorlion of a nov card, llo lardvaro couId
dolocl llo clango and bogin llo procoss of proparing llo syslom lo bring llo
nov card onIino. Wlon llo nov card goos aclivo, llo IinI viII aulomalicaIIy
dolocl llal a dovico is prosonl and bogin llo procoss of lraining llo IinI.
As an asido, llo facl llal an add-in card is roquirod lo connocl IRSNT1# lo llo
farllosl possibIo IRSNT2# pin may moan llal llo spoc dosignors considorod
using llo prosonco dolocl pins lo indicalo informalion sucl as llo IinI vidll on
an add-in card. Hovovor, if llo syslom board simpIy connocls aII llo IRSNT2#
pins logollor, llis indicalion is nol avaiIabIo. VisibiIily of llo IinI vidll may
lavo prosonlod no roaI advanlago anyvay, sinco llo IinI viII aulomalicaIIy
oslabIisl llo usabIo IinI vidll during lraining.
PCI Express System Architecture
700
EIectricaI Requirements
Power SuppIy Requirements
TabIo 18-3 doscribos llo povor suppIiod lo an add-in card. Nolo llal llo curronl
providod by llo +3.3V and +3.3V
AUX
suppIios doos nol clango as a funclion of
llo IinI vidll, vliIo il doos for llo +12V suppIy, indicaling llal llo +12V sup-
pIy providos llo povor noodod for add-in cards llal lavo liglor vallago
roquiromonls. Boll llo +3.3V and +12V povor suppIios aro roquirod for an add-
in connoclor, vliIo +3.3V
AUX
is oplionaI. Tlo curronl Iimils slovn in llo labIo
for +3.3V
AUX
indicalo llal llo liglor aIIovanco is onIy for dovicos llal supporl
vaIoup. Tlis rosombIos llo povor Iimils in ICI assignod for 3.3V
AUX
, in vlicl
llo Iimil is basod on vlollor a card is IMI onabIod, bul lloro is an oxcoplion lo
llo ruIo impIiod by llis labIo in ICI Ixpross. Tlo configuralion bil caIIod AuxiI-
-
Chapter 18: Add-in Cards and Connectors
701
iary Iovor IM InabIo found in llo Dovico ConlroI Rogislor (soo Dovico Con-
lroI Rogislor on pago 905), vlon sol, indicalos llal a dovico las pormission lo
uso llo fuII 375mA of auxiIiary povor rogardIoss of vlollor il supporls llo
vaIoup funclion.
Power Dissipation Limits
Tlo povor consumplion Iimils for difforonl IinI vidlls and card lypos aro
Iislod in TabIo 18-4. Tlo labIo indicalos, for oxampIo, llal a x1 card cannol
oxcood 10W unIoss il is a ligl povor dovico inlondod for sorvor appIicalions, in
vlicl caso llo maximum is 25W. Al llo ligl ond, a x16 graplics card is
aIIovod lo consumo up lo 60W (incroasing llis vaIuo lo 75W is undor curronlIy
undor considoralion).
-

VoIlago ToIoranco
SuppIy Curronl
Capacilivo Ioad
+/- 9 (max)
3.0A (max)
1000 uI (max)

VoIlago ToIoranco
SuppIy Curronl
Capacilivo Ioad
+/- 8
0.5A
300 uI (max)
+/- 8
2.1A
300 uI (max)
+/- 8
4.4A
300 uI (max)

VoIlago ToIoranco
SuppIy Curronl
WaIoup onabIod
Non-WaIoup
onabIod
Capacilivo Ioad
+/- 9 (max)
375 mA (max)
20 mA (max)
150 uI (max)
PCI Express System Architecture
702
Tlo difforonco bolvoon llo lypos of cards is doscribod in moro dolaiI in llo oIoc-
lromoclanicaI spoc, bul basicaIIy, llo slandard loigll cards inlondod for dosI-
lop appIicalions aro Iimilod lo laIf-Iongll add-in cards vill Iovor vallagos,
vliIo cards inlondod for sorvor appIicalions musl bo from al Ioasl 7.0 inclos
Iong up lo a fuII-Iongll card and aro aIIovod lo uso liglor vallagos. Iov-pro-
fiIo cards aro Iimilod lo laIf-Iongll and Iovor vallagos.
Nolo llal dovicos dosignalod as ligl povor aro conslrainod lo slarl up using
llo Iov povor Iimils unliI lloy lavo boon configurod as ligl povor dovicos. As
a rosuIl, aII x1 cards aro iniliaIIy Iimilod lo 10W, and cards inlondod for graplics
appIicalions aro Iimilod lo 25W al iniliaI povor up unliI configurod as a ligl
povor dovico, al vlicl limo lloy can uso up lo 60W (llis may bo incroasod lo
75W in llo fuluro). Soo soclion SIol Iovor Iimil ConlroI on pago 562 for moro
informalion on povor configuralion.
Add-in Card InteroperabiIity
As monlionod oarIior, il is possibIo for a ICI Ixpross add-in card lo bo pIuggod
inlo a sIol llal vas inlondod for a vidor card. Tlis is iIIuslralod in TabIo 18-5,
vlicl aIso poinls oul llal aII llo sIol vidlls musl supporl llo basic x1 card.
Tloro aro basicaIIy llroo sizo-mismalcl sconarios lo considor:
1. . Insorling a smaIIor IinI card inlo a Iargor IinI sIol is fuIIy
aIIovod.
2. . Insorling a Iargor IinI card inlo a smaIIor IinI sIol is nol
aIIovod and is plysicaIIy provonlod.
3. -. InslaIIing a card inlo a sIol llal is nol fuIIy roulod for aII of
llo Ianos. Tlis is nol aIIovod oxcopl for llo caso of a x8 connoclor for vlicl
llo syslom dosignor may clooso lo roulo onIy llo firsl four Ianos. A x8 card
funclions as a x4 card in llis silualion.
--

Slandard Hoigll 10W (max)
DosIlop
appIica-
lion
25W (max)
Sorvor
appIica-
lion
25W (max) 25W (max)
Sorvor
appIica-
lion
60W (max)
Graplics
appIica-
lion
Iov IrofiIo card 10W (max) 10W (max) 25W (max)
Chapter 18: Add-in Cards and Connectors
703
Form Factors Under DeveIopment
GeneraI
In addilion lo llo cards and sIols llal aro dofinod vill llo ICI Ixpross Card
IIoclromoclanicaI spoc, lloro aro ollor form faclors curronlIy undor dovoIop-
monl by various groups. Tloso form faclors aro usuaIIy dosignod for a parlicu-
Iar cIass of appIicalions and llus lavo difforonl conslrainls. A card dosignod for
a sorvor appIicalion for oxampIo, viII lypicaIIy lavo a biggor povor budgol and
moro spaco avaiIabIo llan ono dosignod for a mobiIo appIicalion. Tlo spocs for
lloso form faclors voro sliII undor dovoIopmonl al llo limo of llis pubIicalion
and aro lloroforo subjocl lo clango.
Server IO ModuIe (SIOM)
Tlo ICI SIG is curronlIy dovoIoping a moduIo for llo sorvor onvironmonl caIIod
llo Sorvor IO ModuIo (SIOM). Il las four form faclors: a baso vorsion and a fuII
vorsion, boll of vlicl can uso a singIo- or doubIo-vidll card. Tlo buiIl in lol
svap capabiIily of ICI Ixpross loIps maIo llis moduIo allraclivo lo llo sorvor
marIol bocauso il aIIovs clangos lo bo roadiIy mado lo llo syslom on llo fIy.


Roquirod Roquirod Roquirod Roquirod
No Roquirod AIIovod AIIovod
No No Roquirod AIIovod
No No No Roquirod
PCI Express System Architecture
704
Riser Card
Iiguro 18-7 on pago 704 iIIuslralos an oxampIo of a ICI Ixpross risor card.
Mini PCI Express Card
Rofor lo Iiguro 18-8 on pago 705, Iiguro 18-9 on pago 706 and Iiguro 18-10 on
pago 706. Tlo Mini ICI Ixpross add-in card is simiIar lo llo convonlionaI Mini
ICI card, bul is aboul laIf llo sizo, usos smaIIor connoclors and is oplimizod for
-- -
Chapter 18: Add-in Cards and Connectors
705
mobiIo compuling pIalforms and communicalions appIicalions. Il is dosignod
vill an inlorfaco llal incIudos a x1 ICI Ixpross connoclor, a USB 2.0 connoclor,
and sovoraI IID indicalors. WliIo llis form faclor is dosignod for adding func-
lionaIily inlornaI lo llo syslom and lloroforo doos nol aIIov llo usor lo roadiIy
maIo clangos lo llo syslom, il doos faciIilalo buiId-lo-ordor or configuro-lo-
ordor manufacluro by maIing il oasy lo cuslomizo llo funclionaIily of a
maclino simpIy by cloosing vlicl cards lo add or Ioavo oul of a producl dur-
ing assombIy. Tlis spoc is boing dovoIopod by llo ICI SIG.
-- -
PCI Express System Architecture
706
--
--
Chapter 18: Add-in Cards and Connectors
707
NEWCARD form factor
NIWCARD is a slandard llal is simiIar lo llo Mini ICI Ixpross in funclionaIily
bul is dosignod for llo usor lo roadiIy inslaII or romovo. Tlis spoc is boing
dovoIopod by llo ICMCIA group (IorsonaI Compulor Momory Card Inlorna-
lionaI Associalion) for uso in dosIlop and mobiIo dovicos, and is oxpoclod lo
uIlimaloIy ropIaco llo oxisling CardBus IC card soIulion for lloso compulors.
IiIo llo Mini ICI Ixpross slandard, llo NIWCARD inlorfaco is dofinod lo con-
lain a x1 ICI Ixpross connoclor, a USB 2.0 connoclor, and sovoraI IID indica-
lors.
Ior dosIlop maclinos, NIWCARD viII offor llo lol pIug and lol svap capa-
biIilios of ICI Ixpross and USB, and aIIov a usor lo upgrado or oxpand llo
maclino villoul laving lo opon il. Sinco llo card viII bo abIo lo fil inlo mobiIo
compulors, il viII aIso bo possibIo for llo usor lo slaro a NIWCARD dovico
bolvoon dosIlop and mobiIo compulors.
Ior a communicalions-spocific card, llo IO inlorfaco sido of llo card migll
incIudo virod connoclions sucl as a modom or Illornol inlorfaco, or a viroIoss
porl sucl as a coIIuIar or BIuolooll connoclion.
Iarl Six
ICI Ixpross
Configuralion

The Previous Chapter

Tlo provious claplor providod an inlroduclion lo llo ICI Ixpross add-in card
oIoclromoclanicaI spocificalions. Il doscribod llo card form faclor, llo connoclor
dolaiIs, and llo auxiIiary signaIs vill a doscriplion of lloir funclion. Ollor card
form faclors voro aIso briofIy doscribod, bul il slouId bo slrossod llal somo of
llom lavo nol yol boon approvod by llo SIG as of llis vriling.
This Chapter
Tlis claplor providos an inlroduclion lo configuralion in llo ICI Ixpross onvi-
onmonl. Il inlroducos llo configuralion spaco in vlicl a funclions configura-
lion rogislors aro impIomonlod, lov a funclion is discovorod, lov
configuralion lransaclions aro roulod, ICI-compalibIo spaco, ICI Ixpross
oxlondod configuralion spaco, lov a funclion is discovorod, and lov lo diffor-
onlialo bolvoon a normaI funclion and a bridgo.
The Next Chapter
Tlo noxl claplor providos a dolaiIod doscriplion of llo lvo configuralion mocl-
anisms usod in a ICI Ixpross pIalform: llo ICI-compalibIo configuralion mocl-
anism, and llo ICI Ixpross onlancod configuralion moclanism. Il providos a
dolaiIod doscriplion of llo iniliaIizalion poriod immodialoIy foIIoving povor-
up, as voII as orror landIing during llis poriod.
-- -

Definition of Device and Function

}usl as in llo ICI onvironmonl, a dovico rosidos on a bus and conlains ono or
moro funclions (a dovico conlaining muIlipIo funclions is roforrod lo as a muIli-
funclion dovico). Iacl of llo funclions villin a muIlifunclion dovico providos a
sland-aIono funclionaIily. As an oxampIo, ono funclion couId bo a graplics con-
lroIIor vliIo anollor migll bo a nolvorI inlorfaco.
}usl as in ICI, a dovico may conlain up lo a maximum of oigll funclions num-
borod 0-llrougl-7:
- Tlo ono-and-onIy funclion impIomonlod in a singIo-funclion dovico musl
bo funclion 0.
- In a muIlifunclion dovico, llo firsl funclion musl bo funclion 0, vliIo llo
romaining funclions do nol lavo lo bo impIomonlod in a soquonliaI mannor.
In ollor vords, a dovico couId impIomonl funclions 0, 2, and 7.
In Iiguro 19-1 on pago 713, Dovico 0 on Bus 3 is a muIlifunclion dovico conlain-
ing lvo funclions, oacl of vlicl impIomonls ils ovn sol of configuralion rogis-
lors.

-
-- -

Definition of Primary and Secondary Bus

Tlo bus connoclod lo llo upslroam sido of a bridgo is roforrod lo as ils primary
bus, vliIo llo bus connoclod lo ils dovnslroam sido is roforrod lo as ils socond-
ary bus.
TopoIogy Is Unknown At Startup
Rofor lo Iiguro 19-2 on pago 714. Wlon llo syslom is firsl povorod up, llo con-
figuralion soflvaro las nol yol scannod llo ICI Ixpross fabric lo discovor llo
maclino lopoIogy and lov llo fabric is popuIalod. Tlo configuralion soflvaro
is onIy avaro of llo oxislonco of llo Hosl/ICI bridgo villin llo Rool CompIox
and llal bus numbor 0 is diroclIy connoclod lo llo dovnslroam (i.o., socondary)
sido of llo bridgo.
Il las nol yol scannod bus 0 and lloroforo doos nol yol Inov lov many ICI
Ixpross porls aro impIomonlod on llo Rool CompIox. Tlo procoss of scanning
llo ICI Ixpross fabric lo discovor ils lopoIogy is roforrod lo as llo
procoss.

Each Function ImpIements a Set of Configuration

Registers
Introduction
Al llo bolosl of soflvaro oxoculing on llo procossor, llo Rool CompIox inilialos
configuralion lransaclions lo road from or vrilo lo a funclions configuralion
rogislors. Tloso rogislors aro accossod lo discovor llo oxislonco of a funclion as
voII as lo configuro il for normaI oporalion. In addilion lo momory, IO, and
mossago spaco, ICI Ixpross aIso dofinos a dodicalod bIocI of configuralion
spaco aIIocalod lo oacl funclion villin vlicl ils configuralion rogislors aro
impIomonlod.
Function Configuration Space
Rofor lo Iiguro 19-3 on pago 717. Iacl funclions configuralion spaco is 4KB in
sizo and is popuIalod as doscribod in llo foIIoving lvo subsoclions.
PCI-CompatibIe Space
Tlo 256 bylo (64 dvord) ICI-compalibIo spaco occupios llo firsl 256 bylos of
llis 4KB spaco. Il conlains llo funclions ICI-compalibIo configuralion rogis-
lors. Tlis aroa can bo accossod using oillor of lvo moclanisms (boll of vlicl
aro doscribod Ialor):
- Tlo ICI configuralion accoss moclanism (soo ICI-CompalibIo Configura-
lion Moclanism on pago 723).
- Tlo ICI Ixpross Inlancod Configuralion moclanism (soo ICI Ixpross
Inlancod Configuralion Moclanism on pago 731).
Tlo firsl 16 dvords comprisos llo ICI configuralion loador aroa, vliIo llo
romaining 48 dvord aroa is rosorvod for llo impIomonlalion of funclion-spocific
configuralion rogislors as voII as ICI Nov CapabiIily rogislor sols. Il is manda-
lory llal oacl ICI Ixpross funclion musl impIomonl llo ICI Ixpross CapabiIily
Slrucluro (dofinod Ialor) villin llis aroa. A fuII doscriplion of llo ICI-compali-
bIo rogislors may bo found in ICI CompalibIo Configuralion Rogislors on
pago 769.
-- -

PCI Express Extended Configuration Space

Tlo romaining 3840 bylo (960 dvord) aroa is roforrod lo as llo ICI Ixpross
Ixlondod Configuralion Spaco. Il is uliIizod lo impIomonl llo oplionaI ICI
Ixpross Ixlondod CapabiIily rogislors:
- Advancod Irror Roporling CapabiIily rogislor sol.
- VirluaI ClannoI CapabiIily rogislor sol.
- Dovico SoriaI Numbor CapabiIily rogislor sol.
- Iovor Budgoling CapabiIily rogislor sol.
A fuII doscriplion of llo lloso oplionaI rogislor sols may bo found in Ixpross-
Spocific Configuralion Rogislors on pago 893.
Host/PCI Bridges Configuration Registers
Tlo Hosl/ICI bridgos configuralion rogislor sol doos nol lavo lo bo accossod
using oillor of llo spoc-dofinod configuralion moclanisms monlionod in llo
provious soclion. Rallor, il is mappod inlo a Rool CompIox dosign-spocific
addross spaco (aImosl corlainIy momory spaco) llal is Inovn lo llo pIalform-
spocific BIOS firmvaro. Hovovor, ils configuralion rogislor Iayoul and usago
musl adloro lo llo slandard Typo 0 lompIalo dofinod by llo ICI 2.3 spoc (soo
Hoador Typo 0 on pago 770 for dolaiIs on llo Typo 0 rogislor lompIalo).

--
-- -

Configuration Transactions Are Originated by the

Processor
OnIy the Root CompIex Can Originate Configuration
Transactions
Tlo spoc slalos llal onIy llo Rool CompIox is pormillod lo originalo configura-
lion lransaclions. Tlo Rool CompIox acls as llo procossors surrogalo lo injocl
lransaclion roquosls inlo llo fabric, as voII as lo pass compIolions bacI lo llo
procossor. Tlo configuralion soflvaro oxoculing on llo procossor is rosponsibIo
for dolocling and configuring aII dovicos in llo syslom.
Tlo abiIily lo originalo configuralion lransaclions is roslriclod lo llo procossor/
Rool CompIox lo avoid llo anarcly llal vouId rosuIl if any dovico lad llo abiI-
ily lo clango llo configuralion of ollor dovicos.
Configuration Transactions OnIy Move DownStream
Tlis roslriclion oxisls for llo samo roason slalod in llo provious soclion.
No Peer-to-Peer Configuration Transactions
Tlo foIIoving ruIo appIios lo Rool Iorls, Svilclos, and ICI Ixpross-lo-ICI
Bridgos: Iropagalion of Configuralion Roquosls from poor-lo-poor aro nol sup-
porlod.
Configuration Transactions Are Routed Via Bus, Device,
and Function Number
Tlo lransaclion lypos llal aro roulod via a bus, dovico, and funclion numbor
(i.o., lloy uso ID rouling rallor llan addross-basod rouling) aro:
- Configuralion lransaclions.
- Vondor-dofinod Mossagos may oplionaIIy bo roulod in llis mannor.
- CompIolion lransaclions.
Tlis claplor focusos on configuralion-roIalod issuos.

How a Function Is Discovered

Tlo configuralion soflvaro oxoculing on llo procossor lypicaIIy discovors llo
oxislonco of a funclion by porforming a road from ils ICI-compalibIo Vondor ID
rogislor. A uniquo 16-bil vaIuo is assignod lo oacl vondor by llo ICI-SIG and is
lardvirod inlo llo Vondor ID rogislor of oacl funclion dosignod by llal vondor.
Tlo Vondor ID of IIIIl is rosorvod and viII novor bo assignod lo any vondor.
A funclion is considorod prosonl if llo vaIuo road from ils Vondor ID rogislor is
a vaIuo ollor llan IIIIl. In a syslom llal doponds on a rolurn of aII onos for a
configuralion road from a non-oxislonl rogislor, llo Rool CompIox musl bo
dosignod lo rolurn aII onos for a configuralion road roquosl llal rosuIls in a UR
(Unsupporlod Roquosl) compIolion slalus.
How To Differentiate a PCI-to-PCI Bridge From a Non-Bridge
Function
Rofor lo Iiguro 19-3 on pago 717 and Iiguro 19-4 on pago 719. Tlo Iovor 7 bils of
llo Hoador Typo rogislor idonlifios llo basic calogory of llo funclion:
- 0 = llo funclion is nol a bridgo.
- 1 = llo funclion is a ICI-lo-ICI bridgo (aIa I2I) inlorconnocling lvo busos.
- 2 = llo funclion is a CardBus bridgo.
In Iiguro 19-1 on pago 713, llo Hoador Typo fioId in oacl of llo VirluaI I2Is
vouId rolurn a vaIuo of 1, as vouId llo ICI Ixpross-lo-ICI bridgo (Bus 8,
Dovico 0), vliIo lloso in llo foIIoving Indpoinl funclions vouId rolurn 0:
- Bus 3, Dovico 0.
- Bus 4, Dovico 0.
- Bus 7, Dovico 0.
- Bus 10, Dovico 0.
-
721

--
The Previous Chapter
Tlo provious claplor providod an inlroduclion lo configuralion in llo ICI
Ixpross onvironmonl. Il inlroducod llo configuralion spaco in vlicl a func-
lions configuralion rogislors aro impIomonlod, lov a funclion is discovorod,
lov configuralion lransaclions aro roulod, ICI-compalibIo spaco, ICI Ixpross
oxlondod configuralion spaco, and lov lo difforonlialo bolvoon a normaI func-
lion and a bridgo.
This Chapter
Tlis claplor providos a dolaiIod doscriplion of llo lvo configuralion mocla-
nisms usod in a ICI Ixpross pIalform: llo ICI-compalibIo configuralion mocla-
nism, and llo ICI Ixpross onlancod configuralion moclanism. Il providos a
dolaiIod doscriplion of llo iniliaIizalion poriod immodialoIy foIIoving povor-
up, as voII as orror landIing during llis poriod.
The Next Chapter
Tlo noxl claplor providos a dolaiIod doscriplion of llo discovory procoss and
bus numboring. Il doscribos:
- Inumoraling a syslom vill a singIo Rool CompIox
- Inumoraling a syslom vill muIlipIo Rool CompIoxos
- A muIlifunclion dovico villin a Rool CompIox or a Svilcl
- An Indpoinl omboddod in a Svilcl or Rool CompIox
- Aulomalic Roquoslor ID assignmonl.
- Rool CompIox Rogislor BIocIs (RCRBs)
PCI Express System Architecture
722
Introduction
Rofor lo Iiguro 20-1 on pago 723. Iacl funclion impIomonls a 4KB configuralion
spaco. Tlo Iovor 256 bylos (64 dvords) is llo ICI-compalibIo configuralion
spaco, vliIo llo uppor 960 dvords is llo ICI Ixpross oxlondod configuralion
spaco.
Tloro aro lvo moclanisms avaiIabIo llal aIIov configuralion soflvaro running
on llo procossor lo slimuIalo llo Rool CompIox lo gonoralo configuralion lrans-
aclions:
- Tlo ICI 2.3-compalibIo configuralion accoss moclanism.
- Tlo ICI oxpross onlancod configuralion moclanism.
Tloso lvo moclanisms aro doscribod in llis claplor.
InloI x86 and IovorIC procossors (as lvo oxampIo procossor famiIios) do nol
possoss llo abiIily lo porform configuralion road and vrilo lransaclions. Tloy
uso momory and IO (IO is onIy in llo x86 caso) road and vrilo lransaclions lo
communicalo vill oxlornaI dovicos. Tlis moans llal llo Rool CompIox musl bo
dosignod lo rocognizo corlain IO or momory accossos inilialod by llo procossor
as roquosls lo porform configuralion accossos.
Chapter 20: Configuration Mechanisms
723
PCI-CompatibIe Configuration Mechanism
Ior x86-basod IC-AT compalibIo sysloms, llo 2.3 ICI spoc dofinos a mollod
llal uliIizos procossor-inilialod IO accossos lo inslrucl llo losl/ICI bridgo (in
llis caso, villin llo Rool CompIox) lo porform ICI configuralion accossos.Tlo
-
PCI Express System Architecture
724
spoc doos nol dofino a configuralion moclanism lo bo usod in sysloms ollor
llan IC-AT compalibIo sysloms.
Background
Tlo x86 procossor famiIy is capabIo of addrossing up lo, bul no moro llan, 64KB
of IO addross spaco. In llo IISA spoc, llo usago of llis IO spaco vas dofinod in
sucl a mannor llal llo onIy IO addross rangos avaiIabIo for llo impIomonlalion
of llo ICI Configuralion Moclanism (villoul confIicling vill an ISA or IISA
dovico) voro 0400l - 04IIl, 0800l - 08IIl, and 0C00l - 0CIIl. Many IISA sys-
lom board conlroIIors aIroady rosidod villin llo 0400l - 04IIl addross rango,
maIing il unavaiIabIo.
Considor llo foIIoving:
- As vill any ollor ICI funclion, a losl/ICI bridgo may impIomonl up lo 64
dvords of configuralion rogislors.
- Iacl ICI funclion on oacl ICI bus roquiros 64 dvords of dodicalod config-
uralion spaco.
Duo lo llo IacI of avaiIabIo IO roaI oslalo villin llo 64KB of IO spaco, il vasnl
foasibIo lo map oacl configuralion rogislor diroclIy inlo llo procossors IO
addross spaco. AIlornalivoIy, llo syslom dosignor couId impIomonl llo configu-
ralion rogislors villin llo procossor's momory spaco. Tlo amounl of momory
spaco consumod asido, llo addross rango uliIizod vouId bo unavaiIabIo for aIIo-
calion lo roguIar momory. Tlis vouId Iimil llo syslom's fIoxibiIily rogarding llo
mapping of acluaI momory.
PCI-CompatibIe Configuration Mechanism
Description
GeneraI
Tlo ICI-CompalibIo Configuralion Moclanism uliIizos lvo 32-bil IO porls
impIomonlod in llo Hosl/ICI bridgo villin llo Rool CompIox, Iocalod al IO
addrossos 0CI8l and 0CICl. Tloso lvo porls aro:
- Tlo 32-bil -- , occupying IO addrossos 0CI8l
llrougl 0CIBl.
- Tlo 32-bil , occupying IO addrossos 0CICl
llrougl 0CIIl.
Chapter 20: Configuration Mechanisms
725
Accossing ono of a funclion's ICI-compalibIo configuralion rogislors is a lvo
slop procoss:
1. Wrilo llo largol bus numbor, dovico numbor, funclion numbor and dvord
numbor lo llo Configuralion Addross Iorl and sol llo InabIo bil in il lo
ono.
2. Iorform a ono-bylo, lvo-bylo, or four-bylo IO road from or a vrilo lo llo
Configuralion Dala Iorl.
In rosponso, llo losl/ICI bridgo villin llo Rool CompIox comparos llo spoci-
fiod largol bus lo llo rango of busos llal oxisl on llo ollor sido of llo bridgo
and, if llo largol bus rosidos boyond llo bridgo, il inilialos a configuralion road
or vrilo lransaclion (basod on vlollor llo procossor is porforming an IO road
or vrilo vill llo Configuralion Dala Iorl).
Configuration Address Port
Rofor lo Iiguro 20-2 on pago 726. Tlo Configuralion Addross Iorl onIy Ialclos
informalion vlon llo procossor porforms a fuII 32-bil vrilo lo llo porl. A 32-bil
road from llo porl rolurns ils conlonls. Tlo assorlion of rosol cIoars llo porl lo
aII zoros. Any 8- or 16-bil accoss villin llis IO dvord is lroalod as an 8- or 16-bil
IO accoss. Tlo 32-bils of informalion vrillon lo llo Configuralion Addross Iorl
musl conform lo llo foIIoving lompIalo (iIIuslralod in Iiguro 20-2 on pago 726):
- bils aro lard-virod, road-onIy and musl rolurn - vlon road.
- bils idonlify llo (1-of-64) villin llo largol funclion's ICI-
compalibIo configuralion spaco. Wlon llo Rool CompIox subsoquonlIy
gonoralos llo rosuIlanl configuralion roquosl pacIol, llis bil fioId suppIios
llo conlonl of llo pacIols Rogislor Numbor fioId and llo pacIols Ixlondod
Rogislor Numbor fioId is sol lo aII zoros. Tlis configuralion accoss mocla-
nism is lloroforo Iimilod lo addrossing llo firsl 64 dvords of llo largolod
funclions configuralion spaco (i.o., llo funclions ICI-compalibIo addross
spaco).
- bils idonlify llo numbor (1-of-8) villin llo largol
dovico.
- bils idonlify llo largol dovico numbor (1-of-32).
- bils idonlifios llo - numbor (1-of-256).
- bils aro - and musl bo zoro.
- bil - sol lo a , onabIing llo lransIalion of a subsoquonl procos-
sor IO accoss lo llo Configuralion Dala Iorl inlo a configuralion accoss. If
bil 31 is zoro and llo procossor inilialos an IO road from or IO vrilo lo llo
Configuralion Dala Iorl, llo lransaclion is lroalod as an IO lransaclion
roquosl.
PCI Express System Architecture
726
Bus Compare and Data Port Usage
Rofor lo Iiguro 20-3 on pago 728. Tlo Hosl/ICI bridgo villin llo Rool Com-
pIox impIomonls a Bus Numbor rogislor and a Subordinalo Bus Numbor rogis-
lor. In a clipsol llal onIy supporls ono Rool CompIox, llo bridgo may lavo a
bus numbor rogislor llal is lardvirod lo 0, a road/vrilo rogislor llal rosol
forcos lo 0, or il jusl impIicilIy Inovs llal il is llo bridgo lo bus 0. If bil 31 in llo
Configuralion Addross Iorl (soo Iiguro 20-2 on pago 726) is onabIod (i.o., sol lo
ono), llo bridgo comparos llo largol bus numbor lo llo rango of busos llal
oxisls boyond llo bridgo.
- If llo largol bus is llo samo as llo vaIuo in llo Bus Num-
bor rogislor, llis is a roquosl lo porform a configuralion lransaclion on bus 0.
A subsoquonl IO road from or vrilo lo llo bridgos Configuralion Dala Iorl
al 0CICl causos llo bridgo lo gonoralo a Typo 0 configuralion road or vrilo
lransaclion. Wlon dovicos llal rosido on a ICI bus dolocl a Typo 0 configu-
ralion lransaclion in progross, llis informs llom llal ono of llom is llo lar-
gol dovico (rallor llan a dovico on ono of llo subordinalo busos bonoall llo
bus llo Typo 0 lransaclion is boing porformod on).
--
Device
Number
11 10 8 15 16 23 24 30
Bus
Number
Reserved
31
EnabIe Configuration Space Mapping
1 = enabIed
ShouId aIways be zeros
DoubIeword
2 1 0 7
0 0
Function
Number
0CF8h 0CF9h 0CFAh 0CFBh
Chapter 20: Configuration Mechanisms
727
- - - If llo largol
bus spocifiod in llo Configuralion Addross Iorl is > llan llo vaIuo in llo
bridgos Bus Numbor rogislor, bul is llo vaIuo in llo bridgos Subordinalo
Bus Numbor rogislor, llo bridgo convorls llo subsoquonl procossor IO
accoss lo ils Configuralion Dala Iorl inlo a Typo 1 configuralion lransaclion
on bus 0. Wlon dovicos (ollor llan ICI-lo-ICI bridgos) llal rosido on a bus
dolocl a Typo 1 configuralion accoss in progross, lloy ignoro llo lransaclion.
Tlo onIy dovicos on a bus llal pay allonlion lo llo Typo 1 configuralion
lransaclion aro ICI-lo-ICI bridgos. Iacl of llom musl dolormino if llo lar-
gol bus numbor (doIivorod in llo pacIols loador) is villin llo rango of
busos llal rosido bolind llom:
- If llo largol bus is nol villin rango, llon a ICI-lo-ICI bridgo ignoros
llo Typo 1 accoss.
- If ils in rango, llo accoss is passod llrougl llo ICI-lo-ICI bridgo as
oillor a Typo 0 configuralion lransaclion (if llo largol bus = llo bus
numbor in llo bridgos Socondary Bus Numbor rogislor), or as
- a Typo 1 lransaclion (if llo largol bus numbor llo vaIuo in llo bridgos
Subordinalo Bus Numbor rogislor and > llan llo vaIuo in llo bridgo's
Bus Numbor rogislor).
Tlo subjocl of Typo 0 configuralion accossos is covorod in dolaiI in Typo 0
Configuralion Roquosl on pago 732. Tlo subjocl of Typo 1 configuralion
accossos is covorod in dolaiI in Typo 1 Configuralion Roquosl on pago 733.
SingIe Host/PCI Bridge
Rofor lo Iiguro 20-3 on pago 728. Tlo informalion vrillon lo llo Configuralion
Addross Iorl is Ialclod by llo Hosl/ICI bridgo villin llo Rool CompIox. If bil
31 is sol lo ono and llo largol bus numbor = llo vaIuo in llo bridgos Bus Num-
bor rogislor (or is llo vaIuo in llo bridgos Subordinalo Bus Numbor rogislor),
llo bridgo is onabIod lo convorl a subsoquonl procossor accoss largoling ils Con-
figuralion Dala Iorl inlo a configuralion accoss on bus 0 villin llo Rool Com-
pIox. Tlo procossor llon inilialos a ono-bylo, lvo-bylo, or four-bylo (for an x86
procossor indicalod by llo procossors bylo onabIo signaIs, or, if a IovorIC 60x
procossor, by A|29:31] and TSIZ|0:2]) IO road or vrilo lransaclion lo llo Config-
uralion Dala Iorl al 0CICl. Tlis slimuIalos llo bridgo lo porform a configura-
lion road (if llo procossor is roading from llo Configuralion Dala Iorl) or a
configuralion vrilo (if llo procossor is vriling lo llo Configuralion Dala Iorl).
Il viII bo a Typo 0 configuralion lransaclion if llo largol bus is bus 0, or a Typo 1
configuralion lransaclion if llo largol bus is furllor oul in llo bus liorarcly
boyond bus 0.
PCI Express System Architecture
728
-
Chapter 20: Configuration Mechanisms
729
MuItipIe Host/PCI Bridges
If lloro aro muIlipIo Rool CompIoxos prosonl on llo procossors ISB (rofor lo
Iiguro 20-4 on pago 730), llo Configuralion Addross and Dala porls aro dupIi-
calod al llo samo IO addrossos in oacl of lloir rospoclivo losl/ICI bridgos. In
ordor lo provonl conlonlion on llo procossor's ISB signaIs, onIy ono of llo
bridgos rosponds lo llo procossor's accossos lo llo configuralion porls.
1. Wlon llo procossor inilialos llo IO vrilo lo llo Configuralion Addross
Iorl, onIy ono of llo losl/ICI bridgos aclivoIy parlicipalos in llo lransac-
lion. Tlo ollor bridgo quiolIy snarfs llo dala as ils vrillon lo llo aclivo par-
licipanl.
2. Boll bridgos llon comparo llo largol bus numbor lo lloir rospoclivo Bus
Numbor and Subordinalo Bus Numbor rogislors. If llo largol bus doosn'l
rosido bolind a parlicuIar losl/ICI bridgo, llal bridgo doosnl convorl llo
subsoquonl accoss lo ils Configuralion Dala Iorl inlo a configuralion accoss
on ils bus (in ollor vords, il ignoros llo lransaclion).
3. A subsoquonl road or vrilo accoss lo llo Configuralion Dala Iorl is onIy
accoplod by llo losl/ICI bridgo llal is llo galovay lo llo largol bus. Tlis
bridgo rosponds lo llo procossors lransaclion and llo ollor ignoros il.
4. Wlon llo accoss is mado lo llo Configuralion Dala Iorl, llo bridgo vill a
bus comparo losls llo slalo of llo InabIo bil in ils Configuralion Addross
Iorl. If llo InabIod bil = 1, llo bridgo convorls llo procossors IO accoss
inlo a configuralion accoss:
o If llo largol bus is llo bus immodialoIy on llo ollor sido of llo Hosl/
ICI bridgo, llo bridgo convorls llo accoss lo a Typo 0 configuralion
accoss on ils socondary bus.
o Ollorviso, il convorls il inlo a Typo 1 configuralion accoss.
PCI Express System Architecture
730
-
Chapter 20: Configuration Mechanisms
731
PCI Express Enhanced Configuration Mechanism
Description
Rofor lo TabIo 20 - 1 on pago 732. Iacl funclions 4KB configuralion spaco slarls
al a 4KB-aIignod addross villin llo 256MB momory spaco sol asido as configu-
ralion spaco:
- Addross bils 63:28 indicalos llo 256MB-aIignod baso addross of llo ovoraII
Inlancod Configuralion addross rango.
- Addross bils 27:20 soIocl llo largol bus (1-of-256).
- Addross bils 19:15 soIocl llo largol dovico (1-of-32) on llo bus.
- Addross bils 14:12 soIocl llo largol funclion (1-of-8) villin llo dovico.
- Addross bils 11:2 soIocls llo largol dvord (1-of-1024) villin llo soIoclod
funclions configuralion spaco.
- Addross bils 1:0 dofino llo slarl bylo Iocalion villin llo soIoclod dvord.
Some RuIes
A Rool CompIox dosign is nol roquirod lo supporl an accoss lo llo onlancod
configuralion momory spaco llal crossos a dvord addross boundary (i.o., llo
accoss slraddIos lvo adjaconl momory dvords.
In addilion, somo procossor lypos can porform a sorios of momory accossos as
an alomic, IocIod, lransaclion sorios. A Rool CompIox dosign is nol roquirod lo
supporl an accoss lo llo onlancod configuralion momory spaco using llis IocI-
ing moclanism.
Tlis boing llo caso, soflvaro slouId avoid boll of llo sconarios jusl doscribod
unIoss il is Inovn llal llo Rool CompIox impIomonlalion boing usod supporls
llo lransIalion.
PCI Express System Architecture
732
Type 0 Configuration Request
A configuralion road or vrilo laIos llo form of a Typo 0 configuralion road or
vrilo vlon il arrivos on llo doslinalion bus. On discorning llal il is a Typo 0
configuralion oporalion:
1. Tlo dovicos on llo bus docodo llo loadors Dovico Numbor fioId lo dolor-
mino vlicl of llom is llo largol dovico.
2. Tlo soIoclod dovico docodos llo loadors Iunclion Numbor fioId lo dolor-
mino llo soIoclod funclion villin llo dovico.
3. Tlo soIoclod funclion usos llo concalonalod Ixlondod Rogislor Numbor and
Rogislor Numbor fioIds lo soIocl llo largol dvord in llo funclions configu-
ralion spaco.
4. IinaIIy, llo funclion usos llo Iirsl Dvord Bylo InabIo fioId lo soIocl llo
bylo(s) lo bo road or vrillon villin llo soIoclod dvord.
- --
-- -
A|63:28] Uppor bils of llo 256MB-aIignod baso addross of llo
256MB momory-mappod IO addross rango aIIocalod
for llo Inlancod Configuralion Moclanism.
Tlo mannor in vlicl llo baso addross is aIIocalod is
impIomonlalion-spocific. Il is suppIiod lo llo OS by
syslom firmvaro.
A|27:20] Targol Bus Numbor (1-of-256).
A|19:15] Targol Dovico Numbor (1-of-32).
A|14:12] Targol Iunclion Numbor (1-of-8).
A|11:2]
A|11:8] is llo uppor four bils of llo largol Dvord
Numbor (1-of-1024).
A|7:2] is llo Iovor six bils of llo largol Dvord Num-
bor.
A|1:0] AIong vill llo accoss sizo, dofinos llo Bylo InabIo
solling.
Chapter 20: Configuration Mechanisms
733
Iiguro 20-5 and Iiguro 20-6 iIIuslralo llo Typo 0 configuralion road and vrilo
roquosl loador formals. In boll casos, llo Typo fioId = 00100, vliIo llo slalo of
llo Iml fioIds msb indicalos vlollor ils a road or a vrilo.
Type 1 Configuration Request
WliIo in lransil lo llo doslinalion bus, a configuralion road or vrilo laIos llo
form of a Typo 1 configuralion road or vrilo vlon il is porformod on oacl bus
on llo vay lo llo doslinalion bus. Tlo onIy dovicos llal pay allonlion lo a Typo
1 configuralion road or vrilo aro ICI-lo-ICI bridgos. Upon rocoipl of a Typo 1
configuralion road or vrilo roquosl pacIol, a ICI-lo-ICI bridgo comparos llo
largol bus numbor in llo pacIol loador lo llo rango of busos llal rosido bolind
llo bridgo (as dofinod by llo conlonls of llo bridgos Socondary Bus Numbor
and Subordinalo Bus Numbor configuralion rogislors, soo Iiguro 20-3 on pago
728 and Iiguro 20-4 on pago 730).
-
-
PCI Express System Architecture
734
- If llo largol bus is llo bridgos socondary bus, llo pacIol is convorlod from
a Typo 1 lo a Typo 0 configuralion roquosl vlon il is passod lo llo socond-
ary bus. Tlo dovicos on llal bus llon docodo llo pacIol loador as provi-
ousIy doscribod in Typo 0 Configuralion Roquosl on pago 732.
- If llo largol bus is nol llo bridgos socondary bus bul is a bus llal rosidos
bonoall ils socondary bus, llo Typo 1 roquosl is passod llrougl lo llo
bridgos socondary bus as is.
Iiguro 20-7 and Iiguro 20-8 iIIuslralo llo Typo 1 configuralion road and vrilo
roquosl loador formals. In boll casos, llo Typo fioId = 00101, vliIo llo slalo of
llo Iml fioIds msb indicalos vlollor ils a road or a vrilo.
-
-
Chapter 20: Configuration Mechanisms
735
ExampIe PCI-CompatibIe Configuration Access
Rofor lo Iiguro 20-9 on pago 737. Tlo foIIoving x86 codo sampIo viII causo llo
Rool CompIox lo porform a road from Bus 4, Dovico 0, Iunclion 0s Vondor ID
configuralion rogislor:
- -- --
-
- --
- --

1. On oxoculion of llo (IO Wrilo) inslruclion, llo procossor gonoralos an
IO vrilo lransaclion on ils ISB largoling llo Configuralion Addross Iorl in
llo Rool CompIox Hosl/ICI bridgo. Tlo dala sourcod from llo oax rogislor
is Ialclod inlo llo Configuralion Addross Iorl (soo Iiguro 20-2 on pago
726).
2. Tlo Hosl/ICI bridgo comparos llo largol bus numbor (4) spocifiod in llo
Configuralion Addross Iorl lo llo rango of busos (0-llrougl-10) llal rosido
dovnslroam of llo bridgo. Tlo largol bus faIIs villin llo rango, so llo
bridgo is primod.
3. On oxoculion of llo (IO Road) inslruclion, llo procossor gonoralos an IO
road lransaclion on ils ISB largoling llo Configuralion Dala Iorl in llo
Rool CompIox Hosl/ICI bridgo. Ils a 2-bylo road from llo firsl lvo Ioca-
lions in llo Configuralion Dala Iorl.
4. Sinco llo largol bus is nol bus 0, llo Hosl/ICI bridgo inilialos a Typo 1 Con-
figuralion road on bus 0.
5. AII of llo dovicos on bus 0 Ialcl llo lransaclion roquosl and dolormino llal
il is a lypo 1 Configuralion Road roquosl. As a rosuIl, boll of llo virluaI
ICI-lo-ICI bridgos in llo Rool CompIox comparo llo largol bus numbor in
llo Typo 1 roquosl lo llo rango of busos llal rosido dovnslroam of oacl of
llom.
6. Tlo doslinalion bus (4) is villin llo rango of busos dovnslroam of llo Iofl-
land bridgo, so il passos llo pacIol llrougl lo ils socondary bus (bus 1). Il
is passod llrougl as a Typo 1 roquosl bocauso llis is nol llo doslinalion bus.
7. Tlo upslroam porl on llo Iofl-land svilcl rocoivos llo pacIol and doIivors
il lo llo upslroam ICI-lo-ICI bridgo.
8. Tlo bridgo dolorminos llal llo doslinalion bus rosidos bonoall il, so il
passos llo pacIol llrougl lo bus 2 as a Typo 1 roquosl.
9. Boll of llo bridgos villin llo svilcl rocoivo llo Typo 1 roquosl pacIol and
llo rigll-land bridgo dolorminos llal llo doslinalion bus is diroclIy
bonoall il.
PCI Express System Architecture
736
10. Tlo bridgo passos llo Typo 1 roquosl pacIol llrougl lo bus 4, bul convorls
inlo a Typo 0 Configuralion Road roquosl (bocauso llo pacIol las arrivod al
llo doslinalion bus.
11. Dovico 0 on bus 4 rocoivos llo pacIol and docodos llo largol dovico numbor.
12. Dovico 0 docodos llo largol funclion numbor.
13. Iunclion 0 in Dovico 0 usos llo concalonalod Ixlondod Rogislor Numbor
and Rogislor Numbor fioIds lo soIocl llo largol dvord (dvord 0, soo Iiguro
20-1 on pago 723) in llo funclions configuralion spaco.
14. Tlo firsl lvo Bylo InabIos in llo Iirsl Dvord Bylo InabIo fioId aro assorlod,
so llo funclion rolurns ils Vondor ID in llo rosuIling CompIolion pacIol.
Tlo CompIolion pacIol is roulod bacI lo llo Hosl/ICI bridgo using llo
Roquoslor ID fioId oblainod from llo Typo 0 roquosl pacIol.
15. Tlo lvo bylos of road dala aro doIivorod lo llo procossor ovor ils ISB,
lloroby compIoling llo oxoculion of llo inslruclion. Tlo Vondor ID is
pIacod in llo procossors ax rogislor.
ExampIe Enhanced Configuration Access
Rofor lo Iiguro 20-9 on pago 737. Tlo foIIoving x86 codo sampIo viII causo llo
Rool CompIox lo porform a road from Bus 4, Dovico 0, Iunclion 0s Vondor ID
configuralion rogislor. Tlo oxampIo assumos llal llo 256MB-aIignod baso
addross of llo Inlancod Configuralion momory-mappod IO rango is
50000000l:

- Addross bils 63:28 indicalos llo uppor 36 bils of llo 256MB-aIignod baso
addross of llo ovoraII Inlancod Configuralion addross rango (in llis caso,
000000005l).
- Addross bils 27:20 soIocl llo largol bus (in llis caso, 4).
- Addross bils 19:15 soIocl llo largol dovico (in llis caso, 0) on llo bus.
- Addross bils 14:12 soIocl llo largol funclion (in llis caso, 0) villin llo
dovico.
- Addross bils 11:2 soIocls llo largol dvord (in llis caso, 0) villin llo soIoclod
funclions configuralion spaco.
- Addross bils 1:0 dofino llo slarl bylo Iocalion villin llo soIoclod dvord (in
llis caso, 0).
Tlo procossor inilialos a 2-bylo momory road from momory Iocalions 50400000l
and 50400001l on ils ISB. Tlo roquosl is Ialclod by llo Hosl/ICI bridgo in llo
Rool CompIox. Il docodos llo addross and dolorminos llal il is a configuralion
road roquosl for llo firsl lvo bylos in dvord 0, funclion 0, dovico 0, bus 4. Tlo
romaindor of llo oporalion is llo samo as llal doscribod in llo provious soclion.
Chapter 20: Configuration Mechanisms
737
--
PCI Express System Architecture
738
InitiaI Configuration Accesses
Whats Going On During InitiaIization Time?
During iniliaIizalion limo, llo slarlup configuralion soflvaro is accossing llo
configuralion rogislors villin oacl funclion lo dolormino llo prosonco of a
funclion as voII as ils rosourco roquiromonls. ImmodialoIy aflor RST# is
romovod from a ICI or a ICI-X funclion, il may nol bo proparod lo sorvico con-
figuralion accossos on a limoIy basis. As an oxampIo, a funclions configuralion
rogislors migll nol conlain vaIid dofauIl vaIuos immodialoIy aflor RST# is
romovod. Iorlaps llo funclion musl slarl bacIIoading llis informalion inlo ils
configuralion rogislors from a soriaI IIIROM. In llis caso, il couId bo a sub-
slanliaI amounl of limo aflor RST# romovaI boforo llo funclion can provido road
dala from or accopl vrilo dala inlo ils configuralion rogislors. Ior llis roason,
funclions do nol lavo oboy llo 16 cIocI firsl Dala Ilaso compIolion ruIo during
iniliaIizalion limo.
Definition of InitiaIization Period In PCI
As dofinod in llo ICI 2.3 spoc, IniliaIizalion Timo (Trlfa) bogins vlon RST# is
doassorlod and compIolos 2
25
ICI cIocIs Ialor (32 moga-cycIos). Tlis paramolor
is roforrod lo in llo spoc as Trlfa (Timo from Rosol Higl-lo-Iirsl-Accoss). Al a
bus spood of 33MHz, llis oqualos lo 1.0066 soconds, vliIo il oqualos lo 0.5033
soconds al a bus spood of 66MHz. Run-limo foIIovs iniliaIizalion-limo. If a lar-
gol is accossod during iniliaIizalion-limo, il is aIIovod lo do any of llo foIIov-
ing:
- Ignoro llo roquosl (oxcopl if il is a bool dovico). A bool dovico is ono llal
musl rospond as a largol in ordor lo aIIov llo procossor lo accoss llo bool
ROM. In a lypicaI IC dosign, llis vouId bo ICH (IO ConlroI Hub). Dovicos
in llo procossors pall lo llo bool ROM slouId bo proparod lo bo llo largol
of a lransaclion immodialoIy aflor Trlff oxpiros (fivo cIocI cycIos aflor RST#
is doassorlod).
- CIaim llo accoss and loId in Wail Slalos unliI il can compIolo llo roquosl,
nol lo oxcood llo ond of IniliaIizalion Timo.
- CIaim llo accoss and lorminalo vill Rolry.
Chapter 20: Configuration Mechanisms
739
Definition of InitiaIization Period In PCI-X
In ICI-X, Trlfa is 2
26
cIocIs (64 moga-cycIos) in duralion rallor llan 2
25
as il is
in ICI. Tlis is bocauso llo ICI-X cIocI spood can bo subslanliaIIy faslor llan (up
lo 133MHz) llo ICI cIocI spood and if llis paramolor romainod llo samo as llo
ICI Trlfa spoc, IniliaIizalion Timo vouId bo roducod lo 0.25 soconds (al a cIocI
spood of 133MHz).
During IniliaIizalion Timo, a ICI-X largol las llo samo oplions avaiIabIo as a
ICI largol doos (soo provious soclion).
PCI Express and InitiaIization Time
}usl as in ICI or ICI-X, somo dovicos in a ICI Ixpross onvironmonl may go
llrougl a rallor Iong soIf-iniliaIizalion soquonco lo boforo lloy aro abIo lo sor-
vico configuralion accoss roquosls.
Wlon a ICI Ixpross dovico rocoivos a configuralion roquosl il may rospond
vill a Configuralion Roquosl Rolry CompIolion Slalus (CRS). Roquoslor rocoipl
of a CompIolion vill Configuralion Roquosl Rolry Slalus lorminalos llo config-
uralion accoss roquosl on ICI Ixpross.
InitiaI Configuration Access FaiIure Timeout
Aflor a ICI Ixpross dovico is rosol, llo Rool CompIox and/or syslom soflvaro
musl aIIov 1.0s (+50/-0) for llo dovico lo rolurn a SuccossfuI CompIolion
slalus boforo dociding llal llo dovico las maIfunclionod. Tlis is anaIogous lo
llo ICI/ICI-X Trlfa paramolor.
Wlon allompling a configuralion accoss lo a dovico on a ICI or ICI-X bus
dovnslroam of a ICI Ixpross-lo-ICI or -ICI-X bridgo, Trlfa musl bo laIon inlo
accounl.
DeIay Prior To InitiaI Configuration Access to Device
Aflor syslom lardvaro or soflvaro causos ono or moro dovicos lo bo rosol, sofl-
varo musl vail al Ioasl 100ms from llo ond of rosol boforo issuing any configu-
ralion roquosls lo lloso dovicos. Tlis limo poriod is aIIocalod lo aIIov llo
dovico(s) lo compIolo inlornaI iniliaIizalion.
PCI Express System Architecture
740
Tlo syslom dosign musl guaranloo (in a dosign-spocific mannor) llal aII compo-
nonls llal musl bo soflvaro visibIo al bool limo aro roady lo rocoivo configura-
lion roquosls villin 100ms of llo doassorlion of IundamonlaI Rosol al llo Rool
CompIox.
A Device With a Lengthy SeIf-InitiaIization Period
If a ICI Ixpross dovico roquiros addilionaI limo lo finisl ils soIf iniliaIizalion,
llo syslom dosign musl provido a dosign-spocific moclanism for ro-issuing con-
figuralion roquosls lorminalod vill CRS slalus aflor llo iniliaI 1s limooul las
oIapsod.
To onsuro propor onumoralion of llo syslom in a syslom running Iogacy ICI/
ICI-X basod soflvaro, llo Rool CompIox lardvaro musl ro-issuo llo configura-
lion roquosl.
RC Response To CRS Receipt During Run-Time
Aflor iniliaIizalion limo las oIapsod, llo aclion(s) laIon by llo Rool CompIox
upon rocoipl of a Configuralion Roquosl Rolry CompIolion Slalus is impIomon-
lalion-spocific. Il may ro-issuo llo configuralion roquosl as a nov roquosl or
may indicalo faiIod compIolion lo llo procossor.
If llo Rool CompIox is dosignod lo aulomalicaIIy rolry llo roquosl, llo numbor
of rolrios allomplod boforo indicaling a faiIuro lo llo procossor is dosign-spo-
cific.
During Run-Timo, supporl for a CompIolion Timooul (and llo duralion of llo
limooul) for configuralion roquosls aro impIomonlalion-spocific.
Tlo dofauIl solling in a ICI Ixpross-lo-ICI or -ICI-X bridgo provonls il from
rolurning a Configuralion Roquosl Rolry Slalus (CRS) for a configuralion
roquosl llal largols a ICI or ICI-X dovico dovnslroam of llo bridgo. Tlis can
rosuIl in a Ionglly compIolion doIay llal musl bo laIon inlo accounl by llo
CompIolion Timooul vaIuo usod by llo Rool CompIox. Configuralion soflvaro
can onabIo sucl a bridgo lo rolurn Configuralion Roquosl Rolry Slalus by sol-
ling llo Bridgo Configuralion Rolry InabIo bil in llo bridgos Dovico ConlroI
rogislor.
741
--

The Previous Chapter

Tlo provious claplor providod a dolaiIod doscriplion of llo lvo configuralion
moclanisms usod in a ICI Ixpross pIalform: llo ICI-compalibIo configuralion
moclanism, and llo ICI Ixpross onlancod configuralion moclanism. Il pro-
vidod a dolaiIod doscriplion of llo iniliaIizalion poriod immodialoIy foIIoving
povor-up, as voII as orror landIing during llis poriod.
This Chapter
Tlis claplor providos a dolaiIod doscriplion of llo discovory procoss and bus
numboring. Il doscribos:
- Inumoraling a syslom vill a singIo Rool CompIox
- Inumoraling a syslom vill muIlipIo Rool CompIoxos
- A muIlifunclion dovico villin a Rool CompIox or a Svilcl
- An Indpoinl omboddod in a Svilcl or Rool CompIox
- Aulomalic Roquoslor ID assignmonl.
- Rool CompIox Rogislor BIocIs (RCRBs)
The Next Chapter
Tlo noxl claplor providos a dolaiIod doscriplion of llo configuralion rogislors
rosiding a funclions ICI-compalibIo configuralion spaco. Tlis incIudos llo rog-
islors for boll non-bridgo and bridgo funclions.
Introduction
Tlo discussions associalod vill Iiguro 19-1 on pago 713 and Iiguro 20-4 on
pago 730 assumod llal, oacl of llo busos lad boon discovorod and numborod
oarIior in limo.
PCI Express System Architecture
742
In roaIily, al povor up limo, llo configuralion soflvaro onIy Inovs of llo oxisl-
onco of bus 0 (llo bus llal rosidos on llo dovnslroam sido of llo Hosl/ICI
bridgo) and doos nol ovon Inov vlal dovicos rosido on bus 0 (soo Iiguro 21-1
on pago 742).
Tlis claplor doscribos llo onumoralion procoss: llo procoss of discovoring llo
various busos llal oxisl and llo dovicos and funclions vlicl rosido on oacl of
llom.
Enumerating a System With a SingIe Root CompIex
Iiguro 21-2 on pago 748 iIIuslralos an oxampIo syslom boforo llo busos and
dovicos lavo boon onumoralod, vliIo Iiguro 21-3 on pago 749 slovs llo samo
syslom aflor llo busos and dovicos lavo boon onumoralod. Tlo discussion llal
foIIovs assumos llal llo configuralion soflvaro usos oillor of llo lvo configu-
ralion moclanisms dofinod in llo provious claplor. Al slarlup limo, llo config-
uralion soflvaro oxoculing on llo procossor porforms bus/dovico/funclion
onumoralion in llo foIIoving mannor:

Chapter 21: PCI Express Enumeration
743
1. Slarling vill dovico 0 (bridgo A), llo onumoralion soflvaro allompls lo
road llo Vondor ID from funclion 0 in oacl of llo 32 possibIo dovicos on bus
0.
- If a vaIid (nol IIIIl) Vondor ID is rolurnod from bus 0, dovico 0, func-
lion 0, llis indicalos llal llo dovico is impIomonlod and conlains al
Ioasl ono funclion. Irocood lo llo noxl slop.
- If a vaIuo of IIIIl voro rolurnod as llo Vondor ID, llis vouId indicalo
llal funclion 0 is nol impIomonlod in dovico 0. Sinco il is a ruIo llal llo
firsl funclion impIomonlod in any dovico musl bo funclion 0, llis vouId
moan llal dovico vas nol impIomonlod and llo onumoralion soflvaro
vouId procood lo probo bus 0, dovico 1, funclion 0.
2. Tlo Hoador Typo fioId (soo Iiguro 21-6 and Iiguro 21-7) in llo Hoador rogis-
lor (soo Iiguro 21-4) conlains llo vaIuo ono (0000001b) indicaling llal llis is
a ICI-lo-ICI bridgo vill llo ICI-compalibIo rogislor Iayoul slovn in Iig-
uro 21-7 on pago 752. Tlis discussion assumos llal llo MuIlifunclion bil (bil
7) in llo Hoador Typo rogislor is 0, indicaling llal funclion 0 is llo onIy
funclion in llis bridgo. - - -
- - - -
- -
3. Soflvaro nov porforms a sorios of configuralion vrilos lo sol llo bridgos
bus numbor rogislors as foIIovs:
- Irimary Bus Numbor Rogislor = 0.
- Socondary Bus Numbor Rogislor = 1.
- Subordinalo Bus Numbor Rogislor = 1.
Tlo bridgo is nov avaro llal llo numbor of llo bus diroclIy allaclod lo ils
dovnslroam sido is 1 (Socondary Bus Numbor = 1) and llo numbor of llo
bus farllosl dovnslroam of il is 1 (Subordinalo Bus Numbor = 1).
4. Soflvaro updalos llo Hosl/ICI bridgos Subordinalo Bus Numbor rogislor
lo 1.
5. Tlo onumoralion soflvaro roads bridgo As CapabiIily Rogislor (Iiguro 21-5
on pago 750 and TabIo 21 - 1 on pago 753, a dolaiIod doscriplion of llis rogis-
lor can bo found in ICI Ixpross CapabiIilios Rogislor on pago 898). Tlo
vaIuo 0100b in llo rogislors Dovico/Iorl Typo fioId indicalos llal llis a
Rool Iorl on llo Rool CompIox.
6. Tlo spocificalion slalos llal llo onumoralion soflvaro musl porform a
dopll-firsl soarcl, so boforo procooding lo discovor addilionaI funclions/
dovicos on bus 0, il musl procood lo soarcl bus 1.
7. Soflvaro roads llo Vondor ID of bus 1, dovico 0, funclion 0. A vaIid Vondor
ID is rolurnod, indicaling llal bus 1, dovico 0, funclion 0 oxisls.
8. Tlo Hoador Typo fioId in llo Hoador rogislor conlains llo vaIuo ono
(0000001b) indicaling llal llis is a ICI-lo-ICI bridgo. In addilion, bil 7 is a
0, indicaling llal bridgo C is a singIo-funclion dovico.
PCI Express System Architecture
744
9. Bridgo Cs CapabiIily Rogislor conlains llo vaIuo 0101b in llo Dovico/Iorl
Typo fioId indicaling llal llis is llo upslroam Iorl on a svilcl.
10. Soflvaro nov porforms a sorios of configuralion vrilos lo sol bridgo Cs bus
numbor rogislors as foIIovs:
- Irimary Bus Numbor Rogislor = 1.
- Socondary Bus Numbor Rogislor = 2.
- Subordinalo Bus Numbor Rogislor = 2.
Bridgo C is nov avaro llal llo numbor of llo bus diroclIy allaclod lo ils
dovnslroam sido is 2 (Socondary Bus Numbor = 2) and llo numbor of llo
bus farllosl dovnslroam of il is 2 (Subordinalo Bus Numbor = 2).
11. Soflvaro updalos llo Subordinalo Bus Numbor rogislors in llo Hosl/ICI
bridgo and in bridgo A lo 2.
12. Conlinuing vill ils dopll-firsl soarcl, a road is porformod from bus 2,
dovico 0, funclion 0s Vondor ID rogislor. Tlo oxampIo assumos llal bridgo
D is dovico 0, funclion 0 on bus 2.
13. A vaIid Vondor ID is rolurnod, indicaling llal bus 2, dovico 0, funclion 0
oxisls.
14. Tlo Hoador Typo fioId in llo Hoador rogislor conlains llo vaIuo ono
(0000001b) indicaling llal llis is a ICI-lo-ICI bridgo. In addilion, bil 7 is a
0, indicaling llal bridgo D is a singIo-funclion dovico.
15. Bridgo Ds CapabiIily Rogislor conlains llo vaIuo 0110b in llo Dovico/Iorl
Typo fioId indicaling llal llis is llo dovnslroam Iorl on a svilcl.
16. Soflvaro nov porforms a sorios of configuralion vrilos lo sol bridgo Ds bus
numbor rogislors as foIIovs:
- Irimary Bus Numbor Rogislor = 2.
- Socondary Bus Numbor Rogislor = 3.
- Subordinalo Bus Numbor Rogislor = 3.
Bridgo D is nov avaro llal llo numbor of llo bus diroclIy allaclod lo ils
dovnslroam sido is 3 (Socondary Bus Numbor = 3) and llo numbor of llo
bus farllosl dovnslroam of il is 3 (Subordinalo Bus Numbor = 3).
17. Soflvaro updalos llo Subordinalo Bus Numbor rogislors in llo Hosl/ICI
bridgo, bridgo A, and bridgo C lo 3.
18. Conlinuing vill ils dopll-firsl soarcl, a road is porformod from bus 3,
dovico 0, funclion 0s Vondor ID rogislor.
19. A vaIid Vondor ID is rolurnod, indicaling llal bus 3, dovico 0, funclion 0
oxisls.
20. Tlo Hoador Typo fioId in llo Hoador rogislor conlains llo vaIuo zoro
(0000000b) indicaling llal llis is an Indpoinl dovico. In addilion, bil 7 is a 1,
indicaling llal llis is a muIlifunclion dovico.
21. Tlo dovicos CapabiIily Rogislor conlains llo vaIuo 0000b in llo Dovico/
Iorl Typo fioId indicaling llal llis is an Indpoinl dovico.
22. Tlo onumoralion soflvaro porforms accossos lo llo Vondor ID of funclions
Chapter 21: PCI Express Enumeration
745
1-llrougl-7 in bus 3, dovico 0 and dolorminos llal onIy funclion 1 oxisls in
addilion lo funclion 0.
23. Having oxlauslod llo curronl Iog of llo dopll firsl soarcl, llo onumoralion
soflvaro bacIs up ono IovoI (lo bus 2) and movos on lo road llo Vondor ID
of llo noxl dovico (dovico 1). Tlo oxampIo assumos llal bridgo I is dovico 1,
funclion 0 on bus 2.
24. A vaIid Vondor ID is rolurnod, indicaling llal bus 2, dovico 1, funclion 0
oxisls.
25. Tlo Hoador Typo fioId in bridgo Is Hoador rogislor conlains llo vaIuo ono
(0000001b) indicaling llal llis is a ICI-lo-ICI bridgo. In addilion, bil 7 is a
0, indicaling llal bridgo I is a singIo-funclion dovico.
26. Bridgo Is CapabiIily Rogislor conlains llo vaIuo 0110b in llo Dovico/Iorl
Typo fioId indicaling llal llis is llo dovnslroam Iorl on a svilcl.
27. Soflvaro nov porforms a sorios of configuralion vrilos lo sol bridgo Is bus
numbor rogislors as foIIovs:
- Irimary Bus Numbor Rogislor = 2.
- Socondary Bus Numbor Rogislor = 4.
- Subordinalo Bus Numbor Rogislor = 4.
Bridgo I is nov avaro llal llo numbor of llo bus diroclIy allaclod lo ils
dovnslroam sido is 4 (Socondary Bus Numbor = 4) and llo numbor of llo
bus farllosl dovnslroam of il is 4 (Subordinalo Bus Numbor = 4).
28. Soflvaro updalos llo Subordinalo Bus Numbor rogislors in llo Hosl/ICI
bridgo, bridgo A, and bridgo C lo 4.
29. Conlinuing vill ils dopll-firsl soarcl, a road is porformod from bus 4,
dovico 0, funclion 0s Vondor ID rogislor.
30. A vaIid Vondor ID is rolurnod, indicaling llal bus 4, dovico 0, funclion 0
oxisls.
31. Tlo Hoador Typo fioId in llo Hoador rogislor conlains llo vaIuo zoro
(0000000b) indicaling llal llis is an Indpoinl dovico. In addilion, bil 7 is a 0,
indicaling llal llis is a singIo-funclion dovico.
32. Tlo dovicos CapabiIily Rogislor conlains llo vaIuo 0000b in llo Dovico/
Iorl Typo fioId indicaling llal llis is an Indpoinl dovico.
33. Having oxlauslod llo curronl Iog of llo dopll firsl soarcl, llo onumoralion
soflvaro bacIs up ono IovoI (lo bus 2) and movos on lo road llo Vondor ID
of llo noxl dovico (dovico 2). Tlo oxampIo assumos llal dovicos 2-llrougl-
31 aro nol impIomonlod on bus 2, so no addilionaI dovicos aro discovorod on
bus 2.
34. Tlo onumoralion soflvaro bacIs up lo llo bus villin llo Rool CompIox
(bus 0) and movos on lo road llo Vondor ID of llo noxl dovico (dovico 1).
Tlo oxampIo assumos llal bridgo B is dovico 1, funclion 0 on bus 0.
35. In llo samo mannor as proviousIy doscribod, llo onumoralion soflvaro dis-
covors bridgo B and porforms a sorios of configuralion vrilos lo sol bridgo
PCI Express System Architecture
746
Bs bus numbor rogislors as foIIovs:
- Irimary Bus Numbor Rogislor = 0.
- Socondary Bus Numbor Rogislor = 5.
- Subordinalo Bus Numbor Rogislor = 5.
Bridgo B is nov avaro llal llo numbor of llo bus diroclIy allaclod lo ils
dovnslroam sido is 5 (Socondary Bus Numbor = 5) and llo numbor of llo
bus farllosl dovnslroam of il is 5 (Subordinalo Bus Numbor = 5).
36. Tlo Hosl/ICIs Subordinalo Bus Numbor is updalod lo 5.
37. Bridgo I is llon discovorod and a sorios of configuralion vrilos aro por-
formod lo sol ils bus numbor rogislors as foIIovs:
- Irimary Bus Numbor Rogislor = 5.
- Socondary Bus Numbor Rogislor = 6.
- Subordinalo Bus Numbor Rogislor = 6.
Bridgo I is nov avaro llal llo numbor of llo bus diroclIy allaclod lo ils
dovnslroam sido is 6 (Socondary Bus Numbor = 6) and llo numbor of llo
bus farllosl dovnslroam of il is 6 (Subordinalo Bus Numbor = 6).
38. Tlo Hosl/ICI bridgos and bridgo B Subordinalo Bus Numbor rogislors aro
updalod lo 6.
39. Bridgo G is llon discovorod and a sorios of configuralion vrilos aro por-
formod lo sol ils bus numbor rogislors as foIIovs:
- Irimary Bus Numbor Rogislor = 6.
- Socondary Bus Numbor Rogislor = 7.
- Subordinalo Bus Numbor Rogislor = 7.
Bridgo I is nov avaro llal llo numbor of llo bus diroclIy allaclod lo ils
dovnslroam sido is 7 (Socondary Bus Numbor = 7) and llo numbor of llo
bus farllosl dovnslroam of il is 7 (Subordinalo Bus Numbor = 7).
40. Tlo Hosl/ICI bridgos Subordinalo Bus Numbor rogislor is updalod lo 7.
Bridgo B's and Is Subordinalo Bus Numbor rogislors aro aIso updalod lo 7.
41. A singIo-funclion Indpoinl dovico is discovorod al bus 7, dovico 0, funclion 0.
42. Bridgo H is llon discovorod and a sorios of configuralion vrilos aro por-
formod lo sol ils bus numbor rogislors as foIIovs:
- Irimary Bus Numbor Rogislor = 6.
- Socondary Bus Numbor Rogislor = 8.
- Subordinalo Bus Numbor Rogislor = 8.
Bridgo I is nov avaro llal llo numbor of llo bus diroclIy allaclod lo ils
dovnslroam sido is 8 (Socondary Bus Numbor = 8) and llo numbor of llo
bus farllosl dovnslroam of il is 8 (Subordinalo Bus Numbor = 8).
43. Tlo Hosl/ICI bridgos Subordinalo Bus Numbor rogislor is updalod lo 8.
Bridgo B's and Is Subordinalo Bus Numbor rogislors aro aIso updalod lo 8.
44. Bridgo } is discovorod and ils CapabiIily rogislors Dovico/Iorl Typo fioIds
idonlifios il as a ICI Ixpross-lo-ICI bridgo.
45. A sorios of configuralion vrilos aro porformod lo sol bridgo }s bus numbor
rogislors as foIIovs:
Chapter 21: PCI Express Enumeration
747
- Irimary Bus Numbor Rogislor = 8.
- Socondary Bus Numbor Rogislor = 9.
- Subordinalo Bus Numbor Rogislor = 9.
Bridgo I is nov avaro llal llo numbor of llo bus diroclIy allaclod lo ils
dovnslroam sido is 9 (Socondary Bus Numbor = 9) and llo numbor of llo
bus farllosl dovnslroam of il is 9 (Subordinalo Bus Numbor = 9).
46. Tlo Hosl/ICI bridgos Subordinalo Bus Numbor rogislor is updalod lo 9.
Bridgo B's, bridgo I's, and bridgo H's Subordinalo Bus Numbor rogislors aro
aIso updalod lo 9.
47. AII dovicos and lloir rospoclivo funclions on bus 9 aro discovorod and nono
of llom aro bridgos.
48. Bridgo I is llon discovorod and a sorios of configuralion vrilos aro por-
formod lo sol ils bus numbor rogislors as foIIovs:
- Irimary Bus Numbor Rogislor = 6.
- Socondary Bus Numbor Rogislor = 10.
- Subordinalo Bus Numbor Rogislor = 10.
Bridgo I is nov avaro llal llo numbor of llo bus diroclIy allaclod lo ils
dovnslroam sido is 10 (Socondary Bus Numbor = 10) and llo numbor of llo
bus farllosl dovnslroam of il is 10 (Subordinalo Bus Numbor = 10).
49. Tlo Hosl/ICI bridgos Subordinalo Bus Numbor rogislor is updalod lo 10.
Bridgo B's and bridgo I's Subordinalo Bus Numbor rogislors aro aIso
updalod lo 10.
50. A singIo-funclion Indpoinl dovico is discovorod al bus 10, dovico 0, func-
lion 0.
PCI Express System Architecture
748
- -
Chapter 21: PCI Express Enumeration
749
- -

PCI Express System Architecture

750
-
-
Chapter 21: PCI Express Enumeration
751

PCI Express System Architecture
752

Chapter 21: PCI Express Enumeration
753
Enumerating a System With MuItipIe Root CompIexes
Rofor lo Iiguro 21-8 on pago 757. In a syslom vill muIlipIo Rool CompIoxos,
oacl Rool CompIox:
- ImpIomonls llo Configuralion Addross Iorl and llo Configuralion Dala
Iorl al llo samo IO addrossos (if ils an x86-basod syslom).
- ImpIomonls llo Inlancod Configuralion Moclanism.
- Conlains a Hosl/ICI bridgo.
- ImpIomonls llo Bus Numbor and Subordinalo Bus Numbor rogislors al sop-
aralo addrossos Inovn lo llo configuralion soflvaro.
--
-
0000b ICI Ixpross Indpoinl dovico.
0001b Iogacy ICI Ixpross Indpoinl dovico.
0100b Rool Iorl of ICI Ixpross Rool CompIox. Tlis vaIuo is onIy vaIid for
dovicos/funclions llal impIomonl a Typo 01l ICI Configuralion
Spaco loador.
0101b Upslroam Iorl of ICI Ixpross Svilcl. Tlis vaIuo is onIy vaIid for
dovicos/funclions llal impIomonl a Typo 01l ICI Configuralion
Spaco loador.
0110b Dovnslroam Iorl of ICI Ixpross Svilcl. Tlis vaIuo is onIy vaIid for
dovicos/funclions llal impIomonl a Typo 01l ICI Configuralion
Spaco loador.
0111b ICI Ixpross-lo-ICI/ICI-X Bridgo. Tlis vaIuo is onIy vaIid for
dovicos/funclions llal impIomonl a Typo 01l ICI Configuralion
Spaco loador.
1000b ICI/ICI-X lo ICI Ixpross Bridgo. Tlis vaIuo is onIy vaIid for
dovicos/funclions llal impIomonl a Typo 01l ICI Configuralion
Spaco loador.
AII ollor oncodings aro rosorvod.
PCI Express System Architecture
754
In llo oxampIo iIIuslralion, oacl Rool CompIox is a mombor of llo clipsol and
ono of llom is dosignalod as llo bridgo lo bus 0 (Iols caII llis llo primary Rool
CompIox) vliIo llo ollor ono is dosignalod as llo bridgo lo bus 255 (bus IIl,
Iols caII il llo socondary Rool CompIox). Tlo dofauIl Bus Numbor and Subordi-
nalo Bus Numbor rogislor vaIuos al slarlup limo aro:
- In llo primary Rool CompIox, boll llo Bus Numbor and Subordinalo Bus
Numbor rogislors aro sol lo 0.
- In llo socondary Rool CompIox, boll llo Bus Numbor and Subordinalo Bus
Numbor rogislors aro sol lo IIl (255d).
OperationaI Characteristics of the PCI-CompatibIe
Mechanism
In ordor lo provonl conlonlion on llo procossor's ISB signaIs, onIy ono of llo
bridgos rosponds lo llo procossor's accossos lo llo configuralion porls:
1. Wlon llo procossor inilialos llo IO vrilo lo llo Configuralion Addross
Iorl, onIy ono of llo Hosl/ICI bridgos (lypicaIIy llo ono in llo primary
Rool CompIox) aclivoIy parlicipalos in llo lransaclion. Tlo ollor bridgo
quiolIy snarfs llo dala as ils vrillon lo llo aclivo parlicipanl.
2. Boll bridgos llon comparo llo largol bus numbor lo lloir rospoclivo Bus
Numbor and Subordinalo Bus Numbor rogislors. If llo largol bus doosn'l
rosido bolind a parlicuIar Hosl/ICI bridgo, llal bridgo doosnl convorl llo
subsoquonl accoss lo ils Configuralion Dala Iorl inlo a configuralion accoss
on ils bus (in ollor vords, il ignoros llo lransaclion).
3. A subsoquonl road or vrilo accoss lo llo Configuralion Dala Iorl is onIy
accoplod by llo Hosl/ICI bridgo llal is llo galovay lo llo largol bus. Tlis
bridgo rosponds lo llo procossors lransaclion and llo ollor ignoros il.
4. Wlon llo accoss is mado lo llo Configuralion Dala Iorl, llo soIoclod bridgo
losls llo slalo of llo InabIo bil in ils Configuralion Addross Iorl. If llo
InabIod bil = 1, llo bridgo convorls llo procossors IO accoss inlo a configu-
ralion accoss:
o If llo largol bus is llo bus immodialoIy on llo ollor sido of llo Hosl/
ICI bridgo, llo bridgo convorls llo accoss lo a Typo 0 configuralion
accoss on ils socondary bus.
o Ollorviso, il convorls il inlo a Typo 1 configuralion accoss.
Chapter 21: PCI Express Enumeration
755
OperationaI Characteristics of the Enhanced
Configuration Mechanism
In ordor lo provonl conlonlion on llo procossor's ISB signaIs, onIy ono of llo
bridgos rosponds lo llo procossor's accossos lo llo onlancod configuralion
momory-mappod IO spaco:
1. Wlon llo procossor inilialos a momory-mappod IO accoss lo a momory
Iocalion villin llo onlancod configuralion momory-mappod IO addross
rango, llo Hosl/ICI bridgos in oacl Rool CompIox oxaminos addross bils
A|27:20] lo dolormino llo largol bus numbor.
2. Tlo bridgo vloroin llo largol bus faIIs villin llo rango of busos dovn-
slroam of llal bridgo (as dofinod by llo conlonls of ils Bus Numbor and
Subordinalo Bus Numbor rogislors) acls as llo largol of llo procossors ISB
lransaclion vliIo llo ollor bridgo doos nol aclivoIy parlicipalo in llo lrans-
aclion.
3. Tlo bridgo vill a bus comparo convorls llo procossors momory accoss inlo
a configuralion accoss:
o If llo largol bus is llo bus immodialoIy on llo ollor sido of llo Hosl/
ICI bridgo, llo bridgo convorls llo accoss lo a Typo 0 configuralion
accoss on ils socondary bus.
o Ollorviso, il convorls il inlo a Typo 1 configuralion accoss.
The Enumeration Process
Rofor lo Iiguro 21-8 on pago 757. Tlo procoss of onumoraling llo busos dovn-
slroam of llo primary Rool CompIox is idonlicaI lo llal doscribod in Inumor-
aling a Syslom Will a SingIo Rool CompIox on pago 742. During llo
onumoralion of llo Iofl-land lroo slrucluro, llo Hosl/ICI bridgo in llo socond-
ary Rool CompIox ignorod aII of llo momory-mappod IO configuralion accossos
bocauso, in oacl caso, llo largol bus numbor llal vas spocifiod vas Ioss llan
bus 255. Il slouId bo nolod llal, aIllougl doloclod and numborod, bus 8 las no
dovico allaclod.
Onco llal onumoralion procoss las boon compIolod, llo onumoralion soflvaro
laIos llo foIIoving slops lo onumoralo llo busos and dovicos dovnslroam of
llo socondary Rool CompIox:
1. Tlo onumoralion soflvaro clangos boll llo Bus Numbor and Subordinalo
Bus Numbor rogislor vaIuos in llo socondary Rool CompIoxs Hosl/ICI
PCI Express System Architecture
756
bridgo lo bus 11 (ono groalor llan llo liglosl-numborod bus bonoall llo
primary Rool CompIox).
2. Tlo onumoralion soflvaro llon slarls soarcling on bus 11 and discovors llo
ICI-lo-ICI bridgo allaclod lo llo dovnslroam Rool Iorl.
3. A sorios of configuralion vrilos aro porformod lo sol ils bus numbor rogis-
lors as foIIovs:
- Irimary Bus Numbor Rogislor = 11.
- Socondary Bus Numbor Rogislor = 12.
- Subordinalo Bus Numbor Rogislor = 12.
Tlo bridgo is nov avaro llal llo numbor of llo bus diroclIy allaclod lo ils
dovnslroam sido is 12 (Socondary Bus Numbor = 12) and llo numbor of llo
bus farllosl dovnslroam of il is 12 (Subordinalo Bus Numbor = 12).
4. Tlo Hosl/ICIs Subordinalo Bus Numbor is updalod lo 12.
5. A singIo-funclion Indpoinl dovico is discovorod al bus 12, dovico 0, func-
lion 0.
6. Inumoralion conlinuos on bus 11 and no addilionaI dovicos aro discovorod.
Tlis compIolos llo bus/dovico onumoralion procoss.
Chapter 21: PCI Express Enumeration
757
-
IniliaIIy, Bus Numbor
and Subordinalo
Bus Numbors = 255.
PCI Express System Architecture
758
A MuItifunction Device Within a Root CompIex or a Switch
A MuItifunction Device Within a Root CompIex
Rofor lo Iiguro 21-9 on pago 759.
Tlo spoc is uncIoar on vlollor or nol a I2I on llo rool bus villin a Rool Com-
pIox can bo a muIlifunclion dovico. Il slalos llal llo ruIos rogarding llo impIo-
monlalion of llo Hoador Rogislor (soo Iiguro 21-7 on pago 752) in a ICI-lo-ICI
bridgo villin a Rool CompIox or a Svilcl aro dofinod by llo ICI 2.3 spoc rallor
llan llo ICI Ixpross spoc. Tlis boing llo caso, il vouId bo IogaI for funclion 0 in
a bridgo llal rosidos on llo inlornaI bus of a Rool CompIox lo lavo llo MuIli-
funclion bil (bil 7) in llo Hoador Rogislor sol lo 1. Tlis vouId indicalo llal up lo
sovon addilionaI funclions couId rosido villin llis Rool CompIox dovico and
oacl of llom couId bo ICI-lo-ICI bridgos.
Tlo onIy opon issuo in llo aullors oyos is llo conlonls of llo Dovico/Iorl Typo
fioId in llo CapabiIily rogislor (soo Iiguro 21-5 on pago 750 and TabIo 21 - 1 on
pago 753) of oacl of lloso bridgo funclions. Il is assumod llal il vouId lavo lo
bo 0100b (i.o., Rool Iorl of ICI Ixpross Rool CompIox).
Chapter 21: PCI Express Enumeration
759
A MuItifunction Device Within a Switch
Rofor lo Iiguro 21-10 on pago 760 and Iiguro 21-11 on pago 761. Tlo spoc
doosnl procIudo llo incIusion of a muIlifunclion dovico villin a svilcl
vloroin oacl of llo funclions roprosonls a ICI-lo-ICI bridgo lo a dovnslroam
IinI.
In llo firsl oxampIo llo svilcls inlornaI bus impIomonls lvo muIlifunclion
dovicos oacl of vlicl conlains four funclions, and oacl funclion is llo bridgo lo
ono of llo svilcls dovnslroam porls. In llo svilcls upslroam porl bridgo, llo
conlonls of llo Dovico/Iorl Typo fioId in llo CapabiIily rogislor (soo Iiguro 21-5
on pago 750 and TabIo 21 - 1 on pago 753) is 0101b (i.o., Upslroam Iorl of ICI
Ixpross Svilcl).
In llo socond oxampIo, llo bridgo roprosonling llo svilcls upslroam porl is
dovico 0 on llo IinI (i.o. bus) onloring llo svilcl and il is a muIlifunclion dovico
conlaining lvo funclions oacl of vlicl is a bridgo lo a soparalo inlornaI svilcl
bus. Tlo conlonls of llo Dovico/Iorl Typo fioId in llo CapabiIily rogislor (soo
-
PCI Express System Architecture
760
Iiguro 21-5 on pago 750 and TabIo 21 - 1 on pago 753) of oacl of lloso funclions
is 0101b (i.o., Upslroam Iorl of ICI Ixpross Svilcl). Iacl of llo inlornaI busos
las lvo muIlifunclion dovicos allaclod, and oacl funclion is llo bridgo lo ono
of llo svilcls dovnslroam porls. Tlo conlonls of llo Dovico/Iorl Typo fioId in
llo CapabiIily rogislor (soo Iiguro 21-5 on pago 750 and TabIo 21 - 1 on pago 753)
of oacl of lloso funclions is 0110b (i.o., Dovnslroam Iorl of ICI Ixpross
Svilcl).
-
Chapter 21: PCI Express Enumeration
761
An Endpoint Embedded in a Switch or Root CompIex
Tlo spoc conlains llo foIIoving lvo slalomonls:
- Indpoinl dovicos (roprosonlod by Typo 00l Configuralion Spaco loadors)
may nol appoar lo configuralion soflvaro on llo svilcl's inlornaI bus as
poors of llo virluaI ICI-lo-ICI Bridgos roprosonling llo Svilcl Dovn-
slroam Iorls.
- Svilcl Dovnslroam Iorls aro ICI-ICI Bridgos bridging from llo inlornaI
bus lo busos roprosonling llo Dovnslroam ICI Ixpross IinIs from a ICI
Ixpross Svilcl. OnIy llo ICI-ICI Bridgos roprosonling llo Svilcl Dovn-
slroam Iorls may appoar on llo inlornaI bus. Indpoinls, roprosonlod by
Typo 0 configuralion spaco loadors, may nol appoar on llo inlornaI bus.
Nolling in llis loxl forbids llo impIomonlalion of an Indpoinl dovico villin a
svilcl. In addilion, nolling in llo spoc forbids llo impIomonlalion of an Ind-
poinl dovico villin a Rool CompIox. Iiguro 21-12 on pago 762 and Iiguro 21-13
on pago 763 iIIuslralo oxampIos of lloso dosign casos.

PCI Express System Architecture
762

Chapter 21: PCI Express Enumeration
763
Memorize Your Identity
GeneraI
Wlonovor a funclion inilialos a lransaclion as a roquoslor, il musl suppIy ils
Roquoslor ID in llo pacIols loador. IiIoviso, vlon a funclion inilialos a lrans-
aclion as a CompIolor, il musl suppIy ils CompIolor ID in llo pacIol loador.
Boll of lloso IDs aro comprisod of llo Bus Numbor, Dovico Numbor and Iunc-
lion Numbor.
Tlo funclion Inovs vlicl funclion numbor il is villin ils dovico, bul lov
doos il Inov llo dovico il rosidos villin and vlal bus il rosidos on`

PCI Express System Architecture
764
Iacl limo llal llo sourco bridgo for a bus inilialos a lypo 0 configuralion vrilo
lransaclion (soo Iiguro 21-14 on pago 764), il suppIios llo largolod funclion vill
llo bus numbor from ils Socondary Bus Numbor rogislor and llo numbor of llo
dovico llal llo funclion rosidos villin. Tlo funclion is roquirod lo savo llis
informalion for uso in forming ils IDs vlon il inilialos a lransaclion as oillor a
Roquoslor or as a CompIolor. Tlo informalion is nol savod in program roadabIo
rogislors bul rallor in a funclion-spocific mannor.
A lol-pIug ovonl sucl as llo inslaIIalion or llo romovaI of a dovico can causo
llo onumoralion soflvaro lo ro-assign bus numbors in a porlion of llo bus lior-
arcly. If and vlon llis slouId occur, llo onumoralion soflvaro is roquirod lo
porform a configuralion vrilo lo al Ioasl ono rogislor (any rogislor) villin oacl
funclion in oacl dovico llal rosidos on a bus llal las rocoivod a nov numbor. In
llis mannor, oacl funclion on llo bus is providod vill llo nov bus numbor (as
voII as ils dovico numbor) lo bo usod in lloir rospoclivo IDs.
Root CompIex Bus Number/Device Number
Assignment
Tlo mannor in vlicl llo bus numbor and dovico numbor aro assignod lo func-
lions rosiding on llo inlornaI bus of a Rool CompIox is dosign-spocific.
Initiating Requests Prior To ID Assignment
Boforo llo firsl lypo 0 configuralion vrilo is porformod lo a funclion, il doos nol
Inov llo bus numbor and dovico numbor porlion of ils ID. WliIo il romains in
llis slalo, a funclion is nol pormillod lo inilialo non-poslod roquosls (momory
vrilo roquosls and mossago roquosls). Tloro is ono oxcoplion:
-
Chapter 21: PCI Express Enumeration
765
- Iunclions villin a Rool CompIox aro pormillod lo inilialo roquosls for
accossos lo syslom bool dovico(s).
Initiating CompIetions Prior to ID Assignment
If a funclion musl gonoralo a CompIolion boforo llo firsl lypo 0 configuralion
vrilo is porformod lo il, llo Bus Numbor and Dovico Numbor fioIds in ils Com-
pIolor ID musl bo sol lo zoros. Tlo Roquosl issuor (llo Roquoslor) musl ignoro
llo vaIuo rolurnod in llo CompIolor ID fioId.
Root CompIex Register BIocks (RCRBs)
What ProbIem Does an RCRB Address?
Rofor lo Iiguro 21-15 on pago 766. Main momory is an oxlromoIy popuIar largol.
In addilion lo llo procossor, il is accossod by llo graplics conlroIIor and is fro-
quonlIy accossod by ICI, ICI-X and ICI Ixpross dovicos. Tlis boing llo caso, al
a givon momonl in limo, llo Rool CompIox may simuIlanoousIy rocoivo mom-
ory accoss roquosls llrougl muIlipIo ingross porls:
- Tlo ISB inlorfaco.
- Tlo graplics IinI.
- Ono or moro Rool Iorls.
Il slouId bo obvious llal a lraffic diroclor (IaboIod Iorl/VC Arbilralion) musl
bo impIomonlod villin llo Rool CompIox. In ils simpIosl form, llo Rool Com-
pIox may impIomonl a lardvirod lraffic diroclor.
In addilion lo simpIy landIing muIlipIo simuIlanoous roquosls, llo lraffic diroc-
lor may aIso lavo lo doaI vill QoS issuos. Somo of llo momory accoss roquosl-
ors may roquiro faslor accoss llan ollors. Tlo Rool CompIox Rogislor BIocI
vouId bo usod lo program llo momory conlroIIors ogross porl Iogic rogarding
TC-lo-VC mapping and llo VC arbilralion aIgorillm.
PCI Express System Architecture
766
AdditionaI Information on RCRBs
AddilionaI informalion on RCRBs may bo found in RCRB on pago 957.
MisceIIaneous RuIes
A SpIit Configuration Transaction Requires a SingIe
CompIetion
If a configuralion lransaclion is spIil, llo Roquoslor oxpocls lo rocoivo ono and
onIy ono CompIolion lransaclion conlaining llo dvord or Ioss of roquoslod road
dala.

Chapter 21: PCI Express Enumeration
767
An Issue For PCI Express-to-PCI or -PCI-X Bridges
If sucl a bridgo rocoivos a configuralion roquosl largoling a ICI or ICI-X func-
lion and llo Ixlondod Rogislor Addross fioId is non-zoro, llo bridgo musl
rolurn a UR (Unsupporlod Roquosl) slalus lo llo Roquoslor.
PCI SpeciaI CycIe Transactions
If soflvaro musl causo a ICI SpociaI CycIo lransaclion lo bo gonoralod on a ICI
or ICI-X bus, il laIos llo foIIoving aclions.
To primo llo Hosl/ICI bridgo lo gonoralo a ICI SpociaI CycIo lransaclion, sofl-
varo musl vrilo a 32-bil vaIuo vill llo foIIoving conlonl lo llo Configuralion
Addross Iorl al IO addross 0CI8l:
- Bus Numbor = llo largol ICI Bus llal llo SpociaI CycIo lransaclion is lo bo
porformod on.
- Dovico Numbor = aII onos (31d, or 1Il).
- Iunclion Numbor = aII onos (7d).
- Dvord Numbor = aII zoros.
Aflor llis las boon accompIislod, llo noxl vrilo lo llo Configuralion Dala Iorl
al IO porl 0CICl causos llo Hosl/ICI bridgo lo pass llo lransaclion llrougl as
a Typo 1 configuralion vrilo (so llal il can bo submillod lo ICI-lo-ICI bridgos
farllor oul in llo liorarcly). Tlo lypo 1 configuralion vrilo roquosl viII fIov
unclangod llrougl aII of llo bridgos in llo pall lo llo largol ICI/ICI-X bus
unliI il finaIIy arrivos al llo doslinalion ICI Ixpross-lo-ICI/ICI-X bridgo. Tlis
bridgo convorls llo roquosl in lo a ICI SpociaI CycIo lransaclion and llo dala
vrillon lo llo Hosl/ICI bridgos Configuralion Dala Iorl is suppIiod as llo
mossago in llo Dala Ilaso of llo rosuIlanl ICI or ICI-X lransaclion.
769

--
The Previous Chapter
Tlo provious claplor providos a dolaiIod doscriplion of llo discovory procoss
and bus numboring. Il doscribod:
- Inumoraling a syslom vill a singIo Rool CompIox
- Inumoraling a syslom vill muIlipIo Rool CompIoxos
- A muIlifunclion dovico villin a Rool CompIox or a Svilcl
- An Indpoinl omboddod in a Svilcl or Rool CompIox
- Aulomalic Roquoslor ID assignmonl.
- Rool CompIox Rogislor BIocIs (RCRBs)
This Chapter
Tlis claplor providos a dolaiIod doscriplion of llo configuralion rogislors rosid-
ing a funclions ICI-compalibIo configuralion spaco. Tlis incIudos llo rogislors
for boll non-bridgo and bridgo funclions.
The Next Chapter
Tlo noxl claplor providos a dolaiIod doscriplion of dovico ROMs associalod
vill ICI, ICI Ixpross, and ICI-X funclions. Tlis incIudos llo foIIoving lopics:
- dovico ROM doloclion.
- inlornaI codo/dala formal.
- sladoving.
PCI Express System Architecture
770
- iniliaIizalion codo oxoculion.
- inlorrupl looIing.
Header Type 0
GeneraI
Iiguro 22-1 on pago 771 iIIuslralos llo formal of a funclions Hoador rogion (for
funclions ollor llan ICI-lo-ICI bridgos and CardBus bridgos). Tlo rogislors
marIod in bIacI aro aIvays mandalory. Nolo llal aIllougl many of llo config-
uralion rogislors in llo figuro aro nol marIod mandalory, a rogislor may bo
mandalory for a parlicuIar lypo of dovico. Tlo subsoquonl soclions dofino oacl
rogislor and any circumslancos vloroin il may bo mandalory.
As nolod oarIior, llis formal is dofinod as Hoador Typo 0. Tlo rogislors villin
llo Hoador aro usod lo idonlify llo dovico, lo conlroI ils funclionaIily and lo
sonso ils slalus in a gonoric mannor. Tlo usago of llo dovicos romaining 48
dvords of ICI-compalibIo configuralion spaco is inlondod for dovico-spocific
rogislors, bul, vill llo advonl of llo 2.2 ICI spoc, is aIso usod as an ovorfIov
aroa for somo nov rogislors dofinod in llo ICI spoc (for moro informalion, rofor
lo CapabiIilios Ioinlor Rogislor on pago 779).
Chapter 22: PCI Compatible Configuration Registers
771

PCI Express System Architecture
772
Header Type 0 Registers CompatibIe With PCI
Tlo Hoador Typo 0 ICI configuralion rogislors llal aro impIomonlod and usod
idonlicaIIy in ICI and ICI Ixpross aro:
- Vondor ID rogislor.
- Dovico ID rogislor.
- Rovision ID rogislor.
- CIass Codo rogislor.
- Subsyslom Vondor ID rogislor.
- Subsyslom ID rogislor.
- Hoador Typo rogislor.
- BIST rogislor.
- CapabiIilios Ioinlor rogislor.
- CardBus CIS Ioinlor rogislor.
- Ixpansion ROM Baso Addross rogislor.
Tlo soclions llal foIIov provido a doscriplion of oacl of lloso rogislors.
Header Type 0 Registers IncompatibIe With PCI
In a non-bridgo ICI Ixpross funclion, llo dofinilions of llo foIIoving configura-
lion rogislors in llo funclions ICI-compalibIo configuralion spaco diffor from
llo ICI spocs dofinilion of llo rospoclivo rogislor dofinilions:
- Command Rogislor
- Slalus Rogislor
- Caclo Iino Sizo Rogislor
- Maslor Ialoncy Timor Rogislor
- Inlorrupl Iino Rogislor
- Inlorrupl Iin Rogislor
- Baso Addross Rogislors
- Min_Gnl/Max_Ial Rogislors
Tlo soclions llal foIIov dofino llo impIomonlalion/usago difforoncos of lloso
rogislors. Ior a fuII doscriplion of lloir impIomonlalion in a ICI funclion, rofor
lo llo MindSlaro booI onlilIod - (pub-
Iislod by Addison-WosIoy). Ior a fuII doscriplion of lloir impIomonlalion in a
ICI-X funclion, rofor lo llo MindSlaro booI onlilIod - ,
Iirsl Idilion (pubIislod by Addison-WosIoy).
Chapter 22: PCI Compatible Configuration Registers
773
Registers Used to Identify Devices Driver
Tlo OS usos somo combinalion of llo foIIoving mandalory rogislors lo dolor-
mino vlicl drivor lo Ioad for a dovico:
- Vondor ID.
- Dovico ID.
- Rovision ID.
- CIass Codo.
- SubSyslom Vondor ID.
- SubSyslom ID.
Vendor ID Register
- - . Tlis 16-bil rogislor idonlifios llo man-
ufacluror of llo funclion. Tlo vaIuo lardvirod in llis road-onIy rogislor is
assignod by a conlraI aullorily (llo ICI SIG) llal conlroIs issuanco of llo num-
bors. Tlo vaIuo IIIIl is rosorvod and musl bo rolurnod by llo Hosl/ICI bridgo
vlon an allompl is mado lo porform a configuralion road from a configuralion
rogislor in a non-oxislonl funclion. In ICI or ICI-X, llo road allompl rosuIls in a
Maslor Aborl, vliIo in ICI Ixpross il rosuIls in llo rolurn of UR (Unsupporlod
Roquosl) compIolion slalus. In oillor caso, llo bridgo musl rolurn a Vondor ID
of IIIIl. Tlo orror slalus rolurnod is nol considorod lo bo an orror, bul llo spoc-
ificalion says llal llo bridgo musl nonolloIoss sol ils Rocoivod Maslor Aborl bil
in ils configuralion Slalus rogislor.
Device ID Register
- - . Tlis 16-bil vaIuo is assignod by llo
funclion manufacluror and idonlifios llo lypo of funclion. In conjunclion vill
llo Vondor ID and possibIy llo Rovision ID, llo Dovico ID can bo usod lo Iocalo
a funclion-spocific (and porlaps rovision-spocific) drivor for llo funclion.
Revision ID Register
- - . Tlis 8-bil vaIuo is assignod by llo
funclion manufacluror and idonlifios llo rovision numbor of llo funclion. If llo
vondor las suppIiod a rovision-spocific drivor, llis is landy in onsuring llal llo
corrocl drivor is Ioadod by llo OS.
PCI Express System Architecture
774
CIass Code Register
- - . Tlo CIass Codo rogislor
is piclurod in Iiguro 22-2 on pago 775. Il is a 24-bil, road-onIy rogislor
dividod inlo llroo fioIds: baso CIass, Sub CIass, and Irogramming Inlorfaco.
Il idonlifios llo basic funclion of llo funclion (o.g., a mass slorago conlroI-
Ior), a moro spocific funclion sub-cIass (o.g., IDI mass slorago conlroIIor),
and, in somo casos, a rogislor-spocific programming inlorfaco (sucl as a spo-
cific fIavor of llo IDI rogislor sol).
- Tlo uppor bylo dofinos llo baso CIass of llo funclion,
- llo middIo bylo dofinos a sub-cIass villin llo baso CIass,
- and llo Iovor bylo dofinos llo Irogramming Inlorfaco.
Tlo curronlIy-dofinod baso CIass codos aro Iislod in TabIo 22-1 on pago 775.
TabIo 2 on pago 1020 llrougl TabIo 19 on pago 1031 dofino llo SubcIassos
villin oacl baso CIass. Ior many CIass/SubCIass calogorios, llo Irogram-
ming Inlorfaco bylo is lardvirod lo rolurn zoros (in ollor vords, il las no
moaning). Ior somo, sucl as VGA-compalibIo funclions and IDI conlroI-
Iors, il doos lavo moaning.
Tlis rogislor is usofuI vlon llo OS is allompling lo Iocalo a funclion llal a
CIass drivor can vorI vill. As an oxampIo, assumo llal a parlicuIar dovico
drivor las boon vrillon lo vorI vill any dispIay adaplor llal is 100 XGA
rogislor sol-compalibIo. If llo OS can Iocalo a funclion vill a CIass of 03l
(soo TabIo 22-1 on pago 775) and a Sub CIass of 01l (soo TabIo 5 on
pago 1022), llo drivor viII vorI vill llal funclion. A CIass drivor is moro
fIoxibIo llan a drivor llal las boon vrillon lo vorI onIy vill a spocific
funclion from a spocific vondor.
Ior somo funclions (sucl as llo XGA
dispIay adaplor usod as an oxampIo in llo provious soclion) llo combina-
lion of llo CIass Codo and Sub CIass Codo is sufficionl lo fuIIy-dofino ils
IovoI of rogislor sol compalibiIily. Tlo rogislor sol Iayoul for somo funclion
lypos, lovovor, can vary from ono impIomonlalion lo anollor. As an oxam-
pIo, from a programming inlorfaco porspoclivo lloro aro a numbor of fIavors
of IDI mass slorago conlroIIors, so ils nol sufficionl lo idonlify yoursoIf as
an IDI mass slorago conlroIIor. Tlo Irogramming Inlorfaco bylo vaIuo (soo
TabIo 20 on pago 1031) providos llo finaI IovoI of granuIarily llal idonlifios
llo oxacl rogislor sol Iayoul of llo funclion.
Chapter 22: PCI Compatible Configuration Registers
775
-- - A dolaiIod doscriplion of llo cur-
ronlIy-dofinod CIassos, SubCIassos, and Irogramming Inlorfaco Bylo vaIuos
can bo found in Appondix D.
-- -
-- -
-- -
00l Iunclion buiIl boforo cIass codos voro dofinod (in ollor vords:
boforo rov 2.0 of llo ICI spoc).
01l Mass slorago conlroIIor.
02l NolvorI conlroIIor.
03l DispIay conlroIIor.
04l MuIlimodia dovico.
05l Momory conlroIIor.
06l Bridgo dovico.
07l SimpIo communicalions conlroIIors.
08l Baso syslom poriploraIs.
09l Inpul dovicos.
0Al DocIing slalions.
0Bl Irocossors.
0Cl SoriaI bus conlroIIors.
0Dl WiroIoss conlroIIors.
0Il InloIIigonl IO conlroIIors.
PCI Express System Architecture
776
Subsystem Vendor ID and Subsystem ID Registers
- . Tlis rogislor pair vas addod in
rovision 2.1 of llo ICI spoc and vas oplionaI. Tlo 2.2 ICI spoc and llo ICI-
X spoc slalo llal lloy aro mandalory oxcopl for lloso funclions llal lavo a
baso CIass of 06l (a Bridgo) vill a Sub CIass of 00l-04l (rofor lo TabIo 8 on
pago 1023), or a baso CIass of 08l (Baso Syslom IoriploraIs) vill a Sub
CIass of 00l-03l (soo TabIo 10 on pago 1026). Tlis oxcIudos bridgos of llo
foIIoving lypos:
- Hosl/ICI
- ICI-lo-IISA
- ICI-lo-ISA
- ICI-lo-Micro ClannoI
- ICI-lo-ICI
Il aIso oxcIudos llo foIIoving gonoric syslom poriploraIs:
- Inlorrupl ConlroIIor
- DMA ConlroIIor
- IrogrammabIo Timors
- RTC ConlroIIor
Tlo Subsyslom Vondor ID is oblainod from llo SIG, vliIo llo vondor sup-
pIios ils ovn Subsyslom ID (llo fuII namo of llis rogislor is roaIIy "Sub-
syslom Dovico ID", bul llo dovico is siIonl). A vaIuo of zoro in lloso
rogislors indicalos lloro isnl a Subsyslom Vondor and Subsyslom ID associ-
alod vill llo funclion.
- - A funclion may rosido on
a card or villin an omboddod dovico. Iunclions dosignod around llo samo
0Il SaloIIilo communicalions conlroIIors.
10l Incryplion/Docryplion conlroIIors.
11l Dala acquisilion and signaI procossing conlroIIors.
12l-IIl Rosorvod.
IIl Dovico doos nol fil any of llo dofinod cIass codos.
-- -
-- -
Chapter 22: PCI Compatible Configuration Registers
777
ICI/ICI-X, or ICI Ixpross coro Iogic (producod by a llird-parly) may lavo
llo samo Vondor and Dovico IDs (if llo coro Iogic vondor lardvirod lloir
ovn IDs inlo lloso rogislors). If llis is llo caso, llo OS vouId lavo a prob-
Iom idonlifying llo corrocl drivor lo Ioad inlo momory for llo funclion.
Tloso lvo mandalory rogislors (Subsyslom Vondor ID and Subsyslom ID)
aro usod lo uniquoIy idonlify llo add-in card or subsyslom llal llo funclion
rosidos villin. Using lloso lvo rogislors, llo OS can dislinguisl llo diffor-
onco bolvoon cards or subsysloms manufaclurod by difforonl vondors bul
dosignod around llo samo llird-parly coro Iogic. Tlis pormils llo IIug-
and-IIay OS lo Iocalo llo corrocl drivor lo Ioad inlo momory.
- - -- Tloso lvo rogislors
musl conlain lloir assignod vaIuos boforo llo syslom firsl accossos llom. If
soflvaro allompls lo accoss llom boforo lloy lavo boon iniliaIizod, llo
dovico musl issuo:
- a Rolry lo llo maslor (in ICI).
- a CompIolion vill CRS (Configuralion Roquosl Rolry CompIolion Sla-
lus) in ICI Ixpross.
Tlo vaIuos in lloso rogislors couId bo lardvirod, Ioadod from a soriaI
IIIROM, dolorminod from lardvaro slrapping pins, olc.
Header Type Register
- - . Iiguro 22-3 on pago 778 iIIuslralos llo
formal of llo Hoador Typo rogislor. Bils |6:0] of llis ono bylo rogislor dofino llo
formal of dvords 4-llrougl-15 of llo funclions configuralion Hoador (soo Iig-
uro 22-1 on pago 771 and Iiguro 22-13 on pago 803). In addilion, bil sovon
dofinos llo dovico as a singIo- (bil 7 = 0) or muIlifunclion (bil 7 = 1) dovico. Dur-
ing configuralion, llo programmor dolorminos if lloro aro any ollor funclions
in llis dovico llal roquiro configuralion by losling llo slalo of bil sovon.
CurronlIy, llo onIy Hoador formals dofinod ollor llan llal piclurod in Iiguro
22-1 on pago 771 ( ) aro:
- (ICI-lo-ICI bridgo Hoador formal, doscriplion can bo
found in Hoador Typo 1 on pago 802).
- and (CardBus bridgo, dolaiI can bo found in llo IC Card
spocificalion and in llo MindSlaro booI onlilIod - -
(pubIislod by Addison-WosIoy).
Iuluro vorsions of llo spocificalion may dofino ollor formals.
PCI Express System Architecture
778
BIST Register
- . Tlis rogislor may bo impIomonlod by boll
Roquoslor and CompIolor funclions. If a funclion impIomonls a BuiIl-In SoIf-Tosl
(BIST), il musl impIomonl llis rogislor as iIIuslralod in Iiguro 22-4 on pago 778.
TabIo 22-2 on pago 779 doscribos oacl bil's funclion. If llo funclion doosn'l sup-
porl a BIST, llis rogislor musl rolurn zoros vlon road. Tlo funclions BIST is
invoIod by solling bil six lo ono. Tlo funclion rosols bil six upon compIolion of
llo BIST. Configuralion soflvaro musl faiI llo funclion if il doosn'l rosol bil six
villin lvo soconds. Al llo concIusion of llo BIST, llo losl rosuIl is indicalod in
llo Iovor four bils of llo rogislor. A compIolion codo of zoro indicalos succossfuI
compIolion. A non-zoro vaIuo roprosonls a funclion-spocific orror codo.
Tlo limo Iimil of lvo soconds may nol bo sufficionl limo lo losl a vory compIox
funclion or ono vill an oxlromoIy Iargo buffor llal noods lo bo loslod. In llal
caso, llo romaindor of llo losl couId bo compIolod in llo iniliaIizalion porlion of
llo funclions dovico drivor vlon llo OS Ioads il inlo momory and caIIs il.
- --
- --
Chapter 22: PCI Compatible Configuration Registers
779
CapabiIities Pointer Register
-
--
Configuration Header Space Not Large Enough
Tlo 2.1 ICI spoc dofinod llo firsl 16 dvords of a funclions ICI-compalibIo con-
figuralion spaco as ils configuralion Hoador spaco. Il vas originaIIy inlondod
llal aII of llo funclions ICI spoc-dofinod configuralion rogislors vouId rosido
villin llis rogion and llal aII of ils funclion-spocific configuralion rogislors
vouId rosido villin llo Iovor 48 dvords of ils ICI-compalibIo configuralion
spaco. UnforlunaloIy, lloy ran oul of spaco vlon dofining nov configuralion
rogislors in llo 2.2 ICI spoc. Ior llis roason, llo 2.2 and 2.3 ICI spocs pormil
somo spoc-dofinod rogislors lo bo impIomonlod in llo Iovor 48 dvords of a
funclions ICI-compalibIo configuralion spaco.
Discovering That CapabiIities Exist
If llo CapabiIilios Iisl bil in llo Slalus rogislor (soo Iiguro 22-5 on pago 780) is
sol lo ono, llo funclion impIomonls llo CapabiIilios Ioinlor rogislor in bylo zoro
of dvord 13 in ils ICI-compalibIo configuralion spaco (soo Iiguro 22-1 on pago
771). Tlis impIios llal llo poinlor conlains llo dvord-aIignod slarl addross of
llo CapabiIilios Iisl villin llo funclions Iovor 48 dvords of ICI-compalibIo
configuralion spaco. Il is a ruIo llal llo lvo Ioasl-significanl bils musl bo lard-
virod lo zoro and musl bo ignorod (i.o., masIod) by soflvaro vlon roading llo
- --

3:0 . A vaIuo of zoro indicalos succossfuI compIolion, vliIo
a non-zoro rosuIl indicalos a funclion-spocific orror.
5:4 Rosorvod.
6 . Wriling a ono inlo llis bil slarls llo funclions BIST. Tlo func-
lion rosols llis bil aulomalicaIIy upon compIolion. Soflvaro slouId faiI
llo funclion if llo BIST doos nol compIolo villin lvo soconds.
7 . SlouId rolurn a ono if llo funclion impIomonls a BIST, a
zoro if il doosn'l.
PCI Express System Architecture
780
rogislor. Tlo uppor six bils roprosonls llo uppor six bils of llo 8-bil, dvord-
aIignod slarl addross of llo nov rogislors impIomonlod in llo Iovor 48 dvords
of llo funclions ICI-compalibIo spaco. Tlo lvo Ioasl-significanl bils aro
assumod lo bo zoro.
What the CapabiIities List Looks Like
Tlo configuralion Iocalion poinlod lo by llo CapabiIilios Ioinlor rogislor is llo
firsl onlry in a IinIod sorios of ono or moro configuralion rogislor sols, oacl of
vlicl supporls a foaluro. Iacl onlry las llo gonoraI formal iIIuslralod in Iiguro
22-6 on pago 782. Tlo firsl bylo is roforrod lo as llo CapabiIily ID (assignod by
llo ICI SIG) and idonlifios llo foaluro associalod vill llis rogislor sol (o.g., 2 =
AGI), vliIo llo socond bylo oillor poinls lo anollor foaluros rogislor sol, or
indicalos llal lloro aro no addilionaI rogislor sols (vill a poinlor vaIuo of zoro)
associalod vill llis funclion. In oillor caso, llo Ioasl-significanl lvo bils musl
rolurn zoro. If a poinlor lo llo noxl foaluros rogislor sol is prosonl in llo socond
bylo, il poinls lo a dvord villin llo funclions Iovor 48 dvords of ICI-compal-
ibIo configuralion spaco (il can poinl oillor forvard or bacIvard in llo func-
lions configuralion spaco). Tlo rospoclivo foaluros rogislor sol aIvays
immodialoIy foIIovs llo firsl lvo bylos of llo onlry, and ils Iongll and formal
aro dofinod by vlal lypo of foaluro il is. Tlo CapabiIilios curronlIy dofinod in
llo 2.3 ICI spoc aro lloso Iislod in TabIo 22-3 on pago 781.
- -
Chapter 22: PCI Compatible Configuration Registers
781
-- -
-
00l Rosorvod.
01l . Rofor lo Tlo IM CapabiIily Rogislor
Sol on pago 585.
02l . Rofor lo AGI CapabiIily on pago 845. AIso rofor lo llo MindSlaro
booI onlilIod - (pubIislod by Addi-
son-WosIoy).
03l . Rofor lo VilaI Iroducl Dala (VID) CapabiIily on pago 848.
04l . Tlis capabiIily idonlifios a bridgo llal providos
oxlornaI oxpansion capabiIilios (i.o., an oxpansion classis conlaining add-
in card sIols). IuII documonlalion of llis foaluro can bo found in llo rovi-
sion 1.1 . Ior a dolaiIod, Ixpross-
orionlod doscriplion, rofor lo Inlroduclion To Classis/SIol Numboring
Rogislors on pago 859 and Classis and SIol Numbor Assignmonl on
pago 861.
05l -- -. Rofor lo Tlo MSI CapabiIily Rogislor Sol
on pago 332.
06l . Rofor lo llo claplor onlilIod
in llo MindSlaro booI onlilIod -
(pubIislod by Addison-WosIoy).
07l . Ior a dolaiIod doscriplion, rofor lo llo MindSlaro booI onli-
lIod - (pubIislod by Addison-WosIoy).
08l - .
09l - -. Tlo Iayoul of llo
rogislor sol is vondor spocific, oxcopl llal llo bylo immodialoIy
foIIoving llo Noxl poinlor indicalos llo numbor of bylos in llo
capabiIily slrucluro (incIuding llo ID and Noxl poinlor bylos). An
oxampIo vondor spocific usago is a funclion llal is configurod in llo finaI
manufacluring slops as oillor a 32-bil or 64-bil ICI agonl and llo
Vondor Spocific capabiIily slrucluro loIIs llo dovico drivor vlicl
foaluros llo dovico supporls.
0Al .
0Bl - . A fuII dofinilion of llis capabiIily
can bo found in llo IICMG 2.13 Spocificalion (lllp://vvv.picmg.com).
PCI Express System Architecture
782
CardBus CIS Pointer Register
- . Tlis oplionaI rogislor is impIomonlod by func-
lions llal slaro siIicon bolvoon a Cardbus dovico and a ICI or ICI Ixpross
funclion. Tlis fioId poinls lo llo Card Informalion Slrucluro (CIS) on llo Card-
Bus card. Tlo rogislor is road-onIy and indicalos llal llo CIS can bo accossod
from llo indicalod offsol villin ono of llo foIIoving addross spacos:
- Offsol villin llo funclions funclion-spocific ICI-compalibIo configuralion
spaco (aflor dvord 15d in llo funclions ICI-compalibIo configuralion
spaco).
- Offsol from llo slarl addross indicalod in ono of llo funclions Momory
Baso Addross Rogislors (soo Iiguro 22-10 on pago 796 and Iiguro 22-11 on
pago 797).
- Offsol villin a codo imago in llo funclions oxpansion ROM (soo Ixpan-
sion ROM Baso Addross Rogislor on pago 783 and Ixpansion ROMs on
pago 871).
0Cl . Tlis ID indicalos llal llo associalod dovico conforms
lo llo Slandard Hol-IIug ConlroIIor modoI.
0Dl-
0Il
Rosorvod.
10l -- - - (aIa ICI Ixpross CapabiIily Slruc-
luro). Ior a dolaiIod oxpIanalion, rofor lo ICI Ixpross CapabiIily Rogislor
Sol on pago 896.
11l-IIl Rosorvod.
- -
-- -
-
Chapter 22: PCI Compatible Configuration Registers
783
Tlo formal of llo CardBus CIS Ioinlor rogislor is dofinod in llo rovision 3.0 IC
Card spocificalion. A dolaiIod doscriplion of llo CIS can bo found in llo Mind-
Slaro arclilocluro sorios booI onlilIod - - (pubIislod
by Addison-WosIoy).
Expansion ROM Base Address Register
- - . Many ICI
funclions incorporalo a dovico ROM (llo spoc rofors lo il as an oxpansion ROM)
llal conlains a dovico drivor for llo funclion. Tlo oxpansion ROM slarl mom-
ory addross and sizo is spocifiod in llo Ixpansion ROM Baso Addross Rogislor
al configuralion dvord 12d in llo configuralion Hoador rogion. As doscribod in
llo soclion onlilIod Baso Addross Rogislors on pago 792, on povor-up llo sys-
lom musl bo aulomalicaIIy configurod so llal oacl funclions IO and momory
docodors rocognizo muluaIIy-oxcIusivo addross rangos. Tlo configuralion sofl-
varo musl bo abIo lo dolocl lov mucl momory spaco an oxpansion ROM
roquiros. In addilion, llo syslom musl lavo llo capabiIily of programming a
ROM's addross docodor in ordor lo Iocalo ils ROM in a non-confIicling addross
rango.
Wlon llo slarl-up configuralion program dolocls llal a funclion las an Ixpan-
sion ROM Baso Addross Rogislor impIomonlod (by vriling aII onos lo il and
roading il bacI), il musl llon clocI llo firsl lvo Iocalions in llo ROM for an
Ixpansion ROM signaluro lo dolormino if a ROM is acluaIIy inslaIIod (i.o., lloro
may bo an omply ROM socIol). If inslaIIod, llo configuralion program musl
sladov llo ROM and oxoculo ils iniliaIizalion codo. Tlis procoss is doscribod in
Ixpansion ROMs on pago 871.
Tlo formal of llo oxpansion ROM Baso Addross Rogislor is iIIuslralod in Iiguro
22-7 on pago 785:
- A ono in bil zoro onabIos llo funclions ROM addross docodor (assuming
llal llo Momory Spaco bil in llo Command rogislor is aIso sol lo ono).
- Bils |10:1] aro rosorvod.
- Bils |31:11] aro usod lo spocify llo ROM's slarl addross (slarling on an
addross divisibIo by llo ROMs sizo).
PCI Express System Architecture
784
As an oxampIo, assumo llal llo programmor vrilos IIIIIIIIl lo llo ROMs
Baso Addross Rogislor (bil 0, llo Ixpansion ROM InabIo bil, is cIoarod so as nol
lo onabIo llo ROM addross docodor unliI a slarl momory addross las boon
assignod). A subsoquonl road from llo rogislor in llo oxampIo yioIds
IIII0000l. Tlis indicalos llo foIIoving:
- Bil 0 is a zoro, indicaling llal llo ROM addross docodor is curronlIy dis-
abIod.
- Bils |10:1] aro rosorvod.
- In llo Baso Addross fioId (bils |31:11]), bil 17 is llo Ioasl-significanl bil llal
llo programmor vas abIo lo sol lo ono. Il las a binary-voigllod vaIuo of
128K, indicaling llal llo ROM docodor roquiros 128KB of momory spaco bo
assignod lo llo ROM. Tlo programmor llon vrilos a 32-bil slarl addross
inlo llo rogislor lo assign llo ROM slarl addross on a 128K addross bound-
ary.
Tlo ICI 2.3 spoc rocommonds llal llo dosignor of llo Ixpansion ROM Baso
Addross Rogislor slouId roquosl a momory bIocI sIigllIy Iargor llan llal
roquirod by llo curronl rovision ROM lo bo inslaIIod. Tlis pormils llo inslaIIa-
lion of subsoquonl ROM rovisions llal occupy moro spaco villoul roquiring a
rodosign of llo Iogic associalod vill llo funclions Ixpansion ROM Baso
Addross Rogislor. Tlo spoc sols a Iimil of 16MB as llo maximum oxpansion
ROM sizo.
Tlo Momory Spaco bil in llo Command rogislor las procodonco ovor llo
Ixpansion ROM InabIo bil. Tlo funclions oxpansion ROM slouId rospond lo
momory accossos onIy if boll ils Momory Spaco bil (in ils Command rogislor)
and llo Ixpansion ROM InabIo bil (in ils oxpansion ROM Baso Addross rogis-
lor) aro boll sol lo ono.
In ordor lo minimizo llo numbor of addross docodors llal a funclion musl
impIomonl, ono addross docodor can bo slarod bolvoon llo Ixpansion ROM
Baso Addross Rogislor and ono of llo funclions Momory Baso Addross Rogis-
lors. Tlo lvo Baso Addross Rogislors musl bo abIo lo loId difforonl vaIuos al llo
samo limo, bul llo addross docodor viII nol docodo ROM accossos unIoss llo
Ixpansion ROM InabIo bil is sol in llo Ixpansion ROM Baso Addross Rogislor.
A moro dolaiIod doscriplion of oxpansion ROM doloclion, sladoving and
usago can bo found in Ixpansion ROMs on pago 871.
Chapter 22: PCI Compatible Configuration Registers
785
Command Register
- - . Rofor lo Iiguro 22-8 on pago 785. TabIo 22 - 4
on pago 786 providos a doscriplion of oacl bil in llo Command rogislor of a
non-bridgo funclion (i.o., ono vill a Typo 0 Hoador formal).
- - -- - --
-
PCI Express System Architecture
786
-
-
--
-
- - -- -
- - --
- -- -

--
- -
- - --
- - -
--
- --
-
- -
-
-- --
-- - -- ---
- -- --
---
-- --
-

-
--

- --
-
--
- - - -
--
- -
- -
- --
--
- -
- -- -
Chapter 22: PCI Compatible Configuration Registers
787
4 RO . Doos nol appIy lo ICI Ixpross and
musl bo 0.
5 RO . Doos nol appIy lo ICI Ixpross and musl bo 0.
6 RW --. In llo Slalus rogislor (soo Iiguro 22-5 on pago
780), llo Maslor Dala Iarily Irror bil is sol by a Roquoslor if ils Iarily
Irror Rosponso bil is sol and oillor of llo foIIoving lvo condilions
occurs:
- If llo Roquoslor rocoivos a poisonod CompIolion.
- If llo Roquoslor poisons a vrilo roquosl.
If llo Iarily Irror Rosponso bil is cIoarod, llo Maslor Dala Iarily Irror
slalus bil is novor sol.
Tlo dofauIl vaIuo of llis bil is 0.
7 RO . Doos nol appIy lo ICI Ixpross
and musl bo 0.
8 RW . Wlon sol, llis bil onabIos llo non-falaI and falaI orrors
doloclod by llo funclion lo bo roporlod lo llo Rool CompIox. Tlo func-
lion roporls sucl orrors lo llo Rool CompIox if il is onabIod lo do so
oillor llrougl llis bil or llrougl llo ICI Ixpross spocific bils in llo
Dovico ConlroI rogislor (soo Dovico ConlroI Rogislor on pago 905).
Tlo dofauIl vaIuo of llis bil is 0.
9 RO - . Doos nol appIy lo ICI Ixpross and musl bo
0.
-
-
PCI Express System Architecture
788
Status Register
- - . TabIo 22 - 5 on pago 789 providos a doscrip-
lion of oacl bil in llo Slalus rogislor (aIso rofor lo Iiguro 22-9 on pago 788). Tlo
bil fioIds vill llo RW1C allribulo lavo llo foIIoving claraclorislics:
- Rogislor bils rolurn slalus vlon road, and a slalus bil may bo cIoarod by
vriling a ono lo il. Wriling a 0 lo RW1C bils las no offocl.
10 RW -. ConlroIs llo abiIily of a ICI Ixpross funclion lo gon-
oralo INTx inlorrupl mossagos.
- 0 = Iunclion onabIod lo gonoralo INTx inlorrupl mossagos.
- 1 = Iunclions abiIily lo gonoralo INTx inlorrupl mossagos is dis-
abIod.
If llo funclion lad aIroady lransmillod any Assorl_INTx omuIalion
inlorrupl mossagos and llis bil is llon sol, il musl lransmil a corro-
sponding Doassorl_INTx mossago for oacl assorl mossago lransmillod
oarIior.
Nolo llal INTx omuIalion inlorrupl mossagos forvardod by Rool and
Svilcl Iorls from dovicos dovnslroam of llo Rool or Svilcl Iorl aro
nol affoclod by llis bil. Tlo dofauIl vaIuo of llis bil is 0.
- -
-
-
Chapter 22: PCI Compatible Configuration Registers
789
- -
- -
3 RO -. Indicalos llal llo funclion las an inlorrupl
roquosl oulslanding (llal is, llo funclion lransmillod an inlor-
rupl mossago oarIior in limo and is availing sorvicing).
Nolo llal INTx omuIalion inlorrupls forvardod by Rool and
Svilcl Iorls from dovicos dovnslroam of llo Rool or Svilcl
Iorl aro nol rofIoclod in llis bil. Tlo dofauIl slalo of llis bil is
0. : llis bil is onIy associalod vill INTx mossagos, and
las no moaning if llo dovico is using Mossago SignaIod Inlor-
rupls.
4 RO - -. Indicalos llo prosonco of ono or moro
oxlondod capabiIily rogislor sols in llo Iovor 48 dvords of llo
funclions ICI-compalibIo configuralion spaco. Sinco, al a
minimum, aII ICI Ixpross funclions aro roquirod lo impIo-
monl llo ICI Ixpross capabiIily slrucluro, llis bil musl bo sol
lo 1.
5 RO . Doos nol appIy lo ICI Ixpross and musl bo
0.
7 RO - . Doos nol appIy lo ICI Ixpross
and musl bo 0.
8 RW1C - . Tlo Maslor Dala Iarily Irror bil is
sol by a Roquoslor if llo Iarily Irror InabIo bil is sol in ils
Command rogislor and oillor of llo foIIoving lvo condilions
occurs:
- If llo Roquoslor rocoivos a poisonod CompIolion.
- If llo Roquoslor poisons a vrilo roquosl.
If llo Iarily Irror InabIo bil is cIoarod, llo Maslor Dala Iarily
Irror slalus bil is novor sol.
Tlo dofauIl vaIuo of llis bil is 0.
10:9 RO . Doos nol appIy lo ICI Ixpross and musl bo
0.
PCI Express System Architecture
790
Cache Line Size Register
- - .
Tlis fioId is impIomonlod by ICI Ixpross dovicos as a road-vrilo fioId for Iogacy
compalibiIily purposos bul las no impacl on any ICI Ixpross dovico funclion-
aIily.
Master Latency Timer Register
- - .
Tlis rogislor doos nol appIy lo ICI Ixpross and musl bo lardvirod lo 0.
11 RW1C . Tlis bil is sol vlon a funclion acling
as a CompIolor lorminalos a roquosl by issuing CompIolor
Aborl CompIolion Slalus lo llo Roquoslor.
Tlo dofauIl vaIuo of llis bil is 0.
12 RW1C . Tlis bil is sol vlon a Roquoslor
rocoivos a CompIolion vill CompIolor Aborl CompIolion Sla-
lus.
Tlo dofauIl vaIuo of llis bil is 0.
13 RW1C - . Tlis bil is sol vlon a Roquoslor
rocoivos a CompIolion vill Unsupporlod Roquosl CompIo-
lion Slalus.
Tlo dofauIl vaIuo of llis bil is 0.
14 RW1C - . Tlis bil is sol vlon a funclion sonds
an IRR_IATAI or IRR_NONIATAI mossago, and llo SIRR
InabIo bil in llo Command rogislor is sol lo ono.
Tlo dofauIl vaIuo of llis bil is 0.
15 RW1C . RogardIoss of llo slalo llo Iarily Irror
InabIo bil in llo funclions Command rogislor, llis bil is sol if
llo funclion rocoivos a Ioisonod TII.
Tlo dofauIl vaIuo of llis bil is 0.
- -
- -
Chapter 22: PCI Compatible Configuration Registers
791
Interrupt Line Register
- - .
Usage In a PCI Function
Roquirod if a ICI funclion is capabIo of gonoraling inlorrupl roquosls via an
INTx# pin (i.o., INTA#, INTB#, INTC#, or INTD#). Tlo ICI spoc aIIovs a func-
lion lo gonoralo inlorrupls oillor using an inlorrupl pin, or using MSI-capabiIily
(for moro informalion, soo Mossago SignaIod Inlorrupls on pago 331).
Tlo road/vrilabIo Inlorrupl Iino rogislor is usod lo idonlify vlicl inpul on llo
inlorrupl conlroIIor llo funclion's ICI inlorrupl roquosl pin (as spocifiod in ils
Inlorrupl Iin rogislor, soo Inlorrupl Iin Rogislor on pago 792) is roulod lo. Ior
oxampIo, in a IC onvironmonl llo vaIuos 00l-llrougl-0Il in llis rogislor corro-
spond lo llo IRQ0-llrougl-IRQ15 inpuls on llo inlorrupl conlroIIor. Tlo vaIuo
255d (IIl) indicalos unInovn or no connoclion. Tlo vaIuos from 10l-
llrougl-IIl, incIusivo, aro rosorvod. AIllougl il doosnl slalo llis in llo ICI
spoc, il is llo aullors opinion llal RST# slouId iniliaIizo llo Inlorrupl Iino rog-
islor lo a vaIuo of IIl, lloroby indicaling llal inlorrupl rouling las nol yol boon
assignod lo llo funclion.
Tlo OS or dovico drivor can oxamino a dovico's Inlorrupl Iino rogislor lo dolor-
mino vlicl syslom inlorrupl roquosl Iino llo dovico usos lo issuo roquosls for
sorvico (and, lloroforo, vlicl onlry in llo inlorrupl labIo lo looI).
In a non-IC onvironmonl, llo vaIuo vrillon lo llis rogislor is arclilocluro-spo-
cific and lloroforo oulsido llo scopo of llo spocificalion.
Usage In a PCI Express Function
A ICI Ixpross funclion may gonoralo inlorrupls in llo Iogacy ICI/ICI-X man-
nor. As an oxampIo, vlon a ICI Ixpross-lo-ICI or ICI-X bridgo dolocls llo
assorlion or doassorlion of ono of ils INTA#, INTB#, INTC#, or INTD# inpuls on
llo Iogacy sido of llo bridgo, il sonds an INTx Assorl or Doassorl mossago
upslroam lovards llo Rool CompIox (spocificaIIy, lo llo inlorrupl conlroIIor
villin llo Rool CompIox).
As in ICI, llo Inlorrupl Iino rogislor communicalos inlorrupl Iino rouling infor-
malion. Tlo rogislor is road/vrilo and musl bo impIomonlod by any funclion
llal conlains a vaIid non-zoro vaIuo in ils Inlorrupl Iin configuralion rogislor
(doscribod in llo noxl soclion). Tlo OS or dovico drivor can oxamino a dovico's
PCI Express System Architecture
792
Inlorrupl Iino rogislor lo dolormino vlicl syslom inlorrupl roquosl Iino llo
dovico usos lo issuo roquosls for sorvico (and, lloroforo, vlicl onlry in llo inlor-
rupl labIo lo looI).
In a non-IC onvironmonl, llo vaIuo vrillon lo llis rogislor is arclilocluro-spo-
cific and lloroforo oulsido llo scopo of llo spocificalion.
Interrupt Pin Register
- - .
Usage In a PCI Function
Roquirod if a ICI funclion is capabIo of gonoraling inlorrupl roquosls via an
INTx# pin. Tlo ICI spoc aIIovs a funclion lo gonoralo inlorrupls oillor using an
inlorrupl pin, or using MSI-capabiIily (for moro informalion, soo Tvo Mollods
of Inlorrupl DoIivory on pago 330).
Tlo road-onIy Inlorrupl Iin rogislor dofinos vlicl of llo four ICI inlorrupl
roquosl pins, INTA#-llrougl-INTD#, a ICI funclion is connoclod (i.o., bondod)
lo. Tlo vaIuos 01l-llrougl-04l corrospond lo ICI inlorrupl roquosl pins
INTA#-llrougl-INTD#. A rolurn vaIuo of zoro indicalos llal llo dovico doosn'l
gonoralo inlorrupls. AII ollor vaIuos (05l-IIl) aro rosorvod.
Usage In a PCI Express Function
Tlis road-onIy rogislor idonlifios llo Iogacy INTx inlorrupl Mossago (INTA,
INTB, INTC, or INTD) llo funclion lransmils upslroam lo gonoralo an inlorrupl.
Tlo vaIuos 01l-llrougl-04l corrospond lo Iogacy INTx inlorrupl Mossagos
INTA-llrougl-INTD. A rolurn vaIuo of zoro indicalos llal llo dovico doosn'l
gonoralo inlorrupls using llo Iogacy mollod. AII ollor vaIuos (05l-IIl) aro
rosorvod. Nolo llal, aIllougl llo funclion may nol gonoralo inlorrupls via llo
Iogacy mollod, il may gonoralo llom via llo MSI mollod (soo Dolormining if a
Iunclion Usos INTx# Iins on pago 343 for moro informalion).
Base Address Registers
-. -
-.
Chapter 22: PCI Compatible Configuration Registers
793
Introduction
VirluaIIy aII funclions impIomonl somo momory, and/or a funclion-spocific rog-
islor sol lo conlroI llo funclion and sonso ils slalus. Somo oxampIos aro:
- A paraIIoI porl's Slalus, Command and Dala rogislors couId rosido in IO or
momory-mappod IO spaco.
- A nolvorI inlorfaco's conlroI rogislors (Command/Slalus, olc.) couId rosido
in IO or momory-mappod IO spaco.
- Tlo nolvorI inlorfaco may aIso incorporalo a RAM momory buffor llal
musl bo mappod inlo llo syslom's momory spaco.
- In addilion, a ROM conlaining llo funclions BIOS and inlorrupl sorvico
roulino may bo prosonl in a funclion.
On povor-up, llo syslom musl bo aulomalicaIIy configurod so llal oacl func-
lions IO and momory funclions occupy muluaIIy-oxcIusivo addross rangos. In
ordor lo accompIisl llis, llo syslom musl bo abIo lo dolocl lov many momory
and IO addross rangos a funclion roquiros and llo sizo of oacl. ObviousIy, llo
syslom musl llon bo abIo lo program llo funclions addross docodors in ordor
lo assign non-confIicling addross rangos lo llom.
Tlo Baso Addross Rogislors (BARs), Iocalod in dvords 4-llrougl-9 of llo func-
lions configuralion Hoador spaco (soo Iiguro 22-1 on pago 771), aro usod lo
impIomonl a funclions programmabIo momory and/or IO docodors. Iacl rog-
islor is 32-bils vido (or 64-bils vido if ils a momory docodor and ils associalod
momory bIocI can bo Iocalod abovo llo 4GB addross boundary). Iiguro 22-10
on pago 796, Iiguro 22-11 on pago 797, and Iiguro 22-12 on pago 798 iIIuslralo
llo llroo possibIo formals of a Baso Addross Rogislor. Bil 0 is a road-onIy bil and
indicalos vlollor ils a momory or an IO docodor:
- If bil 0 = 0, llo rogislor is a momory addross docodor.
- If bil 0 = 1, llo rogislor is an IO addross docodor.
Docodors may bo impIomonlod in any of llo Baso Addross Rogislor posilions. If
moro llan ono docodor is impIomonlod, lloro may bo loIos. During configura-
lion, llo configuralion soflvaro musl lloroforo IooI al aII six of llo possibIo
Baso Addross Rogislor posilions in a funclions Hoador lo dolormino vlicl rog-
islors aro acluaIIy impIomonlod.
IO Space Usage
In a IC onvironmonl, IO spaco is donsoIy popuIalod and viII onIy bocomo moro
so in llo fuluro. Ior llis roason and bocauso somo procossors aro onIy capabIo of
porforming momory lransaclions, llo foIIoving ruIos roIalod lo IO spaco usago
PCI Express System Architecture
794
aro dofinod in llo ICI Ixpross spoc:
- -- (as indicalod by a vaIuo of 0000b in
llo Dovico/Iorl Typo fioId in llo funclions ICI Ixpross CapabiIilios Rogis-
lor, soo Iiguro 22-31 on pago 865). Somo oporaling sysloms and/or procos-
sors may nol supporl IO accossos (i.o., accossos using IO rallor llan
momory addrossos). Tlis boing llo caso, llo dosignor of a nalivo ICI
Ixpross funclion slouId avoid llo uso of IO BARs.
Hovovor, llo largol syslom llal a funclion is dosignod for may uso llo
funclion as ono of llo bool dovicos (i.o., llo bool inpul dovico, oulpul dis-
pIay dovico, or bool mass slorago dovico) and may uliIizo a Iogacy dovico
drivor for llo funclion al slarlup limo. Tlo Iogacy drivor may assumo llal
llo funclions dovico-spocific rogislor sol rosidos in IO spaco. In llis caso,
llo funclion dosignor vouId suppIy an IO BAR lo vlicl llo configuralion
soflvaro viII assign an IO addross rango. Wlon llo OS bool las compIolod
and llo OS las Ioadod a nalivo ICI Ixpross drivor for llo funclion, lov-
ovor, llo OS may doaIIocalo aII Iogacy IO addross rangos proviousIy
assignod lo llo soIoclod bool dovicos. Irom llal poinl forvard and for llo
duralion of llo povor-up sossion, llo nalivo drivor viII uliIizo momory
accossos lo communicalo vill ils associalod funclion llrougl llo funclions
momory BARs.
- -- (as indicalod by a vaIuo of 0001b in
llo Dovico/Iorl Typo fioId in llo funclions ICI Ixpross CapabiIilios Rogis-
lor, soo Iiguro 22-31 on pago 865). A Iogacy ICI Ixpross Indpoinl funclion
consisls of a Iogacy ICI or ICI-X funclion suppIiod vill a ICI Ixpross fronl
ond lo inlorfaco il lo llo ICI Ixpross fabric. As many Iogacy funclions
impIomonlod IO BARs, IO BARs aro loIoralod in llis lypo of funclion.
Memory Base Address Register
Tlis soclion providos a dolaiIod doscriplion of llo bil fioIds villin a Momory
BAR. Tlo soclion onlilIod Iinding BIocI Sizo and Assigning Addross Rango
on pago 799 doscribos lov llo rogislor is probod lo dolormino ils oxislonco, llo
sizo of llo momory associalod vill llo docodor, and llo assignmonl of llo baso
addross lo llo docodor.
In a Momory Baso Addross Rogislor, bils |2:1]
dofino vlollor llo docodor is 32- or 64-bils vido:
- If 00b = ils a - (soo Iiguro 22-10 on pago 796. Tlo configu-
ralion soflvaro lloroforo viII vrilo a 32-bil slarl momory addross inlo il
spocifying any addross in llo firsl 4GB of momory addross spaco.
- If 10b = ils a - (soo Iiguro 22-11 on pago 797. Tlo configu-
Chapter 22: PCI Compatible Configuration Registers
795
ralion soflvaro lloroforo vrilos a 64-bil slarl momory addross inlo il
llal spocifios a slarl addross in a 2
64
momory addross spaco. Tlis moans
llal llis - -- - -- - - of
llo configuralion Hoador spaco. Tlo firsl dvord is usod lo sol llo Iovor
32-bils of llo slarl addross and llo socond dvord is usod lo spocify llo
uppor 32-bils of llo slarl addross.
Bil llroo dofinos llo bIocI of momory as
IrofolclabIo or nol. A bIocI of momory spaco may bo marIod as Irofolcl-
abIo onIy if il can guaranloo llal:
- lloro aro - - - (o.g., llo road doosnl aIlor llo con-
lonls of llo Iocalion or aIlor llo slalo of llo funclion in somo mannor).
Ils pormissibIo for a bridgo llal rosidos bolvoon a Roquoslor and a
momory largol lo profolcl road dala from momory llal las llis clarac-
lorislic. If llo Roquoslor doosnl ond up asIing for aII of llo dala llal
llo bridgo road inlo a road-aload buffor, llo bridgo musl discard llo
dala (soo Bridgo Musl Discard Unconsumod Irofolclod Dala on
pago 801). Tlo dala romains unclangod in llo largols momory Ioca-
lions.
- on a road, il - - - irrospoclivo of llo bylo onabIo sol-
lings.
- llo momory dovico - a bridgo llal
rosidos bolvoon llo Roquoslor and llo momory largol porforms
(for moro informalion, rofor lo Bylo Morging on pago 801) in
ils poslod momory vrilo buffor vlon momory vrilos aro
villin llo momory largols rango.
In a nulsloII, roguIar momory is profolclabIo vliIo momory-mappod IO (or
any ollor badIy-bolavod momory rogion) is nol. Tlo configuralion sofl-
varo can dolormino llal a momory largol is profolclabIo or nol by clocIing
llo IrofolclabIo bil in llo momory largols Baso Addross Rogislor (BAR).
AII momory BAR rogislors in ICI Ixpross Indpoinl funclions vill llo
IrofolclabIo bil sol lo ono musl bo impIomonlod as 64-bil momory BARs.
Momory BARs llal do nol lavo llo profolclabIo bil sol lo ono may bo
impIomonlod as 32-bil BARs.
As an oxampIo, llo addross docodor for a bIocI of momory-mappod IO
porls may lardviro llo IrofolclabIo bil lo zoro, vliIo llo addross docodor
for voII-bolavod momory vouId lardviro il lo ono. Ior porformanco roa-
sons, llo spoc urgos llal, vlorovor possibIo, momory-mappod IO rangos bo
marIod as profolclabIo momory.
PCI Express System Architecture
796
Tlo configuralion soflvaro clocIs llis bil lo dolormino a momory largols
oporalionaI claraclorislics, assigns a momory rango lo ils docodor (i.o., ils
Momory BAR), and llon bacIlracIs lo aII upslroam bridgos bolvoon llo
momory largol and llo procossor and configuros llo bridgos lo lroal llo
assignod momory rango in llo approprialo mannor:
- If ils IrofolclabIo momory, ils pormissibIo for a bridgo lo porform road
profolcling lo yioId bollor porformanco, and ils aIso pormissibIo for llo
bridgo lo porform bylo morging in ils poslod momory vrilo buffor for
vrilos porformod lo llo momory.
- If ils non-IrofolclabIo momory, bridgo road profolcling and bylo morg-
ing aro nol aIIovod villin llo assignod rogion of momory spaco. Tlis
viII nol aIIov bridgos lo oplimizo accossos lo llo funclion, bul youro
assurod llo funclion viII vorI corroclIy (and llals prolly imporlanl!).
- -- Tlis fioId consisls of bils |31:7] for a 32-bil momory
docodor and bils |63:7] for a 64-bil momory docodor. Il is usod:
- lo dolormino llo sizo of llo momory associalod vill llis docodor, and
- lo assign a slarl (i.o., baso) addross lo llo docodor.
Irogramming of an oxampIo Momory Baso Addross Rogislor is providod in
Iinding BIocI Sizo and Assigning Addross Rango on pago 799.
Tlo minimum momory rango roquoslod by a BAR is 128 bylos.
- -- - --
Chapter 22: PCI Compatible Configuration Registers
797
IO Base Address Register
Tlis soclion providos a dolaiIod doscriplion of llo bil fioIds
villin an IO Baso Addross Rogislor. Tlo soclion onlilIod Iinding BIocI
Sizo and Assigning Addross Rango on pago 799 doscribos:
- lov llo rogislor is probod lo dolormino ils oxislonco,
- lov lo dolormino llo sizo of llo IO rogislor sol associalod vill llo
docodor and lloroforo llo amounl of IO spaco llal musl bo assignod lo
il, and
- lov lo assign llo baso addross lo llo docodor.
- Rofor lo Iiguro 22-12 on pago 798. Bil zoro rolurns a
ono, indicaling llal llis is an IO, rallor llan a momory, docodor. Bil ono is
rosorvod and musl aIvays rolurn zoro. Bils |31:2] comprisos llo Baso
Addross fioId and is usod lo:
- dolormino llo sizo of llo IO bIocI roquirod and
- lo sol ils slarl addross.
Tlo ICI spoc roquiros llal a dovico llal maps ils conlroI rogislor sol inlo IO
spaco musl nol roquosl moro llan 256 Iocalions por IO Baso Addross Rogis-
lor.
Tlo uppor 16-bils of llo IO BAR may bo
lardvirod lo zoro vlon a funclion is dosignod spocificaIIy for a IC-compal-
ibIo, x86-basod maclino (bocauso InloI x86 procossors aro incapabIo of gon-
- -- - --
PCI Express System Architecture
798
oraling IO addrossos ovor 64KB). Tlo funclion musl sliII porform a fuII 32-
bil docodo of llo IO addross, lovovor.
- Iogacy IC-compalibIo dovicos sucl as VGA and
IDI conlroIIors froquonlIy oxpocl lo bo Iocalod villin fixod Iogacy IO
rangos. Sucl funclions do nol impIomonl Baso Addross Rogislors. Insload,
llo configuralion soflvaro idonlifios llom as Iogacy funclions via lloir
rospoclivo CIass Codo and llon onabIos lloir IO docodor(s) by solling llo IO
Spaco bil in ils Command rogislor lo ono.
A Iogacy IO funclion may or may nol ovn aII of llo bylo Iocalions villin a
dvord of IO spaco:
- A Iogacy IO funclion llal doos ovn aII of llo bylos villin llo curronlIy-
addrossod dvord can porform ils docodo using llo dvord-aIignod
addross suppIiod by A|31:2].
- A Iogacy IO funclion llal doos nol ovn aII of llo bylo Iocalions villin a
dvord musl docodo llo bylo onabIos lo dolormino if il ovns llo bylo-
spocific Iocalion boing addrossod. Il musl oxamino llo bylo onabIos lo
dolormino if llo Roquoslor is addrossing addilionaI, liglor bylo Ioca-
lions villin llo largol IO dvord (idonlifiod via A|31:2]). If il ovns aII of
llo addrossod IO porls, llo funclion can lonor llo roquosl. Hovovor, if
il doosnl ovn llom aII il musl issuo a CompIolor Aborl lo llo
Roquoslor.
- -- - --
Chapter 22: PCI Compatible Configuration Registers
799
Finding BIock Size and Assigning Address Range
- Tlo configuralion program musl probo oacl of a func-
lions possibIo Baso Addross Rogislors lo dolormino:
- Is llo Baso Addross Rogislor impIomonlod`
- Is il a momory or an IO addross docodor`
- If ils a momory docodor, is il a 32- or 64-bil Baso Addross Rogislor`
- If ils a momory docodor, is llo momory associalod vill llo rogislor
IrofolclabIo or non-IrofolclabIo`
- Hov mucl momory or addross spaco doos il roquiro and vill vlal
aIignmonl`
AII of llis informalion can bo ascorlainod simpIy by vriling aII onos lo llo
Baso Addross Rogislor and llon roading il bacI. A rolurn vaIuo of zoro indi-
calos llal llo Baso Addross Rogislor isnl impIomonlod. Assuming llal llo
vaIuo road is non-zoro, scanning llo rolurnod vaIuo (assuming ils non-zoro)
upvards slarling al llo Ioasl-significanl bil of llo Baso Addross fioId, llo
programmor dolorminos llo sizo of llo roquirod momory or llo IO spaco by
finding llo Ioasl-significanl bil llal vas succossfuIIy sol lo ono. Bil zoro of
llo rogislor las a binary-voigllod vaIuo of ono, bil ono a vaIuo of lvo, bil
lvo a vaIuo of four, olc. Tlo binary-voigllod vaIuo of llo Ioasl-significanl
bil sol lo ono in llo Baso Addross fioId indicalos llo roquirod amounl of
spaco. Tlis is aIso llo firsl road/vrilabIo bil in llo rogislor and aII of llo bils
abovo il aro by dofinilion road/vrilabIo. Aflor discovoring llis informalion,
llo program llon vrilos a baso 32- or 64-bil momory addross, or llo baso
32-bil IO addross inlo llo Baso Addross Rogislor.
As an oxampIo, assumo llal IIIIIIIIl is vrillon
lo llo Baso Addross Rogislor al configuralion dvord 04d and llo vaIuo road
bacI is III00000l. Tlo facl llal any bils couId bo clangod lo ono indicalos
llal llo Baso Addross Rogislor is impIomonlod.
- Bil 0 = 0, indicaling llal llis is a momory addross docodor.
- Bils |2:1] = 00b, indicaling llal ils a 32-bil momory docodor.
- Bil 3 = 0, indicaling llal ils nol IrofolclabIo momory.
- Bil 20 is llo firsl ono bil found in llo Baso Addross fioId. Tlo binary-
voigllod vaIuo of llis bil is 1,048,576, indicaling llal llis is an addross
docodor for 1MB of momory.
Tlo programmor llon vrilos a 32-bil baso addross inlo llo rogislor. Hov-
ovor, onIy bils |31:20] aro vrilabIo. Tlo docodor accopls bils |31:20] and
assumos llal bils |19:0] of llo assignod baso addross aro zoro. Tlis moans
PCI Express System Architecture
800
llal llo baso addross is divisibIo by 1MB, llo sizo of llo roquoslod momory
rango. Il is a claraclorislic of ICI, ICI-X, and ICI Ixpross docodors llal llo
assignod slarl addross is aIvays divisibIo by llo sizo of roquoslod rango.
As an oxampIo, il is possibIo lo program llo oxampIo momory addross
docodor for a 1MB bIocI of momory lo slarl on llo ono, lvo, or llroo mog
boundary, bul il is nol possibIo lo sol ils slarl addross al llo 1.5, 2.3, or 3.7
mog boundary.
As a socond oxampIo, assumo llal IIIIIIIIl is vrillon
lo a funclion's Baso Addross Rogislor al configuralion dvord addross 05d
and llo vaIuo road bacI is IIIIII01l. Bil 0 is a ono, indicaling llal llis is
an IO addross docodor. Scanning upvards slarling al bil 2 (llo Ioasl-signifi-
canl bil of llo Baso Addross fioId), bil 8 is llo firsl bil llal vas succossfuIIy
clangod lo ono. Tlo binary-voigllod vaIuo of llis bil is 256, indicaling llal
llis is an IO addross docodor roquosling 256 bylos of IO spaco.
Tlo programmor llon vrilos a 32-bil baso IO addross inlo llo rogislor.
Hovovor, onIy bils |31:8] aro vrilabIo. Tlo docodor accopls bils |31:8] and
assumos llal bils |7:0] of llo assignod baso addross aro zoro. Tlis moans
llal llo baso addross is divisibIo by 256, llo sizo of llo roquoslod IO rango.
SmaIIest/Largest Decoder Sizes
-- - Tlo smaIIosl momory addross
docodor is impIomonlod as a Baso Addross Rogislor llal pormils bils |31:7]
lo bo vrillon. Sinco llo binary-voigllod vaIuo of bil sovon is 128, 128 bylos
is llo smaIIosl momory bIocI a momory docodor can bo dosignod for.
If a 32-bil momory BAR onIy pormils bil 31 lo bo vrillon, il is roquosling
2GB of momory spaco.
A 64-bil momory BAR couId roquosl moro llan 2GB of momory addross
spaco, rosuIling in nono of llo Iovor 32 bils in llo BAR boing vrilabIo. If
llis is llo caso, llo programmor musl aIso vrilo aII onos in llo ligl dvord
of llo BAR lo dolormino lov big a momory spaco llo docodor roquiros.
-- - Tlo smaIIosl IO docodor vouId bo
impIomonlod as a Baso Addross Rogislor llal pormillod bils |31:2] lo bo pro-
grammod. Sinco llo binary-voigllod vaIuo of bil lvo is 4, 4 bylos (a dvord)
is llo smaIIosl IO bIocI an IO docodor can bo dosignod for.
Chapter 22: PCI Compatible Configuration Registers
801
Tlo Iargosl IO docodor vouId pormil bils |31:8] lo bo vrillon. Tlo binary-
voigllod vaIuo of bil 8 is 256 and llis is lloroforo llo Iargosl rango llal an
IO docodor can roquosl.
Byte Merging
A bridgo may combino vrilos lo a singIo dvord villin ono onlry in llo poslod-
vrilo buffor. Tlis foaluro is rocommondod lo improvo porformanco and is onIy
pormillod in momory addross rangos llal aro dosignalod as profolclabIo.
As an oxampIo, assumo llal a Roquoslor porforms lvo momory vrilos:
- llo firsl vrilos lo Iocalions 00000100l and 00000101l and
- llo socond vrilos lo Iocalions 00000102l and 00000103l.
Tloso four Iocalions rosido villin llo samo dvord. Tlo bridgo couId absorb llo
firsl lvo-bylo vrilo inlo a dvord buffor onlry and llon absorb llo socond lvo
bylo vrilo inlo llo samo dvord buffor onlry. Wlon llo bridgo porforms llo
momory vrilo, il can compIolo il as a singIo accoss. Il is a vioIalion of llo spoc,
lovovor, for a bridgo lo combino soparalo bylo vrilos lo llo samo Iocalion inlo
a singIo vrilo. As an oxampIo, assumo llal a Roquoslor porforms four soparalo
momory vrilos lo llo samo dvord: llo firsl vrilos lo Iocalion zoro in llo dvord,
llo socond lo Iocalion zoro again, llo llird lo Iocalion ono and llo fourll lo
Iocalion lvo. Wlon llo bridgo porforms llo poslod vrilos, il las lo porform a
singIo momory vrilo lransaclion lo vrilo llo firsl bylo lo Iocalion zoro. Il llon
porforms a socond momory vrilo lransaclion lo vrilo lo Iocalions zoro (llo soc-
ond bylo vrillon lo il by llo Roquoslor), ono and lvo.
Bridge Must Discard Unconsumed Prefetched Data
A bridgo llal las profolclod momory road dala for a Roquoslor musl discard
any profolclod road dala llal llo Roquoslor doosnl acluaIIy ond up roading.
Tlo foIIoving is an oxampIo sconario llal domonslralos a probIom llal viII
rosuIl if a bridgo doosnl discard profolclod dala llal vasnl consumod:
1. Tlo procossor las lvo buffors in main momory llal occupy adjaconl mom-
ory rogions. Tlo momory is dosignalod as profolclabIo momory.
2. Tlo procossor vrilos dala inlo llo firsl momory buffor and llon inslrucls a
ICI Ixpross Roquoslor lo road and procoss llo dala.
3. Tlo Roquoslor slarls ils momory road and llo bridgo bolvoon llo Roquoslor
and llo largol momory porforms road aloads from llo momory bocauso il is
profolclabIo, voII-bolavod momory. Tlo bridgo onds up profolcling pasl
llo ond of llo firsl momory buffor inlo llo socond ono, bul llo Roquoslor
PCI Express System Architecture
802
onIy acluaIIy roads llo dala from llo firsl buffor aroa.
4. Tlo bridgo doos nol discard llo unusod dala llal vas profolclod from llo
socond buffor.
5. Tlo procossor vrilos dala inlo llo socond momory buffor and llon inslrucls
a Roquoslor (llo samo Roquoslor or a difforonl ono) boyond llo samo bridgo
lo road and procoss llo dala.
6. Tlo Roquoslor slarls ils momory road al llo slarl addross of llo socond
buffor. Tlo bridgo doIivors llo dala llal il profolclod from llo boginning of
llo socond buffor oarIior. - - - - -
-
Min_Gnt/Max_Lat Registers
- - .
Tloso rogislors do nol appIy lo ICI Ixpross. Tloy musl bo road-onIy and lard-
virod lo 0.
Header Type 1
GeneraI
Iiguro 22-13 on pago 803 iIIuslralos llo Iayoul of a ICI-lo-ICI bridgos configu-
ralion loador spaco.
Chapter 22: PCI Compatible Configuration Registers
803
Header Type 1 Registers CompatibIe With PCI
Tlo Hoador Typo 1 ICI configuralion rogislors llal aro impIomonlod and usod
idonlicaIIy in boll ICI and ICI Ixpross aro:
- Vondor ID rogislor.
- Dovico ID rogislor.

PCI Express System Architecture
804
- Rovision ID rogislor.
- CIass Codo rogislor.
- Hoador Typo rogislor.
- BIST rogislor.
- CapabiIilios Ioinlor rogislor.
- Subordinalo Bus Numbor rogislor.
- Socondary Bus Numbor rogislor.
- Irimary Bus Numbor rogislor.
- IO Baso, Iimil and Uppor rogislors.
- Momory Baso and Iimil rogislors.
- Ixpansion ROM Baso Addross rogislor.
Tlo soclions llal foIIov provido a doscriplion of oacl of lloso rogislors.
Header Type 1 Registers IncompatibIe With PCI
In a Hoador Typo 1 bridgo ICI Ixpross funclion, llo dofinilions of llo foIIoving
configuralion rogislors in llo funclions ICI-compalibIo configuralion spaco dif-
for from llo ICI spocs dofinilion of llo rospoclivo rogislor dofinilions:
- Command Rogislor
- Slalus Rogislor
- Caclo Iino Sizo Rogislor
- Maslor Ialoncy Timor Rogislor
- Inlorrupl Iino Rogislor
- Inlorrupl Iin Rogislor
- Baso Addross Rogislors
- Socondary Ialoncy Timor rogislor.
- Socondary Slalus rogislor.
- IrofolclabIo Momory Baso, Iimil, and Uppor rogislors.
- Bridgo ConlroI rogislor.
Tlo soclions llal foIIov dofino llo impIomonlalion/usago difforoncos of lloso
rogislors. Ior a fuII doscriplion of lloir impIomonlalion in a ICI-lo-ICI bridgo
funclion, rofor lo llo MindSlaro booI onlilIod - , Iourll
Idilion (pubIislod by Addison-WosIoy). Ior a fuII doscriplion lloir impIomon-
lalion in a ICI-X lo ICI-X bridgo funclion, rofor lo llo MindSlaro booI onlilIod
- , Iirsl Idilion (pubIislod by Addison-WosIoy).
Chapter 22: PCI Compatible Configuration Registers
805
TerminoIogy
Boforo procooding, ils imporlanl lo dofino somo basic lorms associalod vill an
acluaI or a virluaI ICI-lo-ICI bridgo. Iacl ICI-lo-ICI bridgo is connoclod lo
lvo busos, roforrod lo as ils primary and socondary busos:
- -. Wlon a lransaclion is inilialod and is passod llrougl ono or
moro ICI-lo-ICI bridgos fIoving avay from llo losl procossor, il is said lo
bo moving dovnslroam.
- -. Wlon a lransaclion is inilialod and is passod llrougl ono or
moro ICI-lo-ICI bridgos fIoving lovards llo losl procossor, il is said lo bo
moving upslroam.
- -. ICI bus llal is diroclIy connoclod lo llo upslroam sido of a
bridgo.
- -. ICI bus llal is diroclIy connoclod lo llo dovnslroam inlor-
faco of a ICI-lo-ICI bridgo.
- -. Higlosl-numborod ICI bus on llo dovnslroam sido of
llo bridgo.
Bus Number Registers
-- .
Introduction
Iacl ICI-lo-ICI bridgo musl impIomonl llroo mandalory bus numbor rogislors.
AII of llom aro road/vrilabIo and aro cIoarod lo zoro by rosol. During configu-
ralion, llo configuralion soflvaro iniliaIizos lloso llroo rogislors lo assign bus
numbors. Tloso rogislors aro:
- llo Irimary Bus Numbor rogislor.
- llo Socondary Bus Numbor rogislor.
- llo Subordinalo Bus Numbor rogislor.
Tlo combinalion of llo Socondary and llo Subordinalo Bus Numbor rogislor
vaIuos dofinos llo rango of busos llal oxisls on llo dovnslroam sido of llo
bridgo. Tlo informalion suppIiod by lloso llroo rogislors is usod by llo bridgo
lo dolormino vlollor or nol lo pass a pacIol llrougl lo llo opposilo inlorfaco.
PCI Express System Architecture
806
Primary Bus Number Register
- . Iocalod in Hoador bylo zoro of dvord six.
Tlo Irimary Bus Numbor rogislor is iniliaIizod by soflvaro vill llo numbor of
llo bus llal is diroclIy connoclod lo llo bridgos primary inlorfaco. Tlis rogislor
oxisls for llroo roasons:
- -.
- -- -- - .
- - - -. A bridgo
llal connocls a ICI Ixpross IinI lo a ICI or ICI-X bus rocoivos a SpociaI
CycIo Roquosl (as dofinod in llo ICI spoc) on ils socondary inlorfaco. A Spo-
ciaI CycIo Roquosl is a roquosl lo porform a SpociaI CycIo lransaclion on llo
doslinalion ICI or ICI-X bus. Tlo roquosl laIos llo form of a Typo 1 Config-
uralion vrilo roquosl pacIol (soo Iiguro 20-8 on pago 734) vloroin llo dos-
linalion ID las llo foIIoving claraclorislics:
AII onos in llo Dovico Numbor and Iunclion Numbor fioIds, and
AII zoros in llo Rogislor Numbor and Ixlondod Rogislor Numbor fioIds.
If llo doslinalion bus numbor in llo roquosl pacIol malclos llo vaIuo in llo
Irimary Bus Numbor rogislor and llo ollor fioIds aro as slalod abovo, llo
roquosl is convorlod inlo a SpociaI CycIo lransaclion on llo primary bus and
llo vrilo dala is doIivorod as llo mossago in llo lransaclions Dala Ilaso.
If il doosnl malcl llo bridgos Irimary Bus Numbor rogislor and ils oul-
sido llo rango of busos dofinod by llo bridgos Socondary Bus Numbor and
Subordinalo Bus Numbor rogislors, llo bridgo accopls llo pacIol (llo largol
bus is nol on llo dovnslroam sido of llo bridgo and lloroforo il musl bo
passod upslroam). Tlo bridgo accopls llo pacIol and passos il lo ils oppo-
silo inlorfaco.
Secondary Bus Number Register
- . Iocalod in Hoador bylo ono of dvord six. Tlo
Socondary Bus Numbor rogislor is iniliaIizod by soflvaro vill llo numbor of
llo bus llal is diroclIy connoclod lo llo bridgos socondary inlorfaco. Tlis rogis-
lor oxisls for llroo roasons:
- Wlon a SpociaI CycIo Roquosl is Ialclod on llo primary sido, llo bridgo
usos llis rogislor (and, possibIy, llo Subordinalo Bus Numbor rogislor) lo
dolormino if il slouId bo passod lo llo bridgos socondary inlorfaco as oillor
a ICI SpociaI CycIo lransaclion (if llo bus connoclod lo llo socondary inlor-
faco is llo doslinalion ICI or ICI-X bus) or as is (i.o., as a Typo 1 configura-
lion vrilo roquosl pacIol).
Chapter 22: PCI Compatible Configuration Registers
807
- Wlon a Typo 1 Configuralion lransaclion (road or vrilo and nol a ICI Spo-
ciaI CycIo Roquosl) is Ialclod on llo primary sido, llo bridgo usos llis rogis-
lor (and, possibIy, llo Subordinalo Bus Numbor rogislor) lo dolormino if il
slouId bo passod lo llo bridgos socondary inlorfaco as oillor a Typo 0 con-
figuralion lransaclion (if llo bus connoclod lo llo socondary inlorfaco is llo
doslinalion ICI or ICI-X bus) or as is (i.o., as a Typo 1 configuralion vrilo
roquosl pacIol).
- Wlon a CompIolion pacIol is Ialclod on llo primary sido, llo bridgo usos
llis rogislor (and, possibIy, llo Subordinalo Bus Numbor rogislor) lo dolor-
mino if il slouId bo passod lo llo bridgos socondary inlorfaco.
Subordinate Bus Number Register
- . Iocalod in Hoador bylo lvo of dvord six.
Tlo Subordinalo Bus Numbor rogislor is iniliaIizod by soflvaro vill llo num-
bor of llo liglosl-numborod bus llal oxisls on llo dovnslroam sido of llo
bridgo. If lloro aro no ICI-lo-ICI bridgos on llo socondary bus, llo Subordinalo
Bus Numbor rogislor is iniliaIizod vill llo samo vaIuo as llo Socondary Bus
Numbor rogislor.
Bridge Routes ID Addressed Packets Using Bus Number
Registers
Wlon ono of llo bridgos inlorfacos Ialclos a CompIolion pacIol, an ID-roulod
Vondor-dofinod mossago, or a ICI SpociaI CycIo roquosl, il usos ils inlornaI bus
numbor rogislors lo docido vlollor or nol lo accopl llo pacIol and pass il lo llo
opposilo bridgo inlorfaco:
- Tlo rouling of ICI SpociaI CycIo roquosls vas doscribod in llo provious soc-
lions.
- Wlon llo bridgo Ialclos a CompIolion pacIol or an ID-roulod Vondor-
dofinod mossago on ils primary inlorfaco, il comparos llo Bus Numbor por-
lion of doslinalion ID lo ils Socondary Bus Numbor and Subordinalo Bus
Numbor rogislor vaIuos. If llo largol bus numbor faIIs villin llo rango of
busos dofinod by llo bridgos Socondary Bus Numbor and Subordinalo Bus
Numbor rogislors, llo bridgo accopls llo pacIol and passos il lo ils opposilo
inlorfaco.
- Wlon llo bridgo Ialclos a CompIolion pacIol or an ID-roulod Vondor-
dofinod mossago on ils socondary inlorfaco, il comparos llo Bus Numbor
porlion of llo doslinalion ID lo ils Irimary Bus Numbor rogislor.
If il malclos, llo bridgo accopls llo pacIol and passos il lo llo primary
inlorfaco.
If il doosnl malcl llo bridgos Irimary Bus Numbor rogislor and ils
oulsido llo rango of busos dofinod by llo bridgos Socondary Bus Num-
PCI Express System Architecture
808
bor and Subordinalo Bus Numbor rogislors, llo bridgo accopls llo
pacIol (llo largol bus is nol on llo dovnslroam sido of llo bridgo and
lloroforo il musl bo passod upslroam) and passos il lo ils primary inlor-
faco.
If llo doslinalion bus faIIs villin llo rango of busos dofinod by llo
bridgos Socondary Bus Numbor and Subordinalo Bus Numbor rogis-
lors, llon llo largol bus is on llo dovnslroam sido of llo bridgo. Tlo
bridgo lloroforo doos nol accopl llo pacIol.
- Tloso rogislors aro aIso usod lo roulo Typo 1 configuralion pacIols.
Vendor ID Register
- . Soo Vondor ID Rogislor on pago 773.
Device ID Register
- . Soo Dovico ID Rogislor on pago 773.
Revision ID Register
- . Soo Rovision ID Rogislor on pago 773.
CIass Code Register
- . Rofor lo Iiguro 22-2 on pago 775. Tlo CIass
fioId in llo CIass Codo rogislor of a VirluaI ICI-lo-ICI bridgo, or a ICI Ixpross
bridgo lo a ICI or ICI-X bus viII conlain llo vaIuo 06l (soo TabIo 22-1 on
pago 775), llo SubCIass fioId viII conlain llo vaIuo 04l (soo TabIo 8 on
pago 1023), and llo Irogramming Inlorfaco Bylo viII conlain 00l.
Header Type Register
- . Rofor lo Hoador Typo Rogislor on pago 777.
Tlo Hoador Typo fioId in llo Hoador Typo rogislor of a VirluaI ICI-lo-ICI
bridgo, or a ICI Ixpross bridgo lo a ICI or ICI-X bus viII bo 01l, lloroby indi-
caling llo rogislor Iayoul slovn in Iiguro 22-13 on pago 803.
Chapter 22: PCI Compatible Configuration Registers
809
BIST Register
- .Rofor lo BIST Rogislor on pago 778.
CapabiIities Pointer Register
- . Rofor lo CapabiIilios Ioinlor Rogislor on
pago 779.
Basic Transaction FiItering Mechanism
ICI dovicos llal rosido on llo dovnslroam sido of a ICI-lo-ICI bridgo may
incorporalo inlornaI momory (mappod inlo momory spaco) and/or an inlornaI,
dovico-spocific rogislor sol mappod inlo oillor IO or momory-mappod IO spaco.
Tlo configuralion program aulomalicaIIy dolocls llo prosonco, lypo and
addross spaco roquiromonls of lloso dovicos and aIIocalos spaco lo llom by pro-
gramming lloir addross docodors lo rocognizo llo addross rangos il assigns lo
llom.
Tlo configuralion program assigns aII IO dovicos llal rosido bolind a ICI-lo-
ICI bridgo muluaIIy-oxcIusivo addross rangos llal aro bIocIod logollor villin
a common ovoraII rango of IO Iocalions. Tlo ICI-lo-ICI bridgo is llon pro-
grammod lo pass any IO lransaclions doloclod on llo primary sido of llo bridgo
lo llo socondary sido if llo largol addross is villin llo rango associalod vill
llo communily of IO dovicos llal rosido bolind llo bridgo. ConvorsoIy, any IO
lransaclions doloclod on llo socondary sido of llo bridgo aro passod lo llo pri-
mary sido if llo largol addross is oulsido llo rango associalod vill llo commu-
nily of IO dovicos llal rosido on llo socondary sido (bocauso llo largol dovico
doosnl rosido on llo socondary sido, bul may rosido on llo primary sido).
AII momory-mappod IO dovicos (i.o., non-profolclabIo momory) llal rosido
bolind a ICI-lo-ICI bridgo aro assignod muluaIIy-oxcIusivo momory addross
rangos villin a common bIocI of momory Iocalions. Tlo ICI-lo-ICI bridgo is
llon programmod lo pass any momory-mappod IO lransaclions doloclod on llo
primary sido of llo bridgo lo llo socondary sido if llo largol addross is villin
llo rango associalod vill llo communily of momory-mappod IO dovicos llal
rosido bolind llo bridgo. ConvorsoIy, any momory-mappod IO lransaclions
doloclod on llo socondary sido of llo bridgo aro passod lo llo primary sido if
llo largol addross is oulsido llo rango associalod vill llo communily of mom-
PCI Express System Architecture
810
ory-mappod IO dovicos llal rosido on llo socondary sido (bocauso llo largol
dovico doosnl rosido on llo socondary sido, bul may rosido on llo primary
sido).
AII momory dovicos (i.o., roguIar momory, nol momory-mappod IO) llal rosido
bolind a ICI-lo-ICI bridgo aro assignod muluaIIy-oxcIusivo momory addross
rangos villin a common ovoraII rango of momory Iocalions. Tlo ICI-lo-ICI
bridgo is llon programmod lo pass any momory lransaclions doloclod on llo
primary sido of llo bridgo lo llo socondary sido if llo largol addross is villin
llo rango associalod vill llo communily of momory dovicos llal rosido bolind
llo bridgo. ConvorsoIy, any momory lransaclions doloclod on llo socondary
sido of llo bridgo aro passod lo llo primary sido if llo largol addross is oulsido
llo rango associalod vill llo communily of momory dovicos llal rosido on llo
socondary sido (bocauso llo largol dovico doosnl rosido on llo socondary sido,
bul may rosido on llo primary sido).
Tlo bridgo ilsoIf may incorporalo:
- a momory buffor.
- an IO rogislor sol llal is usod lo conlroI llo bridgo
- a dovico ROM llal conlains a dovico drivor for llo bridgo.
Tlo bridgo musl incorporalo programmabIo addross docodors for lloso dovicos.
Bridges Memory, Register Set and Device ROM
Introduction
A ICI-lo-ICI bridgo dosignor may clooso lo incorporalo llo foIIoving onlilios
villin llo bridgo:
- A sol of inlornaI, dovico-spocific rogislors llal aro usod lo conlroI llo
bridgos oporalionaI claraclorislics or clocI ils slalus. Tloso rogislors aro
oulsido llo scopo of llo ICI spocificalion.
- A momory buffor villin llo bridgo.
- A dovico ROM llal conlains a dovico drivor for llo bridgo.
Tlo rogislor sol musl bo mappod inlo momory or IO addross spaco (or boll).
Tlo dosignor impIomonls ono or lvo Baso Addross Rogislors (programmabIo
addross docodors) for llis purposo.
Chapter 22: PCI Compatible Configuration Registers
811
If lloro is a dovico ROM villin llo bridgo, llo dosignor musl impIomonl an
Ixpansion ROM baso addross rogislor usod by configuralion soflvaro lo map
llo ROM inlo momory spaco.
IiIoviso, if llo bridgo incorporalos a momory buffor, llo dosign musl incIudo a
Baso Addross Rogislor usod lo assign a baso addross lo llo momory.
Base Address Registers
- . -- - -
- - .
Iocalod in Hoador dvords four and fivo. If llo dosignor doosnl impIomonl any
inlornaI, dovico-spocific rogislor sol or momory, llon lloso addross docodors
aronl nocossary. Tloso Baso Addross Rogislors aro usod in llo samo mannor as
lloso doscribod for a non-bridgo ICI funclion (soo Baso Addross Rogislors on
pago 792). If impIomonlod, boll may bo impIomonlod as momory docodors,
boll as IO docodors, ono as momory and ono as IO, or onIy ono may bo impIo-
monlod as oillor IO or momory.
If a BAR is impIomonlod as a momory BAR vill llo profolclabIo bil sol lo ono,
il musl bo impIomonlod as a 64-bil momory BAR and vouId lloroforo consumo
boll dvords four and fivo.
Expansion ROM Base Address Register
- . -- -
- Iocalod in Hoador dvord 14. Tlis rogislor is oplionaI
(bocauso lloro may nol bo a dovico ROM incorporalod villin llo bridgo). Tlo
formal and usago of llis rogislor is procisoIy llo samo as llal doscribod for a
non-bridgo ICI funclion (soo Ixpansion ROM Baso Addross Rogislor on
pago 783).
Bridges IO FiIter
-- .
Introduction
- - - - -
. Ior llis roason, impIomonlalion of llo IO docodo-roIalod con-
figuralion rogislors is oplionaI.
PCI Express System Architecture
812
Wlon llo bridgo dolocls an IO lransaclion inilialod on oillor of ils bus inlor-
facos, il musl dolormino vlicl of llo foIIoving aclions lo laIo:
1. - bocauso llo largol IO addross isnl Iocalod on llo
ollor sido of llo bridgo, nor is il largoling an IO Iocalion omboddod villin
llo bridgo ilsoIf.
2. Wlon llo -- - - --, llo
Roquoslor is pormillod lo accoss llo largolod inlornaI rogislor and llo -
- -- .
3. llo largol IO Iocalion is Iocalod on llo ollor sido of llo bridgo, llo
- - -- and is inilialod on llo opposilo
bus.
Tlo oplionaI configuralion rogislors villin llo bridgo llal supporl llis fiIlor-
ing capabiIily aro:
- - -- --. If prosonl, llo Baso Addross Rogislor or rogislors
can bo dosignod as IO or momory docodors for an inlornaI rogislor sol or
momory.
- - --. If llo bridgo supporls IO spaco on llo
dovnslroam sido of llo bridgo, llo IO Baso rogislor dofinos llo slarl addross
and llo IO Iimil rogislor dofinos llo ond addross of llo rango lo rocognizo
and pass llrougl lo llo socondary bus.
- - -- (IO Baso Uppor 16-Bils and IO Iimil Uppor 16-Bils
rogislors). If llo bridgo supporls a 4GB (rallor llan a 64KB) IO addross
spaco on llo dovnslroam sido of llo bridgo (as indicalod in llo IO Baso and
IO Iimil rogislors), llo combinalion of llo IO Baso and llo IO Baso Uppor
16 Bils rogislors dofino llo slarl addross, and llo combinalion of llo IO
Iimil and llo IO Iimil Uppor 16-Bils rogislors dofino llo ond addross of llo
rango lo rocognizo and pass lo llo socondary sido.
Tlo soclions llal foIIov doscribo oacl of lloso sconarios.
Bridge Doesnt Support Any IO Space Behind Bridge
Assumo llal a bridgo doosnl supporl any dovicos llal rosido in IO spaco on llo
dovnslroam sido of llo bridgo. In ollor vords, il doosnl rocognizo any IO
addrossos as boing impIomonlod bolind llo bridgo and lloroforo ignoros aII IO
lransaclions doloclod on ils primary bus. In llis caso, llo bridgo dosignor doos
nol impIomonl llo oplionaI IO Baso, IO Iimil, or IO Ixlonsion rogislors (i.o., IO
Baso Uppor 16-bils and IO Iimil Uppor 16-Bils rogislors).
Tlo bridgo ignoros aII IO roquosl pacIols doloclod on llo primary bus (ollor
llan lransaclions llal may largol an oplionaI sol of bridgo-spocific rogislors con-
lainod villin llo bridgo ilsoIf).
Chapter 22: PCI Compatible Configuration Registers
813
Any IO lransaclions doloclod on llo bridgos socondary bus vouId bo cIaimod
and passod llrougl lo llo primary bus in caso llo largol IO dovico is impIo-
monlod somovloro upslroam of llo bridgo.
Bridge Supports 64KB IO Space Behind Bridge
Assumo llal a bridgo is dosignod lo supporl IO lransaclions inilialod on llo pri-
mary bus llal may largol Iocalions villin llo firsl 64KB of IO spaco (IO Ioca-
lions 00000000l llrougl 0000IIIIl) on llo socondary sido of llo bridgo. Il
ignoros any primary sido IO accossos ovor llo 64KB addross boundary. In ollor
vords, llo bridgo supporls a 64KB IO spaco, bul nol a 4GB IO spaco on llo soc-
ondary sido of llo bridgo.
In llis caso, llo bridgo dosignor musl impIomonl llo IO Baso and llo IO Iimil
rogislors, bul doos nol impIomonl llo IO Ixlonsion rogislors (i.o., llo IO Baso
Uppor 16-Bils and llo IO Iimil Uppor 16-Bils rogislors).
Tlo IO Baso and IO Iimil rogislor pair compriso llo gIobaI IO addross docodor
for aII IO largols llal rosido on llo socondary sido of llo bridgo:
1. Boforo llo rogislors aro iniliaIizod by llo configuralion soflvaro, lloy aro
firsl road from lo dolormino vlollor lloy supporl 64KB or a 4GB of IO
spaco on llo socondary sido of llo bridgo. In llis sconario, assumo llal llo
rogislors aro lardvirod lo indicalo llal llo bridgo onIy supporls a 64KB IO
spaco.
2. Tlo configuralion soflvaro llon vaIIs llo socondary bus (and any subordi-
nalo busos il discovors) and assigns lo oacl IO docodor il discovors an
oxcIusivo IO addross rango villin llo firsl 64KB of IO spaco. Tlo sub-
rangos assignod lo llo dovicos aro assignod in soquonliaI bIocIs lo maIo
officionl uso of IO spaco.
3. Tlo IO Baso and Iimil rogislor pair aro llon iniliaIizod by llo slarlup con-
figuralion soflvaro vill llo slarl and ond addross of llo IO rango llal aII
IO dovicos llal voro discovorod bolind llo bridgo (on llo socondary and
on any subordinalo busos) lavo boon programmod lo rosido villin. In llis
caso, sinco llo bridgo onIy supporls llo firsl 64KB of IO spaco, llo dofinod
rango viII bo a subsol of llo firsl 64KB of IO spaco.
4. Aflor lloy lavo boon iniliaIizod, lloso lvo rogislors provido llo bridgo vill
llo slarl and llo ond addross of llo IO addross rango lo rocognizo. Aflor
lloy lavo boon iniliaIizod, lloso lvo rogislors provido llo bridgo vill llo
slarl and llo ond addross of llo IO addross rango lo rocognizo for passing
IO lransaclions llrougl llo bridgo.
PCI Express System Architecture
814
Tlo bridgo onIy supporls llo Iovor 64KB of IO spaco, bul llo IO addross
docodor comprisod of llo IO Baso and Iimil rogislors musl porform a fuII IO
addross docodo of addross bils |31:2] lo dolormino vlollor or nol lo accopl an
IO accoss on llo primary bus and pass il lo llo socondary bus.
Tlo formal of llo IO Baso and IO Iimil rogislors aro iIIuslralod in Iiguro 22-14
on pago 815 and Iiguro 22-15 on pago 815. Boll rogislors lavo llo samo formal:
- llo uppor lox digil, bils |7:4], dofinos llo mosl-significanl lox digil of a 16-
bil IO addross,
- llo Iovor lox digil, bils |3:0], dofinos vlollor llo bridgo porforms a 16-bil
or 32-bil IO addross docodo.
In llo sconario undor discussion, llo Iovor lox digil of boll rogislors is lard-
virod vill llo vaIuo 0l, indicaling llal il porforms a 16-bil IO addross docodo
and lloroforo onIy supporls addrossos villin llo firsl 64KB of IO spaco.
Assumo llal llo configuralion soflvaro programs llo uppor digil of llo IO Baso
rogislor vill llo vaIuo 2l and llo uppor digil of llo IO Iimil rogislor vill llo
vaIuo 3l. Tlis indicalos llal llo slarl of llo IO rango lo rocognizo is 2000l and
llo ond addross is 3IIIlan 8KB bIocI. As anollor oxampIo, assumo llal llo
uppor digil in llo baso and Iimil rogislors aro boll sol lo 3l. Tlo IO addross
rango lo rocognizo is llon 3000l llrougl 3IIIla 4KB bIocI. In ollor vords,
llis rogislor pair dofinos llo slarl addross aIignod on a 4KB addross boundary,
and llo sizo, aIso roforrod lo as llo granuIarily, of llo dofinod bIocI is in incro-
monls of 4KB.
Il slouId bo nolod llal, if lloro aronl any IO dovicos on llo bridgos socondary
sido, llo IO Iimil rogislor can bo programmod vill a numoricaIIy Iovor IO
addross llan llo IO Baso rogislor. Tlo bridgo viII nol pass any IO lransaclions
Ialclod on llo primary sido llrougl lo llo socondary sido, bul viII pass any IO
lransaclions Ialclod on llo socondary sido llrougl lo llo primary sido.
Chapter 22: PCI Compatible Configuration Registers
815
- -
-
PCI Express System Architecture
816
. Assumo llal llo IO baso is sol lo 2l and llo IO Iimil is sol lo 3l. Tlo
bridgo is nov primod lo rocognizo any IO lransaclion on llo primary bus llal largols
an IO addross villin llo rango consisling of 2000l llrougl 3IIIl. Rofor lo Iiguro 22-
16 on pago 817.
Anylimo llal llo bridgo dolocls an IO lransaclion on llo primary bus vill an addross
insido llo 2000l llrougl 3IIIl rango, il accopls llo lransaclion and passos il llrougl
(bocauso ils villin llo rango dofinod by llo IO Baso and Iimil rogislors and may
lloroforo bo for an IO dovico llal rosidos bolind llo bridgo).
Anylimo llal llo bridgo dolocls an IO lransaclion on llo primary bus vill an addross
oulsido llo 2000l llrougl 3IIIl rango, il ignoros llo lransaclion (bocauso llo largol
IO addross is oulsido llo rango of addrossos assignod lo IO dovicos llal rosido bolind
llo bridgo).
Anylimo llal llo bridgo dolocls an IO lransaclion on llo socondary bus vill an
addross insido llo 2000l llrougl 3IIIl rango, il ignoros llo lransaclion (bocauso llo
largol addross faIIs villin llo rango assignod lo IO dovicos llal rosido on llo socond-
ary sido of llo bridgo).
Anylimo llal llo bridgo dolocls an IO lransaclion on llo socondary bus vill an
addross oulsido llo 2000l llrougl 3IIIl rango, il accopls llo lransaclion and passos
il llrougl lo llo primary sido (bocauso llo largol addross faIIs oulsido llo rango
assignod lo IO dovicos llal rosido on llo socondary sido of llo bridgo, bul il may bo
for an IO dovico on llo primary sido).
Chapter 22: PCI Compatible Configuration Registers
817
Bridge Supports 4GB IO Space Behind Bridge
Assumo a bridgo is dosignod lo rocognizo IO lransaclions inilialod on llo pri-
mary bus llal largol Iocalions anyvloro villin 4GB of IO spaco (IO Iocalions
00000000l llrougl IIIIIIIIl) on llo dovnslroam sido of llo bridgo.
In llis caso, in addilion lo llo IO Baso and llo IO Iimil rogislors, llo bridgo
dosignor musl aIso impIomonl llo IO Ixlonsion rogislorsIO Baso Uppor 16-
bils and llo IO Iimil Uppor 16-bils rogislors:
-
PCI Express System Architecture
818
- Tlo IO Baso rogislor is iniliaIizod vill llo fourll digil of llo 32-bil slarl IO
addross.
- Tlo IO Baso Uppor 16 bils rogislor is iniliaIizod vill llo fifll llrougl llo
oigll digils of llo 32-bil slarl addross of llo rango.
- Tlo IO Iimil rogislor is iniliaIizod vill llo fourll digil of llo 32-bil ond IO
addross.
- Tlo IO Iimil Uppor 16 bils rogislor is iniliaIizod vill llo fifll llrougl
oiglll digils of llo 32-bil ond addross of llo rango.
Tlo IO Baso and IO Iimil rogislor pair compriso an IO addross docodor. Tloy
aro usod as foIIovs:
1. Boforo llo rogislors aro iniliaIizod by llo configuralion soflvaro, lloy aro
road from lo dolormino if lloy aro capabIo of supporling a 64KB or a 4GB IO
addross spaco bolind llo bridgo. In llis sconario, llo Addross Docodo Typo
fioId (soo Iiguro 22-14 on pago 815) villin oacl of llo rogislors is lardvirod
(vill a vaIuo of 1l) lo indicalo llal a 4GB IO spaco is supporlod on llo soc-
ondary sido.
2. Tlo configuralion soflvaro llan vaIIs llo socondary bus (and any subordi-
nalo busos il discovors bonoall llo socondary bus) and assigns oacl IO
dovico llal il discovors an oxcIusivo IO addross rango villin llo 4GB IO
spaco. Tlo sub-rangos assignod lo llo dovicos aro assignod in soquonliaI
bIocIs lo maIo officionl uso of IO spaco.
3. Tlo IO Baso and IO Baso Ixlonsion (i.o., llo IO Baso Uppor 16-bils) rogislor
pair is llon iniliaIizod by llo slarlup configuralion soflvaro vill llo uppor
fivo digils of llo 4KB-aIignod, 32-bil slarl addross of llo IO rango llal aII IO
dovicos llal voro discovorod bolind llo bridgo (on llo socondary and on
any subordinalo busos) lavo boon programmod lo rosido villin.
4. Tlo IO Iimil and IO Iimil Ixlonsion (i.o., llo IO Iimil Uppor 16 bils) rogis-
lor pair is iniliaIizod vill llo 4KB-aIignod ond addross of llo rango llal llo
dovicos occupy.
In llo sconario undor discussion, sinco llo bridgo supporls llo onliro 4GB IO
spaco, llo dofinod rango is a subsol of llo ovoraII 4GB IO spaco. Aflor lloy lavo
boon iniliaIizod, lloso four rogislors provido llo bridgo vill llo slarl and llo
ond addross of llo IO addross rango lo rocognizo.
Sinco llo bridgo supporls llo onliro 4GB IO spaco, llo IO addross docodor com-
prisod of llo four rogislors (Baso and Iimil rogislors pIus lloir Ixlonsion rogis-
lors) porforms an IO addross docodo villin addross bils |31:12] lo dolormino
vlollor or nol lo pass an IO accoss doloclod on llo primary bus llrougl lo llo
socondary bus and vico vorsa.
Chapter 22: PCI Compatible Configuration Registers
819
Tlo formal of llo IO Baso and IO Iimil rogislors vas iIIuslralod oarIior in Iiguro
22-14 on pago 815 and Iiguro 22-15 on pago 815. In llo sconario undor discus-
sion, llo Iovor lox digil of llo Baso and Iimil rogislors is lardvirod vill llo
vaIuo 1l, indicaling a 32-bil IO addross docodo, supporling addross rocognilion
villin llo onliro 4GB IO spaco. SimpIy pul, llo IO Baso and IO Iimil Uppor 16-
bils rogislors aro usod lo loId llo uppor four digils of llo slarl and ond IO
addross boundarios, rospoclivoIy.
Assumo llal llo configuralion soflvaro programs llo rogislors as foIIovs:
- Uppor digil of llo IO Baso = 2l.
- IO Baso Uppor 16-bils rogislor = 1234l.
- Uppor digil of llo IO Iimil rogislor = 3l.
- IO Iimil Uppor 16-bils rogislor = 1235l.
Tlis indicalos a 72KB rango consisling of:
- slarl of IO rango = 12342000l
- ond addross = 12353IIIl.
As anollor oxampIo, assumo llo foIIoving:
- Uppor digil of llo IO Baso = 3l.
- IO Baso Uppor 16-bils rogislor = 1234l.
- Uppor digil of llo IO Iimil rogislor = 3l.
- IO Iimil Uppor 16-bils rogislor = 1234l.
Tlis indicalos a 4KB rango consisling of:
- slarl of IO rango = 12343000l
- ond addross = 12343IIIl.
In ollor vords, llo four rogislors dofino llo slarl addross aIignod on a 4KB
addross boundary, and llo sizo of llo dofinod bIocI is an incromonl of 4KB.
Bridges PrefetchabIe Memory FiIter
- .
-- - - -
- - -
- - - -- -
PCI Express System Architecture
820
- - -

Wlon a ICI bus maslor inilialos a momory road lransaclion, il
issuos llo slarl momory addross bul doos nol indicalo lov mucl dala is lo
bo road. Tlo onIy oxcoplion is a singIo Dala Ilaso momory road. In llal
caso, llo lolaI amounl of dala lo bo road is roprosonlod by llo Bylo InabIos
llal aro prosonlod in llal Dala Ilaso.
Wlon llo dovico acling as llo largol on llo inilialing bus rocoivos llo lrans-
aclion roquosl, llo mannor in vlicl llo roquosl is landIod doponds on llo
dovico lypo (bridgo or uIlimalo momory largol), as voII as llo lransaclion
lypo usod by llo bus maslor:
- - - :
- , llon llo
largol may porform inlornaI profolclos (i.o., road-aloads) and
quouo up dala lo bo suppIiod lo llo roquoslor if llo lransaclion
onds up asIing for llo dala. Tlis is lo onlanco porformanco. If llo
lransaclion onds villoul aII of llo profolclod dala boing asIod for,
llo romaining dala in llo largols road-aload buffor slouId bo dis-
cardod (unIoss llo largol can guaranloo llo conlinuod froslnoss of
llo dala).
- (o.g., ils a momory-
mappod IO rogislor sol), llon llo momory largol musl vail unliI llo
Bylo InabIos aro prosonlod in oacl Dala Ilaso and onIy road and
suppIy llo roquoslod bylos. No profolcling is pormillod.
- - - ,
llo bridgo Ialclos llo roquosl and issuos a Rolry lo llo inilialing maslor:
- - , lloro aro lvo possibiIi-
lios:
If llo momory addross is -
, llo bridgo may lurn llo road inlo a bursl road
vlon il inilialos llo roquosl on llo ollor sido of llo bridgo and
profolcl dala inlo a bridgo buffor. Wlon llo originaI maslor
llon rolrios llo lransaclion, llo bridgo sourcos dala from llo
fasl road-aload buffor yioIding bollor porformanco. If llo mas-
lor uIlimaloIy doosnl consumo aII of llo dala, il is discardod by
llo bridgo.
- (o.g., ils a mom-
ory-mappod IO rogislor sol), llon no profolcling by llo bridgo
is pormillod vlon il ro-inilialos llo road on llo opposilo sido of
llo bridgo.
Chapter 22: PCI Compatible Configuration Registers
821
- - llis loIIs
llo bridgo llal llo maslor las spocific InovIodgo llal llo momory
rango from llo lransaclions slarl addross up lo llo ond of llo
addrossod Iino of momory spaco is profolclabIo momory. Ivon if
llo bridgos profolclabIo momory rango rogislors indicalo llis is
nol profolclabIo momory, llo bridgo may lurn llo road inlo a bursl
road vlon il inilialos llo roquosl on llo ollor sido of llo bridgo and
profolcl dala up lo llo ond of llo curronl Iino inlo a bridgo buffor.
Wlon llo originaI maslor llon rolrios llo lransaclion, llo bridgo
sourcos dala from llo fasl road-aload buffor yioIding bollor porfor-
manco. If llo maslor uIlimaloIy doosnl consumo aII of llo dala, il is
discardod by llo bridgo.
- - llis
loIIs llo bridgo llal llo maslor las spocific InovIodgo llal llo
momory rango from llo lransaclions slarl addross and up lo llo
ond of llo Iino immodialoIy foIIoving llo addrossod Iino of mom-
ory spaco is profolclabIo momory. Ivon if llo bridgos profolclabIo
momory rango rogislors indicalo llis is nol profolclabIo momory,
llo bridgo may lurn llo road inlo a bursl road vlon il inilialos llo
roquosl on llo ollor sido of llo bridgo and profolcl dala across
caclo Iino boundarios inlo a bridgo buffor. Wlon llo originaI mas-
lor llon rolrios llo lransaclion, llo bridgo sourcos dala from llo fasl
road-aload buffor yioIding bollor porformanco. If llo maslor uIli-
maloIy doosnl consumo aII of llo dala, il is discardod by llo
bridgo.
-- Wlon a ICI Ixpross Roquoslor issuos a momory road
roquosl, il indicalos llo oxacl amounl of dala il vislos lo road:
- Tlo Iirsl DW Bylo InabIo fioId in llo roquosl pacIol loador indicalos
llo bylo(s) lo bo road from llo firsl dvord.
- Tlo Iongll fioId in llo roquosl pacIol loador indicalos llo ovoraII num-
bor of dvords in llo lransfor.
- Tlo Iasl DW Bylo InabIo fioId in llo roquosl pacIol loador indicalos
llo bylo(s) lo bo road from llo Iasl dvord.
Sinco llo oxacl amounl of roquoslod dala is Inovn al llo onsol of a momory
road roquosl, lloro is no roason for profolcling lo acliovo bollor porfor-
manco (as lloro is in ICI).
PCI Express System Architecture
822
- Tlo foIIoving Ixpross
spoc 1.0a roforoncos roprosonl aII of ils roforoncos lo profolcling:
- Iago 33, Iino 5: A ICI Ixpross Indpoinl roquosling momory rosourcos
llrougl a BAR musl sol llo BARs IrofolclabIo bil unIoss llo rango
conlains Iocalions vill road sido-offocls or Iocalions in vlicl llo
dovico doos nol loIoralo vrilo morging.
- Iago 33, Iino 8: Ior a ICI Ixpross Indpoinl, 64-bil addrossing musl bo
supporlod for aII BARs llal lavo llo profolclabIo bil sol. 32-bil addross-
ing is pormillod for aII BARs llal do nol lavo llo profolclabIo bil sol.
- Iago 52, Iino 13: Ior oacl bil of llo Bylo InabIos fioIds: a vaIuo of 0b
indicalos llal llo corrosponding bylo of dala musl nol bo vrillon or, if
non profolclabIo, musl nol bo road al llo CompIolor.
- Iago 54, Iino 9: Tlis is roaIIy jusl a spocific caso of llo ruIo llal in a
non-profolclabIo spaco, non-onabIod bylos musl nol bo road al llo
CompIolor.
- Iago 265, Iino 26: Ior oxampIo, if a Road is issuod lo profolclabIo mom-
ory spaco and llo CompIolion rolurns vill a Unsupporlod Roquosl
CompIolion Slalus, porlaps duo lo a lomporary condilion, llo inilialor
may clooso lo roissuo llo Road Roquosl villoul sido offocls.
- Iago 326, Iino 5: A ICI Ixpross Indpoinl roquosling momory
rosourcos llrougl a BAR musl sol llo BAR's IrofolclabIo bil unIoss llo
rango conlains Iocalions vill road sido-offocls or Iocalions in vlicl llo
dovico doos nol loIoralo vrilo morging. Il is slrongIy oncouragod llal
momory-mappod rosourcos bo dosignod as profolclabIo vlonovor pos-
sibIo. ICI Ixpross dovicos ollor llan Iogacy Indpoinls musl supporl
64-bil addrossing for any Baso Addross rogislor llal roquosls profolcl-
abIo momory rosourcos.
- Iago 328, Iino 1: A ICI Ixpross Indpoinl roquosling momory
rosourcos llrougl a BAR musl sol llo BAR's IrofolclabIo bil unIoss llo
rango conlains Iocalions vill road sido-offocls or Iocalions in vlicl llo
dovico doos nol loIoralo vrilo morging. Il is slrongIy oncouragod llal
momory-mappod rosourcos bo dosignod as profolclabIo vlonovor pos-
sibIo. ICI Ixpross dovicos ollor llan Iogacy Indpoinls musl supporl
64-bil addrossing for any Baso Addross rogislor llal roquosls profolcl-
abIo momory rosourcos.
- Iago 329: Tlo IrofolclabIo Momory Baso and IrofolclabIo Momory
Iimil rogislors musl indicalo llal 64-bil addrossos aro supporlod, as
dofinod in ICI Bridgo 1.1. - - -
- -- - -
- -- --
- --
Chapter 22: PCI Compatible Configuration Registers
823
Characteristics of PrefetchabIe Memory Devices
- -- -
- --
-- - -
- - - Tlo ICI-lo-ICI bridgo spocificalion rocognizos
llo facl llal vliIo boll groups aro mappod inlo momory addross spaco, mom-
ory dovicos and momory-mappod IO dovicos can lavo dislinclIy difforonl opor-
alionaI claraclorislics.
An oplionaI sol of rogislors aro providod in llo bridgos configuralion spaco llal
pormil llo configuralion soflvaro lo dofino llo slarl and ond addross of llo
profolclabIo momory spaco llal is occupiod by voII-bolavod momory dovicos
bolind llo bridgo. A mandalory rogislor pair pormils llo configuralion sofl-
varo lo dofino llo slarl and ond addross of llo momory-mappod IO spaco llal
is occupiod by voII-bolavod momory dovicos bolind llo bridgo.
- A voII-bolavod momory dovico
aIvays rolurns llo samo dala from a Iocalion no mallor lov many limos llo
Iocalion is road from. In ollor vords, roading from a momory dovico
doosnl in any vay aIlor llo conlonls of momory. Tlis is ono of llo clarac-
lorislics of a profolclabIo momory largol.
- A bridgo incor-
poralos a poslod-vrilo buffor llal quicIIy absorbs dala lo bo vrillon lo a
momory dovico on llo ollor sido of llo bridgo. Sinco llo inilialing
Roquoslor is abIo lo immodialoIy compIolo a momory vrilo and doosnl
lavo lo doIay unliI llo vrilo lo llo momory dovico las acluaIIy boon com-
pIolod, posling yioIds bollor porformanco during momory vrilo oporalions.
Tlo bridgo vouId onsuro llal, boforo any subsoquonl momory road is por-
millod lo propagalo llrougl llo bridgo, llo bridgo vouId fIusl ils poslod-
vrilo buffor lo llo momory dovico. Bylo morging is pormillod in a bridgos
poslod momory vrilo buffor vlon landIing vrilos lo profolclabIo momory
(for moro informalion, rofor lo Bylo Morging on pago 801).
Characteristics of Memory-Mapped IO Devices
Momory-mappod IO dovicos oxlibil a difforonl sol of oporalionaI claracloris-
lics.
PCI Express System Architecture
824
-- Iorforming a momory road from a momory-
mappod IO Iocalion oflon las llo offocl of aIloring llo conlonls of llo Ioca-
lion. As oxampIos, ono of llo foIIoving may bo lruo:
- Tlo Iocalion may bo occupiod by a momory-mappod IO slalus porl.
Roading from llo Iocalion causos llo IO dovico lo doassorl any slalus
bils llal voro sol in llo rogislor (on llo assumplion llal lloyvo boon
road and viII lloroforo bo doaIl vill by llo dovico drivor). If llo road
vas causod by a profolcl and llo profolclod dala is novor acluaIIy road
by llo dovico drivor, llon slalus informalion las jusl boon discardod.
- Tlo Iocalion may bo llo fronl-ond of a IIIO dala buffor. Iorforming a
road from llo Iocalion causos llo doIivory of ils curronl conlonls and
llo noxl dala ilom is llon aulomalicaIIy pIacod in llo Iocalion by llo IO
dovico. Tlo dovico assumos llal llo firsl dala ilom las jusl boon road by
llo dovico drivor and sols up llo noxl dala ilom in llo IIIO Iocalion. If
llo road vas causod by a profolcl and llo profolclod dala is novor aclu-
aIIy road by llo dovico drivor, llon llo dala las jusl boon discardod.
Roads villin an aroa of momory spaco occupiod by momory-mappod IO
dovicos musl novor rosuIl in profolcling by a bridgo. A mandalory sol of
rogislors aro providod llal pormil llo configuralion soflvaro lo dofino llo
slarl and ond addross of llo momory spaco llal is occupiod by momory-
mappod IO dovicos llal rosido on llo bridgos socondary sido.
-- Soo Bylo Morging on pago 801.
Determining If Memory Is PrefetchabIe or Not
Tlo configuralion soflvaro dolorminos llal a momory largol supporls profolcl-
ing by losling llo slalo of llo allribulo bil in llo momory largols
Baso Addross Rogislor (soo Baso Addross Rogislors on pago 792 and
IrofolclabIo Allribulo Bil on pago 795).
- IrofolclabIo = 1 indicalos llal llo momory is profolclabIo. Tlo momory lar-
gol musl bo mappod inlo IrofolclabIo momory spaco using llo bridgos
IrofolclabIo Baso and Iimil configuralion rogislors ( if lloy aro impIo-
monlod).
- IrofolclabIo = 0 indicalos llal ils nol. In llis caso, llo momory largol musl
bo mappod inlo momory-mappod IO spaco using llo Momory Baso and
Iimil rogislors.
Chapter 22: PCI Compatible Configuration Registers
825
Bridge Support For Downstream PrefetchabIe Memory Is
OptionaI
If llo bridgo doos nol supporl IrofolclabIo momory on ils socondary sido, llo
IrofolclabIo Momory Baso and Iimil rogislors musl bo impIomonlod as road-
onIy rogislors llal rolurn zoro vlon road, and llo IrofolclabIo Momory Baso
and IrofolclabIo Momory Iimil rogislors aro nol impIomonlod.
Must Support > 4GB PrefetchabIe Memory On Secondary Side
Wlollor or nol a bridgo supporls profolclabIo momory on llo bridgos dovn-
slroam sido is oplionaI. If llo dosignor cloosos lo supporl llis capabiIily, llon
llo foIIoving rogislors musl bo impIomonlod lo dofino llo slarl and ond addross
of llo momory rango occupiod by profolclabIo momory dovicos on llo dovn-
slroam sido of llo bridgo:
- IrofolclabIo Momory Baso rogislor.
- IrofolclabIo Momory Iimil rogislor.
Tloso lvo rogislors aro usod lo dofino llo slarl (baso) and ond (Iimil) addross of
llo momory rango and aro iIIuslralod in Iiguro 22-17 on pago 827 and Iiguro 22-
18 on pago 828. Any addross villin llo Iovor 4GB can bo spocifiod. Tlo slarl
addross is 1MB-aIignod and llo sizo of llo rango is spocifiod in 1MB incromonls.
Tlo Ixpross spoc slalos llal aII momory BARs for profolclabIo momory musl bo
impIomonlod as 64-bil rogislors (soo Iiguro 22-11 on pago 797). To supporl llis,
llo oxlonsions lo Baso and Iimil rogislors musl aIso bo impIomonlod:
- IrofolclabIo Momory Baso Uppor 32-bils rogislor.
- IrofolclabIo Momory Iimil Uppor 32-bils rogislor.
Tlo 4-bil Addross Docodo Typo fioId in llo Baso and Iimil rogislors is lard-
virod lo indicalo llal llo oxlonsion rogislors aro prosonl.
Tlo configuralion soflvaro vaIIs llo socondary bus and any busos subordinalo
lo llo bridgo and assigns oacl IrofolclabIo momory largol a sub-rango in a gIo-
baI ovoraII rango villin llo 2
64
momory spaco. Aflor compIoling llo addross
assignmonl procoss, llo soflvaro llon vrilos llo uppor oigll lox digils of llo
rangos 64-bil slarl addross inlo llo IrofolclabIo Momory Baso Uppor rogislor
and llo noxl llroo lox digils inlo llo uppor llroo digils of llo Baso rogislor. Tlo
uppor oigll lox digils of llo rangos 64-bil ond addross is vrillon inlo llo
IrofolclabIo Momory Iimil Uppor rogislor and llo noxl llroo lox digils inlo llo
uppor llroo digils of llo Iimil rogislor.
PCI Express System Architecture
826
As an oxampIo, assumo llal lloso four rogislors aro sol as foIIovs:
- II00000l is vrillon inlo llo IrofolclabIo Momory Baso Uppor 32-bils rogis-
lor.
- 123l is vrillon inlo llo uppor llroo digils of llo Baso rogislor.
- II000000l is vrillon inlo IrofolclabIo Momory Iimil Uppor 32-bils rogislor.
- 124l is vrillon inlo llo uppor llroo digils of llo Iimil rogislor.
Tlis dofinos llo IrofolclabIo momory addross rango as llo 2MB rango from
II00000012300000l llrougl II000000124IIIIIl. As anollor oxampIo, assumo
lloy aro programmod as foIIovs:
- 00000230l is vrillon inlo llo IrofolclabIo Momory Baso Uppor 32-bils rog-
islor.
- 222l vrillon inlo llo uppor llroo digils of llo Baso rogislor.
- 00000230l is vrillon inlo IrofolclabIo Momory Iimil Uppor 32-bils rogislor.
- 222l vrillon inlo llo uppor llroo digils of llo Iimil rogislor.
Tlis dofinos llo IrofolclabIo momory addross rango as llo 1MB rango from
0000023022200000l llrougl 00000230222IIIIIl.
Chapter 22: PCI Compatible Configuration Registers
827
- -
PCI Express System Architecture
828
-
Chapter 22: PCI Compatible Configuration Registers
829
RuIes for Bridge PrefetchabIe Memory Accesses
Tlo foIIoving ruIos appIy lo IrofolclabIo momory:
1. Bridgo supporl for IrofolclabIo momory on ils socondary sido is oplionaI.
2. If llo bridgo doos nol supporl IrofolclabIo momory on ils socondary sido,
llo IrofolclabIo Momory Baso and Iimil rogislors musl bo impIomonlod as
road-onIy rogislors llal rolurn zoro vlon road.
3. If llo bridgo doos supporl profolclabIo momory on ils dovnslroam sido, il
musl impIomonl llo IrofolclabIo Momory Baso and Iimil rogislors, as voII
as llo IrofolclabIo Momory Baso and Iimil Uppor 32-bils rogislors (as indi-
calod by lardviring llo firsl digil in llo Baso and Iimil rogislors lo a vaIuo
of 1l).
4. Momory lransaclions aro forvardod from llo primary lo llo socondary bus
if llo addross is villin llo rango dofinod by llo IrofolclabIo Momory Baso
and Iimil rogislors or llal dofinod by llo Momory Baso and Iimil rogislors
(for momory-mappod IO).
5. Momory lransaclions aro forvardod from llo socondary lo llo primary bus
vlon llo addross is oulsido llo rangos dofinod by llo oxlondod Irofolcl-
abIo Momory Baso and Iimil rogislors and llo Momory Baso and Iimil rog-
islors (for momory-mappod IO).
6. Wlon 2
64
momory is supporlod on llo dovnslroam sido of llo bridgo,
lransaclions largoling addrossos villin llo addross rango spocifiod by llo
IrofolclabIo Momory Baso and Iimil rogislors (and lloir oxlonsions) aro
pormillod lo cross llo 4GB boundary.
7. Tlo bridgo dosignor musl supporl momory accoss roquosls abovo llo 4GB
addross boundary rocoivod by ils dovnslroam inlorfaco. Irior lo llo 1.1
ICI-lo-ICI bridgo spoc, il vas oplionaI on boll sidos. Tlis vas clangod lo
onsuro llal Roquoslors on llo socondary sido can accoss main momory
abovo llo 4GB addross boundary.
8. Assumo llal llo bridgo supporls IrofolclabIo momory anyvloro in 2
64
momory spaco on llo dovnslroam sido, bul llo configuralion soflvaro
maps aII IrofolclabIo momory bolind llo bridgo boIov llo 4GB boundary.
In llis caso, llo uppor oxlonsions of llo IrofolclabIo Baso and Iimil rogis-
lors musl bo sol lo zoro and llo bridgo doos nol rospond lo momory accoss
roquosls abovo llo 4GB addross boundary rocoivod on llo upslroam inlor-
faco. Tloso rocoivod by llo bridgos dovnslroam inlorfaco vouId bo passod
lo llo upslroam inlorfaco (in caso llo Roquoslor is addrossing main momory
abovo llo 4GB boundary).
9. Assumo llal llo bridgo supporls IrofolclabIo momory anyvloro in 2
64
momory spaco on llo dovnslroam sido and llal llo configuralion soflvaro
maps aII IrofolclabIo momory on llo dovnslroam sido abovo llo 4GB
PCI Express System Architecture
830
boundary. In llis caso, llo uppor oxlonsions of llo IrofolclabIo Baso and
Iimil rogislors conlain non-zoro vaIuos and llo bridgo rosponds onIy lo
profolclabIo momory accoss roquosls rocoivod on ils upslroam inlorfaco llal
aro abovo llo 4GB addross boundary and villin llo dofinod profolclabIo
momory addross rango.
10. Assumo llal llo bridgo supporls IrofolclabIo momory anyvloro in 2
64
momory spaco bolind llo bridgo and llal llo configuralion soflvaro maps
llo IrofolclabIo momory on llo bridgos dovnslroam sido inlo a spaco llal
slraddIos llo 4GB boundary. In llis caso, llo oxlonsion lo llo IrofolclabIo
Baso rogislor is sol lo zoro and llo oxlonsion lo llo Iimil rogislor conlains a
non-zoro vaIuo. Wlon a momory roquosl vill an addross boIov llo 4GB
boundary is doloclod on oillor inlorfaco, llo bridgo comparos llo addross
onIy lo llo IrofolclabIo Momory Baso rogislor. If llo addross is llo slarl
addross spocifiod in llo rogislor, llo addross is in rango. Wlon a momory
roquosl vill an addross abovo llo 4GB boundary is doloclod on oillor inlor-
faco, llo bridgo comparos llo Iovor 32-bils of llo addross lo llo Iimil rogis-
lor and llo Uppor 32-bils of llo addross lo llo Iimil Uppor 32-bils rogislor.
If llo addross is llo ond addross spocifiod in llo lvo rogislors, llo addross
is in rango.
11. Tlo bridgo may bo dosignod lo assumo llal aII momory accossos rocoivod
by ils dovnslroam inlorfaco llal aro passod lo llo primary bus aro profolcl-
abIo. Tlis assumos llal llo doslinalion of aII momory roads lravoIing
upslroam is syslom momory (vlicl is profolclabIo). If a bridgo maIos llis
assumplion, il musl impIomonl a dovico-spocific bil in ils configuralion
spaco llal aIIovs llis abiIily lo bo disabIod.
12. Momory vrilos rocoivod by oillor of llo bridgos inlorfacos aro accoplod
inlo llo bridgos dovnslroam or upslroam poslod momory vrilo buffor. As
doscribod in Bylo Morging on pago 801, llo bridgo is pormillod lo por-
form bylo morging in llo buffor for vrilos lo profolclabIo momory, bul nol
lo momory-mappod IO.
Bridges Memory-Mapped IO FiIter
-- . Tlo bridgo dosignor is roquirod lo impIo-
monl llo Momory Baso and Iimil rogislors usod lo dofino a momory-mappod
IO rango. Tloso lvo rogislors aro usod lo dofino a rango of momory occupiod by
momory-mappod IO dovicos llal rosido on llo dovnslroam sido of llo bridgo.
Iiguro 22-19 on pago 831 and Iiguro 22-20 on pago 831 iIIuslralo llo Momory
Baso and Iimil rogislors. Tlo Iovor digil of oacl rogislor is lardvirod lo zoro
and llo uppor llroo digils aro usod lo dofino llo uppor llroo lox digils of llo
oigll-digil slarl and ond addrossos, rospoclivoIy. UnIiIo llo IrofolclabIo Baso
Chapter 22: PCI Compatible Configuration Registers
831
and Iimil and IO Baso and Iimil rogislor pairs, lloro aro no Ixlonsion rogislors
associalod vill llo Momory Baso and Iimil rogislor pair. Tlis moans llal aII
momory-mappod IO dovicos in llo syslom musl rosido in llo Iovor 4GB of
momory addross spaco.
As an oxampIo, assumo llal llo configuralion soflvaro las vrillon llo foIIov-
ing vaIuos lo llo Momory Baso and Iimil rogislors:
- Tlo uppor llroo digils of llo Momory Baso rogislor conlain 555l.
- Tlo uppor llroo digils of llo Momory Iimil rogislor conlain 678l.
Tlis dofinos a 292MB momory-mappod IO rogion on llo dovnslroam sido of
llo bridgo slarling al 55500000l and onding al 678IIIIIl.
- -
-
PCI Express System Architecture
832
Bridge Command Registers
- .
Introduction
Tlo bridgo dosignor musl impIomonl lvo roquirod command rogislors in llo
bridgos configuralion Hoador rogion:
- Tlo Command rogislor is llo slandard configuralion Command rogislor
dofinod by llo spoc for any funclion. Il is associalod vill llo bridgos pri-
mary bus inlorfaco.
- Tlo Bridgo ConlroI rogislor is an oxlonsion lo llo slandard Command rogis-
lor and is associalod vill llo oporalion of boll of llo bridgos bus inlor-
facos.
Tloso lvo rogislors aro doscribod in llo noxl lvo soclions.
Bridge Command Register
- . Tlo Command rogislor formal, piclurod in Iiguro
22-21 on pago 832, is llo samo as llal for a non-bridgo funclion. Somo of llo
bils, lovovor, lavo difforonl offocls. Iacl of llo bils is doscribod in TabIo 22-6
on pago 833.
-
Chapter 22: PCI Compatible Configuration Registers
833
- --
- -
--
-- - -
-
- -
- --
-- - -
-
- -
--
-
- - --
- --
- - --
- --
-
-- - -

-- - -
- -
- - - --
-- - -
- - -
-
-
- -
- -
-- -

- - -
- - -
- - - -- --
-
- - -
- -
-- -
-
- -
PCI Express System Architecture
834
3 RO -. Doos nol appIy lo ICI Ixpross and musl bo lard-
virod lo 0.
4 RO . Doos nol appIy lo ICI
Ixpross and musl bo lardvirod lo 0.
5 RO . Doos nol appIy lo ICI Ixpross and musl bo
lardvirod lo 0.
6 RW --.
Wlon forvarding a Ioisonod TII from Irimary lo Socondary:
- Tlo primary sido musl sol llo Doloclod Iarily Irror bil in llo
bridgo Slalus rogislor.
- If llo Iarily Irror Rosponso bil in llo Bridgo ConlroI rogislor is
sol, llo socondary sido musl sol llo Maslor Dala Iarily Irror
bil in llo Socondary Slalus rogislor.
Wlon forvarding a Ioisonod TII from Socondary lo Irimary:
- Tlo socondary sido musl sol llo Doloclod Iarily Irror bil in llo
Socondary Slalus rogislor.
- If llo Iarily Irror Rosponso bil in llo Bridgo ConlroI rogislor is
sol, llo primary sido musl sol llo Maslor Dala Iarily Irror bil
in llo bridgo Slalus rogislor.
If llo Iarily Irror Rosponso bil is cIoarod, llo Maslor Dala Iarily
Irror slalus bil in llo bridgo Slalus rogislor is novor sol.
Tlo dofauIl vaIuo of llis bil is 0.
7 RO . Doos nol appIy lo ICI Ixpross. Musl bo lard-
virod lo 0.
8 RW . Wlon sol, llis bil onabIos llo non-falaI and falaI
orrors doloclod by llo bridgos primary inlorfaco lo bo roporlod lo
llo Rool CompIox. Tlo funclion roporls sucl orrors lo llo Rool
CompIox if il is onabIod lo do so oillor llrougl llis bil or llrougl
llo ICI Ixpross spocific bils in llo Dovico ConlroI rogislor (soo
Dovico ConlroI Rogislor on pago 905). Tlo dofauIl vaIuo of llis
bil is 0.
9 RO - Doos nol appIy lo ICI Ixpross and
musl bo lardvirod lo 0.
- --
- -
Chapter 22: PCI Compatible Configuration Registers
835
Bridge ControI Register
- - - -
- - - --
- - -
- - - - - -- -
- -
- -
---
- ---
- --- -
-
- --
--- - - - - -
- -- -- -- --
-
---
- - -
- - -
- -
-
- --
- -
PCI Express System Architecture
836
- --
- -
--
-
- - -
- -
-- - -
- - - - - -
- -
-
- - - -
- -
-- - -
- - - - -
- -
-- - -
-- - - - -
- -
- -
- -
- - -
-
- -


-
- - -- -

- - - - -
-- -
-- - -
--
- -
- - -- -

Chapter 22: PCI Compatible Configuration Registers
837
Bridge Status Registers
Introduction
Tlo bridgo conlains lvo roquirod slalus rogislors, oacl of vlicl is associalod
vill ono of llo lvo inlorfacos.
Bridge Status Register (Primary Bus)
- . Rofor lo Iiguro 22-23 on pago 838 and TabIo 22 - 8 on
pago 838. Tlis roquirod rogislor is compIoloIy compalibIo vill llo Slalus rogis-
lor dofinilion for a non-bridgo funclion (soo Slalus Rogislor on pago 788) and
onIy rofIocls llo slalus of llo bridgos primary inlorfaco.
If llo CapabiIilios Iisl bil (bil 4) is sol lo ono, llis indicalos llal llo bridgo
impIomonls llo CapabiIily Ioinlor rogislor in bylo 0 of dvord 13 in ils configu-
ralion Hoador (soo Iiguro 22-13 on pago 803). Ior a gonoraI doscriplion of llo
Nov CapabiIilios, rofor lo CapabiIilios Ioinlor Rogislor on pago 779. In subso-
quonlIy lravorsing llo Nov CapabiIilios Iisl, soflvaro may discovor llal llo
bridgo impIomonls llo SIol Numboring rogislors. Ior a doscriplion of llis foa-
luro, rofor lo Inlroduclion To Classis/SIol Numboring Rogislors on pago 859
and Classis and SIol Numbor Assignmonl on pago 861.
8 RO - . Nol usod in Ixpross and musl bo lard-
virod lo zoro.
9 RO - . Nol usod in Ixpross and musl bo
lardvirod lo zoro.
10 RO - -. Nol usod in Ixpross and musl bo lard-
virod lo zoro.
11 RO - . Nol usod in Ixpross and musl bo
lardvirod lo zoro.
- --
- -
PCI Express System Architecture
838
- -
- -
- -
3 RO -. Indicalos llal llo bridgo ilsoIf lad provi-
ousIy lransmillod an inlorrupl roquosl lo ils drivor (llal is,
llo funclion lransmillod an inlorrupl mossago oarIior in limo
and is availing sorvicing).
Nolo llal INTx omuIalion inlorrupls forvardod by Rool and
Svilcl Iorls from dovicos dovnslroam of llo Rool or Svilcl
Iorl aro nol rofIoclod in llis bil. Tlo dofauIl slalo of llis bil is
0.
4 RO - -. Indicalos llo prosonco of ono or moro
oxlondod capabiIily rogislor sols in llo Iovor 48 dvords of llo
funclions ICI-compalibIo configuralion spaco. Sinco, al a
minimum, aII ICI Ixpross funclions aro roquirod lo impIo-
monl llo ICI Ixpross capabiIily slrucluro, llis bil musl bo sol
lo 1.
5 RO . Doos nol appIy lo ICI Ixpross and musl bo
0.
Chapter 22: PCI Compatible Configuration Registers
839
7 RO - . Doos nol appIy lo ICI Ixpross
and musl bo 0.
8 RW1C - .
Wlon forvarding a Ioisonod TII from Irimary lo Socond-
ary:
- Tlo primary sido musl sol llo Doloclod Iarily Irror bil in
llo bridgo Slalus rogislor.
- If llo Iarily Irror Rosponso bil in llo Bridgo ConlroI rogis-
lor is sol, llo socondary sido musl sol llo Maslor Dala Iar-
ily Irror bil in llo Socondary Slalus rogislor.
Wlon forvarding a Ioisonod TII from Socondary lo Iri-
mary:
- Tlo socondary sido musl sol llo Doloclod Iarily Irror bil in
llo Socondary Slalus rogislor.
- If llo Iarily Irror Rosponso bil in llo Bridgo ConlroI rogis-
lor is sol, llo primary sido musl sol llo Maslor Dala Iarily
Irror bil in llo bridgo Slalus rogislor.
If llo Iarily Irror Rosponso bil in llo Bridgo Command rogis-
lor is cIoarod, llo Maslor Dala Iarily Irror slalus bil in llo
Socondary Slalus rogislor is novor sol.
Tlo dofauIl vaIuo of llis bil is 0.
10:9 RO . Doos nol appIy lo ICI Ixpross and musl bo
0.
11 RW1C . Tlis bil is sol vlon llo bridgos pri-
mary inlorfaco compIolos a rocoivod roquosl by issuing a
CompIolor Aborl CompIolion Slalus.
DofauIl vaIuo of llis fioId is 0.
12 RW1C . Tlis bil is sol vlon llo bridgos pri-
mary inlorfaco rocoivos a CompIolion vill CompIolor Aborl
CompIolion Slalus.
DofauIl vaIuo of llis fioId is 0.
13 RW1C - . Tlis bil is sol vlon llo bridgos pri-
mary inlorfaco rocoivos a CompIolion vill Unsupporlod
Roquosl CompIolion Slalus.
DofauIl vaIuo of llis fioId is 0.
- -
- -
PCI Express System Architecture
840
Bridge Secondary Status Register
- . Rofor lo Iiguro 22-24 on pago 841. Will llo oxcop-
lion of llo Rocoivod Syslom Irror bil, llis roquirod rogislor is compIoloIy com-
palibIo vill llo Slalus rogislor dofinilion for a non-bridgo funclion (soo Slalus
Rogislor on pago 788) and onIy rofIocls llo slalus of llo socondary sido. Il
slouId bo nolod llal llo CapabiIilios Iisl bil (bil 4) is novor impIomonlod in llis
rogislor.
WliIo bil 14 is llo SignaIod Syslom Irror bil in llo primary sido Slalus rogislor,
il is llo Rocoivod Syslom Irror bil in llo Socondary Slalus rogislor. Wlon sol,
llis bil indicalos llal SIRR# vas doloclod assorlod on llo socondary sido. Wril-
ing a ono lo il cIoars llo bil, vliIo a zoro doosnl affocl il. Rosol cIoars llis bil.
14 RW1C - . Tlis bil is sol vlon llo bridgos pri-
mary inlorfaco sonds an IRR_IATAI (falaI orror) or
IRR_NONIATAI (non-falaI orror) mossago (if llo SIRR
InabIo bil in llo bridgo Command rogislor is sol lo ono).
Tlo dofauIl vaIuo of llis bil is 0.
15 RW1C . Tlis bil is sol by llo bridgos primary
inlorfaco vlonovor il rocoivos a Ioisonod TII, rogardIoss of
llo slalo llo Iarily Irror InabIo bil in llo bridgo Command
rogislor. DofauIl vaIuo of llis bil is 0.
- -
- -
Chapter 22: PCI Compatible Configuration Registers
841
- -
- -
- -
5 RO . Doos nol appIy lo Ixpross and musl bo 0.
7 RO - . Doos nol appIy lo ICI Ixpross
and musl bo 0.
PCI Express System Architecture
842
8 RW1C - .
Wlon forvarding a Ioisonod TII from Irimary lo Socond-
ary:
- Tlo primary sido musl sol llo Doloclod Iarily Irror bil in
llo bridgo Slalus rogislor.
- If llo Iarily Irror Rosponso bil in llo Bridgo ConlroI rogis-
lor is sol, llo socondary sido musl sol llo Maslor Dala Iar-
ily Irror bil in llo Socondary Slalus rogislor.
Wlon forvarding a Ioisonod TII from Socondary lo Iri-
mary:
- Tlo socondary sido musl sol llo Doloclod Iarily Irror bil in
llo Socondary Slalus rogislor.
- If llo Iarily Irror Rosponso bil in llo Bridgo ConlroI rogis-
lor is sol, llo primary sido musl sol llo Maslor Dala Iarily
Irror bil in llo bridgo Slalus rogislor.
If llo Iarily Irror Rosponso bil in llo Bridgo ConlroI rogislor
is cIoarod, llo Maslor Dala Iarily Irror slalus bil in llo Soc-
ondary Slalus rogislor is novor sol. Tlo dofauIl vaIuo of llis
bil is 0.
10:9 RO . Doos nol appIy lo Ixpross and musl bo 0.
11 RW1C . Tlis bil is sol vlon llo bridgos soc-
ondary inlorfaco compIolos a rocoivod roquosl by issuing a
CompIolor Aborl CompIolion Slalus. DofauIl vaIuo of llis
fioId is 0.
12 RW1C . Tlis bil is sol vlon llo bridgos soc-
ondary inlorfaco rocoivos a CompIolion vill CompIolor
Aborl CompIolion Slalus. DofauIl vaIuo of llis fioId is 0.
13 RW1C - . Tlis bil is sol vlon llo bridgos soc-
ondary inlorfaco rocoivos a CompIolion vill Unsupporlod
Roquosl CompIolion Slalus. DofauIl vaIuo of llis fioId is 0.
14 RW1C - . Tlis bil is sol vlon llo bridgos soc-
ondary inlorfaco sonds an IRR_IATAI (falaI orror) or
IRR_NONIATAI (non-falaI orror) mossago (if llo SIRR
InabIo bil in llo Bridgo ConlroI rogislor is sol lo ono. Tlo
dofauIl vaIuo of llis bil is 0.
- -
- -
Chapter 22: PCI Compatible Configuration Registers
843
Bridge Cache Line Size Register
-
Tlis fioId is impIomonlod by ICI Ixpross dovicos as a road-vrilo fioId for Iogacy
compalibiIily purposos bul las no impacl on any ICI Ixpross dovico funclion-
aIily.
Bridge Latency Timer Registers
- .
Bridge Latency Timer Register (Primary Bus)
- . Tlis rogislor doos nol appIy lo ICI Ixpross and
musl bo road-onIy and lardvirod lo 0.
Bridge Secondary Latency Timer Register
- . Tlis rogislor doos nol appIy lo ICI Ixpross and
musl bo road-onIy and lardvirod lo 0.
15 RW1C . Tlis bil is sol by llo bridgos socond-
ary inlorfaco vlonovor il rocoivos a Ioisonod TII, rogardIoss
of llo slalo llo Iarily Irror InabIo bil in llo Bridgo ConlroI
rogislor. DofauIl vaIuo of llis bil is 0.
- -
- -
PCI Express System Architecture
844
Bridge Interrupt-ReIated Registers
- . - - -.
Interrupt Line Register
A bridgo may gonoralo inlorrupls in llo Iogacy ICI/ICI-X mannor duo lo an
inlornaI, bridgo-spocific ovonl. Tlo inlorrupl landIor is villin llo bridgos
dovico drivor. Wlon llo bridgo dolocls sucl an inlornaI ovonl, il sonds an INTx
Assorl mossago upslroam lovards llo Rool CompIox (spocificaIIy, lo llo inlor-
rupl conlroIIor villin llo Rool CompIox).
As in ICI, llo Inlorrupl Iino rogislor communicalos inlorrupl Iino rouling infor-
malion. Tlo rogislor is road/vrilo and musl bo impIomonlod if llo bridgo con-
lains a vaIid non-zoro vaIuo in ils Inlorrupl Iin configuralion rogislor (doscribod
in llo noxl soclion). Tlo OS or dovico drivor can oxamino llo bridgos Inlorrupl
Iino rogislor lo dolormino vlicl syslom inlorrupl roquosl Iino llo bridgo usos
lo issuo roquosls for sorvico (and, lloroforo, vlicl onlry in llo inlorrupl labIo lo
looI).
In a non-IC onvironmonl, llo vaIuo vrillon lo llis rogislor is arclilocluro-spo-
cific and lloroforo oulsido llo scopo of llo spocificalion.
Interrupt Pin Register
Tlis road-onIy rogislor idonlifios llo Iogacy INTx inlorrupl Mossago (INTA,
INTB, INTC, or INTD) llo bridgo lransmils upslroam lo gonoralo an inlorrupl.
Tlo vaIuos 01l-llrougl-04l corrospond lo Iogacy INTx inlorrupl Mossagos
INTA-llrougl-INTD. A rolurn vaIuo of zoro indicalos llal llo bridgo doosn'l
gonoralo inlorrupls using llo Iogacy mollod. AII ollor vaIuos (05l-IIl) aro
rosorvod. Nolo llal, aIllougl llo bridgo may nol gonoralo inlorrupls via llo
Iogacy mollod, il may gonoralo llom via llo MSI mollod (soo Dolormining if a
Iunclion Usos INTx# Iins on pago 343 for moro informalion).
Chapter 22: PCI Compatible Configuration Registers
845
PCI-CompatibIe CapabiIities
AGP CapabiIity
Tlo 2.2 spoc assigns llo CapabiIily ID of 02l lo AGI. Tlo romaindor of llis soc-
lion is onIy incIudod as an oxampIo of a Nov CapabiIily.
Rofor lo Iiguro 22-25 on pago 845.
- Tlo AGIs CapabiIily ID is 02l.
- Tlo socond bylo is llo rogislor llal poinls lo llo rogislor sol associalod vill
llo noxl Nov CapabiIily (if lloro is ono).
- IoIIoving llo poinlor rogislor aro lvo, 4-bil road-onIy fioIds dosignaling llo
major and minor rov of llo AGI spoc llal llo AGI dovico is buiIl lo (al llo
limo of llis vriling, llo major rov is 2l and llo minor is 0l).
- Tlo Iasl bylo of llo firsl dvord is rosorvod and musl rolurn zoro vlon road.
- Tlo noxl lvo dvords conlain llo AGI dovicos AGI Slalus and AGI Com-
mand rogislors.
Tlo soclions llal foIIov dofino lloso rogislors and llo bils villin llom.
Ior a dolaiIod doscriplion of AGI, rofor lo llo MindSlaro booI onlilIod
- (pubIislod by Addison-WosIoy).
AGP Status Register
Tlo AGI Slalus rogislor is dofinod in TabIo 22-10 on pago 846. Tlis is a road-
onIy rogislor. Wrilos lavo no offocl. Rosorvod or unimpIomonlod fioIds or bils
aIvays rolurn zoros vlon road.
-
PCI Express System Architecture
846
AGP Command Register
Tlo AGI Command rogislor is dofinod in TabIo 22-11 on pago 847. Tlis is a
road/vrilabIo rogislor, vill rosorvod fioIds lard-virod lo zoros. AII bils in llo
AGI Command rogislor aro cIoarod lo zoro aflor rosol. Tlis rogislor is pro-
grammod during configuralion. Will ono oxcoplion, llo bolavior of a dovico if
llis rogislor is modifiod during runlimo is nol spocifiod. If llo AGI_InabIo bil
is cIoarod, llo AGI maslor is nol aIIovod lo inilialo a nov roquosl.
- - -
- -
31:24 RQ Tlo RQ fioId conlains llo maximum dopll of llo AGI roquosl
quouo. Tloroforo, llis numbor is llo maximum numbor of
lransaclion roquosls llis dovico can manago. A 0 is inlor-
prolod as a dopll of ono, vliIo IIl is inlorprolod as a dopll of
256.
23:10 Rosorvod Wrilos lavo no offocl. Roads rolurn zoros.
9 SBA If sol, llis dovico supporls Sidoband Addrossing.
8:6 Rosorvod Wrilos lavo no offocl. Roads rolurn zoros.
5 4G If sol, llis dovico supporls addrossos groalor llan 4GB.
4 IW If sol, llis dovico supporls Iasl Wrilo lransaclions.
3 Rosorvod Wrilos lavo no offocl. Roads rolurn a zoro
2:0 RATI Tlo RATI fioId is a bil map llal indicalos llo dala lransfor
ralos supporlod by llis dovico. AGI dovicos musl roporl aII
llal appIy. Tlo RATI fioId appIios lo AD, C/BI#, and SBA
busos.
-
0 1X
1 2X
2 4X
Chapter 22: PCI Compatible Configuration Registers
847
- -
- -
31:24 RQ_Dopll -: Tlo RQ_DIITH fioId musl bo programmod vill
llo maximum numbor of lransaclion roquosls llo maslor is
aIIovod lo onquouo inlo llo largol. Tlo vaIuo pro-
grammod inlo llis fioId musl bo oquaI lo or Ioss llan llo
vaIuo roporlod by llo largol in llo RQ fioId of ils AGI Sla-
lus Rogislor. A 0 vaIuo indicalos a roquosl quouo dopll
of ono onlry, vliIo a vaIuo of IIl indicalos a roquosl quouo
dopll of 256.
: Tlo RQ_DIITH fioId is rosorvod.
23:10 Rosorvod Wrilos lavo no offocl. Roads rolurn zoros.
9 SBA_InabIo Wlon sol, llo Sidoband Addross moclanism is onabIod in
llis dovico.
8 AGI_InabIo -: Solling llo AGI_InabIo bil aIIovs llo maslor lo
inilialo AGI oporalions. Wlon cIoarod, llo maslor cannol
inilialo AGI oporalions. AIso vlon cIoarod, llo maslor is
aIIovod lo slop driving llo SBA porl. If bils 1 or 2 aro sol,
llo maslor musl porform a ro-syncl cycIo boforo inilialing
a nov roquosl.
: Solling llo AGI_InabIo bil aIIovs llo largol lo
accopl AGI oporalions. Wlon cIoarod, llo largol ignoros
incoming AGI oporalions. Tlo largol musl bo compIoloIy
configurod and onabIod boforo llo maslor is onabIod.
Tlo AGI_InabIo bil is llo Iasl lo bo sol. Rosol cIoars llis
bil.
7:6 Rosorvod Wrilos lavo no offocl. Roads rolurn zoros.
PCI Express System Architecture
848
VitaI Product Data (VPD) CapabiIity
Introduction
Tlo 2.1 spoc dofinod llo oplionaI VilaI Iroducl Dala as rosiding in a ICI func-
lions oxpansion ROM.
Tlo 2.2 spoc las doIolod llis informalion from llo ROM and insload pIacos llo
VID (if prosonl) in a funclions ICI configuralion rogislor spaco (soo CapabiIi-
lios Ioinlor Rogislor on pago 779). Tlis soclion doscribos llo 2.2 impIomonla-
lion of llo VID and providos an oxampIo from llo 2.2 spoc.
5 4G -: Solling llo 4G bil aIIovs llo maslor lo inilialo
AGI roquosls lo addrossos al or abovo llo 4GB addross
boundary. Wlon cIoarod, llo maslor is onIy aIIovod lo
accoss addrossos in llo Iovor 4 GB of addrossabIo spaco.
: Solling llo 4G bil onabIos llo largol lo accopl AGI
DAC (DuaI-Addross Commands) commands, vlon bil 9 is
cIoarod. Wlon bils 5 and 9 aro sol, llo largol can accopl a
Typo 4 SBA command and uliIizo A|35:32] of llo Typo 3
SBA command.
4 IW_InabIo Wlon llis bil is sol, momory vrilo lransaclions inilialod by
llo coro Iogic viII foIIov llo fasl vrilo prolocoI. Wlon llis
bil is cIoarod, momory vrilo lransaclions inilialod by llo
coro Iogic viII foIIov llo ICI prolocoI.
3 Rosorvod Wrilos lavo no offocl. Roads rolurn zoros.
2:0 Dala_Ralo No moro llan ono bil in llo Dala_Ralo fioId musl bo sol lo
indicalo llo maximum dala lransfor ralo supporlod. Tlo
samo bil musl bo sol in boll llo maslor and llo largol.
-
0 1X
1 2X
2 4X
- -
- -
Chapter 22: PCI Compatible Configuration Registers
849
Its Not ReaIIy VitaI
Ils aIvays brougll a smiIo lo my faco llal dospilo ils namo, llo VID las novor
boon vilaI. Ils aIvays boon namod VilaI in llo spoc, bul ils vas
. Tlon in llo 2.1 spoc, aIllougl , il vas dofinod as rosiding in a
funclions ROM, bul ils incIusion vas . Tlo 2.2 spoc las nov movod il
from llo ROM lo llo configuralion spaco, bul ils sliII .
What Is VPD?
Tlo configuralion rogislors prosonl in a ICI funclions configuralion Hoador
rogion (llo firsl 16 dvords of ils configuralion spaco) provido llo configuralion
soflvaro vill quilo a bil of informalion aboul llo funclion. Hovovor, addilionaI
usofuI informalion sucl as
- a boards parl numbor
- llo IC (Inginooring Clango) IovoI of a funclion
- llo dovicos soriaI numbor
- an assol lag idonlifior
couId bo quilo usofuI in a ropair, locl supporl or assol managomonl onviron-
monls. If prosonl, llo VID Iisl providos llis lypo of informalion.
Where Is the VPD ReaIIy Stored?
Il is inlondod llal llo VID vouId rosido in a dovico sucl as a soriaI IIIROM
associalod vill llo ICI funclion. Tlo configuralion accoss moclanism
doscribod in llo noxl soclion dofinos lov llis informalion vouId bo accossod
via llo ICI funclions VID foaluro rogislors.
VPD On Cards vs. Embedded PCI Devices
Iacl add-in card may oplionaIIy conlain VID. If ils a muIlifunclion card, onIy
ono funclion may conlain VID or oacl funclion may impIomonl il. Imboddod
funclions may or may nol conlain VID.
How Is VPD Accessed?
Iiguro 22-26 on pago 851 iIIuslralos llo configuralion rogislors llal indicalo llo
prosonco of VID informalion and pormil llo programmor lo accoss il. Tlo
CapabiIily ID of llo VID rogislors is 03l, vliIo llo rogislors usod lo accoss lo
llo VID dala consisls of llo VID Addross and Dala rogislors in conjunclion
vill llo ono-bil IIag rogislor. Tlo programmor accossos llo VID informalion
using llo procoduros doscribod in llo foIIoving lvo soclions.
PCI Express System Architecture
850
Uso llo foIIoving procoduro lo road VID dala:
1. Using a ICI configuralion vrilo, vrilo llo dvord-aIignod VID addross inlo
llo Addross rogislor and simuIlanoousIy sol llo IIag bil lo zoro.
2. Hardvaro llon roads llo indicalod dvord from VID slorago and pIacos llo
four bylos inlo llo Dala rogislor. Upon compIolion of llo oporalion, llo
lardvaro sols llo IIag bil lo ono.
3. Wlon soflvaro soos llo IIag bil sol lo ono by llo lardvaro, il can llon por-
form a ICI configuralion road lo road llo four VID bylos from llo Dala rog-
islor.
If oillor llo Addross or Dala rogislors aro vrillon lo prior lo lardvaro solling
llo IIag bil lo ono, llo rosuIls of llo road aro unprodiclabIo.
Uso llo foIIoving procoduro lo vrilo VID dala. IIoaso
nolo llal onIy Road/Wrilo VID Dala iloms may bo vrillon lo.
1. Wrilo four bylos of dala inlo llo Dala rogislor.
2. Wrilo llo dvord-aIignod VID addross inlo llo Addross rogislor and simuI-
lanoousIy sol llo IIag bil lo ono.
3. Wlon soflvaro dolocls llal llo IIag bil las boon cIoarod lo zoro by lard-
varo, llo VID vrilo las boon compIolod.
If oillor llo Addross or Dala rogislors aro vrillon lo prior lo lardvaro cIoaring
llo IIag bil lo zoro, llo rosuIls of llo VID vrilo aro unprodiclabIo.
- - Tlo foIIoving ruIos
appIy lo boll VID dala roads and vrilos:
1. Onco a VID road or vrilo las boon inilialod, vriling lo oillor llo Addross
or Dala rogislors prior lo llo poinl al vlicl llo lardvaro clangos llo slalo
of llo IIag bil yioIds unprodiclabIo rosuIls.
2. Iacl VID dala road or vrilo aIvays oncompassos aII four bylos villin llo
VID dvord indicalod in llo Addross rogislor.
3. Tlo Ioasl-significanl bylo in llo Dala rogislor corrosponds lo llo Ioasl-signif-
icanl bylo in llo indicalod VID dvord.
4. Tlo iniliaI vaIuos in llo Addross and Dala rogislors aflor rosol aro indolor-
minalo.
5. Roading or vriling dala oulsido llo scopo of llo ovoraII VID dala slrucluro
is nol aIIovod. Tlo spoc doosnl say vlal llo rosuIl viII bo if you do il, so il
is lardvaro dosign-spocific.
6. Tlo vaIuos conlainod in llo VID aro onIy slorod informalion and lavo no
offocl upon llo dovico.
Chapter 22: PCI Compatible Configuration Registers
851
7. Tlo lvo Ioasl-significanl bils in llo Addross rogislor musl aIvays bo zoro
(i.o., il is iIIogaI lo spocify an addross llal is nol aIignod on a dvord addross
boundary).
VPD Data Structure Made Up of Descriptors and Keywords
As monlionod oarIior, llo VID acluaIIy consisls of a dala slrucluro accossod
using llo VID Addross and Dala rogislors. Tlo individuaI dala iloms llal com-
priso llo VID dala slrucluro aro llomsoIvos smaII dala slrucluros Inovn as
doscriplors. Tlo basic formal of lvo of llo doscriplors usod in llo VID vas firsl
dofinod in llo vorsion 1.0a spoc. Ior moro informalion aboul
llis spoc, rofor lo llo MindSlaro booI onlilIod -
(pubIislod by Addison-WosIoy). Tlo lvo ISA-IiIo doscriplor lypos aro:
- -. Tlis doscriplor conlains llo aIplanumoric
namo of llo card or omboddod dovico. If llo VID is impIomonlod, llis
doscriplor is mandalory and is aIvays llo firsl ono in llo VID. Il is iIIus-
lralod in TabIo 22-13 on pago 853.
- -. If llo VID is impIomonlod, llis doscriplor is manda-
lory and is usod lo idonlify llo ond of VID dala slrucluro. Ils vaIuo is
aIvays 78l.
In addilion lo lloso lvo doscriplors, llo 2.2 spoc las dofinod lvo nov doscrip-
lor lypos roforrod lo as:
- -. Tlis doscriplor lypo idonlifios llo - ovoraII
a -- ono or moro - villin llo VID dala
slrucluro. Tlo Iasl Ioyvord in llo Iisl of road-onIy Ioyvords musl bo llo
ClocIsum Ioyvord. Tlis clocIsum oncompassos llo VID from ils firsl
Iocalion lo llo ond of llo road-onIy aroa. A dolaiIod doscriplion of llis
doscriplor can bo found in VID Road-OnIy Doscriplor (VID-R) and Koy-
vords on pago 853.
--
PCI Express System Architecture
852
- -. If usod, llis oplionaI doscriplor lypo is usod lo idonlify
llo - ovoraII llo doscriplors villin llo VID
dala slrucluro. A dolaiIod doscriplion of llis doscriplor can bo found in
VID Road/Wrilo Doscriplor (VID-W) and Koyvords on pago 856.
Tlo basic formal of llo ovoraII VID dala slrucluro is iIIuslralod in TabIo 22-12
on pago 852. Il las llo foIIoving claraclorislics:
1. Tlo VID aIvays -- an -, foIIovod by an
oplionaI Iisl of ono or moro road-onIy VID Ioyvords.
2. Tlo - - aIvays bogins vill llo VID-R doscriplor
and onds vill llo ClocIsum Ioyvord.
3. ImmodialoIy foIIoving llo Iisl of road-onIy Ioyvords is an -
-. If prosonl, llo road-vrilo Ioyvord Iisl is profacod
vill llo VID-W doscriplor. Bocauso llo VID road-vrilo Ioyvords can bo
aIlorod, lloro is no clocIsum al llo ond of llo road/vrilo Ioyvords.
4. Tlo ovoraII dala slrucluro is - a spociaI doscrip-
lor Inovn as llo . Ils vaIuo is aIvays 78l.
-
- - -
Slring Idonlifior Doscriplor AIvays llo firsl onlry.
Road-OnIy Doscriplor Hoads llo Iisl of road-onIy Ioyvords.
Road-OnIy Koyvord
Iisl of Road-OnIy Ioyvords.
Road-OnIy Koyvord
Road-OnIy Koyvord
ClocIsum Koyvord
Road/Wrilo Doscriplor Hoads llo Iisl of road-vrilo Ioyvords.
Road/Wrilo Koyvord
Iisl of Road/Wrilo Ioyvords.
Road/Wrilo Koyvord
Ind Tag doscriplor AIvays usod lo indicalo llo ond of llo
VID. Ils vaIuo is aIvays 78l.
Chapter 22: PCI Compatible Configuration Registers
853
VPD Read-OnIy Descriptor (VPD-R) and Keywords
TabIo 22-14 on pago 853 iIIuslralos llo formal of llo VID-R doscriplor. As mon-
lionod oarIior, llis doscriplor bogins llo Iisl of ono or moro road-onIy Ioyvords
and indicalos llo Iongll of llo Iisl. Iacl Ioyvord is a minimum of four bylos in
Iongll and las llo formal iIIuslralod in TabIo 22-15 on pago 854. Tlo road-onIy
Ioyvords curronlIy-dofinod aro Iislod in TabIo 22-16 on pago 854.

-
0 Musl bo 82l.
1 Ioasl-significanl bylo of idonlifior slring Iongll (llo Iongll oncom-
passos bylos 3-llrougl-n).
2 Mosl-significanl bylo of idonlifior slring Iongll (llo Iongll oncom-
passos bylos 3-llrougl-n).
3-llrougl-n ASCII namo of funclion.
-
-
0 Musl bo 90l.
1 Ioasl-significanl bylo of road-onIy Ioyvord Iisl Iongll (llo Iongll
oncompassos bylos 3-llrougl-n).
2 Mosl-significanl bylo of road-onIy Ioyvord Iisl Iongll (llo Iongll
oncompassos bylos 3-llrougl-n).
3-llrougl-n Iisl of Road-OnIy Ioyvords.
PCI Express System Architecture
854

- -
0 and 1 ASCII Koyvord (soo TabIo 22-16 on pago 854 and TabIo 22-20
on pago 856).
2 Iongll of Koyvord fioId (oncompassing bylos 3-llrougl-n).
3-llrougl-n Koyvord dala fioId.
- -

-
IN Dovico Iarl Numbor in ASCII.
IC Inginooring Clango IovoI (aIplanumoric) of dovico in ASCII.
MN Manufacluror ID in ASCII.
SN SoriaI Numbor (aIplanumoric) in ASCII.
Vx Vondor-Spocific fioId (aIplanumoric) in ASCII. "x" can bo any vaIuo
0-llrougl-Z.
CI Ixlondod CapabiIily. If prosonl, llis Ioyvord indicalos llal llo
funclion impIomonls an addilionaI Nov CapabiIily villin ils IO or
momory spaco. Soo TabIo 22-17 on pago 855 for a compIolo doscrip-
lion.
RV ClocIsum. Soo TabIo 22-18 on pago 855 for compIolo doscriplion.
Chapter 22: PCI Compatible Configuration Registers
855
Is Read-OnIy Checksum Keyword Mandatory?
Tlo spoc doosnl say if llo ClocIsum is mandalory, bul il is llo aullors opin-
ion llal il is. In ollor vords, ovon if llo VID conlainod no ollor road-onIy Ioy-
vords, il musl conlain llo VID-R doscriplor foIIovod by llo ClocIsum
Ioyvord. Tlis providos llo programmor vill llo clocIsum for llo porlion of
llo VID llal oncompassos llo Slring Idonlifior doscriplor, llo VID-R doscriplor
and llo ClocIsum Ioyvord ilsoIf. In ollor vords, il providos llo clocIsum for
ovorylling ollor llan llo road-vrilo porlion of llo VID. Il slands lo roason llo
porlion of llo VID llal can bo vrillon lo slouId nol bo incIudod villin llo
clocIsummod aroa.

-
0 Nov CapabiIily ID.
1 Indox of Baso Addross Rogislor (vaIuo bolvoon 0 and 5) llal poinls lo
spaco conlaining llis capabiIily.
2 Ioasl-significanl bylo of offsol villin BARs rango vloro llis Nov
CapabiIilys rogislor sol bogins.
3 Mosl-significanl bylo of offsol villin BARs rango vloro llis Nov
CapabiIilys rogislor sol bogins.
-
-
0 ClocIsum from slarl of VID up lo and incIuding llis bylo. ClocIsum
is corrocl if sum of aII bylos oquaIs zoro.
1 Rosorvod.
2 Rosorvod.
3-llrougl-n Rosorvod road-onIy spaco (as mucl as dosirod).
PCI Express System Architecture
856
VPD Read/Write Descriptor (VPD-W) and Keywords
Tlo VID may oplionaIIy conlain a Iisl of ono or moro road/vrilo Ioyvord
fioIds. If prosonl, llis Iisl bogins vill llo VID-W doscriplor vlicl indicalos llo
slarl and Iongll of llo road/vrilo Ioyvord Iisl. Tloro is no clocIsum slorod al
llo ond of llo road-vrilo Ioyvord Iisl.
TabIo 22-19 on pago 856 iIIuslralos llo formal of llo VID-W doscriplor and
TabIo 22-20 on pago 856 providos a Iisl of llo curronlIy-dofinod road/vrilo Ioy-
vord fioIds.
-
- -
0 Musl bo 91l
1 Ioasl-significanl bylo of road/vrilo Ioyvord Iisl Iongll (llo Iongll
oncompassos bylos 3-llrougl-n).
2 Mosl-significanl bylo of road/vrilo Ioyvord Iisl Iongll (llo Iongll
oncompassos bylos 3-llrougl-n).
3-llrougl-n Iisl of Road/Wrilo Ioyvords.
- -

-
Vx Vondor-Spocific (aIplanumoric in ASCII). "x" may bo any claraclor
from 0-llrougl-Z.
YA Assol Tag Idonlifior. ASCII aIplanumoric codo suppIiod by syslom
ovnor.
Yx Syslom-spocific aIplanumoric ASCII ilom. "x" may bo any claraclor
from 0-llrougl-9 and B-llrougl-Z.
RW Romaining road/vrilo aroa. Idonlifios llo unusod porlion of llo r/v
spaco. Tlo doscriplion in llo spoc is vory confusing and dofios inlor-
prolalion by llo aullor (maybo Im jusl boing llicI-loadod).
Chapter 22: PCI Compatible Configuration Registers
857
ExampIe VPD List
TabIo 22-21 on pago 857 conlains llo sampIo VID dala slrucluro providod in llo
spoc. Tlo aullor las mado a fov minor corroclions, so il doosnl malcl llo ono
in llo spoc oxaclIy. In llo drafl vorsion of llo spoc, llo 3rd rov, Iasl coIumn con-
lainod "ABC Supor..." olc. and llo offsol in VID-R Tag rov vas vrong. I fixod il
by adjusling llo offsols in llo 1sl coIumn. Il vas fixod in llo finaI vorsion of llo
2.2 spoc by clanging llo Iroducl Namo lo "ABCD Supor...".
-
-

0 Slring ID Tag 82l
1-2 Slring Iongll (32d) 0020l (32d)
3-34 Iroducl namo in ASCII "ABC Supor-Iasl Wid-
gol ConlroIIor"
Slarl of VID Road-OnIy Koyvord Aroa
35 VID-R Tag. Idonlifios slarl and Iongll of road-
onIy Ioyvord aroa villin VID.
90l
36-37 Iongll of road-onIy Ioyvord aroa. 5Al (90d)
38-39 Road-onIy Iarl Numbor Ioyvord. "IN"
40 Iongll of Iarl Numbor dala fioId. 08l (8d)
41-48 Iarl Numbor in ASCII. "6181682A"
49-50 Road-OnIy Inginooring Clango (IC) IovoI Ioy-
vord.
"IC"
51 Iongll of IC dala fioId. 0Al (10d)
52-61 IC dala fioId. "4950262536"
62-63 Road-onIy SoriaI Numbor Ioyvord. "SN"
64 SoriaI Numbor Iongll fioId. 08l (8d)
65-72 SoriaI Numbor dala fioId. "00000194"
PCI Express System Architecture
858
73-74 Road-onIy Manufacluror ID Ioyvord. "MN"
75 Manufacluror ID Iongll fioId. 04l (4d)
76-79 Manufacluror ID "1037"
80-81 Road-onIy ClocIsum Ioyvord. "RV"
82 Iongll of rosorvod road-onIy VID aroa. 2Cl (44d)
83 ClocIsum for bylos 0-llrougl-83. ClocIsum.
84-127 Rosorvod road-onIy aroa.
Slarl of VID Road/Wrilo Koyvord Aroa
128 VID-W Tag 91l
129-130 Iongll of road/vrilo Ioyvord aroa. 007Il (126d)
131-132 Road/Wrilo Vondor-Spocific Koyvord. "V1"
133 Vondor-spocific dala fioId Iongll. 05l (5d)
134-138 Vondor-spocific dala fioId. "65A01"
139-140 Syslom-spocific Ioyvord. "Y1"
141 Syslom-spocific dala fioId Iongll. 0Dl (13d)
142-154 Syslom-spocific dala fioId. "Irror Codo 26"
155-156 Romaining Road/Wrilo aroa Ioyvord. "RW"
157 Iongll of romaining road/vrilo aroa. 61l (97d)
158-254 Romaindor of road/vrilo aroa. rosorvod.
255 Ind Tag 78l
-
-

Chapter 22: PCI Compatible Configuration Registers
859
Introduction To Chassis/SIot Numbering Registers
Assuming llal llo CapabiIilios Iisl bil is sol in llo bridgos primary Slalus rog-
islor, llo bridgo impIomonls llo CapabiIilios Ioinlor rogislor (soo CapabiIilios
Ioinlor Rogislor on pago 779). Wlon soflvaro lravorsos llo IinIod Iisl of Nov
CapabiIily rogislor sols for a bridgo associalod vill a Rool Iorl or a svilcl
dovnslroam porl, il may oncounlor llo SIol Numboring rogislors (if llis is llo
bridgo lo an oxpansion classis).
Iiguro 22-27 on pago 859 picluros llo SIol Numboring rogislor sol. Il consisls of
llo rogislors doscribod in TabIo 22-22 on pago 859. Ior addilionaI informalion,
rofor lo Classis and SIol Numbor Assignmonl on pago 861.
--- --
-
- -
CapabiIily ID . idonlifios llis as llo SIol Numboring rogislor
sol.
Noxl CapabiIily
Ioinlor

= Indicalos llal llis is llo Iasl rogislor sol in llo IinIod

Nov CapabiIilios Iisl.
= dvord-aIignod poinlor lo llo noxl rogislor
sol in llo IinIod Iisl.
PCI Express System Architecture
860
Ixpansion SIol , -.
Tlo configuralion soflvaro usos llo vaIuo in llis rogislor lo
dolormino llo numbor of oxpansion card sIols prosonl in llo
classis. Tlo spoc doosnl dofino vloro llo lardvaro oblains
llis informalion. Il couId road a sol of slrapping pins on llo
lraiIing-odgo of rosol, or couId oblain llo informalion from a
soriaI IIIROM.
Classis Numbor . Tlo vaIuo in llis rogislor idonlifios llo classis
numbor assignod lo llis classis. Al rosol limo, llis rogislor
may:
- bo pro-Ioadod vill 00l, or
- bo impIomonlod as a non-voIaliIo rogislor llal "romombors"
llo classis numbor assignod during a provious pIalform
configuralion.
Tlo configuralion soflvaro viII iniliaIizo aII upslroam
bridgos villin llo samo classis vill llo samo Classis Num-
bor and musl guaranloo llal oacl classis is assignod a mulu-
aIIy-oxcIusivo Classis Numbor. A bridgo may impIomonl llo
Classis/SIol numboring rogislors and yol may nol lavo any
oxpansion card sIols rosiding bonoall il.
Tlo Classis Numbor rogislor may bo cIoarod lo zoro by rosol,
or may bo non-voIaliIo (i.o., llo curronl conlonls of llo rogis-
lor viII survivo rosols and povor cycIos). If il is non-voIaliIo,
ils iniliaI slalo aflor llo firsl povor up viII bo zoro. Wlon llo
configuralion soflvaro dolocls zoro in an oxpansion classis
Classis Numbor rogislor, il musl assign a numbor lo il. Zoro
is nol a vaIid Classis Numbor for an oxpansion classis
bocauso Classis Zoro is rosorvod for llo card sIols omboddod
on llo syslom board.
-
- -
Chapter 22: PCI Compatible Configuration Registers
861
Chassis and SIot Number Assignment
ProbIem: Adding/Removing Bridge Causes Buses to Be
Renumbered
Tlo bosl vay lo slarl llis discussion is lo iIIuslralo llo probIom vill an oxam-
pIo. Assumo llo foIIoving sol of condilions:
1. Tlo syslom las sovoraI Ixpross add-in card sIols on llo bus in llo Rool
CompIox.
2. Tloro aro ono or moro Rool Iorls and ono or moro of lloso Rool Iorls aro
connoclod lo classos, oacl of vlicl las add-in card sIols on llo dovn-
slroam sido of llo classis Svilcl upslroam porl (i.o., llo Svilcl omboddod
in llo classis).
3. Tlo syslom vas slippod as doscribod in iloms ono and lvo and no cards
lavo boon addod or romovod.
4. Diagnoslic soflvaro las doloclod a probIom vill an add-in card in ono of
llo sIols.
-: - -- --
- - - Tlo sofl-
varo Inovs llo foIIoving:
- Tlo bus numbor llal llo dovico rosidos on.
- Wlicl dovico numbor is assignod lo llo dovico.
So, Iols say llal llo soflvaro idonlifios llo bad boy lo llo ond usor by dispIay-
ing ils Iocalion using llo bus and dovico numbors and Iols say llal somoono al
llo faclory vas nico onougl lo plysicaIIy IaboI oacl card sIol using llal infor-
malion (bus and dovico numbor). Tlal vouId vorI jusl finoas Iong as no ono
inslaIIs or romovos a card llal las a bridgo on il. Romombor llal llo configura-
lion soflvaro discovors bridgos oacl limo llal llo maclino is roslarlod and
assigns a bus numbor lo oacl bridgos socondary bus. In ollor vords, if a bus is
addod or romovod, llal can clango llo bus numbors assignod lo a numbor of
llo busos. - - - --
-
If Buses Added/Removed, SIot LabeIs Must Remain Correct
As slalod in llis soclions loading, llo addilion or romovaI of a bus musl nol
rondor llo plysicaI sIol IaboIs incorrocl. Tlis roquiromonl liglIiglls llal llo
bus numbor cannol bo usod as parl of llo sIol IaboIing (bocauso il can clango).
PCI Express System Architecture
862
Tlo onIy oxcoplion vouId bo Bus 0 vlicl cannol bo romovod and is aIvays
assignod bus numbor 0.
Definition of a Chassis
As dofinod in llo 1.1 ICI-lo-ICI bridgo spocificalion, lloro aro lvo lypos of
classos:
- ---Rofor lo Iiguro 22-28 on pago 862. Tloso add-in card --
aro connoclod lo Rool Iorls and aro . Tloso card sIols do nol
prosonl a probIom in llal llo plysicaI IaboIing of llo sIols is aIvays corrocl.
- - ---Rofor lo Iiguro 22-33 on pago 869. An Ixpansion
Classis consisls of a group of ono or moro busos oacl vill card sIols and
llo onliro group can bo inslaIIod in or romovod from llo syslom as a singIo
onlily. Tlo sIols villin an oxpansion classis aro numborod soquonliaIIy and
aro idonlifiod by classis numbor and sIol numbor.
---
Chapter 22: PCI Compatible Configuration Registers
863
Chassis/SIot Numbering Registers
--- - Inlroduc-
lion To Classis/SIol Numboring Rogislors on pago 859 inlroducod llo
ICI-compalibIo configuralion rogislors associalod vill classis and sIol
numboring:
- Tlo --- - (soo Iiguro 22-27 on pago 859 and
TabIo 22-22 on pago 859). Tlo configuralion soflvaro assigns a non-zoro
classis numbor lo oacl upslroam bridgo llal impIomonls llo SIol Num-
boring capabiIily rogislor sol and llal las a non-zoro vaIuo in ils Ixpan-
sion SIol rogislor (indicaling llo numbor of sIols impIomonlod villin
llo classis).
- Tlo - - (soo Iiguro 22-29 on pago 864 and TabIo 22-
23 on pago 864). Tlo Ixpansion SIol rogislor is proIoadod vill llo indi-
calod informalion by lardvaro boforo llo configuralion soflvaro is oxo-
culod. As an oxampIo, llo bridgo couId sampIo a sol of slrapping pins
on llo lraiIing-odgo of rosol lo dolormino llo conlonls of llo Ixpansion
SIol rogislor. A bridgo may impIomonl llo Classis/SIol numboring rog-
islors and yol may nol lavo any oxpansion sIols on ils socondary bus. 0
indicalos llal no sIols aro impIomonlod on llo dovnslroam sido of llo
bridgo.
-- -- In addilion lo lloso ICI-com-
palibIo rogislors, llo foIIoving ICI Ixpross-spocific configuralion rogislors
aro aIso invoIvod in llo procoss:
- Tlo -- - - (soo
Iiguro 22-31 on pago 865). Tlis bil is onIy impIomonlod in llo bridgo lo
a Rool Iorl or lo a dovnslroam svilcl porl. If llis bil is lardvirod lo
ono, llis indicalos llal llo dovnslroam porl is connoclod lo an add-in
sIol rallor llan lo an omboddod dovico or lo a disabIod IinI.
- Tlo - --
- (soo Iiguro 22-30 on pago 865). Tlis lardvaro iniliaIizod fioId
indicalos llo plysicaI sIol numbor allaclod lo llis Iorl. Tlo assignod
sIol numbor musl bo gIobaIIy uniquo villin llis classis. Tlis fioId musl
bo sol lo 0 for a porl llal is connoclod lo a dovico llal is oillor inlo-
gralod on llo syslom board or villin llo samo siIicon as llo Svilcl
dovico or llo Rool Iorl.
Tlo Classis and Ixpansion SIol rogislors musl bo impIomonlod in oacl
upslroam bridgo in an oxpansion classis llal las oxpansion sIols on ils soc-
ondary bus.
PCI Express System Architecture
864
- -
- - --
-
7:6 -. Road-onIy and musl aIvays rolurn zoro vlon road.
5 ---- . Tlis bil musl bo sol lo ono in llo firsl upslroam
bridgo villin oacl oxpansion classis. Tlis is dofinod as foIIovs:
- If lloro is onIy ono oxpansion classis and il conlains onIy ono
upslroam bridgo vill sIols on ils socondary sido, llal bridgo is llo
Iirsl-In-Classis.
- If an oxpansion classis conlains a liorarcly of bridgos springing
from ono paronl upslroam bridgo (soo Iiguro 22-33 on pago 869), llo
paronl upslroam bridgo is Iirsl-In-Classis, vliIo llo ollor upslroam
bridgos viII lavo llo Iirsl-In-Classis bil cIoarod lo zoro.
4:0 - - on bridgos socondary bus. If lloro aronl
any oxpansion sIols on llo bridgos socondary bus, llis fioId musl bo
lardvirod lo zoro.
Chapter 22: PCI Compatible Configuration Registers
865
-
-- - -
PCI Express System Architecture
866
Two ExampIes
- Iiguro 22-32 on pago 867 iIIuslralos a syslom vloroin:
- Tlo Rool CompIox las four Rool Iorls llal aro connoclod lo add-in sIol
connoclors, and ono Rool Iorl connoclod lo an omboddod dovico. Will
llo oxcoplion of llo Rool Iorl llal is connoclod lo an omboddod dovico,
in oacl of llo Rool Iorl bridgos:
SIol ImpIomonlod bil = 1 (lardvaro in iniliaIizod).
IlysicaI SIol Numbor = llo rospoclivo sIols lardvaro-assignod sIol
numbor (lardvaro in iniliaIizod).
Tlo Classis rogislor is nol impIomonlod.
Tlo Ixpansion SIol rogislor is nol impIomonlod.
- Tlo Rool Iorl llal is connoclod lo llo omboddod dovico conlains llo
foIIoving informalion:
SIol ImpIomonlod bil = 0 (lardvaro in iniliaIizod).
IlysicaI SIol Numbor = nol impIomonlod.
Classis rogislor nol impIomonlod.
Ixpansion SIol rogislor nol impIomonlod.
- A classis is connoclod lo add-in sIol connoclor numbor ono.
- In llo upslroam bridgo of llo classis:
Tlo Classis rogislor in llo classis upslroam porl is sol lo 01l by
llo configuralion soflvaro.
Tlo Iirsl In Classis bil is sol lo ono (lardvaro in iniliaIizod).
Tlo upslroam bridgos Ixpansion SIol rogislor conlains llo vaIuo 2
(lardvaro in iniliaIizod) indicaling llal llo classis impIomonls 2
add-in sIol connoclors on llo dovnslroam sido of llo bridgo.
- In oacl of llo classis dovnslroam porl bridgos:
SIol ImpIomonlod bil = 1 (lardvaro in iniliaIizod).
IlysicaI SIol Numbor = llo rospoclivo sIols lardvaro-assignod sIol
numbor (lardvaro in iniliaIizod).
Tlo Classis rogislor is nol impIomonlod.
Tlo Ixpansion SIol rogislor is nol impIomonlod.
Chapter 22: PCI Compatible Configuration Registers
867
Iiguro 22-33 on pago 869 iIIuslralos an oxampIo
vloroin:
- Tlo Rool CompIox las four Rool Iorls llal aro connoclod lo add-in sIol
connoclors, and ono Rool Iorl connoclod lo an omboddod dovico. Will
llo oxcoplion of llo Rool Iorl llal is connoclod lo an omboddod dovico,
in oacl of llo Rool Iorl bridgos:
SIol ImpIomonlod bil = 1 (lardvaro in iniliaIizod).
IlysicaI SIol Numbor = llo rospoclivo sIols lardvaro-assignod sIol
numbor (lardvaro in iniliaIizod).
Tlo Classis rogislor is nol impIomonlod.
Tlo Ixpansion SIol rogislor is nol impIomonlod.
- Tlo Rool Iorl llal is connoclod lo llo omboddod dovico conlains llo
foIIoving informalion:
SIol ImpIomonlod bil = 0 (lardvaro in iniliaIizod).
IlysicaI SIol Numbor = nol impIomonlod.
Classis rogislor nol impIomonlod.
---
PCI Express System Architecture
868
Ixpansion SIol rogislor nol impIomonlod.
- A classis is connoclod lo add-in sIol connoclor numbor ono.
- In llo upslroam bridgo of llo classis:
Tlo Classis rogislor in llo classis upslroam porl is sol lo 01l by
llo configuralion soflvaro.
Tlo Iirsl In Classis bil is sol lo ono (lardvaro in iniliaIizod).
Tlo upslroam bridgos Ixpansion SIol rogislor conlains llo vaIuo 7
(lardvaro in iniliaIizod) indicaling llal llo classis impIomonls 7
add-in sIol connoclors on llo dovnslroam sido of llo bridgo.
- In llo bridgo of oacl of llo dovnslroam svilcl porls llal aro connoclod
lo sIols 1-llrougl-5:
SIol ImpIomonlod bil = 1 (lardvaro in iniliaIizod).
IlysicaI SIol Numbor = llo rospoclivo sIols lardvaro-assignod sIol
numbor (lardvaro in iniliaIizod).
Tlo Classis rogislor is nol impIomonlod.
Tlo Ixpansion SIol rogislor is nol impIomonlod.
- In llo bridgo of llo Iofl-mosl dovnslroam porl on llo samo bus as sIols
1-llrougl-5:
SIol ImpIomonlod bil = 0 (lardvaro in iniliaIizod).
IlysicaI SIol Numbor = nol impIomonlod.
Classis rogislor nol impIomonlod.
Ixpansion SIol rogislor nol impIomonlod.
- In llo upslroam bridgo of llo Iovor svilcl villin llo classis:
Tlo Classis rogislor in llo classis upslroam porl is sol lo 01l by
llo configuralion soflvaro.
Tlo Iirsl In Classis bil is cIoarod lo zoro (lardvaro in iniliaIizod).
Tlo upslroam bridgos Ixpansion SIol rogislor conlains llo vaIuo 2
(lardvaro in iniliaIizod) indicaling llal llo classis impIomonls 2
add-in sIol connoclors on llo dovnslroam sido of llis bridgo.
- In llo bridgo of oacl of llo dovnslroam porls bonoall llo upslroam
bridgo:
SIol ImpIomonlod bil = 1 (lardvaro in iniliaIizod).
IlysicaI SIol Numbor = llo rospoclivo sIols lardvaro-assignod sIol
numbor (lardvaro in iniliaIizod).
Tlo Classis rogislor is nol impIomonlod.
Tlo Ixpansion SIol rogislor is nol impIomonlod.
Chapter 22: PCI Compatible Configuration Registers
869
---

- -
The Previous Chapter
Tlo provious claplor providod a dolaiIod doscriplion of llo configuralion rogis-
lors rosiding a funclions ICI-compalibIo configuralion spaco. Tlis incIudod llo
rogislors for boll non-bridgo and bridgo funclions.
This Chapter
Tlis claplor providos a dolaiIod doscriplion of dovico ROMs associalod vill
ICI, ICI Ixpross, and ICI-X funclions. Tlis incIudos llo foIIoving lopics:
- dovico ROM doloclion.
- inlornaI codo/dala formal.
- sladoving.
- iniliaIizalion codo oxoculion.
- inlorrupl looIing.
The Next Chapter
Tlo noxl claplor providos a doscriplion of:
- Tlo ICI Ixpross CapabiIily rogislor sol in a funclions ICI-compalibIo con-
figuralion spaco.
- Tlo oplionaI ICI Ixpross Ixlondod CapabiIilios rogislor sols in a funclions
oxlondod configuralion spaco:
Tlo Advancod Irror Roporling CapabiIily rogislor sol.
VirluaI ClannoI CapabiIily rogislor sol.
Dovico SoriaI Numbor CapabiIily rogislor sol.
Iovor Budgoling CapabiIily rogislor sol.
- RCRBs.
-- -

ROM PurposeDevice Can Be Used In Boot Process

In ordor lo bool llo OS inlo momory, llo syslom noods llroo dovicos:
- A mass slorago dovico lo Ioad llo OS from. Tlis is somolimos roforrod lo as
llo (IniliaI Irogram Ioad) and is lypicaIIy an IDI or a SCSI lard
drivo.
- A dispIay adaplor lo onabIo progross mossagos lo bo dispIayod during llo
bool procoss. In llis conloxl, llis is lypicaIIy roforrod lo as llo
.
- A Ioyboard lo aIIov llo usor lo inloracl vill llo maclino during llo bool
procoss. In llis conloxl, llis is lypicaIIy roforrod lo as llo .
Tlo OS musl Iocalo llroo dovicos llal faII inlo lloso calogorios and - -
-- -. Romombor llal llo
OS lasnl boon boolod inlo momory yol and lloroforo lasnl Ioadod any Ioad-
abIo dovico drivors inlo momory from disI! Tlis is llo main roason llal dovico
ROMs oxisl. Il conlains a dovico drivor llal pormils llo dovico lo bo usod dur-
ing llo bool procoss.
ROM Detection
Wlon llo configuralion soflvaro is configuring a ICI, ICI-X, or ICI-Ixpross
funclion, il dolorminos if a funclion-spocific ROM oxisls by clocIing lo soo if llo
dosignor las impIomonlod an Ixpansion ROM Baso Addross Rogislor (rofor lo
Iiguro 23-1 on pago 873).
As doscribod in Ixpansion ROM Baso Addross Rogislor on pago 783, llo pro-
grammor vrilos aII onos (vill llo oxcoplion of bil zoro, lo provonl llo onabIing
of llo ROM addross docodor, soo Iiguro 23-1 on pago 873) lo llo Ixpansion
ROM Baso Addross Rogislor and llon roads il bacI. If a vaIuo of zoro is
rolurnod, llon llo rogislor is nol impIomonlod and lloro isnl an oxpansion
ROM associalod vill llo dovico.
On llo ollor land, llo abiIily lo sol any bils lo onos indicalos llo prosonco of llo
Ixpansion ROM Baso Addross Rogislor. Tlis may or may nol indicalo llo pros-
onco of a dovico ROM. AIllougl llo addross docodor and a socIol may oxisl for
a dovico ROM, llo socIol may nol bo occupiod al prosonl. Tlo programmor
dolorminos llo prosonco of llo dovico ROM by:
- -

- assigning a baso addross lo llo rogislors Baso Addross fioId,

- onabIing ils docodor (by solling bil 0 in llo rogislor lo ono),
- and llon allompling lo road llo firsl lvo Iocalions from llo ROM.
If llo firsl lvo Iocalions conlain llo ROM signaluroAA55lllon llo ROM is
prosonl.
Iiguro 23-1 on pago 873 iIIuslralos llo formal of llo Ixpansion ROM Baso
Addross Rogislor. Assumo llal llo rogislor rolurns a vaIuo of IIII0000l vlon
road bacI aflor vriling aII onos lo il. Bil 17 is llo Ioasl-significanl bil llal vas
succossfuIIy clangod lo a ono and las a binary-voigllod vaIuo of 128K. Tlis
indicalos llal il is a 128KB ROM docodor and bils |24:17] villin llo Baso
Addross fioId aro vrilabIo. Tlo programmor nov vrilos a 32-bil slarl addross
inlo llo rogislor and sols bil zoro lo ono lo onabIo ils ROM addross docodor. Tlo
funclions ROM addross docodor is llon onabIod and llo ROM (if prosonl) can
bo accossod. Tlo maximum ROM docodor sizo pormillod by llo ICI spoc is
16MB, diclaling llal bils |31:25] musl bo road/vrilo.
Tlo programmor llon porforms a road from llo firsl lvo Iocalions of llo ROM
and clocIs for a rolurn vaIuo of AA55l. If llis pallorn is nol rocoivod, llo ROM
is nol prosonl. Tlo programmor disabIos llo ROM addross docodor (by cIoaring
bil zoro of llo Ixpansion ROM Baso Addross Rogislor lo zoro). If AA55l is
rocoivod, llo ROM oxisls and a dovico drivor codo imago musl bo copiod inlo
main momory and ils iniliaIizalion codo musl bo oxoculod. Tlis lopic is covorod
in llo soclions llal foIIov.
- - -- - --
-- -

-
- -

ROM Shadowing Required

Tlo ICI spoc roquiros llal dovico ROM codo is novor oxoculod in pIaco (i.o.,
from llo ROM). Il musl bo copiod lo main momory. Tlis is roforrod lo as slad-
oving llo ROM codo. Tlis roquiromonl oxisls for lvo roasons:
- ROM accoss limo is lypicaIIy quilo sIov, rosuIling in poor porformanco
vlonovor llo ROM codo is folclod for oxoculion.
- Onco llo iniliaIizalion porlion of llo dovico drivor in llo ROM las boon
oxoculod, il can bo discardod and llo codo imago in main momory can bo
slorlonod lo incIudo onIy llo codo nocossary for run-limo oporalion. Tlo
porlion of main momory aIIocalod lo loId llo iniliaIizalion porlion of llo
codo can bo frood up, aIIoving moro officionl uso of main momory.
Onco llo prosonco of llo dovico ROM las boon oslabIislod (soo llo provious
soclion), llo configuralion soflvaro musl copy a codo imago inlo main momory
and llon disabIo llo ROM addross docodor (by cIoaring bil zoro of llo Ixpan-
sion ROM Baso Addross Rogislor lo zoro). In a non-IC onvironmonl, llo aroa of
momory llo codo imago is copiod lo couId bo anyvloro in momory spaco. Tlo
spocificalion for llal onvironmonl may dofino a parlicuIar aroa.
In a IC onvironmonl, llo ROM codo imago musl bo copiod inlo main momory
inlo llo rango of addrossos lisloricaIIy associalod vill dovico ROMs:
000C0000l llrougl 000DIIIIl. If llo CIass Codo indicalos llal llis is llo
VGAs dovico ROM, ils codo imago musl bo copiod inlo momory slarling al
Iocalion 000C0000l.
Tlo noxl soclion dofinos llo formal of llo informalion in llo ROM and lov llo
configuralion soflvaro dolorminos vlicl codo imago (yos, lloro can bo moro
llan ono dovico drivor) lo Ioad inlo main momory.
ROM Content
MuItipIe Code Images
Tlo ICI spoc pormils llo incIusion of moro llan ono codo imago in a ICI dovico
ROM. Iacl codo imago vouId conlain a copy of llo dovico drivor in a spocific
maclino codo, or in inlorprolivo codo (oxpIainod Ialor). Tlo configuralion sofl-
varo can llon scan llrougl llo imagos in llo ROM and soIocl llo ono bosl
-- -

suilod lo llo syslom procossor lypo. Tlo ROM migll conlain drivors for various
lypos of dovicos mado by llis dovicos vondor. Tlo codo imago copiod inlo main
momory slouId malcl up vill llo funclions ID. To llis ond, oacl codo imago
aIso conlains:
- llo Vondor ID and Dovico ID. Tlis is usofuI for malcling up llo drivor vill
a funclion llal las a vondor/dovico malcl.
- llo CIass Codo. Tlis is usofuI if llo drivor is a CIass drivor llal can vorI
vill any compalibIo dovico villin a CIass/SubCIass. Ior moro informa-
lion, soo CIass Codo Rogislor on pago 774.
Iiguro 23-3 on pago 877 iIIuslralos llo concopl of muIlipIo codo imagos ombod-
dod villin a dovico ROM. Iacl imago musl slarl on an addross ovonIy-divisibIo
by 512. Iacl imago consisls of lvo dala slrucluros, as voII as a run-limo codo
imago and an iniliaIizalion codo imago. Tlo configuralion soflvaro inlorrogalos
llo dala slrucluros in ordor lo dolormino if llis is llo imago il viII copy lo main
momory and uso. If il is, llo configuralion soflvaro:
1. Copios llo imago lo main momory,
2. DisabIos llo oxpansion ROMs addross docodor,
3. Ixoculos llo iniliaIizalion codo,
4. If llo iniliaIizalion codo slorlons llo Iongll indicalor in llo dala slrucluro,
llo configuralion soflvaro doaIIocalos llo aroa of main momory llal loId
llo iniliaIizalion porlion of llo drivor (in Iiguro 23-4 on pago 879, nolico
llal llo iniliaIizalion porlion of llo drivor is aIvays al llo ond of llo
imago).
5. Tlo aroa of main momory conlaining llo imago is llon vrilo-proloclod.
Tlo soclions llal foIIov provido a dolaiIod discussion of llo codo imago formal
and llo iniliaIizalion procoss.
- -

-
-- -

Format of a Code Image

GeneraI
Iiguro 23-4 on pago 879 iIIuslralos llo formal of a singIo codo imago. Tlo imago
consisls of llo foIIoving compononls:
- . Doscribod in ROM Hoador Iormal on pago 879. AIso con-
lains a 16-bil poinlor lo llo ROM dala slrucluro.
- Doscribod in ROM Dala Slrucluro Iormal on
pago 881. Conlains informalion aboul llo dovico and llo imago.
- . Tlis is llo porlion of llo dovico drivor llal romains in main
momory aflor llo OS Ioads and llal romains avaiIabIo for oxoculion on an
on-going basis.
- . Tlis is llo porlion of llo dovico drivor llal is caIIod and
oxoculod immodialoIy aflor Ioading llo drivor inlo main momory. Il com-
pIolos llo solup of llo dovico and onabIos il for normaI oporalion. Il musl
aIvays rosido al llo ond of llo imago so il can bo abbrovialod or discardod
aflor ils iniliaI oxoculion al syslom slarlup.
- -

ROM Header Format

Tlo ROM Hoador musl bo Iocalod al llo vory slarl of oacl imago villin llo
ROM (so a bollor namo for il migll bo llo Codo Imago Hoador). TabIo 23-1 on
pago 880 dofinos llo formal of llo Hoador and llo purposo of oacl fioId is fur-
llor dofinod in llo paragrapls llal foIIov. Tlo offsol spocifiod in llo labIo is llo
offsol from llo firsl Iocalion in llis ROM codo imago.

-- -

-
-

- -
00l 1d 55l ROM signaluro bylo ono. Tlo firsl lvo bylos
musl conlain AA55l, idonlifying llis as a
dovico ROM. Tlis las aIvays boon llo signa-
luro usod for a dovico ROM in any IC-compal-
ibIo maclino.
01l 1d AAl ROM signaluro bylo lvo.
02l - 17l 22d n
Rosorvod for procossor arclilocluro uniquo
dala. Soo TabIo 23-2 on pago 881. Tlis bIocI of
22d Iocalions is rosorvod for procossor/arcli-
locluro uniquo dala. Ior IC-compalibIo onvi-
ronmonls and imagos llal idonlify llo codo as
InloI x86-compalibIo in llo Codo Typo fioId (soo
Codo Typo on pago 885) of llo ROM dala
slrucluro, llo ICI spoc dofinos llo slrucluro of
llo procossor/arclilocluro uniquo dala aroa in
llo imago Hoador. Ior non-IC compalibIo
onvironmonls, llo conlonl of llis slrucluro is
arclilocluro-spocific. TabIo 23-2 on pago 881
dofinos llo fioIds llal musl bo suppIiod for IC-
compalibiIily. Tlo offsol spocifiod in llo labIo is
llo offsol from llo firsl Iocalion of llis ROM
codo imago.
18l - 19l 2d n
Ioinlor lo ICI Dala Slrucluro. Sinco llis is a 16-
bil poinlor, llo dala slrucluro can bo anyvloro
villin 64K forvard of llo firsl Iocalion in llis
codo imago. Tlis is llo 16-bil offsol (in IillIo-
ondian formal) lo llo ROM dala slrucluro
villin llis codo imago. Il is an offsol from llo
slarl addross of llis codo imago. Bocauso llis is
onIy a 16-bil offsol from llo firsl Iocalion of llis
codo imago, llo dala slrucluro musl rosido
villin 64KB forvard of llo firsl Iocalion of llis
codo imago.
- -

ROM Data Structure Format

As slalod oarIior, llo ROM Dala Slrucluro associalod vill oacl codo imago
musl rosido villin llo firsl 64KB of oacl codo imago. Tlo Dala Slrucluro
musl rosido villin llo run-limo codo (assuming lloro is ono). Ils possibIo
llal a ROM may nol conlain a dovico drivor for llo dovico, bul onIy an ini-
liaIizalion moduIo llal losls llo dovico and gols il roady for normaI opora-
lion. If lloro isnl a run-limo codo moduIo, llo Dala Slrucluro musl rosido
villin llo iniliaIizalion codo. Tlo Dala Slrucluros formal is dofinod in
TabIo 23-3 on pago 882 and llo purposo of oacl fioId is furllor dofinod in
llo soclions llal foIIov llo labIo.
--
-

- -
02l
1
OvoraII sizo of llo imago (in 512 bylo incromonls). Tlo
lolaI sizo of llo runlimo codo pIus llo iniliaIizalion codo
(runlimo codo + iniliaIizalion codo = iniliaIizalion sizo).
Tlis sum is nol nocossariIy llo "ovoraII sizo of llo
imago." Tlo ovoraII sizo of llo imago (Imago Iongll)
couId bo groalor llan llo iniliaIizalion sizo. Tlo Imago
Iongll or Imago sizo is vlal spocifios vloro llo noxl
imago in llo ROM slarls, vliIo llo IniliaIizalion sizo (a
bollor namo for llis fioId) is llo acluaI codo sizo llal is
copiod inlo RAM.
03l-05l 3
Inlry poinl for llo iniliaIizalion codo. Conlains a llroo-
bylo, x86 slorl jump lo llo iniliaIizalion codo onlry
poinl. Tlo IOST porforms a far caII lo llis Iocalion lo
iniliaIizo llo dovico.
06l-17l 18d
Rosorvod (for appIicalion-uniquo dala, sucl as llo
copyrigll nolico).
-- -

-
- -
00l 4
consisling of llo ASCII slring "ICIR" (ICI
ROM).
04l 2
. Tlis is a dupIicalion of llo Vondor ID found in
llo funclions configuralion Vondor ID rogislor (soo Von-
dor ID Rogislor on pago 773). Tlo ROM may conlain muI-
lipIo codo imagos of llo dosirod Codo Typo (o.g., x86 codo),
bul lloy may bo for difforonl dovicos producod by llo samo
(or a difforonl) vondor.
In ordor lo onsuro llal il Ioads llo corrocl ono, llo configu-
ralion soflvaro comparos llo Vondor ID, Dovico ID, and
CIass Codo vaIuos conlainod in llis Dala Slrucluro lo lloso
found in llo funclions Vondor ID, Dovico ID, and CIass
Codo configuralion rogislors.
06l 2
. Tlis is a dupIicalion of llo Dovico ID found in
llo funclions configuralion Dovico ID rogislor (soo Dovico
ID Rogislor on pago 773). Soo oxpIanalion of Vondor ID
fioId in llis labIo.
08l 2
- - . Tlo
poinlor lo llo oplionaI VID is providod as an offsol from
llo slarl Iocalion of llo codo imago. Tlo 2.2 ICI spoc rodo-
finod llis as a Rosorvod bil fioId and llo oplionaI VID (if
prosonl) vas movod lo llo dovicos configuralion rogislors.
Rofor lo VilaI Iroducl Dala (VID) CapabiIily on
pago 848.
0Al 2 ICI in bylos, IillIo-ondian formal.
0Cl 1
ICI -. Tlo Dala Slrucluro formal
slovn in llis labIo is rovision zoro.
0Dl 3
-- . Tlis is a dupIicalion of llo CIass Codo found
in llo funclions configuralion CIass Codo rogislor (soo
CIass Codo Rogislor on pago 774). Soo oxpIanalion of
Vondor ID fioId in llis labIo.
- -

Tlis uniquo signaluro idonlifios llo slarl of llo ICI Dala

Slrucluro. Tlo is slorod al offsol 00l, llo al offsol 01l, olc.
slands for ICI ROM.
- As slalod in TabIo 23-3 on
pago 882, llo configuralion soflvaro doos nol soIocl a codo imago lo Ioad
inlo syslom momory unIoss il is llo corrocl Codo Typo and llo Vondor ID,
Dovico ID, and CIass Codo in llo imagos Dala Slrucluro malcl llo func-
lions rospoclivo configuralion rogislors. Tlo ROM may conlain codo
imagos for varialions on llo dovico, oillor from llo samo vondor or sup-
pIiod by difforonl vondors.
- Rofor lo llo doscriplion of llo Von-
dor ID fioId in llo provious soclion.
10l 2
. Codo imago Iongll in incromonls of 512
bylos (IillIo-ondian formal). Tlo lolaI sizo of llo runlimo
codo pIus llo iniliaIizalion codo (runlimo codo + iniliaIiza-
lion codo = iniliaIizalion sizo). Tlis sum is nol nocossariIy
llo "ovoraII sizo of llo imago." Tlo ovoraII sizo of llo imago
(Imago Iongll) couId bo groalor llan llo iniliaIizalion sizo.
Tlo Imago Iongll or Imago sizo is vlal spocifios vloro llo
noxl imago in llo ROM slarls, vliIo llo IniliaIizalion sizo
(a bollor namo for llis fioId) is llo acluaI codo sizo llal is
copiod inlo RAM.
12l 2 - in llis codo imago.
14l 1 . Soo Codo Typo on pago 885.
15l 1
. Bil 7 indicalos vlollor llis is llo Iasl codo
imago in llo ROM (1 = Iasl imago). Bils |6:0] aro rosorvod
and musl bo zoro.
16l 2 -.
-
- -
-- -

Tlo 2.2 ICI spoc dofinod llis as a

Rosorvod fioId and llo oplionaI VID (if prosonl) vas movod lo llo dovicos
configuralion rogislors. Rofor lo VilaI Iroducl Dala (VID) CapabiIily on
pago 848. Tlo foIIoving doscriplion is onIy providod as lisloricaI informa-
lion.
Tlo VID poinlor is llo offsol (from llo slarl of llo codo imago) lo llo VilaI
Iroducl Dala aroa. Tlo offsol vas slorod in IillIo-ondian formal. Bocauso llo
offsol is onIy 16-bils in sizo, llo VilaI Iroducl Dala aroa lad lo rosido villin
llo firsl 64KB of llo imago. A vaIuo of zoro indicalos llal llo imago conlains
no VilaI Iroducl Dala. Tlo rovision 2.0 ICI spoc said llal llo poinlor vas
roquirod, bul llo 2.1 ICI spoc romovod llal roquiromonl. If no dovico ROM
vas prosonl on a dovico ollor llan llo ono conlaining llo VID, lloro vas
onIy ono imago and il conlainod llo VID. If muIlipIo codo imagos voro
prosonl, oacl imago conlainod VID for llal dovico. Tlo VID dala llal
doscribod llo dovico may bo dupIicalod in oacl codo imago, bul llo VID
llal porlains lo soflvaro may bo difforonl for oacl codo imago.
Tlis 16-bil vaIuo is slorod in llo IillIo-
ondian formal. Il dofinos llo Iongll (in bylos) of llo ICI Dala Slrucluro for
llis imago.
- Tlis 8-bil fioId rofIocls llo rovision of llo
imago's Dala Slrucluro. Tlo curronlIy-dofinod dala slrucluro formal (as of
rovision 2.2 ICI spoc) is rovision zoro.
-- Tlo 24-bil cIass codo fioId conlains llo samo informalion as
llo CIass Codo configuralion rogislor villin llo funclions configuralion
loador. Tlo configuralion soflvaro oxaminos llis fioId lo dolormino if llis is
a VGA-compalibIo inlorfaco. If il is, llo ROM codo imago musl bo copiod
inlo syslom momory slarling al Iocalion 000C0000l (for compalibiIily). Oll-
orviso, il viII lypicaIIy bo copiod inlo llo C0000l-llrougl-DIIIIl rogion
in a IC-compalibIo maclino. AIso rofor lo Vondor ID fioId in ROM dala
slrucluro on pago 883.
Tlis lvo-bylo fioId indicalos llo Iongll of llo onliro codo
imago (rofor lo Iiguro 23-4 on pago 879) in incromonls of 512 bylos. Il is
slorod in IillIo-ondian formal. Tlo lolaI sizo of llo runlimo codo pIus llo ini-
liaIizalion codo (runlimo codo + iniliaIizalion codo = iniliaIizalion sizo).
Tlis sum is nol nocossariIy llo "ovoraII sizo of llo imago." Tlo ovoraII sizo
of llo imago (Imago Iongll) couId bo groalor llan llo iniliaIizalion sizo.
Tlo Imago Iongll or Imago sizo is vlal spocifios vloro llo noxl imago in
llo ROM slarls, vliIo llo IniliaIizalion sizo (a bollor namo for llis fioId) is
llo acluaI codo sizo llal is copiod inlo RAM.
- -

- Tlis lvo-bylo fioId rofIocls llo rovision

IovoI of llo codo villin llo imago.
Tlis ono-bylo fioId idonlifios llo lypo of codo conlainod in llis
imago as oillor oxoculabIo maclino Ianguago for a parlicuIar procossor/
arclilocluro, or as inlorprolivo codo.
- Codo Typo 00l = InloI (IBM IC-AT compalibIo) oxoculabIo codo.
- Codo Typo 01l = . Tlo Opon Iirmvaro
slandard (roforonco IIII slandard 1275-1994) dofinos llo formal and
usago of llo inlorprolivo codo. A basic doscriplion of llo Opon Iirm-
varo slandard can bo found in Inlroduclion lo Opon Iirmvaro on
pago 888.
- Codo Typo 02l = oxoculabIo codo (addod in llo 2.2 ICI
spoc).
- Codo Typo 03l = IxlonsibIo Iirmvaro Inlorfaco (III).
Tlo vaIuos from 04l-llrougl-IIl aro rosorvod.
OnIy bil sovon is curronlIy dofinod.
- 0 = nol Iasl codo imago in ROM.
- 1 = Iasl codo imago in ROM.
Bils |6:0] aro rosorvod.
Execution of InitiaIization Code
Irior lo llo discovory of llo dovicos ROM, llo configuralion soflvaro las
accompIislod llo foIIoving:
- Assignod ono or moro momory and/or IO rangos lo llo funclion by pro-
gramming ils Baso Addross Rogislors (soo Baso Addross Rogislors on
pago 792).
- If llo dovico is inlorrupl-drivon, llo inlorrupl rouling informalion las boon
programmod inlo llo dovicos Inlorrupl Iino rogislor (soo Inlorrupl Iino
Rogislor on pago 791).
- In addilion, if llo UDI bil (llis bil vas in llo 2.1 ICI spoc and vas doIolod
from llo 2.2 ICI spoc) vas sol in llo dovicos configuralion Slalus rogislor,
llo usor las boon promplod lo insorl llo disIollo conlaining llo ICI config-
uralion fiIo, or ICI, and llo usor soIoclod any configuralion oplions avaiI-
abIo from llo fiIo.
-- -

Aflor llo ROM is discovorod, llo configuralion soflvaro copiod a codo imago
from llo ROM inlo RAM momory. Aflor llo approprialo codo imago las boon
copiod inlo syslom momory, llo dovico ROMs addross docodor is disabIod. Tlo
configuralion soflvaro musl Ioop llo aroa of RAM (llo imago rosidos in) road/
vrilabIo. Tlo soquonco llal foIIovs assumos llal llo soIoclod ROM imagos
Codo Typo fioId is 00l and llal llo dovico rosidos on a IC compalibIo pIalform.
Tlo configuralion soflvaro llon oxoculos llo foIIoving soquonco:
1. Rofor lo Iiguro 23-5 on pago 888. Tlo soflvaro caIIs llo iniliaIizalion mod-
uIo villin llo imago (llrougl Iocalion 3l in llo imago), suppIying il vill
llroo paramolors in llo AX rogislor: llo bus numbor, dovico numbor and
funclion numbor of llo funclion associalod vill llo ROM:
Tlo 8-bil bus numbor is suppIiod in AH,
llo dovico numbor is suppIiod in llo uppor fivo bils of AI,
and llo funclion numbor in llo Iovor llroo bils of AI.
Ils nocossary lo suppIy llo iniliaIizalion codo vill llis informalion so llal
il can dolormino lov llo funclion las boon configurod. Ior oxampIo, vlal
IO and/or momory addross rango llo configuralion soflvaro las aIIocalod
lo llo funclion (via ils baso addross rogislors), vlal inpul on llo inlorrupl
conlroIIor llo funclions inlorrupl pin las boon roulod lo, olc.
2. Tlo iniliaIizalion codo llon issuos a caII lo llo ICI BIOS, suppIying llo bus
numbor, dovico numbor, and funclion numbor as inpul paramolors and
roquosling llo conlonls of llo funclions Baso Addross Rogislors. Armod
vill llis informalion, llo iniliaIizalion codo can nov communicalo vill
llo funclions IO rogislor sol lo iniliaIizo llo dovico and proparo il for nor-
maI oporalion.
3. If llo ROM imago las a dovico-spocific Inlorrupl Sorvico Roulino omboddod
villin llo run-limo moduIo, il roads from llo dovicos Inlorrupl Iino con-
figuralion rogislor lo dolormino vlicl syslom inlorrupl roquosl inpul on
llo inlorrupl conlroIIor llo funclions ICI inlorrupl pin las boon roulod lo
by llo configuralion soflvaro. Using llis rouling informalion, llo iniliaIiza-
lion codo Inovs vlicl onlry in llo inlorrupl labIo in momory musl bo
looIod. Il firsl roads llo poinlor curronlIy slorod in llal inlorrupl labIo
onlry and savos il villin llo body of llo run-limo porlion of llo imago. Il
llon sloros llo poinlor lo llo inlorrupl sorvico roulino omboddod villin llo
run-limo moduIo of llo codo imago inlo llal inlorrupl labIo onlry. In llis
vay, il mainlains llo inlogrily of llo inlorrupl clain. Sinco llo aroa of sys-
lom momory il las boon copiod inlo musl bo Iopl road/vrilabIo unliI llo
iniliaIizalion codo compIolos oxoculion, llo iniliaIizalion codo las no prob-
Iom saving llo poinlor llal il road from llo inlorrupl labIo onlry boforo
looIing il lo ils ovn sorvico roulino.
- -

4. Tlo ROM imago may aIso lavo a funclion-spocific BIOS roulino omboddod
villin llo run-limo moduIo of llo codo imago. In llis caso, il noods lo looI
anollor inlorrupl labIo onlry lo llis BIOS roulino. Onco again, il roads and
savos llo poinlor curronlIy slorod in llal inlorrupl labIo onlry and llon
sloros llo poinlor lo llo BIOS roulino omboddod villin llo run-limo mod-
uIo of llo codo imago. In llis vay, il mainlains llo inlogrily of llo inlorrupl
clain. -- - -
- - ---
- -- -- -- -
- -
-
-
5. Sinco llo aroa of syslom momory il rosidos in musl bo Iopl road/vrilabIo
unliI llo iniliaIizalion codo compIolos oxoculion, llo iniliaIizalion codo can
adjusl llo codo imago Iongll (in Iocalion 2l of llo imago). Vory lypicaIIy, al
llo compIolion of iniliaIizalion codo oxoculion llo programmor viII adjusl
llo imago Iongll fioId lo oncompass llo aroa from llo imagos slarl llrougl
llo ond of llo run-limo codo. Tlo iniliaIizalion codo is lypicaIIy onIy oxo-
culod onco and is llon discardod. Il musl aIso rocompulo a nov ClocIsum
and sloro il al llo ond of llo run-limo codo. If il sols llo imago Iongll lo
zoro, il doosnl nood lo rocompulo llo imago clocIsum and updalo il. Wlon
il rolurns conlroI lo llo configuralion soflvaro, a Iongll of zoro vouId indi-
calo llal llo drivor viII nol bo usod for somo roason (porlaps a probIom
vas doloclod during llo solup of llo dovico) and aII of llo momory il occu-
pios can bo doaIIocalod and rousod for somolling oIso.
6. Onco llo iniliaIizalion codo las compIolod oxoculion, il oxoculos a rolurn lo
llo syslom soflvaro llal caIIod il.
Tlo configuralion soflvaro llon porforms lvo finaI aclions:
1. Il inlorrogalos llo imago sizo (al offsol 2l in llo imago) lo dolormino if il
vas aIlorod. If il las, llo configuralion soflvaro adjusls llo amounl of
momory aIIocalod lo llo imago lo maIo moro officionl uso of momory. Tlo
imago is lypicaIIy slorlor llan il vas.
2. Il compulos a nov clocIsum for llo imago and sloros il al llo ond of llo
imago.
3. Wrilo-prolocls llo aroa of main momory llo imago rosidos in. Tlis viII Ioop
llo OS from using llo aroa aflor il laIos conlroI of llo maclino.
Tlo spoc rofors lo llo ICI mollod of vriling dovico ROM
codo and landIing ils doloclion, sladoving, and iniliaIizalion, as llo
. Tlal spoc slrossos llal llis is llo modoI llal
aII dovico ROMs for ollor busos (i.o., ollor llan ICI) slouId adloro lo.
-- -

Introduction to Open Firmware

Introduction
Tlo IIII slandard 1275-1994 onlilIod
- - addrossos lvo aroas of concorn
rogarding llo bool procoss:
- Tlo vory firsl soclion in llis claplor doscribod llo basic ralionaIo for incIud-
ing a dovico ROM in llo dosign of a dovicoil providos a llal
aIIovs llo OS bool program - llo dovico llo procoss.
Tlal raisos llo quoslion of vlal Ianguago lo vrilo llo dovico drivor in. Tlis
is ono of llo lvo major aroas addrossod by llo OponBool slandard. Il is llo
ono llal llo ICI spoc is concornod vill.
- Aflor llo OS is boolod inlo momory, llo BIOS passos conlroI lo il. If ils a
IIug-and-IIay capabIo OS, il vouId bo nico if llo BIOS -- a
llo OS llal idonlifiod a - dofining aII of llo dovicos llal llo OS
las al ils disposaI. Tlo OS couId llon lravorso llis dala slrucluro, dolormino
llo curronl slalo of aII dovicos, and manago llom for llo romaindor of llo
povor-up sossion. In ordor for llis lo vorI, llo oxacl formal of llis dala
slrucluro musl bo slandardizod and undorslood by boll llo BIOS llal
buiIds il and llo OS llal subsoquonlIy laIos ovnorslip of il. Tlis is llo
ollor major aroa addrossod by llo OponBool slandard.
Tloso lvo aroas aro discussod in moro dolaiI in llo lvo soclions llal foIIov. Il
slouId bo nolod llal llis is onIy inlondod as an inlroduclion lo llis slandard.
Tloros a Iol moro lo il llan is covorod loro: llo slandard is approximaloIy 300
pagos in Iongll, 8.5 x 11 in sizo. A dolaiIod discussion of Opon Iirmvaro is
oulsido llo scopo of llis booI.
-
- -

UniversaI Device Driver Format

HisloricaIIy, mosl of llo IC-compalibIo maclinos marIolod in llo pasl lavo
boon basod on InloI x86 procossors. Wlon vriling ROM codo for an add-in sub-
syslom on a card, il vas a simpIo docision llal llo dovico drivor imago lo bo
slorod in llo ROM vouId bo an x86 maclino Ianguago codo imago.
A numbor of syslom vondors lavo croalod sysloms incorporaling ICI and basod
on procossors ollor llan llo x86 procossor famiIy. Tloso maclinos vouId laIo a
subslanliaI porformanco lil vlon oxoculing oxpansion ROM codo llal isnl
vrillon in llo procossors nalivo maclino Ianguago (i.o., x86 codo is foroign lo
IovorIC and ollor lypos of non-InloI compalibIo procossors). Tloy vouId bo
forcod lo omuIalo llo x86 codo, an inloronlIy inofficionl soIulion.
Rallor llan vriling an add-in dovicos ROM codo in maclino Ianguago nalivo
lo a parlicuIar procossor, llo subsyslom dosignor can vrilo llo ROM codo in
Icodo (loIonizod Iorll codo) basod on llo Opon Iirmvaro spocificalion, IIII
1275-1994. In ollor vords, llo dovico drivor is vrillon in llo ligl-ordor Ian-
guago Iorll.
Tlo Opon Iirmvaro compononls vouId consisl of llo foIIoving:
- Tlo syslom BIOS conlains llo Icodo inlorprolor and possibIy an individuaI
Icodo dovico drivor associalod vill oacl of llo omboddod subsysloms llal
llo syslom Opon Iirmvaro is aIroady cognizanl of.
- Iacl add-in subsyslom vouId lopofuIIy conlain an Opon Iirmvaro Icodo
imago.
Tlo Opon Iirmvaro Ianguago is basod on llo Iorll programming Ianguago.
Tlo ROM codo vouId bo vrillon in Iorll sourco codo. Tlo sourco codo is llon
suppIiod as inpul lo a loIonizor program. Tlo loIonizor procossos llo sourco
codo inlo a sorios of comprossod commands, Inovn as Icodo. As an oxampIo,
an onliro Iino of sourco codo migll bo roducod lo a singIo bylo llal roprosonls
llo Iorll command, onIy in a mucl moro compacl form.
Tlo syslom BIOS llal discovorod llo ROM (as doscribod oarIior in llis clap-
lor), incorporalos an inlorprolor llal convorls llo Icodo bylo slroam road from
llo ROM inlo maclino Ianguago inslruclions spocific lo llo sysloms procossor.
Tlo programmor onIy las lo vrilo llis ono univorsaI vorsion of llo drivor and
any maclino vill an Icodo inlorprolor buiIl inlo llo syslom BIOS can llon uli-
Iizo llis drivor vill llo dovico during llo bool procoss (aIIoving llo dovico lo
-- -

bo soIoclod as llo Inpul, Oulpul, or III bool dovico). ObviousIy, oxoculing a

drivor vrillon in inlorprolivo codo vouId yioId Ioss llan oplimum porformanco.
Hovovor, onco llo OS is boolod inlo momory il llon Ioads nalivo codo drivors
for llo llroo bool dovicos lo ropIaco llo Icodo drivors. Iorformanco of llo
dovicos is llon oplimizod.
Tlo ICI spoc rofors llo roador lo anollor documonl, -
for impIomonlalion of Opon Iirmvaro in a ICI-basod maclino. Tlis
documonl is avaiIabIo using anonymous ITI lo llo maclino pIay-
ground.sun.com vill llo fiIo namo /pub/p1275/bindings/poslscripl/ICI.ps.
Passing Resource List To PIug-and-PIay OS
BIOS CaIIs Bus Enumerators For Different Bus Environments
A maclino arclilocluro can conlain many difforonl dovico onvironmonls. Ixam-
pIos vouId bo ICI, CardBus, IIug-and-IIay ISA, olc. Tlo mollods llal musl bo
usod lo accoss llo configuralion rogislors associalod vill oacl of lloso difforonl
dovico lypos aro vory difforonl from oacl ollor. In addilion, llo Iayoul and for-
mal of lloir configuralion rogislors aro quilo difforonl as voII.
Tlo BIOS incIudos a soparalo, bus-spocific program for oacl of lloso onviron-
monls. Tlis program is froquonlIy roforrod lo as a - . Tlo Bus
Inumoralor Inovs:
- lov lo accoss llo configuralion rogislors villin dovicos of ils spocific lypo
(o.g., ICI, ICI-X, ICI Ixpross).
- lov lo discovor dovicos villin ils onvironmonl. Ior oxampIo, in a ICI,
ICI-X, or ICI Ixpross onvironmonl, llo programmor roads llo Vondor ID
from a funclions Vondor ID rogislor. Any vaIuo ollor llan IIIIl ropro-
sonls a vaIid ID, vliIo IIIIl indicalos llal no funclion rosidos al llo cur-
ronlIy-addrossod Iocalion.
- lov lo probo llo dovicos configuralion rogislors lo discovor llo dovicos
rosourco roquiromonls.
- lov lo aIIocalo soIoclod rosourcos lo llo dovico.
Tlo syslom BIOS musl caII llo Bus Inumoralors for oacl of llo bus onviron-
monls supporlod in llo pIalform. Wlon a spocific Inumoralor is caIIod, il dis-
covors aII of llo dovicos villin ils largol onvironmonl, discovors llo rosourcos
oacl roquiros, and aIIocalos non-confIicling rosourcos lo oacl. Il doos nol, lov-
ovor, onabIo llo dovicos. Tlo Inumoralor buiIds a dala slrucluro in momory llal
Iisls aII dovicos of ils lypo llal voro found. Il llon passos a poinlor lo llo slarl of
llal dala slrucluro bacI lo llo syslom BIOS.
- -

Wlon llo syslom BIOS las caIIod oacl of llo Bus Inumoralors for llo difforonl
onvironmonls, il nov las a Iisl of poinlors lo llo various, bus-spocific dala
slrucluros llal Iisl aII of llo dovicos llal il las lo vorI vill.
BIOS SeIects Boot Devices and Finds Drivers For Them
Tlo syslom BIOS vouId llon scan llo dala slrucluros lo Iocalo an Inpul dovico,
an Oulpul dovico, and an III dovico lo uso in booling llo OS inlo momory. In
ordor lo uso oacl of lloso dovicos during llo bool procoss, il vouId aIso roquiro
a dovico drivor for oacl of llom. Tlo drivors vouId oillor bo omboddod villin
llo BIOS ilsoIf or villin dovico ROMs discovorod vill oacl of llo dovicos.
Ior oacl of llo llroo bool dovicos, llo BIOS vouId llon:
- caII llo iniliaIizalion codo villin llo dovico drivor. Tlo iniliaIizalion codo
vouId llon compIolo llo proparalion of llo dovico for uso.
- Tlo BIOS vouId llon sol llo approprialo bils in ils configuralion Command
rogislor (o.g., Bus Maslor InabIo, olc.) lo onabIo llo dovico and bring il on-
Iino.
BIOS Boots PIug-and-PIay OS and Passes Pointer To It
Tlo syslom BIOS llon usos llo llroo dovicos lo bool llo OS inlo momory and
passos conlroI lo llo OS. Il aIso passos llo OS a poinlor llal poinls lo llo load of
llo Iisl of dala slrucluros llal idonlify aII of llo dovicos llal llo OS las lo vorI
vill.
OS Locates and Loads Drivers and CaIIs Init Code In Each
Nolo llal rofors lo llo IniliaIizalion codo porlion of llo drivor. Tlo OS
llon Iocalos llo disI-basod drivors for oacl dovico and Ioads llom inlo momory
ono-by-ono. As il Ioads oacl drivor, il llon caIIs ils iniliaIizalion codo onlry
poinl and llo drivor compIolos llo dovico-spocific solup of llo dovico and
brings llo dovico on-Iino. Tlo maclino is nov up and running and llo OS man-
agos llo syslom dovicos from llis poinl forvard.
893
--

--
The Previous Chapter
Tlo provious claplor providod a dolaiIod doscriplion of dovico ROMs associ-
alod vill ICI, ICI Ixpross, and ICI-X funclions. Tlis incIudod llo foIIoving
lopics:
- dovico ROM doloclion.
- inlornaI codo/dala formal.
- sladoving.
- iniliaIizalion codo oxoculion.
- inlorrupl looIing.
This Chapter
Tlis claplor providos a doscriplion of:
- Tlo ICI Ixpross CapabiIily rogislor sol in a funclions ICI-compalibIo con-
figuralion spaco.
- Tlo oplionaI ICI Ixpross Ixlondod CapabiIilios rogislor sols in a funclions
oxlondod configuralion spaco:
Tlo Advancod Irror Roporling CapabiIily rogislor sol.
VirluaI ClannoI CapabiIily rogislor sol.
Dovico SoriaI Numbor CapabiIily rogislor sol.
Iovor Budgoling CapabiIily rogislor sol.
- RCRBs.
PCI Express System Architecture
894
Introduction
Rofor lo Iiguro 24-1 on pago 895. As doscribod oarIior in Iacl Iunclion ImpIo-
monls a Sol of Configuralion Rogislors on pago 715, oacl ICI Ixpross funclion
las a dodicalod 4KB momory addross rango villin vlicl ils configuralion rog-
islors aro impIomonlod. Iacl Ixpross funclion musl impIomonl llo ICI Ixpross
CapabiIily rogislor sol somovloro in llo Iovor 48 dvords of llo ICI-compalibIo
rogislor spaco (i.o., villin llo Iovor 48 dvord rogion of llo firsl 64 dvords of
configuralion spaco). In addilion, llo funclion may oplionaIIy impIomonl any of
llo ICI Ixpross Ixlondod CapabiIily rogislor sols. Tlo soclions llal foIIov pro-
vido a dolaiIod doscriplion of oacl of lloso Ixpross-spocific rogislor sols.
Chapter 24: Express-Specific Configuration Registers
895
-
PCI Express System Architecture
896
PCI Express CapabiIity Register Set
Introduction
Rofor lo Iiguro 24-2 on pago 897. Ollorviso roforrod lo as llo ICI Ixpross Capa-
biIily Slrucluro, impIomonlalion of llo ICI Ixpross CapabiIily rogislor sol is
mandalory for oacl funclion. Il is impIomonlod as parl of llo IinIod Iisl of
CapabiIily rogislor sols llal rosido in llo Iovor 48 dvords of a funclions ICI-
compalibIo rogislor aroa. Il slouId bo nolod lovovor, llal somo porlions of llis
rogislor sol aro oplionaI.
Rogislor impIomonlalion roquiromonls:
- Ivory Ixpross funclion musl impIomonl llo rogislors llal rosido in dvords
0-llrougl-4.
- Tlo bridgo associalod vill oacl Rool Iorl musl impIomonl llo rogislors
llal rosido in dvords sovon and oigll.
- Iacl bridgo associalod vill a Rool Iorl or a dovnslroam Svilcl Iorl llal is
connoclod lo a sIol (i.o., an add-in card sIol) musl impIomonl llo rogislors
llal rosido in dvords fivo and six.
Tlo soclions llal foIIov provido a dolaiIod doscriplion of oacl of lloso rogislors.
Chapter 24: Express-Specific Configuration Registers
897
Required Registers
GeneraI
Tlo soclions llal foIIov doscribo oacl of llo roquirod rogislors villin llo ICI
Ixpross CapabiIily rogislor sol. Tlo foIIoving rogislors musl bo impIomonlod by
aII Ixpross funclions:
- ICI Ixpross CapabiIily ID Rogislor
- Noxl CapabiIily Ioinlor Rogislor
- ICI Ixpross CapabiIilios Rogislor
- Dovico CapabiIilios Rogislor
- Dovico ConlroI Rogislor
- Dovico Slalus Rogislor
- IinI CapabiIilios Rogislor
- IinI ConlroI Rogislor
- IinI Slalus Rogislor
-- -
PCI Express System Architecture
898
PCI Express CapabiIity ID Register
Tlis road-onIy fioId musl conlain llo vaIuo 10l, indicaling llis is llo slarl of llo
ICI Ixpross CapabiIily rogislor sol.
Next CapabiIity Pointer Register
Tlis road-onIy fioId conlains ono of llo foIIoving:
- Tlo dvord-aIignod, non-zoro offsol lo llo noxl capabiIily rogislor sol in llo
Iovor 48 dvords of llo funclions ICI-compalibIo configuralion spaco.
- 00l, if llo ICI Ixpross CapabiIily rogislor sol is llo finaI rogislor sol in llo
IinIod Iisl of capabiIily rogislor sols in llo funclions ICI-compalibIo config-
uralion spaco.
PCI Express CapabiIities Register
Iiguro 24-3 on pago 898 iIIuslralos llis rogislor and TabIo 24 - 1 on pago 899 pro-
vidos a doscriplion of oacl bil fioId in llis rogislor.
-- - -
Chapter 24: Express-Specific Configuration Registers
899
-- - -
- -
3:0 RO -. SIG-dofinod ICI Ixpross capabiIily slrucluro
vorsion numbor (musl bo 1l).
7:4 RO . Ixpross IogicaI dovico lypo:
- 0000b: -- . Somo OSs and/or procossors
may nol supporl IO accossos (i.o., accossos using IO rallor llan
momory addrossos). Tlis boing llo caso, llo dosignor of a nalivo
ICI Ixpross funclion slouId avoid llo uso of IO BARs.
Hovovor, llo largol syslom llal a funclion is dosignod for may
uso llo funclion as ono of llo bool dovicos (i.o., llo bool inpul
dovico (o.g., Ioyboard), oulpul dispIay dovico, or bool mass
slorago dovico) and may uliIizo a Iogacy dovico drivor for llo
funclion al slarlup limo. Tlo Iogacy drivor may assumo llal llo
funclions dovico-spocific rogislor sol rosidos in IO spaco. In llis
caso, llo funclion dosignor vouId suppIy an IO BAR lo vlicl
llo configuralion soflvaro viII assign an IO addross rango.
Wlon llo OS bool las compIolod and llo OS las Ioadod a
nalivo ICI Ixpross drivor for llo funclion, lovovor, llo OS may
doaIIocalo aII Iogacy IO addross rangos proviousIy assignod lo
llo soIoclod bool dovicos. Irom llal poinl forvard and for llo
duralion of llo povor-up sossion, llo nalivo drivor viII uliIizo
momory accossos lo communicalo vill ils associalod funclion
llrougl llo funclions momory BARs.
- 0001b: -- . A funclion llal roquiros
IO spaco assignmonl llrougl BARs for run-limo oporalions.
Ixlondod configuralion spaco capabiIilios, if impIomonlod on
Iogacy ICI Ixpross Indpoinl dovicos, may bo ignorod by sofl-
varo.
- 0100b: of ICI Ixpross Rool CompIox.
- 0101b: - .
- 0110b: - .
- 0111b: -- .
- 1000b: -- .
- AII ollor oncodings aro rosorvod.
OnIy vaIid for funclions vill a Typo 1 configuralion rogislor
Iayoul.
PCI Express System Architecture
900
Device CapabiIities Register
Iiguro 24-4 on pago 901 and TabIo 24 - 2 on pago 901 provido a doscriplion of
oacl bil fioId in llis rogislor. Tlis rogislor dofinos oporalionaI claraclorislics llal
aro gIobaIIy appIicabIo lo llo dovico (and aII funclions llal rosido villin il).
8 HWInil . Wlon sol, indicalos llal llis Rool Iorl or
Svilcl dovnslroam porl is connoclod lo an add-in card sIol (rallor
llan lo an inlogralod compononl or boing disabIod). Soo Classis
and SIol Numbor Assignmonl on pago 861 for moro informalion.
13:9 RO -- . If llis funclion is aIIocalod moro
llan ono MSI inlorrupl mossago vaIuo (soo Mossago Dala Rogis-
lor on pago 335), llis rogislor conlains llo MSI Dala vaIuo llal is
vrillon lo llo MSI doslinalion addross vlon any slalus bil in
oillor llo SIol Slalus rogislor (soo SIol Slalus Rogislor on
pago 925) or llo Rool Slalus rogislor (soo Rool Slalus Rogislor on
pago 928) of llis funclion aro sol. If syslom soflvaro slouId aIlor
llo numbor of mossago dala vaIuos assignod lo llo funclion, llo
funclions lardvaro musl updalo llis fioId lo rofIocl llo clango.
-- - -
- -
Chapter 24: Express-Specific Configuration Registers
901
- -
- -
- -
2:0 . Max dala payIoad sizo llal llo funclion sup-
porls for TIIs:
- 000b = 128 bylos max payIoad sizo
- 001b = 256 bylos max payIoad sizo
- 010b = 512 bylos max payIoad sizo
- 011b = 1KB max payIoad sizo
- 100b = 2KB max payIoad sizo
- 101b = 4KB max payIoad sizo
- 110b = Rosorvod
- 111b = Rosorvod
PCI Express System Architecture
902
4:3 - .
: NormaIIy, oacl Ixpross funclion (vlon acling as a Roquoslor)
is Iimilod lo no moro llan 32 oulslanding roquosls curronlIy availing com-
pIolion (as indicalod by llo Iovor fivo bils of llo lransaclion Tag, llo uppor
llroo bils of llo Tag musl bo zoro). Hovovor, a funclion may roquiro moro
llan llis. If llo Ixlondod Tag IioId is supporlod (soo bil 5 in llis labIo) and
if llo Ixlondod Tag IioId InabIo bil in llo Dovico ConlroI rogislor is sol (soo
Dovico ConlroI Rogislor on pago 905), llo max is incroasod lo 256 and aII
oigll bils of llo Roquoslor ID Tag fioId aro usod vlon a funclion villin llo
dovico issuos a roquosl pacIol. If a funclion roquiros a groalor Iimil llan
256, il may do llis via Ilanlom Iunclions.
-: Wlon llo dovico villin vlicl a funclion rosidos doos nol
impIomonl aII oigll funclions, a non-zoro vaIuo in llis fioId indicalos llal
llis is so. Assuming aII funclions aro nol impIomonlod and llal llo pro-
grammor las sol llo Ilanlom Iunclion InabIo bil in llo Dovico ConlroI
rogislor (soo Dovico ConlroI Rogislor on pago 905), a funclion may issuo
roquosl pacIols using ils ovn funclion numbor as voII as ono or moro addi-
lionaI funclion numbors.
Tlis fioId indicalos llo numbor of msbs of llo funclion numbor porlion of
Roquoslor ID llal aro IogicaIIy combinod vill llo Tag idonlifior.
- 00b. Tlo - villin llis dovico.
- 01b. Tlo msb of llo funclion numbor in llo Roquoslor ID is usod for
Ilanlom Iunclions. Tlo dovico dosignor may impIomonl funclions 0-3.
Wlon issuing roquosl pacIols, - - -
- - - -
.
- 10b. Tlo lvo msbs of llo funclion numbor in llo Roquoslor ID aro usod
for Ilanlom Iunclions. Tlo dovico dosignor may impIomonl funclions 0
and 1. Wlon issuing roquosl pacIols, - -
- - - . -
- - - - .
- 11b. AII llroo bils of llo funclion numbor in llo Roquoslor ID aro usod for
Ilanlom Iunclions. Tlo dovico dosignor musl onIy impIomonl
(and il - - - ).
- -
- -
Chapter 24: Express-Specific Configuration Registers
903
5 . Max supporlod sizo of llo Tag fioId vlon
llis funclion acls as a Roquoslor.
- 0 = - (max of 32 oulslanding roquosl por
Roquoslor).
- 1 = - (max of 256 oulslanding roquosl por
Roquoslor).
If 8-bil Tags aro supporlod and viII bo usod, llis foaluro is onabIod by sol-
ling llo Ixlondod Tag IioId InabIo bil in llo Dovico ConlroI rogislor (soo
Dovico ConlroI Rogislor on pago 905) lo ono.
8:6 - . AccoplabIo lolaI Ialoncy llal an Ind-
poinl can villsland duo lo llo lransilion from llo I0s slalo lo llo I0 slalo
(soo I0s Ixil Ialoncy Updalo on pago 625). Tlis vaIuo is an indirocl indi-
calion of llo amounl of llo Indpoinls inlornaI bufforing. Iovor manago-
monl soflvaro usos llis vaIuo lo comparo againsl llo I0s oxil Ialoncios
roporlod by aII compononls in llo pall bolvoon llis Indpoinl and ils par-
onl Rool Iorl lo dolormino vlollor ASIM I0s onlry can bo usod vill no
Ioss of porformanco.
- 000b = Ioss llan 64ns
- 001b = 64ns lo Ioss llan 128ns
- 010b = 128ns lo Ioss llan 256ns
- 011b = 256ns lo Ioss llan 51 ns
- 100b = 512ns lo Ioss llan 1s
- 101b = 1s lo Ioss llan 2s
- 110b = 2s-4s
- 111b = Moro llan 4s
- -
- -
PCI Express System Architecture
904
11:9 . AccoplabIo Ialoncy llal an Indpoinl can
villsland duo lo llo lransilion from I1 slalo lo llo I0 slalo (soo I1 Ixil
Ialoncy Updalo on pago 626). Tlis vaIuo is an indirocl indicalion of llo
amounl of llo Indpoinls inlornaI bufforing. Iovor managomonl soflvaro
usos llis vaIuo lo comparo againsl llo I1 Ixil Ialoncios roporlod by aII
compononls in llo pall bolvoon llis Indpoinl and ils paronl Rool Iorl lo
dolormino vlollor ASIM I1 onlry can bo usod vill no Ioss of porfor-
manco.
- 000b = Ioss llan 1s
- 001b = 1s lo Ioss llan 2s
- 010b = 2s lo Ioss llan 4s
- 011b = 4s lo Ioss llan 8s
- 100b = 8s lo Ioss llan 16s
- 101b = 16s lo Ioss llan 32s
- 110b = 32s-64s
- 111b = Moro llan 64s
12 -. Wlon sol lo ono, indicalos an Allonlion Bullon is
impIomonlod on llo card or moduIo. VaIid for llo foIIoving ICI Ixpross
dovico Typos:
- Ixpross Indpoinl dovico
- Iogacy Ixpross Indpoinl dovico
- Svilcl upslroam porl
- Ixpross-lo-ICI/ICI-X bridgo
13 -. Wlon sol lo ono, indicalos an Allonlion Indi-
calor is impIomonlod on llo card or moduIo. VaIid for llo foIIoving ICI
Ixpross dovico Typos:
- Ixpross Indpoinl dovico
- Iogacy Ixpross Indpoinl dovico
- Svilcl upslroam porl
- Ixpross-lo-ICI/ICI-X bridgo
- -
- -
Chapter 24: Express-Specific Configuration Registers
905
Device ControI Register
Iiguro 24-5 on pago 906 and TabIo 24 - 3 on pago 906 provido a doscriplion of
oacl bil fioId in llis rogislor.
14 -. Wlon sol lo ono, indicalos a Iovor Indicalor is
impIomonlod on llo card or moduIo. VaIid for llo foIIoving ICI Ixpross
dovico Typos:
- Ixpross Indpoinl dovico
- Iogacy Ixpross Indpoinl dovico
- Svilcl upslroam porl
- Ixpross-lo-ICI/ICI-X bridgo
25:18 (upslroam porls onIy). In combinalion
vill llo SIol Iovor Iimil ScaIo vaIuo (soo llo noxl rov in llis labIo), spoci-
fios llo uppor Iimil on povor suppIiod by sIol:
Iovor Iimil (in Walls) = SIol Iovor Iimil vaIuo x SIol Iovor Iimil ScaIo
vaIuo
Tlis vaIuo is oillor aulomalicaIIy sol by llo rocoipl of a Sol SIol Iovor Iimil
Mossago rocoivod from llo porl on llo dovnslroam ond of llo IinI, or is
lardvirod lo zoro.
Rofor lo SIol Iovor Iimil ConlroI on pago 562 for a dolaiIod doscriplion.
27:26 (upslroam porls onIy). Spocifios llo scaIo
usod for llo caIcuIalion of llo Iovor Iimil (soo llo provious rov in llis
labIo):
- 00b = 1.0x
- 01b = 0.1x
- 10b = 0.01x
- 11b = 0.001x
Tlis vaIuo is oillor aulomalicaIIy sol by llo rocoipl of a Sol SIol Iovor Iimil
Mossago rocoivod from llo porl on llo dovnslroam ond of llo IinI, or is
lardvirod lo zoro.
- -
- -
PCI Express System Architecture
906
-
-
- -
0 . Ior a muIlifunclion dovico, llis bil
conlroIs orror roporling for aII funclions. Ior a Rool Iorl, llo roporling of
corroclabIo orrors occurs inlornaIIy villin llo Rool CompIox. No oxlornaI
IRR_COR Mossago is gonoralod.
DofauIl vaIuo of llis fioId is 0.
1 Tlis bil conlroIs llo roporling of non-
falaI orrors. Ior a muIlifunclion dovico, il conlroIs orror roporling for aII
funclions. Ior a Rool Iorl, llo roporling of non-falaI orrors occurs inlor-
naIIy villin llo Rool CompIox. No oxlornaI IRR_NONIATAI Mossago is
gonoralod.
DofauIl vaIuo of llis fioId is 0.
Chapter 24: Express-Specific Configuration Registers
907
2 Tlis bil conlroIs llo roporling of falaI orrors.
Ior a muIlifunclion dovico, il conlroIs orror roporling for aII funclions
villin llo dovico. Ior a Rool Iorl, llo roporling of falaI orrors occurs inlor-
naIIy villin llo Rool CompIox. No oxlornaI IRR_IATAI Mossago is gonor-
alod.
DofauIl vaIuo of llis bil is 0.
3 - - Wlon sol lo ono, llis bil
onabIos llo roporling of Unsupporlod Roquosls. Ior a muIlifunclion dovico,
il conlroIs UR roporling for aII funclions. Tlo roporling of orror mossagos
(IRR_COR, IRR_NONIATAI, IRR_IATAI) rocoivod by a Rool Iorl is
conlroIIod oxcIusivoIy by llo Rool ConlroI rogislor (soo Rool ConlroI Rog-
islor on pago 926).
DofauIl vaIuo of llis bil is 0.
4 Wlon sol lo ono, llo dovico is pormillod lo sol
llo RoIaxod Ordoring bil (rofor lo RoIaxod Ordoring on pago 319) in llo
Allribulos fioId of roquosls il inilialos llal do nol roquiro slrong vrilo
ordoring.
DofauIl vaIuo of llis bil is 1, bul il may bo lardvirod lo 0 if a dovico novor
sols llo RoIaxod Ordoring allribulo in roquosls il inilialos as a Roquoslor.
7:5 Sols llo max TII dala payIoad sizo for llo dovico. As a
Rocoivor, llo dovico musl landIo TIIs as Iargo as llo sol vaIuo, as a Trans-
millor, llo dovico musl nol gonoralo TIIs oxcooding llo sol vaIuo. Iormissi-
bIo vaIuos llal can bo programmod aro indicalod by llo Max IayIoad Sizo
Supporlod in llo Dovico CapabiIilios rogislor (soo Dovico CapabiIilios Rog-
islor on pago 900).
- 000b = 128 bylo max payIoad sizo
- 001b = 256 bylo max payIoad sizo
- 010b = 512 bylo max payIoad sizo
- 011b = 1024 bylo max payIoad sizo
- 100b = 2048 bylo max payIoad sizo
- 101b = 4096 bylo max payIoad sizo
- 110b = Rosorvod
- 111b = Rosorvod
DofauIl vaIuo of llis fioId is 000b.
-
- -
PCI Express System Architecture
908
8 Wlon sol lo ono, onabIos a dovico lo uso an 8-
bil Tag fioId as a roquoslor. If cIoarod lo zoro, llo dovico is roslriclod lo a 5-
bil Tag fioId. AIso rofor lo llo doscriplion of llo Ilanlom Iunclions Sup-
porlod fioId in TabIo 24 - 2 on pago 901.
Tlo dofauIl vaIuo of llis bil is 0. Dovicos llal do nol impIomonl llis capa-
biIily lardviro llis bil lo 0.
9 - . Soo llo doscriplion of llo Ilanlom Iunclions
Supporlod fioId in TabIo 24 - 2 on pago 901.
DofauIl vaIuo of llis bil is 0. Dovicos llal do nol impIomonl llis capabiIily
lardviro llis bil lo 0.
10 Wlon sol lo ono, llis bil onabIos
a dovico lo drav Aux povor indopondonl of IMI Aux povor. In a Iogacy
OS onvironmonl, dovicos llal roquiro Aux povor slouId conlinuo lo indi-
calo IMI Aux povor roquiromonls. Aux povor is aIIocalod as roquoslod in
llo Aux Curronl fioId of llo Iovor Managomonl CapabiIilios rogislor
(IMC, soo AuxiIiary Iovor on pago 645), indopondonl of llo IMI InabIo
bil in llo Iovor Managomonl ConlroI/Slalus rogislor (IMCSR, soo IM
ConlroI/Slalus (IMCSR) Rogislor on pago 599). Ior muIlifunclion
dovicos, a compononl is aIIovod lo drav Aux povor if al Ioasl ono of llo
funclions las llis bil sol.
- : Dovicos llal consumo Aux povor musl prosorvo llo vaIuo in llis
fioId vlon Aux povor is avaiIabIo. In sucl dovicos, llis rogislor vaIuo is
nol modifiod by lol, varm, or coId rosol.
- Dovicos llal do nol impIomonl llis capabiIily lardviro llis bil lo 0.
-
- -
Chapter 24: Express-Specific Configuration Registers
909
Device Status Register
Iiguro 24-6 on pago 910 and TabIo 24 - 4 on pago 910 provido a doscriplion of
oacl bil fioId in llis rogislor.
11 Soflvaro sols llis bil lo ono if llo aroa of momory llis
Roquoslor viII accoss is nol caclod by llo procossor(s). Wlon a roquosl
pacIol llal largols syslom momory is rocoivod by llo Rool CompIox (i.o.,
llo momory llal llo procossors caclo from), llo Rool CompIox doos nol
lavo lo doIay llo accoss lo momory lo porform a snoop lransaclion on llo
procossor bus if llo No Snoop allribulo bil is sol. Tlis spoods up llo mom-
ory accoss.
- Nolo llal solling llis bil lo ono slouId nol causo a funclion lo unoquivo-
caIIy sol llo No Snoop allribulo on ovory momory roquosls llal il ini-
lialos. Tlo funclion may onIy sol llo bil vlon il Inovs llal llo
procossor(s) aro nol cacling from llo aroa of momory boing accossod.
- DofauIl vaIuo of llis bil is 1 and il may bo lardvirod lo 0 if a dovico
novor sols llo No Snoop allribulo in Roquosl lransaclions llal il inilialos.
14:12 - Max road roquosl sizo for llo dovico vlon acl-
ing as llo Roquoslor. Tlo dovico musl nol gonoralo road roquosls vill a sizo
> llis vaIuo.
- 000b = 128 bylo max road roquosl sizo
- 001b = 256 bylo max road roquosl sizo
- 010b = 512 bylo max road roquosl sizo
- 011b = 1KB max road roquosl sizo
- 100b = 2KB max road roquosl sizo
- 101b = 4KB max road roquosl sizo
- 110b = Rosorvod
- 111b = Rosorvod
Dovicos llal do nol gonoralo road roquosls Iargor llan 128 bylos aro pormil-
lod lo impIomonl llis fioId as Road OnIy (RO) vill a vaIuo of 000b.
DofauIl vaIuo of llis fioId is 010b.
-
- -
PCI Express System Architecture
910
- -
- -
- -
0 RW1C . A ono indicalos llal ono or moro cor-
roclabIo orrors voro doloclod sinco llo Iasl limo llis bil vas cIoarod
by soflvaro. CorroclabIo orrors aro rofIoclod by llis bil rogardIoss of
vlollor orror roporling is onabIod or nol in llo Dovico ConlroI rog-
islor (soo Dovico ConlroI Rogislor on pago 905). In a muIlifunc-
lion dovico, oacl funclion indicalos vlollor or nol llal funclion
las doloclod any corroclabIo orrors using llis bil.
Ior dovicos supporling Advancod Irror HandIing (soo Advancod
Irror Roporling Moclanisms on pago 382), orrors aro Ioggod in
llis rogislor rogardIoss of llo sollings of llo CorroclabIo Irror MasI
rogislor.
DofauIl vaIuo of llis bil is 0.
Chapter 24: Express-Specific Configuration Registers
911
1 RW1C . A ono indicalos llal ono or moro non-
falaI orrors voro doloclod sinco llo Iasl limo llis bil vas cIoarod by
soflvaro. Non-falaI orrors aro rofIoclod in llis bil rogardIoss of
vlollor orror roporling is onabIod or nol in llo Dovico ConlroI rog-
islor (soo Dovico ConlroI Rogislor on pago 905). In a muIlifunc-
lion dovico, oacl funclion indicalos vlollor or nol llal funclion
las doloclod any non-falaI orrors using llis bil.
Ior dovicos supporling Advancod Irror HandIing, orrors aro
Ioggod in llis rogislor rogardIoss of llo sollings of llo Uncorrocl-
abIo Irror MasI rogislor ( - --
- - - - - ).
DofauIl vaIuo of llis bil is 0.
2 RW1C . A ono indicalos llal ono or moro falaI orrors
voro doloclod sinco llo Iasl limo llis bil vas cIoarod by soflvaro.
IalaI orrors aro rofIoclod in llis bil rogardIoss of vlollor orror
roporling is onabIod or nol in llo Dovico ConlroI rogislor (soo
Dovico ConlroI Rogislor on pago 905). In a muIlifunclion dovico,
oacl funclion indicalos vlollor or nol llal funclion las doloclod
any falaI orrors using llis bil.
Ior dovicos supporling Advancod Irror HandIing (soo Advancod
Irror Roporling CapabiIily on pago 930), orrors aro Ioggod in llis
rogislor rogardIoss of llo sollings of llo UncorroclabIo Irror MasI
rogislor ( - - --
- -)
DofauIl vaIuo of llis bil is 0.
3 RW1C - - . Wlon sol lo ono, indicalos
llal llo funclion rocoivod an Unsupporlod Roquosl. Irrors aro
rofIoclod in llis bil rogardIoss of vlollor orror roporling is onabIod
or nol in llo Dovico ConlroI rogislor (soo Dovico ConlroI Rogislor
on pago 905). In a muIlifunclion dovico, oacl funclion indicalos
vlollor or nol llal funclion las doloclod any UR orrors using llis
bil.
DofauIl vaIuo of llis fioId is 0.
4 RO . Dovicos llal roquiro Aux povor sol llis bil lo
ono if Aux povor is doloclod by llo dovico.
- -
- -
PCI Express System Architecture
912
Link Registers (Required)
Tloro aro llroo IinI-roIalod rogislors:
- Tlo IinI CapabiIilios Rogislor.
- Tlo IinI ConlroI Rogislor.
- Tlo IinI Slalus Rogislor.
- - Iiguro 24-7 on pago 913 and TabIo 24 - 5 on
pago 913 provido a doscriplion of oacl bil fioId in llis rogislor.
5 RO -- . Wlon sol lo ono, indicalos llal llis funclion
las issuod non-poslod roquosl pacIols vlicl lavo nol yol boon
compIolod (oillor by llo rocoipl of a corrosponding CompIolion, or
by llo CompIolion Timooul moclanism). A funclion roporls llis bil
cIoarod onIy vlon aII oulslanding non-poslod roquosls lavo com-
pIolod or lavo boon lorminalod by llo CompIolion Timooul mocla-
nism.
- -: Rool and Svilcl Iorls adloring soIoIy lo
llo 1.0a Ixpross spoc novor issuo non-poslod roquosls on lloir
ovn bolaIf. Sucl Rool and Svilcl Iorls lardviro llis bil lo 0b.
- -
- -
Chapter 24: Express-Specific Configuration Registers
913
- -
- -
- -
3:0 RO .
- 0001b = 2.5 Gb/s
- AII ollor oncodings aro rosorvod.
9:4 RO .
- 000000b = Rosorvod
- 000001b = x1
- 000010b = x2
- 000100b = x4
- 001000b = x8
- 001100b = x12
- 010000b = x16
- 100000b = x32
- AII ollor vaIuos aro rosorvod.
PCI Express System Architecture
914
11:10 RO . Indicalos llo
IovoI of ASIM supporlod on llis IinI.
- 00b = Rosorvod
- 01b = I0s Inlry Supporlod
- 10b = Rosorvod
- 11b = I0s and I1 Supporlod
Rofor lo IinI Aclivo Slalo Iovor Managomonl on pago 608 for
moro informalion.
14:12 RO - . Indicalos llo I0s oxil Ialoncy for llo IinI (i.o., llo
Iongll of limo llis Iorl roquiros lo compIolo a lransilion from I0s
lo I0).
- 000b = Ioss llan 64ns
- 001b = 64ns lo Ioss llan 128ns
- 010b = 128ns lo Ioss llan 256ns
- 011b = 256ns lo Ioss llan 512ns
- 100b = 512ns lo Ioss llan 1s
- 101b = 1s lo Ioss llan 2s
- 110b = 2s-4s
- 111b = Moro llan 4s
: Ixil Ialoncios may bo infIuoncod by a porls roforonco cIocI
configuralion (i.o., vlollor llo porl usos llo roforonco cIocI sup-
pIiod by llo porl al llo romolo ond of llo IinI or il providos il ovn
IocaI roforonco cIocI).
Rofor lo ASIM Ixil Ialoncy on pago 624 for moro informalion.
- -
- -
Chapter 24: Express-Specific Configuration Registers
915
- Iiguro 24-8 on pago 916 and TabIo 24 - 6 on
pago 916 provido a doscriplion of oacl bil fioId in llis rogislor.
17:15 RO . Indicalos llo I1 oxil Ialoncy for llo IinI (i.o., llo
Iongll of limo llis Iorl roquiros lo compIolo a lransilion from I1 lo
I0).
- 000b = Ioss llan 1s
- 001b = 1s lo Ioss llan 2s
- 010b = 2s lo Ioss llan 4s
- 011b = 4s lo Ioss llan 8s
- 100b = 8s lo Ioss llan 16s
- 101b = 16s lo Ioss llan 32s
- 110b = 32s-64s
- 111b = Moro llan 64s
: Ixil Ialoncios may bo infIuoncod by a porls roforonco cIocI
configuralion (i.o., vlollor llo porl usos llo roforonco cIocI sup-
pIiod by llo porl al llo romolo ond of llo IinI or il providos il ovn
IocaI roforonco cIocI). Rofor lo ASIM Ixil Ialoncy on pago 624
for moro informalion.
31:24 HWInil . Indicalos llo Iorl numbor associalod vill llis IinI.
Tlo porl numbor is assignod by llo lardvaro dosignor.
- -
- -
PCI Express System Architecture
916
-
-
- -
1:0 RW . ConlroIs llo
IovoI of ASIM supporlod on llo IinI.
- 00b = -
- 01b = - . Indicalos llo Transmillor onloring I0s
is supporlod. Tlo Rocoivor musl bo capabIo of onloring I0s ovon
vlon llis fioId is disabIod (00b).
- 10b =
- 11b = -
DofauIl vaIuo of llis fioId is 00b or 01b doponding on form faclor.
Al llo limo of vriling, onIy llo IIoclromoclanicaI spocifiod lad
boon roIoasod. Tlis spocificalion maIos no monlion of llo dofauIl
slalo of llo ASIM bils.
Chapter 24: Express-Specific Configuration Registers
917
3
for
Rool
and
Svilcl
Iorls
for
Ind-
poinls

- -: Hardvirod. Indicalos llo RCB vaIuo for llo Rool
Iorl. Il is a lardvirod, road-onIy vaIuo indicaling llo RCB sup-
porl capabiIilios:
0b = 64 bylo
1b = 128 bylo
- -: Sol by configuralion soflvaro lo indicalo llo RCB
vaIuo of llo Rool Iorl upslroam from llo Indpoinl. Dovicos llal
do nol impIomonl llis foaluro musl lardviro llo fioId lo 0b.
0b = 64 bylo
1b = 128 bylo
- -: Rosorvod and lardvirod lo 0b.
4 RW -. 1 = disabIo llo IinI. Rosorvod on Indpoinl dovicos
and Svilcl upslroam porls. Tlo vaIuo vrillon can bo road bacI
immodialoIy, boforo llo IinI las acluaIIy clangod slalo.
DofauIl vaIuo of llis bil is 0b.
5 RW .
- 1 = inilialo IinI rolraining by clanging llo IlysicaI Iayor
ITSSM lo llo Rocovory slalo.
- Roads of llis bil aIvays rolurn 0b.
- Rosorvod on Indpoinl dovicos and Svilcl upslroam porls.
Soo IinI Irrors on pago 379 for moro informalion.
6 RW .
- 1 indicalos llal llis compononl and llo compononl al llo oppo-
silo ond of llis IinI aro using a common roforonco cIocI.
- 0 indicalos llal llis compononl and llo compononl al llo oppo-
silo ond of llis IinI aro using soparalo roforonco cIocIs.
- A compononl faclors llis bil solling inlo ils caIcuIalion of llo I0s
and I1 Ixil Ialoncios (soo TabIo 24 - 5 on pago 913) llal il roporls
in llo IinI CapabiIilios rogislor.
- Aflor clanging llis bil in a compononl on oillor ond of a IinI,
soflvaro musl lriggor llo IinI lo rolrain by solling llo Rolrain
IinI bil lo ono in llis rogislor.
- DofauIl vaIuo of llis fioId is 0b.
Soo ASIM Ixil Ialoncy on pago 624 for moro informalion.
-
- -
PCI Express System Architecture
918
- - Iiguro 24-9 on pago 918 and TabIo 24 - 7 on
pago 919 provido a doscriplion of oacl bil fioId in llis rogislor.
7 RW . Wlon sol lo ono, llis bil forcos llo lransmission of:
- 4096 ITS Ordorod Sols during llo I0s slalo
- foIIovod by a singIo SKI ordorod sol prior lo onloring llo I0
slalo,
- as voII as llo lransmission of 1024 TS1 Ordorod Sols in llo I1
slalo prior lo onloring llo Rocovory slalo.
Tlis modo givos oxlornaI dovicos (o.g., Iogic anaIyzors) llal may bo
moniloring IinI aclivily limo lo acliovo bil and symboI IocI boforo
llo IinI onlors llo I0 or Rocovory slalo and rosumos communica-
lion. DofauIl vaIuo for llis bil is 0b.
Soo I0s Slalo on pago 611 for moro informalion.
- -
-
- -
Chapter 24: Express-Specific Configuration Registers
919
- -
- -
3:0 RO . Tlo nogolialod IinI spood.
- 0001b = 2.5 Gb/s
AII ollor oncodings aro rosorvod.
9:4 RO . Tlo nogolialod IinI vidll.
- 000001b = x1
- 000010b = x2
- 000100b = x4
- 001000b = x8
- 001100b = x12
- 010000b = x16
- 100000b = x32
- AII ollor oncodings aro rosorvod.
Soo Nogolialo IinI Widll|9:4] on pago 551 for moro informalion.
10 RO . 1 = indicalos llal a IinI lraining orror occurrod.
Rosorvod on Indpoinl dovicos and Svilcl upslroam porls. CIoarod
by lardvaro upon succossfuI lraining of llo IinI lo llo I0 IinI
slalo.
Soo IinI Irrors on pago 379 for moro informalion.
11 RO . Wlon sol lo ono, indicalos llal IinI lraining is in
progross (IlysicaI Iayor ITSSM is in llo Configuralion or Rocov-
ory slalo) or llal llo Rolrain IinI bil vas sol lo ono bul IinI lrain-
ing las nol yol bogun.
- Hardvaro cIoars llis bil onco IinI lraining is compIolo.
- Tlis bil is nol appIicabIo and rosorvod on Indpoinl dovicos and
llo Upslroam Iorls of Svilclos.
Soo IinI Irrors on pago 379 for moro informalion.
12 HWInil . Tlis bil indicalos llal llo compononl
usos llo samo plysicaI roforonco cIocI llal llo pIalform providos
on llo connoclor. If llo dovico usos an indopondonl cIocI irrospoc-
livo of llo prosonco of a roforonco on llo connoclor, llis bil musl bo
cIoar.
Soo Config. Rogislors Usod for ASIM Ixil Ialoncy Managomonl
and Roporling on pago 628 for moro informalion.
PCI Express System Architecture
920
SIot Registers
Introduction
Tlo sIol-spocific rogislor sol musl bo impIomonlod for Rool Iorl bridgos and
Svilcl dovnslroam porl bridgos llal aro connoclod lo add-in sIol connoclors.
Tlo rogislors aro:
- SIol CapabiIilios Rogislor
- SIol ConlroI Rogislor
- SIol Slalus Rogislor
Tloy aro doscribod in llo soclions llal foIIov.
SIot CapabiIities Register
Iiguro 24-10 on pago 921 and TabIo 24 - 8 on pago 921 provido a doscriplion of
oacl bil fioId in llis rogislor.
Chapter 24: Express-Specific Configuration Registers
921
- -
- - -
- -
0 -. 1 = Allonlion Bullon is impIomonlod on llo classis
for llis sIol.
1 -. 1 = A Iovor ConlroIIor is impIomonlod for llis
sIol.
2 - -. 1 = An MRI
Sonsor is impIomonlod on llo classis for llis sIol.
3 -. 1 = An Allonlion Indicalor is impIomonlod on
llo classis for llis sIol.
PCI Express System Architecture
922
4 -. 1 = A Iovor Indicalor is impIomonlod on llo clas-
sis for llis sIol.
5 -. 1 = A dovico inslaIIod in llis sIol may bo romovod from
llo syslom villoul any prior nolificalion.
6 . 1 = Tlis sIol supporls Hol-IIug oporalions.
14:7 . In combinalion vill llo SIol Iovor Iimil ScaIo
vaIuo (soo llo noxl rov in llis labIo), spocifios llo max povor (in Walls) avaiI-
abIo lo llo dovico inslaIIod in llis sIol.
-
.
- Tlis fioId musl bo impIomonlod if llo SIol ImpIomonlod bil is sol lo ono in
llo ICI Ixpross CapabiIilios Rogislor (soo ICI Ixpross CapabiIilios Rogis-
lor on pago 898).
- A vrilo lo llis fioId causos llo Iorl lo sond llo Sol SIol Iovor Iimil Mos-
sago upslroam lo llo porl al llo ollor ond of llo IinI.
- Tlo dofauIl vaIuo prior lo lardvaro/firmvaro iniliaIizalion is 0000 0000b.
Soo Tlo Iovor Budgol CapabiIilios Rogislor Sol on pago 564 for moro infor-
malion.
16:15 . Soo llo doscriplion in llo provious rov of llis labIo.
- IossibIo vaIuos:
00b = 1.0x
01b = 0.1x
10b = 0.01x
11b = 0.001x
- Tlis fioId musl bo impIomonlod if llo SIol ImpIomonlod bil is sol lo ono in
llo ICI Ixpross CapabiIilios Rogislor (soo ICI Ixpross CapabiIilios Rogis-
lor on pago 898).
- A vrilo lo llis fioId causos llo Iorl lo sond llo Sol SIol Iovor Iimil Mos-
sago upslroam lo llo porl al llo ollor ond of llo IinI.
- Tlo dofauIl vaIuo prior lo lardvaro/firmvaro iniliaIizalion is 00b.
- - -
- -
Chapter 24: Express-Specific Configuration Registers
923
SIot ControI Register
Iiguro 24-11 on pago 923 and TabIo 24 - 9 on pago 924 provido a doscriplion of
oacl bil fioId in llis rogislor.
31:19 - . Indicalos llo plysicaI sIol numbor allaclod lo llis
Iorl. Musl bo lardvaro iniliaIizod lo a vaIuo llal assigns a sIol numbor llal is
gIobaIIy uniquo villin llo classis. Musl bo iniliaIizod lo 0 for Iorls con-
noclod lo dovicos llal aro oillor inlogralod on llo syslom board or inlogralod
villin llo samo siIicon as llo Svilcl dovnslroam porl or llo Rool Iorl.
Soo Classis and SIol Numbor Assignmonl on pago 861 for moro informa-
lion.
-
- - -
- -
PCI Express System Architecture
924
- -
- -
0 -- . Wlon sol lo ono, onabIos llo gonoralion of
a Hol-IIug inlorrupl or a vaIoup ovonl vlon llo allonlion bullon is prossod.
DofauIl vaIuo of llis fioId is 0. Soo Allonlion Bullon on pago 667 for moro
informalion.
1 . Wlon sol lo ono, onabIos llo gonoralion of a
Hol-IIug inlorrupl or a vaIoup ovonl on a povor fauIl ovonl. DofauIl vaIuo
of llis fioId is 0.
2 - . Wlon sol lo ono, onabIos llo gonoralion of a
Hol-IIug inlorrupl or a vaIoup ovonl on an MRI sonsor clangod ovonl.
DofauIl vaIuo of llis fioId is 0.
Soo IIoclromoclanicaI InlorIocI (oplionaI) on pago 667 for moro informa-
lion.
3 - . Wlon sol lo ono, onabIos llo gonoralion of
a Hol-IIug inlorrupl or a vaIoup ovonl on a prosonco dolocl clangod ovonl.
DofauIl vaIuo of llis fioId is 0.
Soo SIol Slalus and Ivonls Managomonl on pago 674 for moro informalion.
4 . Wlon sol lo ono, onabIos llo gonor-
alion of a Hol-IIug inlorrupl vlon a command is compIolod by llo Hol-IIug
ConlroIIor.
DofauIl vaIuo of llis fioId is 0.
5 . Wlon sol lo ono, onabIos llo gonoralion of a Hol-
IIug inlorrupl on onabIod Hol-IIug ovonls.
DofauIl vaIuo of llis fioId is 0.
7:6 . A road from llis fioId rolurns llo curronl slalo of
llo Allonlion Indicalor, vliIo a vrilo sols llo Allonlion Indicalor lo llo slalo
indicalod boIov:
- 00b = Rosorvod
- 01b = On
- 10b = BIinI
- 11b = Off
Wrilos lo llis fioId aIso causo llo Iorl lo sond llo rospoclivo Allonlion Indica-
lor mossago.
Chapter 24: Express-Specific Configuration Registers
925
SIot Status Register
Iiguro 24-12 on pago 925 and TabIo 24 - 10 on pago 926 provido a doscriplion of
oacl bil fioId in llis rogislor.
9:8 . A road from llis fioId rolurns llo curronl slalo of
llo Iovor Indicalor, vliIo a vrilo sols llo Iovor Indicalor lo llo slalo indi-
calod boIov:
- 00b = Rosorvod
- 01b = On
- 10b = BIinI
- 11b = Off
Wrilos lo llis fioId aIso causo llo Iorl lo sond llo rospoclivo Iovor Indicalor
mossago.
10 . A road from llis fioId rolurns llo curronl slalo of
llo povor appIiod lo llo sIol, vliIo a vrilo sols llo povor slalo of llo sIol lo
llo slalo indicalod boIov:
- 0b = Iovor On
- 1b = Iovor Off
- -
- -
- -
PCI Express System Architecture
926
Root Port Registers
Introduction
AII Rool Iorls musl impIomonl llo Rool ConlroI and Rool Slalus rogislors. Tlo
foIIoving lvo soclions provido a dolaiIod doscriplion of lloso lvo rogislors.
Root ControI Register
Iiguro 24-13 on pago 927 and TabIo 24 - 11 on pago 927 provido a doscriplion of
oacl bil fioId in llis rogislor.
- -
- -
0 RW1C --. 1 = allonlion bullon prossod.
1 RW1C . 1 = Iovor ConlroIIor doloclod a povor fauIl
al llis sIol.
2 RW1C - . 1 = MRI Sonsor slalo clango doloclod.
3 RW1C - . 1 = Irosonco Dolocl clango doloclod.
4 RW1C . 1 = Hol-IIug ConlroIIor compIolod a com-
mand.
5 RO - . MRI sonsor slalus (if MRI impIomonlod).
- 0b = MRI CIosod
- 1b = MRI Opon
6 RO - . Wlon sol lo ono, a card is prosonl in llo sIol
(as indicalod oillor by an in-band moclanism or via llo Irosonco
Dolocl pins as dofinod in llo ICI Ixpross Card IIoclromoclanicaI
Spocificalion).
- 0b = SIol Imply
- 1b = Card Irosonl in sIol
Tlis fioId musl bo impIomonlod on aII Svilcl dovnslroam porls
and on Rool Iorls llal aro allaclod lo an add-in connoclor. Il is
lardvirod lo ono if llo porl is nol connoclod lo an add-in sIol con-
noclor.
Chapter 24: Express-Specific Configuration Registers
927
-
- -
- -
0 - . Wlon sol lo ono, a Syslom Irror is
gonoralod if a corroclabIo orror (IRR_COR) is roporlod by any of llo cliId
(i.o., dovnslroam) dovicos associalod vill llis Rool Iorl, or by llo Rool Iorl
ilsoIf. Tlo moclanism for signaIing a Syslom Irror lo llo syslom is syslom-
spocific (o.g., in an x86-basod syslom, a Non-MasIabIo InlorruplNMI
couId bo gonoralod lo llo procossor).
DofauIl vaIuo of llis bil is 0.
Soo Roporling Irrors lo llo Hosl Syslom on pago 392 for moro informalion.
1 - . Wlon sol lo ono, a Syslom Irror is
gonoralod if a non-falaI orror (IRR_NONIATAI) is roporlod by any of llo
cliId (i.o., dovnslroam) dovicos associalod vill llis Rool Iorl, or by llo Rool
Iorl ilsoIf. Tlo moclanism for signaIing a Syslom Irror lo llo syslom is sys-
lom-spocific (o.g., in an x86-basod syslom, a Non-MasIabIo InlorruplNMI
couId bo gonoralod lo llo procossor).
DofauIl vaIuo of llis bil is 0.
Soo Roporling Irrors lo llo Hosl Syslom on pago 392 for moro informalion.
PCI Express System Architecture
928
Root Status Register
Iiguro 24-14 on pago 928 and TabIo 24 - 12 on pago 929 provido a doscriplion of
oacl bil fioId in llis rogislor.
2 - . Wlon sol lo ono, a Syslom Irror is gonor-
alod if a IalaI orror (IRR_IATAI) is roporlod by any of llo cliId (i.o., dovn-
slroam) dovicos associalod vill llis Rool Iorl, or by llo Rool Iorl ilsoIf. Tlo
moclanism for signaIing a Syslom Irror lo llo syslom is syslom-spocific (o.g.,
in an x86-basod syslom, a Non-MasIabIo InlorruplNMIcouId bo gonor-
alod lo llo procossor).
DofauIl vaIuo of llis fioId is 0.
Soo Roporling Irrors lo llo Hosl Syslom on pago 392 for moro informalion.
3 . Wlon sol lo ono, onabIos inlorrupl gonoralion on
rocoipl of a IMI Mossago from a cliId (i.o., dovnslroam) dovico (vlicl sols
llo IMI Slalus bil in llo Rool Slalus rogislorsoo Rool Slalus Rogislor on
pago 928lo ono).
A IMI inlorrupl is aIso gonoralod vlon soflvaro sols llis bil lo ono (assum-
ing il vas originaIIy cIoarod lo zoro) vlon llo IMI Slalus bil in llo Rool Sla-
lus rogislor is sol lo ono.
DofauIl vaIuo of llis fioId is 0.
Soo Tlo IMI Soquonco on pago 640 for moro informalion.
- -
- -
- -
Chapter 24: Express-Specific Configuration Registers
929
PCI Express Extended CapabiIities
GeneraI
A ICI Ixpross funclion may oplionaIIy impIomonl any, aII, or nono of llo foI-
Ioving Ixlondod CapabiIily rogislor sols:
- Advancod Irror Roporling CapabiIily rogislor sol.
- VirluaI ClannoI (VC) CapabiIily rogislor sol.
- Dovico SoriaI Numbor CapabiIily rogislor sol.
- Iovor Budgoling CapabiIily rogislor sol.
Rofor lo Iiguro 24-1 on pago 895. Tlo firsl oxlondod capabiIily rogislor sol musl
bo impIomonlod al offsol 100l in a funclions 4KB configuralion spaco and ils
Inlancod CapabiIily Hoador rogislor (soo Iiguro 24-15 on pago 930) conlains a
poinlor (llo Noxl CapabiIily Offsol fioId, llis 12-bil fioId musl conlain oillor llo
dvord-aIignod slarl addross of llo noxl capabiIily rogislor sol, or a vaIuo of zoro
if llis is llo Iasl of llo oxlondod capabiIily rogislor sols) lo llo noxl oxlondod
capabiIily rogislor sol in llo Iisl. Tlo rospoclivo capabiIily IDs of oacl rogislor sol
aro:
- Advancod Irror Roporling CapabiIily rogislor sol. ID = 0001l.
- VirluaI ClannoI (VC) CapabiIily rogislor sol. ID = 0002l.
- -
- -
15:0 RO - . Conlains llo Roquoslor ID of llo Iasl cliId (i.o.,
dovnslroam) dovico lo issuo a IMI.
16 RW1C -. Wlon sol lo ono, indicalos llal IMI vas assorlod by
llo Roquoslor indicalod in llo IMI Roquoslor ID fioId. Subsoquonl
IMIs romain ponding unliI llis bil is cIoarod by soflvaro by vril-
ing a 1 lo il.
17 RO . Wlon sol lo ono and llo IMI Slalus bil is sol, indi-
calos llal anollor IMI is ponding. Wlon llo IMI Slalus bil is
cIoarod by soflvaro, llo Rool Iorl lardvaro indicalos llo doIivory
of llo noxl IMI by solling llo IMI Slalus bil again and updaling
llo Roquoslor ID fioId approprialoIy. Tlo IMI Ionding bil is
cIoarod by lardvaro vlon no moro IMIs aro ponding.
PCI Express System Architecture
930
- Dovico SoriaI Numbor CapabiIily rogislor sol. ID = 0003l.
- Iovor Budgoling CapabiIily rogislor sol. ID = 0004l.
Tlo CapabiIily Vorsion fioId is assignod by llo SIG and dofinos llo Iayoul of llo
rogislor sol. Il musl bo 1l for aII of llo oxlondod capabiIilios curronlIy dofinod.
Advanced Error Reporting CapabiIity
GeneraI
Iiguro 24-16 on pago 931 iIIuslralos llo oplionaI Advancod Irror Roporling
capabiIily rogislor sol. Nolo llal llo rogislors in llo Iasl llroo dvords of llis rog-
islor sol may onIy bo impIomonlod for a Rool Iorl funclion (ono llal las a vaIuo
of 0100b in llo Dovico/Iorl Typo fioId of llo ICI Ixpross CapabiIilios rogislor in
llo funclion's ICI-compalibIo configuralion spaco). Tlis capabiIily rogislor sol
consisls of llo rogislors piclurod in Iiguro 24-16 on pago 931 and doscribod in
TabIo 24 - 13 on pago 932.
DetaiIed Description
Ior a dolaiIod doscriplion of llo Advancod Irror Roporling capabiIily rogislor
sol, rofor lo Advancod Irror Roporling Moclanisms on pago 382.
-
Chapter 24: Express-Specific Configuration Registers
931
-
PCI Express System Architecture
932
-
- - -
NA Inlancod
CapabiIily
Hoador
CapabiIily ID = 0001l. Tlo CapabiIily Vorsion fioId
in llis rogislor is assignod by llo SIG and dofinos
llo Iayoul of llo rogislor sol. Il musl bo 1l for aII of
llo oxlondod capabiIilios curronlIy dofinod. Soo
Iiguro 24-17 on pago 935.
NA CapabiIilios
and ConlroI
Rogislor
Conlains llo foIIoving bils fioIds:
- - . Road-onIy. Idonlifios llo bil
posilion of llo firsl orror roporlod in llo Uncor-
roclabIo Irror Slalus rogislor (soo Iiguro 24-23 on
pago 937).
- . Road-onIy. 1 indi-
calos llal llo funclion is capabIo of gonoraling
ICRC (Ind-lo-Ind CRC, rofor lo ICRC Gonor-
alion and ClocIing on pago 361).
- . Road/vrilo slicIy
bil. Wlon sol lo ono, onabIos ICRC gonoralion.
DofauIl = 0.
- . Road-onIy. 1 indicalos
llal llo funclion is capabIo of clocIing ICRC.
- . Road/vrilo slicIy bil.
Wlon sol lo ono, onabIos ICRC clocIing.
DofauIl = 0.
Soo Iiguro 24-18 on pago 935.
CorroclabIo
Irror Rogislors
CorroclabIo
Irror MasI
Rogislor
ConlroIs llo roporling of individuaI corroclabIo
orrors by llo funclion lo llo Rool CompIox via a
ICI Ixpross orror mossago. A masIod orror
(rospoclivo bil sol lo ono) is nol roporlod lo llo
Rool CompIox by llo funclion. Tlis rogislor con-
lains a masI bil for oacl corrosponding orror bil in
llo CorroclabIo Irror Slalus rogislor (soo llo noxl
rov in llis labIo and Iiguro 24-19 on pago 935).
CorroclabIo
Irror Slalus
Rogislor
Roporls llo orror slalus of llo funclions corrocl-
abIo orror sourcos. Soflvaro cIoars a sol bil by vril-
ing a 1 lo llo rospoclivo bil. Soo Iiguro 24-20 on
pago 936.
Chapter 24: Express-Specific Configuration Registers
933
UncorroclabIo
Irror Rogislors
UncorroclabIo
Irror MasI
Rogislor
ConlroIs llo funclions roporling of orrors lo llo
Rool CompIox via a ICI Ixpross orror mossago. A
masIod orror (rospoclivo bil sol lo 1b):
- is nol Ioggod in llo Hoador Iog rogislor (soo Iig-
uro 24-16 on pago 931),
- doos nol updalo llo Iirsl Irror Ioinlor (soo llo
doscriplion of llo CapabiIilios and ConlroI Rog-
islor in llis labIo), and
- is nol roporlod lo llo Rool CompIox.
Tlis rogislor (soo Iiguro 24-21 on pago 936)conlains
a masI bil for oacl corrosponding orror bil in llo
UncorroclabIo Irror Slalus rogislor.
UncorroclabIo
Irror Sovorily
Rogislor
Iacl rospoclivo bil conlroIs vlollor an orror is
roporlod lo llo Rool CompIox via a non-falaI or
falaI orror mossago. An orror is roporlod as falaI if
llo corrosponding bil is sol lo ono. Soo Iiguro 24-22
on pago 937.
UncorroclabIo
Irror Slalus
Rogislor
Roporls llo orror slalus of llo funclions uncorrocl-
abIo orror sourcos. Soo Iiguro 24-23 on pago 937.
-
- - -
PCI Express System Architecture
934
Rool Irror
Rogislors
Rool Irror
Command
Rogislor
ConlroIs llo Rool CompIoxs abiIily lo gonoralo an
inlorrupl lo llo procossor upon rocoipl of:
- a corroclabIo orror mossago,
- a non-falaI orror mossago, or
- a falaI orror mossago
from a cliId funclion dovnslroam of llo Rool Iorl.
Soo Iiguro 24-24 on pago 938.
Rool Irror Sla-
lus Rogislor
TracIs llo Rool Iorls rocoipl of orror mossagos
rocoivod by llo Rool CompIox from a cliId func-
lion dovnslroam of llo Rool Iorl, and of orrors
doloclod by llo Rool Iorl ilsoIf. Non-falaI and falaI
orror mossagos aro groupod logollor as uncorrocl-
abIo. Tloro is a firsl orror bil and a noxl orror bil
associalod vill corroclabIo and uncorroclabIo
orrors, rospoclivoIy. Wlon an orror is rocoivod by a
Rool Iorl, llo rospoclivo firsl orror bil is sol and llo
Roquoslor ID is Ioggod in llo Irror Sourco Idonlifi-
calion rogislor. If soflvaro doos nol cIoar llo firsl
roporlod orror boforo anollor orror mossago is
rocoivod of llo samo calogory (corroclabIo or
uncorroclabIo), llo corrosponding noxl orror slalus
bil viII bo sol, bul llo Roquoslor ID of llo subso-
quonl orror mossago is discardod. Updalod rogard-
Ioss of llo sollings in llo Rool ConlroI and llo Rool
Irror Command rogislors. Soo Iiguro 24-25 on pago
938.
UncorroclabIo
Irror Sourco
ID Rogislor
Idonlifios llo sourco (Roquoslor ID) of llo firsl
uncorroclabIo (non-falaI/falaI) orror roporlod in
llo Rool Irror Slalus rogislor. Updalod rogardIoss
of llo sollings in llo Rool ConlroI and llo Rool
Irror Command rogislors. Soo Iiguro 24-26 on pago
938.
CorroclabIo
Irror Sourco
ID Rogislor
Idonlifios llo sourco (Roquoslor ID) of llo firsl cor-
roclabIo orror roporlod in llo Rool Irror Slalus rog-
islor. Updalod rogardIoss of llo sollings in llo Rool
ConlroI and llo Rool Irror Command rogislors.
Soo Iiguro 24-26 on pago 938.
-
- - -
Chapter 24: Express-Specific Configuration Registers
935

- -
- -
PCI Express System Architecture
936
- -
- -
Chapter 24: Express-Specific Configuration Registers
937
-
- -
PCI Express System Architecture
938
-
- -
--
Chapter 24: Express-Specific Configuration Registers
939
VirtuaI ChanneI CapabiIity
The VC Register Sets Purpose
Tlis rogislor sol sorvos sovoraI purposos:
- In a porl llal impIomonls muIlipIo VC buffors, il pormils llo configuralion
of llo TC-lo-VC mapping.
- Soo Iiguro 24-27 on pago 939. In an ogross porl llal impIomonls muIlipIo
VC buffors, il pormils llo configuralion of llo arbilralion sclomo llal
dofinos llo ordor in vlicl oacl VC accopls pacIols from llo various sourco
ingross porls villin llo dovico. Tlis is roforrod lo as llo VCs porl arbilra-
lion sclomo.
- Soo Iiguro 24-27 on pago 939. In an ogross porl llal impIomonls muIlipIo
VC buffors, il pormils llo configuralion of llo arbilralion sclomo llal
dofinos llo ordor in vlicl llo ogross porl accopls pacIols from ils VC buff-
ors for lransmil onlo llo IinI. Tlis is roforrod lo as llo porls VC arbilralion
sclomo.
- In a porl llal onIy impIomonls a singIo VC (VC0), llo configuralion sofl-
varo may spocify llal onIy pacIols vill corlain TCs bo accoplod inlo llo
VC0 buffor for lransfor. Tlis is roforrod lo as TC fiIloring.

PCI Express System Architecture
940
Who Must ImpIement This Register Set?
Tlo foIIoving funclions musl impIomonl llis oplionaI rogislor sol:
- A funclion (i.o., a porl) llal onIy impIomonls VC0 bul pormils llo configu-
ralion soflvaro lo spocify llal onIy pacIols vill corlain TCs may bo pIacod
in llo VC0 buffor for lransfor.
- A funclion llal impIomonls VCs in addilion lo VC0.
Tlis appIios lo Indpoinl dovicos, upslroam and dovnslroam Svilcl porls, Rool
Iorls, and RCRBs.
MuItifunction Upstream Port Restriction
Tlo spoc conlains llo foIIoving slalomonl:
Tlo ICI Ixpross VirluaI ClannoI CapabiIily slrucluro can bo prosonl in llo
Ixlondod Configuralion Spaco of aII dovicos or in RCRB vill llo roslriclion llal
il is onIy prosonl in llo Ixlondod Configuralion Spaco of Iunclion 0 for muIli-
funclion dovicos al lloir Upslroam Iorls.
Tlo aullors laIo llis lo moan llal if llo upslroam porl of a dovico is impIo-
monlod as a muIlifunclion dovico (soo Iiguro 21-11 on pago 761) and llal porl
mools llo criloria spocifiod in Wlo Musl ImpIomonl Tlis Rogislor Sol` on
pago 940, llis capabiIily rogislor sol is onIy impIomonlod in llo Ixlondod Con-
figuralion Spaco of funclion 0 of llal dovico.
The Register Set
Iiguro 24-28 on pago 941 iIIuslralos llo VC CapabiIily rogislor sol and Iiguro 24-
29 on pago 941 iIIuslralos llo dolaiI of ils Inlancod CapabiIily Hoador rogislor.
DetaiIed Description of VCs
Ior a dolaiIod doscriplion of VCs, rofor lo Claplor 6, onlilIod "QoS/TCs/VCs
and Arbilralion," on pago 251.
Chapter 24: Express-Specific Configuration Registers
941
Port VC CapabiIity Register 1
Tlo rogislor is iIIuslralod in Iiguro 24-30 on pago 942 and oacl bil fioId is
doscribod in TabIo 24 - 14 on pago 942.
-

PCI Express System Architecture
942
-
-
- -
2:0 . Tlo numbor of addilionaI VCs supporlod by llo
dovico.
- 0 = jusl VC0 is supporlod.
- Tlo maximum vaIuo is 7.
6:4 . Indicalos llo numbor of VCs (slarling
vill VC0) llal compriso llo Iov-Iriorily VC (IIVC) group.
- . Tloro is and llo soquonco in vlicl llo porls VC buff-
ors lransfor is govornod by llo fixod-priorily sclomo vloroin VC0 las
llo Iovosl priorily and llo liglosl-numborod VC llal is impIomonlod
las llo liglosl priorily.
- VCs 0-llrougl- aro mombors of llo IIVC group.
Tlo vaIuo spocifiod cannol bo groalor llan llal spocifiod in llo Ixlondod
VC Counl fioId of llis rogislor.
Tlo VCs abovo aro mombors of llo ligl-priorily group vloro
VC+1 las llo Iovosl priorily and llo liglosl VC las llo liglosl pri-
orily.
ConlroI passos lo llo IIVC group onIy vlon llo VCs in llo uppor
group lavo no pacIols lo lransfor. Tlo priorily sclomo usod among
llo VCs llal aro mombors of llo Iovor group is govornod by llo VC
Arbilralion CapabiIily fioId in Iorl VC CapabiIily Rogislor 2 (soo
Iorl VC CapabiIily Rogislor 2 on pago 943).
Chapter 24: Express-Specific Configuration Registers
943
Port VC CapabiIity Register 2
Tlo rogislor is iIIuslralod in Iiguro 24-31 on pago 943 and oacl bil fioId is
doscribod in TabIo 24 - 15 on pago 944.
9:8 . Tlo roforonco cIocI for VCs llal supporl limo-basod
WRR Iorl Arbilralion. Tlis fioId is vaIid for RCRB and for Svilcl Iorls and
is nol vaIid for Rool Iorls and Indpoinl dovicos (musl bo lardvirod lo 0).
- 00b = 100ns roforonco cIocI.
- 01b 11b aro rosorvod.
11:10 . Indicalos llo sizo (in bils) of oacl onlry
in llo dovicos Iorl Arbilralion labIo. Tlis fioId is vaIid onIy for an RCRB
and for any Svilcl Iorl. Il is lardvirod lo 0 for Indpoinl dovicos and Rool
Iorls.
- 00b Tlo sizo of oacl Iorl Arbilralion labIo onlry is 1 bil.
- 01b Tlo sizo of oacl Iorl Arbilralion labIo onlry is 2 bils.
- 10b Tlo sizo of oacl Iorl Arbilralion labIo onlry is 4 bils.
- 11b Tlo sizo of oacl Iorl Arbilralion labIo onlry is 8 bils.
-
-
- -
PCI Express System Architecture
944
Port VC ControI Register
Tlo rogislor is iIIuslralod in Iiguro 24-32 on pago 944 and oacl bil fioId is
doscribod in TabIo 24 - 16 on pago 945.
-
- -
7:0 . Tlis bil masI indicalos llo arbilralion
sclomo(s) supporlod by llo dovico for llo IIVC group. Il is vaIid for aII
dovicos llal roporl a Iov Iriorily Ixlondod VC Counl groalor llan 0 (soo
llo doscriplion in TabIo 24 - 14 on pago 942). Iacl bil corrosponds lo an
arbilralion sclomo dofinod boIov. Wlon moro llan ono bil is sol, il indi-
calos llal llo Iorl can bo configurod lo provido difforonl VC arbilralion sor-
vicos.
- Bil 0: Hardvirod, fixod arbilralion sclomo (o.g., Round Robin).
- Bil 1: Woigllod Round Robin (WRR) arbilralion vill 32 plasos.
- Bil 2: WRR arbilralion vill 64 plasos.
- Bil 3: WRR arbilralion vill 128 plasos.
- Bils 4-7: Rosorvod.
Tlo dosirod arbilralion sclomo is soIoclod via llo VC Arbilralion SoIocl
fioId in llo Iorl VC ConlroI Rogislor (soo TabIo 24 - 16 on pago 945).
31:24 -. Indicalos llo Iocalion of llo VC Arbilralion
TabIo vill roforonco lo llo slarl of llo VC capabiIily rogislor sol (spocifiod
in incromonls of dqvords16 bylos). A vaIuo of 0 indicalos llal llo labIo is
nol prosonl.
-
Chapter 24: Express-Specific Configuration Registers
945
Port VC Status Register
Tlo rogislor is iIIuslralod in Iiguro 24-33 on pago 946 and oacl bil fioId is
doscribod in TabIo 24 - 17 on pago 946.
-
- -
0 . In ordor lo aclivalo a porls VC Arbilralion
TabIo, llo configuralion soflvaro laIos llo foIIoving slops:
1. Wlon soflvaro iniliaIIy programs llo VC Arbilralion TabIo, or vlon any
clango is subsoquonlIy mado lo any onlry in llo labIo, llo VC Arbilra-
lion TabIo Slalus bil in llo Iorl VC Slalus rogislor is aulomalicaIIy sol lo
ono by lardvaro.
2. Soflvaro llon sols llo Ioad VC Arbilralion TabIo bil lo ono, causing llo
porl lo road llo VC Arbilralion TabIo from llo capabiIily rogislor sol and
appIy il.
3. Wlon llo porl lardvaro las compIolod roading and appIying llo
updalod labIo, il aulomalicaIIy cIoars llo VC Arbilralion TabIo Slalus bil
in llo Iorl VC Slalus rogislor.
4. Soflvaro can dolormino if llo updalod labIo las boon appIiod by roading
llo slalo of llo VC Arbilralion TabIo Slalus bil in llo Iorl VC Slalus rog-
islor.
0 indicalos llo updalod labIo las boon road and appIiod.
1 indicalos llal llo updalo is nol yol compIolo.
Tlis bil is vaIid for a dovico vlon llo soIoclod VC Arbilralion lypo (soo llo
noxl rov in llis labIo) usos llo VC Arbilralion TabIo. CIoaring llis bil las
no offocl. Tlis bil aIvays rolurns 0 vlon road.
3:1 Tlo configuralion soflvaro soIocls ono of llo sup-
porlod IIVC arbilralion sclomos by solling il lo llo BCD vaIuo of llo bil
corrosponding lo llo dosirod sclomo (soo llo doscriplion of bils 7:0 in
TabIo 24 - 15 on pago 944). Tlo configuralion soflvaro musl soIocl llo arbi-
lralion sclomo prior lo onabIing moro llan ono VC in llo IIVC group.
PCI Express System Architecture
946
VC Resource Registers
Al a minimum, oacl porl impIomonls a singIo VC, VC0, and il
may oplionaIIy impIomonl up lo oigll VCs, VC0-llrougl-VC7. Ior oacl VC
il supporls, llo porl impIomonls llo foIIoving llroo rogislors:
VC Rosourco CapabiIily rogislor.
VC Rosourco ConlroI rogislor.
VC Rosourco Slalus rogislor.
Tlo foIIoving llroo soclions provido a doscriplion of oacl of lloso rogislors.
Iacl VC impIomonls:
A mandalory TC/VC bil map llal dofinos llo TCs llal slouId bo
accoplod inlo llis VC.
An oplionaI Iorl Arbilralion TabIo llal dofinos llo ordor in vlicl llo
VC accopls pacIols from llo dovico ingross porls llal sourco pacIols lo
il for lransmission.
- - Tlo rogislor is iIIuslralod in Iiguro
24-34 on pago 947 and oacl bil fioId is doscribod in TabIo 24 - 18 on
pago 947.
- -
- -
- -
0 -. Soo llo doscriplion of llo Ioad VC Arbilra-
lion TabIo bil in TabIo 24 - 16 on pago 945.
Chapter 24: Express-Specific Configuration Registers
947
- -
- -
- -
7:0 RO . Tlis bil masI indicalos llo lypos of
Iorl arbilralion (ono or moro) supporlod by llo VC. Il is vaIid for
aII Svilcl Iorls and an RCRB, bul nol for ICI Ixpross Indpoinl
dovicos or Rool Iorls.
Soflvaro soIocls ono of lloso arbilralion sclomos by vriling lo llo
Iorl Arbilralion SoIocl fioId in llo VC Rosourco ConlroI rogislor
(soo VC Rosourco ConlroI Rogislor on pago 948).
- Bil 0. Hardvirod, fixod arbilralion sclomo (o.g., Round Robin).
- Bil 1. Woigllod Round Robin (WRR) arbilralion vill 32 plasos.
- Bil 2. WRR arbilralion vill 64 plasos.
- Bil 3. WRR arbilralion vill 128 plasos.
- Bil 4. Timo-basod WRR vill 128 plasos.
- Bil 5. WRR arbilralion vill 256 plasos.
- Bils 6-7. Rosorvod.
14 RO .
- 1 = Tlis VC onIy supporls lransaclions oplimizod for
Advancod IacIol Svilcling (AS). Tlis bil is vaIid for aII ICI
Ixpross Iorls and RCRB.
- 0 = Tlo VC is capabIo of supporling aII lransaclions dofinod by
llo spoc (incIuding AS lransporl pacIols).
PCI Express System Architecture
948
- - Tlo rogislor is iIIuslralod in Iiguro 24-
35 on pago 948 and oacl bil fioId is doscribod in TabIo 24 - 19 on pago 949.
15 HvInil --.
- 0 = Transaclions vill or villoul llo No Snoop bil sol aro
aIIovod on llis VC.
- 1 = Transaclions vill No Snoop = 0 aro rojoclod as an Unsup-
porlod Roquosl. Tlis bil is vaIid for Rool Iorls and RCRB, bul
nol for Indpoinl dovicos or Svilcl porls.
22:16 HvInil -. Max limo sIols (minus ono) llal llo VC
supporls vlon configurod for limo-basod WRR porl arbilralion.
Tlis fioId is vaIid for aII Svilcl porls, Rool Iorls and an RCRB,
bul nol for Indpoinl dovicos. OnIy vaIid vlon llo Iorl Arbilra-
lion CapabiIily fioId in llis rogislor indicalos llal llo VC supporls
limo-basod WRR porl arbilralion.
31:24 RO -. Indicalos llo Iocalion of llo Iorl
Arbilralion TabIo associalod vill llis VC vill roforonco lo llo
slarl of llo VC capabiIily rogislor sol (spocifiod in incromonls of
dqvords16 bylos). A vaIuo of 0 indicalos llal llo labIo is nol
prosonl. Tlis fioId is vaIid for aII Svilcl porls and an RCRB, bul
nol for Indpoinl dovicos or Rool Iorls.
- -
- -
- -
Chapter 24: Express-Specific Configuration Registers
949
- -
- -
7:0 . TC-lo-VC mapping bil map. Iacl bil villin llis fioId corro-
sponds lo a TC llal is mappod lo llis VC. MuIlipIo bils may bo sol lo ono.

7 1 = TC7 is mappod lo llis VC.
6 1 = TC6 is mappod lo llis VC.
5 1 = TC5 is mappod lo llis VC.
4 1 = TC4 is mappod lo llis VC.
3 1 = TC3 is mappod lo llis VC.
2 1 = TC2 is mappod lo llis VC.
1 1 = TC1 is mappod lo llis VC.
0 1 = TC0 is mappod lo llis VC. Tlis bil is road-onIy. 1 for VC0 and 0 for
aII ollor onabIod VCs.
Boforo romoving ono or moro TCs from llo TC/VC Map of an onabIod VC,
soflvaro musl onsuro llal no nov or oulslanding lransaclions vill lloso TC
IaboIs aro largolod al llo givon IinI.
Tlo dofauIl vaIuo = IIl for VC0 and = 00l for ollor VCs.
16 . In ordor lo aclivalo a VCs Iorl Arbilralion TabIo,
llo configuralion soflvaro laIos llo foIIoving slops:
1. Wlon soflvaro iniliaIIy programs llo VCs Iorl Arbilralion TabIo, or vlon
any clango is subsoquonlIy mado lo any onlry in llo labIo, llo Iorl Arbilra-
lion TabIo Slalus bil in llo VCs VC Rosourco Slalus rogislor (soo VC
Rosourco Slalus Rogislor on pago 950) is aulomalicaIIy sol lo ono.
2. Soflvaro llon sols llo Ioad Iorl Arbilralion TabIo bil lo ono, causing llo VC
lo road llo updalod Iorl Arbilralion TabIo from llo capabiIily rogislor sol
and appIy il.
3. Wlon llo VC lardvaro las compIolod roading and appIying llo updalod
labIo, il aulomalicaIIy cIoars llo Iorl Arbilralion TabIo Slalus bil in ils VC
Rosourco Slalus rogislor.
4. Soflvaro can dolormino if llo updalod labIo las boon appIiod by roading llo
slalo of llo Iorl Arbilralion TabIo Slalus bil in llo VCs VC Slalus rogislor.
0 indicalos llo updalod labIo las boon road and appIiod.
1 indicalos llal llo updalo is nol yol compIolo.
Tlis bil is vaIid for a dovico vlon llo soIoclod Iorl Arbilralion lypo (llo noxl
rov in llis labIo) usos llo Iorl Arbilralion TabIo. CIoaring llis bil las no offocl.
Tlis bil aIvays rolurns 0 vlon road. Tlis bil is vaIid for aII Svilcl Iorls and
an RCRB, bul nol for Indpoinl dovicos or Rool Iorls. Tlis bil aIvays rolurns 0
vlon road and llo dofauIl vaIuo of llis bil is 0.
PCI Express System Architecture
950
- - - Tlo rogislor is iIIuslralod in Iiguro 24-36
on pago 951 and oacl bil fioId is doscribod in TabIo 24 - 20 on pago 951.
19:17 . Tlo configuralion soflvaro soIocls ono of llo sup-
porlod porl arbilralion sclomos by solling il lo llo BCD vaIuo of llo bil corro-
sponding lo llo dosirod sclomo (soo llo doscriplion of bils 7:0 in TabIo 24 - 18
on pago 947). Tlo configuralion soflvaro musl soIocl llo arbilralion sclomo
prior lo onabIing moro llan ono VC in llo IIVC group.
26:24 . Tlis fioId assigns a VC ID (bolvoon 0 and 7) lo llo VC (for VC0, il is
lardvirod lo zoro). Il cannol bo modifiod if llo VC las aIroady boon onabIod.
31 .
- 1 = VC onabIod.
- 0 = VC disabIod.
Tlo slalo of llis bil is quaIifiod by llo slalo of llo VC Nogolialion Ionding bil
(in llo VCs VC Rosourco Slalus rogislor, soo VC Rosourco Slalus Rogislor on
pago 950).
- 0 = nogolialion las boon compIolod (IIov ConlroI iniliaIizalion is com-
pIolod for llo ICI Ixpross Iorl) and llo VC InabIo bil indicalos llo slalo of
llo VC.
- 1 = llo nogolialion procoss las nol yol compIolod and llo slalo of llo VC
InabIo bil lloroforo romains indolorminalo.
Tlis bil is lardvirod lo 1 for VC0. Il is road/vrilo for llo ollor VCs and ils
dofauIl is 0.
To onabIo a VC, ils VC InabIo bil musl bo sol lo ono in llo porls al boll onds of
llo IinI.
To disabIo a VC, ils VC InabIo bil musl bo cIoarod lo zoro in llo porls al boll
onds of llo IinI.
Boforo disabIing a VC, soflvaro musl onsuro llal no lraffic is using llo VC.
Irior lo ro-onabIing a VC, soflvaro musl firsl fuIIy disabIo llo VC in boll com-
pononls on llo IinI.
- -
- -
Chapter 24: Express-Specific Configuration Registers
951
VC Arbitration TabIe
A porl impIomonls a VC Arbilralion TabIo if boll of llo foIIoving aro lruo:
- Tlo Iorl supporls moro llan ono VC.
- Tlo Iorl impIomonls a WRR arbilralion sclomo.
Tlo labIo consisls of a sol of road/vrilo rogislors and is onIy usod if llo configu-
ralion soflvaro soIocls (via llo VC Arbilralion SoIocl fioId in TabIo 24 - 15 on
pago 944) ono of llo impIomonlod WRR VC arbilralion sclomos (soo VC Arbi-
lralion CapabiIily in TabIo 24 - 15 on pago 944).
- - -
- - -
- -
0 -. Soo llo doscriplion of llo Ioad Iorl Arbilra-
lion TabIo bil in TabIo 24 - 19 on pago 949. Tlo dofauIl vaIuo of llis bil is 0.
1 . Indicalos vlollor llo VC nogolialion procoss
(iniliaIizalion or disabIing) is in llo ponding slalo. Wlon llis bil is sol by
lardvaro, il indicalos llal llo VC is sliII in llo procoss of nogolialion. Il is
cIoarod by lardvaro aflor llo VC nogolialion compIolos. Ior VCs ollor llan
VC0, soflvaro usos llis bil lo onabIo or disabIo llo VC. Ior VC0, llis bil
indicalos llo slalus of llo IIov ConlroI iniliaIizalion procoss. Boforo using a
VC, soflvaro musl clocI vlollor llo VC Nogolialion Ionding bil is cIoarod
in llo compononls al boll onds of llo IinI.
PCI Express System Architecture
952
Tlo configuralion soflvaro configuros llo labIo vill llo arbilralion sclomo llal
llo ogross porl Iogic usos lo sorvico llo VC lransmil buffors associalod vill llo
porl. Soo llo doscriplion of llo Ioad VC Arbilralion TabIo bil in TabIo 24 - 16 on
pago 945 for a doscriplion of lov llo labIo is upIoadod inlo llo porls Iogic. Ior
a dolaiIod doscriplion of llo VC Arbilralion TabIo, rofor lo Ioading llo VirluaI
ClannoI Arbilralion TabIo on pago 270.
Port Arbitration TabIes
A VC impIomonls a Iorl Arbilralion TabIo if boll of llo foIIoving aro lruo:
- Tlo Iorl supporls moro llan ono VC.
- Tlo VC impIomonls a WRR arbilralion sclomo.
Tlo labIo consisls of a sol of road/vrilo rogislors and is onIy usod if llo configu-
ralion soflvaro soIocls (via llo Iorl Arbilralion SoIocl fioId in TabIo 24 - 19 on
pago 949) ono of llo impIomonlod WRR Iorl arbilralion sclomos (soo Iorl Arbi-
lralion CapabiIily in TabIo 24 - 18 on pago 947).
Tlo configuralion soflvaro configuros llo labIo vill llo arbilralion sclomo llal
dofinos in vlal ordor llo VC accopls pacIols boing sourcod from llo ingross
porls llal lavo pacIols lo bo passod lo llis VC buffor on llo ogross porl. Soo llo
doscriplion of llo Ioad VC Arbilralion TabIo bil in TabIo 24 - 16 on pago 945 for
a doscriplion of lov llo labIo is upIoadod inlo llo porls Iogic.
Tlis rogislor array is vaIid for aII Svilcl Iorls and RCRBs, bul nol for Indpoinl
dovicos or Rool Iorls. Ior a dolaiIod doscriplion of llo Iorl Arbilralion TabIos,
rofor lo Tlo Iorl Arbilralion Moclanisms on pago 277.
Device SeriaI Number CapabiIity
Tlis oplionaI rogislor sol can bo impIomonlod on any ICI Ixpross dovico in
accordanco vill llo foIIoving ruIos:
- Il consisls of llo Inlancod CapabiIily Hoador piclurod in Iiguro 24-37 on
pago 953 and llo 64-bil SoriaI Numbor rogislor piclurod in Iiguro 24-38 on
pago 953.
- Tlo dovico soriaI numbor is a uniquo, road-onIy 64-bil vaIuo assignod lo llo
dovico vlon il is manufaclurod.
- A muIlifunclion dovico vill llis foaluro onIy impIomonls il on funclion 0
and ollor funclions villin llo dovico musl rolurn llo samo soriaI numbor
vaIuo as llal roporlod by funclion 0.
- Any compononl (o.g., a Svilcl) llal conlains muIlipIo dovicos musl rolurn
Chapter 24: Express-Specific Configuration Registers
953
llo samo soriaI numbor for oacl dovico villin llo compononl.
Tlo soriaI numbor is aIso Inovn as llo IUI-64. Rofor lo Iiguro 24-39 on pago
954. A porlion of llo Ixlondod Uniquo Idonlifior (IUI)-64 is assignod by a rogis-
lralion aullorily oporaling undor llo auspicos of llo IIII organizalion. Tlo
IUI-64 consisls of:
- vaIuo assignod by IIII. Bil 6, llo UnivorsaI/IocaI
scopo bil, is aIvays sol lo ono (UnivorsaI scopo ID, nol assignod lo anylling
oIso in llo univorso) in llo vaIuo assignod by llo IIII.
- - assignod by llo company llal ovns llo assignod
company ID. Tlo inlorprolalion of llo company-assignod oxlonsion is oul-
sido llo scopo of llo spoc. As an oxampIo, il may roprosonl llo dovico ID
and manufacluror-assignod soriaI numbor.

-
PCI Express System Architecture
954
Power Budgeting CapabiIity
GeneraI
Rofor lo Claplor 15, onlilIod "Iovor Budgoling," on pago 557 for a dolaiIod
doscriplion of llo Iovor Budgoling capabiIily.
Tlis oplionaI capabiIily pormils llo pIalform lo proporIy aIIocalo povor lo a
dovico llal is lol-pIuggod inlo llo syslom during runlimo. Using llis rogislor
sol, llo dovico roporls llo foIIoving lo llo pIalform:
- Tlo povor il consumos on a varioly of povor raiIs.
- Tlo povor il consumos in difforonl povor managomonl slalos.
- Tlo povor il consumos undor difforonl oporaling condilions.
Tlo pIalform (i.o., llo syslom and llo OS) usos llis informalion lo onsuro llal
llo syslom can provido llo propor povor and cooIing IovoIs lo llo dovico.
ImpIomonlalion of llis capabiIily rogislor sol (soo Iiguro 24-40 on pago 955) is
oplionaI for dovicos llal aro impIomonlod oillor in a form faclor vlicl doos nol
roquiro lol-pIug supporl, or llal aro inlogralod on llo syslom board. AIllougl
llo spoc slalos llal ICI Ixpross form faclor spocificalions may roquiro supporl
for povor budgoling, il doos nol indicalo any spocific casos vloro llis is
roquirod.
Iiguro 24-40 on pago 955 iIIuslralos llo rogislor sol and Iiguro 24-41 on pago 955
iIIuslralos ils Inlancod CapabiIily Hoador rogislor.

Chapter 24: Express-Specific Configuration Registers
955
How It Works
Tlo povor budgoling dala for llo funclion consisls of a labIo of onlrios slarl-
ing vill onlry 0. Iacl onlry is road by pIacing an indox vaIuo in llo Iovor Bud-
goling Dala SoIocl rogislor (Iiguro 24-40 on pago 955) and llon roading llo
vaIuo rolurnod in llo Iovor Budgoling Dala rogislor (Iiguro 24-42 on pago
956).Tlo ond of labIo is indicalod by a rolurn vaIuo of aII 0's in llo Dala rogislor.
In llo Iovor Budgoling CapabiIily rogislor (soo Iiguro 24-43 on pago 956), llo
Syslom AIIocalod bil is aulomalicaIIy sol lo ono if llo dovico is inlogralod onlo
llo syslom board and ils povor roquiromonls aro lloroforo aIroady laIon inlo
accounl in llo sysloms povor suppIy budgol. In llal caso, llo dovicos povor
roquiromonls slouId bo ignorod by soflvaro in maIing povor budgoling doci-
sions.
-

PCI Express System Architecture
956
-
-
Chapter 24: Express-Specific Configuration Registers
957
RCRB
GeneraI
As monlionod in Rool CompIox Rogislor BIocIs (RCRBs) on pago 765, a Rool
Iorl may oplionaIIy impIomonl a Rool CompIox Rogislor BIocI (RCRB) as a 4KB
bIocI of momory-mappod IO rogislors llal can incIudo ono or moro of llo
oplionaI ICI Ixpross oxlondod capabiIilios and ollor impIomonlalion spocific
rogislors llal appIy lo llo Rool CompIox. An RCRB musl nol rosido in llo samo
momory-mappod IO addross spaco as llal dofinod for normaI ICI Ixpross func-
lions. MuIlipIo Rool Iorls or inlornaI dovicos may bo associalod vill llo samo
RCRB (soo Iiguro 24-44 on pago 958 for an oxampIo).
Firmware Gives OS Base Address of Each RCRB
Tlo spoc roquiros llal llo pIalform firmvaro musl communicalo llo baso
addross of llo RCRB for oacl Rool Iorl or inlornaI dovico in llo Rool CompIox
lo llo OS. Hov llis is accompIislod is oulsido llo scopo of llo spoc.
MisaIigned or Locked Accesses To an RCRB
A Rool CompIox is nol roquirod lo supporl momory accoss roquosls lo an RCRB
llal cross dvord addross boundarios or llal aro accompIislod using a IocIod
lransaclion sorios. Soflvaro slouId lloroforo nol allompl an accoss of oillor
lypo lo an RCRB unIoss il is las dovico-spocific InovIodgo llal llo Rool Com-
pIox supporls llis accoss lypo.
Extended CapabiIities in an RCRB
Any Ixlondod CapabiIily rogislor sols in an RCRB musl aIvays bogin al offsol
0l villin llo RCRBs 4KB momory-mappod IO addross spaco. If llo RCRB doos
nol impIomonl any of llo oplionaI oxlondod capabiIily rogislor sols, llis is indi-
calod by an Inlancod CapabiIily loador vill a CapabiIily ID of IIIIl and a
Noxl CapabiIily Offsol of 0l.
PCI Express System Architecture
958
The RCRB Missing Link
Tlo 1.0a vorsion of llo spoc doos nol idonlify any mollod for discovoring llo
oxislonco of RCRBs llal may rosido villin a Rool CompIox, nor doos il idonlify
any mollod for associaling an RCRB vill ono or moro Rool Iorls. As of llo
limo of llis vriling (6/6/03), lloro is a drafl ICN (Inginooring Clango Nolico)
lo llo 1.0a spoc llal las nol yol boon approvod llal addrossos llis issuo. As
soon as il is approvod, MindSlaro viII immodialoIy incIudo llis informalion in
cIassos laugll by MindSlaro and, of courso, llis informalion viII bo providod in
llo Socond Idilion of llis booI. Il is nol incIudod in llis odilion bocauso drafl
clangos lavo a labil of mulaling boforo lloy roacl lloir finaIizod, approvod
form.

-

- --- -
by Nader SaIeh, CataIyst Enterprises, Inc.
Scope
IO inlorfaco bus loclnoIogios Ioop golling faslor and moro compIox in ordor lo
provido moro bandvidll.
Tlo lrond for IC bus loclnoIogios las boon from a roIalivoIy sIov asynclro-
nous, paraIIoI bus (ISA bus oporaling al 12 MHz and 16 bils) lo synclronous
and faslor paraIIoI bussos (ICI oporaling al 66MHz and 64-bils and ICI-X al
133MHz and 64 bils).
IaraIIoI bus loclnoIogios lavo oxporioncod an oxpononliaIIy incroasing band-
vidll, bul llis loclnoIogy is roacling ils praclicaI Iimilalion for offoring moro
bandvidll. Tloroforo, llo lrond in IC bus loclnoIogios is a movo lovards nov,
ligl-spood soriaI busos.
ICI Ixpross is an omorging soriaI bus loclnoIogy llal is oxpoclod lo dominalo
llo dosIlop and sorvor marIol by 2005. Tloro aro sovoraI issuos llal maIo
dovoIopmonl for ICI Ixpross radicaIIy difforonl llan dovoIopmonl for paraIIoI
busos. Tloso difforoncos croalo a sorios of nov claIIongos vlicl dosignors and
dovoIopors nood lo considor vlon onloring inlo llis nov loclnoIogy. Somo of
lloso aro covorod in llis arlicIo.
-- -

SeriaI Bus TopoIogy

ICI Ixprosss soriaI bus lopoIogy roprosonls a claIIongo for losl and dobug
dovoIopmonl looIs.
In a paraIIoI bus, as llo namo idonlifios, aII of llo prolocoI signaIs associalod
vill dala lransfor aro simuIlanoousIy prosonlod and acl in paraIIoI. DovoIopors
can soo bus signaIs and inlorprol bus condilions by jusl capluring and vioving
rav bus signaIs vill a roIalivoIy simpIo dovoIopmonl looI.
An oxampIo of simuIlanoousIy aclivo signaIs on a ICI bus (Caplurod by a Cala-
Iysl anaIyzor) is dopiclod in Iiguro A-1. In llis oxampIo llo usor can soo llo
individuaI signaIs vlicl oacl lavo lloir ovn spocific moaning. Wlon IRAMI#
is assorlod (Iov), il indicalos llal llo inilialor is roquosling a dala lransfor. CBI
= 0x0010, indicaling llal llis lransfor is an IO road and TRDY# = 0, indicaling
llo dala lransfor of 0x99l compIolod.
AIso, vlon aII bus signaIs (oxcopl cIocI) aro ligl il indicalos llal llo bus is in
llo idIo slalo.
- -
UnIiIo paraIIoI busos, llo slalus of soriaI busos cannol oasiIy bo idonlifiod by
moniloring llo individuaI bus signaIs. A moro compIox procoss is roquirod for
moniloring and inlorprolalion of SoriaI busos sucl as ICI Ixpross, for llo foI-
Ioving roasons:
- - -
- -

1. Tlo dala is lransforrod soriaIIy in a difforonliaI pair and llo roquosl for dala
lransfor, llo lypo of lransfor, addross and cIocI aro aII omboddod on llo
samo signaI Iino in a soriaIizod soquonco rallor llan laving dodicalod,
indopondonl signaIs.
2. Tlo idIo slalo of llo bus cannol simpIy bo quiol sinco aclivilios aro roquirod
lo Ioop llo cIocI rocovory circuil aclivo and onabIod. Tloso conslanl signaI
aclivilios maIo il difficuIl lo rocognizo llo slarl and ond poinls of lransfors.
Tloso addod aclivilios aro aIso scrambIod lo minimizo llo IMI offocls.
3. SoriaI bus prolocoIs roquiro addilionaI loadors and foolors, sucl as CRC, lo
maIo llo dala lransfor moro socuro and orror froo. Tloso addilionaI bils aro
aIso addod lo llo dala pacIols and roquiro inlorprolalion.
4. ICI Ixpross arclilocluro las dofinod prolocoIs llal communicalo in sovoraI
difforonl Iayors. IlysicaI Iayor prolocoI is usod for oslabIisling and main-
laining llo IinIs, llo Dala IinI Iayor IacIols prolocoI is usod for land-
slaIing and Transfor Iayor prolocoIs usod for lransforring llo dala. To
inlorprol bus condilions adoqualoIy, usors musl bo abIo lo convorl rav bils
inlo lloso Iayors.
Convorling binary bils inlo a moaningfuI inlorprolalion of aII lloso Iayors
roquiros an advancod and dodicalod looI, boyond llo capabiIily of many Iov
IovoI moniloring dovoIopmonl looIs.
Iiguro A-2 indicalos a dala capluro of a ICI Ixpross bus lransaclion on a scopo
in ils mosl primilivo form. Comparing lo llo ICI bus, il vouId bo impossibIo lo
inlorprol vlal is occurring on llis soriaI bus.
-- -

Il slouId bo nolod llal llo ICI Ixpross lransmil/rocoivo signaIs oacl consisl of
a difforonliaI signaI pair and llo sampIo slovn loro dispIay llo oulpul of sucl
a difforonliaI signaI pair.
DuaI-SimpIex
Tlo ICI Ixpross soriaI bus is a duaI-simpIox bus (soo Iiguro A-3 on pago 965),
unIiIo llo paraIIoI-basod ICI bus vloro llo slarl and ond of a lransfor can bo
soon on llo samo bus as slovn in Iiguro A-1 on pago 962.
Tlis arclilocluro roquiros llo roquoslor lo lransmil a Roquosl for dala lransfor
on ono lransmil pair, vliIo il rocoivos llo CompIolion rosponso on llo rocoivo
signaI pair. Considoring llal llo rosponso limo can vidoIy vary, dovoIopors
nood lo bo abIo lo sol llo anaIyzor lo fiIlor llo rocoivod and llo lransmillod dala
indopondonl of oacl ollor.
--
- -

AIso llo agonls on llo lvo onds of llo ICI oxpross IinI may bo oquaIIy capabIo
of boing roquoslors and compIolors. Tlis aIIovs a lransaclion lypo lo bo gonor-
alod in oillor diroclion on llo IinI al difforonl limos. Tloroforo, boing abIo lo
spocify llo lriggor and dala capluro on boll busos indopondonlIy is vory impor-
lanl, and usors musl spocify llo diroclion in ordor lo lriggor on llo propor lrans-
for lloy inlond lo viov.
Tlo lvo signaI pairs from llo losl lo llo dovico aro roforrod lo as Upslroam
(lovards llo losl procossor) and Dovnslroam (avay from llo losl procossor).
Tlo anaIyzor slouId bo abIo lo sampIo boll signaI pairs and lriggor on occur-
roncos of pallorns on oillor pair or jusl ono, por usor dofinod sollings.
-- -
-- -

Setting Up the AnaIyzer, Capturing and Triggering

Iiguro A-4 on pago 966 and Iiguro A-5 on pago 967 indicalo various solups for
capluring and lriggoring on possibIo ICI Ixpross bus slalos.
To roviov llo compIolo monus and foaluros you may dovnIoad and lry llo sofl-
varo from llo CalaIysl vob silo (www.getcatalyst.com).
Iiguro A-4 providos a dofauIl solup for capluring anylling on llo bus and indi-
calos vlollor or nol lloro is any dala lransfor or llo bus is in an idIo slalo. Any
lransaclions vouId bo caplurod and dispIayod vill aII dolaiIs incIudod.
Iurllor lriggoring soIoclions viII aIIov usors lo fuIIy quaIify llo bus dala and
lransaclion lypo and lo soo oxaclIy vlal sorl of roquosl and rosponso is commu-
nicalod bolvoon llo agonls on llo bus.
Iiguro A-5 on pago 967 slovs a dala capluro solup for capluring aII TII pacI-
ols on boll busos and lo lriggor vlon a TII momory road lo addross rango
0x00II8DXX.XX occurs, bul onIy vlon il is inilialod in llo dovnslroam bus.
SoquonliaI lriggoring aIso aIIovs llo usor lo lriggor on pallorns onIy aflor a cor-
lain sol of ovonls las occurrod (as dofinod by llo usor).
- --
- -

Link Training, the First Step in Communication

IinI lraining is ono of llo firsl prolocoIs llal lvo agonls porform lo oslabIisl
IinI configuralion paramolors sucl as IinI vidll, Iano poIarilios, or maximum
supporlod dala ralo. Tlo foIIoving scroonslols slov llo acluaI dala caplurod
for a X4 IinI lraining sossion bolvoon llo CalaIysl IX-4 Ixorcisor and a ICI
Ixpross syslom board. Il slouId bo nolod llal llo IinI lraining oxorciso domon-
slralod loro is basod on llo 1.0 spocificalion. In llo imagos llal foIIov, sovoraI
of llo ropoalod pacIols (aII of llo idIo slalo) aro romovod for cIarily, bul aII of llo
soquoncos aro slovn. During llo IinI Training, llo lvo agonls slarl llo com-
municalion by sonding a Iov IovoI ordorod sol TS1, and onco lloy oacl rocog-
nizo llo oxpoclod pacIol from llo ollor sido lloy procood vill IinI vidll
nogolialion, confirmod by boll agonls vill TS2. Tlis is immodialoIy foIIovod
by a soquonco of llroo DIIIs (Dala IinI Iayor IacIols) lo oxclango fIov con-
lroI crodil informalion.
- -
-- -

- -

-- -

- -

-- -

- -

-- -

- -

-
-- -

AII bus aclivilios may bo viovod in llo SymboI Iisling form vlicl roprosonls
llo bus dala in rav form. In llis Iisling, llo SKI (1C) symboI aflor llo COM
(BC) idonlifios llo SKII lypo ordorod sol.
- -
- -

SIot Connector vs. Mid-Bus Pad

Tlo ICI Ixpross bus can aIso bo usod for clip-lo-clip connoclions. In llis caso,
lloro aro no connoclors for llo anaIyzor lo pIug inlo. Tlis roquiros a mid-bus
probing loclniquo.
Tlo mid-bus probing doos nol aIIov for bus oxorcising sinco llo bus slubs can
croalo signaI inlogrily issuos. DovoIopors vanling lo claraclorizo lloir producls
by fuIIy oxorcising il slouId dosign a dovoIopmonl card llal incIudos lloir
dovico and pIug il inlo llo Ixorcisor for claraclorizalion and vorificalion.
Iiguro A-15 on pago 978 iIIuslralos ono rocommondod inlorfaco lo loIp dovoIop-
ors and looI vondors lo provido a common inlorfaco for anaIysis. Hovovor, llis
inlorfaco dosign is nol parl of llo spocificalions and is inlondod onIy for prolo-
lypo boards and doos nol incIudo aII roquirod dolaiIs al llis limo.
Tlis inlorfaco is roforrod lo as mid-bus probing and il dofinos a moclanicaI
spocificalion for llo sol of pads lo probo llo signaIs, moslIy for clip-lo-clip
busos.
Tlo figuro indicalos llo moclanicaI pads llal musl bo dosignod on llo board if
lloy aro inloroslod in using a mid-bus probo lo anaIyzo llo bus.
-- -

Suggoslod signaI assignmonls for llo probo aro nol dofinod in llo spocificalions.
Iiguro A-16 is a proposod suggoslion llal looI vondors aro considoring. Sinco
lloro is an offocl on llo signaIs, llo probo vondor musl provido spocificalions of
llo probo Ioading offocls and llo dovoIopors musl aIso considor lloso offocls.
-
- -

Syslom dovoIopors musl confirm vill lloir anaIyzor/probo vondor lo bo suro

llal llo probo vondor is aIso using llo samo signaI assignmonl.
Exercising: In-Depth Verification
Ono of llo mosl probIomalic issuos dovoIopors lavo is lo losl, or claraclorizo,
lloir producls in sucl a vay llal lloy can bo suro lloy vorI in aII oxpoclod con-
dilions and vill aII ollor producls. A common and oasy vay of losling is lo
lavo a fov difforonl ollor producls avaiIabIo and losl various combinalions lo
vorify llo inloroporabiIily.
- - --
-- -

Tlo probIom vill llis common loclniquo is llal lloro is no assuranco llal aII or
ovon a smaII porconlago of llo possibIo oxpoclod condilions lavo boon loslod
for. In mosl losl casos, configuralions cannol roprosonl llo condilions oxpori-
oncod vlon llo syslom oncounlors ligl dala lraffic, orrors or various lormina-
lion rosponsos.
Tlo Bus Ixorcisor roprosonls a promior looI llal aIIovs dovoIopors lo losl lloir
nov producl boyond llo lypicaI Iimilalions. Ixorcisors can gonoralo orrors, gon-
oralo ligl llrouglpul lraffic, and ovon gonoralo various difforonl rosponsos lo
lransaclion roquosls lo vorify llal a nov dosign can accommodalo aII oxpoclod
condilions and llal llo syslom can proporIy rocovor.
A ICI Ixpross bus Ixorcisor llal can accommodalo mosl of lloso roquiromonls
llla las an oasy programming inlorfaco for aII Iayors, and llal aIIovs usors lo
fuIIy manipuIalo llo dala vouId provo lo bo a usofuI looI for vorifying and losl-
ing ICI Ixpross producls.
SampIos laIon from llo IX-4, a CalaIysl ICI Ixpross bus Ixorcisor, aro pro-
sonlod and oxpIainod loro lo indicalo lov llis lypo of looI may bo appIiod dur-
ing losl, dobug and vorificalion plasos.
Tlo Ixorcisor can aIso bo usod lo vorify various compIianco roquiromonls, as
dofinod by llo spocificalions.
To roviov llo compIolo monus and foaluros, you may dovnIoad and lry llo
soflvaro from calaIysl vob silo www.getcatalyst.com
- -

Tlo IX-4 Ixorcisor inlorfaco indicalos aII possibIo commands and Ordorod Sols
in plysicaI Iayor, dala IinI Iayor and lransaclions Iayor pacIols.
- -- -
-- -

- - -
- -

- -
-- -

Commands associalod vill difforonl Iayors may bo mixod, and oacl may bo sol
vill a difforonl oplion and a numbor of Ioops. Tlo commands may bo issuod
immodialoIy aflor oacl ollor or aflor a dofinod doIay.
Tloso pacIols and commands may aIso bo sonl as a pallorn gonoralor villoul
considoring llo rosponso and propor landslaIo. In llis caso llo usor may gon-
oralo and ropoal a pallorn lo moasuro llo rosponso of llo dovico rogardIoss of
inlogrily of llo rosponso. In a moro lypicaI syslom, unIoss llo rosponso is accu-
ralo, llo inilialor may nol ropoal or conlinuo.
SignaI Integrity, Design and Measurement
GeneraI
Tlo ICI Ixpross bus runs al 2.5Gb/s and il slouId bo nolod llal, villoul a
propor ICB dosign, dovoIopors viII nol bo abIo lo produco a funclionaI producl.
Al lloso froquoncios llo Iossos impacl llo quaIily of llo signaI llal passos
llrougl llo lransmission modium. AddilionaI sourcos of probIoms may aIso bo
allribulod lo crosslaII. In slorl, moro oxlonsivo rosoarcl on ligl-spood dosign
guidoIinos and simuIalion by syslom modoIing aro slrongIy rocommondod.
Horo aro a fov iloms llal firsl limo dosignors of Gigalorlz loclnoIogy slouId bo
avaro of and pursuo.
High Speed PCB Design Requirements
Tlo dosignor musl bo avaro of:
1.
Tloro aro roquiromonls for rouling sucl as llal ligl spood signaIs musl bo
roulod as a symmolricaI pair vill a difforonco of Ioss llan 20 miI bolvoon
llo lvo lracos. Tloso lracos aIso nood lo bo impodanco conlroIIod lo 100
Olm difforonliaI, or 50 Olm singIo ondod.

Tlo ligl spood signaIs slouId aIso avoid slarp bonds sucl as 90 dogroos.
Tlo ICI Ixpross signaI inlogrily is basod on conlroIIing Ioss llrougl llo
inlorconnocl modia as mucl as ollor faclors.
3.
Slilcling is rocommondod lo Ioop llo numbor of vias for ligl spood signaIs
lo a minimum (sucl as lvo for add-in cards). Il is somolimos a praclico lo
- -

add a ground via noxl lo llo signaI via lo Ioop a uniform conlinualion for
llo rolurn pall (roforrod lo as via slilcling).
4.
Ono of llo mosl common issuos in signaI inlogrily is conlroIIing llo jillor. A
froquonl sourco of jillor in a soriaI dala slroam is llo roforonco cIocI. }illor
gonoraIIy occurs duo lo oxcossivo noiso on llo V
CC
suppIy for cIocI dislri-
bulion circuils and ICI Ixpross lranscoivors. Iropor fiIloring and docou-
pIing for llo povor suppIy and around llo cIocI osciIIalors and buffors
musl bo impIomonlod lo Ioop llo DC noiso lo a fov miIIivoIls in ordor lo
Ioop llo jillor, and lloroforo llo Iyo pallorn, of llo oulpul signaIs lo an
accoplabIo IovoI. AIso, cIocI sourcos (on board osciIIalors) musl bo of a ligl
slabiIily and Iov jillor.
Iiguro A-20 on pago 986 is a scroonslol of a moasuromonl mado on a cIocI
lo slov llo accoplabIo jillor, and Iiguro A-21 on pago 987 roprosonls unac-
coplabIo jillor.
-- -

Tlis moasuromonl indicalos a cIocI jillor of 39ps I-I and a slabIo cIocI al llo
dosirod froquoncy.
-- - - -
- -

Tlis moasuromonl indicalos a ligl cIocI jillor aIong vill an unslabIo froquoncy.
Tlo absoIulo jillor and slabiIily is liglIy dopondonl on dovico spocificalion
roquiromonls. DovoIopors nood lo Inov llo accoplabIo Iimils of lloir dovicos
and uso llo moasuromonl rosuIls accordingIy.
-- - - -

- -
--
By Iarry Clisvin, AIbor Kazmi, and Danny Cli (IIX ToclnoIogy, Inc.)
Introduction
Sinco ils dofinilion in llo oarIy 1990s, ICI las bocomo ono of llo mosl succoss-
fuI inlorconnocl loclnoIogios ovor usod in compulors. OriginaIIy inlondod for
porsonaI compulor sysloms, llo ICI arclilocluro las ponolralod inlo virluaIIy
ovory compuling pIalform calogory, incIuding sorvors, slorago, communica-
lions, and a vido rango of omboddod conlroI appIicalions. Irom ils oarIy incar-
nalion as a 32-bil 33MHz inlorconnocl, il las boon oxpandod lo offor liglor
spoods (curronlIy in vidosproad uso al 64-bil 133MHz, vill faslor vorsions on
llo vay). Mosl imporlanlIy, oacl advancomonl in ICI bus spood and vidll pro-
vidod bacIvard soflvaro compalibiIily, aIIoving dosignors lo Iovorago llo
broad codo baso.
As succossfuI as llo ICI arclilocluro las bocomo, lloro is a Iimil lo vlal can bo
accompIislod vill a muIli-drop, paraIIoI slarod bus inlorconnocl loclnoIogy.
Issuos sucl as cIocI sIov, ligl pin counl, lraco rouling roslriclions in prinlod
circuil boards (ICB), bandvidll and Ialoncy roquiromonls, plysicaI scaIabiIily,
and llo nood lo supporl QuaIily of Sorvico (QoS) villin a syslom for a vido
varioly of appIicalions Ioad lo llo dofinilion of llo ICI Ixpross arclilocluro.
ICI Ixpross is llo naluraI succossor lo ICI, and vas dovoIopod lo provido llo
advanlagos of a slalo-of-llo-arl, ligl-spood soriaI inlorconnocl loclnoIogy and
pacIol basod Iayorod arclilocluro, bul mainlain bacIvard compalibiIily vill
llo Iargo ICI soflvaro infraslrucluro. Tlo Ioy goaI vas lo provido an opli-
-- -

mizod and univorsaI inlorconnocl soIulion for a groal varioly of fuluro pIal-
forms, incIuding dosIlop, sorvor, vorIslalion, slorago, communicalions and
omboddod sysloms.
Tlis claplor providos an ovorviov of llo marIols and appIicalions llal ICI
Ixpross is oxpoclod lo sorvo, vill an oxpIanalion of lov llo loclnoIogy viII bo
inlogralod inlo oacl appIicalion, and somo oxpIoralion of llo advanlagos llal
ICI Ixpross brings lo oacl usago.
Iols roviov llo Ioy bonofils of llo ICI Ixpross arclilocluro boforo vo discuss
ils appIicalion in difforonl marIols. Somo of llo Ioy foaluros of llo arclilocluro
vo roviovod in llis booI aro:
- IacIol-basod Iayorod arclilocluro
- SoriaI inlorconnoclion al 2.5 GHz (5 GHz boing considorod)
- IinI-lo-IinI and ond-lo-ond orror doloclion (CRC clocI)
- Ioinl-lo-poinl dala fIov
- DifforonliaI Iov voIlago signaIs for noiso immunily
--
-- --

- QuaIily of Sorvico (QoS)and VirluaI ClannoIs (VC)

- ScaIabIo from 1x lo 32x Ianos
- Soflvaro (bacIvard) compalibiIily vill Iogacy ICI sysloms
Enterprise Computing Systems
ICI Ixpross is oxpoclod lo bo dopIoyod iniliaIIy in dosIlop and sorvor sysloms.
Tloso compulors lypicaIIy uliIizo a clipsol soIulion llal incIudos ono or moro
microprocossors and lvo lypos of spociaI inlorconnocl dovicos, caIIod norll-
bridgos and soullbridgos. Norllbridgos connocl llo CIU vill momory, grapl-
ics and I/O. Soullbridgos connocl lo slandardizod I/O dovicos sucl as lard
disI drivos, nolvorIing moduIos or dovicos, and oflon ICI oxpansion sIols.
Desktop Systems
TypicaI uso of ICI Ixpross in a dosIlop appIicalion is slovn in Iiguro B-2 on
pago 992. Tlo ICI Ixpross porls como diroclIy oul of llo norllbridgo, and aro
bridgod lo ICI sIols llal aro usod for Iogacy pIug-in cards. In somo impIomon-
lalions llo ICI Ixpross inlorconnoclions viII bo compIoloIy liddon from llo
usor bolind ICI bridgos, and in ollor impIomonlalions lloro viII bo ICI
Ixpross sIols in a nov ICI Ixpross connoclor form faclor.
Tlo major bonofil for using ICI Ixpross in llis appIicalion is llo Iov pin counl
associalod vill soriaI inlorfaco loclnoIogy, vlicl viII lransIalo inlo Iovor cosl.
Tlis Iov pin counl providos llo abiIily lo croalo norllbridgos and I/O bridgos
vill smaIIor foolprinls, and a significanlIy fovor numbor of board lracos
bolvoon llo compononls. Tlis providos a major roduclion in llo aroa and com-
pIoxily of llo signaI/lraco rouling in ICBs.
Server Systems
Iiguro B-3 on pago 993 slovs ICI Ixpross usod in an onlorpriso sorvor sys-
lom. Tlis syslom las simiIarilios lo llo dosIlop syslom, sinco lloro is a norll-
bridgo and soullbridgo providing funclions llal paraIIoI lloir roIos in llo
dosIlop syslom, and llo form faclor of llo syslom is oflon simiIar. Sorvors,
lovovor, pIaco a groalor omplasis on porformanco llan dosIlop sysloms do.
-- -

To acliovo lloir porformanco and limo lo marIol objoclivos, sorvor dosignors

lavo adoplod ICI-X. Tlo primary allraclion lo ICI-X las boon incroasod
llrouglpul, bul vill ICI codo compalibiIily. ICI-X offors cIoar bonofils com-
parod lo ICI, and viII romain in sorvor sysloms for a Iong vliIo, bul il suffors
from llo samo slarod bus Iimilalions llal lavo aIroady boon discussod. Tlo
ligl llrouglpul of ICI Ixpross soriaI inlorconnoclion providos a moasurabIo
bonofil vorsus Iogacy inlorconnocl loclnoIogios, ospociaIIy as llo spood of llo
I/O inlorconnocl and llo numbor of ligl spood I/O porls on oacl card
incroasos.
Somo sysloms viII onIy provido ICI-X sIols, bul many novor sysloms viII aIso
offor sovoraI ICI Ixpross sIols. Tlo numbor of ICI Ixpross sIols viII grov ovor
limo comparod lo llo ICI-X sIols, and ovonluaIIy viII bocomo dominanl in llo
samo vay llal ICI did vill provious inlorconnocl loclnoIogios. Sinco band-
vidll is a primary molivalor for a sorvor, lypicaI ICI Ixpross sIols viII bo oillor
x4 or x8 Ianos.
In mosl Iov lo midrango sorvor sysloms, llo ICI-X bridging and ICI Ixpross
sIols viII bo providod by using llo porls rigll off of llo norllbridgo. Hovovor,
ligl-ond sysloms viII roquiro moro I/O sIols of boll Iinds. Sinco ICI Ixpross
is a poinl-lo-poinl loclnoIogy, llo onIy vay lo provido addilionaI connoclion
IinIs is llrougl a dovico caIIod a fan oul svilcl. SpocificaIIy, llo purposo of a
-- - -
-- --

fan oul svilcl is lo muIlipIy llo numbor of ICI Ixpross Ianos from an upslroam
losl porl lo a liglor numbor of dovnslroam ICI Ixpross dovicos. Iiguro 3
boIov, slovs a ICI Ixpross svilcl usod in llo syslom for llis purposo.
Embedded ControI
Ono of llo many aroas llal ICI las ponolralod is omboddod-conlroI sysloms.
Tlis doscribos a vido rango of appIicalions llal moasuro, losl, monilor, or dis-
pIay dala, and incIudos appIicalions sucl as induslriaI conlroI, offico auloma-
lion, losl oquipmonl, and imaging.
In lloso appIicalions, syslom dosignors lypicaIIy uliIizo omboddod procossors.
In many inslancos, Ioading-odgo companios viII difforonlialo lloir producls by
uliIizing somo cuslom Iogic in llo form of an ASIC or IIGA. A bridgo is oflon
usod lo lransIalo llo simpIo cuslom inlorfaco and connocl il lo llo bus.
Il is oxpoclod llal llo omboddod-conlroI marIol viII quicIIy migralo lo ICI
Ixpross, vill a lypicaI oxampIo slovn in Iiguro B-4 on pago 994. AppIicalions
sucl as imaging and vidoo slroaming aro aIvays lungry for bandvidll, and
llo addilionaI llrouglpul of x4 or x8 ICI Ixpross IinIs viII lransIalo inlo
-- -
-- -

liglor vidoo rosoIulion, or llo landIing of moro vidoo slroams by llo syslom.
Ollors viII impIomonl ICI Ixpross bocauso of llo noiso rosislanco ils IVDS
lracos provido, or bocauso of ils officionl rouling and ils abiIily lo looI logollor
subsysloms llrougl a slandard cabIo. SliII ollors viII clooso ICI Ixpross sim-
pIy bocauso of ils ubiquily.
Storage Systems
ICI las bocomo a common bacIpIano loclnoIogy for mainslroam slorago sys-
loms. AIllougl il providos a good mix of foaluros, Iov cosl, and llrouglpul,
llo bus las bocomo a porformanco bollIonocI. Iiguro B-5 on pago 995 slovs
llo uso of ICI Ixpross in a slorago syslom. Sysloms simiIar lo llo ono slovn in
Iiguro B-5 on pago 995 can bo buiIl on a mollorboard, or as parl of a bacIpIano.
Tlo discussion in llis soclion appIios lo boll form faclors.
Wo lavo liglIigllod incroasod bandvidll as ono of llo advanlagos of moving
lo ICI Ixpross, and novloro is il moro bonoficiaI and obvious llan in slorago.
Tlo bandvidll domandod by I/O connoclions sucl as Illornol, Iibro ClannoI,
SCSI, and InfiniBand, is incroasing rapidIy. And llo abiIily lo movo dala
bolvoon I/O moduIos and llo losl procossor is crilicaI lo ovoraII syslom porfor-
manco.
-- -
-- --

In RAID basod slorago sysloms, for oxampIo, dala lo bo arclivod is dislribulod

across sovoraI disI drivos lo provido faslor dala rolriovaI and fauIl loIoranco. As
porformanco and compIoxily incroaso in lloso sysloms, llo nood for faslor road
and vrilo oporalions from muIlipIo I/O Iocalions (disI drivos) bocomos
oxlromoIy imporlanl. ICI Ixpross, vill ils ligl porformanco, poinl-lo-poinl
arclilocluro bocomos vory dosirabIo for llis appIicalion.
ICI Ixpross providos a Ioy roIiabiIily bonofil in slorago appIicalions as voII.
Tlo spocificalion providos for lvo difforonl lypos of orror clocIing (CRC)
sclomos. Tloro is CRC informalion bolvoon oacl IinI lo onsuro a roIiabIo con-
noclion, and lloro is an oplionaI ond-lo-ond CRC llal lravoIs vill llo dala from
sourco lo doslinalion.
In Higl AvaiIabiIily (HA) appIicalions, a soparalo losl can rosido in llo syslom
(as slovn in Iiguro B-5 on pago 995) for faiIovor. If and vlon llo primary losl
bocomos unslabIo or non-oporalionaI, llo socondary losl viII laIo ovor conlroI
of llo syslom. Tlis is an imporlanl foaluro for syslom IovoI roIiabiIily vlon llo
dosignor is allompling lo oIiminalo as many singIo poinls of faiIuro as possibIo.
Tlis socondary losl viII bo inlogralod inlo llo syslom using non-lransparonl
bridging (a dolaiIod discussion of non-lransparonl bridging is providod in
Appondix C).
-- -
-- -

Communications Systems
Tlo Iasl appIicalion llal vo viII oxpIoro is llo uso of ICI Ixpross in communi-
calions sysloms. As vill provious usago modoIs, ICI loclnoIogy las in llo pasl
mado significanl inroads inlo communicalion sysloms, bul ovor limo il las
bocomo Ioss dosirabIo duo lo llo inloronl Iimilalions of a slarod bus. In gon-
oraI, soriaI inlorconnocls sucl as ICI Ixpross lavo bocomo allraclivo lo bacI-
pIano syslom dosignors by providing svilcl-basod lopoIogios llal onabIo
liglor roIiabiIily, scaIabiIily, and robuslnoss.
Higl ond communicalions sysloms aro basod on ono or moro racIs, vill a mid-
pIano or bacIpIano classis usod lo inlorconnocl oacl subsyslom. Many sysloms
uso llo CompaclICI arclilocluro for lloir bacIpIano impIomonlalions, and in
somo casos propriolary bus soIulions aro usod lo inlorconnocl Iino cards, llo
svilcl fabric and llo conlroI moduIos. Somo vondors aro moving lovard llo
AdvancodTCA (ATCA) arclilocluro llal supporls a varioly of difforonl fab-
rics basod upon a slandard classis for communicalion appIicalions. ATCA las a
rango of bonofils, bul llo ICI Ixpross vorsion of ATCA providos a smooll
migralion lo liglor spoods and a sol of foaluros llal fil voII vill llo communi-
calions paradigm.
Ono foaluro common lo many communicalions sysloms is llo abiIily lo assign
priorilios lo difforonl dala slroams basod on QuaIily of Sorvico (QoS). ICI
Ixpross offors Traffic CIassos (TC) llal can bo usod lo difforonlialo lypos of dala.
Tloso TCs aro llon mappod onlo VirluaI ClannoIs (VC) villin llo lardvaro.
Iacl VC las ils ovn sol of quouos in llo subsyslom, providing a soparalo pall
llrougl llo svilcl or bridgo. Tlis moclanism can bo usod lo provido soparalo
clannoIs for difforonl lypos of lraffic (I/O, dala, spociaI mossagos).
Iiguro B-6 on pago 997 slovs a lypicaI communicalion svilcl or roulor. OnIy 6
sIols aro slovn for iIIuslralion purposos, bul acluaI sysloms lypicaIIy lavo 10+
sIols. As slovn in llo figuro, ICI Ixpross loclnoIogy can bo usod lo supporl
rodundanl svilcl fabrics and conlroI moduIos, aIIoving communicalions
oquipmonl vondors lo buiId ligl avaiIabiIily sysloms vill a faslor limo lo mar-
Iol.
-- --

Summary
ICI Ixpross loclnoIogy offors an improvomonl in porformanco and llo promiso
of foaluros boyond ICI, bul doos so in a vay llal prosorvos invoslmonl mado in
ICI soflvaro ovor llo Iasl lon yoars. Tlo combinalion of incroasod bandvidll,
roducod cosl, and oxlondod capabiIilios vill an oasy migralion pall is IiIoIy lo
maIo llo ICI Ixpross arclilocluro llo noxl ubiquilous inlorconnoclion loclnoI-
ogy for a vido varioly of appIicalions.
-- - --
999

ImpIementing InteIIigent Adapters and MuIti-Host
Systems With PCI Express TechnoIogy
By Jack ReguIa, Danny Chi and Tim Canepa (PLX TechnoIogy, Inc. )
Introduction
InloIIigonl adaplors, losl faiIovor moclanisms and muIliprocossor sysloms aro
llroo usago modoIs llal aro common loday, and oxpoclod lo bocomo moro prov-
aIonl as marIol roquiromonls for noxl gonoralion sysloms. Dospilo llo facl llal
oacl of lloso vas dovoIopod in rosponso lo compIoloIy difforonl marIol
domands, aII slaro llo common roquiromonl llal sysloms llal uliIizo llom
roquiro muIlipIo procossors lo co-oxisl villin llo syslom. Tlis appondix oul-
Iinos lov ICI Ixpross can addross lloso noods llrougl non-lransparonl bridg-
ing.
Bocauso of llo vidosproad popuIarily of sysloms using inloIIigonl adaplors,
losl faiIovor and muIlilosl loclnoIogios, ICI Ixpross siIicon vondors musl pro-
vido a moans lo supporl llom. Tlis is acluaIIy a roIalivoIy Iov risI ondoavor,
givon llal ICI Ixpross is soflvaro compalibIo vill ICI, and ICI sysloms lavo
Iong impIomonlod dislribulod procossing. Tlo mosl obvious approacl, and llo
ono llal IIX ospousos, is lo omuIalo llo mosl popuIar impIomonlalion usod in
llo ICI spaco for ICI Ixpross. Tlis slralogy aIIovs syslom dosignors lo uso nol
onIy a famiIiar impIomonlalion bul ono llal is a provon mollodoIogy, and ono
llal can provido significanl soflvaro rouso as lloy migralo from ICI lo ICI
Ixpross.
Tlis papor oulIinos lov muIliprocossor ICI Ixpross sysloms viII bo impIo-
monlod using induslry slandard praclicos oslabIislod in llo ICI paradigm. Wo
firsl, lovovor, viII dofino llo difforonl usago modoIs, and roviov llo succossfuI
offorls in llo ICI communily lo dovoIop moclanisms lo accommodalo lloso
roquiromonls. IinaIIy, vo viII covor lov ICI Ixpross sysloms viII uliIizo non-
lransparonl bridging lo provido llo funclionaIily noodod for lloso lypos of sys-
loms.
PCI Express System Architecture
1000
Usage ModeIs
InteIIigent Adapters
InloIIigonl adaplors aro lypicaIIy poriploraI dovicos llal uso a IocaI procossor lo
offIoad lasIs from llo losl. IxampIos of inloIIigonl adaplors incIudo RAID con-
lroIIors, modom cards, and conlonl procossing bIados llal porform lasIs sucl as
socurily and fIov procossing. GonoraIIy, lloso lasIs aro oillor compulalionaIIy
onorous or roquiro significanl I/O bandvidll if porformod by llo losl. By add-
ing a IocaI procossor lo llo ondpoinl, syslom dosignors can onjoy significanl
incromonlaI porformanco. In llo RAID marIol, a significanl numbor of producls
uliIizo IocaI inloIIigonco for lloir I/O procossing.
Anollor oxampIo of inloIIigonl adaplors is an ocommorco bIado. Bocauso gon-
oraI purposo losl procossors aro nol oplimizod for llo oxpononliaI mallomalics
nocossary for SSI, uliIizing a losl procossor lo porform an SSI landslaIo lypi-
caIIy roducos syslom porformanco by ovor 90. Iurllormoro, ono of llo roquiro-
monls for llo SSI landslaIo oporalion is a lruo random numbor gonoralor.
Many gonoraI purposo procossors do nol lavo llis foaluro, so il is acluaIIy diffi-
cuIl lo porform SSI landslaIos villoul dodicalod lardvaro. SimiIar oxampIos
abound llrougloul llo inloIIigonl adaplor marIolpIaco, in facl, llis usago
modoI is so provaIonl llal for many appIicalions il las bocomo llo do faclo slan-
dard impIomonlalion.
Host FaiIover
Hosl faiIovor capabiIilios aro dosignod inlo sysloms llal roquiro ligl avaiIabiI-
ily. Higl avaiIabiIily las bocomo an incroasingIy imporlanl roquiromonl, ospo-
ciaIIy in slorago and communicalion pIalforms. Tlo onIy praclicaI vay lo
onsuro llal llo ovoraII syslom romains oporalionaI is lo provido rodundancy for
aII compononls. Hosl faiIovor sysloms lypicaIIy incIudo a losl basod syslom
allaclod lo sovoraI ondpoinls. In addilion, a bacIup losl is allaclod lo llo sys-
lom and is configurod lo monilor llo syslom slalus. Wlon llo primary losl
faiIs, llo bacIup losl procossor musl nol onIy rocognizo llo faiIuro, bul llon
laIo slops lo assumo primary conlroI, romovo llo faiIod losl lo provonl addi-
lionaI disruplions, roconslilulo llo syslom slalo, and conlinuo llo oporalion of
llo syslom villoul Iosing any dala.
Appendix D: Intelligent Adapters & Multi-Host Systems
1001
MuItiprocessor Systems
MuIliprocossor sysloms provido groalor procossing bandvidll by aIIoving
muIlipIo compulalionaI onginos lo simuIlanoousIy vorI on soclions of a com-
pIox probIom. UnIiIo sysloms uliIizing losl faiIovor, vloro llo bacIup procos-
sor is ossonliaIIy idIo, muIliprocossor sysloms uliIizo aII llo onginos lo boosl
compulalionaI llrouglpul. Tlis onabIos a syslom lo roacl porformanco IovoIs
nol possibIo by using onIy a singIo losl procossor. MuIliprocossor sysloms lypi-
caIIy consisl of lvo or moro compIolo sub-sysloms llal can pass dala bolvoon
llomsoIvos via a spociaI inlorconnocl. A good oxampIo of a muIlilosl syslom is
a bIado sorvor classis. Iacl bIado is a compIolo subsyslom, oflon ropIolo vill ils
ovn CIU, Dirocl Allaclod Slorago, and I/O.
The History MuIti-Processor ImpIementations Using PCI
To bollor undorsland llo impIomonlalion proposod for ICI Ixpross, ono noods
lo firsl undorsland llo ICI impIomonlalion.
ICI vas originaIIy dofinod in 1992 for porsonaI compulors. Bocauso of llo
naluro of ICs al llal limo, llo prolocoI arclilocls did nol anlicipalo llo nood for
muIliprocossors. Tloroforo, lloy dosignod llo syslom assuming llal llo losl
procossor vouId onumoralo llo onliro momory spaco. ObviousIy, if anollor pro-
cossor is addod, llo syslom oporalion vouId faiI as boll procossors vouId
allompl lo sorvico llo syslom roquosls.
1SovoraI mollodoIogios voro subsoquonlIy invonlod lo accommodalo llo
roquiromonl for muIliprocossor capabiIilios using ICI. Tlo mosl popuIar impIo-
monlalion, and llo ono discussod in llis papor for ICI Ixpross, is llo uso of
non-lransparonl bridging bolvoon llo procossing subsysloms lo isoIalo lloir
momory spacos.
1
Bocauso llo losl doos nol Inov llo syslom lopoIogy vlon il is firsl povorod up
or rosol, il musl porform discovory lo Ioarn vlal dovicos aro prosonl and llon
map llom inlo llo momory spaco. To supporl slandard discovory and configu-
ralion soflvaro, llo ICI spocificalion dofinos a slandard formal for ConlroI and
Slalus Rogislors (CSRs) of compIianl dovicos. Tlo slandard ICI-lo-ICI bridgo
CSR loador, caIIod a Typo 1 loador, incIudos primary, socondary and subordi-
1. Unless explicitly noted, the architecture Ior multiprocessor systems using PCI and
PCI Express are similar and may be used interchangeably.
PCI Express System Architecture
1002
nalo bus numbor rogislors llal, vlon vrillon by llo losl, dofino llo CSR
addrossos of dovicos on llo ollor sido of llo bridgo. Bridgos llal ompIoy a Typo
1 CSR loador aro caIIod lransparonl bridgos.
A Typo 0 loador is usod for ondpoinls. A Typo 0 CSR loador incIudos baso
addross rogislors (BARs) usod lo roquosl momory or I/O aporluros from llo
losl. Boll Typo 1 and Typo 0 loadors incIudo a cIass codo rogislor llal indicalos
vlal Iind of bridgo or ondpoinl is roprosonlod, vill furllor informalion avaiI-
abIo in a subcIass fioId and in dovico ID and vondor ID rogislors. Tlo CSR
loador formal and addrossing ruIos aIIov llo procossor lo soarcl aII llo
branclos of a ICI liorarcly, from llo losl bridgo dovn lo oacl of ils Ioavos,
roading llo cIass codo rogislors of oacl dovico il finds as il procoods, and assign-
ing bus numbors as approprialo as il discovors ICI-lo-ICI bridgos aIong llo
vay. Al llo compIolion of discovory, llo losl Inovs vlicl dovicos aro prosonl
and llo momory and I/O spaco oacl dovico roquiros lo funclion. Tloso concopls
aro iIIuslralod in Iiguro C - 1.
- - -
Appendix D: Intelligent Adapters & Multi-Host Systems
1003
ImpIementing MuIti-host/InteIIigent Adapters in PCI
Express Base Systems
Up lo llis poinl, our discussions lavo boon Iimilod lo ono procossor vill ono
momory spaco. As loclnoIogy progrossod, syslom dosignors bogan dovoIoping
ond poinls vill lloir ovn nalivo procossors buiIl in. Tlo probIom llal llis
causod vas llal boll llo losl procossor and llo inloIIigonl adaplor vouId,
upon povor up or rosol, allompl lo onumoralo llo onliro syslom, causing sys-
lom confIicl and uIlimaloIy a non-funclionaI syslom.
2
To gol around llis, arclilocls dosignod non-lransparonl bridgos. A non-lrans-
paronl ICI-lo-ICI Bridgo, or ICI Ixpross-lo-ICI Ixpross Bridgo, is a bridgo llal
oxposos a Typo 0 CSR loador on boll sidos and forvards lransaclions from ono
sido lo llo ollor vill addross lransIalion, llrougl aporluros croalod by llo
BARs of lloso CSR loadors. Bocauso il oxposos a Typo 0 CSR loador, llo bridgo
appoars lo bo an ondpoinl lo discovory and configuralion soflvaro, oIiminaling
polonliaI discovory soflvaro confIicls. Iacl BAR on oacl sido of llo bridgo cro-
alos a lunnoI or vindov inlo llo momory spaco on llo ollor sido of llo bridgo.
To faciIilalo communicalion bolvoon llo procossing domains on oacl sido, llo
non-lransparonl bridgo aIso lypicaIIy incIudos doorboII rogislors lo sond inlor-
rupls from oacl sido of llo bridgo lo llo ollor, and scralclpad rogislors accossi-
bIo from boll sidos.
A non-lransparonl bridgo is funclionaIIy simiIar lo a lransparonl bridgo in llal
boll provido a pall bolvoon lvo indopondonl ICI busos (or ICI Ixpross IinIs).
Tlo Ioy difforonco is llal vlon a non-lransparonl bridgo is usod, dovicos on llo
dovnslroam sido of llo bridgo (roIalivo lo llo syslom losl) aro nol visibIo from
llo upslroam sido. Tlis aIIovs an inloIIigonl conlroIIor on llo dovnslroam sido
lo manago llo dovicos in ils IocaI domain, vliIo al llo samo limo maIing llom
appoar as a singIo dovico lo llo upslroam conlroIIor. Tlo pall bolvoon llo lvo
busos aIIovs llo dovicos on llo dovnslroam sido lo lransfor dala diroclIy lo llo
upslroam sido of llo bus villoul diroclIy invoIving llo inloIIigonl conlroIIor in
llo dala movomonl. Tlus lransaclions aro forvardod across llo bus unfollorod
jusl as in a ICI-lo-ICI Bridgo, bul llo rosourcos rosponsibIo aro liddon from llo
losl, vlicl soos a singIo dovico.
2. WliIo vo aro using an inloIIigonl ondpoinl as llo oxampIos, vo slouId nolo
llal a simiIar probIom oxisls for muIli-losl sysloms.
PCI Express System Architecture
1004
Bocauso vo nov lavo lvo momory spacos, llo ICI Ixpross syslom noods lo
lransIalo addrossos of lransaclions llal cross from ono momory spaco lo llo
ollor. Tlis is accompIislod via TransIalion and Iimil Rogislors associalod vill
llo BAR. Soo Addross TransIalion on pago 1013 for a dolaiIod doscriplion,
Iiguro C-2 on pago 1004 providos a concopluaI rondoring of Dirocl Addross
TransIalion. Addross lransIalion can bo dono by Dirocl Addross TransIalion
(ossonliaIIy ropIacomonl of llo dala undor a masI), labIo IooIup, or by adding
an offsol lo an addross. Iiguro C-3 on pago 1005 slovs TabIo IooIup TransIa-
lion usod lo croalo muIlipIo vindovs sproad across syslom momory spaco for
pacIol originalod in a IocaI I/O procossors domain, as voII as Dirocl Addross
TransIalion usod lo croalo a singIo vindov in llo opposilo diroclion.
-- -
Appendix D: Intelligent Adapters & Multi-Host Systems
1005
ExampIe: ImpIementing InteIIigent Adapters in a PCI
Express Base System
InloIIigonl adaplors viII bo porvasivo in ICI Ixpross sysloms, and viII IiIoIy bo
llo mosl vidoIy usod oxampIo of sysloms vill muIlipIo procossors.
Iiguro C-4 on pago 1006 iIIuslralos lov ICI Ixpross sysloms viII impIomonl
inloIIigonl adaplors. Tlo syslom diagram consisls of a syslom losl, a rool com-
pIox (llo ICI Ixpross vorsion of a Norllbridgo), a llroo porl svilcl, an oxampIo
ondpoinl, and an inloIIigonl add-in card. SimiIar lo llo syslom arclilocluro, llo
add-in card conlains a IocaI losl, a rool compIox, a llroo porl svilcl, and an
oxampIo ondpoinl. Hovovor vo slouId nolo lvo significanl difforoncos: llo
- - -
PCI Express System Architecture
1006
inloIIigonl add-in card conlains an IIIROM, and ono porl of llo svilcl con-
lains a bacI lo bacI non-lransparonl bridgo.
Upon povor up, llo syslom losl viII bogin onumoraling lo dolormino llo lopoI-
ogy. Il viII pass llrougl llo Rool CompIox and onlor llo firsl svilcl (Svilcl A).
Upon onloring llo lopmosl porl, il viII soo a lransparonl bridgo, so il viII Inov
lo conlinuo lo onumoralo. Tlo losl viII llon poII llo Ioflmosl porl and, upon
finding a Typo 0 CSR loador, viII considor il an ondpoinl and oxpIoro no doopor
aIong llal brancl of llo ICI liorarcly. Tlo losl viII llon uso llo informalion in
llo ondpoinls CSR loador lo configuro baso and Iimil rogislors in bridgos and
BARs in ondpoinls lo compIolo llo momory map for llis brancl of llo syslom.
- -- --
Appendix D: Intelligent Adapters & Multi-Host Systems
1007
Tlo losl viII llon oxpIoro llo rigllmosl porl of Svilcl A and road llo CSR
loador rogislors associalod vill llo lop porl of Svilcl B. Bocauso llis porl is a
non-lransparonl bridgo, llo losl finds a Typo 0 CSR loador. Tlo losl procossor
lloroforo boIiovos llal llis is an ondpoinl and oxpIoros no doopor aIong llal
brancl of llo ICI liorarcly. Tlo losl roads llo BARs of llo lop porl of Svilcl B
lo dolormino llo momory roquiromonls for vindovs inlo llo momory spaco on
llo ollor sido of llo bridgo. Tlo momory spaco roquiromonls can bo proIoadod
from an IIIROM inlo llo BAR Solup Rogislors of Svilcl Bs non-lransparonl
porl or can bo configurod by llo procossor llal is IocaI lo Svilcl B prior lo
aIIoving llo syslom losl lo compIolo discovory.
SimiIar lo llo losl procossor povor up soquonco, llo IocaI losl viII aIso bogin
onumoraling ils ovn syslom. IiIo llo syslom losl procossor, il viII aIIocalo
momory for ond poinls and conlinuo lo onumoralo vlon il oncounlors a lrans-
paronl bridgo. Wlon llo losl roaclos llo lopmosl porl of Svilcl B, il soos a
non-lransparonl bridgo vill a Typo 0 CSR loador. AccordingIy, il roads llo
BARs of llo CSR loador lo dolormino llo momory aporluro roquiromonls, llon
lorminalos discovory aIong llis brancl of ils ICI lroo. Again, llo momory apor-
luro informalion can bo suppIiod by an IIIROM, or by llo syslom losl.
Communicalion bolvoon llo lvo procossor domains is acliovod via a maiIbox
syslom and doorboII inlorrupls. Tlo doorboII faciIily aIIovs oacl procossor lo
sond inlorrupls lo llo ollor. Tlo maiIbox faciIily is a sol of duaI porlod rogislors
llal aro boll roadabIo and vrilabIo by boll procossors. Slarod momory
mappod moclanisms via llo BARs may aIso bo usod for inlor-procossor com-
municalion.
ExampIe: ImpIementing Host FaiIover in a PCI
Express System
Iiguro C-5 on pago 1008 iIIuslralos lov mosl ICI Ixpross sysloms viII impIo-
monl losl faiIovor. Tlo primary losl procossor in llis iIIuslralion is on llo Iofl
sido of llo diagram, vill llo bacIup losl on llo rigll sido of llo diagram. IiIo
mosl sysloms vill vlicl vo aro famiIiar, llo losl procossor connocls lo a rool
compIox. In lurn, llo rool compIox roulos ils lraffic lo llo svilcl. In llis oxam-
pIo, llo svilcl las lvo porls lo ond poinls in addilion lo llo upslroam porl for
llo primary losl vo lavo jusl doscribod. Iurllormoro, llis syslom aIso las
anollor procossor, vlicl is connoclod lo llo svilcl via anollor rool compIox.
PCI Express System Architecture
1008
Tlo svilcl porls lo boll procossors nood lo bo configurabIo lo bolavo oillor as
a lransparonl bridgo or a non-lransparonl bridgo. An IIIROM or slrap pins on
llo svilcl can bo usod lo iniliaIIy boolslrap llis configuralion.
Undor normaI oporalion, upon povor up, llo primary losl bogins lo onumoralo
llo syslom. In our oxampIo, as llo primary losl procossor bogins ils discovory
prolocoI llrougl llo fabric, il discovors llo lvo ond poinls, and lloir momory
roquiromonls, by sizing lloir BARs. Wlon il gols lo llo uppor rigll porl, il finds
a Typo 0 CSR loador. Tlis signifios lo llo primary losl procossor llal il slouId
nol allompl discovory on llo far sido of llo associalod svilcl porl. As in llo
provious oxampIo, llo BARs associalod vill llo non-lransparonl svilcl porl
may lavo boon configurod by IIIROM Ioad prior lo discovory or migll bo con-
figurod by soflvaro running on llo IocaI procossor.
- -- --
Appendix D: Intelligent Adapters & Multi-Host Systems
1009
Again, simiIar lo llo provious oxampIo, llo bacIup procossor povors up and
bogins lo onumoralo. In llis oxampIo, llo bacIup procossor clipsol consisls of
llo rool compIox and llo bacIup procossor onIy. Il discovors llo non-lranspar-
onl svilcl porl and lorminalos ils discovory lloro. Il is Ioyod by IIIROM
Ioadod Dovico ID and Vondor ID rogislors lo Ioad an approprialo drivor.
During llo courso of normaI oporalion, llo losl procossor porforms aII of ils
normaI dulios as il aclivoIy managos llo syslom. In addilion, il viII sond mos-
sagos lo llo bacIup procossor caIIod loarlboal mossagos. Hoarlboal mossagos
aro indicalions of llo conlinuod good loaIll of llo originaling procossor. A
loarlboal mossago migll bo as simpIo as a doorboII inlorrupl assorlion, bul lyp-
icaIIy vouId incIudo somo dala lo roduco llo possibiIily of a faIso posilivo.
ClocIpoinl and journaI mossagos aro aIlornalivo approaclos lo providing llo
bacIup procossor vill a slarling poinl, slouId il nood lo laIo ovor. In llo jour-
naI mollodoIogy, llo bacIup is providod vill a Iisl or journaI of compIolod
lransaclions (in llo appIicalion spocific sonso, nol in llo sonso of bus lransac-
lions). In llo clocIpoinl mollodoIogy, llo bacIup is poriodicaIIy providod vill
a compIolo syslom slalo from vlicl il can roslarl if nocossary. Tlo loarlboals
job is lo provido llo moans by vlicl llo bacIup procossor vorifios llal llo losl
procossor is sliII oporalionaI. TypicaIIy llis dala providos llo Ialosl aclivilios
and llo slalo of aII llo poriploraIs.
If llo bacIup procossor faiIs lo rocoivo limoIy loarlboal mossagos, il viII bogin
assuming conlroI. Ono of ils firsl lasIs is lo domolo llo primary porl lo provonl
llo faiIod procossor from inloracling vill llo rosl of llo syslom. Tlis is accom-
pIislod by roprogramming llo CSRs of llo svilcl using a momory mappod
viov of llo svilcls CSRs providod via a BAR in llo non-lransparonl porl. To
laIo ovor, llo bacIup procossor rovorsos llo lransparonl/non-lransparonl
modos al boll ils porl and llo primary procossors porl and laIos dovn llo IinI
lo llo primary procossor. Aflor cIoaning up any lransaclions Iofl in llo quouos
or Iofl in an incompIolo slalo as a rosuIl of llo losl faiIuro, llo bacIup procossor
roconfiguros llo syslom so llal il can sorvo as llo losl. IinaIIy, il usos llo dala in
llo clocIpoinl or journaI mossagos lo roslarl llo syslom.
PCI Express System Architecture
1010
ExampIe: ImpIementing DuaI Host in a PCI Express
Base System
Iiguro C-6 on pago 1010 iIIuslralos lov ICI Ixpross sysloms migll impIomonl
a duaI losl syslom
3
. In llis oxampIo, llo Ioflmosl bIocIs aro a lypicaIIy com-
pIolo syslom, vill llo rigllmosl bIocIs boing a soparalo subsyslom. As provi-
ousIy discussod, connocling llo Ioflmosl and rigllmosl diagram is a sol of non-
lransparonl bridgos.
3. Back to back non-transparent (NT) ports are unnecessary but occur as a result oI the
use oI identical single board computers Ior both hosts. A transparent backplane Iab-
ric would typically be interposed between the two NT ports.
- -- -
Appendix D: Intelligent Adapters & Multi-Host Systems
1011
Upon povor up, boll procossors viII bogin onumoraling. As boforo, llo losls
viII soarcl oul llo ondpoinls by roading llo CSR and llon aIIocalo momory
approprialoIy. Wlon llo losls oncounlor llo non-lransparonl bridgo porl in
oacl of lloir privalo svilclos, lloy viII assumo il is an ondpoinl and, using llo
dala in llo IIIROM, aIIocalo rosourcos. Boll sysloms viII uso llo doorboII and
maiIbox rogislors doscribod abovo lo communicalo vill oacl ollor.
2
Tlo duaI-losl syslom modoI may bo oxlondod lo a fuIIy rodundanl duaI slar
syslom by using addilionaI svilclos lo duaI-porl llo losls and Iino cards inlo a
rodundanl fabric as slovn in Iiguro C-7 on pago 1012. Tlis is parlicuIarIy
allraclivo lo vondors vlo ompIoy classis basod sysloms for lloir fIoxibiIily,
scaIabiIily and roIiabiIily.
Tvo losl cards aro slovn. Hosl A is llo primary losl of Iabric A and llo soc-
ondary losl of Iabric B. SimiIarIy, Hosl B is llo primary losl of Iabric B and llo
socondary losl of Iabric A.
Iacl losl is connoclod lo llo fabric il sorvos via a lransparonl bridgo/svilcl
porl and lo llo fabric for vlicl il providos onIy bacIup via a non-lransparonl
bridgo/svilcl porl. Tloso non-lransparonl porls aro usod for losl-lo-losl com-
municalions and aIso supporl cross-domain poor-lo-poor lransfors vloro
addross maps do nol aIIov a moro dirocl connoclion.
PCI Express System Architecture
1012
Summary
Tlrougl non-lransparonl bridging, ICI Ixpross Baso offors vondors llo abiIily
lo inlogralo inloIIigonl adaplors and muIli-losl sysloms inlo lloir noxl gonora-
lion dosigns. Tlis appondix domonslralod lov lloso foaluros viII bo dopIoyod
using do-faclo slandard loclniquos adoplod in llo ICI onvironmonl and
slovod lov lloy vouId bo uliIizod for various appIicalions. Bocauso of llis,
vo can oxpocl llis mollodoIogy lo bocomo llo induslry slandard in llo ICI
Ixpross paradigm.

Appendix D: Intelligent Adapters & Multi-Host Systems
1013
Address TransIation
Tlis soclion providos an in-dopll doscriplion of lov sysloms llal uso non-
lransparonl bridgos communicalo using addross lransIalion. Wo provido dolaiIs
aboul llo moclanism by vlicl sysloms dolormino nol onIy llo sizo of llo mom-
ory aIIocalod, bul aIso aboul lov momory poinlors aro ompIoyod. ImpIomonla-
lions using boll Dirocl Addross TransIalion as voII as IooIup TabIo Basod
Addross TransIalion aro discussod. By using llo samo slandardizod arcliloc-
luraI impIomonlalion of non lransparonl bridging popuIarizod in llo ICI para-
digm inlo llo ICI Ixpross onvironmonl, inlorconnocl vondors can spood marIol
adoplion of ICI Ixpross inlo marIols roquiring inloIIigonl adaplors, losl
faiIovor and muIlilosl capabiIilios.
Tlo lransparonl bridgo usos baso and Iimil rogislors in I/O spaco, non-profolcl-
abIo momory spaco, and profolclabIo momory spaco lo map lransaclions in llo
dovnslroam diroclion across llo bridgo. AII dovnslroam dovicos aro roquirod
lo bo mappod in conliguous addross rogions sucl llal a singIo aporluro in oacl
spaco is sufficionl. Upslroam mapping is dono via invorso docoding roIalivo lo
llo samo rogislors. A lransparonl bridgo doos nol lransIalo llo addrossos of for-
vardod lransaclions/pacIols.
Tlo non-lransparonl bridgos uso llo slandard sol of BARs in lloir Typo 0 CSR
loador lo dofino aporluros inlo llo momory spaco on llo ollor sido of llo
bridgo. Tloro aro lvo sols of BARs: ono on llo Irimary sido and ono on llo Soc-
ondary. BARs dofino rosourco aporluros llal aIIov llo forvarding of lransac-
lions lo llo opposilo (ollor sido) inlorfaco.
Ior oacl BAR bridgo lloro oxisls a sol of associalod conlroI and solup rogislors
usuaIIy vrilabIo from llo ollor sido of llo bridgo. Iacl BAR las a solup rog-
islor, vlicl dofinos llo sizo and lypo of ils aporluro, and an addross lransIalion
rogislor. Somo bars aIso lavo a Iimil rogislor llal can bo usod lo roslricl ils apor-
luros sizo. Tloso rogislors nood lo bo programmod prior lo aIIoving accoss
from oulsido llo IocaI subsyslom. Tlis is lypicaIIy dono by soflvaro running on
a IocaI procossor or by Ioading llo rogislors from IIIROM.
In ICI Ixpross, llo Transaclion ID fioIds of pacIols passing llrougl lloso apor-
luros aro aIso lransIalod lo supporl Dovico ID rouling. Tloso Dovico IDs aro
usod lo roulo compIolions lo non-poslod roquosls and ID roulod mossagos.
Tlo lransparonl bridgo forvards CSR lransaclions in llo dovnslroam diroclion
according lo llo socondary and subordinalo bus numbor rogislors, convorling
Typo 1 CSRs lo Typo 0 CSRs as roquirod. Tlo non-lransparonl bridgo accopls
onIy lloso CSR lransaclions addrossod lo il and rolurns an unsupporlod roquosl
rosponso lo aII ollors.
PCI Express System Architecture
1014
Direct Address TransIation
Tlo addrossos of aII upslroam and dovnslroam lransaclions aro lransIalod
(oxcopl BARs accossing CSRs). Will llo oxcoplion of llo casos in llo foIIoving
lvo soclions, addrossos llal aro forvardod from ono inlorfaco lo llo ollor aro
lransIalod by adding a Baso Addross lo lloir offsol villin llo BAR llal lloy
Iandod in as soon in Iiguro C-8 on pago 1014. Tlo BAR Baso TransIalion Rogis-
lors aro usod lo sol up lloso baso lransIalions for llo individuaI BARs.
Lookup TabIe Based Address TransIation
IoIIoving llo do faclo slandard adoplod by llo ICI communily, ICI Ixpross
slouId provido sovoraI BARs for llo purposos of aIIocaling rosourcos. AII BARs
conlain llo momory aIIocalion, lovovor, in accordanco vill ICI induslry con-
vonlions, BAR 0 conlains llo CSR informalion vloroas BAR1 conlains I/O
informalion, BAR 2 and BAR 3 aro uliIizod for IooIup TabIo Basod TransIalion.
BAR 4 and BAR 5 aro uliIizod for Dirocl Addross TransIalions.
On llo socondary sido, BAR3 usos a spociaI IooIup labIo basod addross lransIa-
lion for lransaclions llal faII insido ils vindov as soon in Iiguro C-9 on pago
1015. Tlo IooIup labIo providos moro fIoxibiIily in socondary bus IocaI
-- -
Appendix D: Intelligent Adapters & Multi-Host Systems
1015
addrossos lo primary bus addrossos. Tlo Iocalion of llo indox fioId vill llo
addross bus is programmabIo lo adjusl aporluro sizo.
Downstream BAR Limit Registers
Tlo lvo dovnslroam BARs on llo primary sido (BAR2/3 and BAR4/5) aIso
lavo Iimil rogislors, programmabIo from llo IocaI sido, lo furllor roslricl llo
sizo of llo vindov lloy oxposo, as soon in Iiguro C-10 on pago 1016. BARs can
onIy bo assignod momory rosourcos in povor of lvo granuIarily. Tlo Iimil
rogislors provido a moans lo oblain bollor granuIarily by capping llo sizo of
llo BAR villin llo povor of lvo granuIarily. OnIy lransaclions boIov llo
Iimil rogislors aro forvardod lo llo socondary bus. Transaclions abovo llo Iimil
aro discardod or rolurn 0xIIIIIIII, or a maslor aborl oquivaIonl pacIol, on
roads.
- -
PCI Express System Architecture
1016
Forwarding 64bit Address Memory Transactions
Corlain BARs can bo configurod lo vorI in pairs lo provido llo baso addross
and lransIalion for lransaclions conlaining 64-bil addrossos. Transaclions llal
lil villin lloso 64-bil BARs aro forvardod using Dirocl Addross TransIalion.
As in llo caso of 32 bil lransaclions, vlon a momory lransaclion is forvardod
from llo primary lo llo socondary bus, llo primary addross can bo mappod lo
anollor addross in llo socondary bus domain. Tlo mapping is porformod by
subsliluling a nov baso addross for llo baso of llo originaI addross.
- -
Appendix D: Intelligent Adapters & Multi-Host Systems
1017
A 64-bil BAR pair on llo syslom sido of llo bridgo is usod lo lransIalo a vindov
of 64-bil addrossos in pacIols originalod on llo syslom sido of llo bridgo dovn
boIov 232 in IocaI spaco.
PCI Express System Architecture
1018
1019

-- -
Tlis appondix Iisls llo cIass codos, sub-cIass codos, and programming inlorfaco
bylo dofinilions curronlIy providod in llo 2.3 ICI spocificalion.
-- -
-- -
-- -
00l Iunclion buiIl boforo cIass codos voro dofinod (in ollor vords:
boforo rov 2.0 of llo ICI spoc).
01l Mass slorago conlroIIor.
02l NolvorI conlroIIor.
03l DispIay conlroIIor.
04l MuIlimodia dovico.
05l Momory conlroIIor.
06l Bridgo dovico.
PCI Express System Architecture
1020
07l SimpIo communicalions conlroIIors.
08l Baso syslom poriploraIs.
09l Inpul dovicos.
0Al DocIing slalions.
0Bl Irocossors.
0Cl SoriaI bus conlroIIors.
0Dl WiroIoss conlroIIors.
0Il InloIIigonl IO conlroIIors.
0Il SaloIIilo communicalions conlroIIors.
10l Incryplion/Docryplion conlroIIors.
11l Dala acquisilion and signaI procossing conlroIIors.
12l-IIl Rosorvod.
IIl Dovico doos nol fil any of llo dofinod cIass codos.
--
-- -
00l 00l AII dovicos ollor llan VGA.
01l 01l VGA-compalibIo dovico.
-- -- -
-- -
00l 00l SCSI conlroIIor.
01l xxl IDI conlroIIor. Soo TabIo D-20 on pago 1031
for dofinilion of Irogramming Inlorfaco bylo.
-- -
-- -
Appendix D: Class Codes
1021
02l 00l IIoppy disI conlroIIor.
03l 00l III conlroIIor.
04l 00l RAID conlroIIor.
05l
20l ATA conlroIIor vill singIo DMA .
30l ATA conlroIIor vill clainod DMA.
80l 00l Ollor mass slorago conlroIIor.
-- -
-- -
00l 00l Illornol conlroIIor.
01l 00l ToIon ring conlroIIor.
02l 00l IDDI conlroIIor.
03l 00l ATM conlroIIor.
04l 00l ISDN ConlroIIor.
05l 00l WorIdIip conlroIIor.
06l IICMG 2.14 MuIli Compuling. Ior informalion
on llo uso of llo Irogramming Inlorfaco Bylo,
soo llo IICMG 2.14 MuIli Compuling
Spocificalion (lllp://vvv.picmg.com).
80l 00l Ollor nolvorI conlroIIor.
-- -- -
-- -
PCI Express System Architecture
1022
-- - -
-- -
00l 00l VGA-compalibIo conlroIIor, rosponding lo
momory addrossos 000A0000l llrougl
000BIIIIl (Vidoo Iramo Buffor), and IO
addrossos 03B0l llrougl 3BBl, and 03C0l-
llrougl-03DIl and aII aIiasos of lloso
addrossos.
01l 8514-compalibIo conlroIIor, rosponding lo IO
addross 02I8l and ils aIiasos, 02IAl and
02IIl.
01l 00l XGA conlroIIor.
02l 00l 3D ConlroIIor.
80l 00l Ollor dispIay conlroIIor.
-- -
-- -
00l 00l Vidoo dovico.
01l 00l Audio dovico.
02l 00l Compulor ToIoplony dovico.
80l 00l Ollor muIlimodia dovico.
-- -
-- -
00l 00l RAM momory conlroIIor.
01l 00l IIasl momory conlroIIor.
80l 00l Ollor momory conlroIIor.
Appendix D: Class Codes
1023
-- -
-- -
00l 00l Hosl/ICI bridgo.
01l 00l ICI/ISA bridgo.
02l 00l ICI/IISA bridgo.
03l 00l ICI/Micro ClannoI bridgo.
04l 00l ICI/ICI bridgo.
01l Sublraclivo docodo ICI-lo-ICI bridgo. Sup-
porls sublraclivo docodo in addilion lo normaI
ICI-lo-ICI funclions. Ior a dolaiIod discussion
of llis bridgo lypo, rofor lo llo MindSlaro
- booI, Iourll Idilion (pub-
Iislod by Addison-WosIoy).
05l 00l ICI/ICMCIA bridgo.
06l 00l ICI/NuBus bridgo.
07l 00l ICI/CardBus bridgo.
08l xxl RACIvay bridgo. RACIvay is an ANSI slan-
dard (ANSI/VITA 5-1994) svilcling fabric. Bils
7:1 of llo Inlorfaco bils aro rosorvod, road-onIy
and rolurn zoros. Bil 0 is road-onIy and, if 0,
indicalos llal llo bridgo is in Transparonl
modo, vliIo 1 indicalos llal ils in Ind-Ioinl
modo.
09l
40l Somi-lransparonl ICI-lo-ICI bridgo
vill llo primary ICI bus sido facing
llo syslom losl procossor.
80l Somi-lransparonl ICI-lo-ICI bridgo
vill llo socondary ICI bus sido
facing llo syslom losl procossor.
0Al 00l InfiniBand-lo-ICI losl bridgo.
80l 00l Ollor bridgo lypo.
PCI Express System Architecture
1024
-- - -
-- -
00l
00l Gonoric XT-compalibIo soriaI conlroIIor.
01l 16450-compalibIo soriaI conlroIIor.
02l 16550-compalibIo soriaI conlroIIor.
03l 16650-compalibIo soriaI conlroIIor.
04l 16750-compalibIo soriaI conlroIIor.
05l 16850-compalibIo soriaI conlroIIor.
06l 16950-compalibIo soriaI conlroIIor.
01l
00l IaraIIoI porl.
01l Bi-diroclionaI paraIIoI porl.
02l ICI 1.X-compIianl paraIIoI porl.
03l IIII 1284 conlroIIor.
IIl IIII 1284 largol dovico (nol a conlroIIor).
02l 00l MuIliporl soriaI conlroIIor.
Appendix D: Class Codes
1025
03l
00l Gonoric modom.
01l Hayos-compalibIo modom, 16450-compalibIo inlorfaco. BAR
0 maps llo modoms rogislor sol. Tlo rogislor sol can bo
oillor momory- or IO-mappod (as indicalod by llo lypo of
BAR).
02l Hayos-compalibIo modom, 16550-compalibIo inlorfaco. BAR
0 maps llo modoms rogislor sol. Tlo rogislor sol can bo
oillor momory- or IO-mappod (as indicalod by llo lypo of
BAR).
03l Hayos-compalibIo modom, 16650-compalibIo inlorfaco. BAR
0 maps llo modoms rogislor sol. Tlo rogislor sol can bo
oillor momory- or IO-mappod (as indicalod by llo lypo of
BAR).
04l Hayos-compalibIo modom, 16750-compalibIo inlorfaco. BAR
0 maps llo modoms rogislor sol. Tlo rogislor sol can bo
oillor momory- or IO-mappod (as indicalod by llo lypo of
BAR).
04l 00l GIIB (IIII 488.1/2) conlroIIor.
05l 00l Smarl Card.
80l 00l Ollor communicalions dovico.
-- - -
-- -
PCI Express System Architecture
1026
-- - - -
-- -
00l 00l Gonoric 8259 programmabIo inlorrupl conlroI-
Ior (IIC).
01l ISA IIC.
02l IISA IIC.
10l IO AIIC. Baso Addross Rogislor 0 is usod lo
roquosl a minimum of 32 bylos of non-Irofolcl-
abIo momory. Tvo rogislors villin llal spaco
aro Iocalod al Baso + 00l (IO SoIocl Rogislor)
and Baso + 10l (IO Windov Rogislor). Ior a fuII
doscriplion of llo uso of lloso rogislors, rofor lo
llo dala slool for llo InloI 8237IB in llo 82420/
82430 ICIsol IISA Bridgo DalabooI #290483-
003.
20l IO(x) AIIC inlorrupl conlroIIor.
01l 00l Gonoric 8237 DMA conlroIIor.
01l ISA DMA conlroIIor.
02l IISA DMA conlroIIor.
02l 00l Gonoric 8254 limor.
01l ISA syslom limors.
02l IISA syslom limors.
03l 00l Gonoric RTC conlroIIor.
01l ISA RTC conlroIIor.
04l 00l Gonoric ICI Hol-IIug conlroIIor.
80l 00l Ollor syslom poriploraI.
Appendix D: Class Codes
1027
-- -
-- -
00l 00l Koyboard conlroIIor.
01l 00l Digilizor (pon).
02l 00l Mouso conlroIIor.
03l 00l Scannor conlroIIor.
04l 00l Gonoric gamoporl conlroIIor.
10l Gamoporl conlroIIor. A gamoporl conlroIIor
vill a Irogramming Inlorfaco = 10l indicalos
llal any Baso Addross rogislors in llis funclion
llal roquosl/assign IO addross spaco, llo rogis-
lors in llal IO spaco conform lo llo slandard
Iogacy gamo porls. Tlo bylo al offsol 00l in
an IO rogion bolavos as a Iogacy gamoporl
inlorfaco vloro roads lo llo bylo rolurn joy-
slicI/gamopad informalion and vrilos lo llo
bylo slarl llo RC limor. Tlo bylo al offsol 01l is
an aIias of llo bylo al offsol 00l. AII ollor bylos
in an IO rogion aro unspocifiod and can bo usod
in vondor uniquo vays.
80l 00l Ollor inpul conlroIIor.
-- -
-- -
00l 00l Gonoric docIing slalion.
80l 00l Ollor lypo of docIing slalion.
PCI Express System Architecture
1028
-- ---
-- -
00l 00l 386.
01l 00l 486.
02l 00l Ionlium.
10l 00l AIpla.
20l 00l IovorIC.
30l 00l MIIS
40l 00l Co-procossor.
-- - -
-- -
00l 00l Iiroviro (IIII 1394).
10l IIII 1394 using 1394 OponHCI spoc.
01l 00l ACCISS.bus.
02l 00l SSA (SoriaI Slorago Arclilocluro).
03l 00l USB (UnivorsaI SoriaI Bus) conlroIIor using
UnivorsaI Hosl ConlroIIor spoc.
10l USB (UnivorsaI SoriaI Bus) conlroIIor using
Opon Hosl ConlroIIor spoc.
80l USB (UnivorsaI SoriaI Bus) conlroIIor vill no
spocific programming inlorfaco.
IIl USB dovico (nol Hosl ConlroIIor).
04l 00l Iibro ClannoI.
05l 00l SMBus (Syslom Managomonl Bus).
06l 00l InfiniBand.
Appendix D: Class Codes
1029
07l
00l IIMI SMIC Inlorfaco. Tlo rogislor inlorfaco dof-
inilions for llo InloIIigonl IIalform Manago-
monl Inlorfaco Sub-CIass 07l) aro in llo IIMI
spocificalion.
01l IIMI Kybd ConlroIIor SlyIo Inlorfaco
02l IIMI BIocI Transfor Inlorfaco
08l 00l SIRCOS Inlorfaco Slandard (IIC
61491). Tloro is no rogislor IovoI dofinilion for
llo SIRCOS Inlorfaco slandard. Ior moro
informalion soo IIC 61491.
09l 00l CANbus.
80l 00l Ollor lypo of SoriaI Bus ConlroIIor.
-- -- -
--
00 00l iRDA compalibIo conlroIIor
01l 00l Consumor IR conlroIIor
10l 00l RI conlroIIor
11l 00l BIuolooll.
12l 00l Broadband.
80l 00l Ollor lypo of viroIoss conlroIIor
-- - -
-- -
PCI Express System Architecture
1030
-- -
--
00l xxl InloIIigonl IO conlroIIor adloring lo llo I2O
Arclilocluro spoc. Tlo spoc can bo dovn-
Ioadod from flp.inloI.com/pub/IAI/i2o/.
00l Mossago IIIO al offsol 40l.
80l 00l Ollor lypo of InloIIigonl IO ConlroIIor.
-- - -
--
01l 00l TV
02l 00l Audio
03l 00l Voico
04l 00l Dala
80l 00l Ollor lypo of SaloIIilo Communicalions
ConlroIIor.
-- -
--
00l 00l NolvorI and compuling Incrypl/Docrypl.
10l 00l Inlorlainmonl Incrypl/Docrypl.
80l 00l Ollor Incrypl/Docrypl.
Appendix D: Class Codes
1031
: Tlo SIG documonl compIoloIy doscribos
llo Iayoul and moaning of bils 0 llrougl 3 in llo Irogramming Inlorfaco bylo.
Tlo documonl - - -
doscribos llo moaning of bil 7 in llo Irogramming Inlorfaco bylo. WliIo llo ICI
2.1 spoc slalod llal llis documonl couId bo oblainod via IAX by caIIing
(408)741-1600 and roquosling documonl 8038, llal roforonco vas romovod from
llo 2.3 spoc.
-- - -- -
--
00l 00l DIIO moduIos.
01l 00l Iorformanco counlors.
10l 00l Communicalions synclronizalion pIus
limo and froquoncy losl/moasuromonl.
20l 00l Managomonl card.
80l 00l Ollor Dala Acquisilion and SignaI Irocoss-
ing ConlroIIors.
-
- -
0 Oporaling modo (primary).
1 IrogrammabIo indicalor (primary).
2 Oporaling modo (socondary).
3 IrogrammabIo indicalor (socondary).
6:4 Rosorvod. Hardvirod lo zoro.
7 Maslor IDI dovico.
1033

--
-
Introduction
Nalivo ICI Ixpross impIomonlalions do nol supporl IocI. Supporl for IocIod
lransaclion soquoncos oxisl soIoIy for supporling Iogacy dovico soflvaro oxocul-
ing on llo losl procossor llal porforms a IocIod RMW (road-modify-vrilo)
oporalion on a momory somaploro llal may rosido villin llo momory of a Iog-
acy ICI dovico. Tlis claplor dofinos llo prolocoI dofinod by ICI Ixpross for
supporling IocIod accoss soquoncos llal largol Iogacy dovicos. IaiIuro lo sup-
porl IocI may rosuIl in doadIocIs.
Background
ICI Ixpross conlinuos llo ICI 2.3 lradilion of supporling IocIod lransaclion
soquoncos (RMWroady-modify-vrilo) lo supporl Iogacy dovico soflvaro. ICI
Ixpross dovicos and lloir soflvaro drivors aro novor aIIovod lo uso inslruclions
llal causo llo CIU lo gonoralo IocIod oporalions llal largol momory llal
rosidos bonoall llo Roor CompIox IovoI.
IocIod oporalions consisl of llo basic RMW soquonco, llal is:
1. Ono or moro momory roads from llo largol Iocalion lo oblain llo soma-
ploro vaIuo.
2. Tlo modificalion of llo dala villin a procossor rogislor.
3. Ono or moro vrilos lo vrilo llo modifiod somaploro vaIuo bacI lo llo lar-
gol momory Iocalion.
PCI Express System Architecture
1034
Tlis lransaclion soquonco musl bo porformod sucl llal no ollor accossos aro
pormillod lo llo largol Iocalions (or dovico) during llo IocIod soquonco. Tlis
roquiros bIocIing ollor lransaclions during llo oporalion. Tlo rosuIl polonliaIIy
can rosuIl in doadIocIs and poor porformanco.
Tlo dovicos roquirod lo supporl IocIod soquoncos aro:
- Tlo Rool CompIox.
- Any Svilclos in llo pall Ioading lo a Iogacy dovicos llal may bo llo largol
of a IocIod lransaclion sorios.
- A ICI Ixpross - lo - ICI Bridgo.
- A ICI Ixpross-lo-ICI-X Bridgo.
- Any Iogacy dovicos vloso dovico drivors issuo IocIod lransaclions lo mom-
ory rosiding villin llo Iogacy dovico.
No ollor dovicos musl supporl IocIod lransaclions and musl ignoro any IocIod
lransaclions llal lloy rocoivo.
IocI in llo ICI onvironmonl is acliovod, in parl, via llo uso of llo ICI IOCK#
signaI. Tlo oquivaIonl funclionaIily in ICI Ixpross is accompIislod via a lrans-
aclion llal omuIalos llo IOCK signaI funclionaIily.
The PCI Express Lock ProtocoI
Tlo onIy sourco of IocI supporlod by ICI Ixpross is llo syslom procossor, and,
as a consoquonco, llo sourco of aII IocIod oporalions in ICI Ixpross is llo Rool
CompIox (acling as llo procossors surrogalo). A IocIod oporalion is porformod
bolvoon a Rool CompIox dovnslroam porl and llo ICI Ixpross dovnslroam
porl lo vlicl llo largolod Iogacy dovico is allaclod. In mosl sysloms, llo Iogacy
dovico is lypicaIIy a ICI Ixpross-lo-ICI or ICI Ixpross-lo-ICI-X bridgo. OnIy
ono IocIod soquonco al a limo is supporlod for a givon liorarclicaI pall.
ICI Ixpross Iimils IocIod lransaclions lo Traffic CIass 0 and VirluaI ClannoI 0.
AII lransaclions vill TC vaIuos ollor llan zoro llal aro mappod lo a VC ollor
llan zoro aro pormillod lo lravorso llo fabric villoul rogard lo llo IocIod opor-
alion. AII lransaclions llal aro mappod lo VC0 aro subjocl lo llo IocI ruIos
doscribod in llis appondix. Tlo discussion of llo IocIod prolocoI in llis appon-
dix prosumos llal aII lransaclions lavo boon assignod lo TC0 (unIoss ollorviso
indicalod).
Appendix E: Locked Transaction Series
1035
Lock Messages The VirtuaI Lock SignaI
ICI Ixpross dofinos llo foIIoving lransaclions llal, logollor, acl as a virluaI
viro llal ropIacos llo ICI IOCK# signaI.
- - (MRdII) Originalos a IocIod soquonco.
Tlo firsl MRdII lransaclion bIocIs ollor roquosls from roacling llo largol
dovico. Ono or moro of lloso IocIod road roquosls may bo issuod during llo
soquonco.
- (CpIDII) Rolurns dala and
confirms llal llo pall lo llo largol is IocIod. A succossfuI road CompIolion
llal rolurns dala for llo firsl Momory Road IocI roquosl rosuIls in llo pall
bolvoon llo Rool CompIox and llo largol dovico boing IocIod. Tlal is,
lransaclions lravorsing llo samo pall from ollor porls aro bIocIod from
roacling oillor llo rool porl or llo largol porl. Transaclions boing roulod in
buffors for VC1-VC7 aro unaffoclod by llo IocI.
- (CpIIK) A CompIolion
villoul a dala payIoad indicalos llal llo IocI soquonco cannol compIolo
curronlIy and llo pall romains unIocIod.
- -- An unIocI mossago is issuod by llo Rool CompIox
from llo IocIod rool porl. Tlis mossago unIocIs llo pall bolvoon llo rool
porl and llo largol porl.
The Lock ProtocoI Sequence an ExampIe
Tlis soclion oxpIains llo ICI Ixpross IocI prolocoI by oxampIo. Tlo oxampIo
incIudos llo foIIoving dovicos:
- Tlo Rool CompIox llal inilialos llo IocIod lransaclion sorios on bolaIf of
llo losl procossor.
- A Svilcl in llo pall bolvoon llo rool porl and largolod Iogacy ondpoinl.
- A ICI Ixpross-lo-ICI Bridgo in llo pall lo llo largol.
- Tlo largol ICI dovico vlos Dovico Drivor inilialod llo IocIod RMW.
- A ICI Ixpross ondpoinl is incIudod lo doscribo Svilcl bolavior during
IocI.
In llis oxampIo, llo IocIod oporalion compIolos normaIIy. Tlo slops llal occur
during llo oporalion aro doscribod in llo lvo soclions llal foIIov.
PCI Express System Architecture
1036
The Memory Read Lock Operation
Iiguro I-1 on pago 1037 iIIuslralos llo firsl slop in llo IocIod lransaclion sorios
(i.o., llo iniliaI momory road lo oblain llo somaploro):
1. Tlo CIU inilialos llo IocIod soquonco (a IocIod Momory Road) as a rosuIl
of a drivor oxoculing a IocIod RMW inslruclion llal largols a ICI largol.
2. Tlo Rool Iorl issuos a Momory Road IocI Roquosl from porl 2. Tlo Rool
CompIox is aIvays llo sourco of a IocIod soquonco.
3. Tlo Svilcl rocoivos llo IocI roquosl on ils upslroam porl and forvards llo
roquosl lo llo largol ogross porl (3). Tlo svilcl, upon forvarding llo
roquosl lo llo ogross porl, musl bIocI aII roquosls from porls ollor llan llo
ingross porl (1) from boing sonl from llo ogross porl.
4. A subsoquonl poor-lo-poor lransfor from llo iIIuslralod ICI Ixpross ond-
poinl lo llo ICI bus (svilcl porl 2 lo svilcl porl 3) vouId bo bIocIod unliI
llo IocI is cIoarod. Nolo llal llo IocI is nol yol oslabIislod in llo ollor
diroclion. Transaclions from llo ICI Ixpross ondpoinl couId bo sonl lo llo
Rool CompIox.
5. Tlo Momory Road IocI Roquosl is sonl from llo Svilcls ogross porl lo llo
ICI Ixpross-lo-ICI Bridgo. Tlis bridgo viII impIomonl ICI IocI somanlics
(Soo llo MindSlaro booI onlilIod - , for
dolaiIs rogarding ICI IocI).
6. Tlo bridgo porforms llo Momory Road lransaclion on llo ICI bus vill llo
ICI IOCK# signaI assorlod. Tlo largol momory dovico rolurns llo
roquoslod somaploro dala lo llo bridgo.
7. Road dala is rolurnod lo llo Bridgo and is doIivorod bacI lo llo Svilcl via a
Momory Road IocI CompIolion vill Dala (CpIDII).
8. Tlo svilcl usos ID rouling lo rolurn llo pacIol upslroam lovards llo losl
procossor. Wlon llo CpIDII pacIol is forvardod lo llo upslroam porl of
llo Svilcl, il oslabIislos a IocI in llo upslroam diroclion lo provonl lraffic
from ollor porls from boing roulod upslroam. Tlo ICI Ixpross ondpoinl is
compIoloIy bIocIod from sonding any lransaclion lo llo Svilcl porls via
llo pall of llo IocIod oporalion. Nolo llal lransfors bolvoon Svilcl porls
nol invoIvod in llo IocIod oporalion vouId bo pormillod (nol slovn in llis
oxampIo).
9. Upon dolocling llo CpIDII pacIol, llo Rool CompIox Inovs llal llo IocI
las boon oslabIislod aIong llo pall bolvoon il and llo largol dovico, and
llo compIolion dala is sonl lo llo CIU.
Appendix E: Locked Transaction Series
1037
Read Data Modified and Written to Target and Lock Com-
pIetes
Tlo dovico drivor rocoivos llo somaploro vaIuo, aIlors il, and llon inilialos a
momory vrilo lo updalo llo somaploro villin llo momory of llo Iogacy ICI
dovico. Iiguro I-2 on pago 1038 iIIuslralos llo vrilo soquonco foIIovod by llo
Rool CompIoxs lransmission of llo UnIocI mossago llal roIoasos llo IocI:
10. Tlo Rool CompIox issuos llo Momory Wrilo Roquosl across llo IocIod pall
lo llo largol dovico.
11. Tlo Svilcl forvards llo lransaclion lo llo largol ogross porl (3). Tlo mom-
ory addross of llo Momory Wrilo musl bo llo samo as llo iniliaI Momory
Road roquosl.
- -
PCI Express System Architecture
1038
12. Tlo bridgo forvards llo lransaclion lo llo ICI bus.
13. Tlo largol dovico rocoivos llo momory vrilo dala.
14. Onco llo Momory Wrilo lransaclion is sonl from llo Rool CompIox, il sonds
an UnIocI mossago lo inslrucl llo Svilclos and any ICI/ICI-X bridgos in
llo IocIod pall lo roIoaso llo IocI. Nolo llal llo Rool CompIox prosumos
llo oporalion las compIolod normaIIy (bocauso momory vrilos aro poslod
and no CompIolion is rolurnod lo vorify succoss).
15. Tlo Svilcl rocoivos llo UnIocI mossago, unIocIs ils porls and forvards llo
mossago lo llo ogross porl llal vas IocIod lo nolify any ollor Svilclos
and/or bridgos in llo IocIod pall llal llo IocI musl bo cIoarod.
16. Upon dolocling llo UnIocI mossago, llo bridgo musl aIso roIoaso llo IocI
on llo ICI bus.
- --
Appendix E: Locked Transaction Series
1039
Notification of an UnsuccessfuI Lock
A IocIod lransaclion sorios is aborlod vlon llo iniliaI Momory Road IocI
Roquosl rocoivos a CompIolion pacIol vill no dala (CpIII). Tlis moans llal llo
IocIod soquonco musl lorminalo bocauso no dala vas rolurnod. Tlis couId
rosuIl from an orror associalod vill llo momory road lransaclion, or porlaps
llo largol dovico is busy and cannol rospond al llis limo.
Summary of Locking RuIes
IoIIoving is a Iisl of ordoring ruIos llal appIy lo llo Rool CompIox, Svilclos,
and Bridgos.
RuIes ReIated To the Initiation and Propagation of
Locked Transactions
- IocIod Roquosls vlicl aro compIolod vill a slalus ollor llan SuccossfuI
CompIolion do nol oslabIisl IocI.
- RogardIoss of llo slalus of any of llo CompIolions associalod vill a IocIod
soquonco, aII IocIod soquoncos and allomplod IocIod soquoncos musl bo
lorminalod by llo lransmission of an UnIocI Mossago.
- MRdII, CpIDII and UnIocI somanlics aro aIIovod onIy for llo dofauIl
Traffic CIass (TC0).
- OnIy ono IocIod lransaclion soquonco allompl may bo in progross al a givon
limo villin a singIo liorarcly domain.
- Any dovico vlicl is nol invoIvod in llo IocIod soquonco musl ignoro llo
UnIocI Mossago.
Tlo inilialion and propagalion of a IocIod lransaclion soquonco llrougl llo
ICI Ixpross fabric is porformod as foIIovs:
- A IocIod lransaclion soquonco is slarlod vill a MRdII Roquosl:
Any succossivo roads associalod vill llo IocIod lransaclion soquonco
musl aIso uso MRdII Roquosls.
Tlo CompIolions for any succossfuI MRdII Roquosl uso llo CpIDII
CompIolion lypo, or llo CIIII CompIolion lypo for unsuccossfuI
Roquosls.
PCI Express System Architecture
1040
- If any road associalod vill a IocIod soquonco is compIolod unsuccossfuIIy,
llo Roquoslor musl assumo llal llo alomicily of llo IocI is no Iongor
assurod, and llal llo pall bolvoon llo Roquoslor and CompIolor is no
Iongor IocIod.
- AII vrilos associalod vill a IocIod soquonco musl uso MWr Roquosls.
- Tlo UnIocI Mossago is usod lo indicalo llo ond of a IocIod soquonco. A
Svilcl propagalos UnIocI Mossagos llrougl llo IocIod Igross Iorl.
- Upon rocoiving an UnIocI Mossago, a Iogacy Indpoinl or Bridgo musl
unIocI ilsoIf if il is in a IocIod slalo. If il is nol IocIod, or if llo Rocoivor is a
ICI Ixpross Indpoinl or Bridgo vlicl doos nol supporl IocI, llo UnIocI
Mossago is ignorod and discardod.
RuIes ReIated to Switches
Svilclos musl dolocl lransaclions associalod vill IocIod soquoncos from ollor
lransaclions lo provonl ollor lransaclions from inlorforing vill llo IocI and
polonliaIIy causing doadIocI. Tlo foIIoving ruIos covor lov llis is dono. Nolo
llal IocIod accossos aro Iimilod lo TC0, vlicl is aIvays mappod lo VC0.
- Wlon a Svilcl propagalos a MRdII Roquosl from an Ingross Iorl lo llo
Igross Iorl, il musl bIocI aII Roquosls vlicl map lo llo dofauIl VirluaI
ClannoI (VC0) from boing propagalod lo llo Igross Iorl. If a subsoquonl
MRdII Roquosl is rocoivod al llis Ingross Iorl addrossing a difforonl
Igross Iorl, llo bolavior of llo Svilcl is undofinod. Nolo llal llis sorl of
spIil-IocI accoss is nol supporlod by ICI Ixpross and soflvaro musl nol
causo sucl a IocIod accoss. Syslom doadIocI may rosuIl from sucl accossos.
- Wlon llo CpIDII for llo firsl MRdII Roquosl is rolurnod, if llo CompIo-
lion indicalos a SuccossfuI CompIolion slalus, llo Svilcl musl bIocI aII
Roquosls from aII ollor Iorls from boing propagalod lo oillor of llo Iorls
invoIvod in llo IocIod accoss, oxcopl for Roquosls vlicl map lo clannoIs
ollor llan VC0 on llo Igross Iorl.
- Tlo lvo Iorls invoIvod in llo IocIod soquonco musl romain bIocIod unliI
llo Svilcl rocoivos llo UnIocI Mossago (al llo Ingross Iorl vlicl rocoivod
llo iniliaI MRdII Roquosl)
Tlo UnIocI Mossago musl bo forvardod lo llo IocIod Igross Iorl.
Tlo UnIocI Mossago may bo broadcasl lo aII ollor Iorls.
Tlo Ingross Iorl is unbIocIod onco llo UnIocI Mossago arrivos, and llo
Igross Iorl(s) vlicl voro bIocIod aro unbIocIod foIIoving llo lrans-
mission of llo UnIocI Mossago oul of llo Igross Iorl(s). Iorls llal voro
nol invoIvod in llo IocIod accoss aro unaffoclod by llo UnIocI Mossago
Appendix E: Locked Transaction Series
1041
RuIes ReIated To PCI Express/PCI Bridges
Tlo roquiromonls for ICI Ixpross/ICI Bridgos aro simiIar lo lloso for Svilclos,
oxcopl llal, bocauso lloso Bridgos onIy uso TC0 and VC0, aII ollor lraffic is
bIocIod during llo IocIod accoss. Tlo roquiromonls on llo ICI bus sido aro
doscribod in llo MindSlaro booI onlilIod -
(pubIislod by Addison-WosIoy).
RuIes ReIated To the Root CompIex
A Rool CompIox is pormillod lo supporl IocIod lransaclions as a Roquoslor. If
IocIod lransaclions aro supporlod, a Rool CompIox musl foIIov llo ruIos
aIroady doscribod lo porform a IocIod accoss. Tlo moclanism(s) usod by llo
Rool CompIox lo inlorfaco lo llo losl procossors ISB (Ironl-Sido Bus) aro oul-
sido llo scopo of llo spoc.
RuIes ReIated To Legacy Endpoints
Iogacy Indpoinls aro pormillod lo supporl IocIod accossos, aIllougl lloir uso
is discouragod. If IocIod accossos aro supporlod, Iogacy Indpoinls musl landIo
llom as foIIovs:
- Tlo Iogacy Indpoinl bocomos IocIod vlon il lransmils llo firsl CompIolion
for llo firsl road roquosl of llo IocIod lransaclion sorios accoss vill a Suc-
cossfuI CompIolion slalus:
If llo compIolion slalus is nol SuccossfuI CompIolion, llo Iogacy Ind-
poinl doos nol bocomo IocIod.
Onco IocIod, llo Iogacy Indpoinl musl romain IocIod unliI il rocoivos
llo UnIocI Mossago.
- WliIo IocIod, a Iogacy Indpoinl musl nol issuo any Roquosls using Traffic
CIassos vlicl map lo llo dofauIl VirluaI ClannoI (VC0). Nolo llal llis
roquiromonl appIios lo aII possibIo sourcos of Roquosls villin llo Indpoinl,
in llo caso vloro lloro is moro llan ono possibIo sourco of Roquosls.
Roquosls may bo issuod using Traffic CIassos vlicl map lo VCs ollor llan
VC0.
PCI Express System Architecture
1042
RuIes ReIated To PCI Express Endpoints
Nalivo ICI Ixpross Indpoinls do nol supporl IocI. A ICI Ixpross Indpoinl
musl lroal a MRdII Roquosl as an Unsupporlod Roquosl.

-
12x IacIol Iormal 413
1x IacIol Iormal 412
4x IacIol Iormal 412
8b/10b Docodor 402
8b/10b Incodor 400, 424

ACK 211
ACK DIII 91, 92, 202, 219
ACK/NAK Ialoncy 217, 237
ACK/NAK IrolocoI 90, 211, 212, 220
ACKD_SIQ Counl 214
ACKNAK_Ialoncy_Timor 217, 237
ACII 577
ACII Drivor 570, 579
ACII Maclino Ianguago 578, 580
ACII Sourco Ianguago 578, 580
ACII spoc 569
ACII labIos 577
Aclivo Slalo Iovor Managomonl 46, 87, 403, 608
Advancod Configuralion and Iovor Inlorfaco 569,
577
Advancod CorroclabIo Irror Roporling 385
Advancod CorroclabIo Irror Slalus 385
Advancod CorroclabIo Irrors 384
Advancod Irror CapabiIilios and ConlroI Rogislor
935
Advancod Irror CorroclabIo Irror MasI Rogislor
935
Advancod Irror CorroclabIo Irror Slalus Rogislor
936
Advancod Irror Roporling 382
Advancod Irror Roporling CapabiIily Rogislor Sol
931
Advancod Irror Rool Irror Command Rogislor 938
Advancod Irror Rool Irror Slalus Rogislor 938
Advancod Irror UncorroclabIo and UncorroclabIo
Irror Sourco ID Rogislor 938
Advancod Irror UncorroclabIo Irror MasI Rogislor
936
Advancod Irror UncorroclabIo Irror Sovorily Rogis-
lor 937
Advancod Irror UncorroclabIo Irror Slalus Rogislor
937
Advancod Sourco ID Rogislor 391
Advancod UncorroclabIo Irror HandIing 386
Advancod UncorroclabIo Irror Slalus 387
AGI CapabiIily 845
AGI Command Rogislor 846
AGI Command rogislor 846
AGI Slalus and AGI Command rogislors 845
AGI Slalus Rogislor 845
AGI Slalus rogislor 845
AMI 578, 580
AMI loIon inlorprolor 578
AIIC 16, 25, 353
ASI 578, 580
ASIM 568
ASIM Ixil Ialoncy 628
Assorl_INTx mossagos 348
Assigning VC Numbors 260
Async Nolico of SIol Slalus Clango 683
Allonlion Bullon Irossod Mossago 679
Allonlion Indicalor 657, 664
Allonlion_Indicalor_BIinI Mossago 679
Allonlion_Indicalor_Off Mossago 679
Allonlion_Indicalor_On Mossago 679
Aux_Curronl fioId 598

BARs 793
Baso Addross Rogislors 792, 811
Boacon 469, 497, 642, 643
BIR 455, 466
BIOS 577, 656, 886, 890
BIST 778
BIST rogislor 778
Bil Irror Ralo 455
Bil IocI 94, 440, 441, 465
Bridgo ConlroI Rogislor 835
BuiIl-In SoIf-Tosl 778
Bus Inumoralor 890
Bus Maslor 21, 833
Bus Numbor rogislor 726, 805
Bylo Counl Modifiod 188
bylo morging 801
Bylo Slriping 408
Bylo Slriping Iogic 400

CapabiIilios Iisl bil 336, 585, 779, 837, 840

CapabiIilios Ioinlor rogislor 585, 779, 780
CapabiIily ID 332, 585, 780, 859
Card Connoclor Iovor Svilcling Iogic 657
Card Informalion Slrucluro 782
Card Insorlion 658
Card Insorlion Irocoduro 661
Card Irosonl 657
Card RomovaI 658
Card RomovaI Irocoduro 659
Card Rosol Iogic 657
Cardbus 770, 777, 782

Claraclor 72, 77, 400

Claraclors 405
Classis and SIol Numbor Assignmonl 861
Classis Numbor 860
Classis, Ixpansion 862
Classis, main 862
Classis/SIol Numboring Rogislors 859, 863
CIS 782
CIass Codo 775, 875, 876, 882, 884, 1019
cIass codo 0 1020
cIass codo 1 1020
cIass codo 10l 1030
cIass codo 11l 1031
cIass codo 2 1021
cIass codo 3 1022
cIass codo 4 1022
cIass codo 5 1022
cIass codo 6 1023
cIass codo 7 1024
cIass codo 8 1026
cIass codo 9 1027
cIass codo A 1027
cIass codo B 1028
cIass codo C 1028
cIass codo D 1029
cIass codo I 1030
cIass codo I 1030
CIass Codo rogislor 774
CIass drivor 570, 774
codo imago 875, 878
Codo Typo 883, 885
CoId Rosol 95, 488
CoIIapsing INTx SignaIs 349
Command rogislor 832
company ID 953
CompIolor 37, 49, 50
CompIolor Aborl 366
CompIolion 160
CompIolion IacIol 184
CompIolion Slalus 187, 371
CompIolion Timo-oul 367
CompIolion W/Dala 160
CompIolion-IocIod 160
CompIolions 183
Config Typo 0 Road Roquosl 160
Config Typo 0 Wrilo Roquosl 160
Config Typo 1 Road Roquosl 160
Config Typo 1 Wrilo Roquosl 160
Configuralion Addross Iorl 724, 725, 726
Configuralion Command Rogislor 373
Configuralion Dala Iorl 724, 725
Configuralion Roquosl IacIol 180
Configuralion Roquosls 179
Configuralion Spaco Iayoul 895
Configuralion Slalus Rogislor 374
ConlroI Claraclor Incoding 430
ConlroI Mollod 578, 579
CorroclabIo Irrors 369
CRD 423
Crodil AIIocalod Counl 291
CRIDIT_AIIOCATID 292
Crodils Rocoivod Counlor 291
CRIDITS_CONSUMID 292
CRIDITS_RICIIVID 291
Curronl Running Disparily 423
Cul-Tlrougl 102, 248

D claraclors 405
D0 573, 576, 586
D0 Aclivo 587
D0 UniniliaIizod 586
D1 574, 576, 587
D1_Supporl bil 598
D2 574, 576, 589
D2_Supporl bil 597
D3 574, 576, 590
D3coId 592
D3lol 591
Dala IinI Iayor IacIol 71, 74
Dala Ioisoning 362
Dala Rogislor 603
Dala_ScaIo fioId 601
Dala_SoIocl fioId 602
DDIM 887
Doassorl_INTx mossagos 348
docodors 792
Do-omplasis 455, 466
DofauIl Dovico CIass Iovor Managomonl spoc 576
Dofinilion of On and Off 658
Do-ScrambIor 402
Dovico CapabiIilios Rogislor 900
Dovico CIass Iovor Managomonl spocs 576
Dovico Conloxl 574
Dovico ConlroI Rogislor 905
Dovico Drivor 656, 774, 791, 844, 872, 888,
891, 905
Dovico Drivor IniliaIizalion ModoI 887
Dovico ID 773, 876, 882, 883
Dovico IM Slalos 573, 586
Dovico ROM 783, 872
Dovico SoriaI Numbor CapabiIily 952
Dovico Slalus Rogislor 378, 909

Dovico-Spocific IniliaIizalion (DSI) bil 599

DifforonliaI Rocoivor 439
Digosl 166
Discard Timor SIRR# InabIo 837
Discard Timor Slalus 837
Discard unusod profolcl dala 801
Disparily 423
DIII 71, 74, 75, 111, 154, 198, 201
Dovnslroam 805
Dovnslroam Iorl 50
Drivor 681
DSI bil 599
DuaI SimpIox 41, 399

ICRC 166, 167

ICRC Gonoralion and ClocIing 361, 383
IDB 412
Igross Iorl 44, 50
IISA 724
IIaslic Buffor 402
IIoclricaI IdIo 41, 77, 108, 109, 432, 434, 454,
464
InabIing Irror Roporling 377
IND 412
Ind Tag doscriplor 851
Indpoinl 44, 48, 49, 51, 55
Ind-lo-Ind CRC 166
Irror CIassificalions 368
Irror HandIing 393
Irror HandIing Moclanisms 360
Irror Iogging 389
Irror Mossagos 370
Irror Roporling Moclanisms 359
Irror Sovorily 388
IUI-64 953
Ixpansion ROM 872
Ixpansion ROM Baso Addross Rogislor 783, 811,
872
Ixpansion ROM InabIo bil 784
Ixpansion SIol 860
Ixlonsion ID 953

Iasl BacI-lo-BacI InabIo 834, 836

IC IniliaIizalion Soquonco 305
Icodo dovico drivor 889
Icodo inlorprolor 889
Iirsl DW Bylo InabIos 164, 167
Iirsl-In-Classis bil 864
IIag 317
IIov ConlroI Buffor Sizo (max) 297
IIov ConlroI Buffors 288
IIov ConlroI Crodils 286, 289
IIov ConlroI IIomonls 290, 295
IIov ConlroI IniliaIizalion 294, 304
IIov ConlroI IacIol Iormal 205
IIov ConlroI IacIols 293
IIov ConlroI Updalo Iroquoncy 310
IIov ConlroI Updalos 308
Iorll 889
Iraming SymboIs 156, 400
ITS 109, 434
Iunclion IM Slalo Transilions 593
Iunclion Slalo Transilion DoIays 596
IundamonlaI Rosol 95, 487, 488

GonoraI Iurposo Ivonl 579

GII 579
GII landIor 579

Hardvaro Iixod VC Arbilralion 269

Hardvaro-Iixod Iorl Arbilralion 278
Hoador spaco 779
Hoador Typo Ono 777
Hoador Typo rogislor 777
Hoador Typo Tvo 777
Hoador Typo Zoro 777
Hoador Typo/Iormal IioId 165
Hiorarcly 49
Hiorarcly Domain 49
Hosl/ICI bridgo 727
Hol IIug IIomonls 655
Hol IIug Mossagos 197
Hol Rosol 95, 487, 491
Hol-IIug ConlroIIor 656
Hol-IIug primilivos 682
Hol-IIug Sorvico 655
Hol-IIug Syslom Drivor 655
Hub IinI 32, 33, 35, 51

IDI 774, 872, 1031

Idonlifior Slring doscriplor 851
IIII 953
IIII 1394 Bus Drivor 577
IIII slandard 1275-1994 888
In-band Rosol 491
Indicalor Bylo 883, 885
Infinilo IIov ConlroI Crodils 301
Ingross Iorl 44, 50
InilIC1-I DIII 201
IniliaI Irogram Ioad 872

IniliaIizalion codo 885

IniliaIizalion codo imago 876
Inilialor 118
inpul dovico 872
Inlorrupl DisabIo 346
Inlorrupl Ialoncy 341
inlorrupl Ialoncy 341
Inlorrupl Iino Rogislor 345, 791
Inlorrupl Iin Rogislor 343, 792
Inlorrupl Sorvico Roulino 886
Inlorrupl Slalus 346
Inlorrupl-RoIalod Rogislors 844
Inlor-symboI Inlorforonco 466, 467
INTx Mossago 193
INTx Mossago Iormal 351
INTx# Iins 342
INTx# SignaIing 345
IO Baso Addross Rogislor 797
IO Baso and IO Iimil rogislors 812
IO Docodor 797
IO docodor, Iogacy 798
IO Ixlonsion rogislors 812
IO Road Roquosl 160
IO Roquosl IacIol 172, 579
IO Roquosls 66, 171
IO Wrilo Roquosl 160
III 872
IRI 579
ISA InabIo bil 836
ISA IIug-and-IIay spocificalion 887
Isoclronous Transaclions 252

K claraclor 405
Ioyvords 851, 853

I0 Slalo 46, 403, 482

I0s Slalo 611
I1 ASIM 606, 609, 614
I1 ASIM Nogolialion 616
I1 Slalo 629
I2 Slalo 637
I2/I3 Roady slalo 633, 634
Iano 94, 95, 400, 408, 411, 415, 444
Iano RovorsaI 95
Iasl DW Bylo InabIos 165, 167
Ialoncy Timor Rogislors 843
ICRC 72, 213, 216, 221
Iogacy Indpoinl 49, 330, 332, 335, 352
IinI 13, 14, 41, 94, 101
IinI CapabiIilios Rogislor 609, 912
IinI ConlroI Rogislor 915
IinI Irrors 379
IinI IIov ConlroI-RoIalod Irrors 363
IinI Iovor Managomonl 606
IinI Slalus Rogislor 918
IinI Training and IniliaIizalion 94, 403, 496
IinI Widll 14, 41, 94, 913
Iov-priorily VC Arbilralion 267
ITSSM 213

MaIformod TII 364

Maslor Aborl Modo 836
MCH 28, 33
Momory Baso Addross Rogislor 794
Momory Baso and Iimil rogislors 823, 830
Momory Road IocI Roquosl 160
Momory Road Roquosl 160
Momory Roquosl IacIol 175
Momory Roquosls 64, 68, 174
Momory Spaco bil 784
Momory Wrilo and InvaIidalo InabIo 834
Momory Wrilo Roquosl 160
Momory-Mappod IO 793, 823, 830
Mossago Addross Rogislor 335, 336
Mossago ConlroI Rogislor 333, 336
Mossago Dala rogislor 335, 336
Mossago Roquosl IacIol 190
Mossago Roquosl W/Dala 160
Mossago Roquosls 63, 160, 190
Mossago SignaIod Inlorrupls 331
Miniporl Drivor 570
MSI 331, 791
MSI CapabiIily Rogislor 332
MSI Configuralion 336
MuIlipIo Mossago CapabIo fioId 336
MuIlipIo Mossagos 339

NAK DIII 87, 90, 202, 219

NAK ScloduIing 236
NAK_SCHIDUIID IIag 217, 233
Namospaco 577
Nov CapabiIilios Iisl 837
Noxl CapabiIily Ioinlor 859
NIXT_RCV_SIQ 203, 216, 219, 230
Non-IrofolclabIo Momory 796
Norll Bridgo 16, 23, 29
NuIIifiod IacIol 384, 431
Numbor of Ixpansion SIols 864

OnNov Dosign Inilialivo 571

Opon Iirmvaro 888
OponBool 885, 888
Ordor Managomonl 324
Ordorod-Sols 405
Ordoring RuIos Summary 327
OS bool procoss 888
Oulpul dovico 872

IA/RISC oxoculabIo codo 885

Iarily Irror Rosponso 834, 836
Iauso command 656, 681
Iausing a Drivor 681
ICI Bus Drivor 570, 571, 577
ICI Bus IM Inlorfaco Spocificalion 569
ICI Dala Slrucluro 880
ICI Ixpross CapabiIily ID Rogislor 898
ICI Ixpross CapabiIily Rogislor Sol 897
ICI Ixpross Indpoinl 49
ICI Inlorrupl SignaIing 342
ICI IM 569
ICI povor managomonl 557, 567, 649
ICI-CompalibIo Irror Roporling 372
ICI-lo-ICI Addross Docodo-RoIalod Rogislors 809
ICI-lo-ICI bridgo 727, 770, 777
ICI-lo-ICI bridgo lorminoIogy 805
IlysicaI SIol ID 681
IM CapabiIilios (IMC) Rogislor 597
IM CapabiIily Rogislors 585
IM ConlroI/Slalus (IMCSR) Rogislor 599
IM Ivonl (IMI) Conloxl 575
IM Rogislors 596
IM_Aclivo_Slalo_Roquosl_I1 201
IM_Inlor_I1 DIII 201
IM_Inlor_I23 201
IM_Roquosl_AcI 201
IMC Rogislor 597
IMCSR Rogislor 599
IMI CIocI bil 599
IMI Conloxl 575
IMI# 575
IMI_In bil 602
IMI_Slalus bil 601
IMI_Supporl fioId 597
IoIarily Invorsion 94, 95
Iorl 42, 44, 50
Iorl Arbilralion 45, 84, 85, 86, 263, 274, 277,
939
Iorl Arbilralion TabIo 276, 280, 952
Iorl VC CapabiIily Rogislor 1 941
Iorl VC ConlroI Rogislor 944
Iorl VC Slalus Rogislor 945
IOST 881
Iovor Budgol Rogislor Sol 955
Iovor Budgoling CapabiIily Rogislor 956
Iovor Budgoling Dala Rogislor 956
Iovor Budgoling Inlancod CapabiIily Hoador 955
Iovor Indicalor 665
Iovor IRI 579
povor managomonl 557, 567, 649
Iovor Managomonl DIII IacIol 204
Iovor Managomonl Mossagos 194
Iovor Managomonl IoIicy Ovnor 577
Iovor Managomonl Rogislor Sol 586, 596
Iovor_Indicalor_BIinI Mossago 679
Iovor_Indicalor_Off Mossago 679
Iovor_Indicalor_On Mossago 679
IovorIC 727
IovorSlalo fioId 603
IrofolclabIo Allribulo bil 795, 824
IrofolclabIo Momory 801, 829
IrofolclabIo Momory Baso and Iimil rogislors 823
Irimary bus 805
Irimary Bus Numbor rogislor 806
Irimary Discard Timooul 837
Irimilivos, lol-pIug 655, 682
Iroducor/Consumor ModoI 317
Irogramming Inlorfaco bylo 774

QoS 11, 80, 82, 83, 264

Quory Hol-IIug Syslom Drivor 682
Quory SIol Slalus 683
Quiosco 681
Quiosco command 656
Quioscing Card and Drivor 681

RCRB 275, 957, 958

Road/Wrilo VID Koyvords 856
RoIaxod Ordoring 319
RopIay 88
RopIay Buffor 88
RopIay Timor 384
Roquoslor 37, 49, 50
Rosumo command 656
Rolonlion Ialcl 666
Rolonlion Ialcl Sonsor 666
Rovision ID 773
ROM Dala Slrucluro 878, 881
ROM Doloclion 872

ROM Hoador 878, 879

ROM sladoving 875
Rool CompIox 42, 48, 49, 107, 131, 330, 352,
370, 390, 714, 718, 722, 727, 742, 753,
757, 761, 765
Rool CompIox Irror Slalus 390
Rool CompIox Rogislor BIocI 957
Rool ConlroI Rogislor 926
Rool Irror Command Rogislor 392
Rool Slalus Rogislor 928
Round Robin VC Arbilralion 270
RST# 657
Run limo codo imago 876
Rx CIocI Rocovory 440

SCI 579
ScrambIor 400, 416
SCSI 872
SDI 411
Socondary Bus 805
Socondary Bus Numbor rogislor 806
Socondary Bus Rosol bil 836
Socondary Discard Timooul 837
Socondary Ialoncy Timor Rogislor 843
Socondary Slalus Rogislor 840
Soquonco Numbor 213, 216, 234
SIRR# InabIo 834, 836
Sol SIol Slalus 683
Sovorily of Irror 388
sladov RAM 875
SKII 431, 432, 434
SIol CapabiIilios Rogislor 670, 920
SIol ConlroI 672
SIol ConlroI Rogislor 923
SIol Numbor Assignmonl 861
SIol Numboring Idonlificalion 668
SIol Numboring Rogislors 859, 863
SIol Iovor Iimil ConlroI 672
SIol Iovor Iimil Mossago 196
SIol Slalus Rogislor 925
Sofl Off 573
Soull Bridgo 16, 32
SpociaI CycIo 834
SpIil CompIolion, bridgo cIaiming of 807
Slarl command 656
Slalus Rogislor (Irimary Bus) 837
Slopping ConlroI bil 834
SlicIy Bils 383
STI 411
Slricl Iriorily VC Arbilralion 265
Slring Idonlifior doscriplor 855
Slrong Ordoring 321
Sub CIass 774
Subordinalo bus 805
Subordinalo Bus Numbor rogislor 726, 807
Subsyslom ID 776
Subsyslom Vondor ID 776
Surpriso RomovaI Nolificalion 652
Svilcl 11, 42, 48, 50, 86, 282
SymboI 43, 93, 400, 421, 405
SymboI IocI 94, 405, 441
Syslom ConlroI Inlorrupl 579
Syslom IM Slalos 572

Targol 20, 23, 24

TC 44
TC fiIloring 363
TC/VC Mapping 262
Timo-Basod, Woigllod Round Robin Arbilralion
279
TII 55, 57, 71, 154, 156
ToIon 578, 580, 889
Traffic CIass 44, 81, 87, 161, 164, 252, 256, 262,
318, 321, 363
Training Soquonco 1 405
Training Soquonco 2 405
Transaclion Doscriplor 169
Transaclion ID 169
Transaclion Iayor IacIol 55
Transaclion Typos 113
Transaclions 43
TransIaling SIol IDs 681
TS1 109, 405, 434
TS2 109, 405
TSIZ 727
Turning SIol On 659
Tx Buffor 404
Typo 0 configuralion lransaclion 727
Typo 1 configuralion lransaclion 727

UDI Supporlod bil 885

UncorroclabIo Irror Roporling 388
UncorroclabIo Irror Sovorily 388
UncorroclabIo IalaI Irrors 369
UncorroclabIo Non-IalaI Irrors 369
Unoxpoclod CompIolion 367
UnivorsaI Dovico Drivor 889
UnivorsaI/IocaI Bil 953
UnIocI Mossago 196
Unsupporlod Roquosl 365
Upslroam 805

Upslroam Iorl 50
USB Bus Drivor 577

VC 44
VC Arbilralion 44, 50, 84, 85, 86, 264, 267, 270,
765, 939, 944
VC Arbilralion TabIo 951
VC Rosourco CapabiIily Rogislor 946
VC Rosourco ConlroI Rogislor 948
VC Rosourco Slalus Rogislor 950
Vondor ID 773, 876, 882, 883
VGA 774
VGA dovico ROM 875
VGA InabIo bil 836
VGA IaIollo Snoop bil 834
VirluaI ClannoI 44, 83, 256, 260, 263, 270, 286,
288, 323, 324
VilaI Iroducl Dala 848, 882, 884
VID 848, 882, 884
VID ClocIsum 855
VID dala slrucluro 857
VID-R doscriplor 851, 853
VID-W doscriplor 852, 856

WAKI# SignaI 642, 696

Warm Rosol 95, 488
WDM Dovico Drivor 570, 577, 579
WoaI Ordoring 324
Woigllod Round Robin Iorl Arbilralion 279
Woigllod Round Robin VC Arbilralion 269
Windovs 95/98/NT/2000 569
Windovs Drivor ModoI 579
WorIing slalo 572