b0700bp C
b0700bp C
b0700bp C
REV C
Tables..................................................................................................................................... ix
Preface.................................................................................................................................... xi
Who This Book Is For ............................................................................................................. xi
What You Should Know .......................................................................................................... xi
Revision Information ............................................................................................................... xi
Reference Documents .............................................................................................................. xi
Glossary of Terms ................................................................................................................. xii
1. Introduction ...................................................................................................................... 1
Overview ................................................................................................................................... 1
Features ..................................................................................................................................... 3
Modes of Operation .................................................................................................................. 4
Nodebus Extender Mode ...................................................................................................... 4
LI Mode ............................................................................................................................... 5
Packet Forwarding ................................................................................................................ 5
ATS Migration ..................................................................................................................... 6
iii
B0700BP – Rev C Contents
3. Configuration Information.............................................................................................. 33
System Definition .............................................................................................................. 33
System Definition Procedure .............................................................................................. 33
5. Troubleshooting.............................................................................................................. 55
Overview ................................................................................................................................. 55
ATS Module Controls and Indicators ..................................................................................... 55
Operational Status LED Indicators .................................................................................... 57
Identifying the Primary and Backup ATS Module .............................................................. 57
Redundancy ............................................................................................................................ 58
ATS Troubleshooting ............................................................................................................. 58
Using the Operational Status LEDs .................................................................................... 59
Red off, Green off .......................................................................................................... 59
Red on, Green off .......................................................................................................... 59
Red on, Green on .......................................................................................................... 60
Red off, Green on .......................................................................................................... 61
Using the Tx and Rx/Link Status LEDs ............................................................................. 61
Redundant ATS Troubleshooting ...................................................................................... 61
Replacing a Failed Module ............................................................................................ 62
Memory Dumps and Last Gasp Messages ............................................................................... 62
Last Gasp Messages ............................................................................................................ 62
Memory Dumps ................................................................................................................. 63
Diagnostics ............................................................................................................................. 64
Start-Up Diagnostics .......................................................................................................... 64
Error Recovery Local Diagnostics ....................................................................................... 64
OM Variables ..................................................................................................................... 65
iv
Contents B0700BP – Rev C
Index .................................................................................................................................... 73
v
B0700BP – Rev C Contents
vi
Figures
1-1. ATS Single Module ....................................................................................................... 1
1-2. ATS Redundant Modules .............................................................................................. 2
1-3. ATS in LI Mode ........................................................................................................... 2
1-4. ATS in Nodebus Extender Mode .................................................................................. 5
1-5. Pre-Migration Topology ............................................................................................... 6
1-6. Post-Migration Topology .............................................................................................. 7
2-1. Installing an ATS Module in a 1x8 Mounting Structure ............................................. 10
2-2. Connecting a Single (Non-Redundant) ATS Module to The Mesh ............................ 15
2-3. Fiber Optic Cabling for Single ATS ............................................................................ 16
2-4. Copper Cabling a Single ATS to The Mesh ................................................................ 18
2-5. P0972MQ Cable Assembly ......................................................................................... 19
2-6. Removing the ATS Module Redundant Connector Cover .......................................... 20
2-7. Redundant Connector Installation on ATS Redundant Modules ................................ 21
2-8. Cabling for Redundant ATS ....................................................................................... 23
2-9. Fiber Optic Cabling for Redundant ATS .................................................................... 25
2-10. Copper Cabling the Redundant ATS to The Mesh ..................................................... 27
2-11. P0972MQ Cable Assembly ......................................................................................... 28
4-1. Accessing SMDH ATS Displays .................................................................................. 36
4-2. Switch Domain Display with ATS (Typical) ............................................................... 37
4-3. ATS Station Display ................................................................................................... 38
4-4. System Monitor Domain, ATS ................................................................................... 39
4-5. ATS Network Display ................................................................................................. 40
4-6. ATS Nodebus Display, Typical ................................................................................... 41
4-7. Equipment Information Display for ATS – Typical .................................................... 42
4-8. Configuration Information Display for ATS ............................................................... 46
4-9. Equipment Change Display for ATS ........................................................................... 47
4-10. REBOOT STATION Dialogue Box for Redundant Stations ..................................... 49
4-11. IMAGE UPDATE Dialogue Box ................................................................................ 50
4-12. MAC SUBLAYER Counters Display .......................................................................... 51
5-1. ATS Controls and Indicators (Redundant Modules Shown) ....................................... 56
A-1. Single ATS, Copper Connection to Ethernet Switches ................................................ 68
A-2. Redundant ATS, Copper Connection to Ethernet Switches ........................................ 69
A-3. Single ATS, Fiber Connection to Ethernet Switches ................................................... 70
A-4. Redundant ATS, Fiber Connection to Ethernet Switches ............................................ 71
vii
B0700BP – Rev C Figures
viii
Tables
1-1. The Mesh and Nodebus IP Traffic ................................................................................ 6
2-1. Fiber Cables for Connecting the ATS to the Ethernet Switches ................................... 17
2-2. Copper Cables for Connecting the ATS to the Ethernet Switches ............................... 19
4-1. Equipment Information Display Fields for ATS .......................................................... 43
4-2. Configuration Information Display Fields for ATS ..................................................... 46
4-3. Equipment Change Display Fields for ATS ................................................................. 47
4-4. MAC Sublayer Counters Display ................................................................................ 51
5-1. ATS Controls and Indicators ....................................................................................... 56
5-2. ATS Operational Status LEDs .................................................................................... 57
5-3. ATS Counters ............................................................................................................. 65
ix
B0700BP – Rev C Tables
x
Preface
This document provides information for installing, configuring, troubleshooting, and operating
the I/A Series® system Address Translation Station (ATS).
Revision Information
For this revision of the document (B0700BP-C), the following changes were made:
Chapter 4 “System Management”
♦ Added the “PRIM CABLE STATE” and “SHAD CABLE STATE” fields to “Equip-
ment Information Display” on page 42.
♦ Corrected the description for “CABLE STATE” on page 45.
Reference Documents
The following documents provide additional and related information:
♦ I/A Series Hardware Address Translation Station (PSS 21H-1C4 B4)
♦ I/A Series Letterbug Configurator (B0700AY)
♦ Integrated Control Configurator (B0193AV)
♦ I/A Series Configuration Component (IACC) User’s Guide (B0400BP)
♦ System Definition: A Step-by-Step Procedure (B0193WQ and associated on-line Help)
♦ System Management Displays (B0193JC)
♦ The MESH Control Network Architecture Guide (B0700AZ)
♦ Integrated Control Block Descriptions (B0193AX)
Most documents are available on the I/A Series Electronic Documentation CD-ROM
(K0173WT). The latest revisions of each document are also available through the Global Client
Support Center at http://support.ips.invensys.com.
xi
B0700BP – Rev C Preface
Glossary of Terms
The following acronyms are used in this document:
AW Application Workstation
CP Control Processor
IP Internet Protocol
LI LAN Interface
PDU Protocol Data Unit for software and Power Distribution Unit for hard-
ware
xii
Preface B0700BP – Rev C
xiii
B0700BP – Rev C Preface
xiv
1. Introduction
This chapter describes the main features, redundant operation, and network configuration of
the Address Translation Station.
Overview
The Address Translation Station (ATS) is a station that connects existing I/A Series system Node-
bus networks to The Mesh control network (herein referred to as The Mesh). When optionally
mated with a second ATS, the two operate as a redundant pair. The ATS can:
♦ Add The Mesh stations to an existing I/A Series Nodebus network, up to a combined
total of 1920 Nodebus and Mesh stations
♦ Replace the Nodebus LAN Interfaces, using the higher speed of The Mesh as the
backbone between nodes instead of the Carrierband LAN (Token Bus).
The Mesh
Copper Connections
An ATS can either run standalone (Figure 1-1), or with a second module running in a redundant
configuration. In the redundant configuration (Figure 1-2), the module pair has an interlink con-
nection between them, over which they negotiate the primary/backup roles. These modules install
in a 1x8 or 2x8 mounting structure on the same cell bus as the replaced LAN Interface (LI).
1
B0700BP – Rev C 1. Introduction
The Mesh
Copper Connections
Redundant
Connector
The Mesh
Nodebus Fiber Optic
Connections Connections
Carrierband LAN
Node ID 1 LI LI
Node ID 2 Node ID 3
Nodebus
Nodebus
Nodebus
AW AW AW 100 Mbps
10 Mbps
CP CP CP 5 Mbps
ATS ATS
Nodebus
The Mesh
Node ID 0
The Mesh and Nodebus
A multi node system can be connected to The Mesh by adding an ATS to only one node (see
Figure 1-3). Any node that wants to be directly connected to The Mesh must have an ATS (see
Figure 1-3). Only one node in a system may have both an ATS and a LI module. Additional
nodes do not need to be directly connected to The Mesh, but adding an ATS to other nodes:
2
1. Introduction B0700BP – Rev C
Features
The ATS in the I/A Series system provides the following features.
♦ Connects The Mesh to an existing I/A Series system Nodebus via standard 100 Mbps
Fast Ethernet fiber optic or copper cable
♦ Allows The Mesh stations to communicate with existing I/A Series system Nodebus
stations
♦ Allows “extending” an existing Nodebus based I/A Series system with FCP270 and
ZCP270 control stations.
♦ Replaces LAN Interfaces on a Carrierband network with the high speed Mesh as the
communications backbone between nodes
♦ Provides connection to a higher speed communication backbone. Reduces the net-
work load on the Carrierband network and provides a higher capacity backbone
3
B0700BP – Rev C 1. Introduction
♦ Permits IP communication between stations on the node and stations on The Mesh or
other nodes with an ATS
♦ Available in single or redundant configuration
♦ Uses soft letterbugs configurable via the I/A Series system Letterbug Configurator.
For enhanced serviceability during maintenance operations, the ATS is equipped with a recessed
reset button, located at the front of the module. This feature lets you manually reset the module
without removing the module from the mounting structure.
The ATS uses 100 Mbps Ethernet fiber or copper connections to communicate with I/A Series
stations connected to Ethernet switches in The Mesh. For information about general
guidelines and specific requirements for designing The Mesh, including site planning and net-
work installation guidelines, see The Mesh Control Network Architecture Guide (B0700AZ).
For instructions on installing and cabling the ATS in the single and redundant configurations, see
Chapter 2 “Installing the ATS Module”.
Modes of Operation
The ATS supports two modes of operation: running as a Nodebus extender or running as a LAN
Interface (LI). When the ATS initially boots (change of letterbug or reboot), it obtains a configu-
ration file from its host. The ATS stores and uses the file to determine if there is an LI on its node.
If there is an LI on its node it starts up in the extender mode (see “Nodebus Extender Mode” on
page 4); otherwise it starts in LI mode (see“LI Mode” on page 5). If the host workstation does not
download a configuration file, the ATS will not boot-up. Failure to find a configuration file causes
the ATS to wait, without passing communications, until the file is downloaded.
4
1. Introduction B0700BP – Rev C
Carrierband LAN
LI LI LI
Node ID 1 Node ID 2 Node ID 3
Nodebus
Nodebus
Nodebus
AW AW AW 100 Mbps
10 Mbps
CP CP CP 5 Mbps
ATS
Extender Mode
Nodebus
The Mesh
Node ID 0
The Mesh and Nodebus
The ATS transparently forwards traffic to The Mesh; Nodebus stations do not direct traffic to the
ATS as they would to an LI. Thus, Nodebus stations need no software changes to support the
ATS (although specific applications may require configuration changes). Packets that are actually
for the local node (for example, the AW communicating with the CP on node 2) are not trans-
lated or forwarded to The Mesh.
LI Mode
An ATS operates in LI mode when there isn't an LI on the same node (see Figure 1-3 on page 2).
If there are multiple Address Translation Stations on a network, at most one is in extender mode,
and the rest are in LI mode. In this mode, the ATS operates as the LI for the node, and uses the
special LI MAC address 00-00-6c-00-01-ff. Thus, it acts like an LI, but instead of connecting a
node to the Carrierband LAN, it connects a node to The Mesh.
The ATS in LI mode acts just like an LI when determining whether or not to forward packets
“off-node.” Figure 1-3 depicts a network with one ATS in extender mode (on node 2) and one
ATS in LI mode (on node 1). There is no LI on node 1, so the ATS on that node acts as the LI.
Node 1 is connected to the rest of the network through The Mesh and ATS on node 2. A network
whose Address Translation Stations are all in LI mode is shown in Figure 1-6 on page 7. ATSs
operating in the LI mode can be used to replace all LAN Interface modules.
Packet Forwarding
COMEX packets are forwarded through Address Translation Stations. The ATS ignores the
COMEX LAN ID for purposes of routing.
ATS replies on behalf of The Mesh stations for requests made from the Nodebus, and replies on
behalf of Nodebus stations for requests made from The Mesh. Thus, stations direct Internet Pro-
5
B0700BP – Rev C 1. Introduction
tocol (IP) traffic to the ATS to reach destinations on the other network. The limitations on IP
traffic are shown in Table 1-1.
Only Foxboro® COMEX and IP communications are forwarded by the ATS. Other protocols
that may be used by a customer are not forwarded.
ATS Migration
The ATS can be used in several different ways, depending on the needs of the customer. The ini-
tial network topology is shown in Figure 1-5.
Carrierband LAN
LI LI LI
Node ID 1 Node ID 2 Node ID 3
Nodebus
Nodebus
Nodebus
AW AW AW
CP CP CP
Nodebus 10 Mbps
5 Mbps
Figure 1-5. Pre-Migration Topology
First, the customer may decide to use the network topology as shown in Figure 1-3 and later
migrate to the final network topology shown in Figure 1-6.
6
1. Introduction B0700BP – Rev C
Nodebus
Nodebus
100 Mbps
Nodebus
AW AW AW
10 Mbps
CP CP CP
The Mesh
The Mesh and Nodebus
Node ID 0
The Mesh
AW FCP FCP
7
B0700BP – Rev C 1. Introduction
8
2. Installing the ATS Module
This chapter provides installation and cabling information for the ATS module.
Overview
The ATS (P0972VA) is available in two configurations, single and redundant modules. The single
and redundant ATS modules are identical. Communication between the two modules in the
redundant configuration takes place via a redundant connector, which is attached to the front of
the module pair after the modules are installed (see Figure 1-2 on page 2).
The ATS module(s) installs in a 1x8 or 2x8 mounting structure housed in I/A Series equipment
enclosures. For general information on installing equipment into these enclosures, refer to Enclo-
sures and Mounting Structures (B0700AS).
System Definition
You can use either the System Definition (SysDef ) or I/A Series Configuration Component
(IACC) application to identify the I/A Series system components, system software required by
each component, the system component letterbugs, IP and MAC addresses, and other system
characteristics for correctly loading system software and identifying the system software objects.
The letterbug is an alphanumeric string that the user defines to identify a station in an I/A Series
control system.
System definition is performed prior to installation of the system equipment, and it is updated
with any hardware/software system changes. Reports produced by SysDef or IACC define the
system network and provide information that can be used in conjunction with equipment
installation.
To define an I/A Series system configuration, refer to the following:
♦ System Definition: A Step-By-Step Procedure (B0193WQ)
♦ I/A Series Configuration Component (IACC) User’s Guide (B0400BP).
Also refer to “Configuration Information” on page 33.
! CAUTION
For safety reasons, always consider the possible impact on plant operations before
removing an ATS module from the mounting structure.
9
B0700BP – Rev C 2. Installing the ATS Module
I O I O
Cell Bus
Structure Short Captive
Mounting Screw
Reset Button
Mounting Structure
Cell Bus Connector
270025
Hardware ID
Label
Long Captive
Mounting Screw
Access Hole
10
2. Installing the ATS Module B0700BP – Rev C
! CAUTION
Make sure you install the additional 4 mm (12 AWG) earth (ground) wire on each
1x8 mounting structure and connect these earth wires to the enclosure earth as
instructed in System Power and Earthing (Grounding) (B0700AU) document. Failure
to earth the 1x8 mounting structure and enclosure as instructed increases the ATS
module susceptibility to electromagnetic interference (EMI), thus reducing the ATS
electromagnetic compatibility (EMC) immunity.
3. If not installed, install the Industrial Power Modules in the 1x8 mounting structure
and connect the power cables (see System Power and Earthing (Grounding) (B0700AU)
document).
! CAUTION
Install the BF162YG ferrite cores on the installed power supply cables as described
in System Power and Earthing (Grounding) (B0700AU) document. The P0903ZN
series power cables may come with the ferrite cores as part of the cable assembly.
4. On the ATS module(s), switch the 100TX/100FX mode selection switch to either the
100TX or the 100FX position (see “ATS Module Controls and Indicators” on
page 55) before installing the module(s).
5. Insert the single or primary ATS module (P0972VA) in its assigned slot in the desig-
nated mounting structure and push it firmly in place to seat the module cell bus con-
nector to the cell bus on the rear of the mounting structure. Note that an ATS
module(s) should be added to the same cell bus as the LI, if present.
NOTE
An ATS module that is to be installed in the 1x8 mounting structure or upper half
of the 2x8 mounting structure must be oriented as shown in Figure 2-1 (in the
upright position). An ATS module that is mounted in the lower half of the 2x8
mounting structure must be oriented in the inverted position.
6. Tighten the long captive mounting screw (bottom) from the front of the ATS module
using the hex driver tool (Foxboro part number X0179AZ). This fastens the ATS
module to the mounting structure bus.
! CAUTION
When using the hex driver tool (Foxboro part number X0179AZ) or other 5/32 hex
driver tool, make sure that it does not generate more than 12 inch/pound of torque,
or you might strip the threaded inserts out of the 1x8 mounting structure.
7. Tighten the short captive mounting screw near the top of the ATS module.
11
B0700BP – Rev C 2. Installing the ATS Module
NOTE
The long captive mounting screw should be tightened before the short mounting
screw. The short captive mounting screw must be tightened before any cable
connections can be made to the ATS module.
! WARNING
Make sure you assign the ATS letterbug before connecting the Ethernet fiber optic
or copper cables to the ATS module. This avoids potential process control safety issues
if a letterbug has previously been assigned to the module. Label space is provided on
the front of the module to record the letterbug.
10. If using a redundant pair, insert the backup ATS module (P0972VA) in its assigned
slot in the designated mounting structure and push it firmly in place to seat the mod-
ule cell bus connector to the cell bus on the rear of the mounting structure. Tighten
the long captive screw and then the short captive module mounting screw.
11. Connect the ATS module to Ethernet switches in The Mesh after assigning the letter-
bug to the ATS module. Refer to “ATS Letterbug Assignment” on page 12. If you
wish to connect all cables to the Ethernet switches before assigning a letterbug, refer to
either:
a. To connect a single (non-redundant) module to Ethernet switches in The Mesh,
see “Cabling a Single ATS Module to The Mesh Using Fiber Cables” on page 16
or “Cabling a Single ATS Module to The Mesh Using Copper Cables” on
page 18.
b. To connect a redundant module to Ethernet switches in The Mesh, see “Cabling a
Redundant ATS Module to The Mesh Using Fiber Cables” on page 24 or
“Cabling a Redundant ATS Module to The Mesh Using Copper Cables” on
page 26.
! CAUTION
Observe the signal and power cable separation and segregation guidelines in System
Power and Earthing (Grounding) (B0700AU) document.
12
2. Installing the ATS Module B0700BP – Rev C
For detailed procedures on using the Letterbug Configurator see Letterbug Configurator User’s
Guide (B0700AY) document.
If you are configuring a redundant ATS, start by installing only the primary module. Do not
install the backup module until you are instructed to install it.
NOTE
Redundant ATSs have different hardware IDs but share the same letterbug.
13
B0700BP – Rev C 2. Installing the ATS Module
The backup module boots, receives its ATS information from the primary module,
and lights the green and red Operational Status LED.
9. Connect The Mesh fiber optic or copper cables to the backup module as instructed in
either:
a. “Cabling a Redundant ATS Module to The Mesh Using Fiber Cables” on page 24
or
b. “Cabling a Redundant ATS Module to The Mesh Using Copper Cables” on
page 26.
You have now completed assigning a letterbug to either a single or redundant ATS. To assign
additional letterbugs, repeat these steps. To change existing letterbugs, change the letterbug in the
CSV file, remove the backup ATS module from the mounting structure and repeat these steps.
14
2. Installing the ATS Module B0700BP – Rev C
! CAUTION
When installing fiber optic cable, do not exceed the minimum bend radius of
5 cm (2 in).
RJ-45 Connector
OR
Notes: 1. Use 100 Mbps multi-mode fiber optic cables with LC to MT-RJ connectors (see Table 2-1).
2. Use 100 Mbps CAT 5 copper cables with RJ-45 connectors (see Table 2-2)
Figure 2-2. Connecting a Single (Non-Redundant) ATS Module to The Mesh
15
B0700BP – Rev C 2. Installing the ATS Module
NOTE
This procedure assumes that the fiber optic cables from the The Mesh have been
installed and available in the enclosure.
ATS
Duplex
Fiber Cable
(P0972TR/TS/TT)
Mesh Control Network
LC MT-RJ
Connectors Connectors
Figure 2-3. Fiber Optic Cabling for Single ATS
1. Remove the fiber optic port dust covers from the module’s Mesh Control Network A
and B ports (on the front of the ATS module).
NOTE
Retain the dust covers for use on any unconnected ports, future ATS module stor-
age, or when sockets are not in use.
2. Connect the module’s Mesh Control Network A connector on the front of the ATS
module to Group A Ethernet switch port in The Mesh, as assigned by SysDef or
16
2. Installing the ATS Module B0700BP – Rev C
IACC, using 100 Mbps fiber optic cable with LC to MT-RJ connectors (see
Table 2-1).
3. Connect the module’s Mesh Control Network B connector on the front of the ATS
module to Group B Ethernet switch port in The Mesh, as assigned by SysDef or the
I/A Series Configuration Component (IACC), using 100 Mbps fiber optic cable with
LC to MT-RJ connectors (see Table 2-1).
4. Verify, or switch the 100TX/100FX mode selection switch to the 100FX position (see
Figure 2-3). If you change the 100TX/100FX switch position, you must reboot the
ATS module. Press the Reset button on the ATS module to reboot the module.
Table 2-1. Fiber Cables for Connecting the ATS to the Ethernet Switches
17
B0700BP – Rev C 2. Installing the ATS Module
NOTE
This procedure assumes that the copper cables from the The Mesh have been
installed and available in the enclosure.
RJ-45
Connectors
P0972MQ
Ethernet Control Network
A
Ethernet Switch B
Copper Cable
See Table 2-2
ATS
18
2. Installing the ATS Module B0700BP – Rev C
2m
RJ-45 (6 ft)
Connector To
ATS Module
Ethernet Control
Network Connector
1. Snap one P0972MQ cable assembly (see Figure 2-5) to an earthed DIN rail within six
cable feet of the ATS module.
2. Route the P0972MQ cable and connect its RJ-45 plug connector to the Ethernet
Control Network A connector (second connector) on the top of the ATS module.
3. Snap another P0972MQ cable assembly to an earthed DIN rail within six cable feet of
the ATS module.
4. Route the P0972MQ cable and connect its RJ-45 plug connector to the Ethernet
Control Network B connector (closer to the front of the module) on the top of the
ATS module.
5. Plug the CAT5 cable (see Table 2-2) from the appropriate Group A Mesh switch port,
as assigned by SysDef or IACC, into the A Network’s P0972MQ DIN rail socket as
shown in Figure 2-4.
6. Plug the CAT5 cable (see Table 2-2) from the appropriate Group B Mesh switch port,
as assigned by SysDef or IACC, into the A Network’s P0972MQ DIN rail socket as
shown in Figure 2-4.
7. Set the 100TX/100FX mode selection switch to the 100TX position (see Figure 5-1
on page 56). If you change the 100TX/100FX switch position, you must reboot the
ATS module. Press the recessed Reset button on the ATS module to reboot the mod-
ule.
Table 2-2. Copper Cables for Connecting the ATS to the Ethernet Switches
19
B0700BP – Rev C 2. Installing the ATS Module
2. Place the backup module on a table and remove the redundant connector cover from
the front of the module as described in Step1.
3. Set the 100TX/100FX mode selection switch to the 100TX or the 100FX position
(see Figure 2-4).
4. Press the appropriate end of the redundant connector (P0926DF) by hand into the
receptacle on the front of the backup module (see Figure 2-7).
20
2. Installing the ATS Module B0700BP – Rev C
Redundant
Connector Receptacle
Redundant
Connector
(P0926DF)
Thumbscrew
5. Insert the backup module firmly into a slot adjacent to the primary module in the
1x8 mounting structure while simultaneously engaging the redundant connector into
the primary module.
After approximately 5 seconds, the backup module’s green operational status light-
emitting diode (LED) lights, indicating that the module has married to the primary
module.
6. Tighten the long captive mounting screw from the front of the module using the hex
driver tool (Foxboro part number X0179AZ). This fastens the module to the mount-
ing structure bus.
! CAUTION
When using the hex driver tool (Foxboro part number X0179AZ) or other 5/32 hex
driver tool, make sure that it does not generate more than 12 inch/pound of torque,
or you might strip the threaded inserts out of the 1x8 mounting structure.
7. Tighten the short captive mounting screw near the top of the module.
NOTE
The long captive mounting screw must be tightened before the short mounting
screw. The short captive mounting screw must be tightened before any cable
connections can be made to the ATS module.
8. Hand tighten the thumbscrew on the redundant connector to lock it in place (see
Figure 2-7).
21
B0700BP – Rev C 2. Installing the ATS Module
NOTE
Make sure the redundant connector is properly connected and its thumbscrew is
tight. If the module is the backup module, it can persist in the red-green state when
the redundant connector is improperly seated.
9. Connect the backup module to The Mesh Ethernet switches as instructed in “Cabling
a Redundant ATS Module to The Mesh Using Fiber Cables” on page 24 or “Cabling a
Redundant ATS Module to The Mesh Using Copper Cables” on page 26.
The backup module boots up and runs redundantly with the primary module as
described in one of the following boot-up sequences:
♦ “Case 2: Connecting a Backup Module with the Same Software Image” on
page 29
♦ “Case 3: Connecting a Backup Module with Different Software Image” on
page 30
10. Verify that the backup module is running redundantly with the primary module using
the Equipment Information display in System Management to confirm the following
(see Chapter 4 “System Management”):
PRIMARY MODE: Married Prim
SHADOW MODE: Married Shad
22
2. Installing the ATS Module B0700BP – Rev C
! CAUTION
1. Failure to properly connect the cables will result in the modules not being able to
operate in a redundant mode.
2. When installing fiber optic cables, do not exceed the minimum bend radius of
5 cm (2 in).
OR
Redundant ATS
23
B0700BP – Rev C 2. Installing the ATS Module
NOTE
This procedure assumes that the fiber optic cables from the The Mesh have been
installed and available in the enclosure.
1. Remove the port dust covers from the module’s Mesh Control Network A and B ports
(on the front of both ATS modules - fiber cable connectors from the Ethernet
switches).
NOTE
Retain the dust covers for use on any unconnected ports, future ATS module stor-
age, or when sockets are not in use.
2. Connect the module’s Mesh Control Network A connector on the front of the ATS
module to Group A Ethernet switch port in The Mesh, as assigned by SysDef or
IACC, using 100 Mbps fiber optic cable with LC to MT-RJ connectors (see Table 2-1
on page 17).
3. Connect the module’s Mesh Control Network B connector on the front of the ATS
module to Group B Ethernet switch port in The Mesh, as assigned by SysDef or
IACC, using 100 Mbps fiber optic cable with LC to MT-RJ connectors (see Table 2-1
on page 17).
4. Repeat steps 2 and 3 for the other ATS module (see Figure 2-9).
5. Set the 100TX/100FX mode selection switch to the 100FX position (see Figure 5-1
on page 56). If you change the 100TX/100FX switch position, you must reboot the
ATS module. Press the recessed Reset button on the ATS module to reboot the mod-
ule.
24
2. Installing the ATS Module B0700BP – Rev C
Reset Button
ATS
Duplex
Fiber Cable
(P0972TR/TS/TT) To/From
The Mesh
Mesh Control Network
Group A Switches
A
To/From
A
The Mesh
Group B Switches
Ethernet Fiber Switch B
Note: Fiber Optic splitter/combiners are not used with ATS. Each ATS cable attaches
to an individual port on the fiber optic Ethernet switch.
25
B0700BP – Rev C 2. Installing the ATS Module
NOTE
This procedure assumes that the copper cables from the The Mesh have been
installed and available in the enclosure.
26
2. Installing the ATS Module B0700BP – Rev C
RJ-45
Connector
P0972MQ
Ethernet Control Network
RJ-45
Connector To/From The Mesh
A
Earthed
DIN RJ-45
Rail Connectors
Mount
P0972MQ
Ethernet Control Network
RJ-45
Connector To/From The Mesh
A
Earthed RJ-45
DIN Connector
Rail
Mount
ATS
27
B0700BP – Rev C 2. Installing the ATS Module
2m
RJ-45 (6 ft)
Connector To
ATS Module
Ethernet Control
Network Connector
1. Snap one P0972MQ cable assembly (see Figure 2-11) to an earthed DIN rail within
six cable feet of the ATS module.
2. Route the P0972MQ cable and connect its RJ-45 plug connector to the Ethernet
Control Network A connector on the top of the ATS module.
3. Snap another P0972MQ cable assembly to an earthed DIN rail within six cable feet of
the ATS module.
4. Route the P0972MQ cable and connect its RJ-45 plug connector to the Ethernet
Control Network B connector on the top of the ATS module.
5. Plug the CAT5 cable (see Table 2-2 on page 19) from the appropriate Group A Mesh
switch port, as assigned by SysDef or IACC, into the A Network’s P0972MQ DIN
rail socket as shown in Figure 2-10.
6. Plug the CAT5 cable (see Table 2-2 on page 19) from the appropriate Group B Mesh
switch port, as assigned by SysDef or IACC, into the A Network’s P0972MQ DIN
rail socket as shown in Figure 2-10.
7. Repeat steps 1 through 6 for the other module.
8. Set the 100TX/100FX mode selection switch to the 100TX position (see Figure 5-1
on page 56). If you change the 100TX/100FX switch position, you must reboot the
ATS modules. Press the recessed Reset button on the ATS modules (both modules) to
reboot the modules.
28
2. Installing the ATS Module B0700BP – Rev C
Boot-Up Sequence
The boot up sequence for the ATS module has the following typical cases:
♦ Case 1: Rebooting a commissioned ATS module.
♦ Case 2: Connecting a backup module with the same software image to the 1x8
mounting structure and connecting The Mesh cables, after the primary module has
booted up and initialized on-control.
♦ Case 3: Connecting a backup module with different software image to the 1x8
mounting structure and connecting The Mesh cables, after the primary module has
booted up.
The boot up sequence for above cases are described as follows.
NOTE
For procedures to assign letterbugs to the ATS, see Letterbug Configurator User’s
Guide (B0700AY).
29
B0700BP – Rev C 2. Installing the ATS Module
NOTE
Since the backup module assumes the software image and letterbug of the primary
module, you can use this information to identify the module if its letterbug and
hardware ID are both unknown. Once the unknown module is running redun-
dantly its letterbug is now known, and its ID can be viewed from the Equipment
Information display in System Management, where the ID is the last six characters
of the SHAD ROM ADDRESS in Figure 4-7 on page 42.
30
2. Installing the ATS Module B0700BP – Rev C
NOTE
On an initial V8.1 (or later) installation with ATS(s), the initial time settings Day-
light Savings Time (DST) default values for Nodebus stations are MANUAL/
STANDARD. This means that manual intervention is required for Nodebus stations
to change from Standard Time to Daylight Savings Time and vice versa. To change
the DST time modes, refer to the document System Management Displays (B0193JC).
On initial installation or a letterbug change the ATS module waits for its station configuration file
to be downloaded from the host workstation. When the ATS module is powered up and the sys-
tem is operational, the system checks that the ATS letterbug and MAC addresses assigned are
unique. If they are unique, ATS passes data on the network. If they are not unique, the ATS fails
red/green. After configuration, an ATS does not need its boot host to be present to start “passing
data”.
31
B0700BP – Rev C 2. Installing the ATS Module
32
3. Configuration Information
This chapter provides system configuration information (system definition) and control
configuration information required for ATS.
In general, “configuration” means specifying, to the I/A Series system software, the types of hard-
ware and software modules that comprise the system, and the control blocks that will be used in
the control scheme.
System Definition
You can use either the SysDef or IACC application to identify the I/A Series system components,
system software required by each component, the system component letterbugs, and other system
characteristics for correctly loading system software and identifying the system software objects.
System definition with either SysDef or IACC produces a Commit disk, which is required for
software installation and, therefore, must be completed before software installation. It is initially
performed prior to installation of the system equipment, and it is updated with any hardware/
software system changes. Reports produced by SysDef or IACC define the network of the system
and provide information that can be used in conjunction with equipment installation. In the
future, if changes are made to the initial hardware layout, the system definition database must be
updated to reflect these changes.
Using SysDef or IACC, you define the quantity of ATSs, Ethernet switches and their letterbugs.
Letterbugs are unique, 6-character strings that identify stations, such as Ethernet switches and
ATSs to the I/A Series system software. Refer to “System Startup with ATS Modules” on page 31
33
B0700BP – Rev C 3. Configuration Information
34
4. System Management
This chapter provides general system management information for the Address Translation
Station. It also provides references to the manuals that describe the tools you use to perform in-
depth system management tasks.
35
B0700BP – Rev C 4. System Management
All ATSs are shown as stations designated by their letterbug. Figure 4-1 shows the displays and
menu bar soft keys used to access displays for ATSs that are part of an LAN Interface (LI) domain
or to access ATSs from the SW NETWORK displays.
From the SYSTEM MONITORS display or SYSTEM MONITOR DOMAIN display, you can
click NETWORK to view displays for ATSs that are part of a LAN Interface (LI) domain or SW
NTWRK to view the ATSs as part of the switch network.
System
DomainsMonitors Display
Click NETWORK or Click SW NTWRK
System
DomainsMonitor Domain Switched Network Display
Click NETWORK or Click SW NTWRK Click Switch
Click Next Level
Nodebus Equipment
Click EQUIP CHG
Display Change Display
Click EQUIP INFO (Figure 4-7)
(Figure 4-6)
Click ATS Click CONFIG INFO
Equipment
Information Display
(Figure 4-8)
Equipment
Configuration Display
(Figure 4-9)
Figure 4-1. Accessing SMDH ATS Displays
36
4. System Management B0700BP – Rev C
If a fault on cable A or cable B is detected, the faulty cable, or switch, is identified on the
SWITCH DOMAIN DISPLAY by the mnemonic RA (Receive A), RB (Receive B) or RAB
(Receive A and Receive B) appearing next to the receive cable as shown below:
37
B0700BP – Rev C 4. System Management
RA RB
38
4. System Management B0700BP – Rev C
39
B0700BP – Rev C 4. System Management
Nodebus Display
The NODEBUS DISPLAY shows the ATS station (Figure 4-6) that connects the selected Node-
bus to The MESH, and all the stations attached to that Nodebus.
40
4. System Management B0700BP – Rev C
From the NODEBUS DISPLAY you click on the ATS symbol and then select
♦ Equipment Information (EQUIP INFO)
♦ Configuration Information (CONFIG INFO).
♦ Equipment change (EQUIP CHG)
If a fault on the Nodebus cable A or cable B is detected, the faulty cable is identified on the
NODEBUS DISPLAY by the mnemonic RA (Receive A), RB (Receive B) or RAB (Receive A and
Receive B) appearing next to the ATS module as shown below:
RA BAD CBL A
41
B0700BP – Rev C 4. System Management
42
4. System Management B0700BP – Rev C
Field Description
STATION NAME ATS letterbug assigned during definition of system hardware.
RUN MODE On-line or Off-line. This field is initially Off-line. It changes to
On-line when the ATS reports to the System Monitor after
booting up. If reporting is disabled, the last known state appears in this
field.
RUN MODE and FAIL STATE should be viewed as separate, but
related fields. Although certain Equipment Change options change the
RUN MODE to Off-line, they do not fail the
station. However, a failed station will result in the RUN MODE
changing to Off-line.
The field changes to Off-line if any of the following occur:
♦ Reboot of the station
♦ IMAGE update
♦ Power failure
♦ Any station hardware failure or communication failure that
results in the station no longer being able to send its internal
reports for one minute or more.
For redundant stations, refer to the PRIMARY MODE and
SHADOW MODE fields for the current RUN MODE of each
module of the pair.
FAIL ACK STATE Acknowledged or Not Acknowledged. This field is initially set to
Acknowledged. If the FAIL STATE changes from Not Failed to Failed,
the FAIL ACK STATE field changes to Not Acknowledged to indicate
this transition. Use the ACK key in the top menu bar of the
Equipment Information Display to acknowledge the selected faulted
device or use the ACK ALL key in the top menu bar of the initial
System Management Display to acknowledge all the unacknowledged
devices for which the selected system monitor has responsibility.
FT STATE State is Operational or Non-Operational for redundant ATS. FT
STATE indicates Non Operational if the backup module is not
installed/configured.
FAIL DEV ACK This field is initialized to Acknowledged. If any of the attached devices
become unacknowledged, the field changes to Not Acknowledged.
EE UPDATE STATE EE Updating or Not Updating. This field is initially set to Not
Updating. When IMAGE UPDATE is selected under Equipment
Change options, the status changes to EE Updating until the ATS
image (operating system software) has been burned to flash memory.
For redundant stations, refer to the PRIMARY MODE and
SHADOW MODE fields for the current EEPROM Updating State.
For more information, see “IMAGE UPDATE Procedure” on page 49.
43
B0700BP – Rev C 4. System Management
Field Description
SM REPORT STATE Report All or No Reporting. This refers to the type of internal
reporting taking place from the ATS Station Manager to the System
Monitor. The various states are selectable from the Equipment Change
Display ENABLE ALL REPORTS and DISABLE ALL REPORTS.
The default setting is Report All.
PRIMARY MODE Single Prim, Married Prim, EE Updating, Downloading, or Failed.
Married Prim indicates running in hot standby.
PRIM ROM ADDRESS A six-octet MAC address of the Primary ATS assigned during manu-
facturing. The last six characters of this address is the module hardware
ID which is stamped on a label on the module’s outer cover (see
Figure 2-1 on page 10).
PRIM HARD PART Primary ATS hardware part number.
PRIM HARD REV Primary ATS hardware revision number.
PRIM HARD DATE Primary ATS hardware manufacturing date.
PRIM EEPROM REV Primary ATS EEPROM revision level
PRIM CABLE STATE Indicates the status of the Primary module’s cables for The MESH net-
work (Both Cables OK, Cable A Fault or Cable B Fault). See “CABLE
STATE” on page 45 for more details.
STATION ADDRESS Six-octet Nodebus MAC address. This field specifies a Nodebus MAC
address that is used by other stations in the system to communicate
with the ATS. All ATSs in LI mode have the same address
00-00-6c-00-01-ff.
TYPE Type of station defined when the letterbug is assigned during the site
planning and system definition phases. Z-Module ATS has the type
“Addr Trans Sta”.
FAIL STATE Failed or Not Failed. This field is initially Not Failed. This field
changes to Failed if any of the following occur:
♦ A hardware problem causes the station to fail for more than two
minutes
♦ A physical pull/push of the station (requiring more than two
minutes to come back on-line) is performed
♦ Any station hardware failure or communication failure that
results in the station no longer being able to send its internal
reports for one or more minutes.
System messages may provide additional information on the failure.
However, the immediate action should be to replace the station.
Operator-initiated Equipment Change actions (REBOOT, IMAGE
UPDATE) change the RUN MODE to off-line, but do not change
the FAIL STATE to Failed.
For redundant stations, refer to the PRIMARY MODE and
SHADOW MODE fields for the current FAIL STATE of each
module in the redundant pair.
44
4. System Management B0700BP – Rev C
Field Description
ALARMING STATE Indicates whether alarming for system alarms is Enabled or Inhibited
for the station. When alarming is Inhibited, the System Monitor con-
tinues to indicate overall system and network health (a green “Sys” bar)
while equipment is failed or off-line.
Additionally, when alarming is inhibited, System Alarm messages are
not logged to the system printer or Historian.
FAIL DEV ATT Yes or No. Yes if one or more cables attached to the ATS are failed.
DIAG STATE Not Active.
DOWNLOAD STATE Downloading or Not Downloading. This field is initially set to Not
Downloading. When the station is rebooted via an operator-initiated
request, the status changes to Downloading until the action is
completed. For redundant stations, refer to the PRIMARY MODE
and SHADOW MODE fields for the current Downloading State.
CABLE STATE Fault or OK indicates the status of The MESH Ethernet cables
to/from ATS. If a fault on cable A and/or cable B is detected, Fault
appears in this field. The faulty cable, or switch, is identified on the
SWITCH DOMAIN DISPLAY by the mnemonic RA (Receive A),
RB (Receive B) or RAB (Receive A and Receive B) appearing next to
the receive cable. See “Accessing ATS Displays from the Switch Net-
work” on page 36.
SHADOW MODE Married Shadow, EE Updating, Downloading, Failed, or Off-line
appears for redundant ATSs. A non-existent backup module is marked
as Off-line. Married Shadow indicates running in hot standby.
SHAD ROM ADDRESS Last known six-octet MAC address of the backup ATS. This is
assigned during manufacturing. The last six characters of this address
are the module hardware ID, which is stamped on a label on the
module’s outer cover (see Figure 2-1 on page 10). For a non-existent
backup module, this field is all zeroes.
SHAD HARD PART Last known backup ATS hardware part number. This field is blank if
the backup ATS does not exist.
SHAD HARD REV Last known backup ATS hardware revision number. This field is blank
if the backup ATS does not exist.
SHAD HARD DATE Last known backup ATS hardware manufacturing date. This field is
blank if the backup ATS does not exist.
SHAD EEPROM REV Last known backup ATS EEPROM revision level. This field is blank if
the backup ATS does not exist.
SHAD CABLE STATE Indicates the status of the Shadow module’s cables for The MESH
network (Both Cables OK, Cable A Fault or Cable B Fault). See
“CABLE STATE” above for more details.
MT REPORT STATE GPS Not Config. This field is not used by the ATS.
45
B0700BP – Rev C 4. System Management
Field Description
STATION NAME ATS letterbug assigned during definition of system hardware.
TYPE Type of station defined when the letterbug is assigned during site plan-
ning and system definition phases. This should read “Addr Trans Sta”.
SMON NAME System monitor name for the selected ATS.
SMON AP NAME Name of the workstation that hosts the ATS system monitor.
LI NAME The letterbug of the LI on the node, or the ATS letterbug (if it is run-
ning in LI mode)
BOOT HOST Boot image host name for the selected ATS.
IP ADDR Internet Protocol network address.
SW CONNECTION Ethernet switches to which the ATS is connected per system
configuration.
46
4. System Management B0700BP – Rev C
! CAUTION
Only designated personnel who are aware of the effects of making equipment
changes should initiate equipment changes.
Action Description
CHECKPOINT Not used by ATS.
COMMAND
ENABLE STATION Enables the ATS system alarms to be propagated up the
ALARMING equipment hierarchy and enables ATS system alarm messages.
INHIBIT STATION Prevents the ATS alarms from being propagated up the
ALARMING equipment hierarchy and disables ATS alarm messages.
REBOOT STATION Restarts the ATS.
47
B0700BP – Rev C 4. System Management
Action Description
IMAGE UPDATE Updates the existing ATS software image in flash memory with new
software image if ENABLE DOWNLOAD is active on the Equip-
ment Change display. The update downloads a file and burns it to
flash memory. The system printer logs the update results.
The REBOOT Station and IMAGE UPDATE (EEPROM Update) and their procedures are
described below.
NOTE
For more information and procedures for performing equipment change actions,
refer to I/A Series System Management Displays (B0193JC).
48
4. System Management B0700BP – Rev C
! CAUTION
Rebooting a single ATS disrupts communication for the node that the ATS is con-
nected to.
To reboot a ATS:
1. Access the Equipment Change display for the desired ATS (refer to I/A Series
System Management Displays (B0193JC).
2. In the Equipment Change Display, ensure that the Enable Download state is active. If
it is not, click ENABLE DOWNLOAD.
3. Click REBOOT STATION.
If this is a redundant station, a dialog box (Figure 4-10)offers choices for primary
module, backup module, or both.
! CAUTION
Image Updating a single ATS disrupts communication for the node that the ATS is
connected to.
49
B0700BP – Rev C 4. System Management
While the IMAGE UPDATE runs, the system sends standard update progress mes-
sages to the system printer.
NOTE
Selecting IMAGE UPDATE for a redundant ATS automatically updates both mod-
ules of the redundant pair. Once initiated, the IMAGE UPDATE process is entirely
automatic.
4. To verify the new image revision levels, use one of the following procedures:
♦ Enter the Command Prompt window on the Application Workstation hosting the
updated ATS, and start the Frev utility by typing the following command:
/opt/fox/bin/tools/frev >/tmp/frev.log
♦ Use the Equipment Information display to view the updated EEPROM version in
the PRIM EEPROM REV field and SHAD EEPROM REV field if the ATS is
redundant.
50
4. System Management B0700BP – Rev C
Threshold
Counter Description Value Possible Reason for Increment
802.3 MAC The “MAC RESETS” counters 2 Causes of large numbers of resets include:
RESETS indicate the number of initial- - Significant Network problems due to bad
802.4 MAC izations of the MAC chips switches, bad cables, or extremely high
RESETS caused by error isolation traffic levels (steady state or bursts)
software. - Frequent maintenance activity such as
adding/removing associated switches,
cables or ATS stations.
- Rebooting ATS stations from SMDH.
- Station Hardware faults.
EXCESS For Mesh stations, indicates 0 for normal - Bad cable or bad receiver.
COLLISIONS the number of times the pri- operation of - Problem in Ethernet switches.
mary port lost network con- The Mesh
nectivity with the backup port. network
51
B0700BP – Rev C 4. System Management
System Messages
System messages are classified as either priority-one (High) or priority-two (Low) messages.
Priority-one messages, requiring immediate attention, are those sent to the workstations des-
ignated to report system alarms. This type is also sent to the historian and to a high-priority
message printer.
Priority-two messages, those usually not requiring the user's immediate attention, are sent to
the historian and to a low-priority message printer.
The standard message line contains the following constants:
(mm-dd-yy) = month-date-year
(HH:MM:SS) = hour-minute-second
(PRI <subsystem>) = the primary software (i.e., PRI SYSMON=SYSMN1)
(SM_MSG) = the type
(-00058) = the file code
“Transmitter B failed” = the Message
The diagnostic message format for ATS as it is actually printed using the above listed
parameters:
mm-dd-yy HH:MM:SS PRI SYSMON= ATSSS Process=smon_ech
SYSMN1
Printed Messages
The FTX (fault tolerant communication) messages listed below are those contained in the
“message line” of the printed format line for ATS. The FT (fault tolerant) State Sequencer is
used in the ATS to negotiate the states necessary to run redundant ATS modules.
52
4. System Management B0700BP – Rev C
53
B0700BP – Rev C 4. System Management
SMDH failure messages (not status) appearing in EQUIP INFO displays (see “System Man-
agement Displays for the ATS” on page 35) are also displayed on the system monitor displays
when configured for alarming.
54
5. Troubleshooting
This chapter describes possible ATS failure situations and provides diagnostic routines that
allow you to locate and resolve unit failures quickly.
Overview
In most cases, problems may occur because the ATS is misconfigured or there are faulty network
connections. In the event of a true hardware failure, the I/A Series maintenance approach is ori-
ented toward module replacement. Removing one module of a redundant pair has no affect on
the operation of the other module or any other module.
55
B0700BP – Rev C 5. Troubleshooting
The Mesh
Copper Connections
Short Captive Mounting Screw
Reset Button
Redundant Connector
The Mesh
Fiber Connection A
The Mesh
Fiber Connection B
100TX/100FX
Selection Switch
The Mesh
Transmit/Receive/Link Indicators
Nodebus Transmit/Receive
Indicators
Infrared Port
Green Operational Status LED
Red Operational Status LED
Long Captive Mounting Screw
Item Description
Mesh Control Network A or B Tx LED is on when the ATS is transmitting data over The
Mesh link A or B.
Mesh Control Network A or B LED is blinking when the ATS is receiving data over The
Rx/Link Mesh link A or B. The LED is on steady when the link is
established. If the LED is off for more than 1 s, the link is
broken.
56
5. Troubleshooting B0700BP – Rev C
Item Description
Green and Red Operational Status LEDs indicates the health of the ATS. See “Using the
LEDs Operational Status LEDs” on page 59.
Reset Button Resets the ATS. The ATS database is reloaded from the
boot host workstation or from the primary module.
Nodebus Tx LED is blinking when the ATS is transmitting data over
the Nodebus.
Nodebus Rx LED is blinking when the ATS is receiving data from the
Nodebus.
100TX/100FX Copper/Fiber cable selection switch. Set in the 100TX
position when using copper cable to connect the ATS to
The Mesh Ethernet switch. Set in the 100FX position
when using fiber cable to connect the ATS to The Mesh
Ethernet switch. It can't be used to dynamically switch the
ATS between copper and fiber interfaces. Switch position
is detected once, on application of power to the module. or
using the recessed Reset button.
Infrared port Enables assigning, modifying or reading the ATS
letterbug and reading status information using the hand-
held Letterbug Configurator (refer to “ATS Letterbug
Assignment” on page 12 or the document I/A Series Letter-
bug Configurator (B0700AY).
57
B0700BP – Rev C 5. Troubleshooting
address (BACKUP ROM ADRESS) for each ATS module. The last six digits are the same as
Module ID and are stamped on a label on the module’s front outer cover.
Redundancy
ATS modules may operate as a redundant pair. The ATS can function non-redundantly if its
redundant partner is failed or not present. If configured as redundant, System Management does
not differentiate between missing and failed modules. Redundant modules are connected to and
communicate with each other over a 1 M baud serial channel referred to as the interlink Redun-
dant Adapter. The interlink operates in full duplex mode.
The ATS redundant pair is addressed as one logical entity. One module in the redundant pair
assumes the role of primary and the other module assumes the role of backup. The pair of mod-
ules determine which module acts as the primary or backup module.
Upon initialization each module attempts to communicate with its redundant partner. Once
communication has been accomplished over the interlink, the two modules agree on their roles
depending on their functional state. A fully functional state is defined as all Ethernet ports work-
ing, interlink working, and the module passes all diagnostics. If both modules are working prop-
erly, the module that initialized first becomes the primary module.
Switching between the Primary and backup ATS modules is automatic. The primary module
passes information over the network and to the backup module. Faults are detected by the mod-
ules themselves. Upon detection of a fault, the communication message is aborted, and self-diag-
nostics are run by both modules to determine which module is defective (see“Start-Up
Diagnostics” on page 64). The non-defective module then assumes control without affecting nor-
mal system operations. An aborted control network communication message is then sent by the
non-defective module via the retry mechanisms of the communications protocol. However, you
can switch between the primary and backup ATS modules by pressing the RESET button on the
Primary module. For example, pressing the RESET button on the primary module switches it to
backup module.
The status of the primary and backup ATS is reflected in the SMDH displays. The Equipment
Information pages clearly indicate primary and backup status.
ATS Troubleshooting
The following troubleshooting information is intended as a service guide for some of the most
commonly encountered system problems. Problems that surface in many cases are faults associ-
ated with communication paths (cables, connectors, internal data and power buses, and so forth).
At the module (ATS) level, the quickest way to determine and correct the problem is by replace-
ment. When spare parts are not available, the following checks may provide a practical approach.
! WARNING
Do not remove the redundant connector from the front of the ATS while it is oper-
ating in the redundant mode with the Operational Status LEDs on both modules in
the normal run state (red LED is off and green LED is on). Removing the redun-
dant connector causes the redundant module to go to the Fail state.
58
5. Troubleshooting B0700BP – Rev C
! CAUTION
1. Do not attempt to repair modules in the field!
2. To reboot the ATS, use System Management displays if possible.
59
B0700BP – Rev C 5. Troubleshooting
cates a hardware fault of some kind. Hardware faults are typically internal to the ATS module, but
you can try the following tests to correct the problem:
1. Check the system printer and/or the smon_log for messages. Possible message is;
“(Letterbug) Equipment Off-Line”.
2. Reboot the ATS module using either the module Reset button (see Figure 5-1) or the
System Management displays (see “REBOOT STATION Procedure” on page 48).
3. Cycle power to the ATS module off then on by pulling the module from the cell bus
in the 1x8 mounting structure and pushing the module back into the cell bus. Make
sure you disconnect The Mesh cables from the top or front of the module and
unscrew the long and short captive mounting screws before pulling the module from
the mounting structure (see “Replacing a Failed Module” on page 62).
4. If the module is part of a redundant pair, replace it and verify that the new module
runs redundantly successfully.
5. Check for insufficient voltage, as shown in Steps 1 through 4 in the previous section.
6. Try reading the module status using the I/A Series Letterbug Configurator. Refer to
I/A Series Letterbug Configurator (B0700AY) document.
60
5. Troubleshooting B0700BP – Rev C
If these steps fail to bring the green LED on and the red LED off, you must replace the module.
61
B0700BP – Rev C 5. Troubleshooting
NOTE
If you grasp the connector and squeeze to unlatch it, the spring-apart action may be
defeated.
b. If you are using copper cables with RJ-45 connectors connected to the top of the
failed module from the Mesh Control Network A and B (see Figure 2-8 on
page 23), disconnect the CAT-5 cable from the connector on the top of the failed
module. You may need to use a thin blade screwdriver to depress the latch lever
and manually pull the connector up to disconnect it from the module.
2. Remove the redundant module connector from the front of the module pair (see
Figure 2-6 on page 20). Loosen the thumbscrew completely, then grasp the connector
on the sides by hand and pull out to remove it from the front of the module pair.
Removing the redundant connector does not cause both modules to fail.
3. Loosen the long captive mounting screw from the front of the module using the hex
driver tool (X0179AZ).
4. Loosen the short captive mounting screw near the top of the module.
5. Using both hands, pull on the module to remove it from the mounting structure.
6. Install the new module using the appropriate procedure.
See “Installing a Backup ATS Module” on page 20
After the new module is installed, it automatically boots up, acquires its letterbug, image and con-
figuration from the primary module, and tracks the primary module.
62
5. Troubleshooting B0700BP – Rev C
Memory Dumps
The memory dumps save a memory image of the ATS so that a thorough failure analysis can be
performed if an ATS malfunctions. The failed ATS quickly compares its code image to the code
image in flash memory. Any differences are burned into the flash memory for later analysis. The
failed ATS also burns the entire data space into flash memory for later analysis. The ATS can
reboot immediately after writing the memory dump into the flash memory.
The memory dump information can be extracted from the ATS in one of two ways.
1. The ATS is replaced by another ATS and its dump information extracted off-line.
2. The ATS can be uploaded on-line. It automatically reboots after storing
violation information and resyncs with its redundant partner.
! WARNING
For safety reasons, always consider the possible impact on plant operations before
placing the primary ATS module off-line or rebooting it after the backup
module has failed.
a. If the module was redundant at the time of the violation, the violating module has
become the backup and must become the Primary to upload the memory dump.
To place the Primary module off-line, push the Reset button on the front of the
module or use the SMDH Equipment Change display to reset the module.
b. To initiate the dump upload from the command line prompt, execute the
iaboot_upld <letterbug> command from directory opt/fox/bin/tools.
The module sends its entire flash memory contents to a 16 MB file in directory
/usr/fox/sp/files with the title <letterbug>_dumpX where X is a sequential number
with the current dump having the greatest number.
The entire upload process takes approximately 3 minutes and its status is indi-
cated by messages at the system printer.
Syntax
iaboot_upld <letterbug> action
where:
<letterbug> = 6-character letterbug of the ATS
action = U to upload existing dump image from single/primary module
action = F to create a new dump image and restart single/backup module
After successful launch of the program it issues a double-check message as follows:
If action = F:
“Create a new dump image and restart single/backup module - enter Y/N:”
If action = U:
“Set controller to run single and upload existing dump image - enter Y/N:”
If Y (or y) is entered a final message is issued
“Create new dump image initiated.”
or
“Upload dump initiated”
63
B0700BP – Rev C 5. Troubleshooting
c. If the original fault occurred while the modules were redundant, you can now
restart the backup module, which updates its partner. To restart the module, use
the “REBOOT STATION Procedure” on page 48
NOTE
Single ATSs can transmit their memory dump at any time.
Diagnostics
The ATS diagnostic routines are as follows:
♦ Start-up
♦ Error Recovery Local
♦ Error Recovery Cooperative
The ATS runs diagnostics on its main processor.
NOTE
There are no user scheduled diagnostics required for the ATS.
Start-Up Diagnostics
Start-up diagnostics run every time the module is powered up or restarted. Start-up diagnostics
test the basic core functionality of the module prior to running. They consist of boot flash check-
sum, code flash checksum, main memory tests, Nodebus collision logic and loopback tests, Inter-
rupt controller tests, and other low level functionality. The start-up diagnostics complete in
approximately five seconds. A failure is indicated by the Operational Status LEDs – red LED is on
and green LED is off.
64
5. Troubleshooting B0700BP – Rev C
OM Variables
An ATS maintains the counters listed in Table 5-3.
Each counter is maintained in an OM variable pre-pended with the station letterbug (for exam-
ple, an ATS with letterbug AT0002 would have an OM variable AT0002PDUS30). Each time a
short term report is generated, the OM variables are updated with the current counter values.
PDUS30 records the average number of COMEX packets forwarded per second between the
Nodebus and Mesh since the last short term report. PRIMAC and ALTMAC store the 6-byte
MAC address of the primary and alternate Mesh addresses, respectively. SNRREQS and SNR-
REPS records the number of Station Node Resolution requests and replies sent by the ATS. SNR-
LRUS records the number of entries in the Station Node Cache removed due to lack of space for
a new entry. DRMCAST records the number of COMEX multicasts from The Mesh not for-
warded to the Nodebus to protect older CPs from excess network traffic. The other variables have
the same meaning as the SMAS counters of the same name, but track the Nodebus interface,
rather than aggregating values from The Mesh interfaces. These variables should only be accessed
from Mesh workstations.
65
B0700BP – Rev C 5. Troubleshooting
66
Appendix A. ATS Interconnection
Diagrams
This appendix provides cabling diagrams for connecting ATS to the MESH control network.
Multiple options are available for connecting ATS to Ethernet switches in the MESH control net-
work. The figures in this appendix illustrate the way in which ATS and the Ethernet switches can
be connected and list the cables necessary for the connection. The illustrations are as follows:
♦ “Single ATS, Copper Connection to Ethernet Switches” on page 68 (Figure A-1)
♦ “Redundant ATS, Copper Connection to Ethernet Switches” on page 69 (Figure A-2)
♦ “Single ATS, Fiber Connection to Ethernet Switches” on page 70 (Figure A-3)
♦ “Redundant ATS, Fiber Connection to Ethernet Switches” on page 71 (Figure A-4).
67
B0700BP – Rev C Appendix A. ATS Interconnection Diagrams
68
Appendix A. ATS Interconnection Diagrams B0700BP – Rev C
69
B0700BP – Rev C Appendix A. ATS Interconnection Diagrams
70
Appendix A. ATS Interconnection Diagrams B0700BP – Rev C
71
B0700BP – Rev C Appendix A. ATS Interconnection Diagrams
72
Index
A
ATS 57
hardware ID 12
infrared port 55
installing 9
LED indicators 55
overview 1
replacing a failed module 62
reset button 55
B
Boot-up sequence 29
backup module with the same letterbug and software image 29
backup module with the same letterbug but different software image 30
commissioned ATS 29
C
Cables, installing Mesh 19, 28
Cables, installing Mesh fiber 17, 24
Cables, installing P0972MQ 19, 28
Configuration Information display 46
Customer Satisfaction Center xi
D
Diagnostics
error recovery local diagnostics 64
start-up 9, 64
E
Equipment Change display 47
Equipment Off-Line message 59, 60
Equipment On-Line message 61
Error recovery local diagnostics 64
Extracting memory dump information 63
F
Failure messages 62
Fault Tolerant Module Now Married message 61
Fault Tolerant Module Now Single message 61
73
B0700BP – Rev C Index
H
Hardware ID
ATS 12
I
Identifying primary and backup ATS module 57
IMAGE UPDATE procedure 49
Infrared port 55
Installing
ATS 9
Mesh cables 19, 28
Mesh fiber cables 17, 24
P0972MQ cables 19, 28
L
Last gasp messages 62
LED diagnostic indicators 55
LED indicators 57
Letterbug assignment
ATS 12
Letterbug installation
primary module 12
M
MAC Resets 51
Memory dumps 63
Memory dumps, extracting 63
Messages
Equipment Off-Line 59, 60
Equipment On-Line 61
Fault Tolerant Module Now Single 61
Fault Tolerant Modules Now Married 61
Requesting Stabin 60
Requesting Update Needed 60
Shadow Update Sent 60
N
NFD 50
Nodebus test initiator 50
O
Operational Status LEDs, troubleshooting 57, 59
P
Primary and backup module
74
Index B0700BP – Rev C
identification 57
Primary module
letterbug installation 12
R
Reboot procedure 48
Redundant connector 9, 20
Reference documents xi
Replacing a failed ATS module 62
Requesting Stabin message 60
Requesting Update Needed message 60
Reset button 55
Revision information xi
S
Shadow 60
Shadow Update Sent message 60
SMDH 35
Software installation 33
Start-up diagnostics 9, 64
Switching primary and backup ATS module
ATS module primary to backup switching 58
System Definition 33
System Management
Configuration Information display 46
Equipment Change display 47
System Management displays 35
T
Troubleshooting
failure messages 62
last gasp messages 62
memory dumps 63
Operational Status LEDs 57, 59
redundant ATS failure 61
75
B0700BP – Rev C Index