Routing Engines
Routing Engines
Routing Engines
Command or Action
125
Command or Action
7. Display Error Messages in the System Log File on page 155 show log messages
8. Document the Events Prior to the Failure on page 156
126
What Is a Routing
Engine
Inspect the Routing Engine to ensure that key system processes are operating
normally.
The Routing Engine is a key component in the router. It is primarily responsible for
the protocol intelligence of the router. Thus, it is responsible for creating a routing
table, which consists of all routes learned by all protocols running on the router. The
Routing Engine interprets the routing table, generates a subset of routes to be used
for all forwarding purposes, and places them in the forwarding table. The Routing
Engine also holds the microcode for the Packet Forwarding Engine.
The Routing Engine is responsible for user interaction functions, such as the
command-line interface (CLI), Simple Network Management Protocol (SNMP)
management, and craft interface interaction.
The Routing Engine consists of the following components:
Intel Pentium compact Peripheral Component Interconnect (PCI) platform
Nonrotating compact flash drive (RAM disk)
Standard rotating hard drive
Removable media drive
The JUNOS software resides on the compact flash drive, with an alternate copy
residing on the system hard drive.
This section also includes the following information:
Routing Engine Types and Characteristics on page 127
Routing Engine Locations on page 130
Routing Engine Redundancy on page 135
Routing Engine Component Companionship on page 135
127
Table 32 lists the Routing Engine type characteristics for each routing platform.
Table 32: Routing Engine Characteristics Per Routing Platform
Routing Engine CLI Name
Processor
Memory
256 MB
RE-333 768
RE2
Hard Drive
Routing Platforms
6.4 GB
M40
10 20 GB
RE3
30 GB
RE-1600 2048
RE4
2048 MB
30 GB
RE-400 256 +
512 Upgrade
RE5
768 MB
20 GB
M7i, M10i
ET
PC
JUN
IPE
R
N ET
WO
R
CA R
KS
L
AB E
L
T H IS
HD
D
SID
EU
MA
STE
R
P
FAIL
ON
LIN
E
CO
g003232
RES
NSO
LE
AUX
/ MO
DEM
MG
MT
OFF
LIN
E
128
M5, M10, M20, M40, M40e, and M160 Router Routing Engines
Figure 35 shows the Routing Engines that are supported in the M5, M10, M20, M40,
M40e, and M160 routing platforms. For the current Routing Engines supported on
these routing platforms, see Figure 32 on page 128.
Figure 35: M5, M10, M20, M40, M40e, and M160 Router Routing Engines
HD
JUNI
PER
NETW
ORKS
LABE
L TH
IS SID
E
RESET
P
C
Extractor clip
C
A
R
D
Extractor clip
LED
PC card slot
Extractor clip
LED
Extractor clip
1596
PC card slot
ORKS
LABE
L TH
1 SLOT
NETW
HD
PER
IS SI
g003457
DE
RESET
P
C
JUNI
C
A
R
D
Extractor clip
PC card slots
Extractor clip
129
LABE
L TH
Extractor clip
IS SI
DE
1512
NETW
ORKS
RESET
PER
HD
P
C
JUNI
C
A
R
D
Figure 37: T320 Router and T640 Routing Node Routing Engine
PC card slot
Extractor clip
Figure 38 shows the Routing Engine location in the M5, M10, and M20 Internet
routers.
130
1688
Routing Engine
g002228
RE0
RE1
Routing Engine
Routing Engines
131
Side view
RST
IDE
JUNOS PC CARD
LABEL THIS WAY
Routing Engine
1687
PC CARD
On the M40 Internet router, the Routing Engine module resides in a metal housing
at the back of the chassis, below the fans, in a compartment behind the card cage
(see Figure 40).
The M40 router supports three Routing Engine models: RE-M40 (RE1), RE-333
(RE2), and RE-600 (RE3). See Table 32 on page 128.
All M40 routers shipped before mid-2001 had RE-M40 Routing Engines. All M40
routers shipped after mid-2001 have the RE-333 Routing Engine and housing. You
could also upgrade to the RE-600 (RE3) Routing Engine.
The RE-333 and the RE-600 Routing Engines share the same housing, which is
different from the RE-M40. Therefore, if you want to upgrade from an RE-M40 to an
RE-333 or RE-600, you must also upgrade the Routing Engine housing.
NOTE: Effective July 15, 2001, the RE-M40 Routing Engine was replaced by the
RE-333 Routing Engine, which was made available with JUNOS software, release
4.2. After July 15, 2004, the RE-M40 Routing Engine is no longer supported. See
Routing Engine Characteristics Per Routing Platform on page 128.
See also the End-of-sale and End-of-service Announcement for the M40 routing
platform and products at https://www.juniper.net/support/eol/.
132
If you upgrade the Routing Engine housing, the PCMCIA card slot is not accessible
and you must use the LS-120 PC card. If you want to install a new version of the
JUNOS software, you must use the LS-120 drive.
You can replace the entire Routing Engine housing or just the Routing Engine.
SFM 0
SFM 0
SFM 1
SFM 1
MCS 0
MCS 0
Routing
Engines
RE 0
RE 1
PCG 0
MCS 1
SFM 2
SFM 3
RE 0
RE 1
PCG 0
MCS 1
PCG 1
PCG 1
Do not ins
Do not ins
tall an SF
tall an SF
M in this
slot
M in this
slot
1689
Routing
Engines
133
CB-M
MASTER
FAIL
OK
CB 0
RE0
RE 0
RE1
RE 1
MASTER
FAIL
OK
g002230
CB-M
CB 1
RE0
Routing Engines
134
Routing Engines
g003257
RE0
RE1
RE1
Characteristic
M5/
M10
M7i
M10i
M20
X
works with
HCM
M40
M40e/M160
X
(Host Module)
works with MCS
M320/T320/
T640
X
(Host Subsystem)
works with
Control Board
135
If the router boots from an alternate boot device, the JUNOS software displays a
message indicating this when you log in to the router. For example, this message
shows that the software booted from the hard disk (/dev/ad2s1a):
login: username
Password: password
Last login: date on terminal
--- JUNOS 6.4 R1 built date
----- NOTICE: System is running on alternate media device (/dev/ad1).
136
To display a detailed status of the Routing Engine, use the following JUNOS CLI
operational mode command:
user@host> show chassis routing-engine
Sample Output
What It Means
The command output displays the Routing Engine slot number, current state
(Master, Backup, or Disabled), election priority (Master or Backup), and the airflow
temperature. The command output also displays the total DRAM available to the
Routing Engine processor, the CPU utilization percentage, and the Routing Engine
serial number for the slot. The command output displays when the Routing Engine
started running, how long the Routing Engine has been running, and the time,
uptime, and load averages for the last 1, 5, and 15 minutes.
Check the Uptime to ensure that the Routing Engine has not rebooted since it
started running.
137
Alternative Actions
(For M7i, M10i, M40e, M160, M320, and T320 routers and the T640 routing node)
To check the status and temperature of the Routing Engines, use the following CLI
command:
user@host> show chassis environment routing-engine
user@host> show chassis environment routing-engine
Route engine 0 status:
State:
Present Master
Temperature:
0 degrees C / 32 degrees F
Route engine 1 status:
State:
Present
The command output displays the Routing Engine slot number, operating state,
temperature, and whether it is operating as the master or backup. The state can be
Present or Absent.
To check the status and temperature of a particular Routing Engine, use the
following CLI command:
user@host> show chassis environment routing-engine slot
138
Color
State
Description
HDD
Green
Blinking
MASTER
Blue
On steadily
FAIL
Red
On steadily
ONLINE
Green
On steadily
CONSOLE
PC CARD
AUX / MODEM
MGMT
HDD MASTER
OFFLINE
RESET
FAIL
ONLINE
g003299
Action
Status LEDs
Color
State
Description
HDD
Green
Blinking
MASTER
Blue
On steadily
FAIL
Red
On steadily
OFFLINE
Green
On steadily
You can see the Routing Engine LEDs on the Routing Engine panel located on the
back of the router.
139
MASTER
NC
C
NO
OK
FAIL
OK
FAIL
OK
FAIL
OK
FPC0
FPC1
ACO/LT
AUX/MODEM
MGMT
CONSOLE
FPC2
RE1
OFFLINE ONLINE
MASTER
FPC3
Routing Engine 1
LEDs
140
Color
State
Description
MASTER
Blue
On steadily
ONLINE
Green
On steadily
OFFLINE
Amber
On steadily
RE0, RE1
Shape
g003293
NC
C
NO
FAIL
RE0
You can see the Routing Engine LEDs on the craft interface or on the Routing
Engine panel located on the back of the router (see Figure 46).
Figure 46: M20 Router Routing Engine Panel
RE0
RE1
1155
ONLINE
OFFLINE
MASTER
Routing Engine
LEDs
Routing Engine
offline switches
Color
State
Description
OFFLINE
Amber
On steadily
ONLINE
Green
On steadily
MASTER
Blue
On steadily
141
FAIL
OK
0
NC
C
NO
OK
FAIL
1
RED
ALARM
OK
FAIL
OK
FAIL
OK
FAIL
ALARM
OK
FAIL
OK
FAIL
OK
ROUTING ENGINE
MENU
OK
ALARM
CUTOFF
FAIL
ENTER
YELLOW
ALARM
MANAGEMENT
ETHERNET
CONSOLE
AUXILIARY
1697
NC
C
NO
FAIL
142
Shape
Color
State
Description
OK
Green
OK
Green
Blinking
FAIL
Red
MASTER
HOST0
MENU
ACO/LT
ENTER
HOST1
OFFLINE ONLINE
OK
FPC 0
FAIL
OK
OK
FAIL
FPC 1
FAIL
OK
FAIL
OK
OK
FAIL
FPC 4
FPC 3
FPC 2
FAIL
OK
FAIL
FPC 6
FPC 5
OK
FPC 7
1777
FAIL
MASTER
Shape
Color
MASTER
Green
ONLINE
Green
OFFLINE
Red
State
Description
On steadily
On steadily
Blinking
On steadily
143
g003294
Each host subsystem has three LEDs, located in the middle of the craft interface,
that indicate status. The LEDs labeled RE0 show the status of the Routing Engine in
slot RE0 and the Control Board in slot CB0. The LEDs labeled RE1 show the status of
the Routing Engine in slot RE1 and the Control Board in slot CB1. Table 40 describes
the functions of the host subsystem LEDs.
Table 40: M320 Router Host Subsystem LEDs
Label
Color
State
Description
FAIL
Red
On steadily
OK
Green
On steadily
MASTER
Green
On steadily
OK
MASTER
ACO/LT
OK
SP0
HOST0
MENU
SP1
SP2
HOST1
FAIL
OK
FPC 0
FAIL
OK
FPC 1
FAIL
OK
FPC 2
FAIL
OK
FPC 3
FAIL
OK
FPC 4
FAIL
OK
FPC 5
OK
MASTER
FAIL
OK
FPC 6
FAIL
OK
FPC 7
g003295
FAIL
ENTER
Each host subsystem has three LEDs, located on the upper right of the craft
interface, which indicate status. The LEDs labeled HOST0 show the status of the
Routing Engine in slot RE0 and the Control Board in slot CB0. The LEDs labeled
HOST1 show the status of the Routing Engine in slot RE1 and the Control Board in
slot CB1.
144
Color
State
Description
OK
Green
On steadily
FAIL
Red
On steadily
MASTER
Green
On steadily
FAIL
OK
MASTER
ACO/LT
FPC 0
FAIL
OK
FAIL
FPC 1
OK
FAIL
FPC 2
OK
FAIL
OK
FPC 4
FPC 3
FAIL
OK
FPC 5
OK
MASTER
FAIL
SP4
OK
FPC 6
SP3
FAIL
OK
FPC 7
g003296
OK
SP1
SP2
HOST1
FAIL
ENTER
FAIL
OK
SP0
HOST0
MENU
Each host subsystem has three LEDs, located on the upper right of the craft
interface, which indicate status. The LEDs labeled HOST0 show the status of the
Routing Engine in slot RE0 and the Control Board in slot CB0. The LEDs labeled
HOST1 show the status of the Routing Engine in slot RE1 and the Control Board in
slot CB1. Table 42 describes the functions of the host subsystem LEDs.
Table 42: T640 Routing Node Host Subsystem LEDs
Label
Color
State
Description
OK
Green
On steadily
FAIL
Red
On steadily
MASTER
Green
On steadily
145
Step 3: Check the Redundant Routing Engine Status from the Craft Interface CLI Output
Action
To view the Routing Engine status from the craft interface, use the following CLI
command:
user@host> show chassis craft-interface
Sample Output
146
[...Output truncated...]
147
What It Means
The M10i router craft interface command output displays the LED status of the
master Routing Engine, indicating whether the OK and Fail LEDs are on or off. It also
displays that the backup Routing Engine is active.
The M20 router craft interface command output displays the LED status of the
master Routing Engine, indicating whether the OK and Fail LEDs are on or off.
The M40e and M160 router craft interface command output also displays the LED
status of both the master and backup host modules that include the master and
backup Routing Engines. By default, the master host module (Host 0) has
components installed in slots RE0 and MCS0; the backup host module (Host 1) has
components installed in slots RE1 and MCS1.
The T640 routing node craft interface command output indicates that RE0 is the
master Routing Engine, and that it is active. The status under the backup Routing
Engine (RE1) has no indicators.
148
failure. If the Routing Engine has a compact flash failure and hard disk failure at
the same time, you will not be able to boot up the Routing Engine.
The following sections describe how to check for the following failure conditions:
NOTE: The M7i and M10i routers by default come with no compact flash.
Steps To Follow
A vmcore file is always saved in /var/crash/. To view the core file that is generated
when a crash occurs, use the following CLI command:
user@host> file list /var/crash/ detail
Sample Output
What It Means
The command output lists the vmcore.<n> files that have been generated.
149
You might see the following in the /var/log/messages file after the router comes
back up after a kernel crash occurred. To view the messages log file, use the
following CLI command:
user@host> show log messages
Sample Output
What It Means
What It Means
The kernel checks for a core dump file when the router reboots.
Step 2: Check for Compact Flash Media and Hard Disk Failure
If the Routing Engine has a compact flash failure, the router boots from the hard
disk. When you log in to the router, the JUNOS software CLI will indicate that the
router has booted from alternate media.
If the Routing Engine has a hard drive failure, the router boots from the compact
flash as usual. However, the router cannot write to the hard drive.
150
(/dev/ad1s1a).
user@host>
Action
Check to see which file system is mounted by using the following CLI command:
user@host> show system storage
Sample Output
What It Means
The command output will not show ad0 (the compact-flash) mounted, but instead,
ad1 (the hard disk) has the root file system mounted.
To determine why the compact-flash did not get mounted, use the following CLI
command:
user@host> show system boot-messages | match "ad0|ad1"
user@host> show system boot-messages | match "ad0|ad1"
ad0: not attached, missing in Boot List
ad1: 28615MB <FUJITSU MHS2030AT> [58140/16/63] at ata0-slave using BIOSDMA Mounting root from
ufs:/dev/ad1s1a
What It Means
The command output shows that the compact flash (ad0) was removed from the
boot list.
151
What it Means
The boot messages show that the hard disk (ad1) was removed from the boot list
(using JUNOS, release 6.1R1.4).
To verify that the hard disk (ad1) did not get mounted, use the following CLI
command:
user@host> show system storage
Sample Output
The following sample output was taken from a RE-333 Routing Engine.
user@host> show system storage
Filesystem
512-blocks
Used
/dev/ad0s1a
218690 60294
devfs
32
32
0
/dev/vn0
20044 20044
devfs
32
32
0
/dev/vn1
51920 51920
/dev/vn2
22328 22328
/dev/vn3
3844
3844
/dev/vn4
23328 23328
/dev/vn5
8820
8820
mfs:139
127006 16914
/dev/ad0s1e
24234
28
procfs
8
8
0
What It Means
The command shows that the hard disk (ad1) is not mounted. Instead, /var now
exists only in the swap partition (mfs:139), so any contents saved to /var will not be
saved at the next reboot.
user@host> start shell
user@host% ls -l /
total 47
-rw-r--r-- 1 root wheel 4735 Mar 31 2001 COPYRIGHT
dr-xr-xr-x 2 root wheel 512 Jan 20 2004 altconfig
dr-xr-xr-x 2 root wheel 512 Jan 20 2004 altroot
drwxr-xr-x 2 root wheel 512 Dec 29 12:00 bin
dr-xr-xr-x 3 root wheel 512 Feb 4 23:16 boot
drwxr-xr-x 3 root wheel 512 Feb 3 18:08 config
dr-xr-xr-x 4 root wheel 2084 Feb 4 23:18 dev dr-xr-xr-x 7 root wheel 1536 Feb 4 23:19 etc
lrwxr-xr-x 1 root wheel 17 Dec 29 12:02 kernel -> /packages/jkernel
dr-xr-xr-x 2 root wheel 512 Jan 20 2004 mnt
drwxr-xr-x 2 root wheel 512 Feb 3 21:16 modules
drwxr-xr-x 3 root wheel 1536 Feb 3 21:19 packages
dr-xr-xr-x 1 root wheel 512 Feb 4 23:29 proc
dr-xr-xr-x 2 root wheel 512 Feb 3 21:15 root
dr-xr-xr-x 3 root wheel 1536 Feb 3 21:15 sbin
drwxrwxrwt 3 root wheel 512 Feb 4 23:19 tmp
152
What It Means
The example shows that var has a symbolic link to the /tmp/var directory. It resides
under the /tmp/var directory, and is mounted on the mfs partition.
Verify That the Hard Disk Is Missing from The Boot List
Action
To verify that the hard disk (ad1) is missing from the boot list, use the following CLI
command:
user@host> show system boot-messages | match "ad0|ad1"
Sample Output
What It Means
The device is taken out of the boot list because of an error condition, such as a
HARD READ errror.
To display an alarm that is generated when media (compact flash or hard disk) is
removed from the boot list, use the following CLI command:
user@host> show chassis alarms
Sample Output
What It Means
When the router is operational and the hard disk is removed from the boot list, a
minor yellow alarm is generated. When the router is rebooted and the hard disk is
still removed from the boot list, a red major alarm is generated.
What It Means
The command output displays a major alarm indicating what media is missing
from the boot list and the time and date when the event occurred.
153
Multiple-bit errors are when multiple bits are incorrect. By default, if a multiple-bit
error is detected, a nonmaskable interrupt (NMI) is generated to interrupt the
Routing Engine and panic the kernel causing the router to subsequently reboot. The
Routing Engine panics the kernel, and leaves a vmcore file.Multi-bit parity error
detection was implemented in JUNOS software release 5.3 and above.
Table 43 specifies the storage media by Routing Engine type. The device names are
displayed when the router boots. To display the Routing Engine type on some
routers, use the show chassis hardware CLI command.
Table 43: Storage Media Device Names
Action
Storage Media
RE-M40
(RE1)
RE-400
(RE5)
Flash drive
ad0
ad0
ad0
ad0
Hard disk
ad2
ad1
ad1
ad1
Removable media
afd0
ad3
ad3
To check the router file system and on which disk the router booted, use the
following CLI command:
user@host> show system storage
Sample Output
What It Means
The command output displays statistics about the amount of free disk space in the
routers file systems, including the amount used, the amount available, and the
percentage of system space being used. The values are displayed in 1024-byte
(1KB) blocks.
Filesystem is the name of the file system on which the Routing Engine booted. The
command output also displays the directory to which the file system is mounted.
During normal operation, the / and /config directories are from the compact flash
drive and the /var directory is from the hard drive. If the router booted off the hard
drive, the show system storage command will show all three directories on the hard
drive. If the hard drive fails and the router booted off the compact flash drive, the
show system storage command will show all three directories on the compact flash
drive.
154
NOTE: An event may occasionally cause the Routing Engine not to boot and you
To display the current Routing Engine alarms, use the following CLI command:
user@host> show chassis alarms
Sample Output
What It Means
The command output displays the alarm time, severity level, and description.
To view Routing Engine error messages in the system log file, use the following CLI
command:
user@host> show log messages
Sample Output
What It Means
The messages system log file records the time the failure or event occurred, the
severity level, a code, and a message description. Use the show log messages CLI
command to browse error messages that are generated at least 5 minutes before
and after an event. You can also use the show log messages | match device-name
command to view error messages that are specific to a device name. Use this
information to diagnose a problem and to let JTAC know what error messages were
generated and the router events prior to the event. For more information about
system log messages, see the JUNOS Softw are System L og Messages R eference .
155
To document events that occurred prior to a Routing Engine failure, follow these
steps:
1. Write down any events such as an abrupt router shutdown because of a power
outage, a software upgrade, a configuration commit, or a system snapshot
request.
2. Write down any recovery procedures attempted. If the Routing Engine reported
some errors on the hard drive but appeared to be working fine or a backup
Routing Engine is available, it may not be necessary to recover.
3. Turn on logging to your console to start capturing screen output. This is
especially useful if a terminal server is connected to the Routing Engine console
port.
4. While you have screen capturing enabled, boot the Routing Engine and look at
the router boot messages.
To get hardware information for a failed Routing Engine, follow these steps:
1. Display Routing Engine Hardware Information on page 157
2. Locate the Routing Engine Serial Number ID Label on page 158
To display the Routing Engine hardware information, use the following CLI
command:
user@host> show chassis hardware
Sample Output
156
What It Means
DC
The sample output for an M20 router displays the Routing Engine, slot number, and
serial number, and indicates that it is present in the router. Give this information to
JTAC if the Routing Engine fails.
The sample output for an M40 router shows that the maxicab is the (Motorola)
Routing Engine, and the minicab is the Routing Engine and Packet Forwarding
Engine interface.
On other routers, the Routing Engine serial number is located in the host hardware
inventory line.
157
Figure 52: M10i Router Routing Engine Serial Number ID Label Location
Serial Number ID label
ET
PC
JUN
IPE
RN
ET W
OR
CA R
KS
L
AB E
L
T H IS
HD
D
SID
EU
MA
STE
R
P
FAIL
ON
LIN
E
CO
NSO
g003239
R ES
LE
AUX
/ MO
DEM
MG
MT
OFF
LIN
E
1607
460000078ba2201
Board S/N: 900106217
158
1601
AA1234
LABE
L TH
1 SLOT
IS SI
DE
g003469
ORKS
HD
NETW
RESET
PER
P
C
JUNI
C
A
R
D
*1 2 3 4 5 6 7 8 9 1 0 1 2 *
159
T320 Router and T640 Routing Node Serial Number ID Label Location
For the T320 router and T640 routing node, the serial number ID label is located on
the right side of the top of the Routing Engine (see Figure 56).
1576
Figure 56: T320 Router and T640 Routing Node Routing Engine Serial Number ID Label
*1 2 3 4 5 6 7 8 9 1 0 1 2 *
To replace the Routing Engine, see the appropriate router hardware guide See also,
Replacing a Redundant Routing Engine on page 506..
NOTE: The M5 and M10 routers have a cover over the Routing Engine. The M40e
and M160 routers have a cover over all the rear chassis components.
160