Troubleshooting the MX480

Command-Line Interface

The Junos OS command-line interface (CLI) is the primary tool for controlling and troubleshooting router hardware, the Junos OS, routing protocols, and network connectivity. CLI commands display information from routing tables, information specific to routing protocols, and information about network connectivity derived from the ping and traceroute utilities.

You enter CLI commands on one or more external management devices connected to ports on the Routing Engine.

For information about using the CLI to troubleshoot the Junos OS, see the appropriate Junos OS configuration guide.

Chassis and Interface Alarm Messages

When the Routing Engine detects an alarm condition, it lights the red or yellow alarm LED on the craft interface as appropriate. To view a more detailed description of the alarm cause, issue the show chassis alarms command:

There are two classes of alarm messages:

• Chassis alarms—Indicate a problem with a chassis component such as the cooling system or power supplies.

• Interface alarms—Indicate a problem with a specific network interface.

Alarm Relay Contacts

The craft interface has two alarm relay contacts for connecting the router to external alarm devices. Whenever a system condition triggers either the red or yellow alarm on the craft interface, the alarm relay contacts are also activated. The alarm relay contacts are located on the upper right of the craft interface.

Craft Interface LEDs

The craft interface is the panel on the front of the router located above the DPC cards that contains LEDs and buttons that allow you to troubleshoot the router.

LEDs on the craft interface include the following:

• Alarm LEDs—One large red circular LED and one large yellow triangular LED, located on the upper right of the craft interface, indicate two levels of alarm conditions. The circular red LED lights to indicate a critical condition that can result in a system shutdown. The triangular yellow LED lights to indicate a less severe condition that requires monitoring or maintenance. Both LEDs can be lit simultaneously. A condition that causes an alarm LED to light also activates the corresponding alarm relay contact on the craft interface.

• Host subsystem LEDs—Three LEDs, MASTER, ONLINE, and OFFLINE, indicate the status of the host subsystem. A green MASTER LED indicates that the host is functioning as the primary. The ONLINE LED indicates that the host is online. The OFFLINE LED indicates that the host is installed but the routing engine is offline. The host subsystem LEDs are located on the left of the craft interface and are labeled RE0 and RE1.

• Power supply LEDs—Two LEDs (PEM) indicate the status of each power supply. Green indicates that the power supply is functioning normally. Red indicates that the power supply is not functioning normally. The power supply LEDs are located in the center craft interface, and are labeled 0 through 3.

• Line card LEDs—Two LEDs, OK and FAIL, indicate the status of each DPC, FPC, or MPC. Green indicates OK and red indicates a failure. The LEDs are located along the bottom of the craft interface.

• SCB LEDs—Two LEDs, OK and FAIL, indicate the status of each SCB. Green indicates OK and red indicates a failure. The SCB LEDs are located on the left of the craft interface along the bottom.

• Fan LEDs—Two LEDs indicate the status of the fans. Green indicates the fans are functioning normally and red indicates a fan has failed. The fan LEDs are located on the upper left of the craft interface.

Component LEDs

The following LEDs are located on various router components and display the status of those components:

• DPC LED—One LED labeled OK/FAIL on each DPC faceplate indicates the DPC's status. For more information, see the MX Series Interface Module Reference.

• FPC LED—One LED labeled OK/FAIL on each FPC faceplate indicates the FPC's status.

• MPC LED—One LED labeled OK/FAIL on each FPC faceplate indicates the FPC's status.

• MIC LED—One LED labeled OK/FAIL on each MIC faceplate indicates the MIC's status. For more information, see the MX Series Interface Module Reference.

• PIC LED—One LED labeled OK/FAIL on each PIC faceplate indicates the PIC's status. For more information, see the MX Series Interface Module Reference.

• SCB LEDs—Three LEDs, labeled FABRIC ACTIVE, FABRIC ONLY, and OK/FAIL, on each SCB faceplate indicate the status of the SCB. If no LEDs are lit, the primary RE might still be booting or the SCB is not receiving power.

• Routing Engine LEDs—Four LEDs, labeled MASTER, HDD, ONLINE, and FAIL on each Routing Engine faceplate indicate the status of the Routing Engine and hard disk drive.

• Power supply LEDs—Two LEDs on each power supply faceplate indicate the status of that power supply.

Juniper Networks Technical Assistance Center

If you need assistance during troubleshooting, you can contact the Juniper Networks Technical Assistance Center (JTAC) by using the Web or by telephone.

Problem

Solution

Follow these guidelines to troubleshoot the fans:

• Check the fan LEDs and alarm LEDs on the craft interface.

• If the red alarm LED on the craft interface lights, use the CLI to get information about the source of an alarm condition: user@host> show chassis alarms.

  If the CLI output lists only one fan failure, and the other fans are functioning normally, the fan is most likely faulty and you must replace the fan tray.

• Place your hand near the exhaust vents at the side of the chassis to determine whether the fans are pushing air out of the chassis.

• If a fan tray is removed, a yellow alarm and a red alarm occur.

• The following conditions automatically cause the fans to run at full speed and also trigger the indicated alarm:

  • A fan fails (red alarm).

  • The router temperature exceeds the “temperature warm” threshold (yellow alarm).

  • The temperature of the router exceeds the maximum (“temperature hot”) threshold (red alarm and automatic shutdown of the power supplies).

Problem

Solution

• Monitor the green LED labeled OK above the DPC on the craft interface as soon as a DPC is seated in an operating router.

  The Routing Engine downloads the DPC software to it under two conditions: the DPC is present when the Routing Engine boots Junos OS, and the DPC is installed and requested online through the CLI or push button on the front panel. The DPC then runs diagnostics, during which the OK LED blinks. When the DPC is online and functioning normally, the OK LED lights green steadily.

• Make sure the DPC is properly seated in the midplane. Check that each ejector handle has been turned clockwise and is tight.

• Check the OK/FAIL LED on the DPC and OK and FAIL DPC LEDs on the craft interface. When the DPC is online and functioning normally, the OK LED lights green steadily.

• Issue the show chassis fpc command to check the status of installed DPCs. As shown in the sample output, the value Online in the column labeled State indicates that the DPC is functioning normally:

  Note:

  The show chassis fpc command displays the status of the DPCs.

  For more detailed output, add the detail option. The following example does not specify a slot number, which is optional:

  For further description of the output from the commands, see the Junos OS Administration Library for Routing Devices.

Problem

Solution

• Monitor the green LED labeled OK above the FPC on the craft interface as soon as an FPC is seated in an operating router.

  The Routing Engine downloads the FPC software to it under two conditions: the FPC is present when the Routing Engine boots Junos OS, and the FPC is installed and requested online through the CLI or push button on the front panel. The FPC then runs diagnostics, during which the OK LED blinks. When the FPC is online and functioning normally, the OK LED lights green steadily.

• Make sure the FPC is properly seated in the midplane. Check that each ejector handle has been turned clockwise and is tight.

• Check the OK/FAIL LED on the FPC and OK and FAIL FPC LEDs on the craft interface. When the FPC is online and functioning normally, the OK LED lights green steadily.

• Issue the show chassis fpc command to check the status of installed FPCs. As shown in the sample output, the value Online in the column labeled State indicates that the FPC is functioning normally:

  Note:

  The show chassis fpc command displays the status of the FPCs.

  For more detailed output, add the detail option. The following example does not specify a slot number, which is optional:

  For further description of the output from the commands, see the Junos OS Administration Library for Routing Devices.

Problem

Solution

• Check the status of each port on a MIC by looking at the LED located on the MIC faceplate. For information about the meaning of LED states on different MICs, see the MX Series Interface Module Reference.

• Check the status of a MIC by issuing the show chassis fpc pic-status CLI command. The MIC slots in the MPC are labeled PIC 0/1 and PIC 2/3, left to right:

  For further description of the output from the command, see the CLI Explorer.

Problem

Solution

• Monitor the green LED labeled OK above the MPC on the craft interface as soon as an MPC is seated in an operating router.

  The Routing Engine downloads the MPC software to it under two conditions: The MPC is present when the Routing Engine boots Junos OS, and the MPC is installed and requested online through the CLI or push button on the front panel. The MPC then runs diagnostics, during which the OK LED blinks. When the MPC is online and functioning normally, the OK LED lights green steadily.

• Make sure the MPC is properly seated in the midplane. Check that each ejector handle has been turned clockwise and is tight.

• Check the OK/FAIL LED on the MPC and OK and FAIL line card LEDs on the craft interface. When the MPC is online and functioning normally, the OK LED lights green steadily.

• Issue the show chassis fpc command to check the status of installed MPCs. As shown in the sample output, the value Online in the column labeled State indicates that the MPC is functioning normally:

  Note:

  The show chassis fpc command displays the status of the MPCs.

  For more detailed output, add the detail option. The following example does not specify a slot number, which is optional:

  For further description of the output from the commands, see the Junos OS Administration Library for Routing Devices.

Problem

Solution

• Check the status of each port on a PIC by looking at the LED located on the PIC faceplate. For information about the meaning of LED states on different PICs, see the MX Series Interface Module Reference.

• Check the status of a PIC by issuing the show chassis fpc pic-status CLI command. The PIC slots in the FPC are numbered from 0 through 1, left to right:

  For further description of the output from the command, see the CLI Explorer.

Problem

Solution

• Check the LEDs on each power supply faceplate.

  • If an AC power supply is correctly installed and functioning normally, the AC OK and DC OK LED’s light steadily, and the PS FAIL LED is not lit.

  • If a DC power supply is correctly installed and functioning normally, the PWR_OK, INPUT OK, and BREAKER ON LED’s light steadily.

• Issue the CLI show chassis environment pem command to check the status of installed power supply modules. As shown in the sample output, the value Online in the rows labeled State indicates that each power supply is functioning normally:

If a power supply is not functioning normally, perform the following steps to diagnose and correct the problem:

• If a red alarm condition occurs, issue the show chassis alarms command to determine the source of the problem.

• Check that the AC input switch (—) or DC circuit breaker (|) is in the on position and that the power supply is receiving power.

• Verify that the source circuit breaker has the proper current rating. Each power supply must be connected to a separate source circuit breaker.

• Verify that the AC power cord or DC power cables from the power source to the router are not damaged. If the insulation is cracked or broken, immediately replace the cord or cable.

• Connect the power supply to a different power source with a new power cord or power cables. If the power supply status LEDs indicate that the power supply is not operating normally, the power supply is the source of the problem. Replace the power supply with a spare.

• If all power supplies have failed, the system temperature might have exceeded the threshold, causing the system to shut down.

  Note:

  If the system temperature exceeds the threshold, the Junos OS shuts down all power supplies so that no status is displayed.

  The Junos OS also can shut down one of the power supplies for other reasons. In this case, the remaining power supplies provide power to the router, and you can still view the system status through the CLI or display.

  To restart a high-capacity AC power supply after a shut down due to an over-temperature situation:

  1. Move the power switch on the power supply to the off (o) position.

  2. Turn off power to where the AC line goes into the power distribution module (PDM) area.

  3. Wait for the power supply LEDs to fade out and for the fans inside the power supply to shutdown. This can take up to 10 seconds.

     CAUTION:

     Do not attempt to power-on the power supply if the LED is still lit and the fan is still running. If you do, the router will not reboot.

  4. Turn on power to where the AC line goes into the power distribution module (PDM) area.

  5. Move the power switch on the power supply to the on (|) position.

  6. Verify that the LEDs on the power supply faceplate are properly lit.

  7. Issue the CLI show chassis environment pem command and verify the State is ONLINE and the Temperature is OK.

  To restart a high-capacity DC power supply after a shut down due to an over-temperature situation:

  1. Switch off the circuit breaker(s) on the DC distribution panel to remove power to the chassis and power supplies.

  2. Switch on the circuit breaker(s) on the distribution panel to power up the chassis and power supplies.

     Note:

     The power switch on the power supplies is not part of the outer or inner DC circuits and therefore does not need to be switched off when restarting the chassis.

Each High Capacity AC or DC power supply accepts two AC or DC feeds in two unique AC or DC receptacles. It is possible to operate with one feed, but there is a reduction in the power supply output. The DIP switch must be set according to the number of AC or DC feeds that are present for the power supply. Refer to Figure 1.

Figure 1: MX480 High-Capacity DC Power Supply Input Mode Switch.

• Position – 0 indicates that only one AC or DC feed is provided.

• Position – 1 indicates that two AC or DC feeds are provided.