Upgrading an MX960 to Use the SCBE-MX
This topic describes how to upgrade your MX960, MX480, or MX240 router to use the SCBE-MX without taking the router offline. This “in-service” upgrade only works for MX routers with DPC, MS-DPC, MPC1, MPC2, or MPC3 line cards. If your MX router has another type of line card, you’ll need to take the router offline before you do the upgrade.
Junos OS does not support in-service upgrades to the SCBE-MX on routers with an MX-MPC3E-3D or MX-MPC3-3D MPC. If your MX router has these MPCs, you’ll need to shutdown the system before you do the upgrade. An in-service upgrade can result in service disruption.
Before you do the upgrade, open a telnet session to the primary
Routing Engine CLI operational mode and issue the configure exclusive
command. This command locks the configuration to prevent accidental
changes during the upgrade process.
To prevent traffic loss during the upgrade process, we recommend that you operate the line cards at 50% line rate. This 50% limit must be maintained per PFE on each line card.
Prepare for the Upgrade
Prior to upgrading to the SCBE-MX:
- Verify that the system runs Junos OS Release 11.4 or later
by issuing the show version command on
the primary router. Here’s an example for the MX960:
user@host> show version Model: mx960 Junos Base OS Software Suite [11.4-20110530];
Note:The SCBE-MX is supported only in Junos OS Release 11.4 or later.
The latest software ensures a healthy system—that is, Routing Engines, control boards, and FPCs—before the upgrade.
- Verify that SCB-MX boards are installed:
user@host> show chassis hardware Item Version Part Number Serial Number Description CB0 REV 07 710-021523 ABBC8281 MX SCB CB1 REV 07 710-021523 ABBC8323 MX SCB CB2 REV 07 710-021523 ABBD1410 MX SCB
SCB-MX details are displayed as above, along with other hardware components.
- Establish console connections to both Routing Engines.
You can use a telnet session to connect to the router console by issuing
the
<router name>-con
command. For example, if the router name is juniper, you can connect to RE0 and RE1 consoles by issuing thetelnet juniper-con
andtelnet juniper1-con
commands. - Ensure that graceful switchover (GRES), commit synchronize
(required for nonstop routing), and nonstop routing (NSR) are enabled
or configured by running the
set chassis redundancy graceful-switchover, set system commit synchronize, set routing-options nonstop-routing
commands.Note:These commands are mandatory for this upgrade and may be removed, if desired, after the upgrade.
- Set the upgrade flag on and start the SCB-MX upgrade by
issuing the
set chassis state cb-upgrade on
command.user@host# configure user@host# set chassis state cb-upgrade on user@host# commit
- Determine the order to replace the existing SCB-MXs with
upgraded ones. SCB 0, SCB 1, and SCB 2 are available for the MX960.
SCB 0 is associated with RE0, SCB 1 is associated with RE1, and SCB
2 is the spare SCB. The SCB upgrade order for the MX960 is:
Upgrade the SCB in the Spare Slot 2 (SCB 2)
Upgrade the SCB in the Backup Routing Engine Slot 1 (SCB 1)
Upgrade the SCB in the Primary Routing Engine Slot 0 (SCB 0)
Note:Do not add or remove any router hardware during the upgrade procedure.
Upgrade the SCB-MX in the Spare Slot 2 (SCB 2)
- Take the fabric plane offline by issuing the
request chassis fabric plane 4 offline
command. - Verify that fabric plane 4 is offline by issuing the
show chassis fabric summary
command.user@host> show chassis fabric summary Plane State Uptime 4 Offline 5 Online 1 hour, 15 minutes, 35 seconds
- Take the next fabric plane offline by issuing the
request chassis fabric plane 5 offline
command, and then verify that the fabric plane is offline by issuing the command given in Step 2. - Take the SCB-MX in slot 2 offline by issuing the
request chassis cb offline slot 2
command. - Verify that the control board is offline by issuing the
show chassis environment cb 2
command:user@host> show chassis environment cb 2 CB 2 status: State Offline Power 1 Disabled Power 2 Disabled
- Attach an electrostatic discharge (ESD) grounding strap to your bare wrist, and connect the strap to one of the ESD points on the chassis.
- Remove and replace the SCB-MX in slot 2 on the router (SCB 2) with the SCBE. Use the procedure described in Replacing an MX960 SCB.
- Verify that the installation is successful and the SCBE
is online:
user@host> show chassis environment cb 2 CB 2 status State Online Temperature 30 degrees C / 86 degrees F
- Verify that the fabric planes come online correctly by
issuing the
show chassis fabric summary
command:user@host> show chassis fabric summary Plane State Uptime 4 Online 2 minutes, 25 seconds 5 Online 2 minutes, 15 seconds
- Verify the alarms:
user@host> show chassis alarms Alarm Time Class Description 2011-06-01 13:26:56 EDT Major CB fabrics are of mixed types 2011-06-01 12:10:41 EDT Major Require a fan tray upgrade
Because only one SCB-MX has been upgraded, the alarm indicates that the SCBs are of mixed type. This alarm is cleared after all the control boards are upgraded.
Upgrade the SCB-MX in the Backup Routing Engine Slot 1 (SCB 1)
- Power down the backup Routing Engine from the primary
Routing Engine by issuing the
request system power-off other-routing-engine
command. - Ensure that the Routing Engine is powered down by issuing
the
show chassis routing-engine 1
command. The slot of the Routing Engine may be 0 or 1, and is shown as 1 in this example:user@host> show chassis routing-engine 1 Routing Engine Status: Slot 1: Current State Present
Verify that the Current State is Present, which indicates that the Routing Engine is offline.
- Take the first fabric plane of the backup Routing Engine
offline by issuing the
request chassis fabric plane 3 offline
command. - Verify that the fabric plane is offline by issuing the
show chassis fabric summary
command.user@host> show chassis fabric summary Plane State Uptime 2 Online 3 minutes, 45 seconds 3 Offline
Check if the state of plane 4 is Offline.
- Take the next fabric plane offline by issuing the
request chassis fabric plane 2 offline
command and verify that the fabric plane is offline by issuing the command in Step 4. - Take the SCB-MX in slot 1 offline by issuing the
request chassis cb offline slot 1
command. - Verify that the SCB-MX is offline by issuing the
show chassis environment cb 1
command:user@host> show chassis environment cb 1 CB 1 status: State Offline Power 1 Disabled Power 2 Disabled
- Attach an electrostatic discharge (ESD) grounding strap to your bare wrist, and connect the strap to one of the ESD points on the chassis.
- Remove and replace the offline SCB-MX on the router with the SCBE.
- Verify that the installation is successful and the SCB
is online by issuing the
show chassis environment cb 1
command:user@host> show chassis environment cb 1 CB 1 status State Online Temperature 30 degrees C / 86 degrees F
Other details, such as power, are also displayed along with the state.
- Verify that the fabric planes 2 and 3 come online correctly
by issuing the
show chassis fabric summary
command:user@host> show chassis fabric summary Plane State Uptime 2 Online 2 minutes, 5 seconds 3 Online 1 minutes, 55 seconds
- Verify that the backup routing engine is back online by
issuing the
show chassis routing-engine 1
command:user@host> show chassis routing-engine 1 Routing Engine Status: Slot 1: Current State Backup
Upgrade the SCB-MX in the Primary Routing Engine Slot 0 (SCB 0)
To upgrade the SCB-MX in the primary Routing Engine slot:
- Ensure a Graceful RE Switchover (GRES) to gracefully switch
between the primary and backup Routing Engines, so that the backup
RE becomes the primary RE, by issuing the
request chassis routing-engine master switch
command. - Log in to the new primary Routing Engine after the switchover.
- Switch the configuration mode to ensure that you are still
in configure exclusive mode by issuing the
exit
command and then theconfigure exclusive
command, from the old primary Routing Engine. - Log in to the current primary Routing Engine again and
issue the
configure exclusive
command. - Power down the backup Routing Engine from the primary
Routing Engine by issuing the
request system power-off other-routing-engine
command. - Ensure that the Routing Engine is powered down by issuing
the
show chassis routing-engine 0
command. The slot of the Routing Engine may be 0 or 1, and is shown as 1 in this example:user@host> show chassis routing-engine 1 Routing Engine Status: Slot 0: Current State Present
Verify that the Current State is Present, which indicates that the Routing Engine is offline or powered down.
- Take the first fabric plane of the backup Routing Engine
offline by issuing the
request chassis fabric plane offline 1
command. - Verify that the fabric plane is offline by issuing the
show chassis fabric summary
command.user@host> show chassis fabric summary Plane State Uptime 1 Offline 2 Online 3 minutes, 25 seconds
Verify that the state of plane 1 is Offline.
- Take the next fabric plane offline by issuing the
request chassis fabric plane offline 0
command and verify that the fabric plane is offline by issuing the command given in Step 2. - Take the SCB-MX in slot 0 offline by issuing the
request chassis cb offline slot 0
command. - Verify that the control board is offline by issuing the
show chassis environment cb 0
command:user@host> show chassis environment cb 0 CB 0 status: State Offline Power 1 Disabled Power 2 Disabled
- Attach an electrostatic discharge (ESD) grounding strap to your bare wrist, and connect the strap to one of the ESD points on the chassis.
- Remove and replace the offline SCB-MX on the router with the SCBE. Use the procedure described in Replacing an MX960 SCB.
- Verify that the installation is successful and the SCBE
is online by issuing the
show chassis environment cb 0
command:user@host> show chassis environment cb 0 CB 0 status State Online Temperature 30 degrees C / 86 degrees F
- Verify that the fabric planes 0 and 1 come online correctly
by issuing the
show chassis fabric summary
command:user@host> show chassis fabric summary Plane State Uptime 0 Online 2 minutes, 9 seconds 1 Online 2 minutes, 2 seconds
- Verify that the backup Routing Engine is back online by
issuing the
show chassis routing-engine 0
command:user@host> show chassis routing-engine 0 Routing Engine Status: Slot 0: Current State Backup
- Verify the alarms by issuing the
show chassis alarms
command:user@host> show chassis alarms Alarm Time Class Description 2011-06-01 13:26:56 EDT Major CB fabric links require upgrade/training 2011-06-01 12:10:41 EDT Major Require a fan tray upgrade
The major alarm has changed from
CB fabrics are of mixed types
toCB fabric links require upgrade/training
, as a SCB-MX requires training to change the link speed from 3G to 6G for the SCBE-MX. This alarm is displayed until the 3G to 6G link transition is completed.
Complete the SCBE-MX Upgrade
- Verify if there are any MPCs running at 3G instead of
6G:
user@host> request chassis fabric upgrade-bandwidth info Slot State 0 Upgrade not supported 1 Upgraded 2 Empty 3 Empty 4 Empty 5 Empty 6 Empty 7 Empty
In this example, the results indicate that slot 0 does not support the upgrade and slot 1 needs upgrade.
Note:The SCBE line card supports only DPC, MS-DPC, MPC1, MPC2, and MPC3 line cards for the
upgrade-bandwidth
. If line cards that do not support the command option are present in the chassis during the SCB-MX to SCBE-MX upgrade, therequest chassis fabric upgrade-bandwidth
commands will returnUpgrade not supported
for the slot(s) that contain the unsupported line card(s). - Upgrade the bandwidth of all MPCs by issuing the
request chassis fabric upgrade-bandwidth fpc all
command. If you want to control the MPC line card upgrade, go to Step 3.CAUTION:Use this command only if you are not concerned with the slot upgrade order or if only one old MPC is present in the chassis. Running this command may result in a loss of traffic across that MPC. Using this method may increase that loss, as it does not consider any redundancy or graceful switchover strategies that you may have configured on the system.
- Issue the
request chassis fabric upgrade-bandwidth fpc slot 1
command to upgrade the MPC in slot 1. - Verify that the MPC is upgraded:
user@host> request chassis fabric upgrade-bandwidth info Slot State 0 Upgrade not supported 1 Upgraded 2 Empty
- Verify the fabric plane state for all MPCs:
user@host> show chassis fabric summary Plane State Uptime 0 Spare 21 seconds 1 Spare 12 seconds 2 Online 12 minutes 3 Online 12 minutes 4 Online 30 minutes 5 Online 30 minutes
- Verify the state of MPCs:
user@host> show chassis fabric fpcs FPC 1 PFE #0 Plane 0: Links ok Plane 1: Links ok Plane 2: Plane enabled Plane 3: Plane enabled Plane 4: Plane enabled Plane 5: Plane enabled PFE #1 Plane 0: Links ok Plane 1: Links ok Plane 2: Plane enabled Plane 3: Plane enabled Plane 4: Plane enabled Plane 5: Plane enabled PFE #2 Plane 0: Links ok Plane 1: Links ok Plane 2: Plane enabled Plane 3: Plane enabled Plane 4: Plane enabled Plane 5: Plane enabled PFE #3 Plane 0: Links ok Plane 1: Links ok Plane 2: Plane enabled Plane 3: Plane enabled Plane 4: Plane enabled Plane 5: Plane enabled
Fabric plane details of all MPCs are similarly displayed.
- Verify if the
show chassis fabric summary
command output shows fabric planes in the 'check' state. This indicates that the fabric plane has an error. You can try to recover the fabric plane to normal operation by issuing therequest chassis fabric plane <#> offline
command, followed by therequest chassis fabric plane <#> online
command, where <#> equals the fabric plane in error.Note:After you issue the
request chassis fabric plane <#> offline
andrequest chassis fabric plane <#> online
commands, issue theshow chassis fabric summary
command to verify that the fabric plane errors are rectified and to verify the current state of the fabric planes. - Verify if there are any major alarms:
user@host> show chassis alarms Alarm Time Class Description 2011-06-01 13:37:43 EDT Minor Require a fan tray upgrade 2011-06-01 13:37:26 EDT Minor Backup RE Active
In this example, the major alarms are no longer displayed, and the upgrade is successfully completed.
- Disable the upgrade configuration by issuing the
set chassis state cb-upgrade off
command and then thecommit
command. - Disable the upgrade configuration by issuing the
set chassis state cb-upgrade off
command. - You can delete the upgrade configuration by issuing the
delete chassis state cb-upgrade
command and then thecommit
command.Warning:Deleting the
chassis state cb-upgrade on
configuration before disabling the SCB-MX upgrade using theset chassis state cb-upgrade off
command can cause unexpected errors in the fabric. - Verify the SCBE-MXs are installed by issuing the
show chassis hardware
command:user@host> show chassis hardware Item Version Part Number Serial Number Description CB0 REV 02 750-031391 YE8505 Enhanced MX SCB CB1 REV 07 710-031391 YL6769 Enhanced MX SCB CB2 REV 07 710-031391 YE8492 Enhanced MX SCB
As shown in the example, the MX960 now has MX SCBEs.