Smooth Upgrade from SFB to SFB2
Understanding the Smooth Upgrade Process
The MX2000 line of routers support Switch Fabric Board (SFB; model number: MX2000-SFB) and the enhanced Switch Fabric Board (SFB2; model number: MX2000-SFB-S). SFB2 is designed to support higher bandwidth than that provided by SFB on the MX2000 line of routers. For instance, the MX2000 line of routers with SFB support fabric bandwidth of 800 Gbps. However, the MX2000 line of routers with SFB2 can support fabric bandwidth of 1.92 Tbps. A smooth upgrade enables you to upgrade from SFB to SFB2 with minimal traffic impact on the MX2000 line of routers.
If you have installed the Junos Continuity software package, you cannot perform a smooth upgrade from Switch Fabric Board (SFB) to Enhanced Switch Fabric Board (SFB2) on MX2010 and MX2020 routers.
This topic explains the smooth upgrade process that takes place when you upgrade from Switch Fabric Board (SFB) to enhanced Switch Fabric Board (SFB2) on MX2000 line of routers.
The MX2000 line of routers support either SFB or SFB2 only. The MX2000 line of routers do not support SFB and SFB2 at the same time. However, during an upgrade from SFB to SFB2, the MX2000 line of routers support both SFB and SFB2 at the same time for the duration of the upgrade. But, you must upgrade all 8 SFBs to 8 SFB2s. You cannot replace 4 SFBs with 4SFB2s and retain the other SFBs.
The process of smooth upgrade from SFB and SFB2 includes the following steps:
Initiating the smooth upgrade process. When you initiate smooth upgrade, the router can support both SFB and SFB2 at the same time.
Performing the smooth upgrade. This step consists of replacing all SFBs with SFB2s.
Terminating the smooth upgrade. When you terminate the smooth upgrade process, the router stops supporting SFB and SFB2 at the same time.
A smooth upgrade provides the following benefits:
The smooth upgrade eliminates network downtime during the smooth upgrade window because of 7+1 fabric redundancy. When one SFB is being upgraded to SFB2, the other seven SFBs are available to handle the traffic.
Note:If multiple SFBs are upgraded at the same time, multiple fabric planes are down at any specified time and so traffic is impacted.
When multiple fabric boards and planes come online at the same time, you can batch them together and train. This reduces the booting up time and the time taken for the plane to come online.
On MX2000 line of routers with SFB, fabric grant bypass is enabled by default. Disabling fabric grant bypass helps control congestion and improves performance. On MX2000 line of routers with SFB, you can disable fabric grant bypass by By default, fabric grant bypass is disabled for all MPCs on MX2000 line of routers when they connect to SFB2. Fabric grant bypass is enabled by default on MPC1 (MX-MPC1-3D), MPC2 (MX-MPC2-3D), and the 16-port 10-Gigabit Ethernet MPC (MPC-3D-16xGE-SFPP). When fabric grant bypass is enabled by default, when those MPCs connect to SFB2, fabric grant bypass continues to be enabled and cannot be disabled.
To quickly access the information you need, click the links in Table 1.
Task You Need to Perform |
Where The Information Is Located |
---|---|
Before You begin |
|
Perform a Smooth Upgrade |
Performing a Smooth Upgrade to Enhanced Switch Fabric Board (SFB2) with Minimal Impact on Traffic |
Before you Begin the Smooth Upgrade Process
Before you begin the smooth upgrade from Switch Fabric Board (SFB) to enhanced Switch Fabric Board (SFB2), complete the following tasks:
If you have installed the Junos Continuity software package, you cannot perform a smooth upgrade from Switch Fabric Board (SFB) to Enhanced Switch Fabric Board (SFB2) on MX2010 and MX2020 routers.
Prepare the router and install the version of Junos OS Release (16.1R1 or later) that supports the smooth upgrade process. For more information about how to install or upgrade the version of Junos OS Release, see Installing the Software Package on a Device with Redundant Routing Engines (Junos OS).
Verify that the Switch Fabric Boards and fabric planes are online and operational. At this time, the line cards are connected to SFB.
Performing a Smooth Upgrade to Enhanced Switch Fabric Board (SFB2) with Minimal Impact on Traffic
This example shows how to perform a smooth upgrade from the Switch Fabric Board (SFB) to the enhanced Switch Fabric Board (SFB2) on the MX2000 line of routers. A smooth upgrade helps reduce network downtime because of 7+1 fabric redundancy. When one SFB is being upgraded to SFB2, the other 7 SFBs are available to handle the traffic.
On MX2010 and MX2020 routers, if you have installed the Junos Continuity software package or if the router is not configured to allow multiple versions of the SFBs to coexist, you cannot perform a smooth upgrade from SFB to SFB2.
When not using a smooth upgrade, use one of the following methods to upgrade to SFB2:
Power off the router, replace the SFB with SFB2, and then power on the router.
Take both the Routing Engines offline, replace the SFB with SFB2, and then bring both the Routing Engines online.
Requirements
This example uses the following hardware and software components:
MX2020 router with dual Routing Engines
8 Switch Fabric Boards (SFBs)
8 enhanced Switch Fabric Boards (SFB2s)
Junos OS Release 16.1R1 or later release
Before you begin the smooth upgrade, ensure that you:
Prepare the router and install the version of Junos OS Release that supports the enhanced Switch Fabric Board (SFB2).
Verify that the existing SFBs are online and operational and also check the status of the fabric planes.
For more information about what you must do before you commence smooth upgrade, see Before you Begin the Smooth Upgrade Process.
Overview
The smooth upgrade process is used to upgrade from Switch Fabric Board (SFB) to enhanced Switch Fabric Board (SFB2) with minimal traffic impact. The existing SFBs are replaced one by one, in any order, by the new SFB2s. Because you are replacing a single SFB at a time, the remaining SFBs handle the traffic and so there is minimal impact to traffic. SFB2 is supported only on MX2020 and MX2010 routers.
Topology
This example shows how to perform a smooth upgrade on an MX2020 router that has eight SFBs. The 8 SFBs are replaced with 8 enhanced switch fabric boards (SFB2). First, initiate the smooth upgrade process and then take a single SFB offline. Replace the SFB with an SFB2, and then bring the SFB2 online. You can then repeat the steps for the other seven SFBs.
After you upgrade all the SFBs to SFB2s, the fabric bandwidth per slot of MPC8E and MPC9E on the MX2020 router is increased from 11 Gbps to 25 Gbps. However, the upgrade does not impact the fabric bandwidth per slot of MPC7.
Configuration
To upgrade from SFB to SFB2, perform the following tasks:
- Initiating the Smooth Upgrade Process
- Performing the Smooth Upgrade
- Terminating the Smooth Upgrade Process
Initiating the Smooth Upgrade Process
Step-by-Step Procedure
By default, the MX2000 line of routers do not support both SFB and SFB2 at the same time. However, when you initiate the smooth upgrade process, the router can support both SFB and SFB2 at the same time. So, before you replace an SFB with an SFB2, you must initiate the smooth upgrade process.
In configuration mode, at the [
edit
] hierarchy level, Initiate the smooth upgrade process for the SFBs.[edit] user@host# set chassis state sfb-upgrade on
Commit the changes by using the
commit
statement and exit the configuration mode.[edit] user@host# commit
In operational mode, verify that you have initiated the smooth upgrade process.
user@host> show configuration chassis state { sfb-upgrade on; }
Performing the Smooth Upgrade
Step-by-Step Procedure
In operational mode, take the SFBs offline. There is no specific order that needs to be maintained. In this example, you start with the SFB in slot 7 first.
user@host> request chassis sfb slot 7 offline
Verify that the SFB is offline.
user@host> show chassis sfb
Slot State Uptime 0 Online 1 day, 12 hours, 6 minutes, 59 seconds 1 Online 1 day, 12 hours, 6 minutes, 37 seconds 2 Online 1 day, 12 hours, 6 minutes, 16 seconds 3 Online 1 day, 12 hours, 5 minutes, 55 seconds 4 Online 1 day, 12 hours, 5 minutes, 33 seconds 5 Online 1 day, 12 hours, 5 minutes, 12 seconds 6 Online 1 day, 12 hours, 4 minutes, 51 seconds 7 Offline --- Offlined by cli command ---
Replace the SFB that is offline with the enhanced SFB (SFB2). Minimal traffic loss is expected as only a single SFB is replaced and other seven SFBs are operational and handle the traffic.
In operational mode, bring the SFB2 online.
user@host> request chassis sfb slot 7 online
Verify that the SFB2 is online.
user@host> show chassis sfb
Slot State Uptime 0 Online 1 day, 12 hours, 16 minutes, 38 seconds 1 Online 1 day, 12 hours, 16 minutes, 16 seconds 2 Online 1 day, 12 hours, 15 minutes, 55 seconds 3 Online 1 day, 12 hours, 15 minutes, 34 seconds 4 Online 1 day, 12 hours, 15 minutes, 12 seconds 5 Online 1 day, 12 hours, 14 minutes, 51 seconds 6 Online 1 day, 12 hours, 14 minutes, 30 seconds 7 Online 38 seconds
Repeat Step 3 through Step 5 for upgrading the other SFBs. We recommend that you upgrade fabric boards one at a time for minimal traffic impact.
Terminating the Smooth Upgrade Process
Step-by-Step Procedure
After all the SFBs are upgraded to the enhanced SFB (SFB2), you can terminate the smooth upgrade process. When the smooth upgrade process is initiated, SFB and SFB2 can coexist on the same router. When you terminate the smooth upgrade process, the router can have only SFB or SFB2 and not both at the same time.
In configuration mode, at the [
edit
] hierarchy level, terminate the smooth upgrade process.Note:You can also use the
delete chassis state sfb-upgrade
command to terminate the smooth upgrade process.[edit] user@host# set chassis state sfb-upgrade off
Commit the changes by using the
commit
statement and exit configuration mode.[edit] user@host# commit
In operational mode, verify that you have initiated the smooth upgrade process.
user@host> show configuration chassis state { sfb-upgrade off; }
Verification
To confirm that you have upgraded SFB to SFB2 on the MX2020 router, perform these tasks:
- Verifying That the Switch Fabric Board (SFB) is Offline
- Verifying That the Enhanced Switch Fabric Board (SFB2) is Online
Verifying That the Switch Fabric Board (SFB) is Offline
Purpose
To verify that the SFB on a particular slot, for instance slot 1, is offline.
Action
From operational mode, enter the show chassis fabric
fpcs
command.
user@host> show chassis fabric fpcs Fabric management FPC state: FPC 2 PFE #0 Plane 0: Plane enabled Plane 1: Plane disabled >>>>> Plane 2: Plane enabled Plane 3: Plane enabled Plane 4: Plane enabled Plane 5: Plane enabled Plane 6: Plane enabled Plane 7: Plane enabled FPC 4 PFE #0 Plane 0: Plane enabled Plane 1: Plane disabled >>>>>> Plane 2: Plane enabled Plane 3: Plane enabled Plane 4: Plane enabled Plane 5: Plane enabled Plane 6: Plane enabled Plane 7: Plane enabled PFE #1 Plane 0: Plane enabled Plane 1: Plane disabled >>>> Plane 2: Plane enabled Plane 3: Plane enabled Plane 4: Plane enabled Plane 5: Plane enabled Plane 6: Plane enabled Plane 7: Plane enabled PFE #2 Plane 0: Plane enabled Plane 1: Plane disabled >>>> Plane 2: Plane enabled Plane 3: Plane enabled Plane 4: Plane enabled Plane 5: Plane enabled Plane 6: Plane enabled Plane 7: Plane enabled PFE #3 Plane 0: Plane enabled Plane 1: Plane disabled >>>>> Plane 2: Plane enabled Plane 3: Plane enabled Plane 4: Plane enabled Plane 5: Plane enabled Plane 6: Plane enabled Plane 7: Plane enabled FPC 6 PFE #0 Plane 0: Plane enabled Plane 1: Plane disabled >>>>> Plane 2: Plane enabled Plane 3: Plane enabled Plane 4: Plane enabled Plane 5: Plane enabled Plane 6: Plane enabled Plane 7: Plane enabled PFE #1 Plane 0: Plane enabled Plane 1: Plane disabled >>>>> Plane 2: Plane enabled Plane 3: Plane enabled Plane 4: Plane enabled Plane 5: Plane enabled Plane 6: Plane enabled Plane 7: Plane enabled FPC 7 PFE #0 Plane 0: Plane enabled Plane 1: Plane disabled >>>>> Plane 2: Plane enabled Plane 3: Plane enabled Plane 4: Plane enabled Plane 5: Plane enabled Plane 6: Plane enabled Plane 7: Plane enabled PFE #1 Plane 0: Plane enabled Plane 1: Plane disabled >>>>> Plane 2: Plane enabled Plane 3: Plane enabled Plane 4: Plane enabled Plane 5: Plane enabled Plane 6: Plane enabled Plane 7: Plane enabled PFE #2 Plane 0: Plane enabled Plane 1: Plane disabled >>>>> Plane 2: Plane enabled Plane 3: Plane enabled Plane 4: Plane enabled Plane 5: Plane enabled Plane 6: Plane enabled Plane 7: Plane enabled PFE #3 Plane 0: Plane enabled Plane 1: Plane disabled >>>>>> Plane 2: Plane enabled Plane 3: Plane enabled Plane 4: Plane enabled Plane 5: Plane enabled Plane 6: Plane enabled Plane 7: Plane enabled
From operational mode, enter the show chassis fabric
summary
command.
user@host> show chassis fabric summary Plane State Uptime 0 Online 3 minutes, 14 seconds 1 Offline 2 Online 1 hour, 56 minutes, 53 seconds 3 Online 1 hour, 56 minutes, 39 seconds 4 Online 1 hour, 56 minutes, 25 seconds 5 Online 1 hour, 56 minutes, 11 seconds 6 Online 1 hour, 55 minutes, 56 seconds 7 Online 1 hour, 42 minutes, 28 seconds Note: For extended summary, use show chassis fabric summary extended
Meaning
The SFB in Slot 1 has been taken offline.
Verifying That the Enhanced Switch Fabric Board (SFB2) is Online
Purpose
To verify that the enhanced switch fabric board (SFB2) inserted in the same slot (slot 1) is online.
Action
From operational mode, enter the show chassis fabric
fpcs
command.
user@host> show chassis fabric fpcs Fabric management FPC state: FPC 2 PFE #0 Plane 0: Plane enabled Plane 1: Plane enabled >>>>>> Plane 2: Plane enabled Plane 3: Plane enabled Plane 4: Plane enabled Plane 5: Plane enabled Plane 6: Plane enabled Plane 7: Plane enabled FPC 4 PFE #0 Plane 0: Plane enabled Plane 1: Plane enabled >>>>>> Plane 2: Plane enabled Plane 3: Plane enabled Plane 4: Plane enabled Plane 5: Plane enabled Plane 6: Plane enabled Plane 7: Plane enabled PFE #1 Plane 0: Plane enabled Plane 1: Plane enabled >>>> Plane 2: Plane enabled Plane 3: Plane enabled Plane 4: Plane enabled Plane 5: Plane enabled Plane 6: Plane enabled Plane 7: Plane enabled PFE #2 Plane 0: Plane enabled Plane 1: Plane enabled >>>> Plane 2: Plane enabled Plane 3: Plane enabled Plane 4: Plane enabled Plane 5: Plane enabled Plane 6: Plane enabled Plane 7: Plane enabled PFE #3 Plane 0: Plane enabled Plane 1: Plane enabled >>>>> Plane 2: Plane enabled Plane 3: Plane enabled Plane 4: Plane enabled Plane 5: Plane enabled Plane 6: Plane enabled Plane 7: Plane enabled FPC 6 PFE #0 Plane 0: Plane enabled Plane 1: Plane enabled >>>>> Plane 2: Plane enabled Plane 3: Plane enabled Plane 4: Plane enabled Plane 5: Plane enabled Plane 6: Plane enabled Plane 7: Plane enabled PFE #1 Plane 0: Plane enabled Plane 1: Plane enabled >>>>> Plane 2: Plane enabled Plane 3: Plane enabled Plane 4: Plane enabled Plane 5: Plane enabled Plane 6: Plane enabled Plane 7: Plane enabled FPC 7 PFE #0 Plane 0: Plane enabled Plane 1: Plane enabled >>>>> Plane 2: Plane enabled Plane 3: Plane enabled Plane 4: Plane enabled Plane 5: Plane enabled Plane 6: Plane enabled Plane 7: Plane enabled PFE #1 Plane 0: Plane enabled Plane 1: Plane enabled >>>>> Plane 2: Plane enabled Plane 3: Plane enabled Plane 4: Plane enabled Plane 5: Plane enabled Plane 6: Plane enabled Plane 7: Plane enabled PFE #2 Plane 0: Plane enabled Plane 1: Plane enabled >>>>> Plane 2: Plane enabled Plane 3: Plane enabled Plane 4: Plane enabled Plane 5: Plane enabled Plane 6: Plane enabled Plane 7: Plane enabled PFE #3 Plane 0: Plane enabled Plane 1: Plane enabled >>>>>> Plane 2: Plane enabled Plane 3: Plane enabled Plane 4: Plane enabled Plane 5: Plane enabled Plane 6: Plane enabled Plane 7: Plane enabled
From operational mode, enter the show chassis fabric
summary
command.
user@host> show chassis fabric summary Plane State Uptime 0 Online 6 minutes, 38 seconds 1 Online 2 minutes, 12 seconds >>>> 2 Online 2 hours, 17 seconds 3 Online 2 hours, 3 seconds 4 Online 1 hour, 59 minutes, 49 seconds 5 Online 1 hour, 59 minutes, 35 seconds 6 Online 1 hour, 59 minutes, 20 seconds 7 Online 1 hour, 45 minutes, 52 seconds
Meaning
The SFB2 that replaced the SFB on slot 1 is online and operational.