Help us improve your experience.

Let us know what you think.

Do you have time for a two-minute survey?

 
ON THIS PAGE
 

Gigabit Ethernet PICs

SUMMARY Learn about Gigabit Ethernet (GbE) PICs that are used to connect computers and servers in local area networks (LANs). How to configure GbE PICs to perform traffic policing without the need to configure a firewall filter.

Gigabit Ethernet PIC supports flexible encapsulation and MAC accounting. Gigabit Ethernet connects computers and servers in local networks. The data transfer speed and cabling improvements have recommended many enterprises to replace Fast Ethernet with Gigabit Ethernet for wired local networks.

P2-10G-40G-QSFPP PIC Overview

All the ports on the P2-10G-40G-QSFPP PIC are plugged into quad small form-factor pluggable plus transceivers (QSFP+) that, in turn, are connected to fiber-optic cables that support both 10-Gigabit Ethernet standards and 40-Gigabit Ethernet standards, thereby enabling you to configure the PIC to operate either in 10-Gigabit Ethernet mode or in 40-Gigabit Ethernet mode.

You can configure the ports on the PIC in 10-Gigabit Ethernet mode or 40-Gigabit Ethernet mode at the port group level.

The following sections describe the P2-10G-40G-QSFPP PIC and the various framing modes that are supported on it:

Understanding Dual Configuration on P2-10G-40G-QSFPP PIC

All the ports on the P2-10G-40G-QSFPP PIC are QSFP+ based—that is, all the ports are connected to fiber-optic cables by means of QSFP+ transceivers.

The QSFP+ module—which includes the transceiver and the fiber-optic cable—supports the following standards on the P2-10G-40G-QSFPP PIC:

  • 10-Gigabit Ethernet in LAN PHY framing mode (also known as native Ethernet mode) and WAN PHY framing mode.

    Note that the ports follow a 4-level interface-naming convention—et-fpc/pic/QSFP+ port:channel in this mode.

  • 40-Gigabit Ethernet in LAN PHY framing mode.

    Note that the ports follow a 3-level interface-naming convention—et-fpc/pic/QSFP+ port in this mode.

The P2-10G-40G-QSFPP PIC provides forty-eight 10-Gigabit Ethernet ports or twelve 40-Gigabit Ethernet ports. or .

The PIC can be configured either in 10-Gigabit Ethernet mode or in 40-Gigabit Ethernet mode with the set chassis fpc fpc-number pic pic-number pic-mode (10G | 40G) configuration command. By default, the PIC is configured in 10-Gigabit Ethernet LAN PHY framing mode.

If you want to configure the PIC in 10-Gigabit Ethernet mode to operate in 40-Gigabit Ethernet mode, you must:

  1. Delete all the interfaces in the PIC at the [edit interfaces] hierarchy level.

  2. Configure the PIC to operate in 40-Gigabit Ethernet mode by using the set chassis fpc fpc-slot pic pic-slot pic-mode 40G configuration command and commit.

The PIC reboots and starts operating in the new mode.

The same procedure is applicable when you can configure the PIC in 40-Gigabit Ethernet PIC to operate in 10-Gigabit Ethernet mode. In this case, you must execute the set chassis fpc fpc-slot pic pic-slot pic-mode 10G configuration mode command.

To check the current diagnostics of the PIC, you must run the relevant operational mode CLI commands such as show chassis hardware, show interfaces diagnostics optics interface-name,

Understanding Port Group

The FPC2-PTX-P1A FPC can host two PICs and has eight Packet Forwarding Engines. The first four Packet Forwarding Engines on the FPC are associated with PIC 0 and the next four are associated with PIC 1.

All ports associated to one Packet Forwarding Engine compose a port group. Each PIC supports four Packet Forwarding Engines. Therefore, four port groups exist for each P2-10G-40G-QSFPP PIC.

Each Packet Forwarding Engine providesthroughput of 120 Gbps.

Points to Remember

Consider the following points when configuring the PIC at the port group level:

  • You can configure the ports in 10-Gigabit Ethernet mode or in 40-Gigabit Ethernet mode at the port group level.

  • You can configure the port speed only on the first port in the port group. That is, you must configure the port speed for the port group on the ports numbered 0, 3, 6, and 9—the first ports in the respective port groups. An error message is logged when you try to configure the speed on any other port in the port group and this configuration will not have any effect on the PIC.

  • You can configure the port speed of a port group only when the value of the pic-mode statement at the [edit chassis fpc fpc-slot pic pic-slot pic-mode] is set to 10G or when the statement is not configured.

  • You cannot configure different speeds for the ports in the same port group.

  • You can configure different speeds for different port groups.

Port Group in 10-Gigabit Ethernet Mode

Each Packet Forwarding Engine supports twelve 10-Gigabit Ethernet ports in LAN PHY or in WAN PHY framing mode.

Note that when a port group is configured from 10-Gigabit Ethernet mode to 40-Gigabit Ethernet mode, the ports with 4-level interface-naming convention are deleted and three 40-Gigabit Ethernet mode ports with 3-level interface-naming convention are created.

Note that when the configuration of a port group is changed from 10-Gigabit Ethernet mode to 40-Gigabit Ethernet mode, the configuration of the twelve 10-Gigabit Ethernet ports is deleted and the 4-level interface-naming convention of the ports is also lost. Instead, three 40-Gigabit Ethernet ports are configured and these ports adhere to the 3-level interface-naming convention

Port Group in 40-Gigabit Ethernet Mode

Each Packet Forwarding Engine supports three 40-Gigabit Ethernet ports in LAN PHY framing mode.

Note that when the configuration of a port group is changed from 40-Gigabit Ethernet mode to 10-Gigabit Ethernet mode, the configuration of the three 40-Gigabit Ethernet ports is deleted and the 3-level interface-naming convention of the ports is also lost. Instead, twelve 10-Gigabit Ethernet ports are configured and these ports adhere to the 4-level interface-naming convention.

Port Number Mapping When Port Groups Are Configured

Table 1 shows the port numbering in 40-Gigabit Ethernet mode and in 10-Gigabit Ethernet mode at the port group level.

Table 1: Port Number Mapping When Port Groups Are Configured

QSFP+ Port Number

Port Numbering in 40-Gigabit Ethernet Mode

Port Numbering in 10-Gigabit Ethernet Mode

0 (0)

et-1/1/0

et-1/1/0:0

et-1/1/0:1

et-1/1/0:2

et-1/1/0:3

et-1/1/1

et-1/1/1:0

et-1/1/1:1

et-1/1/1:2

et-1/1/1:3

et-1/1/2

et-1/1/2:0

et-1/1/2:1

et-1/1/2:2

et-1/1/2:3

3(1)

et-1/1/3

et-1/1/3:0

et-1/1/3:1

et-1/1/3:2

et-1/1/3:3

et-1/1/4

et-1/1/4:0

et-1/1/4:1

et-1/1/4:2

et-1/1/4:3

et-1/1/5

et-1/1/5:0

et-1/1/5:1

et-1/1/5:2

et-1/1/5:3

6(2)

et-1/1/6

et-1/1/6:0

et-1/1/6:1

et-1/1/6:2

et-1/1/6:3

et-1/1/7

et-1/1/7:0

et-1/1/7:1

et-1/1/7:2

et-1/1/7:3

et-1/1/8

et-1/1/8:0

et-1/1/8:1

et-1/1/8:2

et-1/1/8:3

6(2)

et-1/1/6

et-1/1/6:0

et-1/1/6:1

et-1/1/6:2

et-1/1/6:3

et-1/1/7

et-1/1/7:0

et-1/1/7:1

et-1/1/7:2

et-1/1/7:3

et-1/1/8

et-1/1/8:0

et-1/1/8:1

et-1/1/8:2

et-1/1/8:3

9(3)

et-1/1/9

et-1/1/9:0

et-1/1/9:1

et-1/1/9:2

et-1/1/9:3

et-1/1/10

et-1/1/10:0

et-1/1/10:1

et-1/1/10:2

et-1/1/10:3

et-1/1/11

et-1/1/11:0

et-1/1/11:1

et-1/1/11:2

et-1/1/11:3

Port Numbering on P2-10G-40G-QSFPP PIC When Port Groups Are Not Configured

Table 2 shows the port numbering in 40-Gigabit Ethernet mode and in 10-Gigabit Ethernet mode when port groups are not configured on the P2-10G-40G-QSFPP PIC.

Table 2: Port Number Mapping When Port Groups Are Not Configured

QSFP+ Port Number

Port Numbering in 40-Gigabit Ethernet Mode

Port Numbering in 10-Gigabit Ethernet Mode

0

et-1/1/0

et-1/1/0:0

et-1/1/0:1

et-1/1/0:2

et-1/1/0:3

1

et-1/1/1

et-1/1/1:0

et-1/1/1:1

et-1/1/1:2

et-1/1/1:3

2

et-1/1/2

et-1/1/2:0

et-1/1/2:1

et-1/1/2:2

et-1/1/2:3

3

et-1/1/3

et-1/1/3:0

et-1/1/3:1

et-1/1/3:2

et-1/1/3:3

4

et-1/1/4

et-1/1/4:0

et-1/1/4:1

et-1/1/4:2

et-1/1/4:3

5

et-1/1/5

et-1/1/5:0

et-1/1/5:1

et-1/1/5:2

et-1/1/5:3

6

et-1/1/6

et-1/1/6:0

et-1/1/6:1

et-1/1/6:2

et-1/1/6:3

7

et-1/1/7

et-1/1/7:0

et-1/1/7:1

et-1/1/7:2

et-1/1/7:3

8

et-1/1/8

et-1/1/8:0

et-1/1/8:1

et-1/1/8:2

et-1/1/8:3

9

et-1/1/9

et-1/1/9:0

et-1/1/9:1

et-1/1/9:2

et-1/1/9:3

10

et-1/1/10

et-1/1/10:0

et-1/1/10:1

et-1/1/10:2

et-1/1/10:3

11

et-1/1/11

et-1/1/11:0

et-1/1/11:1

et-1/1/11:2

et-1/1/11:3

10-Gigabit Ethernet Mode

A 10-Gigabit Ethernet interface can operate in 10-Gigabit Ethernet LAN PHY framing mode or in 10-Gigabit Ethernet WAN PHY framing mode.

You can configure a 10-Gigabit Ethernet interface at the [edit interface interface-name framing-mode (lan-phy | wan-phy)] hierarchy level to operate in 10-Gigabit Ethernet LAN PHY framing mode or in 10-Gigabit Ethernet WAN PHY framing mode.

Each P2-10G-40G-QSFPP PIC provides 48 physical interfaces. The interfaces are represented by the 4-level interface-naming convention—et-fpc/pic/QSFP+ port:channel, where the value of the QSFP+ port option ranges from 0 through 11 and the value of the channel option ranges from 0 through 3.

Framing Mode Overview

When a P2-10G-40G-QSFPP PIC is configured in 10-Gigabit Ethernet framing mode, it can operate in one of the following framing modes:

  • LAN PHY framing mode. Note that by default, the PIC is in 10-Gigabit Ethernet LAN PHY framing mode. You can configure loopback at the [edit interfaces interface-name sonet-options loopback] hierarchy level.

    The ports are set to LAN PHY framing mode by default when the framing-mode statement is not configured at the [edit interface interface-name] hierarchy level.

  • WAN PHY framing mode

Supported Features on LAN PHY and WAN PHY Framing Mode

The following features are supported in LAN PHY and WAN PHY framing mode when the PIC operates in 10-Gigabit Ethernet mode:

  • The following are supported for WAN interface sublayer statistics, defects, and alarms when the PIC operates in WAN PHY framing mode:

    • GR 253 standard.

    • show interfaces interfaces-name operational mode command displays WAN interface sublayer statistics, defects and alarms.

    • Interrupt-driven notification for WAN interface sublayer defects.

    • Path trace and trigger options for WAN interface sublayer alarms.

    • Transmitting and receiving J1 (path trace) messages—J1 is a part of path overhead in a WAN interface sublayer frame.

  • Line loopback and local loopback. Loopback is configured at the [edit interfaces interface-name sonet-options loopback] hierarchy level in WAN PHY framing mode.

  • The defects PHY LOL (loss of light) and PHY PLL (loss of PLL lock) are detected and reported at the physical level in WAN PHY framing mode.

Fast reroute (FRR) in WAN PHY framing mode:

  • Enable or disable preemptive fast reroute (FRR) options at the [edit interfaces interface-name otn-options preemptive-fast-reroute] hierarchy level.

  • Configure thresholds and interval for the optical channel data unit (ODU) signal degradation (odu-signal-degrade) and the configurable pre-FEC bit error rate (BER) (ber-threshold-signal-degrade) at the [edit interfaces interface-name otn-options odu-signal-degrade] hierarchy level and the [edit interfaces interface-name otn-options signal-degrade] hierarchy level, respectively.

40-Gigabit Ethernet Mode

You can configure twelve 40-Gigabit Ethernet interfaces that operate in LAN PHY framing mode. The interfaces are represented by the 3-level interface-naming convention et-fpc/pic/QSFP+ port, where the value of the QSFP+ port variable ranges from 0 through 11.

Configure the P2-10G-40G-QSFPP PIC

Starting with Junos OS Release 14.1R2, PTX5000 supports the P2-10G-40G-QSFPP PIC on the FPC2-PTX-P1A FPC. You can configure the P2-10G-40G-QSFPP PIC to operate either in 10-Gigabit Ethernet mode or in 40-Gigabit Ethernet mode..

The following tasks explain how to configure the P2-10G-40G-QSFPP PIC in 10-Gigabit Ethernet mode or in 40-Gigabit Ethernet mode and to configure the framing modes on it.

Configure the PIC in 10-Gigabit Ethernet Mode or in 40-Gigabit Ethernet Mode

To configure the P2-10G-40G-QSFPP PIC in 10-Gigabit Ethernet mode or in 40-Gigabit Ethernet mode:

  1. In configuration mode, go to the [edit chassis] hierarchy level.
  2. Configure the PIC in 10-Gigabit Ethernet mode or in 40-Gigabit Ethernet mode after specifying the required FPC slot and PIC slot. Note that all the PIC ports in a PIC are configured at once with this configuration command.

Configure the PIC in 10-Gigabit Ethernet Mode to Operate in 40-Gigabit Ethernet Mode

To configure the P2-10G-40G-QSFPP PIC that is configured in 10-Gigabit Ethernet mode to operate in 40-Gigabit Ethernet mode:

  1. In configuration mode, go to the [edit interfaces] hierarchy level.
  2. Delete all the interfaces in the PIC, commit, and then move to the top of the hierarchy level.
  3. Configure the PIC to operate in 40-Gigabit Ethernet mode and commit.

After the configuration is committed, the PIC reboots and starts operating in the 40-Gigabit Ethernet mode. You can now configure the parameters, such as encapsulation, framing mode, and so on, for the twelve 40-Gigabit Ethernet interfaces in the PIC as needed.

Configure the PIC in 40-Gigabit Ethernet Mode to Operate in 10-Gigabit Ethernet Mode

To configure the P2-10G-40G-QSFPP PIC that is configured in 40-Gigabit Ethernet mode to operate in 10-Gigabit Ethernet mode:

  1. In configuration mode, go to the [edit interfaces interfaces-name] hierarchy level.
  2. Delete all the interfaces in the PIC, commit, and then move to the top of the hierarchy level.
  3. Configure the PIC to operate in 10-Gigabit Ethernet mode and commit.

After the configuration is committed, the PIC reboots and starts operating in the 10-Gigabit Ethernet mode. You can now configure the parameters, such as encapsulation, framing mode, and so on, for the forty-eight 10-Gigabit Ethernet interfaces in the PIC as needed.

Configure the PIC at Port Group Level

Before You Begin

Verify that the pic-mode statement at the [edit chassis fpc fpc-slot pic pic-slot pic-mode] is not configured or that its value is set to 10G.

To configure a port group in the P2-10G-40G-QSFPP PIC to operate in 10-Gigabit Ethernet mode or 40-Gigabit Ethernet mode:

  1. In configuration mode, go to the [edit chassis fpc fpc-slot pic pic-slot] hierarchy level.
  2. Configure the port number as 0, 3, 6, or 9 and the speed as 10G or 40G. Note that you can configure the port speed only on the first port in the port group. That is, configure the port speed only on the ports numbered 0, 3, 6, and 9. An error message is displayed when you try to configure the speed on any other port in the port group.

A system log message is logged when you try to configure a different port speed on a port when the port group is operating at another speed.

Configure Framing Mode on P2-10G-40G-QSFPP PIC

You can configure LAN PHY, or WAN PHY framing mode when the PIC is operating in 10-Gigabit Ethernet mode. You can configure LAN PHY framing mode when the PIC is operating in 40-Gigabit Etherent mode.

Configure LAN PHY or WAN PHY Framing Mode in 10-Gigabit Ethernet Mode

To configure the P2-10G-40G-QSFPP PIC in 10-Gigabit Ethernet mode to operate in LAN PHY framing mode or in WAN PHY framing mode, you must configure the framing mode individually on all the interfaces:

You can configure LAN PHY, or WAN PHY framing mode when the PIC is operating in 10-Gigabit Ethernet mode. You can configure LAN PHY framing mode when the PIC is operating in 40-Gigabit Etherent mode. The following tasks explain how to configure the various framing modes on the PIC

  1. In configuration mode, go to the [edit interfaces interfaces-name] hierarchy level, where the interface name is in et-fpc/pic/port:channel format.
  2. Configure the framing mode as LAN PHY or WAN PHY and commit.

    For example, you can configure the framing mode as LAN PHY or WAN PHY on the et-1/1/1:0 interface.

Configure LAN PHY Framing Mode in 40-Gigabit Ethernet Mode

To configure the P2-10G-40G-QSFPP PIC in 40-Gigabit Ethernet mode to operate in LAN PHY framing mode:

  1. In configuration mode, go to the [edit interfaces interfaces-name] hierarchy level, where the interface name is in et-fpc/pic/port format.
  2. Configure the framing mode as LAN PHY and commit.

    For example, you can configure the framing mode as LAN PHY on the et-2/2/2 interface.

Example: Configure the P2-10G-40G-QSFPP PIC

Requirements

This example uses the following hardware and software components:

  • Junos OS Release 14.1R2 or Junos OS Release 14.2 or later

  • One PTX5000 router with P2-10G-40G-QSFPP PIC

Overview

Starting with Junos OS Release 14.1R2 and 14.2R1, PTX5000 supports the P2-10G-40G-QSFPP PIC on the FPC2-PTX-P1A FPC.

All the ports on the P2-10G-40G-QSFPP PIC are QSFP+ based—that is, all the ports are connected to fiber-optic cables by means of QSFP+ transceivers. The P2-10G-40G-QSFPP PIC provides forty-eight 10-Gigabit Ethernet ports or twelve 40-Gigabit Ethernet ports.

The QSFP+ module—which includes the transceiver and the fiber-optic cable—supports the following standards on the P2-10G-40G-QSFPP PIC:

  • 10-Gigabit Ethernet in LAN PHY framing mode (also known as native Ethernet mode) and WAN PHY framing mode.

  • 40-Gigabit Ethernet in LAN PHY framing mode.

Configuration

To configure the P2-10G-40G-QSFPP PIC to operate in 10-Gigabit Ethernet mode, and to set the framing mode and other options on an interface on this PIC, perform the following tasks:

Configuring the P2-10G-40G-QSFPP PIC in 10-Gigabit Ethernet Mode

Step-by-Step Procedure

Configure the PIC in 10-Gigabit Ethernet mode.

  1. In configuration mode, go to the [edit chassis] hierarchy level.

  2. Configure the PIC in 10-Gigabit Ethernet mode after specifying the required FPC slot and PIC slot. Note that the PIC restarts after the configuration is committed and all the ports in the PIC come up in the 10-Gigabit Ethernet mode.

Configuring the Framing Mode on an Interface

Step-by-Step Procedure

To configure an interface et-1/1/1:0 in the P2-10G-40G-QSFPP PIC to operate in LAN PHY framing mode:

  1. In configuration mode, go to the [edit interfaces et-1/1/1:0] hierarchy level.

  2. Configure the framing mode for the interface as LAN PHY and commit.

    Similarly, you can configure LAN PHY or WAN PHY framing mode for the other interfaces in the PIC.

Configuring the Interface Options

Step-by-Step Procedure

Configure the interface options for the interface et-1/1/1:0 as needed. The following procedure configures a few interface-specific options.

  1. In configuration mode, go to the [edit interfaces et-1/1/1:0] hierarchy level.

  2. Configure the encapsulation as ethernet-ccc.

  3. Configure the family as CCC for the logical interface 0.

  4. Enable flow control to regulate the flow of packets from the router to the remote side of the network connection.

  5. Enable loopback mode for the interface, commit the configuration, and exit the configuration mode.

Verification

Displaying Interface Details
Purpose

To display interface-specific details of the et-1/1/1:0 interface.

Action

Execute the show interfaces et-1/1/1:0 operational command.

Meaning

The interface details are displayed. Note that to display information for an interface in 10-Gigabit Ethernet mode for the P2-10G-40G-QSFPP PIC, you must use the et-fpc/pic/port:channel format.

Framing Overview

The 10-Gigabit Ethernet interfaces support operation in two modes:

  • 10GBASE-R, LAN Physical Layer Device (LAN PHY)

  • 10GBASE-W, WAN Physical Layer Device (WAN PHY)

When the external interface is running in LAN PHY mode, it bypasses the WIS sublayer to directly stream block-encoded Ethernet frames on a 10-Gigabit Ethernet serial interface. When the external interface is running in WAN PHY mode, it uses the WIS sublayer to transport 10-Gigabit Ethernet frames in an OC192c SONET payload.

WAN PHY mode is supported on MX240, MX480, MX960, and PTX Series Packet Transport routers only.

Although the external interface provides a lower throughput when running in WAN PHY mode because of the extra SONET overhead, it can interoperate with SONET section or line level repeaters. This creates an advantage when the interface is used for long-distance, point-to-point 10-Gigabit Ethernet links. When the external interface is running in WAN PHY mode, some SONET options are supported.

Understanding WAN Framing

If you use the wan-phy statement option at the [edit interfaces xe-fpc/pic/0 framing] hierarchy level to configure Trio WAN mode framing for 10-Gigabit Ethernet interfaces, then the alarm behavior of the link, although in full compliance with the IEEE 802.3ae 10-Gigabit Ethernet standard, might not be as expected.

In particular:

  • The interface does not distinguish between loss of light (LOL), loss of phase lock loop (PLL), or loss of signal (LOS). If a loss of PLL or LOS alarm occurs, then both PLL and LOS alarms are raised. LOL is also raised because there is no separate LOL indication from the hardware.

  • The interface does not raise LOS, PLL, or LOL alarms when the fiber in disconnected from the interface port. You must remove the hardware to raise this alarm.

  • The interface line-level alarm indicator signal (AIS-L) is not always raised in response to a loss of framing (LOF) defect alarm.

  • If the AIS-L or path-level AIS (AIS-P) occurs, the interface path-level loss of code delineation (LCD-P) is not detected. LCD-P is seen during the path-level remote defect indicator (RDI-P) alarm.

  • If an AIS-L alarm occurs, the AIS-P is not detected, but the LOP alarm is detected.

None of the alarm issues are misleading, but they make troubleshooting the root cause of problems more complex.

Configure Ethernet Framing

The 10-Gigabit Ethernet interfaces uses the interface type xe-fpc/pic/port. On single port devices, the port number is always zero.

The xe-fpc/pic/port interface inherits all the configuration commands that are used for gigabit Ethernet (ge-fpc/pic/port) interfaces.

To configure LAN PHY or WAN PHY operating mode, include the framing statement with the lan-phy or wan-phy option at the [edit interfaces xe-fpc /pic/0 ] hierarchy level.

  • On PTX Series Transport Routers, WAN PHY mode is supported only on the 24-port 10-Gigabit Ethernet LAN/WAN PIC with SFP+

  • When the PHY mode changes, interface traffic is disrupted because of port reinitialization.

To display interface information, use the operational mode command show interfaces xe-fpc/pic/port extensive.