Help us improve your experience.

Let us know what you think.

Do you have time for a two-minute survey?

header-navigation
keyboard_arrow_up
close
keyboard_arrow_left
list Table of Contents
file_download PDF
{ "lLangCode": "en", "lName": "English", "lCountryCode": "us", "transcode": "en_US" }
English
keyboard_arrow_right

Identifying the Source of RED Dropped Packets on PTX Series Routers

date_range 29-Nov-23

This topic describes how to identify the source of random early detection (RED) dropped packets.

Junos OS and PTX Series hardware CoS features use virtual output queues (VOQs) on the ingress to buffer and queue traffic for each egress output queue.

VOQ is a queuing strategy that eliminates congestion drops on the egress and alleviates head-of-line blocking. Head-of-line blocking is a condition in which a queue of packets is blocked from making progress because the packet at the head of the queue is waiting for resources to become available, while other packets behind this packet could be serviced. For example, if the ingress has a single queue for an egress Packet Forwarding Engine, then packets destined for a slow, congested interface can block packets destined for a fast, uncongested interface attached to the same egress Packet Forwarding Engine.

With VOQ, virtual queues are maintained on the ingress Packet Forwarding Engines, instead of on the egress Packet Forwarding Engine. However, the scheduling of the ingress virtual output queues is controlled by the egress Packet Forwarding Engine. For every egress output queue (shallow buffer), the VOQ architecture provides virtual queues on each and every ingress Packet Forwarding Engine. These queues are referred to as virtual because the queues physically exist on the ingress Packet Forwarding Engine only when the line card actually has packets enqueued to it.

Figure 1 shows three ingress Packet Forwarding Engines—PFE0, PFE1, and PFE2. Each ingress Packet Forwarding Engine provides up to eight virtual output queues (PFEn.e0.q0 through PFEn.e0.q7) for the single egress port 0. The egress Packet Forwarding Engine PFEn distributes the bandwidth to each ingress VOQ in a round-robin fashion; therefore they will receive equal treatment regardless of their presented load.

For example, egress PFEn's VOQ e0.q0 has 10 Gbps of bandwidth available to it. PFE0 has an offered load of 10 Gbps to e0.qo, whereas PFE1 and PFE2 have an offered load of 1Gbps to e0.q0. The result is that PFE1 and PFE2 get 100 percent of their traffic through, wheras PFE0 gets only 80 percent of its traffic through.

Figure 1: Virtual Output Queuing on PTX Series RoutersVirtual Output Queuing on PTX Series Routers

When congestion occurs because of the load on the egress output queue, the ingress VOQs corresponding to the egress output queue contain RED dropped packets.

Using the following procedure, you can identify the ingress Packet Forward Engine (in terms of ingress traffic) that is contributing to the egress congestion.

To determine which ingress Packet Forwarding Engine is contributing to the RED dropped packets:

  1. Determine whether there are RED dropped packets on the egress link.
    1. Run the show interfaces queue interface-name command on the egress interface.

      content_copy zoom_out_map
      user@host> show interfaces queue et-7/0/0 
      
    2. In the show output, determine whether the interface is experiencing RED dropped packets, by locating the RED-dropped packets field and checking whether its value is greater than zero.

      The following example shows RED-dropped statistics for the egress Ethernet interface configured on port 0 of PIC 0, located on the FPC in slot 7.

    content_copy zoom_out_map
    user@host> show interfaces queue et-7/0/0
    Physical interface: et-7/0/0, Enabled, Physical link is Up
      Interface index: 206, SNMP ifIndex: 790
    Forwarding classes: 16 supported, 8 in use
    Egress queues: 8 supported, 8 in use
    Queue: 0, Forwarding classes: fc0
      Queued:
        Packets              :             539433200              14896082 pps
        Bytes                :           38302319880            8461137824 bps
      Transmitted:
        Packets              :              67108815               1859497 pps
        Bytes                :            4294964160             952062464 bps
        Tail-dropped packets :                     0                     0 pps
        RL-dropped packets   :                     0                     0 pps
        RL-dropped bytes     :                     0                     0 bps
        RED-dropped packets  :             472324385              13036585 pps
        RED-dropped bytes    :           34007355720            7509075360 bps
    Queue: 1, Forwarding classes: fc1
      Queued:
        Packets              :             539433555              14877096 pps
        Bytes                :           38302345472            8450201072 bps
      Transmitted:
        Packets              :              67108811               1859498 pps
        Bytes                :            4294963904             952062976 bps
        Tail-dropped packets :                     0                     0 pps
        RL-dropped packets   :                     0                     0 pps
        RL-dropped bytes     :                     0                     0 bps
        RED-dropped packets  :             472324744              13017598 pps
        RED-dropped bytes    :           34007381568            7498138096 bps
    Queue: 2, Forwarding classes: fc2
      Queued:
        Packets              :             539433811              14892745 pps
        Bytes                :           38302363728            8459214984 bps
      Transmitted:
        Packets              :              67108833               1859501 pps
        Bytes                :            4294965312             952064512 bps
        Tail-dropped packets :                     0                     0 pps
        RL-dropped packets   :                     0                     0 pps
        RL-dropped bytes     :                     0                     0 bps
        RED-dropped packets  :             472324978              13033244 pps
        RED-dropped bytes    :           34007398416            7507150472 bps
    Queue: 3, Forwarding classes: fc3
      Queued:
        Packets              :             539433461              14879323 pps
        Bytes                :           38302338584            8451484208 bps
      Transmitted:
        Packets              :              67108826               1859498 pps
        Bytes                :            4294964864             952062976 bps
        Tail-dropped packets :                     0                     0 pps
        RL-dropped packets   :                     0                     0 pps
        RL-dropped bytes     :                     0                     0 bps
        RED-dropped packets  :             472324635              13019825 pps
        RED-dropped bytes    :           34007373720            7499421232 bps
    Queue: 4, Forwarding classes: fc4
      Queued:
        Packets              :             539433755              14884190 pps
        Bytes                :           38302359616            8454286816 bps
      Transmitted:
        Packets              :              67108843               1859508 pps
        Bytes                :            4294965952             952068096 bps
        Tail-dropped packets :                     0                     0 pps
        RL-dropped packets   :                     0                     0 pps
        RL-dropped bytes     :                     0                     0 bps
        RED-dropped packets  :             472324912              13024682 pps
        RED-dropped bytes    :           34007393664            7502218720 bps
    Queue: 5, Forwarding classes: fc5
      Queued:
        Packets              :             539433849              14892950 pps
        Bytes                :           38302366384            8459333176 bps
      Transmitted:
        Packets              :              67108843               1859497 pps
        Bytes                :            4294965952             952062464 bps
        Tail-dropped packets :                     0                     0 pps
        RL-dropped packets   :                     0                     0 pps
        RL-dropped bytes     :                     0                     0 bps
        RED-dropped packets  :             472325006              13033453 pps
        RED-dropped bytes    :           34007400432            7507270712 bps
    Queue: 6, Forwarding classes: fc6
      Queued:
        Packets              :             539434160              14879808 pps
        Bytes                :           38302388632            8451762856 bps
      Transmitted:
        Packets              :              67108861               1859514 pps
        Bytes                :            4294967104             952071168 bps
        Tail-dropped packets :                     0                     0 pps
        RL-dropped packets   :                     0                     0 pps
        RL-dropped bytes     :                     0                     0 bps
        RED-dropped packets  :             472325299              13020294 pps
        RED-dropped bytes    :           34007421528            7499691688 bps
    Queue: 7, Forwarding classes: fc7
      Queued:
        Packets              :             539434364              14900946 pps
        Bytes                :           38302403328            8463940000 bps
      Transmitted:
        Packets              :              67108860               1859496 pps
        Bytes                :            4294967040             952061952 bps
        Tail-dropped packets :                     0                     0 pps
        RL-dropped packets   :                     0                     0 pps
        RL-dropped bytes     :                     0                     0 bps
        RED-dropped packets  :             472325504              13041450 pps
        RED-dropped bytes    :           34007436288            7511878048 bps 
    
  2. If the interface is experiencing RED dropped packets, run the show interface voq interface-name command on the egress interface that is experiencing the RED dropped packets.
    content_copy zoom_out_map
    user@host> show interfaces voq et-7/0/0 non-zero
    
    Tip:

    When using the show interfaces voq command, you can use command filters to help locate the exact queue. For command usage, see show interfaces voq.

  3. In the show output, determine whether the interface is experiencing RED dropped packets.

    The following example shows the count of the ingress RED-dropped packets for the egress Ethernet interface configured on port 0 of PIC 0, located on the FPC in slot 7.

    The sample output shows that the cause of the congestion is the ingress Packet Forwarding Engine PFE 0, on FPC number 4, and the ingress Packet Forwarding Engine PFE 0 on FPC number 6, as denoted by the count of RED-dropped packets.

    content_copy zoom_out_map
    user@host> show interfaces voq et-7/0/0 non-zero
    Physical interface: et-7/0/0, Enabled, Physical link is Up
      Interface index: 156, SNMP ifIndex: 699
    
    Queue: 0, Forwarding classes: q00
    
      FPC number: 4
        PFE: 0
          RED-dropped packets  :               6834995                 96929 pps
          RED-dropped bytes    :            5249276160             595537368 bps
    
      FPC number: 6
        PFE: 0
          RED-dropped packets  :               6835203                 96964 pps
          RED-dropped bytes    :            5249435904             595749256 bps
    
    Queue: 1, Forwarding classes: q01
    
      FPC number: 4
        PFE: 0
          RED-dropped packets  :               6834998                 96967 pps
          RED-dropped bytes    :            5249278464             595766280 bps
    
      FPC number: 6
        PFE: 0
          RED-dropped packets  :               6835201                 96627 pps
          RED-dropped bytes    :            5249434368             593677664 bps
    
    Queue: 2, Forwarding classes: q02
    
      FPC number: 4
        PFE: 0
          RED-dropped packets  :               6834997                 96921 pps
          RED-dropped bytes    :            5249277696             595482712 bps
    
      FPC number: 6
        PFE: 0
          RED-dropped packets  :               6835205                 96827 pps
          RED-dropped bytes    :            5249437440             594907344 bps
    
    Queue: 3, Forwarding classes: q03
    
      FPC number: 4
        PFE: 0
          RED-dropped packets  :               6834997                 96961 pps
          RED-dropped bytes    :            5249277696             595731736 bps
    
      FPC number: 6
        PFE: 0
          RED-dropped packets  :               6835202                 96522 pps
          RED-dropped bytes    :            5249435136             593031808 bps
    
    Queue: 4, Forwarding classes: q04
    
      FPC number: 4
        PFE: 0
          RED-dropped packets  :               6834995                 97021 pps
          RED-dropped bytes    :            5249276160             596099296 bps
    
      FPC number: 6
        PFE: 0
          RED-dropped packets  :               6835199                 96935 pps
          RED-dropped bytes    :            5249432832             595572304 bps
    
    Queue: 5, Forwarding classes: q05
    
      FPC number: 4
        PFE: 0
          RED-dropped packets  :               6834996                 96949 pps
          RED-dropped bytes    :            5249276928             595656872 bps
    
      FPC number: 6
        PFE: 0
          RED-dropped packets  :               6835204                 96899 pps
          RED-dropped bytes    :            5249436672             595348960 bps
    
    Queue: 6, Forwarding classes: q06
    
      FPC number: 4
        PFE: 0
          RED-dropped packets  :               6835000                 97019 pps
          RED-dropped bytes    :            5249280000             596088832 bps
    
      FPC number: 6
        PFE: 0
          RED-dropped packets  :               6835201                 96916 pps
          RED-dropped bytes    :            5249434368             595455624 bps
    
    Queue: 7, Forwarding classes: q07
    
      FPC number: 4
        PFE: 0
          RED-dropped packets  :               6834999                 96929 pps
          RED-dropped bytes    :            5249279232             595536704 bps
    
      FPC number: 6
        PFE: 0
          RED-dropped packets  :               6835202                 96941 pps
          RED-dropped bytes    :            5249435136             595609968 bps
Note:

For an aggregate interface, follow the same steps, but you must run the show interface queue command on each child link of the aggregate interface to determine which child egress link is experiencing the congestion. Then run the show interface voq command on that child link to determine which ingress Packet Forward Engine is contributing to the congestion.

footer-navigation