Help us improve your experience.

Let us know what you think.

Do you have time for a two-minute survey?

Navigation

Example: Configuring Graceful Restart

To enable graceful restart, include the graceful-restart statement at the [edit routing-instance instance-name routing-options] or [edit routing-options] hierarchy level as well as in the protocol level.

For example:

protocols {bgp {group ext {graceful-restart;}}}
routing-options {graceful-restart;}

Figure 1 shows a standard MPLS VPN network. Routers CE1 and CE2 are customer edge routers, PE1 and PE2 are provider edge routers, and P0 is a provider core router. Several Layer 3 VPNs are configured across this network, as well as one Layer 2 VPN. Interfaces are shown in the diagram and are not included in the configuration example that follows.

Figure 1: Layer 3 VPN Graceful Restart Topology

Layer 3 VPN Graceful
Restart Topology

Router CE1

On Router CE1, configure the following protocols on the logical interfaces of t3-3/1/0: OSPF on unit 101, RIP on unit 102, BGP on unit 103, and IS-IS on unit 512. Also configure graceful restart, BGP, IS-IS, OSPF, and RIP on the main instance to be able to connect to the routing instances on Router PE1.

[edit]
interfaces {t3-3/1/0 {encapsulation frame-relay;unit 100 {dlci 100;family inet {address 10.96.100.2/30;}}unit 101 {dlci 101;family inet {address 10.96.101.2/30;}}unit 102 {dlci 102;family inet {address 10.96.102.2/30;}}unit 103 {dlci 103;family inet {address 10.96.103.2/30;}}unit 512 {dlci 512;family inet {address 10.96.252.1/30;}}}lo0 {unit 0 {family inet {address 10.245.14.172/32;primary;}address 10.96.110.1/32;address 10.96.111.1/32;address 10.96.112.1/32;address 10.96.113.1/32;address 10.96.116.1/32;}family iso {address 47.0005.80ff.f800.0000.0108.0001.0102.4501.4172.00;}}}
routing-options {graceful-restart;autonomous-system 65100;}
protocols {bgp {group CE-PE-INET {type external;export BGP_INET_LB_DIRECT;neighbor 10.96.103.1 {local-address 10.96.103.2;family inet {unicast;}peer-as 65103;}}}isis {export ISIS_L2VPN_LB_DIRECT;interface t3-3/1/0.512;}ospf {export OSPF_LB_DIRECT;area 0.0.0.0 {interface t3-3/1/0.101;}}rip {group RIP {export RIP_LB_DIRECT;neighbor t3-3/1/0.102;}}}
policy-options {policy-statement OSPF_LB_DIRECT {term direct {from {protocol direct;route-filter 10.96.101.0/30 exact;route-filter 10.96.111.1/32 exact;}then accept;}term final {then reject;}}policy-statement RIP_LB_DIRECT {term direct {from {protocol direct;route-filter 10.96.102.0/30 exact;route-filter 10.96.112.1/32 exact;}then accept;}term final {then reject;}}policy-statement BGP_INET_LB_DIRECT {term direct {from {protocol direct;route-filter 10.96.103.0/30 exact;route-filter 10.96.113.1/32 exact;}then accept;}term final {then reject;}}policy-statement ISIS_L2VPN_LB_DIRECT {term direct {from {protocol direct;route-filter 10.96.116.1/32 exact;}then accept;}term final {then reject;}}}

Router PE1

On Router PE1, configure graceful restart in the master instance, along with BGP, OSPF, MPLS, and LDP. Next, configure several protocol-specific instances of graceful restart. By including instances for BGP, OSPF, Layer 2 VPNs, RIP, and static routes, you can observe the wide range of options available when you implement graceful restart. Configure the following protocols in individual instances on the logical interfaces of t3-0/0/0: a static route on unit 100, OSPF on unit 101, RIP on unit 102, BGP on unit 103, and Frame Relay on unit 512 for the Layer 2 VPN instance.

[edit]
interfaces {t3-0/0/0 {dce;encapsulation frame-relay-ccc;unit 100 {dlci 100;family inet {address 10.96.100.1/30;}family mpls;}unit 101 {dlci 101;family inet {address 10.96.101.1/30;}family mpls;}unit 102 {dlci 102;family inet {address 10.96.102.1/30;}family mpls;}unit 103 {dlci 103;family inet {address 10.96.103.1/30;}family mpls;}unit 512 {encapsulation frame-relay-ccc;dlci 512;}}t1-0/1/0 {unit 0 {family inet {address 10.96.0.2/30;}family mpls;}}lo0 {unit 0 {family inet {address 10.245.14.176/32;}family iso {address 47.0005.80ff.f800.0000.0108.0001.0102.4501.4176.00;}}}}
routing-options {graceful-restart;router-id 10.245.14.176;autonomous-system 69;}
protocols {mpls {interface all;}bgp {group PEPE {type internal;neighbor 10.245.14.182 {local-address 10.245.14.176;family inet-vpn {unicast;}family l2vpn {unicast;}}}}ospf {area 0.0.0.0 {interface t1-0/1/0.0;interface fxp0.0 {disable;}interface lo0.0 {passive;}}}ldp {interface all;}}
policy-options {policy-statement STATIC-import {from community STATIC;then accept;}policy-statement STATIC-export {then {community add STATIC;accept;}}policy-statement OSPF-import {from community OSPF;then accept;}policy-statement OSPF-export {then {community add OSPF;accept;}}policy-statement RIP-import {from community RIP;then accept;}policy-statement RIP-export {then {community add RIP;accept;}}policy-statement BGP-INET-import {from community BGP-INET;then accept;}policy-statement BGP-INET-export {then {community add BGP-INET;accept;}}policy-statement L2VPN-import {from community L2VPN;then accept;}policy-statement L2VPN-export {then {community add L2VPN;accept;}}community BGP-INET members target:69:103;community L2VPN members target:69:512;community OSPF members target:69:101;community RIP members target:69:102;community STATIC members target:69:100;}
routing-instances {BGP-INET {instance-type vrf;interface t3-0/0/0.103;route-distinguisher 10.245.14.176:103;vrf-import BGP-INET-import;vrf-export BGP-INET-export;routing-options {graceful-restart;autonomous-system 65103;}protocols {bgp {group BGP-INET {type external;export BGP-INET-import;neighbor 10.96.103.2 {local-address 10.96.103.1;family inet {unicast;}peer-as 65100;}}}}}L2VPN {instance-type l2vpn;interface t3-0/0/0.512;route-distinguisher 10.245.14.176:512;vrf-import L2VPN-import;vrf-export L2VPN-export;protocols {# There is no graceful-restart statement for Layer 2 VPN instances.l2vpn {encapsulation-type frame-relay;site CE1-ISIS {site-identifier 512;interface t3-0/0/0.512 {remote-site-id 612;}}}}}OSPF {instance-type vrf;interface t3-0/0/0.101;route-distinguisher 10.245.14.176:101;vrf-import OSPF-import;vrf-export OSPF-export;routing-options {graceful-restart;}protocols {ospf {export OSPF-import;area 0.0.0.0 {interface all;}}}}RIP {instance-type vrf;interface t3-0/0/0.102;route-distinguisher 10.245.14.176:102;vrf-import RIP-import;vrf-export RIP-export;routing-options {graceful-restart;}protocols {rip {group RIP {export RIP-import;neighbor t3-0/0/0.102;}}}}STATIC {instance-type vrf;interface t3-0/0/0.100;route-distinguisher 10.245.14.176:100;vrf-import STATIC-import;vrf-export STATIC-export;routing-options {graceful-restart;static {route 10.96.110.1/32 next-hop t3-0/0/0.100;}}}}

Router P0

On Router P0, configure graceful restart in the main instance, along with OSPF, MPLS, and LDP. This allows the protocols on the PE routers to reach one another.

[edit]
interfaces {t3-0/1/3 {unit 0 {family inet {address 10.96.0.5/30;}family mpls;}}t1-0/2/0 {unit 0 {family inet {address 10.96.0.1/30;}family mpls;}}lo0 {unit 0 {family inet {address 10.245.14.174/32;}family iso {address 47.0005.80ff.f800.0000.0108.0001.0102.4501.4174.00;}}}}
routing-options {graceful-restart;router-id 10.245.14.174;autonomous-system 69;}
protocols {mpls {interface all;}ospf {area 0.0.0.0 {interface t1-0/2/0.0;interface t3-0/1/3.0;interface fxp0.0 {disable;}interface lo0.0 {passive;}}}ldp {interface all;}}

Router PE2

On Router PE2, configure BGP, OSPF, MPLS, LDP, and graceful restart in the master instance. Configure the following protocols in individual instances on the logical interfaces of t1-0/1/3: a static route on unit 200, OSPF on unit 201, RIP on unit 202, BGP on unit 203, and Frame Relay on unit 612 for the Layer 2 VPN instance. Also configure protocol-specific graceful restart in all routing instances, except the Layer 2 VPN instance.

[edit]
interfaces {t3-0/0/0 {unit 0 {family inet {address 10.96.0.6/30;}family mpls;}}t1-0/1/3 {dce;encapsulation frame-relay-ccc;unit 200 {dlci 200;family inet {address 10.96.200.1/30;}family mpls;}unit 201 {dlci 201;family inet {address 10.96.201.1/30;}family mpls;}unit 202 {dlci 202;family inet {address 10.96.202.1/30;}family mpls;}unit 203 {dlci 203;family inet {address 10.96.203.1/30;}family mpls;}unit 612 {encapsulation frame-relay-ccc;dlci 612;}}lo0 {unit 0 {family inet {address 10.245.14.182/32;}family iso {address 47.0005.80ff.f800.0000.0108.0001.0102.4501.4182.00;}}}}
routing-options {graceful-restart;router-id 10.245.14.182;autonomous-system 69;}
protocols {mpls {interface all;}bgp {group PEPE {type internal;neighbor 10.245.14.176 {local-address 10.245.14.182;family inet-vpn {unicast;}family l2vpn {unicast;}}}}ospf {area 0.0.0.0 {interface t3-0/0/0.0;interface fxp0.0 {disable;}interface lo0.0 {passive;}}}ldp {interface all;}policy-options {policy-statement STATIC-import {from community STATIC;then accept;}policy-statement STATIC-export {then {community add STATIC;accept;}}policy-statement OSPF-import {from community OSPF;then accept;}policy-statement OSPF-export {then {community add OSPF;accept;}}policy-statement RIP-import {from community RIP;then accept;}policy-statement RIP-export {then {community add RIP;accept;}}policy-statement BGP-INET-import {from community BGP-INET;then accept;}policy-statement BGP-INET-export {then {community add BGP-INET;accept;}}policy-statement L2VPN-import {from community L2VPN;then accept;}policy-statement L2VPN-export {then {community add L2VPN;accept;}}community BGP-INET members target:69:103;community L2VPN members target:69:512;community OSPF members target:69:101;community RIP members target:69:102;community STATIC members target:69:100;}routing-instances {BGP-INET {instance-type vrf;interface t1-0/1/3.203;route-distinguisher 10.245.14.182:203;vrf-import BGP-INET-import;vrf-export BGP-INET-export;routing-options {graceful-restart;autonomous-system 65203;}protocols {bgp {group BGP-INET {type external;export BGP-INET-import;neighbor 10.96.203.2 {local-address 10.96.203.1;family inet {unicast;}peer-as 65200;}}}}}L2VPN {instance-type l2vpn;interface t1-0/1/3.612;route-distinguisher 10.245.14.182:612;vrf-import L2VPN-import;vrf-export L2VPN-export;protocols {# There is no graceful-restart statement for Layer 2 VPN instances.l2vpn {encapsulation-type frame-relay;site CE2-ISIS {site-identifier 612;interface t1-0/1/3.612 {remote-site-id 512;}}}}}OSPF {instance-type vrf;interface t1-0/1/3.201;route-distinguisher 10.245.14.182:201;vrf-import OSPF-import;vrf-export OSPF-export;routing-options {graceful-restart;}protocols {ospf {export OSPF-import;area 0.0.0.0 {interface all;}}}}RIP {instance-type vrf;interface t1-0/1/3.202;route-distinguisher 10.245.14.182:202;vrf-import RIP-import;vrf-export RIP-export;routing-options {graceful-restart;}protocols {rip {group RIP {export RIP-import;neighbor t1-0/1/3.202;}}}}STATIC {instance-type vrf;interface t1-0/1/3.200;route-distinguisher 10.245.14.182:200;vrf-import STATIC-import;vrf-export STATIC-export;routing-options {graceful-restart;static {route 10.96.210.1/32 next-hop t1-0/1/3.200;}}}}}

Router CE2

On Router CE2, complete the Layer 2 and Layer 3 VPN configuration by mirroring the protocols already set on Routers PE2 and CE1. Specifically, configure the following on the logical interfaces of t1-0/0/3: OSPF on unit 201, RIP on unit 202, BGP on unit 203, and IS-IS on unit 612. Finally, configure graceful restart, BGP, IS-IS, OSPF, and RIP on the main instance to be able to connect to the routing instances on Router PE2.

[edit]
interfaces {t1-0/0/3 {encapsulation frame-relay;unit 200 {dlci 200;family inet {address 10.96.200.2/30;}}unit 201 {dlci 201;family inet {address 10.96.201.2/30;}}unit 202 {dlci 202;family inet {address 10.96.202.2/30;}}unit 203 {dlci 203;family inet {address 10.96.203.2/30;}}unit 512 {dlci 512;family inet {address 10.96.252.2/30;}}}lo0 {unit 0 {family inet {address 10.245.14.180/32 {primary;}address 10.96.210.1/32;address 10.96.111.1/32;address 10.96.212.1/32;address 10.96.213.1/32;address 10.96.216.1/32;}family iso {address 47.0005.80ff.f800.0000.0108.0001.0102.4501.4180.00;}}}}
routing-options {graceful-restart;autonomous-system 65200;}
protocols {bgp {group CE-PE-INET {type external;export BGP_INET_LB_DIRECT;neighbor 10.96.203.1 {local-address 10.96.203.2;family inet {unicast;}peer-as 65203;}}}isis {export ISIS_L2VPN_LB_DIRECT;interface t1-0/0/3.612;}ospf {export OSPF_LB_DIRECT;area 0.0.0.0 {interface t1-0/0/3.201;}}rip {group RIP {export RIP_LB_DIRECT;neighbor t1-0/0/3.202;}}}
policy-options {policy-statement OSPF_LB_DIRECT {term direct {from {protocol direct;route-filter 10.96.201.0/30 exact;route-filter 10.96.211.1/32 exact;}then accept;}term final {then reject;}}policy-statement RIP_LB_DIRECT {term direct {from {protocol direct;route-filter 10.96.202.0/30 exact;route-filter 10.96.212.1/32 exact;}then accept;}term final {then reject;}}policy-statement BGP_INET_LB_DIRECT {term direct {from {protocol direct;route-filter 10.96.203.0/30 exact;route-filter 10.96.213.1/32 exact;}then accept;}term final {then reject;}}policy-statement ISIS_L2VPN_LB_DIRECT {term direct {from {protocol direct;route-filter 10.96.216.1/32 exact;}then accept;}term final {then reject;}}}

Router PE1 Status Before a Restart

The following example displays neighbor relationships on Router PE1 before a restart happens:

user@PE1> show bgp neighbor
Peer: 10.96.103.2+3785 AS 65100 Local: 10.96.103.1+179 AS 65103
  Type: External    State: Established    Flags: <>
  Last State: OpenConfirm   Last Event: RecvKeepAlive
  Last Error: None
  Export: [ BGP-INET-import ] 
  Options: <Preference LocalAddress HoldTime GracefulRestart AddressFamily PeerAS Refresh>
  Address families configured: inet-unicast
  Local Address: 10.96.103.1 Holdtime: 90 Preference: 170
  Number of flaps: 0
  Peer ID: 10.96.110.1      Local ID: 10.96.103.1      Active Holdtime: 90
  Keepalive Interval: 30
  Local Interface: t3-0/0/0.103
  NLRI for restart configured on peer: inet-unicast
  NLRI advertised by peer: inet-unicast
  NLRI for this session: inet-unicast
  Peer supports Refresh capability (2)
  Restart time configured on the peer: 120
  Stale routes from peer are kept for: 300
  Restart time requested by this peer: 120
  NLRI that peer supports restart for: inet-unicast
  NLRI peer can save forwarding state: inet-unicast
  NLRI that peer saved forwarding for: inet-unicast
  NLRI that restart is negotiated for: inet-unicast
  NLRI of all end-of-rib markers sent: inet-unicast
  Table BGP-INET.inet.0 Bit: 30001
    RIB State: BGP restart is complete
    RIB State: VPN restart is complete
    Send state: in sync
    Active prefixes:            0
    Received prefixes:          0
    Suppressed due to damping:  0
  Last traffic (seconds): Received 8    Sent 3    Checked 3
  Input messages:  Total 15     Updates 0       Refreshes 0     Octets 321
  Output messages: Total 18     Updates 2       Refreshes 0     Octets 450
  Output Queue[2]: 0

Peer: 10.245.14.182+4701 AS 69    Local: 10.245.14.176+179 AS 69
  Type: Internal    State: Established    Flags: <>
  Last State: OpenConfirm   Last Event: RecvKeepAlive
  Last Error: None
  Options: <Preference LocalAddress HoldTime GracefulRestart AddressFamily 
Rib-group Refresh>
  Address families configured: inet-vpn-unicast l2vpn
  Local Address: 10.245.14.176 Holdtime: 90 Preference: 170
  Number of flaps: 1
  Peer ID: 10.245.14.182    Local ID: 10.245.14.176    Active Holdtime: 90
  Keepalive Interval: 30
  NLRI for restart configured on peer: inet-vpn-unicast l2vpn
  NLRI advertised by peer: inet-vpn-unicast l2vpn
  NLRI for this session: inet-vpn-unicast l2vpn
  Peer supports Refresh capability (2)
  Restart time configured on the peer: 120
  Stale routes from peer are kept for: 300
  Restart time requested by this peer: 120
  NLRI that peer supports restart for: inet-vpn-unicast l2vpn
  NLRI peer can save forwarding state: inet-vpn-unicast l2vpn
  NLRI that peer saved forwarding for: inet-vpn-unicast l2vpn
  NLRI that restart is negotiated for: inet-vpn-unicast l2vpn
  NLRI of all end-of-rib markers sent: inet-vpn-unicast l2vpn
  Table bgp.l3vpn.0 Bit: 10000
    RIB State: BGP restart is complete
    RIB State: VPN restart is complete
    Send state: in sync
    Active prefixes:            0
    Received prefixes:          0
    Suppressed due to damping:  0
  Table bgp.l2vpn.0 Bit: 20000
    RIB State: BGP restart is complete
    RIB State: VPN restart is complete
    Send state: in sync
    Active prefixes:            1
    Received prefixes:          1
    Suppressed due to damping:  0
  Table BGP-INET.inet.0 Bit: 30000
    RIB State: BGP restart is complete
    RIB State: VPN restart is complete
    Send state: in sync
    Active prefixes:            0
    Received prefixes:          0
    Suppressed due to damping:  0
  Table OSPF.inet.0 Bit: 60000
    RIB State: BGP restart is complete
    RIB State: VPN restart is complete
    Send state: in sync
    Active prefixes:            0
    Received prefixes:          0
    Suppressed due to damping:  0
  Table RIP.inet.0 Bit: 70000
    RIB State: BGP restart is complete
    RIB State: VPN restart is complete
    Send state: in sync
    Active prefixes:            0
    Received prefixes:          0
    Suppressed due to damping:  0
  Table STATIC.inet.0 Bit: 80000
    RIB State: BGP restart is complete
    RIB State: VPN restart is complete
    Send state: in sync
    Active prefixes:            0
    Received prefixes:          0
    Suppressed due to damping:  0
  Table L2VPN.l2vpn.0 Bit: 90000
    RIB State: BGP restart is complete
    RIB State: VPN restart is complete
    Send state: in sync
    Active prefixes:            1
    Received prefixes:          1
    Suppressed due to damping:  0
  Last traffic (seconds): Received 28   Sent 28   Checked 28  
  Input messages:  Total 2      Updates 0       Refreshes 0     Octets 86
  Output messages: Total 13     Updates 10      Refreshes 0     Octets 1073
  Output Queue[0]: 0
  Output Queue[1]: 0
  Output Queue[2]: 0
  Output Queue[3]: 0
  Output Queue[4]: 0
  Output Queue[5]: 0
  Output Queue[6]: 0
  Output Queue[7]: 0
  Output Queue[8]: 0

user@PE1> show route instance detail
master:
  Router ID: 10.245.14.176
  Type: forwarding        State: Active
  Restart State: Complete Path selection timeout: 300
  Tables:
    inet.0                 : 17 routes (15 active, 0 holddown, 1 hidden)
    Restart Complete
    inet.3                 : 2 routes (2 active, 0 holddown, 0 hidden)
    Restart Complete
    iso.0                  : 1 routes (1 active, 0 holddown, 0 hidden)
    Restart Complete
    mpls.0                 : 19 routes (19 active, 0 holddown, 0 hidden)
    Restart Complete
    bgp.l3vpn.0            : 10 routes (10 active, 0 holddown, 0 hidden)
    Restart Complete
    inet6.0                : 2 routes (2 active, 0 holddown, 0 hidden)
    Restart Complete
    bgp.l2vpn.0            : 1 routes (1 active, 0 holddown, 0 hidden)
    Restart Complete
BGP-INET:
  Router ID: 10.96.103.1
  Type: vrf               State: Active
  Restart State: Complete Path selection timeout: 300
  Interfaces:
    t3-0/0/0.103
  Route-distinguisher: 10.245.14.176:103
  Vrf-import: [ BGP-INET-import ]
  Vrf-export: [ BGP-INET-export ]
  Tables:
    BGP-INET.inet.0        : 4 routes (4 active, 0 holddown, 0 hidden)
    Restart Complete
L2VPN:
  Router ID: 0.0.0.0
  Type: l2vpn             State: Active
  Restart State: Complete Path selection timeout: 300
  Interfaces:
    t3-0/0/0.512
  Route-distinguisher: 10.245.14.176:512
  Vrf-import: [ L2VPN-import ]
  Vrf-export: [ L2VPN-export ]
  Tables:
    L2VPN.l2vpn.0          : 2 routes (2 active, 0 holddown, 0 hidden)
    Restart Complete
OSPF:
  Router ID: 10.96.101.1
  Type: vrf               State: Active
  Restart State: Complete Path selection timeout: 300
  Interfaces:
    t3-0/0/0.101
  Route-distinguisher: 10.245.14.176:101
  Vrf-import: [ OSPF-import ]
  Vrf-export: [ OSPF-export ]
  Tables:
    OSPF.inet.0            : 8 routes (7 active, 0 holddown, 0 hidden)
    Restart Complete
RIP:
  Router ID: 10.96.102.1
  Type: vrf               State: Active
  Restart State: Complete Path selection timeout: 300
  Interfaces:
    t3-0/0/0.102
  Route-distinguisher: 10.245.14.176:102
  Vrf-import: [ RIP-import ]
  Vrf-export: [ RIP-export ]
  Tables:
    RIP.inet.0             : 6 routes (6 active, 0 holddown, 0 hidden)
    Restart Complete
STATIC:
  Router ID: 10.96.100.1
  Type: vrf               State: Active
  Restart State: Complete Path selection timeout: 300
  Interfaces:
    t3-0/0/0.100
  Route-distinguisher: 10.245.14.176:100
  Vrf-import: [ STATIC-import ]
  Vrf-export: [ STATIC-export ]
  Tables:
    STATIC.inet.0          : 4 routes (4 active, 0 holddown, 0 hidden)
    Restart Complete
__juniper_private1__:
  Router ID: 0.0.0.0
  Type: forwarding        State: Active

user@PE1> show route protocol l2vpn
inet.0: 16 destinations, 17 routes (15 active, 0 holddown, 1 hidden)
Restart Complete
inet.3: 2 destinations, 2 routes (2 active, 0 holddown, 0 hidden)
Restart Complete
BGP-INET.inet.0: 5 destinations, 6 routes (5 active, 0 holddown, 0 hidden)
Restart Complete
OSPF.inet.0: 7 destinations, 8 routes (7 active, 0 holddown, 0 hidden)
Restart Complete
RIP.inet.0: 6 destinations, 6 routes (6 active, 0 holddown, 0 hidden)
Restart Complete
STATIC.inet.0: 4 destinations, 4 routes (4 active, 0 holddown, 0 hidden)
Restart Complete
iso.0: 1 destinations, 1 routes (1 active, 0 holddown, 0 hidden)
Restart Complete
mpls.0: 20 destinations, 20 routes (20 active, 0 holddown, 0 hidden)
Restart Complete
+ = Active Route, - = Last Active, * = Both
800003             *[L2VPN/7] 00:06:00
                    > via t3-0/0/0.512, Pop       Offset: 4
t3-0/0/0.512       *[L2VPN/7] 00:06:00
                    > via t1-0/1/0.0, Push 800003, Push 100004(top) Offset: -4
bgp.l3vpn.0: 10 destinations, 10 routes (10 active, 0 holddown, 0 hidden)
Restart Complete
inet6.0: 2 destinations, 2 routes (2 active, 0 holddown, 0 hidden)
Restart Complete
L2VPN.l2vpn.0: 2 destinations, 2 routes (2 active, 0 holddown, 0 hidden)
Restart Complete
+ = Active Route, - = Last Active, * = Both
10.245.14.176:512:512:611/96                
                   *[L2VPN/7] 00:06:01
                      Discard
                    
bgp.l2vpn.0: 1 destinations, 1 routes (1 active, 0 holddown, 0 hidden)
Restart Complete

Router PE1 Status During a Restart

Before you can verify that graceful restart is working, you must simulate a router restart. To cause the routing process to refresh and simulate a restart, use the restart routing operational mode command:

user@PE1> restart routing
Routing protocol daemon started, pid 3558

The following sample output is captured during the router restart:

user@PE1> show bgp neighbor
Peer: 10.96.103.2     AS 65100 Local: 10.96.103.1     AS 65103
  Type: External    State: Active         Flags: <ImportEval>
  Last State: Idle          Last Event: Start
  Last Error: None
  Export: [ BGP-INET-import ] 
  Options: <Preference LocalAddress HoldTime GracefulRestart AddressFamily PeerAS Refresh>
  Address families configured: inet-unicast
  Local Address: 10.96.103.1 Holdtime: 90 Preference: 170
  Number of flaps: 0
Peer: 10.245.14.182+179 AS 69    Local: 10.245.14.176+2131 AS 69
  Type: Internal    State: Established    Flags: <ImportEval>
  Last State: OpenConfirm   Last Event: RecvKeepAlive
  Last Error: None
  Options: <Preference LocalAddress HoldTime GracefulRestart AddressFamily Rib-group Refresh>
  Address families configured: inet-vpn-unicast l2vpn
  Local Address: 10.245.14.176 Holdtime: 90 Preference: 170
  Number of flaps: 0
  Peer ID: 10.245.14.182    Local ID: 10.245.14.176    Active Holdtime: 90
  Keepalive Interval: 30
  NLRI for restart configured on peer: inet-vpn-unicast l2vpn
  NLRI advertised by peer: inet-vpn-unicast l2vpn
  NLRI for this session: inet-vpn-unicast l2vpn
  Peer supports Refresh capability (2)
  Restart time configured on the peer: 120
  Stale routes from peer are kept for: 300
  Restart time requested by this peer: 120
  NLRI that peer supports restart for: inet-vpn-unicast l2vpn
  NLRI peer can save forwarding state: inet-vpn-unicast l2vpn
  NLRI that peer saved forwarding for: inet-vpn-unicast l2vpn
  NLRI that restart is negotiated for: inet-vpn-unicast l2vpn
  NLRI of received end-of-rib markers: inet-vpn-unicast l2vpn
  Table bgp.l3vpn.0 Bit: 10000
    RIB State: BGP restart in progress
    RIB State: VPN restart in progress
    Send state: in sync
    Active prefixes:            10
    Received prefixes:          10
    Suppressed due to damping:  0
  Table bgp.l2vpn.0 Bit: 20000
    RIB State: BGP restart in progress
    RIB State: VPN restart in progress
    Send state: in sync
    Active prefixes:            1
    Received prefixes:          1
    Suppressed due to damping:  0
  Table BGP-INET.inet.0 Bit: 30000
    RIB State: BGP restart in progress
    RIB State: VPN restart in progress
    Send state: in sync
    Active prefixes:            2
    Received prefixes:          2
    Suppressed due to damping:  0
Table OSPF.inet.0 Bit: 60000
    RIB State: BGP restart is complete
    RIB State: VPN restart in progress
    Send state: in sync
    Active prefixes:            2
    Received prefixes:          2
    Suppressed due to damping:  0
  Table RIP.inet.0 Bit: 70000
    RIB State: BGP restart is complete
    RIB State: VPN restart in progress
    Send state: in sync
    Active prefixes:            2
    Received prefixes:          2
    Suppressed due to damping:  0
  Table STATIC.inet.0 Bit: 80000
    RIB State: BGP restart is complete
    RIB State: VPN restart in progress
    Send state: in sync
    Active prefixes:            1
    Received prefixes:          1
    Suppressed due to damping:  0
  Table L2VPN.l2vpn.0 Bit: 90000
    RIB State: BGP restart is complete
    RIB State: VPN restart in progress
    Send state: in sync
    Active prefixes:            1
    Received prefixes:          1
    Suppressed due to damping:  0
  Last traffic (seconds): Received 0    Sent 0    Checked 0
  Input messages:  Total 14     Updates 13      Refreshes 0     Octets 1053
  Output messages: Total 3      Updates 0       Refreshes 0     Octets 105
  Output Queue[0]: 0
  Output Queue[1]: 0
  Output Queue[2]: 0
  Output Queue[3]: 0
  Output Queue[4]: 0
  Output Queue[5]: 0
  Output Queue[6]: 0
  Output Queue[7]: 0
  Output Queue[8]: 0

user@PE1> show route instance detail
master:
  Router ID: 10.245.14.176
  Type: forwarding        State: Active
  Restart State: Pending  Path selection timeout: 300
  Tables:
    inet.0                 : 17 routes (15 active, 1 holddown, 1 hidden)
    Restart Pending: OSPF LDP
    inet.3                 : 2 routes (2 active, 0 holddown, 0 hidden)
    Restart Pending: OSPF LDP
    iso.0                  : 1 routes (1 active, 0 holddown, 0 hidden)
    Restart Complete
    mpls.0                 : 23 routes (23 active, 0 holddown, 0 hidden)
    Restart Pending: LDP VPN
    bgp.l3vpn.0            : 10 routes (10 active, 0 holddown, 0 hidden)
    Restart Pending: BGP VPN
    inet6.0                : 2 routes (2 active, 0 holddown, 0 hidden)
    Restart Complete
    bgp.l2vpn.0            : 1 routes (1 active, 0 holddown, 0 hidden)
    Restart Pending: BGP VPN
BGP-INET:
  Router ID: 10.96.103.1
  Type: vrf               State: Active
  Restart State: Pending  Path selection timeout: 300
  Interfaces:
    t3-0/0/0.103
  Route-distinguisher: 10.245.14.176:103
  Vrf-import: [ BGP-INET-import ]
  Vrf-export: [ BGP-INET-export ]
  Tables:
    BGP-INET.inet.0        : 6 routes (5 active, 0 holddown, 0 hidden)
    Restart Pending: VPN
L2VPN:
  Router ID: 0.0.0.0
  Type: l2vpn             State: Active
  Restart State: Pending  Path selection timeout: 300
  Interfaces:
    t3-0/0/0.512
  Route-distinguisher: 10.245.14.176:512
  Vrf-import: [ L2VPN-import ]
  Vrf-export: [ L2VPN-export ]
  Tables:
    L2VPN.l2vpn.0          : 2 routes (2 active, 0 holddown, 0 hidden)
    Restart Pending: VPN L2VPN
OSPF:
  Router ID: 10.96.101.1
  Type: vrf               State: Active
  Restart State: Pending  Path selection timeout: 300
  Interfaces:
    t3-0/0/0.101
  Route-distinguisher: 10.245.14.176:101
  Vrf-import: [ OSPF-import ]
  Vrf-export: [ OSPF-export ]
  Tables:           
    OSPF.inet.0            : 8 routes (7 active, 1 holddown, 0 hidden)
    Restart Pending: OSPF VPN
RIP:
  Router ID: 10.96.102.1
  Type: vrf               State: Active
  Restart State: Pending  Path selection timeout: 300
  Interfaces:
    t3-0/0/0.102
  Route-distinguisher: 10.245.14.176:102
  Vrf-import: [ RIP-import ]
  Vrf-export: [ RIP-export ]
  Tables:
    RIP.inet.0             : 8 routes (6 active, 2 holddown, 0 hidden)
    Restart Pending: RIP VPN
STATIC:
  Router ID: 10.96.100.1
  Type: vrf               State: Active
  Restart State: Pending  Path selection timeout: 300
  Interfaces:
    t3-0/0/0.100
  Route-distinguisher: 10.245.14.176:100
  Vrf-import: [ STATIC-import ]
  Vrf-export: [ STATIC-export ]
  Tables:
    STATIC.inet.0          : 4 routes (4 active, 0 holddown, 0 hidden)
    Restart Pending: VPN
__juniper_private1__:
  Router ID: 0.0.0.0
  Type: forwarding        State: Active 
user@PE1> show route instance summary
Instance           Type           Primary rib            Active/holddown/hidden
master             forwarding     
                                  inet.0                 15/0/1
                                  iso.0                  1/0/0
                                  mpls.0                 35/0/0
                                  l3vpn.0                0/0/0
                                  inet6.0                2/0/0
                                  l2vpn.0                0/0/0
                                  l2circuit.0            0/0/0
BGP-INET           vrf            
                                  BGP-INET.inet.0        5/0/0
                                  BGP-INET.iso.0         0/0/0
                                  BGP-INET.inet6.0       0/0/0
L2VPN              l2vpn          
                                  L2VPN.inet.0           0/0/0
                                  L2VPN.iso.0            0/0/0
                                  L2VPN.inet6.0          0/0/0
                                  L2VPN.l2vpn.0          2/0/0
OSPF               vrf            
                                  OSPF.inet.0            7/0/0
                                  OSPF.iso.0             0/0/0
                                  OSPF.inet6.0           0/0/0
RIP                vrf            
                                  RIP.inet.0             6/0/0
                                  RIP.iso.0              0/0/0
                                  RIP.inet6.0            0/0/0
STATIC             vrf            
                                  STATIC.inet.0          4/0/0
                                  STATIC.iso.0           0/0/0
                                  STATIC.inet6.0         0/0/0
__juniper_private1__ forwarding
                                  __juniper_priva.inet.0 0/0/0
                                  __juniper_privat.iso.0 0/0/0
                                  __juniper_priv.inet6.0 0/0/0

user@PE1> show route protocol l2vpn

inet.0: 16 destinations, 17 routes (15 active, 1 holddown, 1 hidden)
Restart Pending: OSPF LDP

inet.3: 2 destinations, 2 routes (2 active, 0 holddown, 0 hidden)
Restart Pending: OSPF LDP

BGP-INET.inet.0: 5 destinations, 6 routes (5 active, 0 holddown, 0 hidden)
Restart Pending: VPN

OSPF.inet.0: 7 destinations, 8 routes (7 active, 1 holddown, 0 hidden)
Restart Pending: OSPF VPN

RIP.inet.0: 6 destinations, 8 routes (6 active, 2 holddown, 0 hidden)
Restart Pending: RIP VPN

STATIC.inet.0: 4 destinations, 4 routes (4 active, 0 holddown, 0 hidden)
Restart Pending: VPN

iso.0: 1 destinations, 1 routes (1 active, 0 holddown, 0 hidden)
Restart Complete

mpls.0: 24 destinations, 24 routes (24 active, 0 holddown, 0 hidden)
Restart Pending: LDP VPN
+ = Active Route, - = Last Active, * = Both

800001             *[L2VPN/7] 00:00:13
                    > via t3-0/0/0.512, Pop       Offset: 4
t3-0/0/0.512       *[L2VPN/7] 00:00:13
                    > via t1-0/1/0.0, Push 800003, Push 100004(top) Offset: -4

bgp.l3vpn.0: 10 destinations, 10 routes (10 active, 0 holddown, 0 hidden)
Restart Pending: BGP VPN

inet6.0: 2 destinations, 2 routes (2 active, 0 holddown, 0 hidden)
Restart Complete

L2VPN.l2vpn.0: 2 destinations, 2 routes (2 active, 0 holddown, 0 hidden)
Restart Pending: VPN L2VPN
+ = Active Route, - = Last Active, * = Both

10.245.14.176:512:512:611/96
                   *[L2VPN/7] 00:00:13
                      Discard
bgp.l2vpn.0: 1 destinations, 1 routes (1 active, 0 holddown, 0 hidden)
Restart Pending: BGP VPN

Published: 2013-08-28