Help us improve your experience.

Let us know what you think.

Do you have time for a two-minute survey?

Announcement: Try the Ask AI chatbot for answers to your technical questions about Juniper products and solutions.

close
header-navigation
keyboard_arrow_up
close
keyboard_arrow_left
list Table of Contents
file_download PDF
{ "lLangCode": "en", "lName": "English", "lCountryCode": "us", "transcode": "en_US" }
English
keyboard_arrow_right

Detailed Configurations for the EVPN-VXLAN Network for the Data Centers

date_range 15-Sep-23

This section includes the complete configurations for the following devices:

  • Data Center 1 Border Spine 1 and Border Spine 2 (DC1-Spine1 and DC1-Spine2)

  • Data Center 1 Leaf 1 and Leaf 2 (DC1-Leaf1 and DC1-Leaf2)

  • Data Center 2 Border Spine 1 and Border Spine 2 (DC2-Spine1 and DC1-Spine2)

  • Data Center 2 Leaf 1 and Leaf 2 (DC2-Leaf1 and DC2-Leaf2)

  • A simplified WAN router configuration that can be used for testing

Figure 1 shows the detailed topology used in this example.

Figure 1: OTT DCI TopologyNetwork topology diagram showing two data centers connected via WAN underlay, using a spine-leaf architecture for scalability and performance.
Note:

The configurations are shown as typed, rather than as displayed with a show configuration | display set command. As a result the BGP authentication key appears in plain text instead of the obfuscated form. The authentication key used is for testing purposes and should be changed to suit your environment.

The need to channelize for 10 GE interfaces varies by QFX switch model. Based on the equipment used in this example channelization is not needed at the leaf switches, but is used on the spines for the 10 GE links to the WAN cloud.

Border Spine Device 1 in Data Center 1

content_copy zoom_out_map
set chassis fpc 0 pic 0 port 6 channel-speed 10
set interfaces xe-0/0/6:0 mtu 9200
set interfaces xe-0/0/6:0 unit 0 family inet address 172.16.1.7/31
set interfaces et-0/0/8 description "Fabric link"
set interfaces et-0/0/8 mtu 9200
set interfaces et-0/0/8 unit 0 description "** to DC1-Leaf3"
set interfaces et-0/0/8 unit 0 family inet address 10.80.224.6/31
set interfaces et-0/0/9 description "Fabric link"
set interfaces et-0/0/9 mtu 9200
set interfaces et-0/0/9 unit 0 description "** to DC1-Leaf4"
set interfaces et-0/0/9 unit 0 family inet address 10.80.224.8/31
set interfaces et-0/0/17 description "Fabric link"
set interfaces et-0/0/17 mtu 9200
set interfaces et-0/0/17 unit 0 description "** to DC1-Leaf1"
set interfaces et-0/0/17 unit 0 family inet address 10.80.224.2/31
set interfaces et-0/0/18 description "Fabric link"
set interfaces et-0/0/18 traps
set interfaces et-0/0/18 mtu 9200
set interfaces et-0/0/18 unit 0 description "** to DC1-Leaf2"
set interfaces et-0/0/18 unit 0 family inet address 10.80.224.4/31
set interfaces lo0 unit 0 description "** DC1-Spine1"
set interfaces lo0 unit 0 family inet address 10.80.224.149/32
set policy-options policy-statement ECMP-POLICY then load-balance per-packet
set policy-options policy-statement FROM_Lo0 term 10 from interface lo0.0
set policy-options policy-statement FROM_Lo0 term 10 then accept
set policy-options policy-statement FROM_Lo0 term 20 then reject
set policy-options policy-statement UNDERLAY-EXPORT term LOOPBACK from route-filter 10.80.224.128/25 orlonger
set policy-options policy-statement UNDERLAY-EXPORT term LOOPBACK from route-filter 10.0.0.0/24 orlonger
set policy-options policy-statement UNDERLAY-EXPORT term LOOPBACK then accept
set policy-options policy-statement UNDERLAY-EXPORT term DEFAULT then reject
set policy-options policy-statement UNDERLAY-IMPORT term LOOPBACK from route-filter 10.80.224.128/25 orlonger
set policy-options policy-statement UNDERLAY-IMPORT term LOOPBACK from route-filter 10.0.0.0/24 orlonger
set policy-options policy-statement UNDERLAY-IMPORT term LOOPBACK then accept
set policy-options policy-statement UNDERLAY-IMPORT term DEFAULT then reject
set routing-options forwarding-table export ECMP-POLICY
set routing-options forwarding-table ecmp-fast-reroute
set routing-options autonomous-system 64730
set protocols bgp hold-time 10
set protocols bgp log-updown
set protocols bgp group EVPN_FABRIC type internal
set protocols bgp group EVPN_FABRIC bfd-liveness-detection minimum-interval 1000
set protocols bgp group EVPN_FABRIC bfd-liveness-detection multiplier 3
set protocols bgp group EVPN_FABRIC description "Reflector group for overlay IBGP peering with leaves"
set protocols bgp group EVPN_FABRIC local-address 10.80.224.149
set protocols bgp group EVPN_FABRIC family evpn signaling
set protocols bgp group EVPN_FABRIC authentication-key "samplepassword-fortesting"
set protocols bgp group EVPN_FABRIC vpn-apply-export
set protocols bgp group EVPN_FABRIC cluster 10.80.224.149
set protocols bgp group EVPN_FABRIC local-as 64730
set protocols bgp group EVPN_FABRIC multipath
set protocols bgp group EVPN_FABRIC neighbor 10.80.224.140
set protocols bgp group EVPN_FABRIC neighbor 10.80.224.141
set protocols bgp group EVPN_FABRIC neighbor 10.80.224.142
set protocols bgp group EVPN_FABRIC neighbor 10.80.224.143
set protocols bgp group UNDERLAY type external
set protocols bgp group UNDERLAY description "Group for underlay EBGP peering"
set protocols bgp group UNDERLAY import UNDERLAY-IMPORT
set protocols bgp group UNDERLAY family inet unicast
set protocols bgp group UNDERLAY authentication-key "samplepassword-fortesting"
set protocols bgp group UNDERLAY export UNDERLAY-EXPORT
set protocols bgp group UNDERLAY local-as 65001
set protocols bgp group UNDERLAY multipath multiple-as
set protocols bgp group UNDERLAY bfd-liveness-detection minimum-interval 350
set protocols bgp group UNDERLAY bfd-liveness-detection multiplier 3
set protocols bgp group UNDERLAY neighbor 10.80.224.3 peer-as 65012
set protocols bgp group UNDERLAY neighbor 10.80.224.5 peer-as 65013
set protocols bgp group UNDERLAY neighbor 10.80.224.7 peer-as 65014
set protocols bgp group UNDERLAY neighbor 10.80.224.9 peer-as 65015
set protocols bgp group UNDERLAY neighbor 172.16.1.6 peer-as 65199
set protocols bgp group OVERLAY_INTERDC type external
set protocols bgp group OVERLAY_INTERDC description "Group for overlay EBGP peering to remote DC"
set protocols bgp group OVERLAY_INTERDC multihop no-nexthop-change
set protocols bgp group OVERLAY_INTERDC local-address 10.80.224.149
set protocols bgp group OVERLAY_INTERDC family evpn signaling delay-route-advertisements minimum-delay routing-uptime 480
set protocols bgp group OVERLAY_INTERDC local-as 64730
set protocols bgp group OVERLAY_INTERDC multipath multiple-as
set protocols bgp group OVERLAY_INTERDC neighbor 10.0.0.2 peer-as 64830
set protocols bgp group OVERLAY_INTERDC neighbor 10.0.0.3 peer-as 64830
set protocols lldp interface all

Border Spine Device 2 in Data Center 1

content_copy zoom_out_map
set chassis fpc 0 pic 0 port 33 channel-speed 10g
set interfaces xe-0/0/6:0 mtu 9200
set interfaces xe-0/0/6:0 unit 0 family inet address 172.16.1.5/31
set interfaces et-0/0/8 description "Fabric link"
set interfaces et-0/0/8 mtu 9200
set interfaces et-0/0/8 unit 0 description "** to DC1-Leaf3"
set interfaces et-0/0/8 unit 0 family inet address 10.80.224.16/31
set interfaces et-0/0/9 description "Fabric link"
set interfaces et-0/0/9 mtu 9200
set interfaces et-0/0/9 unit 0 description "** to DC1-Leaf4"
set interfaces et-0/0/9 unit 0 family inet address 10.80.224.18/31
set interfaces et-0/0/17 description "Fabric link"
set interfaces et-0/0/17 mtu 9200
set interfaces et-0/0/17 unit 0 description "** to DC1-Leaf2"
set interfaces et-0/0/17 unit 0 family inet address 10.80.224.14/31
set interfaces et-0/0/18 description "Fabric link"
set interfaces et-0/0/18 mtu 9200
set interfaces et-0/0/18 unit 0 description "** to DC1-Leaf1"
set interfaces et-0/0/18 unit 0 family inet address 10.80.224.12/31
set interfaces lo0 unit 0 description "** DC1-Spine2"
set interfaces lo0 unit 0 family inet address 10.80.224.150/32
set policy-options policy-statement ECMP-POLICY then load-balance per-packet
set policy-options policy-statement FROM_Lo0 term 10 from interface lo0.0
set policy-options policy-statement FROM_Lo0 term 10 then accept
set policy-options policy-statement FROM_Lo0 term 20 then reject
set policy-options policy-statement UNDERLAY-EXPORT term LOOPBACK from route-filter 10.80.224.128/25 orlonger
set policy-options policy-statement UNDERLAY-EXPORT term LOOPBACK then accept
set policy-options policy-statement UNDERLAY-EXPORT term DEFAULT then reject
set policy-options policy-statement UNDERLAY-IMPORT term LOOPBACK from route-filter 10.80.224.128/25 orlonger
set policy-options policy-statement UNDERLAY-IMPORT term LOOPBACK from route-filter 10.0.0.0/24 orlonger
set policy-options policy-statement UNDERLAY-IMPORT term LOOPBACK then accept
set policy-options policy-statement UNDERLAY-IMPORT term DEFAULT then reject
set routing-options forwarding-table export ECMP-POLICY
set routing-options forwarding-table ecmp-fast-reroute
set routing-options autonomous-system 64730
set protocols bgp hold-time 10
set protocols bgp log-updown
set protocols bgp group EVPN_FABRIC type internal
set protocols bgp group EVPN_FABRIC bfd-liveness-detection minimum-interval 1000
set protocols bgp group EVPN_FABRIC bfd-liveness-detection multiplier 3
set protocols bgp group EVPN_FABRIC description "Reflector group for overlay IBGP peering with leaves"
set protocols bgp group EVPN_FABRIC local-address 10.80.224.150
set protocols bgp group EVPN_FABRIC family evpn signaling
set protocols bgp group EVPN_FABRIC authentication-key "samplepassword-fortesting"
set protocols bgp group EVPN_FABRIC vpn-apply-export
set protocols bgp group EVPN_FABRIC cluster 10.80.224.150
set protocols bgp group EVPN_FABRIC local-as 64730
set protocols bgp group EVPN_FABRIC multipath
set protocols bgp group EVPN_FABRIC neighbor 10.80.224.140
set protocols bgp group EVPN_FABRIC neighbor 10.80.224.141
set protocols bgp group EVPN_FABRIC neighbor 10.80.224.142
set protocols bgp group EVPN_FABRIC neighbor 10.80.224.143
set protocols bgp group UNDERLAY type external
set protocols bgp group UNDERLAY description "Group for underlay EBGP peering"
set protocols bgp group UNDERLAY import UNDERLAY-IMPORT
set protocols bgp group UNDERLAY family inet unicast
set protocols bgp group UNDERLAY authentication-key "samplepassword-fortesting"
set protocols bgp group UNDERLAY export UNDERLAY-EXPORT
set protocols bgp group UNDERLAY local-as 65002
set protocols bgp group UNDERLAY multipath multiple-as
set protocols bgp group UNDERLAY bfd-liveness-detection minimum-interval 350
set protocols bgp group UNDERLAY bfd-liveness-detection multiplier 3
set protocols bgp group UNDERLAY neighbor 10.80.224.13 peer-as 65012
set protocols bgp group UNDERLAY neighbor 10.80.224.19 peer-as 65015
set protocols bgp group UNDERLAY neighbor 10.80.224.17 peer-as 65014
set protocols bgp group UNDERLAY neighbor 10.80.224.15 peer-as 65013
set protocols bgp group UNDERLAY neighbor 172.16.1.4 peer-as 65199
set protocols bgp group OVERLAY_INTERDC type external
set protocols bgp group OVERLAY_INTERDC description "Group for overlay EBGP peering to remote DC"
set protocols bgp group OVERLAY_INTERDC multihop no-nexthop-change
set protocols bgp group OVERLAY_INTERDC local-address 10.80.224.150
set protocols bgp group OVERLAY_INTERDC family evpn signaling delay-route-advertisements minimum-delay routing-uptime 480
set protocols bgp group OVERLAY_INTERDC local-as 64730
set protocols bgp group OVERLAY_INTERDC multipath multiple-as
set protocols bgp group OVERLAY_INTERDC neighbor 10.0.0.2 peer-as 64830
set protocols bgp group OVERLAY_INTERDC neighbor 10.0.0.3 peer-as 64830
set protocols lldp interface all

Leaf Device 1 in Data Center 1

content_copy zoom_out_map
set system arp aging-timer 5
set interfaces xe-0/0/1 description "DC1 Server1"
set interfaces xe-0/0/1 unit 0 family ethernet-switching vlan members v203
set interfaces et-0/0/49 description "Fabric interface"
set interfaces et-0/0/49 mtu 9200
set interfaces et-0/0/49 unit 0 description "** to DC1-Spine1"
set interfaces et-0/0/49 unit 0 family inet address 10.80.224.3/31
set interfaces et-0/0/50 description "Fabric interface"
set interfaces et-0/0/50 mtu 9200
set interfaces et-0/0/50 unit 0 description "** to DC1-Spine2"
set interfaces et-0/0/50 unit 0 family inet address 10.80.224.13/31
set interfaces irb unit 10 virtual-gateway-accept-data
set interfaces irb unit 10 description "** L3 interface for v10 in Tenant_1"
set interfaces irb unit 10 family inet address 10.1.10.11/24 preferred
set interfaces irb unit 10 family inet address 10.1.10.11/24 virtual-gateway-address 10.1.10.1
set interfaces irb unit 11 virtual-gateway-accept-data
set interfaces irb unit 11 description "** L3 interface for v11 in Tenant_1"
set interfaces irb unit 11 family inet address 10.1.11.11/24 preferred
set interfaces irb unit 11 family inet address 10.1.11.11/24 virtual-gateway-address 10.1.11.1
set interfaces irb unit 12 virtual-gateway-accept-data
set interfaces irb unit 12 description "** L3 interface for v12 in Tenant_1"
set interfaces irb unit 12 family inet address 10.1.12.11/24 preferred
set interfaces irb unit 12 family inet address 10.1.12.11/24 virtual-gateway-address 10.1.12.1
set interfaces irb unit 202 virtual-gateway-accept-data
set interfaces irb unit 202 description "** L3 interface for v202 in Tenant_1"
set interfaces irb unit 202 family inet address 10.1.202.11/24 preferred
set interfaces irb unit 202 family inet address 10.1.202.11/24 virtual-gateway-address 10.1.202.1
set interfaces irb unit 203 virtual-gateway-accept-data
set interfaces irb unit 203 description "** L3 interface for v203 in Tenant_1"
set interfaces irb unit 203 family inet address 10.1.203.11/24 preferred
set interfaces irb unit 203 family inet address 10.1.203.11/24 virtual-gateway-address 10.1.203.1
set interfaces lo0 unit 0 description "** DC1-Leaf1"
set interfaces lo0 unit 0 family inet address 10.80.224.140/32
set interfaces lo0 unit 1 family inet address 10.80.225.140/32
set forwarding-options vxlan-routing overlay-ecmp
set forwarding-options vxlan-routing next-hop 32768
set policy-options policy-statement ECMP-POLICY then load-balance per-packet
set policy-options policy-statement FROM_Lo0 term 10 from interface lo0.0
set policy-options policy-statement FROM_Lo0 term 10 then accept
set policy-options policy-statement FROM_Lo0 term 20 then reject
set policy-options policy-statement OVERLAY_IMPORT term 5 from community comm_pod1
set policy-options policy-statement OVERLAY_IMPORT term 5 then accept
set policy-options policy-statement OVERLAY_IMPORT term 10 from community comm_pod2
set policy-options policy-statement OVERLAY_IMPORT term 10 then accept
set policy-options policy-statement OVERLAY_IMPORT term 20 from community shared_202_fm_pod2
set policy-options policy-statement OVERLAY_IMPORT term 20 from community shared_202_fm_pod1
set policy-options policy-statement OVERLAY_IMPORT term 20 from community shared_203_fm_pod2
set policy-options policy-statement OVERLAY_IMPORT term 20 from community shared_203_fm_pod1
set policy-options policy-statement OVERLAY_IMPORT term 20 then accept
set policy-options policy-statement T5_EXPORT term fm_direct from protocol direct
set policy-options policy-statement T5_EXPORT term fm_direct then accept
set policy-options policy-statement T5_EXPORT term fm_static from protocol static
set policy-options policy-statement T5_EXPORT term fm_static then accept
set policy-options policy-statement T5_EXPORT term fm_v4_host from protocol evpn
set policy-options policy-statement T5_EXPORT term fm_v4_host from route-filter 0.0.0.0/0 prefix-length-range /32-/32
set policy-options policy-statement T5_EXPORT term fm_v4_host then accept
set policy-options policy-statement T5_EXPORT term fm_v6_host from protocol evpn
set policy-options policy-statement T5_EXPORT term fm_v6_host from route-filter 0::0/0 prefix-length-range /128-/128
set policy-options policy-statement T5_EXPORT term fm_v6_host then accept
set policy-options policy-statement VRF1_T5_RT_EXPORT term t1 then community add target_t5_pod1
set policy-options policy-statement VRF1_T5_RT_EXPORT term t1 then accept
set policy-options policy-statement VRF1_T5_RT_IMPORT term t1 from community target_t5_pod1
set policy-options policy-statement VRF1_T5_RT_IMPORT term t1 then accept
set policy-options policy-statement VRF1_T5_RT_IMPORT term t2 from community target_t5_pod2
set policy-options policy-statement VRF1_T5_RT_IMPORT term t2 then accept
set policy-options community comm_pod1 members target:64730:999
set policy-options community comm_pod2 members target:64830:999
set policy-options community shared_202_fm_pod1 members target:64730:202
set policy-options community shared_202_fm_pod2 members target:64830:202
set policy-options community shared_203_fm_pod1 members target:64730:203
set policy-options community shared_203_fm_pod2 members target:64830:203
set policy-options community target_t5_pod1 members target:64730:9999
set policy-options community target_t5_pod2 members target:64830:9999
set routing-instances TENANT_1_VRF instance-type vrf
set routing-instances TENANT_1_VRF routing-options multipath
set routing-instances TENANT_1_VRF protocols evpn ip-prefix-routes advertise direct-nexthop
set routing-instances TENANT_1_VRF protocols evpn ip-prefix-routes encapsulation vxlan
set routing-instances TENANT_1_VRF protocols evpn ip-prefix-routes vni 9999
set routing-instances TENANT_1_VRF protocols evpn ip-prefix-routes export T5_EXPORT
set routing-instances TENANT_1_VRF routing-options multipath
set routing-instances TENANT_1_VRF description "VRF for Tenant_1"
set routing-instances TENANT_1_VRF interface irb.10
set routing-instances TENANT_1_VRF interface irb.11
set routing-instances TENANT_1_VRF interface irb.12
set routing-instances TENANT_1_VRF interface irb.202
set routing-instances TENANT_1_VRF interface irb.203
set routing-instances TENANT_1_VRF interface lo0.1
set routing-instances TENANT_1_VRF route-distinguisher 10.80.225.140:9999
set routing-instances TENANT_1_VRF vrf-import VRF1_T5_RT_IMPORT
set routing-instances TENANT_1_VRF vrf-export VRF1_T5_RT_EXPORT
set routing-instances TENANT_1_VRF vrf-target target:1:65001
set routing-instances TENANT_1_VRF vrf-table-label
set routing-options forwarding-table export ECMP-POLICY
set routing-options forwarding-table ecmp-fast-reroute
set routing-options forwarding-table chained-composite-next-hop ingress evpn
set routing-options router-id 10.80.224.140
set routing-options autonomous-system 64730
set protocols evpn vni-options vni 110 vrf-target target:64730:110
set protocols evpn vni-options vni 111 vrf-target target:64730:111
set protocols evpn vni-options vni 112 vrf-target target:64730:112
set protocols evpn vni-options vni 1202 vrf-target target:64730:202
set protocols evpn vni-options vni 1203 vrf-target target:64730:203
set protocols evpn encapsulation vxlan
set protocols evpn default-gateway no-gateway-community
set protocols evpn extended-vni-list 110
set protocols evpn extended-vni-list 111
set protocols evpn extended-vni-list 112
set protocols evpn extended-vni-list 1202
set protocols evpn extended-vni-list 1203
set protocols bgp group EVPN_FABRIC type internal
set protocols bgp group EVPN_FABRIC bfd-liveness-detection minimum-interval 1000
set protocols bgp group EVPN_FABRIC bfd-liveness-detection multiplier 3
set protocols bgp group EVPN_FABRIC description "Group for IBGP peering to reflectors"
set protocols bgp group EVPN_FABRIC local-address 10.80.224.140
set protocols bgp group EVPN_FABRIC family evpn signaling
set protocols bgp group EVPN_FABRIC authentication-key "samplepassword-fortesting"
set protocols bgp group EVPN_FABRIC local-as 64730
set protocols bgp group EVPN_FABRIC multipath
set protocols bgp group EVPN_FABRIC neighbor 10.80.224.149
set protocols bgp group EVPN_FABRIC neighbor 10.80.224.150
set protocols bgp group UNDERLAY type external
set protocols bgp group UNDERLAY description "Group for EBGP peering in underlay"
set protocols bgp group UNDERLAY family inet unicast
set protocols bgp group UNDERLAY authentication-key "samplepassword-fortesting"
set protocols bgp group UNDERLAY export FROM_Lo0
set protocols bgp group UNDERLAY local-as 65012
set protocols bgp group UNDERLAY multipath multiple-as
set protocols bgp group UNDERLAY bfd-liveness-detection minimum-interval 350
set protocols bgp group UNDERLAY bfd-liveness-detection multiplier 3
set protocols bgp group UNDERLAY neighbor 10.80.224.12 peer-as 65002
set protocols bgp group UNDERLAY neighbor 10.80.224.2 peer-as 65001
set protocols bgp hold-time 10
set protocols bgp log-updown
set protocols l2-learning global-mac-table-aging-time 600
set protocols l2-learning global-mac-ip-table-aging-time 300
set protocols lldp interface all
set switch-options vtep-source-interface lo0.0
set switch-options route-distinguisher 10.80.224.140:1
set switch-options vrf-import OVERLAY_IMPORT
set switch-options vrf-target target:64730:999
set vlans v10 description "Tenant_1 - VLAN id 10"
set vlans v10 vlan-id 10
set vlans v10 l3-interface irb.10
set vlans v10 vxlan vni 110
set vlans v11 description "Tenant_1 - VLAN id 11"
set vlans v11 vlan-id 11
set vlans v11 l3-interface irb.11
set vlans v11 vxlan vni 111
set vlans v12 description "Tenant_1 - VLAN id 12"
set vlans v12 vlan-id 12
set vlans v12 l3-interface irb.12
set vlans v12 vxlan vni 112
set vlans v202 description "Tenant_1 - VLAN id 202"
set vlans v202 vlan-id 202
set vlans v202 l3-interface irb.202
set vlans v202 vxlan vni 1202
set vlans v203 description "Tenant_1 - VLAN id 203"
set vlans v203 vlan-id 203
set vlans v203 l3-interface irb.203
set vlans v203 vxlan vni 1203

Leaf Device 2 in Data Center 1

content_copy zoom_out_map
set system arp aging-timer 5
set interfaces xe-0/0/1:0 description "DC1 Server2"
set interfaces xe-0/0/1:0 unit 0 family ethernet-switching vlan members v203
set interfaces et-0/0/49 description "Fabric interface"
set interfaces et-0/0/49 mtu 9200
set interfaces et-0/0/49 unit 0 description "** to DC1-Spine2"
set interfaces et-0/0/49 unit 0 family inet address 10.80.224.15/31
set interfaces et-0/0/50 description "Fabric interface"
set interfaces et-0/0/50 traps
set interfaces et-0/0/50 mtu 9200
set interfaces et-0/0/50 unit 0 description "** to DC1-Spine1"
set interfaces et-0/0/50 unit 0 family inet address 10.80.224.5/31
set interfaces irb unit 10 virtual-gateway-accept-data
set interfaces irb unit 10 description "** L3 interface for v10 in Tenant_1"
set interfaces irb unit 10 family inet address 10.1.10.12/24 preferred
set interfaces irb unit 10 family inet address 10.1.10.12/24 virtual-gateway-address 10.1.10.1
set interfaces irb unit 11 virtual-gateway-accept-data
set interfaces irb unit 11 description "** L3 interface for v11 in Tenant_1"
set interfaces irb unit 11 family inet address 10.1.11.12/24 preferred
set interfaces irb unit 11 family inet address 10.1.11.12/24 virtual-gateway-address 10.1.11.1
set interfaces irb unit 12 virtual-gateway-accept-data
set interfaces irb unit 12 description "** L3 interface for v12 in Tenant_1"
set interfaces irb unit 12 family inet address 10.1.12.12/24 preferred
set interfaces irb unit 12 family inet address 10.1.12.12/24 virtual-gateway-address 10.1.12.1
set interfaces irb unit 202 virtual-gateway-accept-data
set interfaces irb unit 202 description "** L3 interface for v202 in Tenant_1"
set interfaces irb unit 202 family inet address 10.1.202.12/24 preferred
set interfaces irb unit 202 family inet address 10.1.202.12/24 virtual-gateway-address 10.1.202.1
set interfaces irb unit 203 virtual-gateway-accept-data
set interfaces irb unit 203 description "** L3 interface for v203 in Tenant_1"
set interfaces irb unit 203 family inet address 10.1.203.12/24 preferred
set interfaces irb unit 203 family inet address 10.1.203.12/24 virtual-gateway-address 10.1.203.1
set interfaces lo0 unit 0 description "** DC1-Leaf2"
set interfaces lo0 unit 0 family inet address 10.80.224.141/32
set interfaces lo0 unit 1 family inet address 10.80.225.141/32
set forwarding-options vxlan-routing overlay-ecmp
set forwarding-options vxlan-routing next-hop 32768
set policy-options policy-statement ECMP-POLICY then load-balance per-packet
set policy-options policy-statement FROM_Lo0 term 10 from interface lo0.0
set policy-options policy-statement FROM_Lo0 term 10 then accept
set policy-options policy-statement FROM_Lo0 term 20 then reject
set policy-options policy-statement OVERLAY_IMPORT term 5 from community comm_pod1
set policy-options policy-statement OVERLAY_IMPORT term 5 then accept
set policy-options policy-statement OVERLAY_IMPORT term 10 from community comm_pod2
set policy-options policy-statement OVERLAY_IMPORT term 10 then accept
set policy-options policy-statement OVERLAY_IMPORT term 20 from community shared_202_fm_pod2
set policy-options policy-statement OVERLAY_IMPORT term 20 from community shared_202_fm_pod1
set policy-options policy-statement OVERLAY_IMPORT term 20 from community shared_203_fm_pod2
set policy-options policy-statement OVERLAY_IMPORT term 20 from community shared_203_fm_pod1
set policy-options policy-statement OVERLAY_IMPORT term 20 then accept
set policy-options policy-statement T5_EXPORT term fm_direct from protocol direct
set policy-options policy-statement T5_EXPORT term fm_direct then accept
set policy-options policy-statement T5_EXPORT term fm_static from protocol static
set policy-options policy-statement T5_EXPORT term fm_static then accept
set policy-options policy-statement T5_EXPORT term fm_v4_host from protocol evpn
set policy-options policy-statement T5_EXPORT term fm_v4_host from route-filter 0.0.0.0/0 prefix-length-range /32-/32
set policy-options policy-statement T5_EXPORT term fm_v4_host then accept
set policy-options policy-statement T5_EXPORT term fm_v6_host from protocol evpn
set policy-options policy-statement T5_EXPORT term fm_v6_host from route-filter 0::0/0 prefix-length-range /128-/128
set policy-options policy-statement T5_EXPORT term fm_v6_host then accept
set policy-options policy-statement VRF1_T5_RT_EXPORT term t1 then community add target_t5_pod1
set policy-options policy-statement VRF1_T5_RT_EXPORT term t1 then accept
set policy-options policy-statement VRF1_T5_RT_IMPORT term t1 from community target_t5_pod1
set policy-options policy-statement VRF1_T5_RT_IMPORT term t1 then accept
set policy-options policy-statement VRF1_T5_RT_IMPORT term t2 from community target_t5_pod2
set policy-options policy-statement VRF1_T5_RT_IMPORT term t2 then accept
set policy-options community comm_pod1 members target:64730:999
set policy-options community comm_pod2 members target:64830:999
set policy-options community shared_202_fm_pod1 members target:64730:202
set policy-options community shared_202_fm_pod2 members target:64830:202
set policy-options community shared_203_fm_pod1 members target:64730:203
set policy-options community shared_203_fm_pod2 members target:64830:203
set policy-options community target_t5_pod1 members target:64730:9999
set policy-options community target_t5_pod2 members target:64830:9999
set routing-instances TENANT_1_VRF instance-type vrf
set routing-instances TENANT_1_VRF protocols evpn ip-prefix-routes advertise direct-nexthop
set routing-instances TENANT_1_VRF protocols evpn ip-prefix-routes encapsulation vxlan
set routing-instances TENANT_1_VRF protocols evpn ip-prefix-routes vni 9999
set routing-instances TENANT_1_VRF protocols evpn ip-prefix-routes export T5_EXPORT
set routing-instances TENANT_1_VRF routing-options multipath
set routing-instances TENANT_1_VRF description "VRF for Tenant_1"
set routing-instances TENANT_1_VRF interface irb.10
set routing-instances TENANT_1_VRF interface irb.11
set routing-instances TENANT_1_VRF interface irb.12
set routing-instances TENANT_1_VRF interface irb.202
set routing-instances TENANT_1_VRF interface irb.203
set routing-instances TENANT_1_VRF interface lo0.1
set routing-instances TENANT_1_VRF route-distinguisher 10.80.225.141:9999
set routing-instances TENANT_1_VRF vrf-import VRF1_T5_RT_IMPORT
set routing-instances TENANT_1_VRF vrf-export VRF1_T5_RT_EXPORT
set routing-instances TENANT_1_VRF vrf-target target:1:65001
set routing-instances TENANT_1_VRF vrf-table-label
set routing-options forwarding-table export ECMP-POLICY
set routing-options forwarding-table ecmp-fast-reroute
set routing-options forwarding-table chained-composite-next-hop ingress evpn
set routing-options router-id 10.80.224.141
set routing-options autonomous-system 64730
set protocols evpn vni-options vni 110 vrf-target target:64730:110
set protocols evpn vni-options vni 111 vrf-target target:64730:111
set protocols evpn vni-options vni 112 vrf-target target:64730:112
set protocols evpn vni-options vni 1202 vrf-target target:64730:202
set protocols evpn vni-options vni 1203 vrf-target target:64730:203
set protocols evpn encapsulation vxlan
set protocols evpn default-gateway no-gateway-community
set protocols evpn extended-vni-list 110
set protocols evpn extended-vni-list 111
set protocols evpn extended-vni-list 112
set protocols evpn extended-vni-list 1202
set protocols evpn extended-vni-list 1203
set protocols bgp group EVPN_FABRIC type internal
set protocols bgp group EVPN_FABRIC bfd-liveness-detection minimum-interval 1000
set protocols bgp group EVPN_FABRIC bfd-liveness-detection multiplier 3
set protocols bgp group EVPN_FABRIC description "Group for IBGP peering to reflectors"
set protocols bgp group EVPN_FABRIC local-address 10.80.224.141
set protocols bgp group EVPN_FABRIC family evpn signaling
set protocols bgp group EVPN_FABRIC authentication-key "samplepassword-fortesting"
set protocols bgp group EVPN_FABRIC local-as 64730
set protocols bgp group EVPN_FABRIC multipath
set protocols bgp group EVPN_FABRIC neighbor 10.80.224.149
set protocols bgp group EVPN_FABRIC neighbor 10.80.224.150
set protocols bgp group UNDERLAY type external
set protocols bgp group UNDERLAY description "Group for EBGP peering in underlay"
set protocols bgp group UNDERLAY family inet unicast
set protocols bgp group UNDERLAY authentication-key "samplepassword-fortesting"
set protocols bgp group UNDERLAY export FROM_Lo0
set protocols bgp group UNDERLAY local-as 65013
set protocols bgp group UNDERLAY multipath multiple-as
set protocols bgp group UNDERLAY bfd-liveness-detection minimum-interval 350
set protocols bgp group UNDERLAY bfd-liveness-detection multiplier 3
set protocols bgp group UNDERLAY neighbor 10.80.224.4 peer-as 65001
set protocols bgp group UNDERLAY neighbor 10.80.224.14 peer-as 65002
set protocols bgp hold-time 10
set protocols bgp log-updown
set protocols l2-learning global-mac-table-aging-time 600
set protocols l2-learning global-mac-ip-table-aging-time 300
set protocols lldp interface all
set switch-options vtep-source-interface lo0.0
set switch-options route-distinguisher 10.80.224.141:1
set switch-options vrf-import OVERLAY_IMPORT
set switch-options vrf-target target:64730:999
set vlans v10 description "Tenant_1 - VLAN id 10"
set vlans v10 vlan-id 10
set vlans v10 l3-interface irb.10
set vlans v10 vxlan vni 110
set vlans v11 description "Tenant_1 - VLAN id 11"
set vlans v11 vlan-id 11
set vlans v11 l3-interface irb.11
set vlans v11 vxlan vni 111
set vlans v12 description "Tenant_1 - VLAN id 12"
set vlans v12 vlan-id 12
set vlans v12 l3-interface irb.12
set vlans v12 vxlan vni 112
set vlans v202 description "Tenant_1 - VLAN id 202"
set vlans v202 vlan-id 202
set vlans v202 l3-interface irb.202
set vlans v202 vxlan vni 1202
set vlans v203 description "Tenant_1 - VLAN id 203"
set vlans v203 vlan-id 203
set vlans v203 l3-interface irb.203
set vlans v203 vxlan vni 1203

Border Spine 1 in Data Center 2

content_copy zoom_out_map
set chassis fpc 0 pic 0 port 6 channel-speed 10g
set interfaces et-0/0/0 description "Fabric interface"
set interfaces et-0/0/0 mtu 9200
set interfaces et-0/0/0 unit 0 description "** to DC2-Leaf1"
set interfaces et-0/0/0 unit 0 family inet address 172.16.0.0/31
set interfaces et-0/0/1 description "Fabric interface"
set interfaces et-0/0/1 mtu 9200
set interfaces et-0/0/1 unit 0 description "** to DC2-Leaf2"
set interfaces et-0/0/1 unit 0 family inet address 172.16.0.2/31
set interfaces et-0/0/2 description "Fabric interface"
set interfaces et-0/0/2 mtu 9200
set interfaces et-0/0/2 unit 0 description "** to DC2-Leaf3"
set interfaces et-0/0/2 unit 0 family inet address 172.16.0.4/31
set interfaces xe-0/0/6:1 description "To WAN Router"
set interfaces xe-0/0/6:1 mtu 9200
set interfaces xe-0/0/6:1 unit 0 family inet address 172.16.1.9/31
set interfaces lo0 unit 0 description "** DC2-Spine1"
set interfaces lo0 unit 0 family inet address 10.0.0.2/32
set policy-options policy-statement ECMP-POLICY then load-balance per-packet
set policy-options policy-statement FROM_Lo0 term 10 from interface lo0.0
set policy-options policy-statement FROM_Lo0 term 10 then accept
set policy-options policy-statement FROM_Lo0 term 20 then reject
set policy-options policy-statement UNDERLAY-EXPORT term LOOPBACK from route-filter 10.80.224.128/25 orlonger
set policy-options policy-statement UNDERLAY-EXPORT term LOOPBACK from route-filter 10.0.0.0/24 orlonger
set policy-options policy-statement UNDERLAY-EXPORT term LOOPBACK then accept
set policy-options policy-statement UNDERLAY-EXPORT term DEFAULT then reject
set policy-options policy-statement UNDERLAY-IMPORT term LOOPBACK from route-filter 10.80.224.128/25 orlonger
set policy-options policy-statement UNDERLAY-IMPORT term LOOPBACK from route-filter 10.0.0.0/24 orlonger
set policy-options policy-statement UNDERLAY-IMPORT term LOOPBACK then accept
set policy-options policy-statement UNDERLAY-IMPORT term DEFAULT then reject
set routing-options forwarding-table export ECMP-POLICY
set routing-options forwarding-table ecmp-fast-reroute
set routing-options autonomous-system 64830
set routing-options forwarding-table chained-composite-next-hop ingress evpn
set protocols bgp group UNDERLAY type external
set protocols bgp group UNDERLAY description "Group for EBGP peering in underlay"
set protocols bgp group UNDERLAY import UNDERLAY-IMPORT
set protocols bgp group UNDERLAY family inet unicast
set protocols bgp group UNDERLAY authentication-key "samplepassword-fortesting"
set protocols bgp group UNDERLAY export UNDERLAY-EXPORT
set protocols bgp group UNDERLAY local-as 65101
set protocols bgp group UNDERLAY multipath multiple-as
set protocols bgp group UNDERLAY bfd-liveness-detection minimum-interval 350
set protocols bgp group UNDERLAY bfd-liveness-detection multiplier 3
set protocols bgp group UNDERLAY neighbor 172.16.0.3 peer-as 65018
set protocols bgp group UNDERLAY neighbor 172.16.0.1 peer-as 65019
set protocols bgp group UNDERLAY neighbor 172.16.0.5 peer-as 65020
set protocols bgp group UNDERLAY neighbor 172.16.1.8 peer-as 65229
set protocols bgp group EVPN_FABRIC type internal
set protocols bgp group EVPN_FABRIC description "Group for overlay IBGP peering to reflectors"
set protocols bgp group EVPN_FABRIC local-address 10.0.0.2
set protocols bgp group EVPN_FABRIC family evpn signaling
set protocols bgp group EVPN_FABRIC authentication-key "samplepassword-fortesting"
set protocols bgp group EVPN_FABRIC cluster 10.0.0.2
set protocols bgp group EVPN_FABRIC local-as 64830
set protocols bgp group EVPN_FABRIC multipath
set protocols bgp group EVPN_FABRIC bfd-liveness-detection minimum-interval 1000
set protocols bgp group EVPN_FABRIC bfd-liveness-detection multiplier 3
set protocols bgp group EVPN_FABRIC neighbor 10.0.0.19
set protocols bgp group EVPN_FABRIC neighbor 10.0.0.18
set protocols bgp group EVPN_FABRIC neighbor 10.0.0.14
set protocols bgp group EVPN_FABRIC vpn-apply-export
set protocols bgp group OVERLAY_INTERDC type external
set protocols bgp group OVERLAY_INTERDC description "Group for overlay EBGP peering to remote DC"
set protocols bgp group OVERLAY_INTERDC multihop no-nexthop-change
set protocols bgp group OVERLAY_INTERDC local-address 10.0.0.2
set protocols bgp group OVERLAY_INTERDC family evpn signaling delay-route-advertisements minimum-delay routing-uptime 480
set protocols bgp group OVERLAY_INTERDC local-as 64830
set protocols bgp group OVERLAY_INTERDC multipath multiple-as
set protocols bgp group OVERLAY_INTERDC neighbor 10.80.224.149 peer-as 64730
set protocols bgp group OVERLAY_INTERDC neighbor 10.80.224.150 peer-as 64730
set protocols bgp hold-time 10
set protocols bgp log-updown
set protocols lldp interface all

Border Spine Device 2 in Data Center 2

content_copy zoom_out_map
set chassis fpc 0 pic 0 port 6 channel-speed 10g
set interfaces et-0/0/0 description "Fabric interface"
set interfaces et-0/0/0 mtu 9200
set interfaces et-0/0/0 unit 0 description "** to DC2-Leaf1"
set interfaces et-0/0/0 unit 0 family inet address 172.16.0.6/31
set interfaces et-0/0/1 description "Fabric interface"
set interfaces et-0/0/1 mtu 9200
set interfaces et-0/0/1 unit 0 description "** to DC2-Leaf2"
set interfaces et-0/0/1 unit 0 family inet address 172.16.0.8/31
set interfaces et-0/0/2 description "Fabric interface"
set interfaces et-0/0/2 mtu 9200
set interfaces et-0/0/2 unit 0 description "** to DC2-Leaf3"
set interfaces et-0/0/2 unit 0 family inet address 172.16.0.10/31
set interfaces xe-0/0/6:1 description "To WAN Router"
set interfaces xe-0/0/6:1 mtu 9200
set interfaces xe-0/0/6:1 unit 0 family inet address 172.16.1.11/31
set interfaces lo0 unit 0 description "** DC2-Spine2"
set interfaces lo0 unit 0 family inet address 10.0.0.3/32
set forwarding-options vxlan-routing overlay-ecmp
set policy-options policy-statement ECMP-POLICY then load-balance per-packet
set policy-options policy-statement FROM_Lo0 term 10 from interface lo0.0
set policy-options policy-statement FROM_Lo0 term 10 then accept
set policy-options policy-statement FROM_Lo0 term 20 then reject
set policy-options policy-statement UNDERLAY-EXPORT term LOOPBACK from route-filter 10.80.224.128/25 orlonger
set policy-options policy-statement UNDERLAY-EXPORT term LOOPBACK from route-filter 10.0.0.0/24 orlonger
set policy-options policy-statement UNDERLAY-EXPORT term LOOPBACK then accept
set policy-options policy-statement UNDERLAY-EXPORT term DEFAULT then reject
set policy-options policy-statement UNDERLAY-IMPORT term LOOPBACK from route-filter 10.80.224.128/25 orlonger
set policy-options policy-statement UNDERLAY-IMPORT term LOOPBACK from route-filter 10.0.0.0/24 orlonger
set policy-options policy-statement UNDERLAY-IMPORT term LOOPBACK then accept
set policy-options policy-statement UNDERLAY-IMPORT term DEFAULT then reject
set routing-options forwarding-table export ECMP-POLICY
set routing-options forwarding-table ecmp-fast-reroute
set routing-options forwarding-table chained-composite-next-hop ingress evpn
set routing-options autonomous-system 64830
set protocols bgp group UNDERLAY type external
set protocols bgp group UNDERLAY description "Group for EBGP peering in underlay"
set protocols bgp group UNDERLAY import UNDERLAY-IMPORT
set protocols bgp group UNDERLAY family inet unicast
set protocols bgp group UNDERLAY authentication-key "samplepassword-fortesting"
set protocols bgp group UNDERLAY export UNDERLAY-EXPORT
set protocols bgp group UNDERLAY local-as 65102
set protocols bgp group UNDERLAY multipath multiple-as
set protocols bgp group UNDERLAY bfd-liveness-detection minimum-interval 350
set protocols bgp group UNDERLAY bfd-liveness-detection multiplier 3
set protocols bgp group UNDERLAY neighbor 172.16.0.9 peer-as 65018
set protocols bgp group UNDERLAY neighbor 172.16.0.7 peer-as 65019
set protocols bgp group UNDERLAY neighbor 172.16.0.11 peer-as 65020
set protocols bgp group UNDERLAY neighbor 172.16.1.10 peer-as 65229
set protocols bgp group EVPN_FABRIC type internal
set protocols bgp group EVPN_FABRIC description "Group for overlay IBGP peering to reflectors"
set protocols bgp group EVPN_FABRIC local-address 10.0.0.3
set protocols bgp group EVPN_FABRIC family evpn signaling
set protocols bgp group EVPN_FABRIC authentication-key "samplepassword-fortesting"
set protocols bgp group EVPN_FABRIC cluster 10.0.0.3
set protocols bgp group EVPN_FABRIC local-as 64830
set protocols bgp group EVPN_FABRIC multipath
set protocols bgp group EVPN_FABRIC bfd-liveness-detection minimum-interval 1000
set protocols bgp group EVPN_FABRIC bfd-liveness-detection multiplier 3
set protocols bgp group EVPN_FABRIC neighbor 10.0.0.19
set protocols bgp group EVPN_FABRIC neighbor 10.0.0.18
set protocols bgp group EVPN_FABRIC neighbor 10.0.0.14
set protocols bgp group EVPN_FABRIC vpn-apply-export
set protocols bgp group OVERLAY_INTERDC type external
set protocols bgp group OVERLAY_INTERDC description "Group for overlay EBGP peering to remote DC"
set protocols bgp group OVERLAY_INTERDC multihop no-nexthop-change
set protocols bgp group OVERLAY_INTERDC local-address 10.0.0.3
set protocols bgp group OVERLAY_INTERDC family evpn signaling delay-route-advertisements minimum-delay routing-uptime 480
set protocols bgp group OVERLAY_INTERDC local-as 64830
set protocols bgp group OVERLAY_INTERDC multipath multiple-as
set protocols bgp group OVERLAY_INTERDC neighbor 10.80.224.149 peer-as 64730
set protocols bgp group OVERLAY_INTERDC neighbor 10.80.224.150 peer-as 64730
set protocols bgp hold-time 10
set protocols bgp log-updown
set protocols lldp interface all

Leaf Device 1 in Data Center 2

content_copy zoom_out_map
set system arp aging-timer 5
set chassis aggregated-devices ethernet device-count 20
set interfaces xe-0/0/13 ether-options 802.3ad ae1
set interfaces xe-0/0/14 ether-options 802.3ad ae2
set interfaces et-0/0/48 description "Fabric interface"
set interfaces et-0/0/48 mtu 9200
set interfaces et-0/0/48 unit 0 description "** to DC2-Spine1"
set interfaces et-0/0/48 unit 0 family inet address 172.16.0.1/31
set interfaces et-0/0/49 description "Fabric interface"
set interfaces et-0/0/49 mtu 9200
set interfaces et-0/0/49 unit 0 description "** to DC2-Spine2"
set interfaces et-0/0/49 unit 0 family inet address 172.16.0.7/31
set interfaces ae1 description "DC2 Server1"
set interfaces ae1 esi 00:00:00:00:00:02:02:02:02:01
set interfaces ae1 esi all-active
set interfaces ae1 aggregated-ether-options link-speed 10g
set interfaces ae1 aggregated-ether-options lacp active
set interfaces ae1 aggregated-ether-options lacp periodic fast
set interfaces ae1 aggregated-ether-options lacp system-id 00:02:02:02:02:01
set interfaces ae1 unit 0 family ethernet-switching interface-mode trunk
set interfaces ae1 unit 0 family ethernet-switching vlan members v170
set interfaces ae1 unit 0 family ethernet-switching vlan members v171
set interfaces ae1 unit 0 family ethernet-switching vlan members v172
set interfaces ae1 unit 0 family ethernet-switching vlan members v202
set interfaces ae1 unit 0 family ethernet-switching vlan members v203
set interfaces ae2 description "DC2 Server2"
set interfaces ae2 esi 00:00:00:00:00:02:02:02:02:02
set interfaces ae2 esi all-active
set interfaces ae2 aggregated-ether-options link-speed 10g
set interfaces ae2 aggregated-ether-options lacp active
set interfaces ae2 aggregated-ether-options lacp periodic fast
set interfaces ae2 aggregated-ether-options lacp system-id 00:02:02:02:02:02
set interfaces ae2 unit 0 family ethernet-switching interface-mode trunk
set interfaces ae2 unit 0 family ethernet-switching vlan members v170
set interfaces ae2 unit 0 family ethernet-switching vlan members v171
set interfaces ae2 unit 0 family ethernet-switching vlan members v172
set interfaces ae2 unit 0 family ethernet-switching vlan members v202
set interfaces ae2 unit 0 family ethernet-switching vlan members v203
set interfaces irb unit 170 virtual-gateway-accept-data
set interfaces irb unit 170 description "** L3 interface for v170 in Tenant_1"
set interfaces irb unit 170 family inet address 10.1.170.19/24 preferred
set interfaces irb unit 170 family inet address 10.1.170.19/24 virtual-gateway-address 10.1.170.1
set interfaces irb unit 171 virtual-gateway-accept-data
set interfaces irb unit 171 description "** L3 interface for v171 in Tenant_1"
set interfaces irb unit 171 family inet address 10.1.171.19/24 preferred
set interfaces irb unit 171 family inet address 10.1.171.19/24 virtual-gateway-address 10.1.171.1
set interfaces irb unit 172 virtual-gateway-accept-data
set interfaces irb unit 172 description "** L3 interface for v172 in Tenant_1"
set interfaces irb unit 172 family inet address 10.1.172.19/24 preferred
set interfaces irb unit 172 family inet address 10.1.172.19/24 virtual-gateway-address 10.1.172.1
set interfaces irb unit 202 virtual-gateway-accept-data
set interfaces irb unit 202 description "** L3 interface for v202 in Tenant_1"
set interfaces irb unit 202 family inet address 10.1.202.19/24 preferred
set interfaces irb unit 202 family inet address 10.1.202.19/24 virtual-gateway-address 10.1.202.1
set interfaces irb unit 203 virtual-gateway-accept-data
set interfaces irb unit 203 description "** L3 interface for v203 in Tenant_1"
set interfaces irb unit 203 family inet address 10.1.203.19/24 preferred
set interfaces irb unit 203 family inet address 10.1.203.19/24 virtual-gateway-address 10.1.203.1
set interfaces lo0 traps
set interfaces lo0 unit 0 description "** DC2-Leaf1"
set interfaces lo0 unit 0 family inet address 10.0.0.19/32
set interfaces lo0 unit 1 family inet address 10.0.1.19/32
set forwarding-options vxlan-routing overlay-ecmp
set forwarding-options vxlan-routing next-hop 32768
set policy-options policy-statement ECMP-POLICY then load-balance per-packet
set policy-options policy-statement FROM_Lo0 term 10 from interface lo0.0
set policy-options policy-statement FROM_Lo0 term 10 then accept
set policy-options policy-statement FROM_Lo0 term 20 then reject
set policy-options policy-statement OVERLAY_IMPORT term 5 from community comm_pod1
set policy-options policy-statement OVERLAY_IMPORT term 5 then accept
set policy-options policy-statement OVERLAY_IMPORT term 10 from community comm_pod2
set policy-options policy-statement OVERLAY_IMPORT term 10 then accept
set policy-options policy-statement OVERLAY_IMPORT term 20 from community shared_202_fm_pod2
set policy-options policy-statement OVERLAY_IMPORT term 20 from community shared_202_fm_pod1
set policy-options policy-statement OVERLAY_IMPORT term 20 from community shared_203_fm_pod2
set policy-options policy-statement OVERLAY_IMPORT term 20 from community shared_203_fm_pod1
set policy-options policy-statement OVERLAY_IMPORT term 20 then accept
set policy-options policy-statement T5_EXPORT term fm_direct from protocol direct
set policy-options policy-statement T5_EXPORT term fm_direct then accept
set policy-options policy-statement T5_EXPORT term fm_static from protocol static
set policy-options policy-statement T5_EXPORT term fm_static then accept
set policy-options policy-statement T5_EXPORT term fm_v4_host from protocol evpn
set policy-options policy-statement T5_EXPORT term fm_v4_host from route-filter 0.0.0.0/0 prefix-length-range /32-/32
set policy-options policy-statement T5_EXPORT term fm_v4_host then accept
set policy-options policy-statement T5_EXPORT term fm_v6_host from protocol evpn
set policy-options policy-statement T5_EXPORT term fm_v6_host from route-filter 0::0/0 prefix-length-range /128-/128
set policy-options policy-statement T5_EXPORT term fm_v6_host then accept
set policy-options policy-statement VRF1_T5_RT_EXPORT term t1 then community add target_t5_pod2
set policy-options policy-statement VRF1_T5_RT_EXPORT term t1 then accept
set policy-options policy-statement VRF1_T5_RT_IMPORT term t1 from community target_t5_pod1
set policy-options policy-statement VRF1_T5_RT_IMPORT term t1 then accept
set policy-options policy-statement VRF1_T5_RT_IMPORT term t2 from community target_t5_pod2
set policy-options policy-statement VRF1_T5_RT_IMPORT term t2 then accept
set policy-options community comm_pod1 members target:64730:999
set policy-options community comm_pod2 members target:64830:999
set policy-options community shared_202_fm_pod1 members target:64730:202
set policy-options community shared_202_fm_pod2 members target:64830:202
set policy-options community shared_203_fm_pod1 members target:64730:203
set policy-options community shared_203_fm_pod2 members target:64830:203
set policy-options community target_t5_pod1 members target:64730:9999
set policy-options community target_t5_pod2 members target:64830:9999
set routing-instances TENANT_1_VRF description "VRF for Tenant_1"
set routing-instances TENANT_1_VRF instance-type vrf
set routing-instances TENANT_1_VRF interface irb.170
set routing-instances TENANT_1_VRF interface irb.171
set routing-instances TENANT_1_VRF interface irb.172
set routing-instances TENANT_1_VRF interface irb.202
set routing-instances TENANT_1_VRF interface irb.203
set routing-instances TENANT_1_VRF interface lo0.1
set routing-instances TENANT_1_VRF route-distinguisher 10.0.1.19:9999
set routing-instances TENANT_1_VRF vrf-import VRF1_T5_RT_IMPORT
set routing-instances TENANT_1_VRF vrf-export VRF1_T5_RT_EXPORT
set routing-instances TENANT_1_VRF vrf-target target:1:65001
set routing-instances TENANT_1_VRF vrf-table-label
set routing-instances TENANT_1_VRF routing-options multipath
set routing-instances TENANT_1_VRF protocols evpn ip-prefix-routes advertise direct-nexthop
set routing-instances TENANT_1_VRF protocols evpn ip-prefix-routes encapsulation vxlan
set routing-instances TENANT_1_VRF protocols evpn ip-prefix-routes vni 9999
set routing-instances TENANT_1_VRF protocols evpn ip-prefix-routes export T5_EXPORT
set routing-options router-id 10.0.0.19
set routing-options autonomous-system 64830
set routing-options forwarding-table export ECMP-POLICY
set routing-options forwarding-table ecmp-fast-reroute
set routing-options forwarding-table chained-composite-next-hop ingress evpn
set protocols bgp hold-time 10
set protocols bgp log-updown
set protocols bgp group EVPN_FABRIC type internal
set protocols bgp group EVPN_FABRIC bfd-liveness-detection minimum-interval 1000
set protocols bgp group EVPN_FABRIC bfd-liveness-detection multiplier 3
set protocols bgp group EVPN_FABRIC description "Group for overlay IBGP peering to reflectors"
set protocols bgp group EVPN_FABRIC local-address 10.0.0.19
set protocols bgp group EVPN_FABRIC family evpn signaling
set protocols bgp group EVPN_FABRIC authentication-key "samplepassword-fortesting"
set protocols bgp group EVPN_FABRIC local-as 64830
set protocols bgp group EVPN_FABRIC multipath
set protocols bgp group EVPN_FABRIC neighbor 10.0.0.2
set protocols bgp group EVPN_FABRIC neighbor 10.0.0.3
set protocols bgp group UNDERLAY type external
set protocols bgp group UNDERLAY description "Group for EBGP peering in underlay"
set protocols bgp group UNDERLAY family inet unicast
set protocols bgp group UNDERLAY authentication-key "samplepassword-fortesting"
set protocols bgp group UNDERLAY export FROM_Lo0
set protocols bgp group UNDERLAY local-as 65019
set protocols bgp group UNDERLAY multipath multiple-as
set protocols bgp group UNDERLAY bfd-liveness-detection minimum-interval 350
set protocols bgp group UNDERLAY bfd-liveness-detection multiplier 3
set protocols bgp group UNDERLAY neighbor 172.16.0.0 peer-as 65101
set protocols bgp group UNDERLAY neighbor 172.16.0.6 peer-as 65102
set protocols evpn vni-options vni 1170 vrf-target target:64830:1170
set protocols evpn vni-options vni 1171 vrf-target target:64830:1171
set protocols evpn vni-options vni 1172 vrf-target target:64830:1172
set protocols evpn vni-options vni 1202 vrf-target target:64830:202
set protocols evpn vni-options vni 1203 vrf-target target:64830:203
set protocols evpn encapsulation vxlan
set protocols evpn default-gateway no-gateway-community
set protocols evpn extended-vni-list 1170
set protocols evpn extended-vni-list 1171
set protocols evpn extended-vni-list 1172
set protocols evpn extended-vni-list 1202
set protocols evpn extended-vni-list 1203
set protocols l2-learning global-mac-table-aging-time 600
set protocols l2-learning global-mac-ip-table-aging-time 300
set protocols lldp interface all
set switch-options vtep-source-interface lo0.0
set switch-options route-distinguisher 10.0.0.19:1
set switch-options vrf-import OVERLAY_IMPORT
set switch-options vrf-target target:64830:999
set vlans v170 description "Tenant_1 - VLAN id 170"
set vlans v170 vlan-id 170
set vlans v170 l3-interface irb.170
set vlans v170 vxlan vni 1170
set vlans v171 description "Tenant_1 - VLAN id 171"
set vlans v171 vlan-id 171
set vlans v171 l3-interface irb.171
set vlans v171 vxlan vni 1171
set vlans v172 description "Tenant_1 - VLAN id 172"
set vlans v172 vlan-id 172
set vlans v172 l3-interface irb.172
set vlans v172 vxlan vni 1172
set vlans v202 description "Tenant_1 - VLAN id 202"
set vlans v202 vlan-id 202
set vlans v202 l3-interface irb.202
set vlans v202 vxlan vni 1202
set vlans v203 description "Tenant_1 - VLAN id 203"
set vlans v203 vlan-id 203
set vlans v203 l3-interface irb.203
set vlans v203 vxlan vni 1203

Leaf Device 2 in Data Center 2

content_copy zoom_out_map
set system arp aging-timer 5
set chassis aggregated-devices ethernet device-count 20
set interfaces xe-0/0/13 ether-options 802.3ad ae1
set interfaces xe-0/0/14 ether-options 802.3ad ae2
set interfaces et-0/0/48 description "Fabric interface"
set interfaces et-0/0/48 mtu 9200
set interfaces et-0/0/48 unit 0 description "** to DC2-Spine1"
set interfaces et-0/0/48 unit 0 family inet address 172.16.0.3/31
set interfaces et-0/0/49 description "Fabric interface"
set interfaces et-0/0/49 mtu 9200
set interfaces et-0/0/49 unit 0 description "** to DC2-Spine2"
set interfaces et-0/0/49 unit 0 family inet address 172.16.0.9/31
set interfaces ae1 description "DC2 Server1"
set interfaces ae1 mtu 9200
set interfaces ae1 esi 00:00:00:00:00:02:02:02:02:01
set interfaces ae1 esi all-active
set interfaces ae1 aggregated-ether-options link-speed 10g
set interfaces ae1 aggregated-ether-options lacp active
set interfaces ae1 aggregated-ether-options lacp periodic fast
set interfaces ae1 aggregated-ether-options lacp system-id 00:02:02:02:02:01
set interfaces ae1 unit 0 family ethernet-switching interface-mode trunk
set interfaces ae1 unit 0 family ethernet-switching vlan members v170
set interfaces ae1 unit 0 family ethernet-switching vlan members v171
set interfaces ae1 unit 0 family ethernet-switching vlan members v172
set interfaces ae1 unit 0 family ethernet-switching vlan members v202
set interfaces ae1 unit 0 family ethernet-switching vlan members v203
set interfaces ae2 description "DC2 Server2"
set interfaces ae2 mtu 9200
set interfaces ae2 esi 00:00:00:00:00:02:02:02:02:02
set interfaces ae2 esi all-active
set interfaces ae2 aggregated-ether-options link-speed 10g
set interfaces ae2 aggregated-ether-options lacp active
set interfaces ae2 aggregated-ether-options lacp periodic fast
set interfaces ae2 aggregated-ether-options lacp system-id 00:02:02:02:02:02
set interfaces ae2 unit 0 family ethernet-switching interface-mode trunk
set interfaces ae2 unit 0 family ethernet-switching vlan members v170
set interfaces ae2 unit 0 family ethernet-switching vlan members v171
set interfaces ae2 unit 0 family ethernet-switching vlan members v172
set interfaces ae2 unit 0 family ethernet-switching vlan members v202
set interfaces ae2 unit 0 family ethernet-switching vlan members v203
set interfaces irb unit 170 virtual-gateway-accept-data
set interfaces irb unit 170 description "** L3 interface for v170 in Tenant_1"
set interfaces irb unit 170 family inet address 10.1.170.18/24 preferred
set interfaces irb unit 170 family inet address 10.1.170.18/24 virtual-gateway-address 10.1.170.1
set interfaces irb unit 171 virtual-gateway-accept-data
set interfaces irb unit 171 description "** L3 interface for v171 in Tenant_1"
set interfaces irb unit 171 family inet address 10.1.171.18/24 preferred
set interfaces irb unit 171 family inet address 10.1.171.18/24 virtual-gateway-address 10.1.171.1
set interfaces irb unit 172 virtual-gateway-accept-data
set interfaces irb unit 172 description "** L3 interface for v172 in Tenant_1"
set interfaces irb unit 172 family inet address 10.1.172.18/24 preferred
set interfaces irb unit 172 family inet address 10.1.172.18/24 virtual-gateway-address 10.1.172.1
set interfaces irb unit 202 virtual-gateway-accept-data
set interfaces irb unit 202 description "** L3 interface for v202 in Tenant_1"
set interfaces irb unit 202 family inet address 10.1.202.18/24 preferred
set interfaces irb unit 202 family inet address 10.1.202.18/24 virtual-gateway-address 10.1.202.1
set interfaces irb unit 203 virtual-gateway-accept-data
set interfaces irb unit 203 description "** L3 interface for v203 in Tenant_1"
set interfaces irb unit 203 family inet address 10.1.203.18/24 preferred
set interfaces irb unit 203 family inet address 10.1.203.18/24 virtual-gateway-address 10.1.203.1
set interfaces lo0 unit 0 description "** DC2-Leaf2"
set interfaces lo0 unit 0 family inet address 10.0.0.18/32
set interfaces lo0 unit 1 family inet address 10.0.1.18/32
set forwarding-options vxlan-routing next-hop 32768
set forwarding-options vxlan-routing overlay-ecmp
set forwarding-options vxlan-routing next-hop 32768
set policy-options policy-statement ECMP-POLICY then load-balance per-packet
set policy-options policy-statement FROM_Lo0 term 10 from interface lo0.0
set policy-options policy-statement FROM_Lo0 term 10 then accept
set policy-options policy-statement FROM_Lo0 term 20 then reject
set policy-options policy-statement OVERLAY_IMPORT term 5 from community comm_pod1
set policy-options policy-statement OVERLAY_IMPORT term 5 then accept
set policy-options policy-statement OVERLAY_IMPORT term 10 from community comm_pod2
set policy-options policy-statement OVERLAY_IMPORT term 10 then accept
set policy-options policy-statement OVERLAY_IMPORT term 20 from community shared_202_fm_pod2
set policy-options policy-statement OVERLAY_IMPORT term 20 from community shared_202_fm_pod1
set policy-options policy-statement OVERLAY_IMPORT term 20 from community shared_203_fm_pod2
set policy-options policy-statement OVERLAY_IMPORT term 20 from community shared_203_fm_pod1
set policy-options policy-statement OVERLAY_IMPORT term 20 then accept
set policy-options policy-statement T5_EXPORT term fm_direct from protocol direct
set policy-options policy-statement T5_EXPORT term fm_direct then accept
set policy-options policy-statement T5_EXPORT term fm_static from protocol static
set policy-options policy-statement T5_EXPORT term fm_static then accept
set policy-options policy-statement T5_EXPORT term fm_v4_host from protocol evpn
set policy-options policy-statement T5_EXPORT term fm_v4_host from route-filter 0.0.0.0/0 prefix-length-range /32-/32
set policy-options policy-statement T5_EXPORT term fm_v4_host then accept
set policy-options policy-statement T5_EXPORT term fm_v6_host from protocol evpn
set policy-options policy-statement T5_EXPORT term fm_v6_host from route-filter 0::0/0 prefix-length-range /128-/128
set policy-options policy-statement T5_EXPORT term fm_v6_host then accept
set policy-options policy-statement VRF1_T5_RT_EXPORT term t1 then community add target_t5_pod2
set policy-options policy-statement VRF1_T5_RT_EXPORT term t1 then accept
set policy-options policy-statement VRF1_T5_RT_IMPORT term t1 from community target_t5_pod1
set policy-options policy-statement VRF1_T5_RT_IMPORT term t1 then accept
set policy-options policy-statement VRF1_T5_RT_IMPORT term t2 from community target_t5_pod2
set policy-options policy-statement VRF1_T5_RT_IMPORT term t2 then accept
set policy-options community comm_pod1 members target:64730:999
set policy-options community comm_pod2 members target:64830:999
set policy-options community shared_202_fm_pod1 members target:64730:202
set policy-options community shared_202_fm_pod2 members target:64830:202
set policy-options community shared_203_fm_pod1 members target:64730:203
set policy-options community shared_203_fm_pod2 members target:64830:203
set policy-options community target_t5_pod1 members target:64730:9999
set policy-options community target_t5_pod2 members target:64830:9999
set routing-instances TENANT_1_VRF description "VRF for Tenant_1"
set routing-instances TENANT_1_VRF instance-type vrf
set routing-instances TENANT_1_VRF interface irb.170
set routing-instances TENANT_1_VRF interface irb.171
set routing-instances TENANT_1_VRF interface irb.172
set routing-instances TENANT_1_VRF interface irb.202
set routing-instances TENANT_1_VRF interface irb.203
set routing-instances TENANT_1_VRF interface lo0.1
set routing-instances TENANT_1_VRF route-distinguisher 10.0.1.18:9999
set routing-instances TENANT_1_VRF vrf-import VRF1_T5_RT_IMPORT
set routing-instances TENANT_1_VRF vrf-export VRF1_T5_RT_EXPORT
set routing-instances TENANT_1_VRF vrf-target target:1:65001
set routing-instances TENANT_1_VRF vrf-table-label
set routing-instances TENANT_1_VRF routing-options multipath
set routing-instances TENANT_1_VRF protocols evpn ip-prefix-routes advertise direct-nexthop
set routing-instances TENANT_1_VRF protocols evpn ip-prefix-routes encapsulation vxlan
set routing-instances TENANT_1_VRF protocols evpn ip-prefix-routes vni 9999
set routing-instances TENANT_1_VRF protocols evpn ip-prefix-routes export T5_EXPORT
set routing-options router-id 10.0.0.18
set routing-options autonomous-system 64830
set routing-options forwarding-table export ECMP-POLICY
set routing-options forwarding-table ecmp-fast-reroute
set routing-options forwarding-table chained-composite-next-hop ingress evpn
set protocols bgp hold-time 10
set protocols bgp log-updown
set protocols bgp group EVPN_FABRIC type internal
set protocols bgp group EVPN_FABRIC bfd-liveness-detection minimum-interval 1000
set protocols bgp group EVPN_FABRIC bfd-liveness-detection multiplier 3
set protocols bgp group EVPN_FABRIC description "Group for overlay IBGP peering to reflectors"
set protocols bgp group EVPN_FABRIC local-address 10.0.0.18
set protocols bgp group EVPN_FABRIC family evpn signaling
set protocols bgp group EVPN_FABRIC authentication-key "samplepassword-fortesting"
set protocols bgp group EVPN_FABRIC local-as 64830
set protocols bgp group EVPN_FABRIC multipath
set protocols bgp group EVPN_FABRIC neighbor 10.0.0.2
set protocols bgp group EVPN_FABRIC neighbor 10.0.0.3
set protocols bgp group UNDERLAY type external
set protocols bgp group UNDERLAY description "Group for EBGP peering in underlay"
set protocols bgp group UNDERLAY family inet unicast
set protocols bgp group UNDERLAY authentication-key "samplepassword-fortesting"
set protocols bgp group UNDERLAY export FROM_Lo0
set protocols bgp group UNDERLAY local-as 65018
set protocols bgp group UNDERLAY multipath multiple-as
set protocols bgp group UNDERLAY bfd-liveness-detection minimum-interval 350
set protocols bgp group UNDERLAY bfd-liveness-detection multiplier 3
set protocols bgp group UNDERLAY neighbor 172.16.0.2 peer-as 65101
set protocols bgp group UNDERLAY neighbor 172.16.0.8 peer-as 65102
set protocols evpn vni-options vni 1170 vrf-target target:64830:1170
set protocols evpn vni-options vni 1171 vrf-target target:64830:1171
set protocols evpn vni-options vni 1172 vrf-target target:64830:1172
set protocols evpn vni-options vni 1202 vrf-target target:64830:202
set protocols evpn vni-options vni 1203 vrf-target target:64830:203
set protocols evpn encapsulation vxlan
set protocols evpn default-gateway no-gateway-community
set protocols evpn extended-vni-list 1170
set protocols evpn extended-vni-list 1171
set protocols evpn extended-vni-list 1172
set protocols evpn extended-vni-list 1202
set protocols evpn extended-vni-list 1203
set protocols l2-learning global-mac-table-aging-time 600
set protocols l2-learning global-mac-ip-table-aging-time 300
set protocols lldp interface all
set switch-options vtep-source-interface lo0.0
set switch-options route-distinguisher 10.0.0.18:1
set switch-options vrf-import OVERLAY_IMPORT
set switch-options vrf-target target:64830:999
set vlans v170 description "Tenant_1 - VLAN id 170"
set vlans v170 vlan-id 170
set vlans v170 l3-interface irb.170
set vlans v170 vxlan vni 1170
set vlans v171 description "Tenant_1 - VLAN id 171"
set vlans v171 vlan-id 171
set vlans v171 l3-interface irb.171
set vlans v171 vxlan vni 1171
set vlans v172 description "Tenant_1 - VLAN id 172"
set vlans v172 vlan-id 172
set vlans v172 l3-interface irb.172
set vlans v172 vxlan vni 1172
set vlans v202 description "Tenant_1 - VLAN id 202"
set vlans v202 vlan-id 202
set vlans v202 l3-interface irb.202
set vlans v202 vxlan vni 1202
set vlans v203 description "Tenant_1 - VLAN id 203"
set vlans v203 vlan-id 203
set vlans v203 l3-interface irb.203
set vlans v203 vxlan vni 1203

Simplified WAN router configuration for testing.

The focus of this example is on the configuration and operation of the spine devices for OTT DCI. As a result the WAN underlay is treated opaquely. From the perspective of the spine devices the WAN routers, and whatever complexity is used in the WAN cloud, for example an MPLS-based Layer 3 VPN, is of no concern. The spines simply use their local BGP peering to exchange underlay routes for the loopback addresses used in each DC.

A simplified WAN router configuration is provided to help in testing and to better illustrate the functionality provided by the WAN cloud, from the perspective of the spine devices. Figure 2 provides a topology that can be used for testing with a single routing device acting as a WAN cloud.

Figure 2: A Simplified WAN UnderlayNetwork topology diagram showing connectivity between Data Center 1 and Data Center 2 via WAN underlay. Highlights underlay and overlay ASNs, spine switch IPs, and EBGP routing protocols.
content_copy zoom_out_map
set interfaces xe-0/0/0 unit 0 family inet address 172.16.1.4/31
set interfaces xe-0/0/1 unit 0 family inet address 172.16.1.6/31
set interfaces xe-0/0/2 unit 0 family inet address 172.16.1.8/31
set interfaces xe-0/0/3 unit 0 family inet address 172.16.1.10/31  
set routing-options autonomous-system 65299 
set routing-options forwarding-table export ECMP-POLICY  
set protocols bgp group UNDERLAY authentication-key "samplepassword-fortesting"
set protocols bgp group UNDERLAY export dci
set protocols bgp group UNDERLAY bfd-liveness-detection minimum-interval 350
set protocols bgp group UNDERLAY bfd-liveness-detection multiplier 3
set protocols bgp group UNDERLAY multipath multiple-as
set protocols bgp group UNDERLAY neighbor 172.16.1.9 peer-as 65101
set protocols bgp group UNDERLAY neighbor 172.16.1.11 peer-as 65102
set protocols bgp group UNDERLAY neighbor 172.16.1.7 peer-as 65001
set protocols bgp group UNDERLAY neighbor 172.16.1.7 local-as 65199
set protocols bgp group UNDERLAY neighbor 172.16.1.5 peer-as 65002
set protocols bgp group UNDERLAY neighbor 172.16.1.5 local-as 65199
set policy-options policy-statement dci term 1 from protocol direct
set policy-options policy-statement dci term 1 then accept
set policy-options policy-statement ECMP-POLICY then load-balance per-packet
footer-navigation