Sanog16 Mpls Transport Santanu
Sanog16 Mpls Transport Santanu
Sanog16 Mpls Transport Santanu
Santanu Dasgupta
Why MPLS?
What Is MPLS?
! Multi Protocol Label Switching is a technology for delivery of IP services ! MPLS technology switches packets (IP packets, AAL5 frames) instead of routing packets to transport the data ! MPLS packets can run on other Layer 2 technologies such as ATM, FR, PPP, POS, Ethernet ! Other Layer 2 technologies can be run over an MPLS network
Evolution of MPLS
TDP Labels imp/dis/swap LDP Label Imposition LDP Label Swapping LDP Label Disposition
TE RSVP Integrity TE RSVP Refresh Reduction TE RSVP Reliable Messages TE RSVP Message Authentication TE RSVP Hello State timeout TE MIB
PE-CE RIP, OSPF, STATIC, eBGP, ISIS MPLS VPNs Carrier Supporting Carrier
Int. Peering for CSC & I-AS Load balancing BGP VPN over IP (Biscuit) EIGRP Limit #sredistributed routes VRF Aware HSRP VRF Aware GLBP
VRF Aware Static Labels Static Label (LDP) Static Cross Connect
!! Proposed in IETFlater combined with other proposals from IBM (ARIS), Toshiba (CSR)
TE Node Exclusion List Support TE AutoBandwidth TE AutoBandwidth MPLS VPNs BGP Label Distribution (RFC 3107) MPLS VPNs BGP+LABEL for InterAS & CSC OSPF Sham Link
MPLS Group LDP Auto-enable VRF Lite Formally Chartered LDP Session Protection PE-CE EIGRP by IETF LDP-IGP Sync VRF Select Cisco Calls a LDP inbound label filters BOF at IETF to VRF Aware Static Labels Static Label (LDP) Standardize MD5 TagMPLS Switching
MPLS MD5 Global/Group Config LSP Ping/Traceroute V9 IP SLA Support for LSP Ping/ Traceroute v9 LDP FECs LDP Graceful Restart iBGP & eiBGP Multipath
Cisco Ships iBGP Multipath for CSC & Inter-AS MPLS (Tag Multihop -eBGP support for Inter-AS RT-rewrite at ASBR Switching)
VRF Fall Back Half-duplex VRFs EXP NULL Support with BGP 3 label loadbalance fix CSC/IAS Multipath Interface Peering OSPF Process Limit removal PE Overload Protection
Large Scale MPLS VPN VRF Aware NAT TE Forwarding Adjacency Support Deployment Deployed VRF Aware ODAP TE Overload Avoidance Support AToM Cisco Ships IPv6 Support with MPLS VPNs (6PE) TE Configurable Tunnel Path Calculation MPLS TE VRF Aware AAA TE over ATM PVC Mode
VRF Aware DHCP Relay TE InterArea TE Support VRF Aware IS-IS VRF Aware TFTP VRF Aware Syslog VRF Aware TACACS VRF Aware Firewalls VRF Aware IPSec VRF Aware Bootp Multicast VPNs-Intranet VRF aware Dialer Watch VRF specific static ARP TE over ATM LC-ATM mode
VPN MIB MPLS LSR MIB MPLS TE SNMP Notification TE FRR MIB TE MIB VPN MIB
Layer MPLS 2 LSR MIB Interprovider MPLS TE SNMP Notification Interworking Capabilities
TE FRR MIB
1996
1997
BGP Support for EIGRP PE-CE SOO for EIGRP 2547 over IP (L2TPv3)
1998
1999
2000 Time
2001
Inter-AS TE
2002
2003
2004+
Evolution of MPLS
TDP Labels imp/dis/swap LDP Label Imposition LDP Label Swapping LDP Label Disposition
TE IS-IS Extensions TE OSPF Extensions TE RSVP Extensions TE Autoroute Calculation TE Node Exclusion List Support TE AutoBandwidth TE AutoBandwidth TE InterArea TE Support
VRF Aware Static Labels Static Label (LDP) Static Cross Connect LDP Auto-enable
MPLS LSR MIB More advanced TE Forwarding Adjacency Support MPLS TE SNMP Notification PW concepts TE FRR MIB TE Overload Avoidance Support
VPLS & HLDP inbound label filters VPLS Evolved VRF Aware Static Labels Label (LDP) (L2 Static MP MPLS MD5 Service)
MPLS MD5 Global/Group Config LSP Ping/Traceroute V9 IP SLA Support for LSP Ping/ Traceroute v9 LDP FECs
Path iBGP Multipath for CSC & Inter-AS Computation Multihop -eBGP support for Inter-AS RT-rewrite at ASBR Element
VRF Fall Back Half-duplex VRFs EXP NULL Support with BGP 3 label loadbalance fix CSC/IAS Multipath Interface Peering OSPF Process Limit removal PE Overload Protection BGP Support for EIGRP PE-CE SOO for EIGRP 2547 over IP (L2TPv3)
MPLS P2MP Traffic Transport Advanced TE LSP Attributes MPLS TE SNMP Notification Engineering Profile MPLS TE Verbatim Support TE FRR MIB (MPLS-TP) & Label TE AutoTunnel Mesh groups -ACLs VRF aware Ping/Traceroute OAM Switched TE AutoTunnel Mesh Group-OSPF VCCV verifications Multicast
MPLS LSR MIB TE Link Protection Ethernet OAM UCP O-UNI O-Te TE Node Protection Path Protection SRLG-ISIS SRLG-OSPF Inter-AS TE Static, Policy and Autoroute mapping AToM/CBTS/QoS based routing on to TE
2005-2010 Time
IP+ATM
IP+Optical GMPLS
MPLS
Network Infrastructure
Technology Basics
MPLS Components
Few Components Play Role in Creating MPLS Network:
! IGP: Core Routing Protocol ! MPLS Label ! Encapsulation of MPLS label ! Forwarding Equivalence Class ! Label Distribution Protocol ! MPLS Applications related protocols: MP-BGP, RSVPetc.
3. At Egress Edge:
Label disposition Remove labels and forward packets
PE
Label Switch Router (LSR) or P (Provider) router Router OR ATM switch + label switch controller
0 1 2 3 0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5 6 7 8 9 0 1
Label 20bits
COS S
TTL-8bits
MAC Header
Label
GFC VPI
VCI
PTI
CLP
HEC DATA
Label
10
! IP prefix/host address ! Layer 2 circuits (ATM, FR, PPP, HDLC, Ethernet) ! Groups of addresses/sitesVPN x ! A bridge/switch instanceVSI ! Tunnel interfacetraffic engineering
11
12
2. Ingress Edge LSR Receives Packet, Performs Layer 3 Value-Added Services, and Labels Packets
2006 Cisco Systems, Inc. All rights reserved.
To Enable mpls: ip cef mpls label protocol ldp ! Interface ether0/0 mpls ip
! Downstream on-demand
!! Upstream node requests a label for a learnt prefix via the downstream node !! Next exampleATM MPLS
14
128.89 0 1 1 128.89.25.4 Data 128.89.25.4 Data 171.69 0 128.89.25.4 Data 128.89.25.4 Data
15
0 1 0
128.89
171.69
16
MPLS with Downstream Unsolicited Mode Step II: Assigning Local Labels
In Address Label Prefix 128.89 171.69 Out Out Iface Label 1 1 In Address Label Prefix 4 5 128.89 171.69 Out Out Iface Label 0 1 In Address Label Prefix 9 128.89 Out Out Iface Label 0 -
0 1 0
128.89
171.69
17
MPLS with Downstream Unsolicited Mode Step II: Assigning Remote Labels
In Address Label Prefix 128.89 171.69 Out Out Iface Label 1 1 4 5 In Address Label Prefix 4 5 128.89 171.69 Out Out Iface Label 0 1 9 7 In Address Label Prefix 9 128.89 Out Out Iface Label 0 -
0 1 0
128.89
171.69
18
0 0
128.89 Data
171.69
19
Label Information Base (LIB) Per-Label Forwarding, Queuing, and Multicast Mechanisms
2006 Cisco Systems, Inc. All rights reserved. 20
LIB
MPLS Process
MFI
FIB
MPLS Traffic
IP Traffic
21
Label Stacking
! There may be more than one label in an MPLS packet ! As we know labels correspond to forwarding equivalence classes
!! Examplethere can be one label for routing the packet to an egress point and another that separates a customer A packet from customer B !! Inner labels can be used to designate services/FECs, etc. ! e.g. VPNs, fast reroute Outer Label TE Label LDP Label VPN Label
! Outer label used to route/switch the MPLS packets in the network ! Last label in the stack is marked with EOS bit ! Allows building services such as
!! MPLS VPNs !! Traffic engineering and fast re-route !! VPNs over traffic engineered core !! Any transport over MPLS
2006 Cisco Systems, Inc. All rights reserved.
22
Encapsulation Examples
Label
0 1 2 3 0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5 6 7 8 9 0 1
COS S
TTL
DataLink Header
Outer Label
Inner Label
Layer 3 Header
Ethernet II Destination: xx:xx:xx:xx:xx:xx Source: yy:yy:yy:yy:yy:yy eType: MPLS Unicast (0x8847) WAN HDLC, Frame Relay, ATM AAL5, etc
MultiProtocol Label Switching Header (Outer) MPLS Label: 16 MPLS Experimental Bits: 0 MPLS Bottom Of Label Stack: 0 MPLS TTL: 255 MultiProtocol Label Switching Header (Inner) MPLS Label: 100 MPLS Experimental Bits: 3 MPLS Bottom Of Label Stack: 1 MPLS TTL: 2
Internet Protocol Version: 4 Header length: 20 bytes [snip] Time to live: 255 Protocol: ICMP (0x01) Header checksum: 0xa3fd (correct) Source: 10.1.1.2 (10.1.1.2) Destination: 172.16.255.2 (172.16.255.2)
23
Label Stack
[PE1]#show ip cef vrf blue 11.2.1.3 11.2.1.3/32, version 13, epoch 0, cached adjacency to Serial1/0 0 packets, 0 bytes tag information set, all rewrites owned local tag: VPN route head fast tag rewrite with Se1/0, point2point, tags imposed {46 67} via 172.16.255.2, 0 dependencies, recursive next hop 172.16.1.1, Serial1/0 via 172.16.255.2/32 (Default) valid cached adjacency tag rewrite with Se1/0, point2point, tags imposed {46 67} [PE1]#
2-2
2006 Cisco Systems, Inc. All rights reserved. 24
MPLS VPNs
25
L2 vs. L3 VPNs
Layer 2 VPNs
! ! ! Customer endpoints (CPE) connected via Layer 2 such as Frame Relay DLCI, ATM VC or point-to-point connection Provider network is not responsible for distributing site routers as routing relationship is between the customer endpoints Good for point to point L2 connectivity, provider will need to manually fully mesh end points if any-to-any connectivity is required
Layer 3 VPN
!! Customer end points peer with providers routers @ L3 !! Provider network responsible for distributing routing information to VPN sites !! Dont have to manually fully mesh customer endpoints to support any-to-any connectivity
27
Layer 3 VPNs
28
Multicast
VPN B Intranet
VoIP
VPN A VPN A VPN B VPN C VPN A VPN B VPN C
Hosting
Extranet
Overlay VPN
! ! ! ! ! ! ! ! ACLs, ATM/FR, IP tunnels, IPSec, etc. requiring n*(n-1) peering points Transport dependent Groups endpoints, not groups Pushes content outside the network Costs scale exponentially NAT necessary for overlapping address space Limited scaling QoS complexity
MPLS-Based VPNs
! ! ! ! ! ! ! ! Point to Cloud single point of connectivity Transport independent Easy grouping of users and services Enables content hosting inside the network Flat cost curve Supports private overlapping IP addresses Scalable to over millions of VPNs Per VPN QoS
29
CE4
CE3
VRF P1 LDP P2 LDP PE3 iBGPVPNv4 PE2 VRF
VRF PE1
LDP iBGPVPNv4
VRF
CE1
1.! VPN service is enabled on PEs (VRFs are created and applied to VPN site interface) 2.! VPN sites CE1 connects to a VRF enabled interface on a PE1 3.! VPN site routing by CE1 is distributed to MP-iBGP on PE1 4.! PE1 allocates VPN label for each prefix, sets itself as a next hop and relays VPN site routes to PE3 9.! PE3 distributes CE1s routes to CE2 (Similar happens from CE2 side)
2006 Cisco Systems, Inc. All rights reserved.
CE2
30
CE1
IGP/eBGP Net=16.1/16
P1
P2
IGP/eBGP Net=16.1/16
CE2 PE2
PE1
ip vrf Yellow RD 1:100 route-target export 1:100 route-target import 1:100
P1 PE1
! Interface S1/0 ip vrf forwarding Yellow !
P2 PE2
CE2
IPv4 CE2 Receives IPv4 Packet
1.!PE1 imposes pre allocated label for the prefix 2.!Core facing interface allocates IGP label 3.!Core swap IGP labels 4.!PE2 strips off VPN label and forwards the packet to CE2 as an IP packet
32
CISCO MPLS-BASED VPNS: EQUIVALENT TO THE SECURITY OF FRAME RELAY AND ATM
MIERCOM STUDY
33
VPN A
Multicast Receiver VPNa
VPN A
VPN A
!! Criticality of more than selling connectivity !! Run multicast within an MPLS VPN !! native multicast deployment in the core !! Simplified CE provisioning !! Highly Efficient Multicast trees built dynamically in the core as needed
2006 Cisco Systems, Inc. All rights reserved. 34
CustomerA
PE1 FR/ATM
HQ VPN A
VM
P2
PE2
Branch Office
Local or Direct Dial ISP Remote Users/ Telecommuters
VM
Provider Networks
MPLS to IPsec/PE
Customer A VPN B
Internet PE3
VM
35 35
Deployment Example II: MPLS VPN Subscriber with VPNs in Campus That Spans Across SPs MPLS VPN Network C1-Hub Site
L2
Egress PE
Ingress PE
CE
Layer 3
L2
36
! L2 Access ! Multi-VRF-CE at Distribution ! BGP/MPLS VPNs in core only ! Multi-VRF between core and distribution
PE w/VRF
MP-iBGP VPN1 VPN2 802.1Q BGP/MPLS VPN
2006 Cisco Systems, Inc. All rights reserved.
L2 P Layer 3 L2
37
Deployment Example IV: Full MPLS VPN in Enterprise WAN + Subscribed MPLS VPNs
Enterprise-A Data Center 1
Enterprise Owned MPLS International WAN
Layer 2 VPNs
39
Layer 2 VPNs
Similar to L3 VPN
! Designate a label for the circuit ! Exchange that label information with the egress PE ! Encapsulate the incoming traffic (Layer 2 frames) ! Apply label (learned through the exchange) ! Forward the MPLS packet (l2 encapsulated to destination on an LSP) ! At the egress
!! Look up the L2 label !! Forward the packet onto the L2 attachment circuit
40
VPN A
1. L2 transport route entered on ingress PE!
CE1
2. PE1 starts LDP session with PE2 if one does not already exist!
VPN A
CE2 PE2
5. PE2 receives VC FEC TLV & VC label TLV that matches local VCID!
PE1
3. PE1 allocates VC label for new interface & binds to congured VC ID!
4. PE1 sends label mapping message containing VC FEC TLV & VC label TLV!
Note: PE2 repeats steps 1-5 so that bi-directional label/VCID mappings are established!
Draft Martini compliant (point-to-point): draft-martini-l2circuit-trans-mpls describes label distribution mechanisms for VC labels draft-martini-l2circuit-encap-mpls describes emulated VC encapsulation mechanisms
2006 Cisco Systems, Inc. All rights reserved. 41
Frame Relay
CPE Router, FRAD
PE1 Config:
MPLS Backbone
MPLS LSP
Frame Relay
CPE Router, FRAD
PE2 Config: connect FR1 serial5/0 201 l2transport mpls l2transport route 1.1.1.1 1
AtoM Tunnel
VC1Connects DLCI 101 to DLCI 201 VC2Connects DLCI 102 to DLCI 202
2006 Cisco Systems, Inc. All rights reserved.
42
MPLS Backbone
PE2 PE
CE2
ATM
CPE Routers
CPE Routers
43
102 PE1
Root Bridge
MAC 1
MAC 2
Data PE2
Root Bridge
CE1
MAC 1
Common VC ID between PEs creates a Virtual Switching Instance
CE2 MAC 2
PE3
Root Bridge
MAC Address Adj MAC 2 MAC 1 MAC x ! 201 E0/0 xxx CE3 Data MAC 1 MAC 2 201
VPLS defines an architecture that delivers Ethernet Multipoint Services (EMS) over an MPLS network ! VPLS operation emulates an IEEE Ethernet bridge. Two VPLS drafts in existence !! Draft-ietf-l2vpn-vpls-ldp-01 " Ciscos implementation !! Draft-ietf-l2vpn-vpls-bgp-01
2006 Cisco Systems, Inc. All rights reserved. 44
192.168.11.25/24
192.168.11.2/24
192.168.11.12/24
H-VPLS
! ! ! Two tier hierarchy MPLS or Ethernet edge MPLS core
H-VPLS
u-PE PE-CLE MTU-s
GE
PW
MPLS Core
MPLS Edge
45
Full Mesh of PWs Between VSIs n-PE Blue VSI Red VSI (Common VC ID between PEs creates a VSI)
Legend
CE n-PE VSI PW Tunnel LSP - Customer Edge Device - network facing-Provider Edge - Virtual Switch Instance - Pseudo-Wire - Tunnel Label Switch Path that provides PW transport
46
47
! Capacity planning
!! TE improves aggregate availability of the network
2006 Cisco Systems, Inc. All rights reserved. 48
49
! Traffic engineering
!! Headend-based !! Accounts for available link bandwidth !! Admission control
50
R1 R6
R7
IP (Mostly) Uses Destination-Based Least-Cost Routing Flows from R8 and R1 Merge at R2 and Become Indistinguishable From R2, Traffic to R3, R4, R5 Use Upper Route Alternate Path Under-Utilized
2006 Cisco Systems, Inc. All rights reserved. 51
!! Some links are DS3, some are OC-3 !! Router A has 40mb of traffic for Router F, 40mb of traffic for Router G !! Massive (44%) packet loss at Router B!Router E!
!! Changing to A->C->D->E wont help
Router A
OC-3 DS3
OC-3
Router E Router G
OC-3
Router C
2006 Cisco Systems, Inc. All rights reserved.
DS3 DS3
Router D
OC-3
52
! Router A sees all links ! Router A computes paths on properties other than just shortest cost ! No link oversubscribed!
Router F
Router A
OC-3 DS3
OC-3
Router E Router G
OC-3
Router C
2006 Cisco Systems, Inc. All rights reserved.
40Mb
DS3
Router D
DS3
OC-3
53
Upstream
2006 Cisco Systems, Inc. All rights reserved.
Unidirectional Tunnel
Downstream
54
Information Distribution
! You need a link-state protocol as your IGP
!! IS-IS or OSPF
55
PATH
TE Headend
PATH
TE Tailend
! PATH messages are sent with requested bandwidth (&label) ! RESV messages are sent with label bindings for the TE tunnel ! Tunnels can be explicitly routed ! Admission control at each hop to see if the bandwidth requirement can be met
2006 Cisco Systems, Inc. All rights reserved.
!! Policy route
56
R9
R5
R6
! Multiple hops can be by-passed; R2 swaps the label which R4 expects before pushing the label for R6 ! R2 locally patches traffic onto the link with R6
2006 Cisco Systems, Inc. All rights reserved. 57
Link Protection
Router A Router B Router D Router E
Router X Router C
Router Y
Node Protection
Router A Router B Router D Router E Router F
Router X Router C
Router Y
59
TE Deployment Scenarios
60
Tactical TE Deployment
Requirement: Need to Handle Scattered Congestion Points in the Network Solution: Deploy MPLS TE on Only Those Nodes That Face Congestion
MPLS Traffic Engineering Tunnel Relieves Congestion Points Bulk of Traffic Flow e.g. Internet Download
Internet
61
1-Hop TE Deployment
Requirement: Need Protection OnlyMinimize Packet Loss Lots of Bandwidth in the Core Solution: Deploy MPLS Fast Reroute for Less than 50ms Failover Time with 1-Hop Primary TE Tunnels and Backup Tunnel for Each
VPN Site B
63
VPN Site A
Central Site
64
MPLS TE Summary
! Useful for rerouting traffic in congested environments ! Build innovative services like virtual leased line ! Build protection solutions using MPLS FRR
65
MPLS Management
66
External-Focused Operations
67
! MPLS OAM
! LSP Ping, Trace, and Multipath (ECMP) Tree Trace ! IP SLA LSP Health Monitor
2006 Cisco Systems, Inc. All rights reserved. 68
LSP Ping
! Feature Functionality
! Enables detailed MPLS data path validation between PE routers
! Benefits
! Finds MPLS-specific forwarding errors not detected by regular IP ping operations ! Enables detailed MPLS forwarding trouble shooting not available by other existing IP connectivity validations tools
69
LSP Trace
! Feature Functionality
! Enables hop-by-hop trouble shooting (fault isolation) along PE-PE LSP path in MPLS network
! Benefits
! Finds MPLS-specific forwarding failures along PE-PE LSP path, which can not be detected by regular IP traceroute operations
70
! Benefits
! Detailed discovery of all MPLS (LSP) paths between PE routers which can not be detected by regular IP traceroute operations
71
! Benefits
! Detailed control over LSP ping probe frequency (primary and secondary frequency) and event control (e.g., Traps, logging) after MPLS LSP connectivity failure has been detected ! Automated discovery of remote PE target routers via BGP VPN next-hop discovery
72
CE
IP SLA
CE
PE1
IP SLA
IP SLA agent Automated LSP pings sent by PE1 Automated LSP pings sent by PE2 Automated LSP pings sent by PE3
PE50 PE3
IP SLA
CE
73
Summary
74
75