Mpls Oam Tutorial
Mpls Oam Tutorial
Mpls Oam Tutorial
Sam K Aldrin
[email protected]
NANOG55
Agenda
Introduction
Terms and Terminology
An Introduction to Tools
Introduction to MPLS
MPLS TP 101
Troubleshooting MPLS
MPLS OAM
LSP Ping
ECMP troubleshooting
BFD for MPLS
Tools Galore
NANOG55
What is OAM
Means different things to different people and
organizations.
Worst, some times it means different things to
different people within the same organization
IETF standardized the meaning of OAM within the
IETF
June 2011, RFC 6291
NANOG55
NANOG55
NANOG55
Agenda
Introduction
Terms and Terminology
An Introduction to Tools
Introduction to MPLS
MPLS TP 101
Troubleshooting MPLS
MPLS OAM
LSP Ping
ECMP troubleshooting
BFD for MPLS
June 3-6,
Tools
Galore
2012
NANOG55
Important Terminologies
Before we dive deeper, it is important to
understand some of the terminologies and their
meanings
What are they ?
Various organizations (IEEE, ITUT, IETF) all have their
version
We will discuss here selected set of definitions from
RFC 5860, RFC 6371 and draft-ietf-opsawg-oamoverview-05
NANOG55
Important Terminologies
Maintenance Point (MP)
Is a functional entity that is defined within a node that either
initiate or react to a OAM message
Relationship of MP
(ME)
(MEP)
(MIP)
(MIP)
(MEP)
B
traceroute to B
Request
Response
NANOG55
Connectivity Verification
Ability of an endpoint to verify it is connected to a specific endpoint.
(BFD,Ping)
Route Tracing
This is also known as path tracing, allows to identify the path taken
from one MEP to another MEP (traceroute)
Fault Verification
Exercised on demand to validate the reported fault. (Ping)
Fault Isolation
Localizing and isolating the failure domain/point (traceroute)
Performance
Includes Packet Loss Measurements and Packet Delay
Measurements
E.g. IP Performance Metrics (IPPM) (RFC 2330)
June 3-6, 2012
NANOG55
10
Agenda
Introduction
Terms and Terminology
An Introduction to Tools
Introduction to MPLS
MPLS TP 101
Troubleshooting MPLS
MPLS OAM
LSP Ping
ECMP troubleshooting
BFD for MPLS
Tools Galore
NANOG55
11
Ping
Ping refers to tools that allows to detect liveliness of a
remote host
Most commonly known Ping is based on ICMP Echo
Request and Response
Security policies and firewalls sometimes prevent
forwarding of ICMP messages.
UDP/TCP version of the Ping has surfaced to circumvent
barriers introduced by security policies and Firewalls on
ICMP Echo Requests
RFC 4379 use UDP port 3503 for LSP Ping
Different implementations of Ping has different options
June 3-6, 2012
NANOG55
12
Traceroute
Design to trace the path taken from a node A to a
node B.
Probe packets are generated with monotonically
increasing TTL value
Forcing ICMP TTL expiry message from each
intermediate node.
In Linux Echo request packet is UDP (default
destination port is UDP:33434)
In some other platforms it can be ICMP Echo
request.
June 3-6, 2012
NANOG55
14
NANOG55
15
traceroute
2
1. ICMP_TME_EXCEED
1. Echo Req, TTL=1
3. Echo Req,TTL=3
4. ICMP_TME_EXCEED
3. ICMP_TME_EXCEED
4. Echo Req, TTL=4
NANOG55
16
Challenges
Over the years networking has evolved with that
comes OAM challenges
NANOG55
17
NANOG55
18
ECMP
Ping From A to B
User Data A to B with
UDP Src/Dest Port X/Y
A
User Data A to B with
UDP Src/Dest Port A/B
NANOG55
19
A
User Data A to B with
UDP Src/Dest Port A/B
3
Can not utilize end-end connectivity
tools to quickly detect the failure
May need to wait until control protocol
time-out
If it is an oversubscribed link that causing
intermittent traffic drops, protocols would
not timeout
NANOG55
20
A
User Data A to B with
UDP Src/Dest Port A/B
Challenges:
Ingress Node (A) may not even know how many ECMP from intermediate node (1)
Monitoring probes SHOULD take the same path as the normal data
Different vendors utilize different hash algorithms in selection ECMP paths
NANOG55
21
ECMP challenges
Conclusion
No standard method to exercise end-end
continuity and connectivity verifications that
covers all of the ECMP in IP networks
NANOG55
22
Agenda
Introduction
Terms and Terminology
An Introduction to Tools
Introduction to MPLS
MPLS TP 101
Troubleshooting MPLS
MPLS OAM
LSP Ping
ECMP troubleshooting
BFD for MPLS
Tools Galore
NANOG55
23
What is MPLS
NANOG55
25
Agenda
Introduction
Terms and Terminology
An Introduction to Tools
Introduction to MPLS
MPLS TP 101
Troubleshooting MPLS
MPLS OAM
LSP Ping
ECMP troubleshooting
BFD for MPLS
June 3-6,
Tools
Galore
2012
NANOG55
26
What is MPLS-TP
MPLS
RFC 5654
MPLS TP
NANOG55
27
NANOG55
28
MPLS- TP
Reliability and
Resiliency
OAM Requirements
In band OAM
Loss and delay
measurements for
SLA
Fault notification
and Alarm
indication
NANOG55
29
Agenda
Introduction
Terms and Terminology
An Introduction to Tools
Introduction to MPLS
MPLS TP 101
Troubleshooting MPLS
MPLS OAM
LSP Ping
ECMP troubleshooting
BFD for MPLS
Tools Galore
NANOG55
30
NANOG55
31
NANOG55
32
ICMP ping
X
LSP
PE1
P1
P2
L0:10.10.10.10
P3
PE2
L0:20.20.20.20
ICMP ping emulates the data but can only verify IP layer
It cannot verify if MPLS path is broken but IP is working
It cannot verify ECMP
It cannot validate control plane to data plane
It cannot verify various MPLS control plane protocols
It cannot verify for unlabelled interface, black-holes, control
plane to data plane mismatch, etc.
NANOG55
33
->label 60
->label 70
->Pop
LSP
PE1
L0:10.10.10.10
P1
P2
P3
X
PE2
L0:20.20.20.20
Agenda
Introduction
Terms and Terminology
An Introduction to Tools
Introduction to MPLS
MPLS TP 101
Troubleshooting MPLS
MPLS OAM
LSP Ping
ECMP troubleshooting
BFD for MPLS
Tools Galore
NANOG55
35
NANOG55
36
Agenda
Introduction
Terms and Terminology
An Introduction to Tools
Introduction to MPLS
MPLS TP 101
Troubleshooting MPLS
MPLS OAM
LSP Ping
ECMP troubleshooting
BFD for MPLS
Tools Galore
NANOG55
37
LSP ping
Requirements
Detect LSP failures
Detect label mismatch
Detect CP to DP mismatch
Pin point the failure
Detect MTU failures
Applications
Verify all MPLS FEC types
Verify PE, P, MPLS TP devices
Ability to verify MPLS VPN,
TE, LDP, TP, P2MP, etc., LSPs.
June 3-6, 2012
Solution
LSP ping to detect
connectivity checks
LSP ping based traceroute for
path verification
LSP ping based topology tree
verification
Standards
RFC4379 and all other
extensions
NANOG55
38
NANOG55
39
Length
Value field
17
20
56
Not Assigned
13
25
14
L2 VPN endpoint
10
10
14
FEC 128 PW
11
16+
FEC 129 PW
12
13
17
14
15
June 3-6,
162012
40
NANOG55
41
Meaning
-------
-----------
No return code
DSMAP mismatch
Reserved
10
Mapping for this FEC is not the given label at stack depth <RSC>
11
12
13
NANOG55
42
NANOG55
43
NANOG55
44
Downstream Mapping
15
23
31
Downstream Router ID
MTU
Addr Type
DS Index
Depth Limit
MultiPath Length
Protocol
.
Downstream Label
DSMAP TLV
Protocol
0
7
MTU
15
23
Addr Type
31
DS Flags
NANOG55
45
E0/0:10.131.151.1
50
E0/0:10.131.161.1
60
E0/1:10.131.151.2
PE1
PE1 Downstream for
PE2
MTU: MRU of E0/0
Address type: 1
DS Intf Addr:
10.131.151.1
DS Label : 50
E0/0:10.131.171.1
3
E0/1:10.131.161.2
P1
P2
P1 Downstream for
PE2
MTU: MRU of E0/0
Address type: 1
DS Intf Addr:
10.131.161.1
DS Label : 60
E0/1:10.131.171.2
PE2
P2 Downstream for
PE2
MTU: MRU of E0/0
Address type: 1
DS Intf Addr:
10.131.171.1
DS Label : 3
NANOG55
46
Theory of Operation
LSP
60
50
127/8
SA
SA
127/8
Echo Req
SA
127/8
Echo Req
Echo Req
60
50
P1
P2
PE1
PE2
SA
127/8
Echo Reply
NANOG55
47
SA
50
127/8
SA
127/8
Echo Req
Echo Req
60
50
P1
PE1
SA
127/8
P2
Echo Reply
PE2
NANOG55
48
PE1
127/8
70
50
PE1
127/8
Echo Req
60
Echo Req
P2
3
50
PE
1
P1
70
P2
PE1
Echo Reply
PE2
49
Label TTL: 3
Label TTL: 1
E0/0:10.131.151.1
50
E0/0:10.131.161.1
E0/1:10.131.151.2
PE1
60
E0/0:10.131.171.1
E0/1:10.131.161.2
P1
P1 Downstream for
PE2
MTU: MRU of E0/0
Address type: 1
DS Intf Addr:
10.131.161.1
DS Label : 60
P2
E0/1:10.131.171.2
PE2
P2 Downstream for
PE2
MTU: MRU of E0/0
Address type: 1
DS Intf Addr:
10.131.171.1
DS Label : 3
LSP Ping with TTL is used to validate every hop of the LSP
Downstream TLV is used to validate and request downstream info
If the responding router is Egress of the FEC, a return code of 3 is
returned.
JuneNo
DSMAP TLV is sent in the NANOG55
response by Egress router for the FEC
3-6, 2012
50
Agenda
Introduction
Terms and Terminology
An Introduction to Tools
Introduction to MPLS
MPLS TP 101
Troubleshooting MPLS
MPLS OAM
LSP Ping
ECMP troubleshooting
BFD for MPLS
Tools Galore
NANOG55
51
P3
E0/0
E1/0
E0/0
E1/0
E2/0
E0/0
E0/0
E0/0
E1/0
E2/0
E1/0
PE1
P1
E1/0
E1/0
E0/0
E2/0
E2/0
P4
P5
PE2
PE1
1
TTL = 1
DA: 127.0.0.0
MapSize/hash:
32/8
Bitmap:0xFFFF
NANOG55
52
P3
E0/0
E1/0
E0/0
E1/0
E2/0
E0/0
E0/0
E1/0
E2/0
E1/0
PE1
PE1
1
TTL = 1
DA: 127.0.0.0
MapSize/hash:
32/8
Bitmap:0xFFFF
E0/0
P1
E1/0
E1/0
E0/0
E2/0
E2/0
P4
P5
PE2
P1
2
MultiPath1
[E0/0]
Bitmap: 0x00FF
Multipath2[E2/0]
Bitmap: 0xFF00
NANOG55
53
P3
E0/0
E1/0
E0/0
E1/0
E2/0
E0/0
E0/0
E1/0
E2/0
E1/0
PE1
E0/0
P1
E1/0
E1/0
E0/0
E2/0
E2/0
P4
P5
PE2
PE1
3
TTL = 2
DA: 127.0.0.24
Mapsize/Hash:
32/8
Bitmap:0x00FF
NANOG55
54
P3
E0/0
E1/0
E0/0
E1/0
E2/0
E0/0
E0/0
E1/0
E2/0
E1/0
PE1
PE1
3
TTL = 2
DA: 127.0.0.24
Mapsize/Hash:
32/8
Bitmap:0x00FF
E0/0
P1
E1/0
E1/0
E0/0
E2/0
E2/0
P4
P5
PE2
P2
MultiPath1 [E0/0]
Bitmap: 0x00FF
4
NANOG55
55
P3
E0/0
E1/0
E0/0
E1/0
E2/0
E0/0
E0/0
E0/0
E1/0
E2/0
E1/0
PE1
P1
E1/0
E1/0
E0/0
E2/0
E2/0
P4
P5
PE2
PE1
5
TTL = 3
DA: 127.0.0.24
Mapsize/hash:
32/8
Bitmap:0x00FF
NANOG55
56
P3
E0/0
E1/0
E0/0
E1/0
E2/0
E0/0
E0/0
E0/0
E1/0
E2/0
E1/0
PE1
P1
E0/0
E2/0
E2/0
P4
PE2
P5
P3
MultiPath1
[E0/0]
Bitmap: 0x00FF
PE1
5
TTL = 3
DA: 127.0.0.24
Mapsize/hash:
32/8
Bitmap:0x00FF
E1/0
E1/0
NANOG55
57
P3
E0/0
E1/0
E0/0
E1/0
E2/0
E0/0
E0/0
E0/0
E1/0
E2/0
E1/0
PE1
P1
E1/0
E1/0
E0/0
E2/0
E2/0
P4
P5
PE2
PE1
7
TTL = 4
DA: 127.0.0.24
Mapsize/Hash:
32/8
Bitmap:0x00FF
NANOG55
58
P3
E0/0
E1/0
E0/0
E1/0
E2/0
E0/0
E0/0
E0/0
E1/0
E2/0
E1/0
PE1
P1
E0/0
E2/0
E2/0
P4
PE1
7
TTL = 4
DA: 127.0.0.24
Mapsize/Hash:
32/8
Bitmap:0x00FF
E1/0
E1/0
P5
PE2
PE2
Egress of the FEC
8
NANOG55
59
P3
E0/0
E1/0
E0/0
E1/0
E2/0
E0/0
E0/0
PE1
1
TTL = 1
DA: 127.0.0.0
MapSize/hash: 32/8
Bitmap:0xFFFF
3
PE1
TTL = 2
DA: 127.0.0.24
Mapsize/Hash: 32/8
Bitmap:0x00FF
PE1
5
TTL = 3
DA: 127.0.0.24
Mapsize/hash: 32/8
Bitmap:0x00FF
7
PE1
TTL = 4
DA: 127.0.0.24
Mapsize/Hash: 32/8
Bitmap:0x00FF
E1/0
E1/0
E2/0
E1/0
PE1
E1/0
E0/0
9
PE1
TTL = 2
DA: 127.0.0.0
Mapsize/Hash: 32/8
Bitmap:0xFF00
11
PE1
TTL = 3
DA: 127.0.0.0
Mapsize/Hash: 32/8
Bitmap:0xF000
PE1
13
TTL = 4
DA: 127.0.0.0
Mapsize/Hash: 32/8
Bitmap:0xF000
E2/0
E2/0
P1
P1
MultiPath1 [E0/0]
Bitmap: 0x00FF
Multipath2[E2/0]
Bitmap: 0xFF00
E0/0
P4
2
P2
MultiPath1 [E0/0]
Bitmap: 0x00FF
P4
MultiPath1 [E0/0]
Bitmap: 0xF000
MultiPath2 [Eth2/0]
Bitmap: -0x0F00
15
PE1
TTL = 3
DA: 127.0.0.4
Mapsize/Hash: 32/8
Bitmap:0x0F00
PE2
P5
10
P3
MultiPath1 [E0/0]
Bitmap: 0x00FF
P3
MultiPath1 [E0/0]
Bitmap: 0xF000
P5
MultiPath1 [E0/0]
Bitmap: 0x0F00
PE2
Egress of the FEC
12
PE2
Egress of the FEC
16
PE2
Egress of the FEC
14
18
PE1
17
TTL = 4
DA: 127.0.0.4
Mapsize/Hash: 32/8
Bitmap:0x0F00
NANOG55
60
LSP Ping
LSP Trace
ECMP Trace
Yes
Yes
Yes
RSVP TE v4 and
v6
Yes
Yes
N/A
PW v4 and v6
Yes
MSPW(Yes)
Entropy Label
VPN v4 and v6
Yes
Yes
N/A
BGP v4 and v6
Yes
Yes
N/A
P2MP TE and
mLDP
Yes
Yes
N/A
MPLS-TP
Yes
Yes
N/A
NANOG55
61
Solution
Applications
Solution
June 3-6, 2012
62
Agenda
Introduction
Terms and Terminology
An Introduction to Tools
Introduction to MPLS
MPLS TP 101
Troubleshooting MPLS
MPLS OAM
LSP Ping
ECMP troubleshooting
BFD for MPLS
Tools Galore
NANOG55
63
NANOG55
64
NANOG55
65
NANOG55
66
NANOG55
67
MEP
MIP
MEP
LSP Ping
BFD
LSP Ping
BFD
LSP Ping
BFD
68
Agenda
Introduction
Terms and Terminology
An Introduction to Tools
Introduction to MPLS
MPLS TP 101
Troubleshooting MPLS
MPLS OAM
LSP Ping
ECMP troubleshooting
BFD for MPLS
Tools Galore
NANOG55
69
Tools
CC and CV for MPLS networks using LSP Ping
Fault Isolation using traceroute with LSP Ping
Performance monitoring based on Y.1731 model
1:1, 1+1, 1:n and m:n protection supported using BFD
All FEC types supported using LSP ping
Provides support for IPv4 and IPv6
Automated tools built around LSP ping and other OAM
tools
No CCIE expertise required to use these tools
NANOG55
70
Connectivity
Verification
Path
Discovery
Echo (Ping)
Traceroute
Defect
Performance
Indications Monitoring
LSP Ping
Ping
Traceroute
IPPM
MPLS-TP
OAM
-Delay
- Packet loss
CC
CV
Traceroute -Alarm
Reporting
- Client
failure Ind
- Remote
Defect
-Delay
- Packet loss
Ref: draft-ietf-opsawg-oam-overview-05
June 3-6, 2012
NANOG55
71
Summary
NANOG55
72
Summary
MPLS OAM covers all types of MPLS networks
No CCIEs required to manage MPLS networks
Already built into major vendors MPLS devices
Deployed and being used in major carrier networks
Inter-op tests carried out at various labs prove the OAM
technologies WORK
MPLS-TP brought forth the usefulness of OAM in
transport networks
MPLS OAM a proven technology
NANOG55
73
Questions
NANOG55
74