Tecspg 2435

Routing Optical Networking Technical
Deep Dive
Brad Riapolov, Technical Solutions Architect
Emerson Moura, Distinguished Sales Architect
Valerio Viscardi, Principal Sales Architect
Kent Dailey, Technical Solutions Architect
(Dirk Schroetter, Technical Solutions Architect, contributor)
TECSPG-2435
Cisco Webex App
Questions?
Use Cisco Webex App to chat
with the speaker after the session
How
1 Find this session in the Cisco Live Mobile App
2 Click “Join the Discussion”
3 Install the Webex App or go directly to the Webex space Enter your personal notes here
4 Enter messages/questions in the Webex space
Webex spaces will be moderated

until February 24, 2023.
TECSPG-2435 © 2023 Cisco and/or its affiliates. All rights reserved. Cisco Public 2
Complete your Session Survey
• Please complete your session survey
after each session. Your feedback
is very important.
• Complete a minimum of 4 session
surveys and the Overall Conference
survey (open from Thursday) to
receive your Cisco Live t-shirt.
• All surveys can be taken in the Cisco Events Mobile App or
by logging in to the Session Catalog and clicking the
"Attendee Dashboard” at
https://www.ciscolive.com/emea/learn/sessions/session-
catalog.html
Continue
Agenda Your Education
Visit the Cisco Showcase for related demos.
Book your one-on-one Meet the Engineer meeting.
Attend any of the related sessions at the DevNet,

Capture the Flag, and Walk-in Labs zones.
Visit the On-Demand Library for more sessions

at ciscolive.com/on-demand.
Agenda
• Defining Routing Optical Networking
• Realizing Routing Optical Networking
• Minimize Transponders
• Simplify ROADMs
• Modernize Control Plane
• Eliminate OTN
• Integrating DCO’s into existing and multi-vendor networks

• Getting started and Network Modeling considerations
• Conclusion
Defining Routed
Optical
Networking
Why are we here
“The Cisco Routed Optical Networking solution converges the IP
packet and optical layers into a simpler, more operationally
efficient network, granting streamlined planning, design,
activation, troubleshooting, and management. Reducing the
number of devices in the network:
- enhances resiliency
- increases availability
- and economically optimizes fiber capacity
You can construct this solution with Cisco products available
today.”
Routed Optical Networking 400ZR/ZR+
QSFP-DD DCO
Pluggable Optics
75GHz min.
width DWDM:
ROADM, FOADM
or Terminals
L3 VPN
L2 VPN
L1 PLE* 400GE Capable
Router: Modular,
*PLE: Private Line Emulation Fixed (from 1RU)
Why Routers with Coherent Pluggables?
Extended 50% Fewer

End-to-End IP Flexibility
Reach Devices
Today’s 400G and Better ROI and TCO Pluggable

200G Pluggables Reduced installation QSFP-DD and CFP2
support longer One OS (IOS-XR) and integration costs DCO Modules
distances with
embedded Digital SR EVPN End-to-End Reduced Failure Simplified network
Coherent Optics Domain, easier design
Troubleshooting
Campus – Metro –
True Pay as you Need
Regional – Long-
(Flexible
Haul Applications
Consumption)
Shift in Economics & Technology Evolution
Optics & Routing
Devices vs Pluggables Cost Optical Systems Evolution Routing Bandwidth Scale
Subsea
Chassis
DCI
Ratio: Router port cost < Optic cost Chassis Based Solutions → Pluggables NPU capacity> Projected Traffic Demand
Historical Economics
Things change…
COST
IPIP
ROUTING
ROUTING
L2
L2Switching
Switching
TDM Switching
Lambda
Lambda
Switching
Switching
Historical Economics
New Paradigm…
COST
IP ROUTING
Silicon
L2 Switching
TDM Switching
Optics
Lambda
Switching
COST
Transitioning Networks to be simpler
is Routed Optical Networking
Networks Today Network Tomorrow
Packet Packet
Services Services
Private Private
Line Line
Services Services
Wave Wave
Services Services
• Lots of complexity • Much simpler

• Inefficient • More efficient
• Hard to manage and operate • Easier to manage
• One span at a time
Benefits of a Routed Optical Network
Analysts project massive savings
Converges all services onto a single network layer
Eliminates siloed IP & Optical operational layers
Integrates transponders and “grey” optics
Integrates OTN Services and ROADMs
Space, power and operational savings
Shorter Time-to-Market for services
Source: ACG Research
Why QSFP-DD is successful
System Density
QSFP-DD addresses 4 pillars LC Faceplate Densities of 32/36 Ports
necessary for a pluggable
module to succeed Superior Performance
All optical/copper reaches supportable,
including DCO 400-ZR/P for DWDM
Applications with a view to 800G
Investment Protection
QSFP28
Backwards compatibility enables smooth
QSFP-DD network transition allowing reuse of the
$9B investment the industry has already
made in QSFP modules
Standards-based Adoption
Wide alignment across the
Industry
Back of the Napkin Cost Comparison
Simple CAPEX Math
Cisco Global Price List (USD) – January 18, 2023
Back of the Napkin Power Comparison
Simple OPEX Math
US operator “metro” simulation results
01
Simulation using P95 of
busy hour traffic 34.1
02
16 Tb/s installed
capacity
Gb/s
Average site traffic
29.3 -95%
1.97 Tb/s busy hour Wavelength usage
03 traffic.
04 Single wavelength on Gb/s -97% Energy usage

aggregation rings Median site traffic
Customer’s ZR+ Opportunity
Current State
6 node Ring with 2,850Km circumference
71Km average span distance
100G Transponder based
Potential Bandwidth depletion by 2022
Proposed Solution
8201 + ZR+ Optics + NCS 2000 64ch Mux/Demux
With ULL fiber all links can do 400G w/o regen
Addresses needs NOW with existing delivery
capabilities
Complete Deployment and Migration Services
Phase 1: Customer’s Architecture
Replacing TXPs with cost efficient Next Gen Router + DCO
100% per 100G
Current: 100G DWDM transport
100G 100G
Capable 100G TXP ROADM ILAs ROADM 100G TXP Capable
Router(s) Router(s)
Nx 100G Nx100G:Nx100G Nx100G Nx100G:Nx100G Nx 100G
Proposed: 400G DWDM transport using ZR+ DCO pluggables
100G 100G
400G Router 64ch MUX / 64ch MUX / 400G Router
Capable ILAs Capable
w/Open ZR+ DEMUX DEMUX w/Open ZR+
Router(s) Router(s)
Nx 100G Nx100G:Mx400G Mx400G Nx100G:Mx400G Nx 100G
Using ZR+ DCO Using ZR+ DCO
Cisco 8201-32FH Cisco NCS 2006 Cisco NCS 2006 Cisco 8201-32FH
40% per 100G
Phase 2: Proposed End State Architecture
Leveraging L3 capabilities of 8K to improve cost base of deployment
Current: 100G DWDM transport
100G 100G
Capable 100G TXP ROADM ILAs ROADM 100G TXP Capable
Router(s) Router(s)
Nx 100G Nx100G:Nx100G Nx100G Nx100G:Nx100G Nx 100G
Proposed: 400G DWDM transport using ZR+ DCO pluggables
400G Router 64ch MUX / ILAs

64ch MUX / 400G Router
w/Open ZR+ DEMUX DEMUX w/Open ZR+
Nx100G:Mx400G Mx400G Nx100G:Mx400G
Using ZR+ DCO Using ZR+ DCO
Cisco 8201-32FH Cisco NCS 2006 Cisco NCS 2006 Cisco 8201-32FH
Economic Benefits over time
Comparative Cost of Legacy TXP vs NexGen
Router w/DCO
8K+ZRP
TXP
½ cost
CAPEX
~2x
~2x
~2x
~2x
~2x
Year 1 (16 ch) Year 2 (23 ch) Year 3 (32 ch) Year 4 (45 ch) Year 5 (64 ch)
ASSUMPTIONS:
• Does not include OPEX Savings (Power, Space, Cooling)
• 16 Channels at Year 1 and then Channel growth rate of 40%
• Does not include price erosion that typically benefits newer technology
Routed Optical Networking Journey
How to get there?
Traditional Multi-Layer Architecture Routed Optical Networking Architecture
Transitional Architecture
3 Management Systems, 3 control planes IP/MPLS optimized, simplified control plane

IP/MPLS+ GMPLS + WSON/SSON Full services convergence
Start Today with

Past 400G DCO Adoption
Phased Vision
Approach
1 2 3
Independent IP and Optical networks Routed Optical Networking
© 2023 Cisco and/or its affiliates. All rights reserved. Cisco Public
Routed Optical Networking Journey
How to get there?
Traditional Multi-Layer Architecture Routed Optical Networking Architecture
Transitional Architecture
400ZR/OpenZR+
DCO Pluggables
3 Management Systems, 3 control planes IP/MPLS optimized, simplified control plane

IP/MPLS+ GMPLS + WSON/SSON Full services convergence
Transponders
Existing DWDM
Start Today with

Past 400G DCO Adoption
Phased Vision
Approach
1 2 3
Independent IP and Optical networks Routed Optical Networking
© 2023 Cisco and/or its affiliates. All rights reserved. Cisco Public
Initial Discussion
• Which components are most important to you?

• What questions would you like answered today?
Realizing Routed
Optical
Networking
Routed Optical Networking Principles
Minimize Simplify
Transponders ROADM
RON
Modernize Replace
Control Plane OTN
Minimize
Transponders
Routed Optical Networking Principles - Progress
Minimize Simplify
ZR Optics (400G variants) Transponders ROADM
High Scale Routers
Works w/ Existing Deployments
RON
Modernize Replace
Control Plane OTN
400G DCO Standards and Industry Specifications
Simplified functionality
Edge optimized FEC (C-FEC)
Client Line
400GE 400ZR
100GE
Client Line 100G
200G
200GE
300G
400GE
Up to 120km reach 400G
Nx 100GE
(Muxponder Mode)
Extended reach
Flexible Client Mapping +
High Performance FEC (oFEC)
Simplified functionality +
100G
200G High performance FEC (oFEC)
300G Client Line 100G
200G
400G
Ethernet
300G High performance pluggable modules
400G
OTN OpenROADM Multi-vendor interoperability
FlexO
Extended reaches
Reference Slide
OIF 400ZR Overview

• 400GE pluggables with Integrated DCO*
• Compatible with DWDM line systems or dark fiber
• Focused on multivendor interoperability and
power optimization
• OIF driven DWDM I/F specification
• Standard form factors: QSFP-DD, OSFP or CFP2
• Supports multiple use cases:

• Campus and metro applications
• Data Center Interconnect, Peering, Core, Edge, Aggregation networks Pluggable DCO:
• Enterprise, Wireline, Mobile and Cable markets
*Digital Coherent Optics
DSP + Coherent Optics
• Unamplified links up to 40 km
Product ID: QDD-400G-ZR-S

Reference Slide
Open ZR+ includes a superset of functionalities

• Umbrella term for implementations beyond OIF 400ZR
• Related industry works: OpenZR+ and OpenROADM
• Key characteristics:
• Extended performance in comparison with OIF 400ZR
• Multi-rate DWDM line over pluggable with Integrated DCO
• Compatible with standard form factors: QSFP-DD, OSFP or
CFP2
• Supports multiple use cases:
• Metro, Regional and simple Long-Haul applications
• Data Center Interconnect, Peering, Core, Edge, Aggregation
networks
Pluggable DCO:
Digital Coherent Optics
• Enterprise, Wireline, Mobile and Cable markets DSP + Coherent Optics
Product ID: QDD-400G-ZRP-S

Reference Slide
Cisco ZR and ZR+ Specs from Datasheet

Transmitter Specifications Receiver Specifications
https://www.cisco.com/c/en/us/products/collateral/interfaces-
modules/transceiver-modules/datasheet-c78-744377.html
Reference Slide
400G QSFP-DD 400ZR & OpenZR+ specifications

Enable a broad range of use cases: campus, metro/regional and long haul
Mode Line Baud Modulation FEC Min. Min. TX OSNR Min. RX DGD Max. CD
Rate Rate Format Channel Power Tolerance Sensitivity Compensation Compensation
Spacing
Unit Gbps GBaud GHz dBm dB/0.1 nm dBm ps ps/nm
-8.5 (Typical)
OIF ZR 400 59.8 DP-16QAM CFEC 75 26 -20 33 +/- 2400
-10 (EoL)
400 DP-16QAM -10 24 -12 55 20,000
300 60.14 DP-8QAM -10 21 -15 66 40,000

OpenZR+ OFEC 75
200 DP-QPSK -9 16 -18 66 50,000
100 30.07 DP-QPSK -8 12.5 -18 83 100,000
Note: OpenZR+ MSA based on V2 specification – July 2022
Cisco Bright QSFP-DD ZR+
• 400G ZR+ QDD pluggable with +1dBm EOL TX
Available Power
• Easier interoperability with all deployed Add/Drop
architectures
• Enhances un-amplified reach by about 10dB
• Optical specifications aligned with current OpenZR+
• Improved OSNR Sensitivity of 0.6dB (EOL)
• Two different versions
• Ethernet only (for Routers and Switches) – available now
• OTN (for OpenROADM hosts) – planned
Product ID: DP04QSDD-HE0=* • OTN option offers support of L1 Encryption

* Ethernet variant
Reference Slide
400G High Power (Bright) QSFP-DD DCO

Cisco Implementation Specifications – Ethernet Variant
Mode Line Baud Modulation FEC Min. Max TX Max RX RX RX RX DGD Max. CD
Rate Rate Format Channel Power Power OSNR Sensitivity Sensitivity Compensation Compensation
Spacing Sensitivity (Optimal) (No ASE
Noise)
Unit Gbps GBaud GHz dBm dBm dB dBm dBm ps ps/nm
400 16QAM 22.5 -12dBm -21dBm +/- 52000
300 60.1 8QAM 75 19.5 -15dBm -23dBm +/- 100000
200 QPSK +1 14.8 -18dBm -29dBm 60 +/- 100000

OFEC (tunable down 13
Ethernet 200 40.1 8QAM to -9dBm) 17.2 -16dBm -28dBm +/- 100000
200 16QAM 50 19.3 -15dBm -25dBm +/- 85000

30.1
100 QPSK 11.5 -20dBm -32dBm 80 +/- 160000
Reference: Cisco 400G (Bright) 400G QSFP-DD DCO datasheet

https://www.cisco.com/c/en/us/products/collateral/interfaces-modules/transceiver-modules/400g-qsfp-dd-high-
power-optical-module-ds.html
What’s the Reach?
QDD-ZR and QDD-ZR+
Single-Channel / Dark Fiber Pair
10dB Span Budget
Up to 40km Distance
QDD-ZR and QDD-ZR+

Single or Multi-Channel Leverages DWDM Pre and Booster Amplifiers
along with DWDM Filters for Multi-Channel
QDD-ZR/+ max distance is 120km Inline Amplifiers might be needed
QDD-ZR+
Multi-Channel
Leverages DWDM Pre, Booster, and Inline
Amplifiers
with DWDM Filters for Multi-Channel
n# - Inline Amplifiers w/wo/RAMAN Amplifiers
400G QDD-ZR+ max distance is 1,400km
ZR+ can be downshifted to 300G, 200G, and 100G to support further distances and worse
OSNR
What’s the Reach with Bright ZR+
BrZR+
Single-Channel / Dark Fiber Pair
20dB Span Budget
Up to 80km Distance
QDD-ZR, QDD-ZR+, and BrZR+ Leverages DWDM Pre and Booster Amplifiers
Single or Multi-Channel along with DWDM Filters for Multi-Channel
Inline Amplifiers might be needed
QDD-ZR/+ max distance is 120km BrZR+ could require less amplification due to
the increased TX Power
QDD-ZR+ and BrZR+

Multi-Channel Leverages DWDM Pre, Booster, and Inline
Amplifiers
with DWDM Filters for Multi-Channel
BrZR+ has 0.6dB of OSNR Improvement
n# - Inline Amplifiers w/wo/RAMAN Amplifiers increasing performance
400G QDD-ZR+ max distance is 1,400km
ZR+ and BrZR+ can be downshifted to 300G, 200G, and 100G to support further distances and
worse OSNR
Replace Transponders with DCO Pluggables
Prior Architectures Leverage DCO Pluggables and
2-3 discrete layers available Automation Tools
CNC EPNM
Routers (Core, Edge, Aggregation & Peering) IP orchestration, path optimization & Visualization IP & Optical Management
Packet Routers (Core, Edge, Aggregation & Peering)

Services DCO Netconf/ Yang Telemetry &
Packet
Services
Config
Eliminate Dedicated
Gray Client Pluggables Transponders & Grey Optics
Transponder via ZR/ ZR+ on routers
Transponder
POTS Device/
Transponder POTS Device/
Transponder
Alien wavelength over Cisco NCS
2000 or 3rd Party Open Line
Optical Network System (OLS)
Optical Network
400G-QDD-DCO’s
Routed Optical Networking Capable Products
Access Access Service Edge Core
Non-Ethernet Pre-Agg Ethernet Aggregation Peering
ASR 920/NCS 4200 NCS 540 ASR 9000 8000

➢ 100G Optimized, 400G ➢ 400G Optimised
➢ Multi-dimensional scale ➢ LSR Core
➢ GE/10G optimised ➢ 10/25/100G ➢ Massive control plane ➢ PE Roadmap
➢ Legacy interfaces optimised
➢ Entry SR & EVPN ➢ Extends XR
➢ TDM → IP ➢ Full SR & eVPN NCS 5500/5700
➢ Mass Scale data plane, 100G Optimized, 400G
➢ Transport-focused
➢ Distributed PE w/ SR and EVPN
MPLS Segment Routing, Peering, Automation (EPNM, Crosswork, NSO)
Traditional and Flexible Consumption Models
CISCO OPTICS / OPTICAL NCS 2000 NCS 1000
5G Mobility Cloud Core and Packet Core
Cisco 400G Router Portfolio
NCS 540 NCS 5700 CISCO 8000 ASR 9000
N540-24Q8L2DD-SYS Jericho 2 Cisco Silicon One Cisco LightSpeed Plus

NC57-24DD 8201 (24x 400GE + 12x A9K-20HG-FLEX-SE/TER
(24x400GE LC) 100GE) (5x 400GE + 15x 100G)
NC57-18DD-SE 8202(12x 400GE + 60x A9K-8HG-FLEX-SE/TR
(18x400GE LC) 100GE) (2x 400GE + 6x 100GE)
NCS-57C3-MOD 8202-32FH-(M) (32x400G) A99-10X400GE-X-TR/SE
NC57-MPA-2D4H 8201-24H8FH
ASR-9903
NCS-57B1-6D24H-S (8x 400GE + 24x 100GE)
NCS-57C1-48Q6D-S 36x 400GE LC
14x 400GE + 34x 100GE LC
Reference Slide
400G DCO 400ZR/OpenZR+ QSFP-DD

Router Compatibility
Product Family Network Device Product ID Minimum IOS XR Version
8201-SYS 8202-SYS
7.3.15
8800-LC-36FH 88-LC0-36FH-M
Cisco 8000 88-LC0-36FH
7.3.2
8101-32FH 8201-32FH
8202-32FH-M 7.5.2
NC57-24DD NC57-18DD-SE
NCS-57B1-6D24H-S NCS-57B1-5D24-SE 7.3.2
NCS 5500 NC57-36H6D-S
NCS-57C1-48Q6-SYS 7.5.2
NC57-MOD-S NC57-MPA-2D4H-S 7.6.1
A9K-20HG-FLEX-SE A9K-20HG-FLEX-TR
A9K-20HG-FLEX-FC
7.3.2
ASR 9000 A9903-20HG-PEC
A99-10X400GE-X-TR A99-10X400GE-X-SE
A99-4T-FC
ASR-9902 ASR-9902-FC 7.7.1
NCS 540 N540-24Q8L2DD-SYS 7.4.1
Reference: Cisco Transceiver Compatibility Matrix: https://tmgmatrix.cisco.com/. Future software releases subject to changes.
Please check with your Cisco account team fort the latest compabilitiy information.
Reference Slide
400G High Power (Bright) QSFP-DD DCO

Router Compatibility
Product Family Network Device Product ID Minimum IOS XR Version
8201-32FH 88-LC0-36FH
Cisco 8000
88-LC0-34H14FH
NC57-MPA-2D4H-S
NCS 5500 7.9.1
ASR 9000
NCS 540 N540-24Q8L2DD-SYS 7.10 (Planned)
Disclaimer: Cisco Bright QSFP-DD ZR+ is currently in development and will be offered on a when-and-if-available basis. This roadmap is subject to change at the sole discretion of
Cisco, and Cisco will have no liability for delay in the delivery or failure to deliver any of the products or features set forth in this document.
Reference: Cisco Transceiver Compatibility Matrix: https://tmgmatrix.cisco.com/. Future software releases subject to changes.
Please check with your Cisco account team fort the latest compabilitiy information.
Reference Slide
Example of DCO port compatibility

Before installing a QSFP-DD DCO pluggable, always check the supported
configurations and requirements. Example provided in the table below:
Fixed-port Routers 400G DCO Support Operating Temperature Notes
Cisco 8201 • QDD-400G-ZR-S – supported on 40° C at sea level or 35° C at Requires use of Port Side Intake Fans and
all 400G ports 1500 meter Power Supplies
• QDD-400G-ZRP-S – supported on
even-numbered 400G ports
Cisco 8202 • QDD-400G-ZR-S – supported on 40° C at sea level or 35° C at Requires use of Port Side Intake Fans and
all 400G ports 1500 meter Power Supplies
• QDD-400G-ZRP-S – supported on
even-numbered 400G ports
8201-32FH • QDD-400G-ZR-S – supported on 40° C at sea level or 35° C at Requires use of Port Side Intake Fans and
all 400G ports 1500 meter Power Supplies.
• QDD-400G-ZRP-S – supported on The 8201-32FH fixed-port router must be
even-numbered 400G ports operated only with 2kW power supplies while
using the QDD-400G-ZR-S and QDD-
400G-ZRP-S optical modules. These optical
modules are not supported when 1.4KW
power supplies are used.
Source: www.cisco.com (direct link: http://cs.co/9008zXQgK)
ZR/ZR+/BrZR+ Transport with NCS 1001
Metro-Regional Networks
NCS 540 NCS 5500 CISCO 8000 ASR 9000
NCS1K-MD64
8000 8000
IOS-XR End-to-End
400G-ZR/+/BrZR+
9000 QSFPDD’s 9000
NCS1001
540 540
Amplified Solution
5500 Supporting 120km without intermediate 5500

sites
BrZR+ could require less amplification due to the increased TX Power

ZR/ZR+/BrZR+ Transport with NCS 2K/NCS 1010
Metro-Regional-Long Haul Networks
NCS 540 NCS 5500 CISCO 8000 ASR 9000
Various Add/Drop
Infrastructure
8000
NCS 2000 SMR20 8000
NCS 1010 OLT 400G-ZR/+/BrZR+
NCS 2000/ 1010 9000 QSFPDD’s
9000
EDFA/RAMAN (as
needed)
540 540
Line Amplifiers (as needed)
EDFA/RAMAN (as needed) 5500
5500
BrZR+ has 0.6dB of OSNR Improvement increasing performance

Cisco Nexus 400G Switch Portfolio
Nexus 3400-S Nexus 9300 GX Nexus 9500 GX Nexus 9500 R Series Nexus 9000
GX2, GX3
Innovium Terralynx Cisco Cloud Scale GX Cisco Cloud Scale GX Broadcom Jericho 2 Broadcom Jericho 2
1RU 32p 400G 1RU 16p 400G Switch 16p 400G Line Card 24p 400G Line Card 24p 400G Line Card
Switch 8-slot GX 400G Fabric 8-slot R2 400G Fabric 8-slot R2 400G Fabric
4RU 8-slot Switch 1RU 28p 100G Module Module Module
+ 8p 400G Switch 4-slot GX 400G Fabric
Module
(Compatible with EX/FX
Line Cards & FM-E/FM-E2
Fabric Modules)
Metro/Regional Transport with 200G-CFP2-DCO Optics
Site 1
NCS-5504/8/16
Site 2
NC55-MOD-A LC NC55-MPA-2TH-S
Powered By…
Operates over nearly all deployed

DWDM/ROADM Infrastructure or
NC55-MPA-2TH-S even dark fiber NC55-MPA-2TH-S
Site 3 Site 4
Benefits of Silicon One (8000)
Beginning of a long lifecycle
Generation ahead in chip design over competitors
New ASIC line + QSFP-DD 400G provides
unprecedented opportunity for investment protection
800G generation systems running in the lab
1/3 the chip power of equivalent SP-class systems
Similar power/bit to 12.8T SoC systems
Safe approach to network sourcing
Cisco’s long-term stability & investment capacity
Forwarding ASIC Metrics
Forwarding tables (FIB, ECMP)
# counters & updates per packet
Programmability / SDK
QoS operations, hierarchy
Buffer capacity (MB vs. GB)
Baseline PPS
Power vs. bandwidth (higher is better)
Chip bandwidth
Partially “fabric bound”?
Traditional “Routing” vs. “Switching” – 2017
32x bandwidth gap
CRS / ASR 9000 DC System on Chip

200G ASICs 6.4T
Traditional “Routing” vs. “Switching” – 2018
NCS 5500
Routing Broadcom DNX Switching
= TCAM option
Silicon One Q100 / Q200
Q100
Q200
Key HW Differences with ASR 9000
8000 Series does not address high-scale edge
3 Designs with One ASIC Architecture
CPU SiOne
Fabric (8)
8100/8200
Optics CPU
CPU
CPU
CPU
CPU P
PPPP
P
2 RSPs CPU
CPU PP
PPPP
CPU
CPU PPP
PPP
CPU P
PPP
P
CPU
CPU SiOne
Q100 Optics
Optics
Optics
Optics
Optics
Optics
Optics
Optics
LC
(4-18)
*pending 8800
Largest customer can fit into the Silicon One platform
19.2 Tbps
P100
8200 Series
8201-32FH
8201
8202
8201-24H8FH
Reference Slide
8200 Hardware
8201-32FH 8202-32FH-M 8201-24H8FH 8201 8202
Bandwidth 12.8 Tbps 12.8 Tbps 5.6Tbps 10.8 Tbps 10.8 Tbps
ASIC Q200 Q200 Q200 Q100 Q100
QSFP28 0 0 24 12 60
QSFP56-DD (400G) 32 32 (MACsec) 8 24 12
Depth 23.6” / 600mm 23.6” / 600mm 23.6” / 600mm 20.1” / 511 mm 20.1” / 511 mm
Weight 31 lb / 14.1 kg 42 lb / 19kg 31 lb / 14.1 kg 24 lb / 10.9 kg 42 lb / 19 kg
CPU / Memory
Fans 6 4 6 5 3
Airflow Either PSI / PSE future Either Either Either
Typical/Max power 288/675W TBD TBD 415/660W 700/1150W
8800 Series Systems
8804 8808 8812 8818

Rack Units 10 RU 16 RU 21 RU 33 RU
48x100GE (MACSec) 36x400GE (Q200/MACSec)

Line Cards 34x100GE & 14x400GE
(Q200/16x 100G MACSec)
36x400GE (Q100) 36x400GE (Q200)
Capacity 57.6 Tbps 115 Tbps 172 Tbps 259.2 Tbps
NCS-5700s
NCS-57C3 -(Pre-)Aggregation, Core/LSR, Peering NCS-57D2 -Aggregation, Core/LSR, Peering

• Capacity 2.4 Tbps • Capacity: 7.2 Tbps
• 48x 1/10/25G SFP28 and 8x 100G QSFP28 (Base) / 4x • 66 Ports: 2x 400G QSFP-DD +16x 400GQSFP-DD / 64x
100G QSFP28 (Scale) ports + 2x MPAs (800G) + 1x MPA 100G QSFP-DD
(400G)
• Compact 2RU, 600mm depth, F2B/B2F air-flow, single
• Compact 3RU, 284mm depth, F2B air-flow, dual Route Route Processor, redundant PSU
Processor, redundant PSU
• Supports MACsec, IPSec, Class C timing
• Supports MACsec, Class C timing
NCS 540s
Small Medium Large
800G
N540X-6Z18G-SYS-D/A N540X-12Z16G-SYS-D/A N540-24Q8L2DD-SYS

160G
64G
N540-12Z20G-SYS-D/A
N540-6Z14S-SYS-D
Fronthaul
N540-ACC-SYS
N540-6Z18G-SYS-A/D
300G
300G N540X-16Z4G8Q2C-D/A N540-FH-CSR-SYS

128G N540X-8Z16G-SYS-D/A
900G
N540X-16Z8Q2C-D N540-FH-AGG-SYS
N540X-4Z14G2Q-D
N540-28Z4C-SYS-D
Pluggable DCO Discussion
• How applicable to do you see DCO Pluggables in

your Network?
Simplify ROADM
Minimize Simplify
Transponders ROADM Not a prerequisite
Simple DWDM Line System
CAPEX & OPEX Savings from
fewer network layers
RON Continue with Power Savings
Modernize Replace
Control Plane OTN
New QDD-OLS
Pluggable
Disclaimer: This product is pending Release. Please confirm availability
with Cisco.
QSFP-DD OLS Overview
• Transforms separate EDFA system into a
QDD Pluggable – continuing platform
reduction options
• Extends the distance capabilities of ZR
Pluggables further
• Supports 4/8/16/32 channel systems
• Colored or Colorless Add-Drop
• 2.4THz Bandwidth - B/W range - 1539.1 to
1558.4 nm
• Combines Booster and Preamplifiers – each with
17dBm output and up to 25 dB gain
• Dual CS connector pairs for LINE and MUX
Leverage QDD-OLS with Passive Filters
30dB 120km spans
4x 400G interconnect
Leverage QDD-OLS with Breakout Cable
• No additional Rack Space Required

• Two Options
• 1x 8 cable (11dB Loss)
• 1x16 cable (13.5dB Loss)
• CS connector on QSFP-DD end

and LC connector on add/drop end
Disclaimer: This product is pending

Release. Please confirm availability with
Cisco.
NCS 1001
Point-to-point DWDM
NCS-1001
Protected System
• Point to Point metro DWDM networks
• Protection and unprotected topologies
• 3-Module Slots: Dual EDFA, PSM, and OTDR Options
• Optical Performance optimized for high baud-rate,
Unprotected System
higher-order modulation formats
• Visibility with Channel monitoring, OTDR
• Automated turn-up
Hop-to-Hop Only Design Example
Pre-Amplifier Pre-Amplifier
(EDFA) (EDFA)
EDFA
EDFA
Booster
NCS1001 Booster
(EDFA)
(EDFA)
Line Amp
Module
4, 48, 64-ch
M/D M/D
Optical
Mux/Demux
Client Infrastructure
• H2H (Hop-to-Hop) only (no Optimal Bypass)
• ZR @ 400G & ZR+ @ 100G,200G, 300G &
400G
• Compact 1RU NCS1001 having EDFA and
OTDR options
Available
New Smart DWDM

Line System
NCS 1010
Why NCS 1010 for Routed Optical Networking
Any coherent source? Simplicity
• Ingress EDFA to support 400ZR and
• Simpler patching – integrated
OpenZR+ DCOs operate at -10dBm module
• Low loss couplers for 95/140 • Independent degree operation
GBaud-Rates that need higher RX • Automated turn-up
power • Full spectrum loading from the start
• DGE on ILAs for equalization and
better control of Raman Gain ripple
Complete life-cycle
Scale automation
• Device automation - ZTP, OC YANG
• Hitless upgrade from C to C+L
config, Telemetry
• Embedded channelized ASE for
• Automated E2E turn-up with embedded
consistency in performance from day-
control loops
1 to full capacity growth
• Automated Connection Verification for
• 33-port Twin-WSS architecture to
patch loss checks at each site.
use as express or add-drop
• Enhanced visibility - OTDR, OSC, OCM
• Machine Learning on OTDR traces to
improve event detection
NCS 1010 Chassis Overview
• 3RU 300mm pizza-box with 1x optical module
• All Units are Modular and Field Replaceable
• 4x Optical Module options ECU

• OLT (Optical Line Terminal) C-Band
• OLT (Optical Line Terminal) L-Band Optical Module / Line Card
• ILA (In Line Amplifier) C-Band PSU’s Fan Trays
• ILA (In Line Amplifier) L-Band

• RAMAN C+L is optional (when needed)
• IOS-XR software
Controller
NCS 1010 Integrated Approach
33 port Flex-
OTDR
ROADM
C+L-Band
OSC
combiner
ASE loading Raman
OLT Photonic Line Card Connection Ingress

Verification EDFAs for ZR
NCS 1010 Line Card Modules and Configurations
Optical Line Terminal (OLT) Inline Amplifier (ILA)
• OLT C-Band • ILA C-Band

• OLT L-Band* • ILA C-Band with 1x Raman amp
• OLT C-Band with Raman
• ILA C-Band with 2x Raman
amps
• ILA L-Band*
OLT C-Band with Raman ILA C-Band with 1x Raman
* Disclaimer: The L-Band Versions are pending Release. Please confirm availability with Cisco.
NCS 1010 L-Band = a simple addition
NCS 1010 OLT C+L NCS 1010 ILA C+L
NCS 1010 OLT-C NCS 1010 ILA-C
NCS 1010 OLT-L NCS 1010 ILA-L
• Combiner present on NCS 1010 C-band module allows expansion to L-band
Optical Line Terminal (OLT) Building Blocks
NCS 1010 OLT - Optical Transport Platform – 3RU
• 32 ports WSS-based (33rd for NL)
• w/ embedded EDFA + Raman Amplification (optional)
• Including OTDR, OCM, OSC and ASE Source
32 ODD/EVEN Colored MUX-DEMUX – 1RU + 1RU

• Athermal AWG, w/ USB-powered power monitoring
Add only when & where needed

• 32 + 32 Channels, interleaved grids
FLEXIBLE Add/Drop Structure

Sites can be different
COLORLESS BREAK OUT – Colorless Modular Passive
Patch Panel – 4RU
• 4x Passive Optical modules, w/ USB-powered power
monitoring
• Up to 72 Channels Add/Drop + 6-Dir interconnection
COLORLESS BREAK OUT – Colorless Modular Passive

Patch panel – 1RU
• 2x Passive Optical modules, w/ USB-powered power
monitoring
Colorless Add/Drop Options
Breakout Modules Overview
• MPO16 to 24x LC Duplex Connectors

BRK-24 • 1x3 Splitter/Coupler per WSS Port for
Add/Drop Channels

BRK-16 • 1x2 Splitter/Coupler per WSS Port for
Add/Drop Channels

BRK-8 • 1-1 Splitter/Coupler per WSS Port for
Add/Drop Channels and Degree
Interconnect
Fixed Add/Drop Options
32-Channel Mux/Demux Overview
• 1RU Form Factor – 32 channels

• Odd and Even Versions supporting
up to 150GHz spacing
• Front Panel LED’s detailing which
wavelengths are provisioned
• USB 2.0 Port for Inventory, IL
Values, and Photodiode readings
Reference Slide
NCS 1010 OLT Module Quick View 2x33-WSS – allows for design
with low loss add-drop couplers
OSC can be switched to both fibers CV laser for bi-directional & high drop power for next gen
for 5G class timing support, latency connection verification and baud-rates
measurements, OSNR readings patch-cord loss checks
Embedded
bidirectional OTDR Ingress EDFAs for low output
for fiber power DCOs
characterization
Intrinsic degree
separation
Embedded C+L
filter
Embedded channelized ASE for

Embedded OCM for “OSA-like view”
Switchable gain range, true-OLS, operational ease to
of spectral profile on all ports
Variable gain PRE scale channels
Reference Slide
NCS 1010 ILA Module Quick View

OSC can be switched to both Embedded low cost DGE for
fibers for 5G class timing support, better performance with Raman
latency measurements, OSNR gain ripple
readings
Embedded
bidirectional OTDR
for fiber
characterization
Embedded C+L
filter
Switchable gain range, Embedded OCM for “OSA-like view”

Variable gain PRE of spectral profile on all ports
NCS 1010 Sample Configuration
Wavelength Any Coherent

Connections Source
Fiber-side
Interconnects
2-Fiber Degrees shown

72-Colorless Add/Drop Channels per Degree
NCS 1010 High Performance OLS
OCM, Flex-grid
C+L-Band ASE Equalization
OTDR, Open Line
support loading Everywhere
OSC, CV System
NCS 1010 Network Automation Demo
RON
Key Drivers Discussion
• What are the things you consider overly complex in

your transport network today?
Modernize
Control Plane
Minimize Simplify
Transponders ROADM
Segment Routing/SRv6
RON
SDN Programmability/Automation
EVPN Integration with SR Modernize Replace
<50ms protection
Control Plane OTN
Crosswork tools
IOS-XR superiority to legacy solutions
Simple Modern Trustworthy
Transport simplification and stability Advanced telemetry Trustworthiness begins in hardware

Visibility to enable analytics and machine Anti-counterfeit and Trust Anchor
Simplified transport with Segment Routing
learning infrastructure
Service simplification APIs into all levels of software A trustworthy network OS

EVPN for Unified Service Delivery, Cloud Creativity and flexibility through
Image signing and secure boot infrastructure
Native BNG model-driven programmability
Operational simplification Extendable to Third Party Software Trustworthy at runtime

Complement the IOS XR foundation with Run-time defense, encrypted transport,
NSO, Yang Development Kit, Yang Suite
targeted third party software DDoS protection
Improving the Services Layer
Limited Cross-domain Automation
Legacy Central Office
Metro Network Domain Core Network Domain Data Center Domain
L2VPN L3VPN VXLAN VNF VNF
Aggregation
Ethernet MPLS IP
Access
Centralized Delivery
of Services
HW Appliances
E2E service provisioning is lengthy and complex:

✓ Multiple network domains under different management teams
✓ Manual operations
✓ Heterogeneous Underlay and Overlay networks
Controller
Cloud Scale Networking
Central Office
Access
Metro Network Core and Peering Network Network Data Center
BGP VPN VNF VNF
VNF
IGP Segment Routing
VNF
Compute Leaf Spine
Unified underlay and overlay E2E Cross-domain automation with Transform the CO into a data center to
networks with segment routing model-driven programmability and enable distributed service delivery and
and EVPN streaming telemetry speed up service creation
Simplify Automate Virtualize
Controller
Cloud Scale Networking
Central Office
Access Metro Network Core and Peering Network Network Data Center
High Bandwidth
Encrypted mMTC
Low Delay
uRLLC BGP VPN VNF
VNF
IGP Segment Routing VNF
VNF
Compute Leaf Spine
Simplified intent based Model driven, Multi Domain Path Single infrastructure for different SLA
steering, per destination, per Computation, Intent aware and forwarding requirements
flow forwarding and protection.
Simplify Automate Virtualize
Segment Routing Adoption
Total SR: 397

In Production: 153
Americas EMEA APJC FY22 Prod. Planned: 107
181 137 79
Deployed
Active Testing
Deployment Planned
Segment Routing Technical Advantages
Material Network Simplification
Optimized Traffic Delivery Network Resiliency

- FRR over ANY topology (LFA/RFLA)
01 - Complete control over forwarding path
- Ingress router “forces the path”
03 - Sub-50msec convergence
- Minimize network congestion
- Transit routers only need to know how to
get to a segment, not the full per-path
- Segments are topology or services-based
Network Simplification SDN – App-Eng Routing

- Can integrate with SDN Controllers for
02 - Reduction of protocols as IGP takes over 04 optimal path selection
- No LDP/RSVP-TE to sync/troubleshoot - Balance between distributed intelligence
- MPLS tunnels are simplified (IGP = client) and centralized optimization
- Migrations do not disrupt data plane
Segment Routing Financial Benefits
Monetizing Technology
Better Network Asset
Utilization
50% networks over-engineered
to support suboptimal routing
Lower Resource
Consumption Lower CapEx
Minimal Control Plane Pressure Lower OpEx
Ingress nodes, not Intermediate Visibility
Avoid 1000s of labels in LDP Automation
Traffic Matrix Collection

Automated
Netflow-independent
Saves state on reboots
TI-LFA – Zero-Segment Benefits
100%-coverage 50-ms link, A 8
16008
node, and SRLG protection
Packet to 8
Simple to operate and understand 1 2

• automatically computed by the IGP
1000
• One configuration line only Packet to 8
prefix-SID(Z) 5
Prevents transient congestion and Packet to 8
suboptimal routing
• leverages the post-convergence path, 4 3
planned to carry the traffic
Default metric: 10
A case against G.8032 Ethernet Rings
B C
Smaller size – reconvergence suffers as the ring grows
Short L2 rings, star mesh not supported Edge A E D
Satellite
Cascaded rings – physical disruption to stop unexplained
behavior 8 1
Some locations on the ring do not have the best path to
destination 7 2
No multi-failure resiliency Core
6 3
Optical restoration is not faster than IP
No traffic prioritization and engineering 5 4
No security for the control plane Satellite
No measurable latency advantage (5 μs/km) G
IP Compared to L2 Rings
Using ALL available paths (resilience = # of Fiber paths)
B C
Any-to-Any connectivity = Aggregating traffic from any site onto Edge A E D
the optical link and/or offloading traffic directly into any other
site Satellite
Optical Fiber Path = Routing Topology 8 1
Easy & flexible integration and placement of new Platforms, like
Far Edge compute, cloud native BNG
7 2
Built-in Fast-Convergence/Protection mechanisms (IP-FRR/TI-
Core
LFA) 6 3
L3 Control Plane as Single Control Plane vs. IP/MPLS + Optical
GMPLS + WSON/SSON 5 4
Network Slicing through Segment Routing - Low Latency path, Satellite
Disjoint Path, Highest BW path G
Reference Slide
G.8032 vs IP Compared
VLAN-Based Solutions EVPN-SR
Scale • Large, flat L2 architectures don’t scale • Will scale to thousands of nodes per domain
• VLAN tag stacking is not a manageable • 20-bit labels yield virtually limitless tunnels and
solution services
• 10’s of thousands of LSPs
Operations • Understanding switching path will be very • Traffic routing will be deterministic based on
difficult since there is no control-plane state dynamic or explicit path selection via control plane
for services or tunnels • Switching paths are easily traced using MPLS OAM
toolkit
Automation • Requires EMS or manual configuration and • EVPN dynamically learns remote endpoints
assignment (which will be error-prone and • Programmatically define the path for the packet at
complex to manage) the source node
Optimization • Traffic engineering with VLAN-based • Native ECMP allows efficient use of network
switching is very difficult if not impossible resources – no configuration required
Flexibility • VLAN-based solutions constrained to logical • Any arbitrary topology can be supported with same
hub-and-spoke or ring architectures resiliency and scale
Routed Optical
Networking
Automation
Automation vision
Visibility
Verify and monitor customer experience
Automate processes by
bringing together Insights
Correlate data, identify trends and patterns
visibility, insights and
actions in a closed loop
Action
Automate processes to drive agility
IETF ACTN – Open Automation Reference
Framework
+---------+ +---------+ +---------+
| CNC | | CNC | | CNC |
+---------+ +---------+ +---------+
\ | /
\ | /
Boundary ========\==================|=====================/=======
between \ | /
Customer & ----------- | CMI --------------
Network Operator \ | /
+---------------+
| MDSC |
+---------------+
/ | \
------------ | MPI -------------
/ | \
+-------+ +-------+ +-------+
| PNC | | PNC | | PNC |
+-------+ +-------+ +-------+
| SBI / | / \
| / | SBI SBI / \
--------- ----- | / \
( ) ( ) | / \
- Control - ( Phys. ) | / -----
( Plane ) ( Net ) | / ( )
( Physical ) ----- | / ( Phys. )
( Network ) ----- ----- ( Net )
- - ( ) ( ) -----
( ) ( Phys. ) ( Phys. )
--------- ( Net ) ( Net )
----- -----
MDSC
Abstraction and Control of

Traffic Engineered Networks
Open automation at each level
Restconf/UI
Multi-Domain Level Crosswork

Hierarchical Controller
Restconf Restconf
TAPI IETF Models
Domain Level Cisco Optical Crosswork
Network Controller Network Controller
Netconf Netconf
gNMI
Device Level
NCS 2000 / 1010 IOS-XR Router
Routed Optical Networking Open Automation
Stack Unified API
EVPN-VPWS
EPNM
IP+Optical
Element Management
Crosswork Network Controller
Services Layer
Visualization Telemetry IETF Service/Topology
Traffic Eng ZTP
TE and xVPN Provisioning

Crosswork Hierarchical
L3 IP Network+SR Controller
ML/MD Visualization
ML/MD Provisioning
IP + Optical using ZR/OpenZR+
Crosswork Optical Network

Controller
Optical line system mgmt
ONF TAPI
Optical service mgmt
Cisco Optical
3rd Party
Optical
Stack Unified API
EVPN-VPWS
EPNM
IP+Optical
Element Management
Services Layer
Traffic Eng ZTP

ML/MD Visualization
ML/MD Provisioning

Controller
ONF TAPI
Cisco Optical
3rd Party
Optical
HCO Architecture
• Flexible architecture, comprising a Service/Domain Inventory
Orchestrators Reconciliation
robust relational database that holds the
network model, and a core of Intent API JSON, CSV, REST…
functionality implemented in Java Crosswork HCO

NBI
• All peripheral functionality is written in adapters
UI App1 App2 Engines
(Discovery,
Python: applications that process and Network Database (Layers, Nodes, Links, Inventory Policy, PCE,
What-If,
analyze the network data, adapters that Services, Crosslinks, States, History)
Transactions,
Redundancy,
connect up and down, provisioning SBI SDN NMS/EMS Direct
Security)
Adapters Adapters Adapters
• Engines for common functions

REST, MTOSI, CLI, TL1,
RESTCONF Proprietary NETCONF
• General network database is Postgres ,
IP Transport EMS/
TimescaleDB for time series, PostGIS Controllers Controllers NMS
for geographic data
N N N N N N N N N N N
E E E E E E E E E E E
HCO Applications
GUI explorer is the default view
Network Inventory – “Inventory” means nodes, links, TE, services, as well as chassis inventory
NMC Xconnects – IP to Optical Link-Layer interconnects
SHQL is their SQL-like query language
Layer relationships from optical to service layer
Network history app – keeps record of network changes for past replay. Both state and PM data is
covered in network history
RCA – Correlation engine, see what underlying layer issue caused a higher layer fault
Service manager – Wizards for provisioning supported services
Link assurance – New app for ZR/ZR+ plus optical path monitoring
HCO – Main RON specific functions
• Multi-layer discovery and visualization of RON links
• Multi-layer provisioning of Routed Optical Networking links

• 400G only as of 11/10/21
• Assurance of Routed Optical Networking links

• Dedicated application showing IP+Optical components of a single RON link
• Show router and optical hops in the path, show common telemetry such as RX/TX
power at each hop
• Show layers in alarm
HCO Demo
RON
Routed Optical Networking Open Automation Stack
Unified API
EVPN-VPWS
EPNM
IP+Optical
Element Management
Services Layer
Traffic Eng ZTP

ML/MD Visualization
ML/MD Provisioning

Controller
ONF TAPI
Cisco Optical
3rd Party
Optical
What is an (Optical Network Controller)?
• Key part of SDN Architecture
• Cisco Domain controller for Optical Network
• Centralized SW provides control of Optical network
• Moves distributed network function (WSON, GMPLS, …) to Infra
Common Compute
centralized SW entity
Common collect and deploy
• Collects from Network
• Provides Network Control and Intelligence
• Provides abstracted Network view and Functions on Northbound
Interface (TAPI Models, RESTCONF & NetConf)
Advanced ROADM Hop by Hop
What does Cisco Optical Network Controller do?
• Inputs
• Nodes, Links, Connectivity, SRLG, Inventory,
GET getTopology
Utilization, etc. (calculates network topology) GET getAllManagedElements ONF TAPI
• Alarms and PM data (TCA/Streaming Telemetry) GET getPhysicalTerminationPoints OpenROADM
GET getAllServices
• Functions for L0 and L1 GET …
• Compute to service requests (RWA functions)

• Calculate the circuit path (+ optical impairments Consumer
verification) Inventory Topology O PCE Opt.
Infra
and establish path Abstraction / Communication Bus ( Data Distribution)
• Reaction to network events Producer Collect / Deploy Service

db
Collect Deploy
• Optical path restoration

• Supports Optical network re-optimization
Cisco Optical
Network
Cisco Optical Network Controller
• CONC installed as cApp on Crosswork Infrastructure
• Can be installed with other CW cApps or on a standalone cluster
Stack Unified API
EVPN-VPWS
EPNM
IP+Optical
Element Management
Services Layer
Traffic Eng ZTP

ML/MD Visualization
ML/MD Provisioning

Controller
ONF TAPI
Cisco Optical
3rd Party
Optical
CNC delivers Outcome Driven Approach
Intent-based Service Provisioning

Service-Oriented Transport
Automated Provisioning (SR-MPLS, SRv6, RSVP-
(L2VPN, L3VPN)
Provisioning TE)
Dynamic Traffic Bandwidth-Aware

Flexible Algorithm
Local Congestion
Engineering Path Control Mitigation
Closed loop Real-time Network

Automation Optimization
Integrated service
Service Health Network State
lifecycle Visualization Optimization
Monitoring Monitoring
management
CNC: Conceptual Diagram
Common UI & NBI (RESTCONF, REST)
Device Network Service

Device Zero Touch Optimization Active
Health Change Provisioning
Management Provisioning Engine Topology
Monitoring Automation Connector
IP
Transport
Services
Internal Communication Channel
Data Collection Network Service

SR PCE Orchestrator
SR PCE
SR PCE Device Packs
Collectors (SNMP, Telemetry, CLI)
PCEP, IGP, BGP-LS SNMP, Syslog, gNMI, MDT CLI NETCONF
Network Devices
Cisco Crosswork Network Controller
• Unified controller for IP services
• Supports Routed Optical Networking

SR-TE, RSVP-TE, L2VPN, and L3VPN
service provisioning
• SR-TE bandwidth on demand and
local congestion mitigation
• Powerful multi-vendor network data
collection using Crosswork Data
Gateway
Automation and Management Demo (CNC)
RON
Routed Optical Networking Open Automation Stack
Unified API
EVPN-VPWS
EPNM
IP+Optical
Element Management
Services Layer
Traffic Eng ZTP

ML/MD Visualization
ML/MD Provisioning

Controller
ONF TAPI
Cisco Optical
3rd Party
Optical
EPNM View of 8201 Chassis with ZR+ optics
Automation Discussion
• Why is automation important to your network?

• What tasks do you seek to automate in your network?
Replace OTN
Minimize Simplify
Transponders ROADM
RON PLE
Lowering total capacity
OPEX reduced with significantly fewer
Modernize Replace ports
Control Plane Better handles unpredictable traffic
OTN patterns Faster end-to-end service
enablement
Emulation vs native Packet Circuits
• TDM transport OCn Circuit = switched timeslots OCn
• Static timeslot allocation TDM TDM
• Native packet transport

• Bandwidth only consumed when
Circuit = just a pseudowire
customer is sending data 10GE 10GE
• Allows for multiple traffic classes Pkt Pkt

and forwarding behaviors
• Emulation
• Bit transparency 10GE Circuit = pseudowire with guaranteed BW 10GE
• Constant network load Emu Emu
OTN - Services
• Circuit oriented in fixed chunk
• Hard to change traffic rate (ODU-Flex, hitless resizing)
Packet Groomed 100G

OTN Groomed 100G
Flow 10
Resource
Flow 9 saving due to
Flow 8 simultaneous
usage and
• Sub-optimal bandwidth
Flow 7
Flow 6
statistical utilization
• Hard to change traffic profile
multiplexing
Flow 5
Flow 4
Flow 3
Flow 2
Flow 1
PLE and CS-SR demystified
PLE EVPN-VPWS
• Bit transparent (100% control protocol • No special hardware required
transparent) • Most cost effective
• SyncE • Limited MTU
• Multi-protocol (TDM, FibreChannel) • No bandwidth consumption during idle
• No MTU limits
Circuit-style SR (CS-SR) SR
• Guaranteed bandwidth • ECMP
• persistent, co-routed, bi-directional paths • TI-LFA
• 1:1 End-to-end path protection and restoration • Scale & Simplicity
PLE is not …
• PLE does not replace TDM2IP services

SATOP (RFC4553) does carry only T1/E1, T3/E3
CESoP (RFC5086) does carry NxDS0 inside T1/E1
CEP (RFC4842) does carry SONET/SDH circuits (SPEs/VTs/VCs)
• OTN emulation (OTN2IP)

PLE allows you to carry client signals in a similar way to OTN
From the outside PLE does look like OTN, but inside you have packet
switching !
Converging all Services onto a single IP
Infrastructure
Low speed Low speed Low speed
private lines private lines private lines
Internet and Internet and Internet and
L2VPN/L3VPN High speed L2VPN/L3VPN High speed L2VPN/L3VPN High speed
services private lines services private lines services private lines
PDH
SONE
IP
TSDH
CEM CEM PLE
OTN IP OTN IP
DWDM (TXP) DWDM (DCO) DWDM (DCO)
Legacy mode 1.) Embracing 2.) Full

of operation Routed Optical convergence using
Networking and TDM2IP PLE
Reference Slide
Technology Evolution 14,000
• Legacy TDM SONET/SDH chipsets do 12,000
not allow to scale bandwidth nor
Chipset Bandwidth in Gbps

10,000
power
• Investment in TDM chipsets has been 8,000
declining to zero
6,000
• Even OTN chipset investment is
already stalling now 4,000
• Pure packet chipsets show dramatic 2,000

scale and power improvements
0
Packet switching is the least expensive 2013 2015 2017 2019 2020 2021
transport available! SONET OTN Packet
Technology Evolution
• Supported client types

• 1GE, 10GE
• OC48/STM16, OC192/STM64
• Fibre channel (1, 2, 4, 8,16 and 32G)
NC55-OIP-02
• OTU2, OTU2e
• Any mix of client types supported
• Supported in NCS-55A2 and NCS-57C3
NCS-55A2
NCS-57C3
Reference Slide
Multi-Type/Rate Port Configuration

RP/0/RP0/CPU0:ple(config-Optics)#port-mode ethernet framing cem-packetize rate ?
10GE 10GE rate
1GE 1GE rate
RP/0/RP0/CPU0:ple(config-Optics)#port-mode sonet framing cem-packetize rate ?

OC192 OC192 for rate
OC48 OC48 for rate
Controller optics
RP/0/RP0/CPU0:ple(config-Optics)#port-mode sdh framing cem-packetize rate ?
STM16 STM16 for rate
STM64 STM64 for rate
RP/0/RP0/CPU0:ple(config-Optics)#port-mode FC framing cem-packetize rate ?

FC1 Fibre Channel 1G
RP/0/RP0/CPU0:ple(config-Optics)#port-mode otn framing cem-packetize rate ?

otu2 otu2 rate
otu2e otu2e rate
What is the Big Deal? structure agnostic emulation packet
PSN RTP Control
payload
header timestamp word
Bit-stream EVPN-VPWS Bit-stream

packetization de-packetization
Mapping the VPWS

to a suitable path MPLS path
Encap Decap
Tx clock
Attachment circuit Attachment circuit
timestamp SyncE
(SONET, Ethernet or OTN) (SONET, Ethernet or OTN)
CS-SR (SR-TE) PTP DCR
BITS in
BITS in
DCR … differential clock recovery

Common clock (frequency) CS-SR … circuit-style SR policy
via SyncE, PTP or BITS
Basic PLE VPWS Example
PLE EVPN-VPWS (EVI 10)
AC-ID 1 AC-ID 2
SR policy (to_three)
SR policy (to_one)
0/0/1/0 1 2 3 0/0/1/0
l2vpn l2vpn
pw-class pw-cs-srte pw-class pw-cs-srte
encapsulation mpls encapsulation mpls
preferred-path sr-te policy to_three preferred-path sr-te policy to_one
! !
! !
xconnect group evpn_vpws xconnect group evpn_vpws
p2p p0 p2p p0
interface CEM0/0/1/0 interface CEM0/0/1/0
neighbor evpn evi 10 target 2 source 1 neighbor evpn evi 10 target 1 source 2
pw-class pw-cs-srte pw-class pw-cs-srte
PLE Performance Management
PLE pseudowire trail
• Similar to Y.1731 frame loss measurement
Periodic OAM packets
• Periodic (1 second) tranmission of transmit PW Tx
counter PW Rx
counter value to far end node counter
• Frame loss derived at far end end by

comparing transmit and receive counters
• Usual performance monitoring and
vailability metrics such as ES, SES, UAS
Accommodating Segment Routing for Circuit-
style Services
SR allows a single network to accommodate flows of different services types

• IP-centric services with ECMP, shared bandwidth and local protection
• Circuit-centric services with circuit with the following properties
Co-routed bidirectional
Persistence
Guaranteed Latency
Guaranteed Bandwidth
End-to-end path protection
Point to point services : PW, CEM,..
PLE using “Circuit-style” segment routing
• PLE pseudowire has a distinct bandwidth requirement
assigned Pseudowire provisioning
• Pseudowire is mapped to a SR policy

• Headend routing requests a path via PCEP from a central
PCE
PCE
• Bandwidth
• Path constraints Utilization Topology
(SNMP, (BGP-LS)
• The path is encoded via a list of adjacency SIDs in the Telemetry)
packet header
• The central PCE maintains a real time view of
• The network topology (BGP-LS)
• All path/bandwidth requests (PCEP)
Partitioning the network for circuit-style Services
out-q CS
2G 2G
Link BW
out-q IP
CS partition • To allow Circuit Style services, the
2G 2G
network is partition.
2G
MPLS EXP 7
• CS partition
10G 10G
• IP partition
IP network
10G 10G • Allocate one MPLS-EXP to the circuit-
100G 8G 8G style partition
• QoS configuration (MQC) isolates circuit
MPLS EXP 0..7 IP partition
8G traffic from IP traffic
8G
98G
MPLS EXP 0..6
Established, active
Established, failed
Enabling more Recovery Schemes on-demand, active
Policy1 X
A Z
disjoint
A’ Z’
Policy2
unprotected
1:1 protection
CP pref=20
(working) X
A CP pref=10 disjoint Z
(protect)
Established, active
Established, failed
Enabling more Recovery Schemes on-demand, active
Policy1 X CP pref=20
(working)
X
A Z
disjoint
A Z
A’ Z’ CP pref=10
backup ineligable
(restore)
Policy2
unprotected 1+R restoration

1:1 protection 1:1+R prot.&restor.
CP pref=20 CP pref=30
(working) X (working) X
A CP pref=10 disjoint Z A CP pref=20
(protect)
disjoint Z
(protect)
CP pref=10
backup ineligable
X
(restore)
Low Latency is inherent to Cisco’s PLE Solution
• Packet networks are no longer ”slow” or introduce high latency thanks to
hardware-based packet forwarding
• Transfer delay of a packet node is <10 μs per hop (equal to roughly
2km of fiber)
• Reasons for increased latency are buffering due to congestion, fiber distance, and
sub-optimal routing
• Implementing strict bandwidth accounting via a Central PCE allows packet network
design with a utilization <100% on every link which avoids packets being buffered
• Implementing QoS with PLE traffic mapped to a strict priority queue to cover
temporary congestion scenarios
Addressing Common Misconceptions
• Resiliency: PLE offers more Protection and Protection Switching

capabilities than traditional OTN Networks
• Transparency: PLE is bit transparent
• Latency: Router Latency are similar to traditional OTN Networks
• OAM&P: Advanced toolsets offer broader automation, management, and
monitoring capabilities
CS-SR/PLE Demo
RON
PLE Discussion
• Why are Private Line services important to your company?

• What is your initial assessment of the PLE technology?
Routed Optical Networking Principles - Complete
Minimize Simplify
Transponders ROADM
RON
Modernize Replace
Control Plane OTN
Integrating
DCO’s into
existing and
multi-vendor
networks
Existing DWDM
Interoperability
Considerations
What interoperability are we talking about?
Focus of this
discussion
Cisco
How does the existing network look like?
IP Network inventory: Hardware and software
DWDM network specifications: e.g. wavelenght

grid, operating figures (OSNR, DGD), EoL margins
Operational Tools: Management systems,

automation/orchestration tools
400G QSFP-DD DCO technology for existing networks
Key interoperability considerations
1 2 3 4
DWDM Management
Router/Switch
Network Performance and
Compatibility
Compatibility Automation
400G QSFP-DD DCO technology for existing networks
1 2 3 4
DWDM Management
Router/Switch
Compatibility
Router or Switch Compatibility
Key Considerations
• Pluggable form factor: QSFP-DD56 (standard)

• Software: DCO requires specific software features
• Power profile: 400G DCO works within the QSFP- Which and
DD power envelope how many
• Thermal profile: Varies by platform and defines on ports can host
which ports DCO pluggables can be deployed the pluggable
400G DCO
400G QSFP-DD DCO technology for existing
networks
1 2 3 4
DWDM Management
Router/Switch
Compatibility
400G DCO and ROADM Compatibility
Anatomy of 400G ZR/ZR+ Optical Signal
Transmitter Receiver
Safety margins are required on top of these specifications. Ex.: 2dB OSNR margin
System level designs use statistical methods (2 sigma, 3 sigma) to account for uncertainties
400G DCO and ROADM Compatibility (Cont’d)
Minimum ROADM or DWDM Mux/Demux Requirements
ROADM
75GHz
(fixed or flex grid) -10dBm
Channel
Or Input Power1
Bandwidth
Terminals
50GHz fixed grid ROADM implementations are incompatible with ZR/ZR+

1) Optical power considerations for first generation 400Gbps DCO following OIF 400ZR and OpenZR+ specifications
400G DCO and ROADM compatibility examples
Multiple solutions can be applied to equalize DCO wavelengths
A. Power equalization via VoAs
A. Power equalization via VoAs
B. DCO Power amplification via

dedicated unit.
Ex. NCS2K-6AD-DD-CFS unit
A. Power equalization via VoAs B. DCO Power amplification via

dedicated unit.
C. DCO Power amplification via

3rd party components.
A. Power equalization via VoAs B. DCO Power amplification via C. DCO Power amplification via
dedicated unit. 3rd party components.
D. DCO Power amplification via

dedicated amplifier in interleaved
channels.
A. Power equalization via VoAs B. DCO Power amplification via C. DCO Power amplification via D. DCO Power amplification via
dedicated unit. dedicated ROADM degree. dedicated amplifier in interleaved
Ex. NCS2K-6AD-DD-CFS unit channels.
A. Power equalization via VoAs B. DCO Power amplification via C. DCO Power amplification via D. DCO Power amplification via
dedicated unit. dedicated ROADM degree. dedicated amplifier in interleaved
Ex. NCS2K-6AD-DD-CFS unit channels.
This is not an exhaustive list.

Point to point DWDM systems are simpler and, in some cases, won’t require changes.
400G High Power (Bright) DCO and ROADMs
Simpler solution with less or no equalization of DCO wavelengths
E. Power equalization via VoAs. F. DCO Power amplification via G. DCO Mux/Demux via external H. DCO Mux/Demux via dedicated
Still required due to add/drop dedicated unit. Not really needed! hardware. Unlikely. hardware in interleaved channels -
vs pass-through channels. from the same DWDM vendor.
Again, this is not an exhaustive list.

Key take-away: Bright ZR+ allows for simpler interoperability with existing DWDM.
networks
1 2 3 4
DWDM Management
Router/Switch
Compatibility
All things equal,
DCO ONSR sensitivity
DCO Performance has ~0.5 - 2dBs
difference versus
transponder
400G DCO provides excellent performance and supports a wide range of use cases.
Parameter Unit 400G Transponder OIF 2 MSA3 Cisco’s Enhanced Cisco’s High
1 400ZR 400G OpenZR+ OpenZR+ Power BrZR+
Optical Modulation PM-16QAM PM-16QAM PM-16QAM PM-16QAM PM-16QAM
Baud rate GBaud 46.3 to 72 59.84 60.14 60.14 60.14
Transmit Power dBm +3 to -10 dBm -8.5 to -10 dBm -6 to -10 dBm -6 to -10 dBm -9 to +1 dBm
-17 dBm
Receiver sensitivity dBm -20 dBm -12 dBm -12 dBm -12 dBm
Receiver OSNR
sensitivity (0.1nm dB 22 26 24 23.1 22.5
resolution)
Max CD Tolerance ps/nm 150,000 2,400 20,000 52,0000 48,000-52,000
DGD Max ps 64 33 50 60 60
Sources: 1 - Typical x GBaud 400Gbps transponder implementation
2 – OIF 400ZR Technical Specification
3 – MSA OpenZR+ Technical Specification – version 1.0 (Sept. 2020)
For Routed Optical Networking designs, the shorter distances between routers mean
the ~1 – 2 dBs OSNR difference may be compatible with the ROADM infrastructure
without any changes.
networks
1 2 3 4
DWDM Management
Router/Switch
Compatibility
Common network and element management
functions
Configuration Fault Performance Lifecycle
• Device • Thresholds • Thresholds • Network Inventory

• Security • Visualization • Visualization • Software Updates
• Protocols • Logging • Logging • Add/Retire/Upgrade
• Trunk Interfaces • Historic database • Historic database nodes
• Client Interfaces • Northbound Interfaces • Northbound Interfaces
• Services
• Back-ups
Reference Slide
400Gbps Pluggable DCOs configuration parameters

400ZR OpenZR+ (Cisco example)
Client Speed 1x400, 4x100 1x400, 4x100, 3x100, 2x100,

1x100
Trunk Speed 400G 400G, 300G, 200G, 1x100
Frequency C-Band, 196.1 To 191.3 THz C-Band, 196.1 To 191.3 THz
FEC cFEC oFEC, cFEC
Modulation 16QAM 16QAM, 8QAM, QPSK
DAC-Rate 1x1 1x1.25 (oFEC), 1x1 (cFEC)
Chromatic Dispersion (CD) -2400 to +2400 -160000 to +160000
Transmitted (Tx) Power Based on the module capability Based on the module capability
Reference Slide
DCO performance management (PM) parameters

Optics PM Coherent DSP PM
PM Parameters Description PM Parameters Description
CD Chromatic dispersion Q Q factor
DGD Differential group delay Q-margin Q margin
LBC Laser bias current in mA EC-BITS Error corrected bits
FREQ-OFF Low signal frequency offset in Mhz PostFEC BER Post forward error correction bit error rate
OPR Optical power RX in uW or dbm PreFEC BER Pre forward error correction bit error rate
OPT Optical power TX in uW or dbm UC-WORDS Uncorrected words
OSNR Optical signal-to-noise ratio in dB
PCR Polarization change rate
Pluggable DCO transceivers provide
PDL Polarization dependent loss
detailed visibility of optical transport
RX-SIG Receiving signal power uW or dbm
performance and fiber quality directly
SNR Signal-to-noise ratio
to the router (or host).
SOPMD Second order polarization mode dispersion
Reference Slide
Sample PM counters output for optics
Reference Slide
Sample PM counters output for DSP
Industry Management
Solutions
How to manage and configure DCO transceivers
without CLI?
• Much more data to manage

• Transport operations require visual tools
• End goal is automation, i.e. must be friendly for machine-
to-machine communication
• Operators are embracing open/standard management
frameworks
Open management and automation
Industry initiatives
• Common data models (covers DCO pluggables)

• gRPC management protocol
Over 30 companies • Subscription based streaming telemetry
Webscales and CSPs • Vendor neutral testing and compliance
• YANG language, NETCONF and RESTCONF protocols

• Consensus based data models, hackatons, catalog
• Abstraction and Control of Traffic Engineered Networks
framework (ACTN – see next slides)
• YANG models for disaggregated DWDM systems

(covers DCO pluggables), RPCs and device templates
• Controller based archtiecture (see next slides)
OpenConfig models for 400G DCO
Model Use
Primary model used to configure input interface to output line

openconfig-terminal-device
port structure and add optical parameters to oc-platform
Used to provision optical channel parameters and for monitoring

openconfig-platform
optical channel state
Used for monitoring physical channel state data such as RX/TX

openconfig-platform-transceiver
power, and output frequency
Note: This list is only the parent models utilized and does include imported models.
OpenConfig DCO model logical view
openconfig-platform
OpenConfig hierarchical structure mapped to
pluggable DCO
OIF 400ZR
Logical Channels Logical Channel Optical Channel

4 x 100GE or 400Gbps only
1 x 400GE
100GE
100GE
400GE
100GE
100GE
OpenConfig hierarchical structure mapped to
pluggable DCO
OpenZR+
Logical Channels Logical Channel Optical Channel

N x 100GE or N x 100Gbps
1x400GE N = 1, 2, 3 or 4
100GE
…
400GE
100GE
Sample optical channel configuration
using OpenConfig platform component
Target output power in dBm

Optical channel frequency in MHz
Operational mode
Note: Example based on QDD-400G-ZRP-S (OpenZR+) in port 0/0/0/10 on Cisco 8201

Full configuration example using NETCONF: https://xrdocs.io/design/blogs//zr-openconfig-mgmt
400G DCO Provisioning using configuration modes
Single integer value
PID Operational Mode Line Rate FEC Type Modulation Baud Rate Pulse Shaping
QDD-400G-ZR-S 5003 400 cFEC 16QAM 59.84 No
QDD-400G-ZRP-S 5004 400 cFEC 16QAM 59.84 No
QDD-400G-ZRP-S 5005 400 oFEC 16QAM 60.14 Yes
QDD-400G-ZRP-S 5006 400 oFEC 16QAM 60.14 No
QDD-400G-ZRP-S 5008 300 oFEC 8QAM 60.14 No
QDD-400G-ZRP-S 5009 200 oFEC QPSK 60.14 Yes
QDD-400G-ZRP-S 5010 200 oFEC QPSK 60.14 No
QDD-400G-ZRP-S 5013 100 oFEC QPSK 30.08 No
Reference Slide
Sample model driven telemetry data
Note: Ouput cut for brevity.

Reference Slide
Model driven telemetry sample config

telemetry model-driven
include select-leaves-on-events
destination-group pipeline
address-family ipv4 172.27.223.244 port 5432
encoding self-describing-gpb
protocol tcp
!
!
sensor-group optics
sensor-path Cisco-IOS-XR-controller-otu-oper:otu Data you want
sensor-path Cisco-IOS-XR-controller-optics-oper:optics-oper
sensor-path Cisco-IOS-XR-pmengine-oper:performance-management/otu to monitor
sensor-path Cisco-IOS-XR-pmengine-oper:performance-management/optics
!
subscription optics-sub
sensor-group-id optics sample-interval 30000
destination-id pipeline Pub/sub
source-interface MgmtEth0/RP0/CPU0/0 model
Reference Slide
DCO monitoring using open-source Grafana
Model driven telemetry provides data at higher frequency
Example
30 sec
vs
15 min
Integration Options
3
Upper Layer Management/Controller
(NetCool, Moog AIOps, Vitria, Cisco HCO, etc)
1 Hardest to do it Requires transport
vendor collaboration for integration
(e.g. via SNMP)
IP
2 Legacy Transport
IP Layer
Network Transport Network
Operator Management Operator 2 Also very hard to do. Requires
Management transport vendor collaboration for
SNMP, integration (e.g. via RESTConf,
1 SNMP,
Syslog, CORBA, SNMP NBI)
Streaming Telemetry, Proprietary
CLI 3 Easier and commonly deployed.
Depends less on transport vendor
collaboration for integration (e.g.
via RESTConf, SNMP NBI)
400G-ZR+ across existing OLS Demo
RON
Bright 400G-ZR+ across existing OLS Demo
RON
Brownfield and multi-vendor scenarios
• Do you currently support Alien Wavelengths in your OLS?

• Do you plan on adopting an open architecture in your
Network?
Getting started
and Network
Modeling
considerations
Best-kept secret of WAN Automation Engine
• WAE is perfectly capable of

simulating L1 networks.
L1 Circuit
• Needs Noise and Sigma values of
the network, used to simulate L1 L1 Circuit L1
Path Link
Circuit Paths
• Regeneration through manual L1
Node placement
L1
Node L1 Waypoint
How to model the network
L3 circuit
(Optional) Port circuits for LAGs
Add/Drop node to model A/D impairments
Line node to connect to lines
L1 link to model ROADM domain
L1 circuits and circuit paths
Port circuits and associated ports

are optional, they model LAG
members
Modeling a L1 Link
• Required parameters are “Noise A to B”
and “Noise B to A”
• The Sigmas are all optional
• All values are in dB
• Noise/Sigma may be:
• Minimum OSNR (XTALK, actually)
• Average OSNR (XTALK)
• Yes, the values are < 0
• L1 Links w/o Noise are “mute”
Modeling a L1 Circuit
Add L1 Port on ‘B’

and ‘D’
Add L1 Circuit
between the nodes
New circuit
established
Reference Slide
Some terms before we get into the weeds …
WAE Terminology Explanation
L1 Link ROADM or APC domain
L1 Circuit A L1 relation between two L1 nodes. May have multiple L1 Circuit Paths. The L1 Circuits
define the logical topology of the network.
L1 Circuit Path The set of L1 Links that make up a L1 Circuit. Can be modelled with a Feasibility Limit and
Acceptance Threshold.
Feasibility Limit B2B OSNR + OSNR Margin. Required ‘received OSNR’
Acceptance Threshold The ‘n’ in ‘n-Sigma’
Feasibility Metric (Sim) The WAE calculated Noise. Must be less-than-or-equal than the Feasibility Limit for a L1
Circuit Path to be considered ‘active’.
The L1 Circuit Path Noise model in WAE
Noise൘ σl
l ൘
Feasibility Metric = l ∈ L1 Links 10 10 +n 10 ) 2
σ σl ∈ L1 Links(10
Using only Noise Using Noise and Sigma

• Use worst-case or average noise figure • Use average noise (XTALK) in Noise field
• Provide noise figure (XTALK) in dB • Sigma field:
Noise+σ൘ Noise൘
10 log10 10 10 − 10 10
Circuit Path established if Feasibility Metric ≤ Feasibility Limit (B2B OSNR)
A worked example – Link between local L1 Nodes
Add direction
Average XTALK [dB]
“Sigma” XTALK [dB]
Avg. Avg. σ Max. Max. Noise

XTALK XTALK XTALK XTALK Sigma
(dB) (lin) (dB) (lin) (dB)
MUX -36.958 2.01E-4 0.083 -36.875 2.05E-4 -54.1
DEMUX -41.858 6.25E-5 0.083 -41.775 6.65E-5 -59
Noise Sigma is 10 * log(max – min XTALK)
A worked example – Link between A and B
Same as before – now for the line
Avg. Avg. σ Max. Max. Noise

XTALK XTALK XTALK XTALK Sigma
(dB) (lin) (dB) (lin) (dB)
A-B -26.926 2.03E-4 0.254 -26.672 2.15E-4 -39.1
B-A -27.009 1.99E-3 0.254 -26.775 2.11E-3 -39.2
A worked example – Circuit Path between A and B
Specifies the B2B OSNR and the ‘n’ σ
Subtract OSNR Margin from B2B OSNR
A quick excursion – How to build redundancy
Select ‘Create disjoint primary and …’
Your definition of ‘disjoint’
But actually, I want a L3 network …
Defines physical topology Defines logical topology

Noise L1 Circuit Feasible Paths
L1 Link
Noise σ Circuit Path Achievable bitrate
OSNR margin
Designing
RON using
WAE
L3 Circuit Uses L3 circuits

Capacity
‘Victim L3 circuits’ on logical Demands
Optimizer
Defines possible L3 topo topology Builds optimal L3 network
Build ‘Victim’ Circuit for each L1 Circuit (1/2)
Set to very low capacity
Idea is that any demand using this circuit

will cause new capacity to be built.
The circuit only serves to have the
optimizer see a L3 adjacency
Build ‘Victim’ Circuit for each L1 Circuit (2/2)
Select Source Site
Select Source Node (Add/Drop node)
Select L1 port for the L1 Circuit
Select L1 Circuit between sites
Running the Capacity Planning Optimizer (1/3)
How ‘hot’ you want your L3 interfaces
Should be minimum of capacity in L1 topo
Optimizer may build new L1 circuits
If L1 Circuit Path is ‘feasible’
New L1 Circuits may be built if:

• L1 Circuit Path is feasible
• Addition of L1 Path improves solution
What are we optimizing for ?
Cost factors for ‘Minimize Cost’
What failure conditions to consider
Results (1/2)
What was added ?
Results (2/2)
L3 links sized per ‘Failure Sets’
Failures causing this utilization
Worst-Case Interface utilization
Reference Slide
Very High Level description of the algorithm
Algorithm adds LAG members or parallel Algorithm will consider adding new L3 or L1
circuits to network until sufficient capacity adjacencies if:
available under selected failure conditions.
L1 Circuit Paths are feasible
Addition of L3 or L1 adjacency will improve on the
objective selected:
• Minimize capacity (= minimize number of interfaces)
• Minimize cost
Modeling Demo
RON
How to increase fiber capacity?
Higher Better spectral
Wider channel Better FEC Use L-Band
modulation efficiency
More bits per symbol ->
“Easily” done Increased reach More b/s/Hz “Easily” done
Higher capacity
Increased capacity per Higher overhead eats Reach ~ 1/constellation

Dispersion coefficient β Doubles # channels
channel into usable capacity size
"X" km @ 16QAM ->

Fewer channels Power, real estate, cost Nonlinear coefficient ɣ Increases attenuation
"X/4" km @ 64QAM
Increased blocking No “dramatically better” Negatively impacts

Reduce attenuation
probability FEC on horizon spectral efficiency
Reduce reach
Requires drastically
different fiber to
have big effect
Not a question of “if” but “when” physics mandates more “Hop-to-Hop”
Blocking probability in the real world
Wider channels can have massive consequences …
Map traffic according to customer

requirements (meshed network)
Use 600 Gbps channels @ 112.5 GHz -> 42
channels / band
Question: Blocking probability of next channel
Answer: up to 97%
“36” and “51” are 2/4 hub sites (peering,
population centers)
Subnet where p >= 10%

x/y on edge: # channels/# ROADM domains
Lessons learned: A real-life customer design
(1/4)
• DWDM network much denser than IP
(3:1 ratio)
• Diagram shows demand ‘A’ to ‘F’
mapped to two paths.
• Nodes ‘B’, ‘C’, and ‘G’ have other
neighbors, not shown here.
• This is the steady-state
• Customer requested 2-cut survivability
per traffic relation
(2/4)
• Fiber cut @ G-H, B-C & G-E
• Speed of circuits B-C & G-F now at
Y/2.
• Requires at least directionless on
ROADM
• Two options to deal with that:
• Limit these links to Y/2 in steady state
• Introduce regenerators
• Neither are really good:

• Fiber capacity
• CapEx for regens, optimum placement a
mathematical hard problem.
(3/4)
• Conceptual view here
• No more optical restoration – all
‘restoration’ on IP layer
• Can simplify ‘Add/Drop’
• Interfaces at their achievable rate
• No λ blocking
• Real advantage:
• Customer saves ~ 1/6 of fiber (customer
does not own the fiber)
• Actually …
(4/4)
• Additional routers just to increase fiber
capacity.
• Even though larger IP footprint now,
the CapEx was less wrt ‘traditional’
solution because:
• Difference ROADM+CDC vs.
ROADM+MUX+Router was small
• All pluggables @ maximum achievable
speed
• Better fiber utilization
• Fewer fibers
• No need for C+L for planned lifetime
• Restoration on IP Layer very beneficial

US operator “metro” simulation results
01
Simulation using P95 of
busy hour traffic 34.1
02
16 Tb/s installed
capacity
Gb/s
Average site traffic
29.3 -95%
1.97 Tb/s busy hour Wavelength usage
03 traffic.
04 Single wavelength on Gb/s -97% Energy usage

aggregation rings Median site traffic
Simulation 1: Demands
Optical/Fiber transport network
Simulation 2: New demands @ P95 of busy hour
Simulation Results
40% installed PMO capacity P95 busy hour traffic
Sum inter-site demands 6.408 Tb 1.976 Tb
Inter-site installed capacity 38.7 Tb 30.3 Tb
ZR/ZR+ pluggables 194 152
Grey pluggables 334 314
Maximum λ used between hubs 4 2
Maximum λ used on rings 2 1
WC link utilization 100 % 70.69 %
Power savings from TXP elimination alone: > US$ 500k
Digging deeper: Likely SRLGs in topology
3
3
2 2
1 1 1
4
5
5
1
4
5 6
2 6
1 Denotes SRLG (subset shown)
New topology of network
Simulation Results
40% installed PMO capacity P95 busy hour traffic
Sum inter-site demands 6.408 Tb 1.976 Tb
Inter-site installed capacity 46.8 Tb 34.4 Tb
ZR/ZR+ pluggables 234 172
Grey pluggables 334 314
Maximum λ used between hubs 3 2
Maximum λ used on rings 3 2
WC link utilization 100 % 70.69 %
Power savings from TXP elimination alone: > US$ 500k
Modeling Architecture Discussion
“Existing topology” “Alternate Topology”
• no changes, no new ROADMs • Requires changes and 15 new
• masks existing SRLGs from design ROADMs
& IP layer • No “hidden” SRLGs at cost of ~
• Less pluggables 20 pluggables
• Less links • Saves ~ 15% of fiber
• Less reliability • More IP links
• More reliability
Regional network
Simulation Results
Hollow Core (left) Hop-by-Hop (right)
Installed capacity 27.1 Tbps 36.1 Tbps
# wavelengths used 171 94
Max. # wavelength on a span 23 11
Average traffic/wavelength ~ 80 Gbps ~ 192 Gbps
Stranded capacity G-Hub2
• 23 wavelengths used in Hollow Core
• 3 @ 200G
• 20 @ 300G
• ~ 5% of fiber capacity lost
• Reality wherever “long” and “short”
circuits use the same spans
Conclusion
RON Conclusion: Assumptions vs Realities (FAQ)
ASSUMPTIONS REALITIES
RON is a solution using silicon, photonics, and software to simplify the network and
RON = ZR/ZR+/BrZR+
reduce costs
RON = IPoDWDM
ROADMs and transponders are part of the solution, where needed, using any optical
RON = routers+pluggables
network topology
Latest silicon advancements have driven down router costs per bit
Too many router ports with coherent RON uses less wavelengths, reduces capex, and increases fiber efficiency through
optics drive up costs aggregation
More OEO transitions with RON vs Express wavelengths are usually underutilized (< 20%) and not efficient use of fiber or
using express wavelengths optics
Managing RON can be challenging RON uses model-driven automation across domains/vendors to reduce complexity and
vs traditional systems costs
RON is for shorter distances in RON is for all use cases; efficiently maximizing fiber capacity through shorter distances
access/metro with hop-to-hop provisioning
Putting Everything Together is doable
>250Tbps 400GE ZR/ZR+ Simple DWDM Modern Software New Network
Line System & Control Plane Paradigm
Hop-by-Hop
Routed Optical
Networking
Key Takeaways for a Simplified Network
Converge IP and Optical Layers into 1 Start deploying capable Hardware
Reduce CAPEX through Device Count, Space,
•
Power
now
Higher Resiliency and Economically Optimize Routed Optical Networking Architecture
Fiber Capacity
• Resiliency based upon fiber/router topology – not
just static Optical TXP Circuits
• Utilize each Link efficiently, reduce overall OPEX
cost
Gain a Simpler Operationally Efficient Network
• Maximizes wavelength / fiber capacity Single control plane
• Zero density trade-off on Routers via QSFP-DD Converged IP+Optical architecture
• 400G ZR/ZR+ DCO Pluggables

Cleaner network lifecycle
• Planning, Design, Activation, Management,
Troubleshooting, Restoration, Upgrades
Pay for Learning with Cisco
Cisco Learning and Certifications

Learning Credits
(CLCs) are prepaid training
vouchers redeemed directly
From technology training and team development to Cisco certifications and learning with Cisco.
plans, let us help you empower your business and career. www.cisco.com/go/certs
Learn Train Certify

Cisco U. Cisco Training Bootcamps Cisco Certifications and Specialist
IT learning hub that guides teams Intensive team & individual automation Certifications
and learners toward their goals and technology training programs Award-winning certification
program empowers students
Cisco Digital Learning Cisco Learning Partner Program and IT Professionals to advance
Subscription-based product, technology, Authorized training partners supporting their technical careers
and certification training Cisco technology and career certifications
Cisco Guided Study Groups
Cisco Modeling Labs Cisco Instructor-led and 180-day certification prep program
Network simulation platform for design, with learning and support
Virtual Instructor-led training
testing, and troubleshooting Accelerated curriculum of product,
technology, and certification courses Cisco Continuing
Cisco Learning Network Education Program
Resource community portal for Recertification training options
certifications and learning for Cisco certified individuals
Here at the event? Visit us at The Learning and Certifications lounge at the World of Solutions
References
Cisco Routed Optical Networking portal
Link: https://www.cisco.com/c/en/us/solutions/service-provider/routed-optical-networking/index.html
White Paper
Link: http://cs.co/9008z1LWo
Related Press Releases (with links)
Zain Upgrades with Cisco
Tech Mahindra and Cisco Collaborate to Drive 5G Modernization with Routed Optical Networking
Link Net Begins Transformation to Cisco Routed Optical Networking
Datagroup Takes Internet Speeds to New Heights Across Ukraine with Cisco Routed Optical Networking
Earthlink Deploys Cisco 400G DCO Optics in EMEAR
Rakuten Mobile Advances Its Network for 5G and IoT Services with Cisco Routed Optical Networking
Colt Takes Network Innovation to New Heights with a 400G-Capable Routed Optical Networking
Cisco Redesigns Internet Infrastructure to Support a More Inclusive Future
Windstream Wholesale Sets 400G ZR+ Record with Acacia Coherent Pluggable Module
Telia Carrier Embraces Coherent Pluggables using Acacia's OpenZR+ Modules and Cisco Routers
WebSprix to Deploy Cisco Routed Optical Networking Solution with Cisco 8000
Cisco.com Public Collateral (with links)
Routed Optical Networking Leadership Report – 650Group report
IDC Info Brief on Routed Optical Networking
ACG TCO - The Economic Benefits of IP Transport at 400G
Executive Brief on Routed Optical Networking
Solutions for IP Optimizing Optical Transport – White Paper
Contacts and Links
[email protected] https://xrdocs.io
[email protected]
[email protected] Crosswork Demo dCloud
[email protected] https://dcloud2-lon.cisco.com/content/demo/522342
IOS-XR self-paced lab

https://dcloud2-lon.cisco.com/content/demo/532059
Complete your Session Survey
• Please complete your session survey
after each session. Your feedback
is important.
• Complete a minimum of 4 session
surveys and the Overall Conference
survey (open from Thursday) to
receive your Cisco Live t-shirt.
• All surveys can be taken in the Cisco Events Mobile App or
by logging in to the Session Catalog and clicking the
"Attendee Dashboard” at
https://www.ciscolive.com/emea/learn/sessions/session-catalog.html
Continue
Agenda Your Education
Visit the Cisco Showcase for related demos.
Book your one-on-one Meet the Engineer meeting.
Attend any of the related sessions at the DevNet,

Capture the Flag, and Walk-in Labs zones.
Visit the On-Demand Library for more sessions

at ciscolive.com/on-demand.
Thank you

Tecspg 2435

Uploaded by

Copyright:

Available Formats

Tecspg 2435

Uploaded by

Document Information

Original Title

Copyright

Available Formats

Share this document

Share or Embed Document

Sharing Options

Did you find this document useful?

Is this content inappropriate?

Copyright:

Available Formats

Tecspg 2435

Uploaded by

Copyright:

Available Formats

Routing Optical Networking Technical

4 Enter messages/questions in the Webex space

Webex spaces will be moderated

Visit the Cisco Showcase for related demos.

Book your one-on-one Meet the Engineer meeting.

Attend any of the related sessions at the DevNet,

Visit the On-Demand Library for more sessions

• Integrating DCO’s into existing and multi-vendor networks

Extended 50% Fewer

Today’s 400G and Better ROI and TCO Pluggable

Devices vs Pluggables Cost Optical Systems Evolution Routing Bandwidth Scale

• Lots of complexity • Much simpler

Converges all services onto a single network layer

Eliminates siloed IP & Optical operational layers

Integrates transponders and “grey” optics

Integrates OTN Services and ROADMs

Space, power and operational savings

Shorter Time-to-Market for services

Source: ACG Research

Cisco Global Price List (USD) – January 18, 2023

04 Single wavelength on Gb/s -97% Energy usage

Current: 100G DWDM transport

Proposed: 400G DWDM transport using ZR+ DCO pluggables

Current: 100G DWDM transport

Proposed: 400G DWDM transport using ZR+ DCO pluggables

400G Router 64ch MUX / ILAs

3 Management Systems, 3 control planes IP/MPLS optimized, simplified control plane

Start Today with

3 Management Systems, 3 control planes IP/MPLS optimized, simplified control plane

Start Today with

• Which components are most important to you?

OIF 400ZR Overview

• Supports multiple use cases:

Product ID: QDD-400G-ZR-S

Open ZR+ includes a superset of functionalities

Product ID: QDD-400G-ZRP-S

Cisco ZR and ZR+ Specs from Datasheet

400G QSFP-DD 400ZR & OpenZR+ specifications

400 DP-16QAM -10 24 -12 55 20,000

300 60.14 DP-8QAM -10 21 -15 66 40,000

100 30.07 DP-QPSK -8 12.5 -18 83 100,000

Note: OpenZR+ MSA based on V2 specification – July 2022

Product ID: DP04QSDD-HE0=* • OTN option offers support of L1 Encryption

400G High Power (Bright) QSFP-DD DCO

400 16QAM 22.5 -12dBm -21dBm +/- 52000

300 60.1 8QAM 75 19.5 -15dBm -23dBm +/- 100000

200 QPSK +1 14.8 -18dBm -29dBm 60 +/- 100000

200 16QAM 50 19.3 -15dBm -25dBm +/- 85000

Reference: Cisco 400G (Bright) 400G QSFP-DD DCO datasheet

QDD-ZR and QDD-ZR+

QDD-ZR+ and BrZR+

Packet Routers (Core, Edge, Aggregation & Peering)

ASR 920/NCS 4200 NCS 540 ASR 9000 8000

MPLS Segment Routing, Peering, Automation (EPNM, Crosswork, NSO)

Traditional and Flexible Consumption Models

CISCO OPTICS / OPTICAL NCS 2000 NCS 1000

5G Mobility Cloud Core and Packet Core

N540-24Q8L2DD-SYS Jericho 2 Cisco Silicon One Cisco LightSpeed Plus

400G DCO 400ZR/OpenZR+ QSFP-DD