Data Center Resource Guide
Data Center Resource Guide
DATACENTER
• Learning Goals
• Target Audience
- Channel and Partner Systems Engineers
• Duration
- Approximately 3 hours
• Next Steps
Cognitive
Campus
Specialist
Arista
Tap
Certification
Aggregation Program
Specialist
Service
Sales Provider
Specialist
Pre-Sales Engineers
• The next generation data center requires an agile and scalable network
infrastructure which supports the ability to rapidly deploy, expand or contract
the IT infrastructure needed to run business applications.
• Next generation enterprise data centers are highly virtualized and built to
provide workload mobility and multi-tenancy. The virtualized environment
will benefit from a robust IP fabric where workloads can be placed anywhere
in the context of the data center.
• Next generation data centers are highly automatized and provide real-
time telemetry data of network health.
1st Gen Leaf & Spine using 2nd Gen workload mobility 2nd Gen automation for
merchant Silicon 3x ports & 3x speed cloud scale economics
3rd Gen NetDB - network wide state, CloudVision– Network Rollback, Visibility,
higher scaling, real time analytics Bug Scrub, Snapshot, Health Status L2 MLAG L3 ECMP VxLAN
Data Data
Center Center LANZ Visibility End to End
WAN 7500E
7280SE
Data
3rd Gen Universal Spine Cloudvision Hybrid Cloud
1G Attached
Center
10G Attached 10G Attached
Servers Servers Servers Storage
Single binary image for all Same EOS across State driven, pprogrammable + Highly scalable
platforms hardware generations open API & SDK extensibility
4.14.7
Interface Counters
LANZ Data
4.15.7
Fan Speed sFlow Data
Temperature Sensor
Power Draw
Configurations
Routing Tables
MAC Tables
ACL Counters
VXLAN Mappings
Table Utilization
Buffer Utilization
System logs
CPU Load
Rapid convergence and Self-healing, quality, security, Hitless live migration Physical-virtual-container +
recovery upgrade & automation full state telemetry
11 Confidential. Copyright © Arista 2020. All rights reserved.
Arista Product Overview - 2020
• High oversubscription
• Sub-optimal for E-W traffic
• Limited workload mobility
• Management via CLI (box by box)
• Easier to automate
- 2-Tier, cookie cutter, repeatable elements
SLB
• CloudVision Orchestration,
WAAS Management, and
Compute Leaf Compute Leaf Storage Leaf Services Leaf Border Leaf Learning
(Dual-Homed) (Single-Homed) (Deep Buffers) (Deep Buffers) (LAN/WAN)
POD 1 POD 2
POD 3
Dual-Homed Leaf Dual-Homed Leaf Storage Leaf Storage Leaf Hadoop Hadoop Haddop Hadoop Internet/DMZ Internet/DMZ WAN Data Center Interconnect
Deep Deep
Buffers Buffers VTEP(s)
VARP-FHRP
MLAG MLAG
MLAG MLAG MLAG MLAG MLAG MLAG MLAG MLAG Web Servers Web Servers External
Network Metro A
External
Private Metro A Public
App Delivery App Delivery MPLS - A MPLS-B Network
NAS NAS
Controllers Controllers Cloud Cloud
Firewalls Firewalls Traditional Hybrid
WAN Cloud
IP Storage IP Storage MLAG MLAG
External External
Network Network
Network Considerations:
Public Cloud 1 Public Cloud 2 Public Cloud 3 Public Cloud 1 Public Cloud 2 Public Cloud 3
Network instances
Uniform networking
grow ad-hoc and
across clouds
operate in isolation
Enterprise DC Private Cloud
Analytics
Available
Architecture
Arista Router at
vEOS Router in Azure
Equinix West
• Proven Routing
• Secure Tunneling
• High Availability
• Traffic Engineering
• APIs and Programmability
Switch Switch FE FE
VOQ
PP
Fabric 1 Fabric 2
F F F F F F
a a a a a a
b b b b b b
r r r r r r
i i i i i i
c c c c c c
1 2 3 4 5 6
Clos network: 80% Flow Based Systems: 80-90% Cell-based System: 100%
2-tier networks Arista 7300X and Nexus 9500 Arista 7500E and 7500R
Confidential.
Copyright © Arista
Copyright
2019.© All
Arista
rights
2020.
reserved.
All rights reserved.
Two-Tier Leaf-Spine Design
Spine
Point-to-Point
Point-to-Point
Layer(Layer
2 or 3)
Layer 3
Leaf Nodes
Confidential. Copyright © Arista 2016. All rights reserved.
Layer 2 Leaf Spine Technologies
MLAG peers
- A pair of physical Arista switches
- Members identified by common text string
• MLAG peer
MLAG Domain-ID
- A single switch within an MLAG domain
MLAG Peer Link • MLAG Peer Link
- Non-proprietary Ethernet physical link between
MLAG peers
- Used to synchronize state between MLAG peers
• MLAG member port
MLAG - Physical ports that are part of an MLAG
MLAG peer
• MLAG
MLAG member VLAN - This is the combined port-channel between MLAG
port peers and the downstream/upstream devices
LA • MLAG VLAN
G
- A logical VLAN used on MLAG peer-links ports
- Supports communication between MLAG peers.
Spine
Point-to-Point
(Layer 3)
OSPF/BGP
Leaf Nodes
Confidential. Copyright © Arista 2016. All rights reserved.
Key Benefits of Layer 3 Topology - ECMP
Point-to-Point
(Layer 3)
X
VLAN
VLAN VLAN Leaf Nodes 10
10 10
Spine
VxLAN
Point-to-Point
(Layer 3)
VLAN VLAN
10 Leaf Nodes 10
Confidential.
Copyright © Arista
Copyright
2019.© All
Arista
rights
2020.
reserved.
All rights reserved.
Choosing an underlay routing protocol
• The overlay and underlay in EVPN with VXLAN are IP based
- There is no need for fancy protocols like LDP or RSVP
- Therefore there is no reason to run an IGP to support these protocols
• BGP
- Supports multiple address families
- Scalable
- Predictable
- Controllable (via policies)
Spine 1 Spine 2
AS 65001
eBGP
NVE 1 NVE 2 NVE 3 NVE 4
AS 65002
Confidential. Copyright © Arista 2020. All rights reserved.
Building the overlay
• Define a loopback interface on each switch
- For the overlay we want to use loopback interfaces
- We do not want to lose the overlay if an interface goes down
• Build a new BGP session between the loopback interfaces
• At this point you have a choice to make
- eBGP or iBGP
Confidential.
Copyright © Arista
Copyright
2019.© All
Arista
rights
2020.
reserved.
All rights reserved.
VxLAN Overview
Frame Frame
L3 - IP Segments
VTI 12.1.0.1 VTI 13.1.0.1 2. VTI (Virtual Tunnel Interface) – The IP interface of the VTEP.
For example a loopback interface that is mapped to a VTEP
VTEP3 10.3.0.1
E0/1 E0/2
• VXLAN requires MAC learning
- This will be discussed in detail
Confidential. Copyright © Arista 2020. All rights reserved.
VTEPs and Broadcasts
Host 2 Host 3
broadcast interfaces
- VTEPs behave like NBMA serial interfaces
- P-T-P, P-T-MP, MP-T-MP etc.
Broadcast Broadcast
Packet Packet
• Like serial interfaces VTEP interfaces replicate DIP: VTEP2 DIP: VTEP3
Broadcast Packet
DIP:192.168.1.255
Host 1
Confidential. Copyright © Arista 2020. All rights reserved.
BUM Traffic Forwarding Methods
Head-End Replication (HER) Multicast
• Each VTEP maintains a list of all • VNIs mapped to Multicast Group
VTEPs that must receive BUM - On 1:1 or N:1 basis
traffic • VTEPs are both Senders and
• This list is maintained on a per-VNI Receivers
basis - Join all necessary (*,G) feeds to service
local VNIs
• N unicast copies of BUM frame
- Send to all appropriate (S,G) feeds for
egress the source VTEP Bum traffic originated on local VNIs
- N = Total VTEPs that must receive the
BUM frame • Single instance of VXLAN encap’d
BUM frame egresses source VTEP
• Ethernet VPN
• RFC 7432 (https://tools.ietf.org/html/rfc7432)
• Address-Family within BGP
- Address-Family Identifier: 25
- Subsequent Address-Family Identifier: 70
• Control-Plane that enables L2VPN and L3VPN services
- Other features such as Active/Active multihoming are provided, but not covered in ATD
• Supports multiple Data-Plane encapsulations
- MPLS and VXLAN
• We will focus on VXLAN
MAC learning
Spine 1 MLAG Spine 2 ARP Spine 1 Spine 2
Broadcast
L2 Domain
Leaf 1 Leaf 2 Leaf 3 Leaf 4 Leaf 5 Leaf 6 Leaf 1 Leaf 2 Leaf 3 Leaf 4 Leaf 5 Leaf 6
1. You want IP routing at the ToR AND a L2 domain that spans racks (IRB)
2. You need an IP fabric and an L2 fabric
3. You need L2 stretch across data centers connected by a L3 core
4. You want redundant L2 POD to L2 POD connectivity without worrying about loops
EVPN
• EVPN defines VPN services using VXLAN as the tunneling protocol
• EVPN adds the following features to basic VXLAN tunneling
- L2 VPN services
- L3 VPN services
Comparison to MPLS
• EVPN with VXLAN is similar to MPLS L3 VPNs and VPLS
• VXLAN = MPLS label
• EVPN = L3 VPNs and VPLS
Open, Standards-based
Closed architectures
approaches
Customer Spectrum
✔ ✔ ✔
EOS SDK
EOS DevOps Toolkit
eAPI CloudVision
OpenConfig
Ruby/Python Object Model
Any Cloud
• Build configurations
via Configlets
- Static or Generated
• Inheritance model
• Execute Tasks to
apply configlets
Switch
State
Intf Intf
down up
Polled
State
Intf Intf Intf Intf Intf Intf
up up up up up up
Streamed
State
Intf Intf Intf
up down up TIME
Temperature Sensor
VXLAN Mappings
Table Utilization
Buffer Utilization
When you know what your When you don’t know what
looking for… you are looking for…
• Snapshots
• Device Views • Events
• Discrete Metrics • Cloud Tracer
• Aggregated Metrics • Continuous Snapshots
• Search (MAC, IP) • Adaptive Events
• Topology Views
State Streaming-based
Modern, granular, complete.
(No Polling - at all!)
Common Dashboard
Starting Point... for Visibility
For diving deeper into Wired and Wireless
control, data, mgmt plane 3rd Party devices
Data Plane
Flow Tracker
Understand
Visualization and
traffic patterns
trend analysis
Broad Visibility
Correlations from
DC to campus to
cloud + Endpoint
Inventory for
Security baseline
Algorithm-Driven
Proactive Alerts Predicts events
Ties into event based on historical
and notification data
system
Many Uses
Capacity Planning
Preventative
maintenance, etc
Network Constraint
Rules
Uplink capacity, Device specific
redundancy, peers, rules
other Visualize alerts on
network devices or
even attached hosts
Correlated Metrics
Search Enhances the search
Infrastructure results
Start with MAC and
IP search, more to
come...
Traffic rate:
show interfaces counters rates
LANZ data:
show queue-monitor length drops
show queue-monitor length
statistics
show queue-monitor length tx-
latency
Historical state
MONTH
repository,
proactive
tracking of
state changes
AEM to track
WEEK
changes to
ARP, MAC,
route table
entries
CLI Scheduler
DAYS
(scheduled
tech-supports)
DIFFERENT ACROSS PLATFORMS UNIFORM ACROSS PLATFORMS VISUALIZATION & ANALYTICS ACROSS PLATFORMS
Cloud Tracer
Integrated with
CloudVision
Telemetry
Enterprise DC Arista Router at
Equinix Cloud vEOS Router in Azure
West
Exchange
Software Consistency
Spine
Virtual
Campus
Leaf Spine
Spline
Virtual
Leaf Leaf
Security Islands!
Simplified
integration
point
Open
Physical Closed
Host Agents Physical
Network Fabric
Network
Typical vendor approach (ACI, Contrail) is to create yet- Arista approach is Best of Breed:
another security policy controller and lock it to physical Let customers use their existing security policy controller;
network and host agents Provide service insertion to the physical network
• Enables logical topology to enable services & enforce service policies in the Network
• No constraints on physical topology - or device placement – as layer-2 or layer-3 device
• Policy authoring and control by security team via service devices
7 Firewall will apply ‘all’ rules for the frame and will
forward/ log or drop the frame
Physical Network NSX as the single policy engine for authoring Micro-
segmentation policies for both Virtual and Physical
workloads
Dynamic orchestration of policy for enforcement in
Arista leaf switches
NSX Logical Switch
DC
To Networks
W Zone Segmentation E
To Networks • Zscaler Private Access (ZPA)
VPC/VNET VPC/VNET
- Handles North / South
ZPA
To Campus,
Branch
Customer Challenges
• Maintaining security config on all
devices
• Knowing which devices are vulnerable
• Operating out-of-support products
Any Cloud
Modular and Fixed options Modular and Fixed options Fixed Systems
Integrated 10G / 100G / 200G MACsec, Secure Leaf deployments Integrated hardware-based
Metro (80K) to Long Haul (5000K) Distances with 10G / 100G MACsec IPSec on all ports
Tiered structure ✘ ✔
Outsourced support ✘ ✔
Key takeaway:
If network uptime is important to your business Arista is the ONLY choice
Confidential. Copyright © Arista 2020. All rights reserved.
5. Arista Differentiator: Arista TAC Escalation Process
Engage TAC
via email or phone If TAC can’t resolve issue, it gets
escalated to:
Shannon
Nashua,NH Korea
China
Pune Japan[*Hiring in progress]
Santa Clara Cary,NC
Bangalore
Sydney
Contact us:
Phone: 1866 476 0000
Global locations All products ~19s to respond to calls
Email: [email protected]
[email protected] for round the supported by single ~10min. TSE assignment
Forum: https://eos.arista.com/forum/ clock coverage tier, all employee TAC for email cases
Confidential. Copyright © Arista 2020. All rights reserved.
7. Arista Differentiator: Customer Feedback
"I work with many, many vendors, and Arista has, by far, the best TAC in the Industry!"
• Currently offer several courses that cover general Arista Knowledge and
CloudVision
• New program being developed to cover full certification from beginner to
expert - 8 levels
- Will cover in-depth training on VXLAN, EVPN, BGP, MPLS, WIFI, Cloud Vision, etc.
- Roadmap for launch early 2020
• WiFi specific specialization training
• Partner hosted Arista specific CWNP WiFi training
Conclusion
www.arista.com
Confidential. Copyright © Arista 2020. All rights reserved.