ACI MultiPod and How To Build MultiDatacenter With Cisco ACI - How Does Internet Work

Download as pdf or txt
Download as pdf or txt
You are on page 1of 3

ACI MultiPod and how to build MultiDatacenter with Cisco ACI https://howdoesinternetwork.

com/2019/aci-multipod

HOW DOES INTERNET WORK

ALL  ABOUT THIS PROJECT 

ALL ARTICLES DATA CENTERS WITH CISCO DATA CENTERS WITH VMWARE IPV6

CONFIGURING NETWORK DEVICES NETWORKING TIPS & TRICKS

VOICE FUNDAMENTALS AND SECURITY SECURITY OF NETWORKS – ALL SECURITY

ROUTING SWITCHING

PROTOCOLS – ALL GREAT NETWORKING PROTOCOLS ARRANGED AND EXPLAINED BOOKS

 ABOUT THIS PROJECT

ALL ARTICLES INDEX

ACI MultiPod and how to


build MultiDatacenter with ▪ Index

Cisco ACI ▪ Fundamentals


▪ Troubleshooting
 Valter Popeskic  Data Center with Cisco , Software De�ned
▪ Con�guration
Datacenters  2 Comments
▪ Software De�ned
Datacenters
W H AT I S M U LT I P O D ?
▪ Data Centers with
ACI MultiPod was �rst designed to enable the spread of ACI
VMware
Fabric inside a building (into two or more Pods), let’s say in two
rooms at di�erent �oors, without the need to connect all the ▪ Data Centers with
Leafs from one room to all the Spines in the other room. It was a Cisco
way of simplifying the cabling and all that comes with building ▪ Routing
spread CLOS topology fabric stu�. ▪ Switching

1 of 7 27-06-2022, 13:04
ACI MultiPod and how to build MultiDatacenter with Cisco ACI https://howdoesinternetwork.com/2019/aci-multipod

MultiPod also saves some Leaf ports giving the fact that Pod to ▪ Security
Pod connection through Multicast enabled IPN network connects ▪ IPv6
directly to Spines.
▪ Protocols
▪ Voice
▪ Devices
▪ Networking Tips & Tricks
▪ About this project
▪ About the author
▪ Books

People soon realized that MultiPod will be a great solution for a


dual site (or more than dual) Datacenter with the ability to have
single management with a single ACI Fabric stretched across two
Search the site
or more locations that are connected with an IP connection not
too long so that enables RTT latency of less than 50msec with
Multicast support. Not too simple but it seems not too Search
demanding for most cases.

Enabling the things from above, MultiPod begun to bee a


preferred way of creating this modern Software De�ned
MultiDatacenter solutions based on Cisco N9K switches. RELATED POSTS
New ACI deployment?
Datacenter build in this way will have a central point of
Watch out when
management of both sides and it will enable to create stretched
connecting APICs to Leafs
L2 domains available everywhere. It enables that without the
need to stretch the VLANs in an old fashion way by really sending Cisco ACI – API Calls vs
L2 tra�c between sites and risking the L2 broadcast storm JSON POST
melting tragedy. All L2 tra�c will �ow as VxLAN encapsulated
unicast or multicast in-between sites inside the overlay. What is Cisco ACI?

Cisco ACI – Con�guring by


I P N N E T WO R K C O N N E C T I N G T H E P O D S
POSTing JSON
IPN network should be a dedicated link between two
datacenters, preferably created as redundant two dark �ber links How to Advertise a Route
with di�erent physical path. Con�guration can easily be created from ACI Layer2 BD
as redundant with redundant Nexus switches on both sides. Outside …
Multicast RP that is needed can also be con�gured redundantly
VMware NSX-T Install Tips
using phantom RPs so that bidirectional Multicast can work if one
& Tricks
of the IPN switches fails and when all of them work every switch
will be RP for 1/4 of multicast groups. CLOS Topology

Multicast-enabled IPN network is directly connecting Spines on ACI MultiPod – Enable


both sides and enables the EBGP protocol between Spines to Standby APIC
exchange all connected endpoint routes learned on spines on 

2 of 7 27-06-2022, 13:04
ACI MultiPod and how to build MultiDatacenter with Cisco ACI https://howdoesinternetwork.com/2019/aci-multipod

one side to their neighbor on the other side. Each POD (site) then Setting up Cisco ACI From
has locally discovered endpoints from local Leafs and has the Scratch
info about all endpoint from the other side so it can send the
tra�c to them when needed. Multicast is needed because all VMware TKGI –
BUM tra�c (Broadcast and Unknown Unicast) can be sent to the Deployment of Harbor
other side as Multicast so that it gets there redundantly. Container Registry fails
with …
How is IPN con�gured is part of the next articles in preparation
and it will contain detailed con�guration examples on how to
bring the IPN devices up and running without the need to consult
pretty super�cial MultiPod Cisco ACI con�g guides.

If you are running ACI MultiPod as a solution for multiple


Datacenter locations, which implies that you have one centralized
Management point, it is recommended to spread the APIC
controller cluster to both sites so that you get more resiliency in
case one of the sites or the connection in-between fails.

C AV E AT S
▪ Take care that Multicast enabled interfaces between two
local IPN switches should be routed ports directly
connected and not shared (if existing) with vPC peer link
(this will not work).
▪ Interfaces from IPN switch towards Spines are routed
subinterfaces with dot1q tag 4 which is hardcoded in
Spine ACI MultiPod and MultiSite con�guration.
▪ Making the port trunk and using vlan interface 4
will not work because you will then make possible
for two Spines to see each other through IPN
switches which is prohibited.
▪ It will also not work because Spines all share the
same MAC when connecting towards IPN by
default.

A P I C C O N T R O L L E R C LU S T E R
Long story short, you need three controllers to have working
Fabric management and that’s because of all that clustering
quorum things that need to be met in order for the cluster system
to be able to decide if he’s cluster member majority is enough to
prevent data corruption and con�guration loss.

 You can’t have two controllers cluster of APICs.

The story goes so that in ACI MultiPod it is always recommended 

3 of 7 27-06-2022, 13:04

You might also like