Introduction
This document describes the Cisco NX-OS configuration limits for Cisco Nexus 9000 Series switches.
The values provided in this guide should not be interpreted as theoretical system limits for Cisco Nexus 9000 Series hardware or Cisco NX-OS software. These limits refer to values that have been validated by Cisco. They can increase over time as more testing and validation is done.
Verified Scalability Limits - Unidimensional
The tables in this section list the verified scalability limits for the Cisco Nexus 9000 Series switches for Cisco NX-OS Release 9.3(4).
These limits are validated with a unidimensional configuration. The values that are provided in these tables focus on the scalability of one particular feature at a time.
Each number is the absolute maximum that is currently supported by this Cisco NX-OS release for the corresponding feature. If the hardware is capable of higher scale, future software releases might increase this verified maximum limit. Results might differ from the values that are listed in this guide when you try to achieve maximum scalability with multiple features enabled.
Note |
|
Feature |
Supported Platforms |
Verified Limits |
---|---|---|
Fabric Extenders1 and Fabric Extender server interfaces |
Nexus 9300, 9300-EX, and 9300-FX switches |
16 and 768 |
Nexus 9500 switches |
32 and 1536 |
|
VLANs across all Fabric Extenders |
Nexus 9300 and 9500 switches |
2000 |
Nexus 9300-EX and 9300-FX switches |
562 |
|
VLANs per Fabric Extender server interface2 |
Nexus 9300, 9300-EX, 9300-FX, and 9500 switches |
75 |
Port channels |
Nexus 9300 switches |
256 |
Nexus 9300-EX and 9300-FX/FX2 switches + FEX |
511 |
|
Nexus 9500 switches |
426 |
|
Unique Fabric Extenders per Cisco Nexus 9500 Series supported line card |
Nexus 9500 switches |
12 |
Feature 3 |
Supported Platforms |
Verified Limits |
---|---|---|
FLOGI per port |
Nexus 93180YC-FX switches |
256 |
FLOGI per switch |
Nexus 93180YC-FX switches |
1000 |
Port channels |
Nexus 93180YC-FX switches |
84 |
Maximum number of member ports in a port channel |
Nexus 93180YC-FX switches |
16 |
VFCs |
Nexus 93180YC-FX switches |
544 |
VSANs |
Nexus 93180YC-FX switches |
32 |
Note |
For a list of platforms on which FCoE is supported, see the Cisco Nexus 9000 Series NX-OS FCoE Configuration Guide. |
Feature 5 |
Supported Platforms |
Verified Limits |
---|---|---|
FLOGI per port |
Nexus 93180YC-FX switches |
256 |
FLOGI per switch |
Nexus 93180YC-FX switches |
1000 |
Port channels |
Nexus 93180YC-FX switches |
8 6 |
Maximum member ports in a port channel |
Nexus 93180YC-FX switches |
16 |
Maximum FC ports |
Nexus 93180YC-FX switches |
48 |
VSANs |
Nexus 93180YC-FX switches |
32 |
Feature |
Supported Platforms |
Verified Limits |
---|---|---|
Nodes per device group |
Nexus 9200, 9300, and 9500 switches |
64 |
Nodes across all device groups |
Nexus 9200, 9300, and 9500 switches |
256 |
Device groups per switch |
Nexus 9200, 9300, and 9500 switches |
48 |
ITD services per switch |
Nexus 9200, 9300, and 9500 switches |
150 7 |
Ingress interfaces per ITD service |
Nexus 9200, 9300, and 9500 switches |
8 |
Virtual IP addresses per ITD service |
Nexus 9200, 9300, and 9500 switches |
255 |
Device groups per ITD service |
Nexus 9200, 9300, and 9500 switches |
48 |
Note |
|
Feature |
Supported Platforms |
Verified Limits |
---|---|---|
DHCP clients per switch |
Nexus 9200, 9300, 9300-EX, 9300-FX/FX2, 9500 switches, and the X9700-EX line cards |
10 (IPv4) + 10 (IPv6) |
Flex link |
Nexus 9300-EX, 9300-FX/FX2, and 9364C switches |
One pair consists of one each of active and backup interface. The active and backup interface can be either a physical port or port channel. |
IP DHCP relay addresses (helper addresses) per L3 interface |
Nexus 9200, 9300, 9300-EX, 9300-FX/FX2, 9500 switches, and the X9700-EX line cards |
32 (IPv4) + 32 (IPv6) |
Generic routing encapsulation (GRE) tunnels |
Nexus 9200, 9300-EX, 9300-FX/FX2, 9500 switches and the X9700-EX line cards |
16 |
Nexus 9300 switches |
8 |
|
LACP rate fast support during system switchover |
Nexus 9500 switches with X9700-EX and X9700-FX line cards |
606 ports in total on the Nexus 9516 switches with 16 line cards |
MAC address - table limit per port |
Nexus 9500 switches with N9K-X9636C-RX line cards |
2000 |
MAC address - table system, VLAN limit |
Nexus 9500 switches with N9K-X9636C-RX line cards |
2000 |
Port channel links |
Nexus 9200, 9300, 9300-EX, 9300-FX/FX2, 9500 switches, and the X9700-EX, X9636C-R/RX, X9636Q-R line cards |
32 |
SVIs |
Nexus 9200 switches |
490 |
Nexus 9300-EX and FX/FX2 switches |
1000 (with HSRP) 1000 HSRP groups |
|
Nexus 9300 switches |
450 (with HSRP) |
|
Nexus 9500 switches and the Nexus 9700-EX line cards |
490 (with HSRP), 1500 (without HSRP) |
|
Nexus 9600-R and 9600-RX line cards |
3967 |
|
Selective Q-in-Q with Multiprovider tag |
Nexus 93180YC-EX, 93180YC-FX, and 9336C-FX2 switches |
4000 mappings, 10 provider VLANs; System wide: 48,000 mappings, 512 Provider VLANs |
SVI Unnumbered |
Nexus 9200, 9300, 9300-EX, 9300-FX/FX2, and 9500 switches and the X9700-EX line cards |
Primary (50); Secondary (450), 1 primary SVI can have a maximum of 50 secondary SVIs |
vPCs |
Nexus 9200, Nexus 9300, and Nexus 9300-FX/FX2 switch |
80 |
Nexus 9300-EX switches |
48 |
|
Nexus 9500 switches and the X9700-EX line cards |
300 |
|
X9636C-R/RX and X9636Q-R line cards |
255 |
|
Static Network Address Translation (NAT) |
Nexus 9200, 9300, 9300-EX, 9300-FX, and 9300-FX2 switches |
1023 |
Dynamic Network Address Translation (NAT) |
Nexus 9200, 9300, 9300-EX, 9300-FX, and 9300-FX2 switches |
1023 |
Static twice Network Address Translation (NAT) |
Nexus 9200, 9300, 9300-EX, 9300-FX, and 9300-FX2 switches |
768 |
Dynamic twice Network Address Translation (NAT) |
Nexus 9200, 9300, 9300-EX, 9300-FX, and 9300-FX2 switches |
1023 |
Feature |
Supported Platforms |
Verified Limits |
|
---|---|---|---|
Forwarding Equivalence Classes (FECs) (Node /Prefix /Adj / Binding SID) |
Nexus 9200 switches |
MPLS Heavy Template: 512; Default: 128 |
|
Nexus 9300 and 9500 switches |
128 |
||
Nexus 9300-EX, and 9300-FX switches and the X9700-EX/FX line cards |
MPLS Heavy Template: 4096; Default: 1024 |
||
X9636C-R/RX and X9636Q-R line cards |
1000 |
||
Equal-cost multipaths (ECMPs) |
Nexus 9200, 9300, and 9500 switches |
16 |
|
Nexus 9300-EX and 9300-FX switches, and the X9700-EX/FX line cards |
32 |
||
X9636C-R/RX and X9636Q-R line cards |
8 - way |
||
Equal-cost multipaths Groups (ECMPs) |
Nexus 9300-EX and 9300-FX switches, and the X9700-EX/FX line cards |
MPLS Heavy Template: 4096; Default: 1024 |
|
N9K-X9636C-RX line cards |
24000 ECMP Groups 2 paths per ECMP
|
||
FECs * ECMPs |
Nexus 9200, 9300, and 9500 switches |
1000 |
|
X9636C-R/RX and X9636Q-R line cards |
8000 |
||
Flex counters for segment-routing in ingress direction |
Nexus 9300 and 9500 switches |
4000 (includes ingress and egress) |
|
Nexus 9200 switches |
4000 (includes ingress and egress) (MPLS Heavy Template) |
||
Nexus 9300-EX/FX switches and the X9700-EX/FX line cards |
Total ingress label stats: 4000; VRF ingress label stats: 1,000; (MPLS Heavy Template) |
||
Flex counters for segment-routing in Egress direction |
Nexus 9300 and 9500 switches |
4000 (includes ingress and egress) |
|
Nexus 2000 switches |
4000 (includes ingress and egress) (MPLS Heavy Template) |
||
Nexus 9300-EX/FX switches and the X9700-EX/FX line cards |
Total ingress label stats: 48000 (MPLS Heavy Template) |
||
Egress Peer Engineering |
Nexus 9200, 9300, 9300-EX, and 9300-FX switches and the X9700-EX/FX line cards |
64 |
|
IAS option B labels |
X9636C-R/RX and X9636Q-R line cards |
450000 |
|
Label-switched paths (LSPs) for label stack imposition8 |
Nexus 9300 and 9500 switches |
128 (with 4 - way ECMP and 3 label stack push) |
|
Nexus 9200 switches |
256 (with 32 - way ECMP and 5 label stack push) |
||
Nexus 9300-EX/FX switches and the X9700-EX/FX line cards |
256 (with 32 - way ECMP and 5 label stack push) |
||
Layer 3 VPN routes |
X9636C-R/RX and X9636Q-R line cards |
450000 |
|
Layer 3 EVPN Labels |
Nexus 9300 and 9500 switches |
128 |
|
Nexus 9200 switches |
128 (With MPLS Heavy Template) |
||
Nexus 9300-EX/FX switches and the X9700-EX/FX line cards |
1000 (With MPLS Heavy Template) |
||
LDP session |
N9K-X9636C-RX, N9K-X9636C-R, N9K-X9636Q-R, and N9K-96136YC-R line cards |
200 |
|
Node Sid/Prefix SID |
Nexus 9200, 9300, and 9500 switches |
128 |
|
Nexus 9300-EX/FX switches and the X9700-EX/FX line cards |
4,000 |
||
Adjacency SID |
Nexus 9200, 9300, and 9500 switches |
128 |
|
Nexus 9300-EX/FX switches and the X9700-EX/FX line cards |
600 |
||
Binding SID |
Nexus 9200, 9300, and 9500 switches |
50 |
|
Nexus 9300-EX/FX switches and the X9700-EX/FX line cards |
1000 |
||
Private VLANs (PVLANs) |
|||
Primary VLANs 9 |
Nexus 9300, 9500 switches, and the X9700-EX/FX line cards |
16 |
|
Nexus 9300-EX and 9300-FX/FX2 switches |
400 |
||
Secondary VLANs 10 |
Nexus 9300, 9500 switches, and the X9700-EX/FX line cards |
20 |
|
Nexus 9300-EX and 9300-FX/FX2 switches |
400 |
||
Ports in Community host mode |
Nexus 9300, Nexus 9300-EX, 9300-FX/FX2, and 9500 switches, and the X9700-EX/FX line cards |
40 |
|
Ports in isolated host mode |
Nexus 9500 switches |
20 |
|
Nexus 9300, Nexus 9300-EX, and 9300-FX/FX2 switches, and the X9700-EX/FX line cards |
40 |
||
Ports in isolated trunk host mode |
Nexus 9500 switches |
22 |
|
Nexus 9300, Nexus 9300-EX, 9300-FX/FX2 switches, and the X9700-EX/FX line cards |
40 |
||
Ports in promiscuous mode |
Nexus 9300-EX and 9300-FX switches |
10 |
|
Nexus 9500 switches |
48 |
||
Nexus 9300 and 9300-FX2 switches, and the X9700-EX/FX line cards |
5 |
||
Ports in promiscuous trunk mode |
Nexus 9300-EX and 9300-FX switches |
10 |
|
Nexus 9500 switches |
80 |
||
Nexus 9300 and 9300-FX2 switches, and the X9700-EX/FX line cards |
5 |
||
PVLANs allowed on a PVLAN port 11 |
Nexus 9300, 9500 switches, and the X9700-EX/FX line cards |
16 |
|
Nexus 9300-EX and 9300-FX/FX2 switches |
400 |
Note |
For network scalability, Cisco recommends using a hierarchical routing design with multi-hop BGP for advertising the attached prefixes from a top-of-rack (ToR) or border leaf switch. |
Feature |
Supported Platforms |
Verified Limits |
---|---|---|
MAC addresses |
Nexus 9200 and 9300-EX, 9300-FX/FX2 switches and the X9700-EX/FX line cards |
92000 |
Nexus 9300 and 9500 switches |
90000 |
|
Nexus 9364C switches |
90000 (default system routing mode without system routing layer 3 scale) 32000 (default system routing mode with system routing layer 3 scale) |
|
X9636C-R/RX and X9636Q-R line cards |
192000 |
|
N9K-C9264PQ, N9K-C9272Q, N9K-C9236C, N9K-C92300YC, N9K-C92304QC, N9K-C92300YC, and 9300-EX switches |
200000 12 |
|
MST instances |
Nexus 9200, 9300, 9300-EX, 9300-FX/FX2 switches and the X9700-EX/FX, X9636C-R/RX, and X9636Q-R line cards |
64 |
MST PV count with single instances 0 |
Nexus 9200, 9300-FX, and 9300-FX switches |
190000 |
MST virtual ports with more than 1 MST instance |
Nexus 9200, 9300, 9300-EX, and 9300-FX/FX2 switches |
48000 |
Nexus 9500 switches and the X9700-EX/FX line cards |
85000 |
|
X9636C-R/RX and X9636Q-R line cards) |
236000 |
|
RPVST virtual ports |
Nexus 9200, 9300, 9300-EX, and 9300-FX/FX2 switches |
12000 |
Nexus 9500 switches and the X9700-EX/FX line cards |
22,000 |
|
X9636C-R/RX and X9636Q-R line cards |
13750 |
|
VLANs |
Nexus 9200, 9300, 9300-EX, 9300-FX/FX2, and 9500 switches and the X9700-EX/FX, X9636C-R/RX, and X9636Q-R line cards |
3967 (the remaining 127 VLANs are reserved) |
Nexus 92348GC-X switches |
4096 |
|
VLANs in RPVST mode |
Nexus 9200 and 9300-EX/FX/FX2/FX3/GX switches |
3967 |
Nexus 9300 and 9500 switches |
500 |
|
X9700-EX/FX line cards |
396713 |
|
X9636C-R/RX and X9636Q-R line cards |
250 |
|
Total number of VLANs × ports with switch port isolated (3967 VLANs x 48 ports) |
Nexus 9200, 9300, 9300-EX, 9300-FX/FX2, and 9500 switches, and the X9700-EX/FX line cards |
190,000 |
Private VLANs (PVLANs) |
||
Primary VLANs |
Nexus 9300, 9300-EX/FX/FX2, 9500 switches and the Nexus 9700-EX line cards |
16 |
Secondary VLANs |
Nexus 9300, 9300-EX/FX/FX2, 9500 switches and the Nexus 9700-EX line cards |
20 |
Ports in Community host mode |
Nexus 9300, 9300-EX/FX/FX2, 9500 switches and the Nexus 9700-EX line cards |
40 |
Ports in isolated host mode |
Nexus 9500 switches |
20 |
Nexus 9300, 9300-EX/FX/FX2 switches and the Nexus 9700-EX line cards |
40 |
|
Ports in isolated trunk host mode |
Nexus 9500 switches |
22 |
Nexus 9300, 9300-EX/FX/FX2 switches and the Nexus 9700-EX line cards |
40 |
|
Ports in promiscuous mode |
Nexus 9500 switches |
48 |
Nexus 9300, 9300-EX/FX/FX2 switches and the Nexus 9700-EX line cards |
5 |
|
Ports in promiscuous trunk mode |
Nexus 9500 switches |
80 |
Nexus 9300, 9300-EX/FX/FX2 switches and the Nexus 9700-EX line cards |
5 |
|
PVLANs allowed on a PVLAN port |
Nexus 9300, 9300-EX/FX/FX2, 9500 switches and the Nexus 9700-EX line cards |
16 |
Note |
|
Feature |
Supported Platforms |
Verified Limits |
||||
---|---|---|---|---|---|---|
IPv4 multicast routes
|
Nexus 9200 and 9348GC-FXP switches |
8192 (Layer 2 + Layer 3)
|
||||
Nexus 9300 switches |
8192 (Layer 2 + Layer 3) |
|||||
Nexus 9300-EX switches and the X9700-EX line cards |
8192 (Layer 2 + Layer 3); 32768 (layer 2 + Layer 3 with system routing template - multicast -heavy mode); 8192 (with system routing template - lpm - heavy mode) |
|||||
Nexus 9332C and 9364C switches |
16384 (Layer 2 + Layer 3) with the default template and the system routing layer 3 scale configuration. |
|||||
Nexus 9300-FX/FX2 switches |
8192 (Layer 2 + Layer 3); 32768 (Layer 2 + Layer 3 with system routing template -multicast -heavy mode); 131072 (with system routing template -multicast - ext - heavy mode) |
|||||
Nexus 9500 switches |
32768 (Layer 2 + Layer 3) |
|||||
Nexus 9500 and 9300-GX switches and the X9700-FX line cards |
8192 (Layer 2 + Layer 3); 32768 (layer 2 + Layer 3 with system routing template - multicast -heavy mode); 131072 (with system routing template - multicast - ext - heavy mode) 14 |
|||||
X9636C-R/RX and X9636Q-R line cards |
32768 (Layer 3) |
|||||
IPv6 multicast routes |
Nexus 92160YC-X, 9300-EX, 9300-FX, and 9500 switches |
8192 (Layer 3 with system routing template - default, multicast - heavy, multicast - ext - heavy and multicast - heavy, multicast - ext - heavy, dual - stack - multicast) |
||||
Nexus 9300-FX2 and 9364C switches |
8192 (Layer 3 with system routing template -multicast -heavy mode) |
|||||
Nexus 9332C and 9364C switches |
8192 (Layer 2 + Layer 3 with system routing template -multicast -heavy mode) |
|||||
Nexus 9348GC-FXP switches |
8192 (layer 2 + Layer 3 with system routing template - multicast -heavy -multicast - ext - heavy mode) |
|||||
MLD snooping groups |
Nexus 9200, 9300, 9300-EX, and 9300-FX/FX2, 9500 switches and the X9700-EX/FX line cards |
8192 |
||||
Outgoing interfaces (OIFs) |
Nexus 9200, 9300, 9300-EX, 9300-FX/FX2, and 9500 switches and the X9700-EX/FX line cards |
40 (SVI + physical Layer 3) or 256 (physical Layer 3) |
||||
X9636C-R/RX and X9636Q-R line cards |
16 OIFs for 32K mroutes or 287 OIFs for 1000 mroutes |
|||||
IGMP snooping groups |
Nexus 9200, 9300, 9300-EX, and 9500 switches and the X9700-EX line cards |
8000 |
||||
Nexus 9600-R and 9600-RX line cards |
8000 |
|||||
Nexus 9300-FX/FX2 switches and the X9700-FX line cards |
16000 |
|||||
PIM neighbors |
Nexus 9200, 9300, 9300-EX, and 9300-FX/FX2 switches |
250 |
||||
Nexus 9500 switches and the X9700-EX/FX,X9636C-R/RX, and X9636Q-R line cards |
500 |
|||||
MVPN- unidimensional |
||||||
Multicast VRFs |
Nexus 9500 switches with -R/-RX line cards (except the N9K-X96136YC-R line card) |
100 |
||||
Multicast routes (including VRF and default) |
Nexus 9500 switches with -R/-RX line cards (except the N9K-X96136YC-R line card) |
20000 |
||||
Default MDT groups |
Nexus 9500 switches with -R/-RX line cards (except the N9K-X96136YC-R line card) |
100 |
||||
Data MDT groups |
Nexus 9500 switches with -R/-RX line cards (except the N9K-X96136YC-R line card) |
100 Data MDT groups per VRF. With 100 mVRFs (total 100*100= 10,000) |
||||
MVPN Peers (PIM neighbors) per device |
Nexus 9500 switches with -R/-RX line cards (except the N9K-X96136YC-R line card) |
100 |
Note |
|
Feature |
Verified Limits |
||
---|---|---|---|
Nodes |
35 (2 spines and 33 leafs) |
||
Routes |
32000 |
||
Host Policy |
|||
Sender |
8000 |
||
Receiver |
8000 |
||
PIM |
512 |
||
FlowPolicy |
2000 |
||
ASM group-range |
20 |
||
NBM Static Flows |
|||
Per switch maximum (receiver leaf where the static OIF will be programmed) mroutes |
1500 |
||
Per fabric maximum mroutes |
8000 |
||
VRFs |
16 |
||
RTP Flow Monitoring with ACL |
|||
ACL |
128 IPv4 ACL entries or 64 IPv6 ACL entries (total 128 TCAM spaces)
|
Note |
For a list of platforms on which IP Fabric for Media Solution is supported, see Cisco Nexus 9000 Series NX-OS IP Fabric for Media Solution Guide. |
Feature |
Supported Platforms |
Verified Limits |
---|---|---|
OpenFlow ports |
Nexus 9300 switches |
96 |
OpenFlow Layer 2 flows |
Nexus 9300 switches |
32000 |
OpenFlow Layer 3 flows |
Nexus 9300 switches |
3000 |
OpenFlow IPv6 Layer 3 flows |
Nexus 9300 switches |
1500 |
Feature |
Supported Platforms |
Verified Limits |
---|---|---|
Class maps per policy map |
Nexus 9300-GX switches |
128 |
AFD |
Nexus 9300-GX switches |
32 profiles |
WRED |
Nexus 9300-GX switches |
32 profiles |
Ingress 1R2C |
Nexus 9300-GX switches |
1280 |
Egress 1R2C |
Nexus 9300-GX switches |
256 |
Ingress 2R3C |
Nexus 9300-GX switches |
766 |
PFC all ports |
Nexus 9300-GX switches |
766 |
Total policy maps |
Nexus 9300-GX switches |
4000 |
Feature |
Supported Platforms |
Verified Limits |
---|---|---|
Egress ACLs |
Nexus 9200, 9300, 9300-EX, and 9300-FX/FX2 switches and Nexus 9500 platform switches with the -R and -RX line cards |
20000 |
System ACLs |
Nexus 9200, 9300, 9300-EX, and 9300-FX/FX2 switches and Nexus 9500 platform switches with the -R and -RX line cards |
4000 TCAM entries in internal TCAM 64000 TCAM entries in external TCAM |
ACLs |
Nexus 92348GC-X switches |
Ingress - 3072 IPv4, 1792 IPv6 |
RACL Labels (maximum) |
Nexus 93600CD-GX and 9316D-GX switches |
62 |
Nexus 9504 and 9508 switches |
4,000 |
|
DHCP snooping bindings |
Nexus 9200, 9300, 9300-EX, 9300-FX/FX2, and 9500 switches and the X9700-EX line cards |
2048 |
IPv4 ingress access control entries (ACEs) |
X9636C-R/RX and X9636Q-R line cards |
|
IPv6 ingress access control entries (ACEs) |
For X9636C-R/RX and X9636Q-R line cards |
|
IPv4 ingress TCAM entries |
Nexus 9200, 9300-EX, 9300-FX switches and the Nexus 9700-EX line cards |
3582 (per slice of the forwarding engine) |
Nexus 9300-FX2 switches |
3582 |
|
Nexus 9300 and 9500 switches |
3072 (per network forwarding engine) |
|
IPv4 egress TCAM entries |
Nexus 9200, 9300-EX, 9300-FX/FX2 switches and the Nexus 9700-EX line cards |
1792 (per slice of the forwarding engine) |
Nexus 9300 and 9500 switches |
768 (per network forwarding engine) |
|
IPv6 ingress TCAM entries |
Nexus 9200, 9300-EX, 9300-FX/FX2 switches and the Nexus 9700-EX line cards |
1792 (per slice of the forwarding engine) |
Nexus 9300 and 9500 switches |
1536 (per network forwarding engine) |
|
IPv6 egress TCAM entries |
Nexus 9200, 9300-EX, 9300-FX/FX2 switches and the Nexus 9700-EX line cards |
896 (per slice of the forwarding engine) |
Nexus 9300 and 9500 switches |
256 (per network forwarding engine) |
|
PT TCAM (when storing IPv4 ACEs) |
Nexus 93240YC-FX2 and 9336C-FX2 switches |
8192 |
PT TCAM (when storing IPv6 ACEs) |
Nexus 93240YC-FX2 and 9336C-FX2 switches |
2048 |
PT TCAM UDFs Supported |
||
PT TCAM (when storing IPv4 ACEs) |
Nexus 93240YC-FX2 and 9336C-FX2 switches |
UDFs are not supported |
PT TCAM (when storing IPv6 ACEs) |
Nexus 93240YC-FX2 and 9336C-FX2 switches |
3 |
Note |
|
Feature |
Supported Platforms |
Verified Limits |
---|---|---|
ARP |
Nexus 9300-GX switches |
48000 |
Host and LPM IPv4 routes |
Nexus 9300-GX switches |
470000 |
Host and LPM IPv6 routes |
Nexus 9300-GX switches |
256000 |
Leaf |
Nexus 9300-GX switches |
256 |
SID DB |
Nexus 9300-GX switches |
2,000 |
SRv6 and VXLAN Peer |
Nexus 9300-GX switches |
256 |
VRF |
Nexus 9300-GX switches |
1000 |
ND |
Nexus 9300-GX switches |
24000 |
Feature |
Supported Platforms |
Verified Limits |
|
---|---|---|---|
MPLS Stripping |
|||
Labels |
Nexus 9300 and 9500 switches |
12000 |
|
Ingress interfaces |
Nexus 9200 and 9300 switches |
48 |
|
Nexus 9500 switches |
400 |
||
Egress interfaces |
Nexus 9200 and 9300 switches |
16 |
|
Nexus 9500 switches |
64 |
||
PTP |
|||
PTP ports |
Nexus 9200, 9300, 9300-EX, 9300-FX, 9300-FX2, and 9500 switches |
64 |
|
N9K-C92160YC-X line cards |
44 |
||
X9700-EX line cards |
1305 |
||
9508-R line cards |
64 per line card 300 per chassis
|
||
PTP offload 15 |
N9K-X9564PX line cards |
32 PTP sessions per line card. |
|
N9K-X9636PQ line cards |
24 PTP session per line card. |
||
sFlow |
|||
sFlow ports |
Nexus 9200, 9300, 9300-EX, and 9300-FX/FX2 switches |
64 |
|
Nexus 9500 switches and the X9700-EX line cards |
256 |
||
SPAN and ERSPAN |
|||
Configurable SPAN or ERSPAN sessions |
Nexus 9200, 9300, 9300-EX, and 9300-FX/FX2 switches and the X9636C-R/RX and X9636Q-R line cards |
32 |
|
Active SPAN or ERSPAN sessions16 |
Nexus 9200, 9300, 9300-EX, 9300-FX/FX2, 9300-GX, and 9500 switches and the X9700-EX, X9636C-R/RX, and X9636Q-R line cards |
4 sessions (per chassis/ToR or based on the number of the line cards in the EoR.17 |
|
Active localized SPAN or ERSPAN sessions per line card18 |
Nexus 9200, 9300, 9300-EX, 9300-FX/FX2, and 9500 switches and the X9700-EX line cards |
4 |
|
X9636C-R/RX and X9636Q-R line card |
32 sessions across ports on single-line card |
||
Active localized SPAN or ERSPAN session (Rx and Tx, Rx, or Tx) |
X9636C-R/RX and X9636Q-R line cards |
32 sessions, 128 sources, and 1 destination |
|
Source interfaces per SPAN or ERSPAN session (Rx and Tx, Rx, or Tx) |
Nexus 9200, 9300, 9300-EX, 9300-FX/FX2, and 9500 switches and the X9700-EX line cards |
48 |
|
Destination interfaces per SPAN session |
Nexus 9200, 9300, 9300-EX, 9300-FX/FX2, and 9500 switches and the X9700-EX, X9636C-R/RX, and X9636Q-R line cards |
1 (physical/PO interface) |
|
Source VLANs per SPAN or ERSPAN session |
Nexus 9200, 9300, 9300-EX, 9300-FX/FX2, and 9500 switches and the X9700-EX, X9636C-R/RX, and X9636Q-R line cards |
32 |
|
Tap Aggregation |
|||
Redirect interfaces in the redirect port list |
Nexus 9200, 9300, 9300-EX, 9300-FX/FX2, and 9500 switches |
12 |
|
Redirect port lists (or fan outs) per system |
Nexus 9200, 9300-EX, and 9300-FX/FX2 switches |
12 |
|
Nexus 9300 and 9500 switches |
100 |
||
NetFlow |
|||
Flow monitors |
Nexus 9300-EX switches and Nexus 9500 switches with 9700-EX and FM-E fabric line cards |
2 flow monitors per type (2 IPv4 flow monitors and 2 IPv6 flow monitors). 1 flow monitor for CE flows 2 exporters for each flow monitor. Hence, a total of 4 different exporters can be configured. |
|
Nexus 9300-FX/FX2/GX switches and 9500 with FX LC cards |
30 IPv4 flow monitor and each flow monitor with two exporters 28 IPv6 flow monitor and each flow monitor with two exporters 32 Layer2 Flow monitor and each flow monitor with two exporters Maximum number of exporters supported per flow monitor is 2 |
||
Layer 3 interfaces (Layer 3 ports, port channels, and SVIs) to which IPv4 flow monitors can be applied |
Nexus 9300-EX switches |
1024 (with members on just one ASIC slice): 922 for IPv4/IPv6 flow monitors, while 32 are reserved for the Layer 2 flow monitors. Maximum number of SVIs supported:
Number of Layer 3 interfaces (Layer 3 ports, port channels, and SVIs) to which IPv4 flow monitors can be applied. You can use the show interface hardware-mappings command to check if the interface belongs to ASIC slice 0 or slice 1. |
|
Layer 3 interfaces (Layer 3 ports, port channels, and SVIs) to which IPv6 flow monitors can be applied |
Nexus 9300-EX switches |
252 (with members on just one ASIC slice) or 126 (with members on both ASIC slices). You can use the show interface hardware-mappings command to check if the interface belongs to ASIC slice 0 or slice 1. |
|
Maximum number of flows in the software table (IPv4 or IPv6 or CE flows) |
Nexus 9000 switches |
100000 flows using the show flow cache command |
|
Maximum number of concurrent flows supported (IPv4 or IPv6 or CE flows) |
Nexus 9300-EX/FX/FX2 switches |
6000 traffic flows. By increasing LCPU-PG-SIZE using the following command one can achieve Max 18000 concurrent flows, after modifying LCPU-PG-SIZE, the switch needs reboot after saving configuration
In Cisco Nexus Release 9.3(3), the hardware qos command is not supported. |
Note |
PTP is supported for all Cisco Nexus 9000 Series hardware except for the 100G 9408PC line card and the 100G M4PC generic expansion module (GEM). |
Feature |
Platform |
Port Speed |
Scale Limit (Flows) |
Export Interval (seconds) |
Packets / Flow |
---|---|---|---|---|---|
Layer 2 Flow monitor |
Nexus 9300-EX switches |
10G |
3,800 |
60 |
89,000 |
40G |
3,800 |
60 |
3,56,000 |
||
100G |
3,800 |
60 |
8,85,000 |
||
Nexus 9300-FX/FX2 switches |
10G |
6,000 |
60 |
89,000 |
|
40G |
6,000 |
60 |
3,56,000 |
||
100G |
6,000 |
60 |
8,85,000 |
||
Nexus 9300-GX switches |
10G |
6,000 |
60 |
89,000 |
|
40G |
6,000 |
60 |
3,56,000 |
||
100G |
6,000 |
60 |
8,85,000 |
||
Layer 3 Flow monitor (IPv4) |
Nexus 9300-EX |
10G |
27,000 |
60 |
12,000 |
40G |
27,000 |
60 |
54,000 |
||
100G |
27,000 |
60 |
1,60,000 |
||
Nexus 9300-FX/FX2 |
10G |
24,000 |
60 |
12,000 |
|
40G |
24,000 |
60 |
54,000 |
||
100G |
24,000 |
60 |
1,60,000 |
||
Nexus 9300-GX switches |
10G |
24,000 |
60 |
12,000 |
|
40G |
24,000 |
60 |
54,000 |
||
100G |
24,000 |
60 |
1,60,000 |
||
Layer 3 Flow monitor (IPv6) |
Nexus 9300-EX |
10G |
15,000 |
60 |
12,000 |
40G |
15,000 |
60 |
54,000 |
||
100G |
15,000 |
60 |
1,60,000 |
||
Nexus 9300-FX/FX2 |
10G |
11,000 |
60 |
12,000 |
|
40G |
11,000 |
60 |
54,000 |
||
100G |
11,000 |
60 |
1,60,000 |
||
Nexus 9300-GX |
10G |
11,000 |
60 |
12,000 |
|
40G |
11,000 |
60 |
54,000 |
||
100G |
11,000 |
60 |
1,60,000 |
Feature |
Supported Platforms |
Verified Limits |
||
---|---|---|---|---|
Unicast Routing |
||||
BFD sessions (echo mode) |
Nexus 9200, 9300, 9364C, 9300-EX, and 9300-FX/FX2, 9300-GX switches |
128
|
||
Nexus 9500 switches |
512 |
|||
X9700-EX /FX line cards |
51219 |
|||
X9636C-R/RX and X9636Q-R line cards |
288 |
|||
BGP neighbors |
Nexus 9200 switches |
512 (IPv4), 512 (IPv6), or 256 (IPv4 + IPv6) |
||
Nexus 92348GC-X switches |
141 |
|||
Nexus 9300, 9364C, 9300-EX, 9300-FX/FX2, and 9300-GX switches |
1024 (9346C, 9300-EX, 9300-FX/FX2) |
|||
Nexus 9500 switches and the X9700-EX/FX line cards |
2000 |
|||
X9636C-R/RX and X9636Q-R line cards |
960 |
|||
EIGRP routes |
Nexus 9200, 9300, 9364C, 9300-EX, 9300-FX/FX2, 9300-GX, and 9500 switches and the X9700-EX /FX line cards |
20,000 |
||
EIGRP neighbors |
Nexus 9200, 9300, 9364C, 9300-EX, 9300-FX/FX2, and 9300-GC switches |
256 |
||
Nexus 9500 switches and the X9700-EX/FX line cards |
512 |
|||
HSRP groups |
Nexus 9200, 9300, 9364C, 9300-EX, 9300-GX, and 9500 switches and the X9700-EX /FX, X9636C-R/RX, and X9636Q-R line cards |
490 |
||
Nexus 9300-EX and FX2 switches |
1000 20 |
|||
IPv4 ARP |
Nexus 9200 and 9364C switches |
32000 |
||
Nexus 9300 and 9500 switches and the X9700-EX /FX, X9636C-R/RX, and the X9636Q-R line cards |
48000 |
|||
Nexus 9300-EX and 9300-FX switches |
48000 (without URPF) 32000 (with URPF enabled) |
|||
Nexus 9300-FX2 and 9300-GX switches |
48000 / 32000 (with out/with urpf enabled) (in default routing mode, Hash Table: Shared between IPv6 ND, IPv4 ARP) |
|||
IPv4 host routes 21 |
Nexus 9200 switches |
96000 (hash table and there will be more collisions after 80%) |
||
Nexus 9300 and 9500 switches |
Default System Routing Mode: 208000 (hash table and there will be more collisions after 80%) |
|||
Nexus 9364C switches |
96000 (default system routing mode without system routing layer 3 scale) 128000 (default system routing mode with system routing layer 3 scale) |
|||
Nexus 9300-EX switches |
458000 (default); 786000 / 720000 (with system routing template - lpm - heavy mode) |
|||
Nexus 9300-FX switches |
471000 / 419000 (with out / with urpf enabled) (default); 786000 / 734000 (with system routing template - lpm -heavy mode) |
|||
Nexus 9300-FX2 and 9300-GX switches |
471000 (default); 786000 / 734000 (with out / with urpf enabled) (with system routing template - lpm -heavy mode) |
|||
X9700-EX line card |
589000 (default); 786000 (with system routing template - lpm -heavy mode) |
|||
X9636C-R line cards |
750000 |
|||
X9636C-RX line cards |
1000000 |
|||
IPv6 host routes 22 |
Nexus 9200 switches |
48000 (hash table and there will be more collisions after 80%) |
||
Nexus 9300 and 9500 switches |
Default System Routing Mode: 104000 (hash table and there will be more collisions after 80%); ALPM Routing Mode: 16000 with host Routes Programmed in the LPM Table. |
|||
Nexus 9364C switches |
48000 (default system routing mode without system routing layer 3 scale) 64000 (default system routing mode with system routing layer 3 scale) |
|||
Nexus 9300-EX switches |
24000 / 16000 (with out/with urpf enabled) |
|||
Nexus 9300-FX switches |
265000 / 235000 (with out/with urpf enabled) (default) 442,000 / 412000 (with out/with urpf enabled) (with system routing template -lpm - heavy mode) |
|||
Nexus 9300-FX2 and 9300-GX switches |
265000 (default), 442000 / 412000 (with out/with urpf enabled) (with system routing template -lpm - heavy mode) |
|||
X9700-EX/FX line cards |
32000 (FM-E), 235000 (FM-E2) |
|||
X9636C-RX line cards |
256000 |
|||
IPv6 ND |
Nexus 9200, 9364C, 9300-EX, 9300-FX2, and 9300-GX switches |
32000 (default), 16000 (lpm heavy) |
||
Nexus 9300 and 9500 switches |
48000 |
|||
Nexus 9300-FX |
32000 (in default routing mode, Hash Table: Shared between IPv6 ND, IPv4 ARP) |
|||
X9700-EX/FX, X9636C-R/RX, and X9636Q-R line cards |
32000 |
|||
IPv4 unicast routes (LPM)* |
Nexus 9200 switches |
|
||
Nexus 9300 switches |
12000 (default system routing mode); 128000 (ALPM routing mode) |
|||
Nexus 9364C switches |
Default system routing mode without system routing layer 3 scale:
128000 (default system routing mode with system routing layer 3 scale) |
|||
Nexus 9300-EX switches |
458000 (default) |
|||
Nexus 9300-FX switches |
471000 / 419000 (with out / with urpf enabled) (default) |
|||
Nexus 9300-FX2 and 9300-GX switches |
471000 (default) |
|||
Nexus 9300 switches |
128000 (default system routing mode); 16,000 (max-host routing mode) |
|||
Nexus 9500 switches |
128000 with no IPv6 routes (64-bit ALPM routing mode) |
|||
X9700-EX /FX line cards |
589000 (default) |
|||
N9K-X9636Q-R, N9K-9636C-R, and N9K-93180YC-R line cards |
192000 (Default system routing template) |
|||
X9636C-RX line cards |
1000000 (Default system routing template) |
|||
IPv6 unicast routes (LPM)* |
Nexus 9200 switches |
|
||
Nexus 9300 switches |
7000 (6000 routes < /64, 1000 routes > /64) (default system routing mode); 20000 (ALPM routing mode) |
|||
Nexus 9364C switches |
Default system routing mode without system routing layer 3 scale
64000 (default system routing mode with system routing layer 3 scale) |
|||
Nexus 9300-EX switches |
206000 (/64 prefix length); 1900 (non /64 prefix length) |
|||
Nexus 9300-FX switches |
265000 / 235000 (with out/with urpf enabled) (default) |
|||
Nexus 9300-FX2 and 9300-GX switches |
265000 (default) |
|||
Nexus 9500 switches |
20000 (default system routing mode) 4000 (max-host routing mode) 80000 with no IPv4 routes (64-bit ALPM routing mode) |
|||
X9700-EX /FX line cards |
176000 (/64 prefix length); 3900 (non /64 prefix length) ( FM-E ) and 235000 ( any prefix length) ( FM-E2) |
|||
X9636C-R, X9636Q-R, and X96136YC-R line cards |
62000 (Default system routing template) |
|||
X9636C-RX line cards |
256000 (Default system routing template) |
|||
IPv4 and IPv6 unicast routes (LPM) in 64-bit ALPM routing mode |
Nexus 9500 switches |
128000 (IPv4) and 80000 (IPv6) |
||
IPv4 host routes (LPM heavy mode) |
Nexus 9236C, 9272Q, and 92304QC switches |
262000 |
||
Nexus 92160YC-X switches |
650000 |
|||
Nexus 9364C switches |
262000 |
|||
Nexus 9300-EX switches |
786000 / 720000 (with out/with urpf enabled) |
|||
Nexus 9300-FX switches |
786000 / 734000 (with out/with urpf enabled) |
|||
Nexus 9300-FX2 and 9300-GX switches |
786000 / 734000 (with out/with urpf enabled) |
|||
X9700-EX /FX line cards |
786,000 |
|||
IPv6 host routes (LPM heavy mode) |
Nexus 9200 switches |
16000 |
||
Nexus 9364 switches |
131000 |
|||
Nexus 9300-EX switches |
24000 / 16000 (with out/with urpf enabled) (protocol learned host) |
|||
Nexus 9300-FX/FX2 and 9300-GX switches |
442000 / 412000 (with out/with urpf enabled) (protocol learned host) |
|||
X9700-EX/FX line cards |
32000 (shared between IPv6 ND and protocol learned host) ( FM-E ) and 235000 ( FM-E2) |
|||
IPv4 LPM routes (LPM heavy mode) |
Nexus 9236C, 9272Q, and 92304QC switches |
262000 |
||
Nexus 92160YC-X switches |
650000 |
|||
Nexus 9364C switches |
262000 |
|||
Nexus 9300-EX switches |
786000 / 720000 (with out/with urpf enabled) |
|||
Nexus 9300-FX switches |
786000 / 734000 (with out/with urpf enabled) |
|||
Nexus 9300-FX2 and 9300-GX switches |
786000 / 734000 (with out/with urpf enabled) |
|||
X9700-EX/FX line cards |
786000 |
|||
IPv6 LPM routes (LPM heavy mode) |
Nexus 9236C, 9272Q, and 92304QC switches |
131000 (/64 prefix length); 1900 (non /64 LPM scale) |
||
Nexus 92160YC-X switches |
294000 (/64 prefix length); 1900 (non /64 LPM scale) |
|||
Nexus 9364C switches |
131000 |
|||
Nexus 9300-EX switches |
353000 / 324000 (with out/with urpf enabled) (/64 prefix length); 1900 (non /64 prefix length) |
|||
Nexus 9300-FX/FX2 and 9300-GX switches |
442000 / 412000 (with out/with urpf enabled) |
|||
X9700-EX /FX line cards |
235000 (/64 prefix length); 3900 (non /64 prefix length) ( FM-E) and 235000 (any prefix len) (FM-E2) |
|||
IPv4 host routes (dual-host mode) |
Nexus 9200 and 9364C switches |
163000 |
||
Nexus 9300-EX and 9300-FX/FX2, and 9300-GX switches |
262000 |
|||
IPv6 host routes (dual-host mode) |
Nexus 9200 and 9364C switches |
81000 |
||
Nexus 9300-EX and 9300-FX/FX2, 9300-GX switches |
131000 |
|||
IPv4 LPM routes (dual-host mode) |
Nexus 9200 and 9300-EX switches |
6000 |
||
Nexus 9300-FX and 9364C switches |
8000 |
|||
Nexus 9300-FX2 and 9300-GX switches |
10,000 |
|||
Nexus 9500 switches with the X9700-EX/FX line cards |
Not supported |
|||
IPv6 LPM routes (dual-host mode) |
Nexus 9200, 9300-EX, 9364C, and 9300-FX switches |
1900 |
||
Nexus 9300-FX2 and 9300-GX switches |
3900 |
|||
Nexus 9500 switches with the X9700-EX/FX line cards |
Not supported |
|||
IPv4 ARP (dual-host mode) |
Nexus 9200, 9300, 9364C, 9300-EX, 9300-FX/FX2, and 9300-GX switches |
64000 |
||
IPv6 ND (dual-host mode) |
Nexus 9200, 9300, 9364C, 9300-EX, 9300-FX/FX2, and 9300-GX switches |
64000 |
||
IPv4 host routes (internet-peering mode)
|
Nexus 9300-EX, 9300-FX/FX2, and 9300-GX switches |
1 Million (protocol learned host) |
||
Nexus 9500 with X9700-EX /FX line cards |
1 Million (protocol learned host) |
|||
IPv6 host routes (internet-peering mode)
|
Nexus 9300-EX switches |
16000 (Hash Table: Shared between IPv6 ND and protocol learned IPv6 host) |
||
Nexus 9300-FX/FX2 and 9300-GX switches |
500,000 (protocol learned host) |
|||
Nexus 9500 with X9700-EX line cards |
16000 (Hash Table: Shared between IPv6 ND and protocol learned IPv6 host) |
|||
Nexus 9500 with X9700-FX line cards |
500,000 (protocol learned host) |
|||
IPv4 LPM routes (internet-peering mode)
|
Nexus 9300-EX, 9300-FX/FX2, and 9300-GX switches |
1 Million (protocol learned host) |
||
Nexus 9500 with X9700-EX /FX line cards |
1 Million (protocol learned host) |
|||
IPv6 LPM routes (internet-peering mode)
|
Nexus 9300-EX switches |
500,000 (Prefix length 0-83) protocol learned host 1900 (Prefix length /84-127) |
||
Nexus 9500 with X9700-EX line cards |
500,000 (Prefix length 48-83) protocol learned host 1900 (Prefix length /84-127) |
|||
Nexus 9500 with X9700-FX line cards |
500,000 (Prefix length 48-128) protocol learned host |
|||
Nexus 9500 with FM-E and FM-E2 fabric line cards |
176,000 ( Prefix length 0-47 ) protocol learned host |
|||
Routes (internet-peering mode) |
Nexus 9500 switches with the N9K-X9636Q-R and N9K-9636C-R line cards |
1 Million23 |
||
IPv4 routes (internet-peering mode) |
Nexus 9500 switches with the N9K-X9636Q-R and N9K-9636C-R line cards |
85200024 |
||
IPv6 routes (internet-peering mode) |
Nexus 9500 switches with the N9K-X9636Q-R and N9K-9636C-R line cards |
17500025 |
||
Routes (internet-peering mode) |
Nexus 9500 switches with the N9K-96136YC-R line cards |
852000 |
||
IPv4 routes (internet-peering mode) |
Nexus 9500 switches with the N9K-96136YC-R line cards |
781000 |
||
IPv6 routes (internet-peering mode) |
Nexus 9500 switches with the N9K-96136YC-R line cards |
71000 |
||
IPv4 ARP (internet peering mode) |
Nexus 9300-EX switches and the X9700-EX/FX line cards |
32000 (Hash Table: Shared between IPv6 ND, IPv4 ARP, and protocol learned IPv6 host) |
||
Nexus 9300-FX/FX2 and 9300-GX switches |
32000 (Hash Table: Shared between IPv6 ND, IPv4 ARP) |
|||
IPv6 ND (internet-peering mode) |
Nexus 9300-EX switches and the X9700-EX/FX line cards |
16000 (Hash Table: Shared between IPv6 ND, IPv4 ARP, and protocol learned IPv6 host) |
||
Nexus 9300-FX/FX2 and 9300-GX switches |
16000 (Hash Table: Shared between IPv6 ND, IPv4 ARP) |
|||
IS-ISv4 adjacencies (either L1, L2, or sum of L1 and L2 with default timers) |
Nexus 9200, 9300, 9364C, 9300-EX, 9300-FX/FX2, 9300-GX, and 9500 switches and the X9700-EX /FX line cards |
255 |
||
IS-ISv4 BFD sessions (with default timers) |
Nexus 9300, 9364C, 9300-EX, 9300-FX/FX2, 9300-GX, and 9500 switches and the X9700-EX/FX line cards |
255 |
||
IS-ISv4 routes |
Nexus 9200, 9300, 9364C, 9300-EX, 9300-FX/FX2, 9300-GX, and 9500 switches and the X9700-EX /FX line cards |
10000 |
||
IS-ISv4 network type |
Nexus 9200, 9300, 9364C, 9300-EX, 9300-FX/FX2, 9300-GX, and 9500 switches and the X9700-EX/FX line cards |
Point to point, broadcast |
||
Groups with default timers (3s/10s) and multiple group optimizations. [There are 2 primary, one for IPv4 and the other for IPv6, and 7926 secondary] |
X9636C-R/RX and X9636Q-R line cards |
7928 |
||
Groups with aggressive timers (1s/3s) and multiple groups optimization. [There are 2 primary, one for IPv4 and the other for IPv6, and 7926 secondary]26 |
X9636C-R/RX and X9636Q-R line cards |
7928 |
||
Groups per interface or I/ module |
X9636C-R/RX and X9636Q-R line cards |
Maximum 16 (Because 16 is the unique virtual MAC address limit) |
||
OSPF/OSPFv3 LSA/LSDB size |
X9636C-R/RX and X9636Q-R line cards |
250000 |
||
OSPF/OSPFv3 areas |
X9636C-R/RX and X9636Q-R line cards |
15 |
||
OSPFv2 neighbors |
Nexus 9500 switches and the X9700-EX /FX, X9636C-R/RX, and X9636Q-R line cards |
1000 |
||
Nexus 9200, 9300, 9364C, 9300-EX, 9300-FX/FX2, 9300-GX, and 9500 switches |
256 |
|||
OSPFv3 neighbors |
Nexus 9500 switches and the X9700-EX/FX, X9636C-R/RX, and X9636Q-R line cards |
1000 |
||
Nexus 9200, 9300, 9364C, 9300-EX, 9300-FX/FX2, 9300-GX, and 9500 switches |
256 |
|||
OSPF/OSPFv3 LSA/LSDB size |
Nexus 9200, 9300, 9364C, 9300-EX, 9300-FX/FX2, 9300-GX, and 9500 switches and the X9700-EX/FX line cards |
100000 |
||
OSPF/OSPFv3 areas |
Nexus 9200, 9300, 9364C, 9300-EX, 9300-FX, 9300-FX2, 9300-GX, and 9500 switches and the X9700-EX/FX line cards |
100 |
||
EIGRP instance |
Nexus 9200, 9300, 9364C, 9300-EX, 9300-FX, 9300-FX2, 9300-GX, and 9500 switches and the X9700-EX/FX line cards |
15 |
||
IS-IS instance |
Nexus 9200, 9300, 9364C, 9300-EX, 9300-FX, 9300-FX2, 9300-GX, and 9500 switches and the X9700-EX/FX line cards |
16 |
||
OSPF instance |
Nexus 9200, 9300, 9364C, 9300-EX, 9300-FX, 9300-FX2, 9300-GX, and 9500 switches and the X9700-EX/FX line cards |
16 |
||
OSPFv3 instance |
Nexus 9200, 9300, 9364C, 9300-EX, 9300-FX, 9300-FX2, 9300-GX, and 9500 switches and the X9700-EX/FX line cards |
16 |
||
Static routes |
Nexus 9200, 9300, 9364C, 9300-EX, 9300-FX, 9300-FX2, 9300-GX, and 9500 switches and the X9700-EX/FX line cards |
8000 |
||
VRFs |
Nexus 9200, 9300, 9364C, 9300-EX, 9300-FX/FX2, 9300-GX, and 9500 switches and the X9700-EX/FX line cards |
1000 |
||
X9636C-R/RX and X9636Q-R line cards |
3967 |
|||
VRRP groups per interface or I/O module |
Nexus 9200, 9300, 9364C, 9300-EX, 9300-FX/FX2, 9300-GX, and 9500 switches and the X9700-EX/FX line cards |
250 |
||
Policy-based routing (PBR) |
||||
Configured sequences per policy |
Nexus 9200, 9300-EX, 9300-FX/FX2 switches and the X9700-EX/FX line cards |
128 |
||
Nexus 9300 and 9500 switches |
256 |
|||
Next-hop addresses per policy |
Nexus 9200, 9300, 9300-EX, 9300-FX/FX2, and 9500 switches and the X9700-EX/FX line cards |
32 |
||
IPv4 ACEs (unidimensional) |
Nexus 9200, 9300-EX, and 9300-FX/FX2 switches and the X9700-EX /FX line cards |
3582 (per network forwarding engine) |
||
Nexus 9300 and 9500 switches |
3072 (per network forwarding engine) |
|||
IPv6 ACEs (unidimensional) |
Nexus 9200, 9300-EX, and 9300-FX/FX2 switches |
1792 (per network forwarding engine) |
||
Nexus 9300 and 9500 switches |
1536 (per network forwarding engine) |
|||
IPv4 and IPv6s ACEs |
Nexus 9200, 9300-EX, and 9300-FX/FX2 switches |
1024 IPv4 + 128 IPv6 |
||
Nexus 9300 and 9500 switches |
2048 IPv4 + 256 IPv6 |
|||
X9700-EX/FX line cards |
1024 IPv4 |
|||
Interfaces with PBR policy |
Nexus 9200, 9300-EX, and 9300-FX/FX2 switches and the X9700-EX/FX line cards |
512 |
||
Nexus 9300 and 9500 switches |
256 |
|||
VRRPv3 |
||||
VRRPv3 groups per interface |
Nexus 9200, 9300-EX, and 9300-FX/FX2, and 9300-GX switches and the X9700-EX /FX line cards |
255 |
||
VRRPv3 groups with default timers (1 s) |
Nexus 9200, 9300-EX, and 9300-FX/FX2, and 9300-GX switches and the X9700-EX/FX line cards |
490 |
||
VRRPv3 groups with relaxed timers (3 s) |
Nexus 9200, 9300-EX, and 9300-FX/FX2, and 9300-GX switches and the X9700-EX /FX line cards |
490 |
||
Pathways with one VRRPv3 group with default timer (1 s) |
Nexus 9200, 9300-EX, and 9300-FX/FX2, and 9300-GX switches and the X9700-EX/FX line cards |
489 |
||
VRRPv3 groups and pathways combined |
Nexus 9200, 9300-EX, and 9300-FX/FX2, and 9300-GX switches and the X9700-EX/FX line cards |
490 |
||
ECMP |
||||
ECMP Paths |
Nexus 9200, 9300-EX, and 9300-FX/FX2/FXP, and 9300-GX switches and Nexus 9504/9508 switches with -R/ RX line cards |
64 |
For the Cisco Nexus 9200 Platform switches, the default value for LPM unicast routes is 6000 (IPv4) or 1900 (IPv6). You can use the hardware profile multicast max-limit lpm-entries 0 command to increase the number of IPv4 LPM unicast routes to 8000. The hardware profile ipv6 lpm-entries maximum 0 command reserves the entire LPM table for IPv4. With this configuration, the IPv4 LPM scale is 14,000 (with 2000 reserved for multicast by default). This value can be increased to 16,000 with the hardware profile multicast max-limit lpm-entries 0 command. The hardware profile ipv6 lpm-entries maximum 4096 command reserves the entire LPM table for IPv6. With this configuration, the IPv6 LPM scale is 3900. When you allocate the entire table for IPv4 or IPv6 LPM unicast routes, the other address family cannot be used.
The maximum number of PBR next-hops based on 4 FM-E supported is 192 per slice of the forwarding engine
Note |
|
Guidelines and Limitations for OSPF Verified Scalability Limits
-
To achieve the highest scale, we recommend that you use a single OSPF instance instead of multiple instances.
-
Each OSPFv2 and OSPFv3 scale value might vary when combined with other parameters.
-
The graceful restart timeout value might need to be increased in multi-dimensional scenarios.
Feature |
Supported Platforms |
Verified Limits |
---|---|---|
Primary VLANs |
Nexus 9300-EX and 9300-FX/FX2 switches |
16 |
Secondary VLANs |
Nexus 9300-EX and 9300-FX/FX2 switches |
20 |
Ports in community host mode |
Nexus 9300-EX and 9300-FX/FX2 switches |
40 |
Port in Isolated host mode |
Nexus 9300-EX and 9300-FX/FX2 switches |
40 |
Ports in isolated trunk mode |
Nexus 9300-EX and 9300-FX/FX2 switches |
40 |
Ports in promiscuous mode |
Nexus 9300-EX and 9300-FX/FX2 switches |
5 |
PVLANs allowed on a PVLAN port |
Nexus 9300-EX and 9300-FX/FX2 switches |
16 |
Feature |
Supported Platforms |
Verified Limits |
---|---|---|
IGMP snooping over VXLAN |
||
VXLAN VLANs |
Nexus 9200, 9300, 9300-EX, and 9300-FX/FX2 and the X9700-EX/FX line cards |
1000 |
VTEP Peers27 |
Nexus 9200 and 9300 switches |
256 |
Nexus 9300-EX, 9300-FX/FX2, and 9500 switches and the X9700-EX/FX, X9636C-R/RX, and X9636Q-R line cards |
512 |
|
Underlay multicast groups |
Nexus 9200, 9300, 9300-EX, and 9300-FX/FX2 switches and the X9700-EX/FX line cards |
128 |
Multi-Site 28 |
||
Number of Sites |
Nexus 9200 and 9300 switches |
10 |
Nexus 9300-EX, 9300-FX/FX2, 9332C, 9364C, and 9500 switches and the X9700-EX/FX line cards |
25 |
|
Number of BGWs per site with TRM enabled29 |
Nexus 9200, 9300, 9332C, 9364C, and 9500 switches and the X9700-EX/FX line cards |
2 (Anycast), 2(vPC) |
Nexus 9300-EX and 9300-FX/FX2 switches |
6 (Anycast), 2(vPC) |
|
Number of sites for TRM |
Nexus 9200, 9300, 9300-EX, 9300-FX/FX2, 9332C, 9364C, and 9500 switches and the X9700-EX/FX line cards switches |
15 sites |
Number of BGWs for TRM |
Nexus 9200, 9300, 9300-EX, 9300-FX/FX2, 9332C, 9364C, and 9500 switches and the X9700-EX/FX line cards switches |
06 BGW |
VTEPs per Site |
Nexus 9200, 9300, 9300-EX, 9300-FX/FX2, and 9500 switches and the X9700-EX/FX line cards |
256 |
Tenant Route Multicast L3 Mode with VXLAN BGP eVPN |
||
VXLAN Layer 2 VNI |
Nexus 9200, 9300, 9300-EX, and 9300-FX/FX2 and the X9700-EX/FX line cards |
1000 |
VXLAN Layer 3 VNI/VRFs |
Nexus 9200, 9300, 9300-EX, and 9300-FX/FX2 and the X9700-EX/FX line cards |
250 |
VTEP Peers |
Nexus 9200, 9300, 9300-EX, and 9300-FX/FX2 and the X9700-EX/FX line cards |
256 |
Underlay Multicast Group (PIM ASM Underlay) |
Nexus 9200, 9300,9300-EX, and 9300-FX/FX2 and the X9700-EX/FX line cards |
230 |
Overlay Multicast Group (PIM ASM & PIM SSM) |
Nexus 9200, 9300, 9300-EX, and 9300-FX/FX2 and the X9700-EX/FX line cards |
720031 |
VXLAN Flood and Learn |
||
Virtual network identifiers (VNIs) or VXLAN-mapped VLANs |
Nexus 9200, 9300, 9300-EX,and 9300-FX/FX2 switches |
2000 |
Nexus 9500 switches and the X9700-EX/FX line cards |
1000 |
|
Underlay multicast groups |
Nexus 9200, 9300, 9300-EX, 9300-FX/FX2, and 9500 switches and the X9700-EX/FX line cards |
128 |
Overlay MAC addresses |
Nexus 9200, 9300, and 9500 switches |
64000 |
Nexus 9300-EX and 9300-FX switches and the X9700-EX/FX line cards |
90000 |
|
Nexus 9300-FX2 switches |
60000 |
|
Remote VXLAN tunnel endpoints (VTEPs Multicast) |
Nexus 9200, 9300, 9300-EX, 9300-FX/FX2, 9364C-EX, and 9500 switches and the X9700-EX/FX line cards |
256 |
Ingress replication peers 32 |
Nexus 9200, 9300, 9300-EX, 9300-FX/FX2, and 9500 switches and the X9700-EX/FX line cards |
256 |
Ingress replication Layer 2 VNIs |
Nexus 9200, 9300, 9300-EX, 9300-FX/FX2, and 9500 switches and the X9700-EX/FX line cards |
1000 |
MAC addresses for ingress replication |
Nexus 9200, 9300, and 9500 switches |
64000 |
Nexus 9300-EX and 9300-FX/FX2 switches and the X9700-EX/FX line cards |
90000 |
|
Port VLAN translations under an interface |
Nexus 9300 and 9500 switches and the X9700-EX/FX line cards |
100 |
Nexus 9300-EX and 9300-FX switches |
4000 |
|
Nexus 9300-FX2 switches |
500 |
|
Port VLAN translations in a switch |
Nexus 9300 switches and the X9700-EX/FX line cards |
2000 |
Nexus 9300-EX and 9300-FX, switches |
24000 |
|
Nexus 9300-FX2 switches |
6000 |
|
Nexus 9500 switches |
200 |
|
Static MAC addresses pointing to a remote VTEP |
Nexus 9200, 9300, 9300-EX, 9300-FX/FX2, and 9500 switches and the X9700-EX/FX line cards |
1000 |
VXLAN VLAN logical port VP count |
Nexus 9300 and 9500 switches |
7000 |
VXLAN VLANs per FEX port (host interface) |
Nexus 9300 and 9500 switches |
75 |
Nexus 93180YC-EX |
7533 |
|
Layer 2 routed VNIs for vPC-centralized gateway |
Nexus 9200, 9300, 9300-EX, 9300-FX/FX2, and 9500 switches and the X9700-EX/FX line cards |
450 |
IGMP groups |
Nexus 9200, 9300, 9300-EX, 9300-FX/FX2, and 9500 switches and the X9700-EX/FX line cards |
8192 |
VXLAN BGP eVPN |
||
Layer 2 VNIs |
Nexus 9200 and 9300 switches and the X9636C-R/RX and X9636Q-R line cards |
2000 |
Nexus 9300-EX and 9300-FX/FX2 switches |
2000, 4000 (with no Layer 3 VNIs) |
|
Nexus 9500 switches and the X9700-EX/FX line cards |
1000 |
|
Xconnect VLANs |
Nexus 9300, 9332C, 9300-EX, 9300-FX/FX2, and 9300-GX switches |
40 |
SVI with Distributed Anycast Gateway; Layer 2 VNI extended |
Nexus 9300-EX switches |
200034 |
Nexus 9300-EX switches |
200035 |
|
Nexus 9300 and 9300-FX/FX2 switches |
2000 |
|
Nexus 9500 switches and the X9700-EX/FX line cards |
1000 |
|
Layer 3 VNIs / VRFs36 |
Nexus 9200, 9300, 9300-EX, and 9300-FX/FX2 switches and the X9636C-R/RX and X9636Q-R line cards |
900 |
Nexus 9500 switches and the X9700-EX/FX line cards |
750 |
|
Underlay multicast groups |
Nexus 9200, 9300, 9300-EX, and 9300-FX/FX2, and 9500 switches and the X9700-EX/FX line cards |
128 |
VTEPs |
Nexus 9200, 9300, 9300-EX, and 9300-FX/FX2, and 9500 switches and the X9700-EX FX, X9636C-R/RX, and X9636Q-R line cards |
512 |
MAC addresses |
Nexus 9200, 9300, and 9500 switches |
64000 |
Nexus 9300-EX and 9300-FX/FX2 switches and the X9700-EX /FX line cards |
90000 |
|
Nexus 92348GC-X switches |
97000 |
|
Port VLAN translations under an interface |
Nexus 9300 and 9500 switches and the X9700-EX/FX line cards |
100 |
Nexus 9300-EX, 9300-FX, and 9300-GX switches |
4000 |
|
Nexus 9300-FX2 switches |
500 |
|
Port VLAN translations in a switch |
Nexus 9300 and 9300-GX switches and the X9700-EX/FX line cards |
2000 |
Nexus 9300-EX, 9300-FX, and 9300-GX switches |
24000 |
|
Nexus 9300-FX2 switches |
6000 |
|
Nexus 9500 switches |
200 |
|
IPv4 host routes |
Nexus 9200, 9300, and 9500 switches |
60000 |
Nexus 92348GC-X switches |
16000 |
|
Nexus 9300-EX switches |
458000 |
|
Nexus 9300-FX/FX2 switches |
471000 |
|
X9700-EX/FX line cards |
656000 |
|
X9636C-R/RX and X9636Q-R line cards |
128000 |
|
IPv6 host routes |
Nexus 9200, 9300, and 9500 switches |
7000 |
Nexus 9300-EX switches |
24000 |
|
Nexus 9300-FX/FX2 switches |
265000 |
|
X9700-EX/FX line card |
34000 |
|
X9636C-R/RX and X9636Q-R line cards |
32000 |
|
Overlay IPv4 LPM routes |
Nexus 9200 switches |
8000 |
Nexus 9300 and 9500 switches |
12000 |
|
Nexus 9300-EX switches |
458000 |
|
Nexus 9300-FX/FX2 switches |
471000 |
|
X9700-EX/FX line cards |
656000 |
|
Overlay IPv6 LPM routes |
Nexus 9200 switches |
2000 |
Nexus 9300 and 9500 switches |
7000 |
|
Nexus 9300-EX switches |
20600037 |
|
Nexus 9300-FX/FX2 switches |
26500038 |
|
X9700-EX/FX line cards |
17400039 |
|
VXLAN VLAN logical port VP count |
Nexus 9300 switches |
10,000 |
Nexus 9500 switches |
7000 |
|
VXLAN VLANs per FEX port (host interface) |
Nexus 9500 switches |
75 |
IGMP groups |
Nexus 9200, 9300, 9300-EX, and 9300-FX/FX2, and 9500 switches and the X9700-EX/FX line cards |
8192 |
VXLAN BGP eVPN Ingress Replication |
||
Layer 2 VNIs |
Nexus 9200, 9300, 9300-EX, and 9300-FX/FX2 switches |
2000 |
Nexus 9500 switches and the X9700-EX/FX line cards |
1000 |
|
Xconnect VLANs |
Nexus 9300, 9300-EX, and 9300-FX/FX2, and 9300-GX switches |
40 |
Selective Qinvni with multiprovider tag |
Nexus 93180YC-EX, 93180YC-FX, and 9336C-FX2 switches |
4000 mappings, 10 provider VLANs; System wide: 48,000 mappings, 512 Provider VLANs |
SVI with Distributed Anycast Gateway; Layer 2 VNI extended |
Nexus 9200 and 9300-EX switches |
200040 |
Nexus 9300 and 9300-FX/FX2 switches |
2000 |
|
Nexus 9500 switches and the X9700-EX/FX line cards |
1000 |
|
Layer 3 VNIs / VRFs41 |
Nexus 9200, 9300, 9300-EX, and 9300-FX/FX2 switches |
900 |
Nexus 9500 switches and the X9700-EX/FX line cards |
750 |
|
VTEPs |
Nexus 9200, 9300, 9300-EX, 9300-FX/FX2, and 9500 switches and the X9700-EX/FX line cards |
512 |
MAC addresses |
Nexus 9200, 9300, and 9500 switches |
64000 |
Nexus 9300-EX and 9300-FX/FX2 switches and the X9700-EX/FX line cards |
90000 |
|
IPv4 host routes |
Nexus 9200, 9300, and 9500 switches |
32000 |
Nexus 9300-EX switches |
458000 |
|
Nexus 9300-FX/FX2 switches |
471000 |
|
X9700-EX/FX line cards |
656000 |
|
IPv6 host routes |
Nexus 9200, 9300, and 9500 switches |
7000 |
Nexus 9200, 9300, and 9500 switches |
24000 |
|
Nexus 9300-EX switches |
206000 |
|
Nexus 9300-FX/FX2 switches |
265000 |
|
X9700-EX/FX line cards |
34000 |
|
Overlay IPv4 LPM routes |
Nexus 9200 switches |
8000 |
Nexus 9300 and 9500 switches |
12000 |
|
Nexus 9300-EX switches |
458000 |
|
Nexus 9300-FX/FX2 switches |
471500 |
|
X9700-EX/FX line cards |
656000 |
|
Overlay IPv6 LPM routes |
Nexus 9200 switches |
2000 |
Nexus 9300 and 9500 switches |
7000 |
|
Nexus 9300-EX switches |
20600042 |
|
Nexus 9300-FX/FX2 switches |
26500043 |
|
X9700-EX/FX line cards |
174,00044 |
|
VXLAN VLAN logical port VP count |
Nexus 9300 and 9500 switches |
7500 |
VXLAN VLANs per FEX port (host interface) |
Nexus 9300 and 9500 switches |
75 |
IGMP groups |
Nexus 9200, 9300, 9300-EX, 9300-FX/FX2, and 9500 switches and the X9700-EX/FX line cards |
8192 |
VXLAN Static Tunnels |
||
VNIs |
Nexus 9300-EX, 9300-FX, 9300-FX2, and 9364C switches |
100 |
VRFs |
Nexus 9300-EX, 9300-FX, 9300-FX2, and 9364C switches |
100 |
VTEP peers |
Nexus 9300-EX, 9300-FX, 9300-FX2, and 9364C switches |
256 |
v4 routes |
Nexus 9300-EX, 9300-FX, 9300-FX2, and 9364C switches |
10000 |
Feature |
Supported Platforms |
Verified Limit |
---|---|---|
TCAM size |
Nexus 92160YC-X, 9300-EX, and 9300-FX switches |
1024 entries |
Nexus 92160YC-X switches |
IPv4 – 4 entries per rule (TCP, UDP, ICMP, and IP) |
|
Nexus 9300-EX, and 9300-FX switches |
IPv4 – 2 entries per rule (ICMP and IP) |
|
Nexus 92160YC-X switches |
IPv6 – 8 entries per rule (4 entries per ICMP and IPv6 for a total of 8 entries) |
|
Nexus 9300-EX and 9300-FX switches |
IPv6 – 8 entries per rule (4 entries per ICMP and IPv6 for a total of 8 entries) |
|
Nexus 92160YC-X, 9300-EX, and 9300-FX switches |
24 entries out of 1000 is consumed for default |
|
TCAM scale |
Nexus 92160YC-X switches |
250 (IPv4) or 62 (IPv6) |
Nexus 9300-EX and 9300-FX switches |
500 (IPv4) or 125 (IPv6) |
The entire Cisco Tetration Analytics documentation set is available at the following URL: https://www.cisco.com/c/en/us/support/data-center-analytics/tetration-analytics/tsd-products-support-series-home.html
Verified Scalability Limits - Multidimensional
The tables in this section list the verified scalability limits for the Cisco Nexus 9508 switch with an X9636C-R, X9636C-RX, or X9636Q-R line card or a C9508-FM-R fabric module and Cisco Nexus 9504 with -R line cards for Cisco NX-OS Release 9.3(4). These limits are validated with a multidimensional configuration. The values provided in these tables focus on the scalability of all listed features at the same time.
Each number is the absolute maximum currently supported by this Cisco NX-OS release for the corresponding feature. If the hardware is capable of a higher scale, future software releases might increase this verified maximum limit. Results might differ from the values listed here when trying to achieve maximum scalability with multiple features enabled.
Attention |
These numbers are not the maximum verified values if each feature is viewed in isolation. For these numbers, see the "Verified Scalability Limits" section. |
Feature |
Verified Limits |
---|---|
Number of 100G ports |
288 |
ECMP |
16-way (Upstream) |
BGP neighbors |
960 |
BGP IPv4 /32 unicast routes |
30,000 |
BGP IPv4 VLSM unicast routes |
18,000 |
BGP IPv6 /128 unicast routes |
16,000 |
BGP IPv6 VLSM unicast routes |
1,000 |
IS-IS v2 neighbors |
255 |
IS-IS v3 neighbors |
255 |
IS-IS L2 adjacency |
16 |
IS-IS IPv4 /32 unicast routes |
20,000 |
IS-IS IPv4 VLSM unicast routes |
1,000 |
IS-IS IPv6 /128 unicast routes |
20,000 |
IS-IS IPv6 VLSM unicast routes |
1,000 |
BFD sessions |
272 |
PIM neighbors |
256 |
ACL ACEs |
15,000 500 |
Sub-interfaces |
712 |
SPAN sessions |
1 local SPAN session |
Multicast SSM |
20,000 |
Feature |
Verified Limits |
---|---|
Number of 100G ports |
180 |
Number of 40G ports |
108 |
ECMP |
8-way (Upstream) |
BGP neighbors |
8 |
BGP IPv4 VLSM unicast routes |
40,000 |
BGP IPv6 VLSM unicast routes |
10,000 |
OSPFv2 neighbors |
108 |
OSPFv3 neighbors |
30 |
OSPF IPv4 /32 unicast routes |
100,000 |
OSPF IPv4 VLSM unicast routes |
155,000 |
OSPFv3 IPv6 /128 unicast routes |
1,000 |
OSPFv3 IPv6 VLSM unicast routes |
9,000 |
BFD sessions |
108 |
VRF |
250 |
PIM neighbors |
108 |
IPv4 (*,G) multicast routes |
2,000 |
IPv4 (S,G) multicast routes |
10,000 |
ACL ACEs |
500 (IPv4) 500 (IPv6) |
SPAN sessions |
1 local SPAN session |
Feature |
Verified Limits |
---|---|
Number of 100G ports |
180 |
Number of 40G ports |
108 |
ECMP |
16-way (Upstream) |
BGP neighbors |
8 |
BGP IPv4 VLSM unicast routes |
40,000 |
BGP IPv6 VLSM unicast routes |
10,000 |
EIGRP v4 neighbors |
276 |
EIGRP v6 neighbors |
276 |
EIGRP IPv4 /32 unicast routes |
30,000 |
EIGRP IPv4 VLSM unicast routes |
1,000 |
EIGRP IPv6 /128 unicast routes |
30,000 |
EIGRP IPv6 VLSM unicast routes |
1,000 |
BFD sessions |
276 |
VRF |
250 |
PIM neighbors |
276 |
IPv4 (*,G) multicast routes |
6,000 |
IPv4 (S,G) multicast routes |
16,000 |
ACL ACEs |
500 (IPv4) 500 (IPv6) |
SPAN sessions |
1 local SPAN session |
Feature |
Verified Limits |
---|---|
MPLS L3VPN |
3967 |
VPE |
3967 |
PE nodes |
3 |
PE routes |
20,000 |
X9636C-RX line card: ACL scale-IPv4 |
95,000 |
X9636C-RX line card: ACL scale-IPv6 |
20,000 |
HSRP, HSRP VIP |
3967 each for v4 and v6 |
vPC uRPF |
3967 |
Strict uRPF |
Yes |
VRF |
3967 |
SVI |
3967 |
Layer 3 VPN routes IP ECMP |
2,000 |
MPLS LSR ECMP |
2,000 |
VPNv4 routes |
400,000 |
VPNv6 routes |
90,000 |
EBGP neighbors |
750 |
Feature |
Verified Limits |
---|---|
MAC addresses |
19,000 |
Number of sub-interfaces |
500 |
vPC Port channels |
46 |
ECMP |
16-way (Upstream) |
OSPFv2 neighbors |
47 |
OSPFv3 neighbors |
47 |
OSPF IPv4 /32 unicast routes |
45,000 |
OSPF IPv4 VLSM unicast routes |
1,000 |
OSPF IPv6 /128 unicast routes |
20,000 |
OSPF IPv6 VLSM unicast routes |
1,000 |
BFD sessions |
49 |
VRF |
250 |
VLAN |
3,750 |
SVI |
3,750 |
VRRP v4 groups |
1,996 VRRS / 4 VRRPv3 |
VRRP v6 groups |
1,996 VRRS / 4 VRRPv3 |
HSRP IPv4 |
1,743 Secondary groups / 7 Primary groups |
HSRP IPv6 |
1,743 Secondary groups / 7 Primary groups |
PIM neighbors |
396 |
IPv4 (*,G) multicast routes |
3,080 |
IPv4 (S,G) multicast routes |
26,600 |
IGMP snooping database entries |
6,400 |
sFlow enabled interfaces |
83 |
UDLD enabled interfaces |
93 |
SPAN sessions |
1 local SPAN session |
Feature |
Verified Limits |
---|---|
VLAN |
100 |
SVI |
100 |
MAC entries |
10,000 |
ARP entries |
70 |
HSRPv4 VIPs |
100 |
HSRPv6 VIPs |
100 |
LACP |
11 |
LACP members |
4 |
eBGP IPv6 neighbors |
9 |
eBGP IPv4 LU neighbors |
9 |
IPv4 (LU) routes |
6888 |
IPv4 (LU) paths |
17580 |
IPv6 routes |
6,663 |
IPv4 (LU) routes |
17,338 |
SR ECMP |
18 (dual-homed) |
MPLS HW entries |
11,957 |
Feature |
Verified Limits |
---|---|
Number of ports |
16 |
ECMP |
8-way (Upstream) |
BGP neighbors |
200 |
BGP EVPN Layer 2 VPN host routes |
64,000 |
BGP IPv4 VLSM unicast routes or ospf |
10,000 |
BGP IPv6 VLSM unicast routes or ospf |
6,000 |
BFD sessions |
20 |
PIM neighbors |
20 |
IPv4 (*, G) multicast routes (co-existing) |
4,000 |
IPv4 (S,G) multicast routes (co-existing) |
2,000 |
Layer 3 VNI |
900 |
Layer 2 VNI |
2000 |
Local VTEP |
1 |
Remote VTEPs |
256 |
VLAN |
3600 |
SVI |
900 |
MAC |
90,000 |
Deployment Case Studies
This section provides sample topologies for some common deployments. For each topology, the scalability numbers are the limits with all of the listed features enabled at the same time.
Attention |
These numbers are not the maximum verified values if each feature is viewed in isolation. For these numbers, see the "Verified Scalability Limits" section. |
Layer 2/Layer 3 Aggregation Topology (Max-Host Routing Mode)
This Layer 2/Layer 3 aggregation topology consists of Cisco Nexus 9508 switches as virtual port channel (vPC) aggregation pairs. These aggregation nodes are fully loaded with N9K-X9564TX, N9K-X9564PX, and N9K-X9636PQ line cards. The N9K-X9636PQ line cards are used in normal mode and breakout mode. Cisco Nexus 9396PX and 93128TX switches are used as top-of-rack units with Cisco Nexus 3000 Series switches to achieve the desired vPC scale.
The Cisco Nexus 9508 switch is also used as a core Layer 3 node that connects to a pair of vPC aggregation nodes. The focus of the topology is to test IPv4 ARP, IPv6 neighbor discovery (ND), and Layer 2 scalability and other routing, switching, and Layer 4 through Layer 7 features for management and operations. All Layer 3 interfaces are configured for dual stack, and the traffic is dual stack for all VLANs.
In the following table, the Verified Limit column lists the verified scaling capabilities with all listed features enabled at the same time. The scale numbers listed here exceed those used by most customers in their topologies. These numbers are not the maximum verified values if each feature is viewed in isolation.
Feature |
9508 Verified Limit (Max-Host Routing Mode) |
---|---|
Fully loaded chassis |
1 N9K-X9636PQ, 1 N9K-X9564TX, 2 N9K-X9564PX, 1 N9K-X9432PQ, 1 N9K-X9536PQ |
Physical interfaces enabled |
276 |
Multicast S,G routes |
653 |
Multicast *,G routes |
500 |
IPv4 unicast routes (LPM) |
5000 |
IPv6 unicast routes (LPM) |
850 |
IPv4 ARP |
65,000 |
IPv6 ND |
40,000 |
MAC addresses |
90,000 |
VLANs |
490 |
vPCs* |
200 |
OSPFv2 neighbors |
20 |
OSPFv3 neighbors |
4 |
BGP (IPv4) neighbors |
65 |
BGP (IPv6) neighbors |
65 |
SVIs |
490 |
STP logical ports |
2800 (RPVST) |
HSRP VLANs (IPv4/IPv6) |
490 |
Virtual ports |
700 |
Port channel links |
8 |
* The number of VLANs per vPC supported should be within the MST or RPVST virtual port count specified in this table, depending on the topology.
Layer 2/Layer 3 Aggregation Topology (Default Routing Mode)
This Layer 2/Layer 3 aggregation topology consists of Cisco Nexus 9516 switches as virtual port channel (vPC) aggregation pairs. These aggregation nodes are fully loaded with N9K-X9564TX, N9K-X9564PX, and N9K-X9536PQ line cards. The chassis is fully loaded with five line cards configured for breakout mode. The Cisco Nexus 9396PX and 93128TX switches are used as top-of-rack units with Cisco Nexus 3000 Series switches to achieve the desired vPC scale. The Cisco Nexus 9516 nodes are running in default routing mode. The Cisco Nexus 3164Q switch is also used as a core Layer 3 node that connects to a pair of vPC aggregation nodes.
The focus of the topology is to test IPv4 ARP, IPv6 neighbor discovery (ND), Layer 2 scalability, IPv4 and IPv6 LPM routing, Layer 2 and Layer 3 multicast routing for IPv4, and Layer 4 through Layer 7 features for management and operations. All Layer 3 interfaces are configured for dual stack, and the traffic is dual stack for all VLANs.
In the following table, the Verified Limit column lists the verified scaling capabilities with all listed features enabled at the same time. These numbers are not the maximum verified values if each feature is viewed in isolation.
Feature |
9516 Switch Verified Limit (Default Routing Mode) |
9300 Platform Verified Limit (Default Routing Mode) |
---|---|---|
Chassis configuration |
5 N9K-X9432PQ line cards 4 N9K-X9464PX line cards 3 N9K-X9536PQ line cards 3 N9K-X9464TX line cards 1 N9K-X9564TX line card |
9372 |
Physical ports |
1335 |
50 |
vPCs |
303 |
24 |
SVIs |
450 |
450 |
VRFs |
100 |
100 |
IPv4 ARP |
40,000 |
40,000 |
IPv6 ND |
10,000 |
10,000 |
STP logical ports |
10,000 |
6000 |
BGP neighbors (IPv4 + IPv6) |
502 + 502 |
502 + 502 |
IPv4 LPM routes |
50,000 |
6000 |
IPv6 LPM routes |
10,000 |
1000 |
BFD (IPv4 + IPv6) |
300 |
102 |
IGP OSPFv2 neighbors |
502 |
502 |
IGP OSPFv3 neighbors |
502 |
502 |
HSRP (IPv4 + IPv6) |
450 + 450 |
450 + 450 |
IGMP groups |
2000 |
2000 |
Multicast *,G routes |
2000 |
2000 |
Multicast S,G routes |
8000 |
6000 |
Tracking objects |
450 |
450 |
VLANs |
500 |
500 |
PIM neighbors |
502 |
502 |
MAC addresses |
60,000 |
60,000 |
Network address translation (NAT) |
Not applicable |
756 |
sFlow |
256 |
32 |
FEX System Topology
The FEX 9500 multi-dimensional scale topology consists of Cisco Nexus 9508 switches as virtual port channel (vPC) pairs. Each switch has multiple X9564PX line cards. Each switch has 32 FEX uplinks connected to them. The FEX 9300 multi-dimensional scale topology consists of two Cisco Nexus 9396PX switches used in vPC mode along with 16 FEX uplinks connected to each switch. Multiple FEXs of type Nexus 2248TP-E, 2232PP, 2248PQ, and 2348UPQ are used.
The switches are used at the Layer 2 and Layer 3 boundary and are also configured as VXLAN VTEPs. The FEX host ports are operating as Layer 2 ports. The switches are configured as gateways with the use of SVI interfaces.
In the following table, the Verified Limit column lists the verified scaling capabilities with all listed features enabled at the same time. The scale numbers listed here exceed those used by most customers in their topologies. These numbers are not the maximum verified values if each feature is viewed in isolation.
Feature |
9500 Platform Verified Limit |
9300 Platform Verified Limit |
---|---|---|
Fabric Extenders |
32 |
16 |
Up interfaces |
1100 |
560 |
Port channels |
426 |
256 |
vPC members |
390 |
360 |
VLANs |
744 |
416 |
PVLAN VLANs |
56 |
56 |
Secondary VLANs per primary VLAN |
25 |
25 |
MAC addresses |
45,000 |
25,000 |
HSRP |
365 |
365 |
ARP |
12,000 |
10,000 |
Neighbor discovery (ND) |
5000 |
5000 |
Multicast (*,G) |
4000 |
4000 |
Multicast (S,G) |
4000 |
4000 |
Multicast System Topology
Two Cisco Nexus 9508 switches are configured as vPC peers in one domain, and two Cisco Nexus 9372PX switches are configured as vPC peers in the other domain. The chassis are fully loaded with N9K-X9432PQ, N9K-X9464PX, N9K-X9536PQ, N9K-X9564PX, N9K-X9564TX, and N9K-X9636PQ line cards. eBGP routing is used to connect these two PIM domains. OSPF is used as IGP in one domain, and EIGRP is configured in the other domain. This setup is configured with multiple rendezvous points (RPs) to serve different multicast group ranges. BSR is used to advertise RP information in both of these PIM domains. PIM anycast is used in one domain, and MSDP anycast is used in the other domain for redundancy and load balancing. Static RP configuration is also used for a range of multicast groups.
The Cisco Nexus 9516 and Cisco Nexus 7000 Series switches are used as Layer 3 core routers in one domain. The Cisco Nexus 3164Q switches are used as Layer 3 core routers in the other domain. This topology also includes the Cisco Nexus 9396PX, Cisco Nexus 9372PX, and Cisco Nexus 3016/3064T switches in the access layer.
In addition to including Layer 2/Layer 3 IPv4 multicast routing, this topology also covers IPv4 and IPv6 host and LPM routing and Layer 2 unicast forwarding. All interfaces are configured for dual stack.
In the following table, the Verified Limit column lists the verified scaling capabilities with all listed features enabled at the same time. These numbers are not the maximum verified values if each feature is viewed in isolation.
Feature |
9500 Platform Verified Limit |
9300 Platform Verified Limit |
---|---|---|
Chassis configuration |
N9K-X9636PQ, N9K-X9536PQ, N9K-X9564PX, N9K-X9564TX, N9K-X9432PQ, N9K-X9464PX, N9K-X9432PQ, C3164PQ |
C9372PX, C9396PX, C3164PQ |
Multicast S,G routes |
17,500 |
5000 |
Multicast *,G routes |
2500 (IGMP) 12500 (snooping) |
500 (IGMP) 2500 (snooping) |
Sources |
2000, 200, 100, 40, 10, 3, 2, 1 |
2000, 200, 100, 40, 10, 3, 2, 1 |
Replications |
40 |
20 |
ECMPs |
16 |
8 |
SVIs |
200 |
200 |
HSRP/VRRP |
200 HSRP |
100 VRRP |
MAC addresses |
40,000 |
10,000 |
ARP |
20,000 |
4000 |
Unicast LPM IPv4 routes |
20,000 |
4000 |
Unicast LPM IPv6 routes |
10,000 |
1000 |
IPv4 ARP |
18,000 |
4000 |
IPv6 ND |
4000 |
2000 |
MSDP peers (fully mesh) |
4 |
4 |
Anycast RPs (MSDP and PIM anycast) 45 |
2 MSDP |
2 PIM anycast |
IPv4 multicast routes with PIM bidirectional groups |
8000 |
8000 |
VXLAN BGP/eVPN iBGP Centric Topology
This VXLAN BGP/eVPN iBGP centric topology consists of Cisco Nexus 9300 and 9500 Platform switches acting as VXLAN vPC tunnel endpoints (VTEPs) and VXLAN non-vPC VTEPs. VXLAN VTEPs establish iBGP sessions to a Cisco Nexus 9508 switch (route reflector) acting as a spine node. VXLAN-distributed anycast gateway SVIs are configured for dual stack, and the traffic is dual stack.
The focus of this topology is to test VXLAN overlay network scale and underlay Layer 2 switching and other routing, multicast, and Layer 4 through Layer 7 features for management and operations. Underlay PIM neighbors and IS-IS adjacency were tested with the default timer and Bidirectional Forwarding Detection (BFD) enabled on all links.
In the following table, the Verified Limit column lists the verified scaling capabilities with all listed features enabled at the same time. These numbers are not the maximum verified values if each feature is viewed in isolation.
Feature |
Supported Platform |
Verified Limit |
---|---|---|
System Routing Template |
Nexus 9200, 9300, 9300-EX, 9300-FX, and 9500 switches and the X9700-EX/FX line cards |
default |
Nexus 9364C switches |
Not applicable |
|
VXLAN VTEPs |
Nexus 9200, 9300, 9300-EX, 9300-FX, 9364C and 9500 switches and the X9700-EX/FX line cards |
128 |
VXLAN Layer 2 VNIs |
Nexus 9200, 9300, 9300-EX, 9300-FX, 9364C and 9500 switches and the X9700-EX/FX line cards |
2000 |
VXLAN Layer 3 VNIs/VRFs |
Nexus 9200, 9300, 9300-EX, 9300-FX, 9364C and 9500 switches and the X9700-EX/FX line cards |
500 |
VXLAN multicast groups |
Nexus 9200, 9300, 9300-EX, 9300-FX, 9364C and 9500 switches and the X9700-EX/FX line cards |
128 |
VXLAN overlay MAC addresses |
Nexus 9200, 9300, 9300-EX, 9300-FX, 9364C and 9500 switches and the X9700-EX/FX line cards |
64,000 |
VXLAN overlay IPv4 host routes |
Nexus 9200, 9300, 9300-EX, 9300-FX, 9364C and 9500 switches and the X9700-EX/FX line cards |
60,000 |
VXLAN overlay IPv6 host routes |
Nexus 9200, 9300, 9300-EX, 9300-FX, and 9500 switches and the X9700-EX/FX line cards |
16,000 |
Nexus 9364C switches |
Not applicable |
|
VXLAN overlay IGMP Snooping groups |
Nexus 9200, 9300, 9300-EX, 9300-FX, 9364C and 9500 switches and the X9700-EX/FX line cards |
1000 |
VXLAN IPv4 LPM routes |
Nexus 9200, 9300-EX, 9300-FX, and 9364C switches and the X9700-EX/FX line cards |
5120 |
VXLAN IPv6 LPM routes |
Nexus 9200, 9300-EX, and 9300-FX switches and the X9700-EX/FX line cards |
1500 |
Nexus 9364C switches |
Not applicable |
|
VXLAN VLAN logical port VP count |
Nexus 9364C switches |
Not applicable |
VLANs on VTEP node |
Nexus 9200, 9300, 9300-EX, 9300-FX, 9364C, and 9500 switches and the X9700-EX/FX line cards |
1700 (total VLANs) 1500 (VXLAN VLANs) 200 (non-VXLAN VLANs) |
MST instances |
Nexus 9200, 9300, 9300-EX, 9300-FX, and 9500 switches and the X9700-EX/FX line cards |
20 |
Nexus 9364C switches |
Not applicable |
|
STP logical ports |
Nexus 9200, 9300, 9300-EX, 9300-FX, and 9500 switches and the X9700-EX/FX line cards |
3500 |
Nexus 9364C switches |
Not applicable |
|
vPC port channels |
Nexus 9200, 9300, 9300-EX, and 9300-FX switches and the X9700-EX/FX line cards |
40 |
Nexus 9364C switches |
Not applicable |
|
Underlay IS-IS neighbors |
Nexus 9200, 9300, 9300-EX, and 9300-FX switches and the X9700-EX/FX line cards |
32 |
Nexus 9364C switches |
Not applicable |
|
Underlay PIM neighbors |
Nexus 9200, 9300, 9300-EX, 9300-FX, and 9500 switches and the X9700-EX/FX line cards |
12 |
Nexus 9364C switches |
Not applicable |
|
Underlay HSRP groups for regular VLANs |
Nexus 9364C switches |
Not applicable |
Underlay vPC SVIs |
Nexus 9200, 9300, 9300-EX, 9300-FX, and 9500 switches and the X9700-EX/FX line cards |
200 |
Nexus 9364C switches |
Not applicable |