Cisco MDS 9000 Series Configuration Manual
  1. Manuals
  2. Brands
  3. Cisco Manuals
  4. Switch
  5. MDS 9000 Series
  6. Configuration manual

Cisco MDS 9000 Series Configuration Manual

Nx-os interfaces multilayer switches
Hide thumbs Also See for MDS 9000 Series:
Table of Contents

Advertisement

Quick Links

Download this manual See also: Troubleshooting Manual, Configuration Manual
Cisco MDS 9000 Family NX-OS Interfaces
Configuration Guide
Cisco MDS NX-OS Release 4.2(1) Through 4.2(7a)
July 2010
Cisco Systems, Inc.
www.cisco.com
Cisco has more than 200 offices worldwide.
Addresses, phone numbers, and fax numbers
are listed on the Cisco website at
www.cisco.com/go/offices.
Text Part Number: OL-19445-02

Advertisement

Table of Contents
loading

Related Manuals for Cisco MDS 9000 Series

Summary of Contents for Cisco MDS 9000 Series

  • Page 1 Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide Cisco MDS NX-OS Release 4.2(1) Through 4.2(7a) July 2010 Cisco Systems, Inc. www.cisco.com Cisco has more than 200 offices worldwide. Addresses, phone numbers, and fax numbers are listed on the Cisco website at www.cisco.com/go/offices.
  • Page 2 OR ITS SUPPLIERS HAVE BEEN ADVISED OF THE POSSIBILITY OF SUCH DAMAGES. Cisco and the Cisco logo are trademarks or registered trademarks of Cisco and/or its affiliates in the U.S. and other countries. To view a list of Cisco trademarks, go to this URL: www.cisco.com/go/trademarks.

  • Page 3: Table Of Contents

    C H A P T E R Fibre Channel Interfaces Generation 1 Interfaces Configuration Guidelines About Interface Modes About Interface States Configuring Fibre Channel Interfaces 2-11 Graceful Shutdown 2-12 Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide OL-19445-02, Cisco MDS NX-OS Release 4.2(x)
  • Page 4 2-44 Configuring No-Credit Timeout Value 2-45 Configuring Credit Loss Recovery Threshold and Action 2-45 Configuring Average Credit Non-Available Duration Threshold and Action 2-47 Management Interfaces 2-47 Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide OL-19445-02, Cisco MDS NX-OS Release 4.2(x)
  • Page 5 Configuring a 24-Port 8-Gbps Fibre Channel Switching Module Example 3-37 Configuring a 4/44-Port 8-Gbps Fibre Channel Switching Module Example 3-37 Configuring a 24-Port 4-Gbps Fibre Channel Switching Module Example 3-38 Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide OL-19445-02, Cisco MDS NX-OS Release 4.2(x)
  • Page 6 Configuring Trunk Mode and VSAN List About Trunk Modes Configuring Trunk Mode About Trunk-Allowed VSAN Lists and VF_IDs Configuring an Allowed-Active List of VSANs 5-12 Example F Port Trunking Configuration 5-12 Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide OL-19445-02, Cisco MDS NX-OS Release 4.2(x)
  • Page 7 Configuring N Port Virtualization C H A P T E R About N Port Identifier Virtualization Enabling N Port Identifier Virtualization About N Port Virtualization NPV Mode Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide OL-19445-02, Cisco MDS NX-OS Release 4.2(x)
  • Page 8 Debugging FlexAttach Virtual pWWN Security Settings for FlexAttach Virtual pWWN FlexAttach Virtual pWWN CFS Distribution Difference Between San Device Virtualization and FlexAttach Port Virtualization N D E X Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide viii OL-19445-02, Cisco MDS NX-OS Release 4.2(x)

  • Page 9: New And Changed Information

    For a complete list of document titles, see the list of Related Documentation in the “Preface.” To find additional information about Cisco MDS NX-OS Release 4.2(x), see the Cisco MDS 9000 Family Release Notes available at the following Cisco Systems website: http://www.cisco.com/en/US/products/ps5989/prod_release_notes_list.htm...
  • Page 10 S e n d d o c u m e n t a t i o n c o m m e n t s t o m d s f e e d b a c k - d o c @ c i s c o . c o m Table 1-1 New and Changed Features for Cisco MDS NX-OS Release 4.2(x) Changed...

  • Page 11: Preface

    S e n d d o c u m e n t a t i o n c o m m e n t s t o m d s f e e d b a c k - d o c @ c i s c o . c o m Preface This preface describes the audience, organization, and conventions of the Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide. It also provides information on how to obtain related documentation.

  • Page 12: Document Conventions

    Means reader take note. Notes contain helpful suggestions or references to material not covered in the manual. Means reader be careful. In this situation, you might do something that could result in equipment Caution damage or loss of data. Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide OL-19445-02, Cisco MDS NX-OS Release 4.2(x)

  • Page 13: Related Documentation

    S e n d d o c u m e n t a t i o n c o m m e n t s t o m d s f e e d b a c k - d o c @ c i s c o . c o m Related Documentation The documentation set for the Cisco MDS 9000 Family includes the following documents. To find a document online, use the Cisco MDS NX-OS Documentation Locator at: http://www.cisco.com/en/US/docs/storage/san_switches/mds9000/roadmaps/doclocater.htm...

  • Page 14: Cisco Nx-Os

    S e n d d o c u m e n t a t i o n c o m m e n t s t o m d s f e e d b a c k - d o c @ c i s c o . c o m Cisco MDS 9000 Family Storage Services Module Software Installation and Upgrade Guide •...

  • Page 15: Troubleshooting And Reference

    Subscribe to What’s New in Cisco Product Documentation, which lists all new and revised Cisco technical documentation as an RSS feed and delivers content directly to your desktop using a reader application. The RSS feeds are a free service.
  • Page 16 S e n d d o c u m e n t a t i o n c o m m e n t s t o m d s f e e d b a c k - d o c @ c i s c o . c o m Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide...

  • Page 17: Chapter 1 Interfaces Overview

    • Trunks and PortChannels Trunking, also known as VSAN trunking, is a feature specific to switches in the Cisco MDS 9000 Family. Trunking enables interconnect ports to transmit and receive frames in more than one VSAN, over the same physical link. Trunking is supported on E ports and F ports.

  • Page 18: Fibre Channel Port Rate Limiting

    IDs for these switches. NPIV is used by edge switches in the NPV mode to log in to multiple end devices that share a link to the core switch. This feature is available only for Cisco MDS Blade Switch Series, the Cisco MDS 9124 Multilayer Fabric Switch, and the Cisco MDS 9134 Multilayer Fabric Switch.
  • Page 19 S e n d d o c u m e n t a t i o n c o m m e n t s t o m d s f e e d b a c k - d o c @ c i s c o . c o m Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide...
  • Page 20 S e n d d o c u m e n t a t i o n c o m m e n t s t o m d s f e e d b a c k - d o c @ c i s c o . c o m Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide...

  • Page 21: Configuring Interfaces

    • Default Settings, page 2-50 • For more information on configuring mgmt0 interfaces, refer to the Cisco MDS 9000 Family NX-OS Fundamentals Configuration Guide and Cisco MDS 9000 Family NX-OS IP Services Configuration Guide. See the Cisco MDS 9000 Family NX-OS IP Services Configuration Guide for more information on configuring Gigabit Ethernet interfaces.

  • Page 22: Generation 1 Interfaces Configuration Guidelines

    The Generation 1 interfaces configuration guidelines apply to the following hardware: The 32-port, 2-Gbps or 1-Gbps switching module interfaces. • The Cisco MDS 9140 and 9120 switch interfaces. • Due to the hardware design of the MDS 9134 switch, we do not support interface Note out-of-service action on either of its two 10-Gigabit ports.

  • Page 23: About Interface Modes

    E port on a 32-port host-optimized switching module, the other three ports in that 4-port group cannot be used. In the Cisco MDS 9100 Series, the groups of ports that are located on the left and outlined in white are Note full line rate.
  • Page 24 An NP port is a port on a device that is in NPV mode and connected to the core switch via an F port. NP ports function like N ports except that in addition to providing N port operations, they also function as proxies for multiple, physical N ports. Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide OL-19445-02, Cisco MDS NX-OS Release 4.2(x)
  • Page 25 N port (TN port) or trunked NP port (TNP port) to create a link between a core switch and an NPV switch or an HBA to carry tagged frames. TF ports are specific to Cisco MDS 9000 Family switches.
  • Page 26 Cisco MDS 9000 Family. When configured in ST port mode, the interface cannot be attached to any device, and thus cannot be used for normal Fibre Channel traffic (see the Cisco MDS 9000 Family NX-OS System Management Configuration Guide).

  • Page 27: About Interface States

    NL port mode. If the interface is attached to a third-party switch, it operates in E port mode. If the interface is attached to another switch in the Cisco MDS 9000 Family, it may become operational in TE port mode (see Chapter 5, “Configuring...
  • Page 28 If the administrative state is up and the operational state is down, the reason code differs based on the nonoperational reason code as described in Table 2-4. Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide OL-19445-02, Cisco MDS NX-OS Release 4.2(x)
  • Page 29 The physical layer link is operational and the protocol initialization is in progress. Reconfigure fabric in progress The fabric is currently being reconfigured. Offline The Cisco NX-OS software waits for the specified R_A_TOV time before retrying initialization. Inactive The interface VSAN is deleted or is in a suspended state.
  • Page 30 Suspended due to incompatible An improper connection is detected. All interfaces in a remote switch WWN PortChannel must be connected to the same pair of switches. Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide 2-10 OL-19445-02, Cisco MDS NX-OS Release 4.2(x)

  • Page 31: Configuring Fibre Channel Interfaces

    Note before and after the comma. For the Cisco Fabric Switch for HP c-Class BladeSystem and the Cisco Fabric Switch for IBM BladeCenter, you can configure a range of interfaces among internal ports or external ports, but you cannot mix both interface types within the same range. For example, “bay 1-10, bay 12” or “ext 0, ext 15-18”...

  • Page 32: Graceful Shutdown

    A graceful shutdown ensures that no frames are lost when the interface is shutting down. When a shutdown is triggered either by you or the Cisco NX-OS software, the switches connected to the shutdown link coordinate with each other to ensure that all frames in the ports are safely sent through the link before shutting down.

  • Page 33: Configuring Interface Modes

    Example 2-1 Setup Utility Configure default switchport mode F (yes/no) [n]: y Example 2-2 Command Line switch(config)# system default switchport mode F Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide 2-13 OL-19445-02, Cisco MDS NX-OS Release 4.2(x)

  • Page 34: Configuring Port Speeds

    Sets the administrative mode of Fibre Channel ports to switch(config)# no system default switchport mode F the default (unless user configured). For detailed information about the switch setup utility see the Cisco MDS 9000 Family NX-OS Note Fundamentals Configuration Guide. Configuring Port Speeds By default, the port administrative speed for an interface is automatically calculated by the switch.

  • Page 35: About Interface Descriptions

    S e n d d o c u m e n t a t i o n c o m m e n t s t o m d s f e e d b a c k - d o c @ c i s c o . c o m For internal ports on the Cisco Fabric Switch for HP c_Class BladeSystem and Cisco Fabric Switch for IBM BladeCenter, a port speed of 1 Gbps is not supported.

  • Page 36: About Frame Encapsulation

    The switchport encap eisl command is disabled by default. If you enable encapsulation, all outgoing frames are encapsulated, and you will see a new line (Encapsulation is eisl) in the show interface SD_port_interface command output (see the Cisco MDS 9000 Family NX-OS System Management Configuration Guide).

  • Page 37: About Beacon Mode

    “Generation 1 Interfaces Configuration Guidelines” section on page 2-2. 4. Refer to the Cisco MDS 9000 Family hardware installation guide for your platform. About Speed LEDs Each port has one link LED on the left and one speed LED on the right.

  • Page 38: About Bit Error Thresholds

    You can configure attribute default values for various switch port attributes. These attributes will be applied globally to all future switch port configurations, even if you do not individually specify them at that time. Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide 2-18 OL-19445-02, Cisco MDS NX-OS Release 4.2(x)

  • Page 39: About Sfp Transmitter Types

    The small form-factor pluggable (SFP) hardware transmitters are identified by their acronyms when displayed in the show interface brief command. If the related SFP has a Cisco-assigned extended ID, then the show interface and show interface brief commands display the ID instead of the transmitter type.

  • Page 40: Displaying Interface Information

    3 input OLS, 9 LRR, 1 NOS, 0 loop inits 9 output OLS, 7 LRR, 1 NOS, 0 loop inits 16 receive B2B credit remaining 3 transmit B2B credit remaining..Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide 2-20 OL-19445-02, Cisco MDS NX-OS Release 4.2(x)
  • Page 41 5 minutes output rate 0 bits/sec, 0 bytes/sec, 0 frames/sec 1856 frames input, 116632 bytes 0 discards, 0 errors 0 CRC, 0 unknown class 0 too long, 0 too short Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide 2-21 OL-19445-02, Cisco MDS NX-OS Release 4.2(x)
  • Page 42 1 input OLS, 1 LRR, 1 NOS, 0 loop inits 2 output OLS, 1 LRR, 0 NOS, 0 loop inits 16 receive B2B credit remaining Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide 2-22 OL-19445-02, Cisco MDS NX-OS Release 4.2(x)
  • Page 43 1500 GigabitEthernet4/6 down 10.1.1.2/8 auto 3000 GigabitEthernet4/7 down 10.1.1.27/24 auto 1500 GigabitEthernet4/8 down auto 1500 ------------------------------------------------------------------------------- Interface Status Oper Mode Oper Speed (Gbps) ------------------------------------------------------------------------------- Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide 2-23 OL-19445-02, Cisco MDS NX-OS Release 4.2(x)
  • Page 44 0 input OLS, 0 LRR, 0 NOS, 0 loop inits 0 output OLS, 0 LRR, 0 NOS, 0 loop inits 0 link failures, 0 sync losses, 0 signal losses 16 receive B2B credit remaining Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide 2-24 OL-19445-02, Cisco MDS NX-OS Release 4.2(x)
  • Page 45 Total Rate Total Mbits/s Frames Mbits/s Frames ------------------------------------------------------------------------------- fc3/1 3871 3874 fc3/2 3902 4232 fc3/3 3901 4138 fc3/4 3895 3894 fc3/5 3890 3897 fc9/8 fc9/9 Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide 2-25 OL-19445-02, Cisco MDS NX-OS Release 4.2(x)
  • Page 46 Frames ------------------------------------------------------------------------------- port-channel 1 port-channel 2 3946 3946 The show interface transceiver command can only be issued on a switch in the Cisco MDS 9100 Series Note if the SFP is present (see Example 2-10). Example 2-10 Displays Transceiver Information...
  • Page 47 Example 2-15 Displays Interface Information in a Brief Format After the System Default Switchport Mode F Command is Executed switch# show interface brief ------------------------------------------------------------------------------- Interface Vsan Admin Admin Status Oper Oper Port Mode Trunk Mode Speed Channel Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide 2-27 OL-19445-02, Cisco MDS NX-OS Release 4.2(x)

  • Page 48: Tl Ports For Private Loops

    Generation 2 switching module interfaces • Cisco MDS 9124 Fabric Switch Cisco Fabric Switch for HP c-Class BladeSystem • Cisco Fabric Switch for IBM BladeCenter • Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide 2-28 OL-19445-02, Cisco MDS NX-OS Release 4.2(x)
  • Page 49 Communication between a private initiator to a private target on the same private loop does not invoke TL port services. Table 2-6 lists the TL port translations supported in Cisco MDS 9000 Family switches. Figure 2-3 shows examples of TL port translation support.

  • Page 50: About Tl Port Alpa Caches

    A cache contains entries for recently allocated ALPA values. These caches are maintained on various TL ports. If a device already has an ALPA, the Cisco NX-OS software attempts to allocate the same ALPA to the device each time. The ALPA cache is maintained in persistent storage and saves information across switch reboots.
  • Page 51 1, FCID 0x420000 ------------------------------------------------------------------------ alpa pWWN nWWN SCSI Type FC-ID ------------------------------------------------------------------------ 0x01 20:10:00:05:30:00:4a:de 20:00:00:05:30:00:4a:de Initiator 0xfffc42 0x02 21:00:00:e0:8b:01:95:e7 20:00:00:e0:8b:01:95:e7 Initiator 0x420100 Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide 2-31 OL-19445-02, Cisco MDS NX-OS Release 4.2(x)

  • Page 52: Manually Inserting Entries Into Alpa Cache

    The causes of link failure can be any of the following: • ESP trustsec-violation Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide 2-32 OL-19445-02, Cisco MDS NX-OS Release 4.2(x)
  • Page 53 Switch# config t Switch (config)# interface fc1/1 Switch (config-if)# errdisable detect cause link-down num-times 5 duration 120 Switch (config-if)# errdisable detect cause bit-errors num-times 5 duration 120 Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide 2-33 OL-19445-02, Cisco MDS NX-OS Release 4.2(x)

  • Page 54: Configuring Port Monitor

    You can configure the thresholds for various counters and trigger an event when the values cross the threshold settings. This section includes the following topics: Enabling Port Monitor, page 2-35 • Configuring a Port Monitor Policy, page 2-35 • Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide 2-34 OL-19445-02, Cisco MDS NX-OS Release 4.2(x)

  • Page 55: Enabling Port Monitor

    Applies the policy to the access ports. switch(config-port-monitor)# port-type access-port Applies the policy to the trunk ports. switch(config-port-monitor)# port-type trunks Applies the policy to all ports. switch(config-port-monitor)# port-type all Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide 2-35 OL-19445-02, Cisco MDS NX-OS Release 4.2(x)
  • Page 56 Turns on monitoring for the specified counter. switch(config-port-monitor)# monitor counter {invalid-crc|invalid-words|link-loss|protoco l-error|rx-performance|signal-loss|state-cha nge|sync-loss|tx-performance|credit-loss-rec o|tx-credit-not-available|lr-rx|lr-tx|timeou t-discards|tx-discards} Turns off monitoring for the specified counter. switch(config-port-monitor)# no monitor counter {invalid-crc|invalid-words|link-loss|protoco l-error|rx-performance|signal-loss|state-cha nge|sync-loss|tx-performance|credit-loss-rec o|tx-credit-not-available|lr-rx|lr-tx|timeou t-discards|tx-discards} Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide 2-36 OL-19445-02, Cisco MDS NX-OS Release 4.2(x)
  • Page 57 Delta Not enabled Signal Loss Delta Not enabled Invalid Words Delta Not enabled Invalid CRC's Delta Not enabled RX Performance Delta 2147483648 524288000 Not enabled Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide 2-37 OL-19445-02, Cisco MDS NX-OS Release 4.2(x)

  • Page 58: Activating A Port Monitor Policy

    -------- ---------------- ----- ------------------ ----- ----- Link Loss Delta Sync Loss Delta Protocol Error Delta Signal Loss Delta Invalid Words Delta Invalid CRC's Delta RX Performance Delta 2147483648 524288000 Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide 2-38 OL-19445-02, Cisco MDS NX-OS Release 4.2(x)
  • Page 59 Sync Loss Delta Protocol Error Delta Signal Loss Delta Invalid Words Delta Invalid CRC's Delta RX Performance Delta 2147483648 524288000 TX Performance Delta 2147483648 524288000 ------------------------------------------------------------------------------------------ Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide 2-39 OL-19445-02, Cisco MDS NX-OS Release 4.2(x)

  • Page 60: Configuring Port Group Monitor

    Specifies the delta Tx counter poll interval in switch(config-port-group-monitor)# counter tx-performance poll-interval seconds delta seconds and thresholds in percentage. rising-threshold percentage1 falling-threshold percentage2 Reverts to the default policy. switch(config-port-group-monitor)# no counter tx-performance Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide 2-40 OL-19445-02, Cisco MDS NX-OS Release 4.2(x)
  • Page 61 ------------------------------------------------------------------------------------------ Counter Threshold Interval %ge Rising Threshold %ge Falling Threshold In Use ------- --------- -------- -------------------- ---------------------- ------ RX Performance Delta TX Performance Delta ------------------------------------------------------------------------------------------ Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide 2-41 OL-19445-02, Cisco MDS NX-OS Release 4.2(x)

  • Page 62: Activating A Port Group Monitor Policy

    The following commands display information about port group monitor: switch# show port-group-monitor status Port Group Monitor : Enabled Active Policies : pgm2 Last 10 logs : switch# Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide 2-42 OL-19445-02, Cisco MDS NX-OS Release 4.2(x)
  • Page 63 ------------------------------------------------------------------------------------------ Counter Threshold Interval %ge Rising Threshold %ge Falling Threshold In Use ------- --------- -------- -------------------- ---------------------- ------ RX Performance Delta TX Performance Delta ------------------------------------------------------------------------------------------ Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide 2-43 OL-19445-02, Cisco MDS NX-OS Release 4.2(x)

  • Page 64: Configuring Slow Drain Device Detection And Congestion Avoidance

    The default stuck frame timeout value is 500 ms. We recommend that you retain the default configuration for ISLs and configure a value not exceeding 500 ms (100 to 200 ms) for fabric F ports. Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide 2-44...

  • Page 65: Configuring No-Credit Timeout Value

    When the port sees the credit loss condition and fails to recover, the port flaps. This function is already part of port guard and so you can configure the supported actions using the Port Guard feature. Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide 2-45...
  • Page 66 Portguard In Use ------- --------- -------- ---------------- ----- ------------------ ----- --------- ------ Credit Loss Reco Delta Not enabled TX Credit Not Available Delta Not enabled Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide 2-46 OL-19445-02, Cisco MDS NX-OS Release 4.2(x)

  • Page 67: Configuring Average Credit Non-Available Duration Threshold And Action

    You need to explicitly configure a default gateway to connect to the switch and send IP packets or add a Note route for each subnet. Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide 2-47 OL-19445-02, Cisco MDS NX-OS Release 4.2(x)

  • Page 68: Configuring Management Interfaces

    Displaying Management Interface Configuration To display the management interface configuration, use the show interface mgmt 0 command. switch# show interface mgmt 0 mgmt0 is up Hardware is FastEthernet Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide 2-48 OL-19445-02, Cisco MDS NX-OS Release 4.2(x)

  • Page 69: Vsan Interfaces

    • After configuring the VSAN interface, you can configure an IP address or Virtual Router Redundancy Protocol (VRRP) feature (see the Cisco MDS 9000 Family NX-OS IP Services Configuration Guide). Creating VSAN Interfaces To create a VSAN interface, follow these steps:...

  • Page 70: Displaying Vsan Interface Information

    Trunk-allowed VSANs or VF-IDs 1 to 4093 Interface VSAN Default VSAN (1) Beacon mode Off (disabled) EISL encapsulation Disabled Data field size 2112 bytes Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide 2-50 OL-19445-02, Cisco MDS NX-OS Release 4.2(x)

  • Page 71: About Generations Of Modules And Switches

    About Generations of Modules and Switches The Cisco MDS 9500 Series switches, Cisco MDS 9222i, Cisco MDS 9216A and Cisco MDS 9216i switches support a set of modules called the Generation 2 modules. Each module or switch can have one or more ports in port groups that share common resources such as bandwidth and buffer credits.

  • Page 72: Port Groups And Port Rate Modes

    Cisco MDS 9000 Family Switching and Services Modules Generation 2 Fibre Channel switching modules are not supported on the Cisco MDS 9216 switch; Note however, they are supported by both the Supervisor-1 module and the Supervisor-2 module.

  • Page 73: Port Groups

    Ethernet ports DS-X9112 12-port 4-Gbps 12.8 4 Gbps Fibre Channel switching module DS-X9704 4-port 10-Gbps 10 Gbps Fibre Channel switching module Generation 2 Fabric Switches Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide OL-19445-02, Cisco MDS NX-OS Release 4.2(x)

  • Page 74: Port Rate Modes

    In Generation 1 modules, you cannot configure the port rate modes. The mode is determined implicitly based on the port mode and line card type. Port rate modes are not supported on the Cisco Fabric Switch for HP c-Class BladeSystem, and the Cisco Note Fabric Switch for IBM BladeCenter.
  • Page 75 Cisco MDS 9000 Family Switching and Services Modules 1. Shared rate mode is supported on Fx ports only and no ISLs. Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide OL-19445-02, Cisco MDS NX-OS Release 4.2(x)

  • Page 76: Dedicated Rate Mode

    Auto with 2-Gbps maximum 2 Gbps 2-Gbps 1-Gbps 1 Gbps Note The 4-Port 10-Gbps Fibre Channel module ports in auto mode only support auto speed mode at 10 Gbps. Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide OL-19445-02, Cisco MDS NX-OS Release 4.2(x)

  • Page 77: Dynamic Bandwidth Management

    Within a port group, some ports can be configured in dedicated rate mode while others operate in shared mode. Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide OL-19445-02, Cisco MDS NX-OS Release 4.2(x)

  • Page 78: Out-Of-Service Interfaces

    Combining Generation 1, Generation 2, and Generation 3 Modules Cisco MDS NX-OS Release 4.1(1) and later supports combining Generation 1, Generation 2, and Generation 3 modules and switches with the following considerations: MDS NX-OS Release 4.1(1) and later features are not supported on Generation 1 switches and •...

  • Page 79: Port Indexes

    • 48-port or the 24-port 8-Gbps module. When a Cisco or a other vendor switch port is connected to a Generation 1 module port (ISL Note connection), the receive buffer-to-buffer credits of the port connected to the Generation 1 module port must not exceed 255.
  • Page 80 1/2/4 Gbps FC Module powered-dn Supervisor/Fabric-2 DS-X9530-SF2-K9 active * Power-Status Power Down Reason ------------ --------------------------- powered-dn Insufficient resources (dest Index) * this terminal session MAC-Address(es) Serial-Num -------------------------------------- ---------- Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide 3-10 OL-19445-02, Cisco MDS NX-OS Release 4.2(x)

  • Page 81: Portchannels

    For information on recovering a module powered-down because port indexes are not available, refer to the Cisco MDS 9000 Family Troubleshooting Guide, Release 3.x. Whenever using mixed Generation 1 and Generation 2 modules, power up the Generation 1 modules first.
  • Page 82 Configure the Generation 2 switching modules, followed by the Generation 3 switching modules, • and then configure the PortChannel. Table 3-8 describes the results of adding a member to a PortChannel for various configurations. Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide 3-12 OL-19445-02, Cisco MDS NX-OS Release 4.2(x)
  • Page 83 Auto max 2000 Auto Generation 2 or Normal Fail Generation 3 Force Pass Auto Auto max 2000 Generation 2 or Normal Fail Generation 3 Force Pass Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide 3-13 OL-19445-02, Cisco MDS NX-OS Release 4.2(x)

  • Page 84: Configuring Module Interface Shared Resources

    Before configuring a Generation 2 or Generation 3 interface, you can use the show interface capabilities command to display detailed information about the capabilities of the interface. Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide 3-14 OL-19445-02, Cisco MDS NX-OS Release 4.2(x)
  • Page 85 Channel Switching Modules The 48-Port, 24-Port, and 4/44-Port 8-Gbps Fibre Channel switching modules support the following features: • 1-Gbps, 2-Gbps, 4-Gbps, and 8-Gbps speed traffic Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide 3-15 OL-19445-02, Cisco MDS NX-OS Release 4.2(x)
  • Page 86 ISL ports cannot operate in shared rate mode. Note Configure the rate mode (dedicated or shared) to use. See the “Configuring Rate Mode” section on page 3-21. Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide 3-16 OL-19445-02, Cisco MDS NX-OS Release 4.2(x)

  • Page 87: Configuration Guidelines For 48-Port And 24-Port 4-Gbps Fibre Channel Switching Modules

    “BB_Credit Buffers for Switching Modules” section on page 4-6, “BB_Credit Buffers for Fabric Switches” section on page 4-16, and the “About Extended BB_Credits” section on page 4-17. Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide 3-17 OL-19445-02, Cisco MDS NX-OS Release 4.2(x)

  • Page 88: Configuration Guidelines For 12-Port 4-Gbps Switching Module Interfaces

    Only 10-Gbps speed traffic • Only dedicated rate mode • ISL (E or TE) and F port modes • Extended BB_credits • Performance buffers • Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide 3-18 OL-19445-02, Cisco MDS NX-OS Release 4.2(x)

  • Page 89: Configuring Port Speed

    Purpose Step 1 Enters configuration mode. switch# config t switch(config)# Step 2 Selects the interface and enters interface switch(config)# interface fc 1/1 switch(config-if)# configuration submode. Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide 3-19 OL-19445-02, Cisco MDS NX-OS Release 4.2(x)
  • Page 90 326 frames output, 21364 bytes 0 discards, 0 errors 0 input OLS, 0 LRR, 1 NOS, 0 loop inits 3 output OLS, 2 LRR, 0 NOS, 0 loop inits Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide 3-20 OL-19445-02, Cisco MDS NX-OS Release 4.2(x)

  • Page 91: Configuring Rate Mode

    -------------------------------------------------------------------- Interfaces in the Port-Group B2B Credit Bandwidth Rate Mode Buffers (Gbps) -------------------------------------------------------------------- fc9/1 shared fc9/2 shared fc9/3 shared fc9/4 shared fc9/5 shared fc9/6 shared Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide 3-21 OL-19445-02, Cisco MDS NX-OS Release 4.2(x)
  • Page 92 Allocated dedicated bandwidth is 0.0 Gbps -------------------------------------------------------------------- Interfaces in the Port-Group B2B Credit Bandwidth Rate Mode Buffers (Gbps) -------------------------------------------------------------------- fc4/1 shared fc4/2 shared fc4/3 shared Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide 3-22 OL-19445-02, Cisco MDS NX-OS Release 4.2(x)
  • Page 93 -------------------------------------------------------------------- Interfaces in the Port-Group B2B Credit Bandwidth Rate Mode Buffers (Gbps) -------------------------------------------------------------------- fc4/25 shared fc4/26 shared fc4/27 shared fc4/28 shared fc4/29 shared fc4/30 shared Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide 3-23 OL-19445-02, Cisco MDS NX-OS Release 4.2(x)
  • Page 94 Allocated dedicated bandwidth is 0.0 Gbps -------------------------------------------------------------------- Interfaces in the Port-Group B2B Credit Bandwidth Rate Mode Buffers (Gbps) -------------------------------------------------------------------- fc7/1 shared fc7/2 shared fc7/3 shared fc7/4 shared Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide 3-24 OL-19445-02, Cisco MDS NX-OS Release 4.2(x)
  • Page 95 Allocated dedicated bandwidth is 0.0 Gbps -------------------------------------------------------------------- Interfaces in the Port-Group B2B Credit Bandwidth Rate Mode Buffers (Gbps) -------------------------------------------------------------------- fc7/37 shared fc7/38 shared fc7/39 shared fc7/40 shared fc7/41 shared Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide 3-25 OL-19445-02, Cisco MDS NX-OS Release 4.2(x)

  • Page 96: Configuring Oversubscription Ratio Restrictions

    By default, all 48-port and 24-port 4-Gbps, and 8-Gbps Fibre Channel switching modules have restrictions on oversubscription ratios enabled. As of Cisco SAN-OS Release 3.1(1) and NX-OS Release 4.1(1), you can disable restrictions on oversubscription ratios.
  • Page 97 Port-Group 2 Total bandwidth is 12.8 Gbps Total shared bandwidth is 0.8 Gbps Allocated dedicated bandwidth is 12.0 Gbps Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide 3-27 OL-19445-02, Cisco MDS NX-OS Release 4.2(x)

  • Page 98: Disabling Restrictions On Oversubscription Ratios

    1, 2, and 4 Gbps, then the allocated bandwidth ratio is 1:2:4. As of Cisco SAN-OS Release 3.0 and NX-OS Release 4.1(1) or when restrictions on oversubscription ratios are enabled, the port bandwidths are allocated in equal proportions, regardless of port speed, so, the bandwidth allocation for the same three ports mentioned in the example would be 1:1:1.

  • Page 99: Oversubscription Ratio Restrictions Example

    -------------------------------------------------------------------- fc2/37 shared fc2/38 shared fc2/39 dedicated fc2/40 dedicated fc2/41 dedicated fc2/42 shared fc2/43 shared fc2/44 shared fc2/45 shared fc2/46 shared fc2/47 shared fc2/48 shared Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide 3-29 OL-19445-02, Cisco MDS NX-OS Release 4.2(x)
  • Page 100 | include oversubscription-limit no rate-mode oversubscription-limit module 2 <---indicates no restrictions on oversubscrption ratios Save the new oversubscription ratio configuration to the startup configuration. Step 7 Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide 3-30 OL-19445-02, Cisco MDS NX-OS Release 4.2(x)

  • Page 101: Enabling Restrictions On Oversubscription Ratios

    As of Cisco SAN-OS Release 3.1(2), all 48-port and 24-port 4-Gbps Fibre Channel switching modules, as well as 18-port Fibre Channel/4-port Gigabit Ethernet Multiservice modules, have bandwidth fairness enabled by default. As of Cisco NX-OS Release 4.1(1), all the 8-Gbps Fibre Channel switching modules have bandwidth fairness enabled by default.

  • Page 102: Enabling Bandwidth Fairness

    You must reload the module for the command to take effect. Step 3 Exits configuration mode. switch(config)# exit Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide 3-32 OL-19445-02, Cisco MDS NX-OS Release 4.2(x)

  • Page 103: Upgrade Or Downgrade Scenario

    S e n d d o c u m e n t a t i o n c o m m e n t s t o m d s f e e d b a c k - d o c @ c i s c o . c o m Upgrade or Downgrade Scenario When you are upgrading from a release earlier than Cisco SAN-OS Release 3.1(2), all modules operate with bandwidth fairness disabled until the next module reload. After the upgrade, any new module that is inserted has bandwidth fairness enabled.

  • Page 104: Releasing Shared Resources In A Port Group

    Step 3 Removes the interface from a PortChannel. switch(config-if)# no channel-group Step 4 Disables the interface. switch(config-if)# shutdown Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide 3-34 OL-19445-02, Cisco MDS NX-OS Release 4.2(x)

  • Page 105: Disabling Acl Adjacency Sharing For System Image Downgrade

    Fibre Channel ACL adjacency sharing is enabled by default on the switches with an active Generation 2 switching module as of Cisco MDS SAN-OS Release 3.0(3), and with an active Generation 3 module as of MDS NX-OS Release 4.1(1). Fibre Channel ACL adjacency sharing improves the performance for zoning and inter-VSAN routing (IVR) network address translation (NAT).

  • Page 106: Example Configurations

    Step 7 switch# config t switch(config)# interface fc 4/5 - 6 Step 8 Configure the port speed, rate mode, and port mode on the interfaces. Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide 3-36 OL-19445-02, Cisco MDS NX-OS Release 4.2(x)

  • Page 107: Configuring A 24-Port 8-Gbps Fibre Channel Switching Module Example

    Configuring a 4/44-Port 8-Gbps Fibre Channel Switching Module Example These steps describe how to configure the 4/44-port 8-Gbps module interfaces: Select interfaces fc 4/11 through fc 4/12. Step 1 switch# config t Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide 3-37 OL-19445-02, Cisco MDS NX-OS Release 4.2(x)

  • Page 108: Configuring A 24-Port 4-Gbps Fibre Channel Switching Module Example

    Configure the port speed, rate mode, and port mode on the interfaces. Step 2 switch(config-if)# switchport speed 4000 switch(config-if)# switchport rate-mode dedicated switch(config-if)# switchport mode e Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide 3-38 OL-19445-02, Cisco MDS NX-OS Release 4.2(x)

  • Page 109: Configuring A 48-Port 4-Gbps Fibre Channel Switching Module Example

    Enable the interfaces and return to configuration mode. Step 6 switch(config-if)# no shutdown switch(config-if)# exit switch# Select the interfaces fc 4/7 through fc 4/10. Step 7 Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide 3-39 OL-19445-02, Cisco MDS NX-OS Release 4.2(x)

  • Page 110: Default Settings

    Default 4/44-Port 8-Gbps 48-Port 8-Gbps 24-Port 8-Gbps Host-Optimized Switching Parameter Switching Module Switching Module Module Speed mode auto auto auto_max_4G Rate mode shared shared shared Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide 3-40 OL-19445-02, Cisco MDS NX-OS Release 4.2(x)
  • Page 111 Switching Module Module Port mode BB_credit buffers 1. Auto_max_4G speed mode on the 4/44-port 8-Gbps switching module negotiates to a maximum speed of 4 Gbps. Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide 3-41 OL-19445-02, Cisco MDS NX-OS Release 4.2(x)
  • Page 112 S e n d d o c u m e n t a t i o n c o m m e n t s t o m d s f e e d b a c k - d o c @ c i s c o . c o m Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide 3-42 OL-19445-02, Cisco MDS NX-OS Release 4.2(x)

  • Page 113: About Buffer-To-Buffer Credits

    Configuring Interface Buffers Fibre Channel interfaces use buffer credits to ensure all packets are delivered to their destination. This chapter describes the different buffer credits available on the Cisco MDS Family switches and modules, and includes the following topics: About Buffer-to-Buffer Credits, page 4-1 •...

  • Page 114: Configuring Buffer-To-Buffer Credits

    S e n d d o c u m e n t a t i o n c o m m e n t s t o m d s f e e d b a c k - d o c @ c i s c o . c o m In the Cisco MDS 9100 Series, the groups of ports on the left outlined in white are in dedicated rate Note mode.

  • Page 115: Configuring Performance Buffers

    (for example, forwarding frames over FCIP interfaces). For each physical Fibre Channel interface in any switch in the Cisco MDS 9000 Family, you can specify the amount of performance buffers allocated in addition to the configured receive BB_credit value.
  • Page 116 250 BB credits Shared Dedicated 32 BB credits 1 Gbps 2 Gbps 4 Gbps 8 Gbps 250 BB credits 250 BB credits 250 BB credits 250 BB credits Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide OL-19445-02, Cisco MDS NX-OS Release 4.2(x)
  • Page 117 125 BB credits Shared Dedicated 32 BB credits 1 Gbps 2 Gbps 4 Gbps 8 Gbps 250 BB credits 250 BB credits 250 BB credits 125 BB credits Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide OL-19445-02, Cisco MDS NX-OS Release 4.2(x)

  • Page 118: Bb_Credit Buffers For Switching Modules

    The default BB_credit buffer allocation is the same for all port speeds. Note BB_Credit Buffers for Switching Modules This section describes how buffer credits are allocated to Cisco MDS 9000 switching modules, and includes the following topics: • Configuring Buffer Credits on a Generation 2 or Generation 3 Module, page 4-6 •...
  • Page 119 8-Gbps speed (10:1 oversubscription) Two ports with dedicated rate mode and 4-Gbps speed plus • four ports with shared rate mode and 4-Gbps speed (4:1 oversubscription) Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide OL-19445-02, Cisco MDS NX-OS Release 4.2(x)
  • Page 120 8-Gbps speed (10:1 oversubscription) Two ports with dedicated rate mode and 4-Gbps speed plus • one port with shared rate mode and 8-Gbps speed (2:1 oversubscription) Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide OL-19445-02, Cisco MDS NX-OS Release 4.2(x)
  • Page 121 3-Gbps speed plus eight ports with shared rate mode and 4-Gbps speed (2:1 oversubscription) Twelve ports with dedicated rate mode and 1-Gbps speed • Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide OL-19445-02, Cisco MDS NX-OS Release 4.2(x)
  • Page 122 Three ports with dedicated rate mode and 4-Gbps speed plus • four ports with shared rate mode and 1-Gbps speed plus five ports put out-of-service (see Figure 4-6) Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide 4-10 OL-19445-02, Cisco MDS NX-OS Release 4.2(x)
  • Page 123 2-Gbps 2-Gbps 1-Gbps 1-Gbps Out of Dedicated Dedicated Dedicated Shared Shared Service 2-Gbps 2-Gbps 2-Gbps 1-Gbps 1-Gbps Out of Dedicated Dedicated Dedicated Shared Shared Service Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide 4-11 OL-19445-02, Cisco MDS NX-OS Release 4.2(x)
  • Page 124 Figure 4-8) For detailed configuration steps of this example, see the “Configuring a 24-Port 4-Gbps Fibre Channel Note Switching Module Example” section on page 3-38. Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide 4-12 OL-19445-02, Cisco MDS NX-OS Release 4.2(x)
  • Page 125 12-Port 4-Gbps Switching Module BB_Credit Buffer Allocation BB_Credit Buffers Per Port Dedicated Rate Mode 4-Gbps Speed BB_Credit Buffer Allocation Type Fx Port Default BB_credit buffers Maximum BB_credit buffers Default Performance buffers Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide 4-13 OL-19445-02, Cisco MDS NX-OS Release 4.2(x)
  • Page 126 By default, the ports in the 12-port 4-Gbps switching modules come up in 4-Gbps dedicated rate mode but can be configured as 1-Gbps and 2-Gbps dedicated rate mode. Shared mode is not supported. Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide 4-14...
  • Page 127 BB_credit buffers for all the ports in ISL mode (5488 - (750 * 4)). Extended BB_credits are allocated across all ports on the switch. That is, they are not allocated Note by port group. Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide 4-15 OL-19445-02, Cisco MDS NX-OS Release 4.2(x)

  • Page 128: Bb_Credit Buffers For Fabric Switches

    S e n d d o c u m e n t a t i o n c o m m e n t s t o m d s f e e d b a c k - d o c @ c i s c o . c o m BB_Credit Buffers for Fabric Switches This section describes how buffer credits are allocated to Cisco MDS 9000 Fabric switches, and includes the following topics: •...

  • Page 129: About Extended Bb_Credits

    1. ISL = E port or TE port. About Extended BB_Credits Extended BB_credits are not supported on the Cisco MDS 9124 Fabric Switch, Cisco MDS 9134 Fabric Note Switch, the Cisco Fabric Switch for HP c-Class BladeSystem, and the Cisco Fabric Switch for IBM BladeCenter.
  • Page 130 S e n d d o c u m e n t a t i o n c o m m e n t s t o m d s f e e d b a c k - d o c @ c i s c o . c o m Configure this feature in any port of the full-rate 4-port group in either the Cisco MDS 9216i Switch •...

  • Page 131: Configuring Extended Bb_Credits

    Configuring Extended BB_credits To configure extended BB_credits for a MDS-14/2 interface, for a Generation 2 switching module interface (not including the Cisco MDS 9124 Fabric Switch), or for an interface in a Cisco MDS 9216i switch, follow these steps: Command...

  • Page 132: To Use The Bb_Sc_N Field During Plogi Or Flogi, Follow These Steps

    You can also configure the receive data field size for Fibre Channel interfaces. If the default data field size is 2112 bytes, the frame length will be 2148 bytes. Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide 4-20 OL-19445-02, Cisco MDS NX-OS Release 4.2(x)

  • Page 133: Displaying Bb_Credit Information

    Transmit B2B Credit is 0 Receive B2B Credit is 12 Receive B2B Credit performance buffers is 48 12 receive B2B credit remaining 0 transmit B2B credit remaining Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide 4-21 OL-19445-02, Cisco MDS NX-OS Release 4.2(x)
  • Page 134 S e n d d o c u m e n t a t i o n c o m m e n t s t o m d s f e e d b a c k - d o c @ c i s c o . c o m Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide 4-22 OL-19445-02, Cisco MDS NX-OS Release 4.2(x)

  • Page 135: Configuring Trunking

    Default Settings, page 5-14 About Trunking Trunking, also known as VSAN trunking, is a feature specific to switches in the Cisco MDS 9000 Family. Trunking enables interconnect ports to transmit and receive frames in more than one VSAN, over the same physical link. Trunking is supported on E ports and F ports. (See...

  • Page 136: Trunking E Ports

    E port TE port TE port Trunking Trunking is not supported by internal ports on both the Cisco Fabric Switch for HP c_Class BladeSystem Note and the Cisco Fabric Switch for IBM BladeCenter. Trunking F Ports Trunking F ports allows interconnected ports to transmit and receive tagged frames in more than one VSAN, over the same physical link.

  • Page 137: Key Concepts

    Figure 5-2). PTP is used because PTP also supports trunking PortChannels. The TF-TNP port link between a third-party NPV core and a Cisco NPV switch is Note established using the EVFP protocol. A Fibre Channel VSAN is called Virtual Fabric and uses a VF_ID in place of the VSAN ID. By •...

  • Page 138: Trunking Misconfiguration Examples

    In this example, the trunking protocol detects potential VSAN merging and isolates the ports involved. The trunking protocol cannot detect merging of VSANs when a third-party switch is placed in between two Cisco MDS 9000 Family switches (see Figure 5-4). Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide OL-19445-02, Cisco MDS NX-OS Release 4.2(x)

  • Page 139: Upgrade And Downgrade Restrictions

    VSAN 2 and VSAN 3 are effectively merged with overlapping entries in the name server and the zone applications. The Cisco MDS 9000 Fabric Manager helps detect such topologies. Refer to the Cisco MDS 9000 Family Fabric Manager Configuration Guide.
  • Page 140 Receive data field Size is 2112 Beacon is turned off Trunk vsans (admin allowed and active) (1,100-101,1101,1163-1166,1216,2172,2 182-2183) Trunk vsans (up) (1,2183) Trunk vsans (isolated) Trunk vsans (initializing) (1101,1163-1166,1216,2172,2182) Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide OL-19445-02, Cisco MDS NX-OS Release 4.2(x)

  • Page 141: Enabling The Trunking Protocols

    Figure 5-2 and includes the following topics: About Trunking Protocols, page 5-7 • Enabling the Cisco Trunking and Channeling Protocols, page 5-8 • Enabling the F Port Trunking and Channeling Protocol, page 5-8 • About Trunking Protocols The trunking protocol is important for trunking operations on the ports. The protocols enable the following activities: Dynamic negotiation of operational trunk mode.

  • Page 142: Enabling The Cisco Trunking And Channeling Protocols

    S e n d d o c u m e n t a t i o n c o m m e n t s t o m d s f e e d b a c k - d o c @ c i s c o . c o m Enabling the Cisco Trunking and Channeling Protocols To enable or disable the Cisco trunking and channeling protocol, follow these steps: Command...

  • Page 143: Configuring Trunk Mode

    No trunking F-NP link The preferred configuration on the Cisco MDS 9000 Family switches is one side of the trunk set to auto and the other side set to on. When connected to a third-party switch, the trunk mode configuration on E ports has no effect. The ISL Note is always in a trunking disabled state.
  • Page 144 Cannot be used as virtual fabric identifier. Note If the VF_ID of the F port and the N port do not match, then no tagged frames can be exchanged. Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide 5-10 OL-19445-02, Cisco MDS NX-OS Release 4.2(x)
  • Page 145 The ISL between switch 3 and switch 1 includes VSAN 1, 2, and 5. • Consequently, VSAN 2 can only be routed from switch 1 through switch 3 to switch 2. Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide 5-11 OL-19445-02, Cisco MDS NX-OS Release 4.2(x)

  • Page 146: Configuring An Allowed-Active List Of Vsans

    Enable the F port trunking and channeling protocol on the MDS core switch: Step 1 switch(config)# feature fport-channel-trunk Enable NPIV on the MDS core switch: Step 2 Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide 5-12 OL-19445-02, Cisco MDS NX-OS Release 4.2(x)

  • Page 147: Displaying Trunking Information

    236 frames output, 13818044 bytes, 0 discards 11 input OLS, 12 LRR, 10 NOS, 28 loop inits 34 output OLS, 19 LRR, 17 NOS, 12 loop inits Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide 5-13 OL-19445-02, Cisco MDS NX-OS Release 4.2(x)

  • Page 148: Default Settings

    1 to 4093 user-defined VSAN IDs. Allowed VF-ID list 1 to 4093 user-defined VF-IDs. Trunking protocol on E ports Enabled. Trunking protocol on F ports Disabled. Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide 5-14 OL-19445-02, Cisco MDS NX-OS Release 4.2(x)

  • Page 149: Configuring Portchannels

    PortChannel link. Figure 6-1 PortChannel Flexibility Switch 1 Switch 2 PortChannel A PortChannel B PortChannel C Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide OL-19445-02, Cisco MDS NX-OS Release 4.2(x)

  • Page 150: About E Portchannels

    PortChannels may contain up to 16 physical links and may span multiple modules for added high availability. See the Cisco MDS 9000 Family NX-OS Fabric Configuration Guide for information about failover Note scenarios for PortChannels and FSPF links.

  • Page 151: About F And Tf Portchannels

    An F PortChannel trunk combines the functionality and advantages of a TF port and an F PortChannel. This logical link uses the Cisco PTP and PCP protocols over Cisco EPP (ELS). If a Cisco MDS 9124 or 9134 switch is used as a core switch, only a nontrunking F PortChannel is Note supported.

  • Page 152: About Load Balancing

    TF ports and TNP ports – Trunking—Trunking permits carrying traffic on multiple VSANs between switches. • See the Cisco MDS 9000 Family NX-OS Fabric Configuration Guide. Both PortChanneling and trunking can be used between TE ports over EISLs. • About Load Balancing Two mechanisms support the load balancing functionality: Flow based—All frames between source and destination follow the same links for a given flow.
  • Page 153 For exchange 1, no frame uses link 2. For the next exchange, link 2 is chosen by the hash algorithm. Now all frames in exchange 2 use link 2. Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide OL-19445-02, Cisco MDS NX-OS Release 4.2(x)

  • Page 154: About Portchannel Modes

    PortChannels in releases prior to Release 2.0(1b), where the channel group mode is implicitly assumed to be ON. In Cisco MDS SAN-OS Releases 1.3 and earlier, the only available PortChannel mode was the ON mode. PortChannels configured in the ON mode require you to explicitly enable and disable the PortChannel member ports at either end if you add or remove ports from the PortChannel configuration.

  • Page 155: Configuration Guidelines And Restrictions

    This is the default mode. You must explicitly configure this mode. Configuration Guidelines and Restrictions Cisco MDS 9000 Family switches support the following number of PortChannels per switch: Switches with only Generation 1 switching modules do not support F and TF PortChannels. •...
  • Page 156 Since the FLOGI payload carries only the VF bits to trigger the use of a protocol after the FLOGI • exchange, those bits will be overridden. In the case of the NPV switches with core Cisco switch, PCP protocol will be initiated.

  • Page 157: Portchannel Configuration

    Assuming that the links are brought up in the 1, 2, 3, 4 sequence, links 3 and 4 will be operationally down as the fabric is misconfigured. Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide OL-19445-02, Cisco MDS NX-OS Release 4.2(x)

  • Page 158: About Portchannel Configuration

    128 PortChannels. On switches with only Generation 2 switching modules, or Generation 2 and Generation 3 switching modules, you can configure a maximum of 256 PortChannels. Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide 6-10 OL-19445-02, Cisco MDS NX-OS Release 4.2(x)

  • Page 159: Creating A Portchannel

    ON mode. Step 3 Configures the ACTIVE mode. switch(config-if)# channel mode active Reverts to the default ON mode. switch(config-if)# no channel mode active Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide 6-11 OL-19445-02, Cisco MDS NX-OS Release 4.2(x)

  • Page 160: About Portchannel Deletion

    Deleting an Interface from a PortChannel, page 6-15 • Note For information about PortChannel support on Generation 2 switching modules, see the “PortChannels” section on page 3-11. Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide 6-12 OL-19445-02, Cisco MDS NX-OS Release 4.2(x)
  • Page 161 An interface enters the suspended state if the interface is configured in the ON mode. • An interface enters the isolated state if the interface is configured in the ACTIVE mode. • Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide 6-13 OL-19445-02, Cisco MDS NX-OS Release 4.2(x)

  • Page 162: Adding An Interface To A Portchannel

    (see the “Graceful Shutdown” section on page 2-12). Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide 6-14 OL-19445-02, Cisco MDS NX-OS Release 4.2(x)

  • Page 163: About Interface Deletion From A Portchannel

    2. PortChannel Protocols In earlier Cisco SAN-OS releases, PortChannels required additional administrative tasks to support synchronization. The Cisco NX-OS software provides robust error detection and synchronization capabilities. You can manually configure channel groups or they can be automatically created. In both cases, the channel groups have the same capability and configurational parameters.

  • Page 164: About Channel Group Creation

    • Converting to Manually Configured Channel Groups, page 6-19 About Channel Group Creation Channel groups are not supported on internal ports in the Cisco Fabric Switch for HP c-Class Note BladeSystem and the Cisco Fabric Switch for IBM BladeSystem. Assuming link A1-B1 comes up first in Figure 6-8, that link is operational as an individual link.When...
  • Page 165 The channel group is removed when no member ports exist. Autocreation is not supported as of MDS NX-OS Release 4.1(1b) and later. Note Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide 6-17 OL-19445-02, Cisco MDS NX-OS Release 4.2(x)

  • Page 166: About Autocreation

    When enabling autocreation in any switch in the Cisco MDS 9000 Family, we recommend that you retain at least one interconnected port between the switches without any autocreation configuration. If all ports...

  • Page 167: About Manually Configured Channel Groups

    Configure the PortChannel member interfaces on the core switch: Step 4 switch(config)# interface fc2/1-3 switch(config-if)# shut Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide 6-19 OL-19445-02, Cisco MDS NX-OS Release 4.2(x)
  • Page 168 Create the PortChannel on the MDS core switch: Step 3 switch(config)# interface port-channel 2 switch(config-if)# switchport mode F switch(config-if)# switchport rate-mode dedicated switch(config-if)# channel mode active switch(config-if)# exit Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide 6-20 OL-19445-02, Cisco MDS NX-OS Release 4.2(x)

  • Page 169: Verifying The Portchannel Configuration

    FOP is the first port that comes up in a PortChannel and can change if the port goes down. The FOP is also identified by an asterisk ( * ). Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide 6-21 OL-19445-02, Cisco MDS NX-OS Release 4.2(x)
  • Page 170 Operational channel mode is active Last membership update succeeded First operational port is fcip200 2 ports in total, 2 ports up Ports: fcip101 [up] fcip200 [up] * Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide 6-22 OL-19445-02, Cisco MDS NX-OS Release 4.2(x)
  • Page 171 2 ports, first operational port is fcip200 fcip101 [up] fcip200 [up] The show port-channel usage command displays details of the used and unused PortChannel numbers. Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide 6-23 OL-19445-02, Cisco MDS NX-OS Release 4.2(x)
  • Page 172 ------------------------------------------------------------------------------ Interface Total Ports Oper Ports First Oper Port ------------------------------------------------------------------------------ port-channel 1 port-channel 2 fc8/13 port-channel 3 port-channel 4 port-channel 5 fc8/3 port-channel 6 Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide 6-24 OL-19445-02, Cisco MDS NX-OS Release 4.2(x)

  • Page 173: Default Settings

    FSPF is enabled by default. Create PortChannel Administratively up. Default PortChannel mode ON mode on non-NPV and NPIV core switches. ACTIVE mode on NPV switches. Autocreation Disabled. Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide 6-25 OL-19445-02, Cisco MDS NX-OS Release 4.2(x)
  • Page 174 S e n d d o c u m e n t a t i o n c o m m e n t s t o m d s f e e d b a c k - d o c @ c i s c o . c o m Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide 6-26 OL-19445-02, Cisco MDS NX-OS Release 4.2(x)

  • Page 175: Chapter 7 Configuring N Port Virtualization

    NPV mode do not join a fabric. They pass traffic between NPV core switch links and end devices, which eliminates the domain IDs for these edge switches. NPV is supported by the following Cisco MDS 9000 switches and Cisco Nexus 5000 Series switches only: Cisco MDS 9124 Multilayer Fabric Switch •...

  • Page 176: Enabling N Port Identifier Virtualization

    7-2). NPV also allows multiple devices to attach to the same port on the NPV core switch, thereby reducing the need for more ports on the core. Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide OL-19445-02, Cisco MDS NX-OS Release 4.2(x)
  • Page 177 NPV configuration at the interface level. Figure 7-3 Cisco NPV Configuration–Interface View Host N-Port NPV Core Switch NPV Device F-Port F-Port NP-Port NPIV enabled N-Port Host Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide OL-19445-02, Cisco MDS NX-OS Release 4.2(x)

  • Page 178: Npv Mode

    Configure system's network name system System config command tacacs+ Enable tacacs+ telnet Enable telnet username Configure user information. Set secondary base MAC addr and range for additional WWNs Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide OL-19445-02, Cisco MDS NX-OS Release 4.2(x)

  • Page 179: Np Ports

    NPV device. The BB_SCN of internal FLOGIs on NP ports is always set to zero. The BB_SCN is supported at the Note F-port of the NPV device. Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide OL-19445-02, Cisco MDS NX-OS Release 4.2(x)

  • Page 180: Default Port Numbers

    Default Port Numbers Port numbers on NPV-enabled switches will vary depending on the switch model. For details about port numbers for NPV-eligible switches, see the Cisco NX-OS Family Licensing Guide. Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide OL-19445-02, Cisco MDS NX-OS Release 4.2(x)

  • Page 181: Npv Cfs Distribution Over Ip

    Traffic Map As in Cisco MDS SAN-OS Release 3.3(1a) and NX-OS Release 4.1(1a), NPV supports traffic management by allowing you to select and configure the external interfaces that the server uses to connect to the core switches.

  • Page 182: Multiple Vsan Support

    • Nondisruptive upgrades are supported. See the Cisco MDS 9000 Family NX-OS Fundamentals Configuration Guide. Port tracking is supported. See the Cisco MDS 9000 Family NX-OS Security Configuration Guide. • • You can configure zoning for end devices that are connected to NPV devices using all available member types on the NPV core switch.

  • Page 183: Npv Traffic Management Guidelines

    NPIV-capable hosts, and then disable the NPIV feature. After the upgrade or downgrade is complete, enable the NPIV feature and then bringup the F ports. Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide OL-19445-02, Cisco MDS NX-OS Release 4.2(x)
  • Page 184 Step 5 Enables NPV mode on a NPV device (module, switch(config)# npv enable Cisco MDS 9124 or Cisco MDS 9134 Fabric Switch). The module or switch is rebooted, and when it comes back up, is in NPV mode. A write-erase is performed during the Note reboot.

  • Page 185: Configuring Npv Traffic Management

    Enables disruptive load balancing on the NPV tive core switch. switch (config)# Step 3 Disables disruptive load balancing on the NPV switch (config)# no npv auto-load-balance disruptive core switch. Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide 7-11 OL-19445-02, Cisco MDS NX-OS Release 4.2(x)

  • Page 186: Dpvm Configuration

    NPV device, then the NPV core switch’s VSAN F port is located in that VSAN. Otherwise, the port VSAN remains unchanged. For details about DPVM configuration, see the Cisco MDS 9000 Family NX-OS Fabric Configuration Guide.
  • Page 187 External Interfaces: ==================== Interface: fc1/1, VSAN: 2, FCID: 0x1c0000, State: Up Interface: fc1/2, VSAN: 3, FCID: 0x040000, State: Up Number of External Interfaces: 2 Server Interfaces: Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide 7-13 OL-19445-02, Cisco MDS NX-OS Release 4.2(x)

  • Page 188: Verifying Npv Traffic Management

    To display the NPV internal traffic details, enter the show npv internal info traffic-map command. NPV Traffic Map Information: ---------------------------------------- Server-If External-If(s) ---------------------------------------- fc1/3 fc1/10,fc1/11 fc1/5 fc1/1,fc1/2 ---------------------------------------- Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide 7-14 OL-19445-02, Cisco MDS NX-OS Release 4.2(x)

  • Page 189: Chapter 8 Configuring Flexattach Virtual Pwwn

    SAN. This is accomplished by moving the virtual pWWN to the new port. No change is needed if FlexAttach was configured using the physical port WWN of the server to the virtual port WWN mapping. Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide OL-19445-02, Cisco MDS NX-OS Release 4.2(x)

  • Page 190: Flexattach Virtual Pwwn Guidelines And Requirements

    Following are recommended guidelines and requirements when deploying FlexAttach virtual pWWN: FlexAttach configuration is supported only on NPV switches. • Cisco Fabric Services (CFS) IP version 4 (IPv4) distribution should be enabled. • Virtual WWNs should be unique across the fabric.

  • Page 191: Manually Enabling Flexattach Virtual Pwwn

    Several checks are done by the NPV core to ensure the uniqueness of virtual pWWNs in the switch across the NPV switches. When duplicate virtual pWWNs are configured, the subsequent logins are rejected by the NPV core switch. Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide OL-19445-02, Cisco MDS NX-OS Release 4.2(x)

  • Page 192: Verifying Flexattach Virtual Pwwn

    NPV core. (See Example 8-2.) Example 8-2 Verifying the End Device switch# show fcns database VSAN 1: -------------------------------------------------------------------------- FCID TYPE PWWN (VENDOR) FC4-TYPE:FEATURE Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide OL-19445-02, Cisco MDS NX-OS Release 4.2(x)

  • Page 193: Debugging Flexattach Virtual Pwwn

    Security settings for the FlexAttach virtual pWWN feature are done by port security at the NPV core. Node WWN of the end device is used to provide physical security. Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide OL-19445-02, Cisco MDS NX-OS Release 4.2(x)

  • Page 194: Flexattach Virtual Pwwn Cfs Distribution

    S e n d d o c u m e n t a t i o n c o m m e n t s t o m d s f e e d b a c k - d o c @ c i s c o . c o m For more details on enabling port security, refer to the Cisco MDS 9000 Family NX-OS Security Configuration Guide.

  • Page 195: I N D E X

    2-31 See also switching modules clearing 2-32 4/44-port 8-Gbps switching modules description 2-30 default settings 3-41 displaying contents 2-32 example configurations inserting entries manually 2-32 Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide IN-1 OL-19445-02, Cisco MDS NX-OS Release 4.2(x)
  • Page 196 2-10 BB_SC downgrading enabling 4-19 disabling ACL adjacency sharing 3-35 beacon modes dynamic bandwidth management configuring 2-17 description description 2-17 Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide IN-2 OL-19445-02, Cisco MDS NX-OS Release 4.2(x)
  • Page 197 BB_credits description characteristics 2-1 to 2-12 See also Fx ports configuring 2-11 frame encapsulation configuring auto port mode 2-13 configuring 2-16 configuring beacon modes 2-17 Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide IN-3 OL-19445-02, Cisco MDS NX-OS Release 4.2(x)
  • Page 198 3-34 mgmt0 interfaces taking interfaces out of service 3-33 configuring 2-47, 2-48 Generation 3 switching modules default settings 2-50 default settings 3-40 features 2-47 Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide IN-4 OL-19445-02, Cisco MDS NX-OS Release 4.2(x)
  • Page 199 Generation 2 Fibre Channel switching modules Generation 3 Fibre Channel switching modules port indexes description performance buffers port modes configuring auto description description 2-3 to 2-7 Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide IN-5 OL-19445-02, Cisco MDS NX-OS Release 4.2(x)
  • Page 200 SD ports TL ports configuring 2-13 ALPA caches 2-30 SFPs configuring 2-13 displaying transmitter types 2-26 description 2-28 Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide IN-6 OL-19445-02, Cisco MDS NX-OS Release 4.2(x)
  • Page 201 2-19 configuring 5-8, 5-9 default settings 5-14 status trunk ports displaying information 5-14 virtual devices TL ports 2-31 VSAN IDs allowed list 5-14 Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide IN-7 OL-19445-02, Cisco MDS NX-OS Release 4.2(x)
  • Page 202 Index Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide IN-8 OL-19445-02, Cisco MDS NX-OS Release 4.2(x)

Table of Contents