Setting up an IRF fabric Overview The Intelligent Resilient Framework (IRF) technology virtualizes multiple physical devices at the same layer into one virtual fabric to provide data center class availability and scalability. IRF virtualization technology offers processing power, interaction, unified management, and uninterrupted maintenance of multiple devices.
Network topology An IRF fabric can use a daisy-chain or ring topology. IRF does not support the full mesh topology. For information about connecting IRF member devices, see "Connecting IRF physical interfaces." Basic concepts IRF member roles IRF uses two member roles: master and standby (called subordinate throughout the documentation). When devices form an IRF fabric, they elect a master to manage and control the IRF fabric, and all the other devices back up the master.
Page 7
Figure 2 A network that contains two IRF domains Core network IRF fabric 1 (domain 10) Device A Device B IRF link IRF fabric 2 Device D Device C (domain 20) IRF link Access network IRF split IRF split occurs when an IRF fabric breaks up into multiple IRF fabrics because of IRF link failures, as shown in Figure 3.
Member priority Member priority determines the possibility of a member device to be elected the master. A member with higher priority is more likely to be elected the master. Interface naming conventions An interface is named in the chassis-number/slot-number/port-index format. •...
10 -rw- 4609 Jan 01 2011 00:07:53 startup.cfg 11 -rw- 3626 Jan 01 2011 01:51:56 startup.cfg_bak 12 -rw- 78833 Jan 01 2011 00:07:53 startup.mdb 13 drw- - Jan 01 2011 00:15:48 test 14 drw- - Jan 01 2011 04:16:53 versionInfo 524288 KB total (365292 KB free) To create and access the test folder under the root directory of the flash memory on member device <Master>...
• The master device fails or is removed. • The IRF fabric splits. • Independent IRF fabrics merge. NOTE: Master election does not occur when two split IRF fabrics merge. Master election selects a master in descending order: Current master, even if a new member has higher priority. When an IRF fabric is being formed, all members consider themselves as the master.
Shuts down all physical network ports in the Recovery-state fabrics except for the following ports: IRF physical interfaces. Ports you have specified with the mad exclude interface command. In contrast, BFD MAD, ARP MAD, and ND MAD do not compare the number of members in fabrics. These MAD mechanisms use the following process to hand a multi-active collision: Compare the member IDs of the masters in the IRF fabrics.
Page 12
Advantages Disadvantages Application scenario mechanism BFD, see High a BFD MAD link to the intermediate device. Availability Configuration Guide. If common Ethernet ports are used, this MAD • Detection speed is • No intermediate device is mechanism is applicable slower than BFD MAD required.
Page 13
Figure 5 LACP MAD scenario Customer premise network Intermediate device LACP-enabled dynamic link aggregation IRF fabric LACP-enabled dynamic link aggregation IRF link Subordinate Master Internet Common traffic path LACP MAD traffic path BFD MAD You can use common or management Ethernet ports for BFD MAD links. •...
Page 14
Figure 6 shows a typical BFD MAD scenario that uses an intermediate device. Figure 7 shows a typical BFD MAD scenario that does not use an intermediate device. With BFD MAD, the master attempts to establish BFD sessions with other member devices by using its MAD IP address as the source IP address.
Page 15
Figure 8 shows a typical ARP MAD scenario that uses an intermediate device. Each IRF member compares the domain ID and the active ID in incoming extended ARP packets with its domain ID and active ID. • If the domain IDs are different, the extended ARP packet is from a different IRF fabric. The device does not continue to process the packet with the MAD mechanism.
Extended ND traffic path Hardware compatibility An HPE 5700 switch can form an IRF fabric only with devices in the same series. General restrictions and configuration guidelines For a successful IRF setup, follow the restrictions and guidelines in this section and the setup procedure in "Setup and configuration task...
Page 17
The transceiver modules at the two ends of an IRF link must be the same type. For more information about the SFP+ and QSFP+ transceiver modules, see the switch installation guide and HPE Comware-Based Devices Transceiver Modules User Guide. NOTE: The transceiver modules and DAC cables available for the switch are subject to change over time.
Table 2 SFP+ ports on the switch Switch SFP+ port groups (JG896A) HPE FlexFabric 5700-40XG-2QSFP+ Switch The SFP+ ports are grouped by port number in order, starting from 1. Each group contains (JG897A) HPE FlexFabric 5700-40XG-2QSFP+ four ports. TAA-compliant Switch...
Page 19
Figure 10 Basic IRF setup flow chart Assign the device a Bind the physical Connect IRF member ID and a Reboot the device interfaces to IRF physical interfaces priority ports Save the Subordinate devices Activate IRF ports IRF fabric is set up configuration automatically reboot To set up an IRF fabric, perform the following tasks:...
Tasks at a glance Remarks multi-active collision 13. (Optional.) Recovering an IRF fabric Planning the IRF fabric setup Consider the following items when you plan an IRF fabric: • Hardware compatibility and restrictions. • IRF fabric size. • Master device. •...
Specifying a priority for each member device IRF member priority represents the possibility for a device to be elected the master in an IRF fabric. The higher the priority, the higher the possibility. A change to member priority affects the election result at the next master election. However, it does not cause an immediate master re-election.
Step Command Remarks interface-number ] } &<1-24> interface, enter its interface view. • Enter interface view: interface interface-type interface-number Shut down the interface or shutdown By default, all interfaces are up. the range of interfaces. Return to system view. quit Enter IRF port view.
• Remote login—Log in at a Layer 3 interface on any member device by using methods including Telnet and SNMP. When you log in to an IRF fabric, you are placed at the CLI of the master, regardless of at which member device you are logged in.
Configuring the global load sharing mode Step Command Remarks Enter system view. system-view By default, packets are distributed automatically across IRF member links based on irf-port global load-sharing mode Configure the global IRF packet types. { destination-ip | destination-mac link load sharing mode. | source-ip | source-mac } * If you execute this command multiple times, the most recent...
This feature specifies the amount of time an IRF fabric can continue using a MAC address as the IRF bridge MAC address after the address owner leaves. By default, the bridge MAC address of the master device becomes the IRF bridge MAC address upon the setup of the IRF fabric.
• undo irf mac-address persistent—Bridge MAC address of the current master replaces the original one as soon as the owner of the original bridge MAC leaves. To configure the IRF bridge MAC persistence setting: Step Command Remarks Enter system view. system-view •...
Configuration prerequisites Make sure the device you are adding to the IRF fabric has sufficient storage space for the new software images. If sufficient storage space is not available, the device automatically deletes the current software images. If the reclaimed space is still insufficient, the device cannot complete the auto-update. You must reboot the device, and then access the Boot menus to delete files.
Do not configure LACP MAD together with BFD MAD, ARP MAD, or ND MAD, because they handle collisions differently. Do not configure BFD MAD together with ARP MAD or ND MAD if common Ethernet ports are used for MAD. BFD MAD is exclusive with the spanning tree feature, but ARP MAD and ND MAD require the spanning tree feature.
Step Command Remarks the range of Ethernet ports allowed. to the specified aggregation Also perform this step on the group. intermediate device. Configuring BFD MAD Before you configure BFD MAD, choose a BFD MAD link scheme as described in "BFD MAD."...
Page 31
Step Command Remarks [ to interface-type To assign one port to the BFD interface-number ] } &<1-24> MAD VLAN, enter Ethernet • interface view. Enter interface view: interface interface-type interface-number • Assign the port to the VLAN as an access port: port access vlan vlan-id •...
Step Command Remarks (Optional.) Assign a domain By default, the domain ID of an irf domain domain-id ID to the IRF fabric. IRF fabric is 0. Of all management Ethernet Enter management interface ports on an IRF fabric, only the Ethernet interface view.
Page 33
Step Command Remarks leaves. owner leaves. Create a VLAN dedicated to The default VLAN on the device vlan vlan-id ARP MAD. is VLAN 1. Return to system view. quit Enter Ethernet interface interface interface-type view. interface-number • Assign the port to the VLAN as an access port: port access vlan vlan-id •...
Step Command Remarks Of all management Ethernet Enter management interface ports on an IRF fabric, only the Ethernet interface view. m-gigabitethernet interface-number master's management Ethernet port is accessible. Assign an IP address to the ip address ip-address { mask | By default, no IP addresses are management Ethernet mask-length }...
Step Command Remarks • Assign the port to the VLAN as a hybrid port: port hybrid vlan vlan-id { tagged | untagged } Return to system view. quit Create the VLAN interface interface and enter VLAN interface vlan-interface vlan-interface-id view. ipv6 address 10.
Page 36
Figure 13 Recovering the IRF fabric IP network IP network IP network IRF fabric 2 IRF fabric 2 IRF fabric 1 IRF fabric 1 (Recovery) (Recovery) (Active) (Active) fabric After the IRF link IRF merge is recovered IP network IP network IP network If the active IRF fabric fails before the IRF link is recovered (see Figure...
LACP MAD-enabled IRF configuration example Network requirements As shown in Figure 15, set up a four-chassis IRF fabric at the access layer of the enterprise network. Configure LACP MAD on the multichassis aggregation to Device E, an HPE device that supports extended LACP.
Page 38
Figure 15 Network diagram Device E IP network XGE1/0/1~XGE1/0/4 XGE2/0/1 XGE1/0/2 Device A Device B XGE1/0/47 XGE2/0/47 XGE2/0/45 XGE1/0/45 XGE1/0/48 XGE2/0/48 XGE2/0/46 XGE1/0/46 (IRF-port1/2) (IRF-port2/1) (IRF-port2/2) (IRF-port1/1) XGE3/0/45 XGE4/0/45 XGE3/0/46 XGE4/0/46 (IRF-port3/2) (IRF-port4/1) XGE3/0/2 XGE4/0/1 XGE3/0/47 XGE4/0/47 XGE3/0/48 XGE4/0/48 Device C Device D (IRF-port3/1) (IRF-port4/2)
Page 39
[Sysname] irf-port-configuration active Configure Device B: # Change the member ID of Device B to 2 and reboot the device to validate the change. <Sysname> system-view [Sysname] irf member 1 renumber 2 Renumbering the member ID may result in configuration change or loss. Continue? [Y/N]:y [Sysname] quit <Sysname>...
Page 40
[Sysname-if-range] shutdown [Sysname-if-range] quit # Bind Ten-GigabitEthernet 3/0/47 and Ten-GigabitEthernet 3/0/48 to IRF-port 3/1. [Sysname] irf-port 3/1 [Sysname-irf-port3/1] port group interface ten-gigabitethernet 3/0/47 [Sysname-irf-port3/1] port group interface ten-gigabitethernet 3/0/48 [Sysname-irf-port3/1] quit # Bind Ten-GigabitEthernet 3/0/45 and Ten-GigabitEthernet 3/0/46 to IRF-port 3/2. [Sysname] irf-port 3/2 [Sysname-irf-port3/2] port group interface ten-gigabitethernet 3/0/45 [Sysname-irf-port3/2] port group interface ten-gigabitethernet 3/0/46...
[Sysname-if-range] quit [Sysname] save # Activate the IRF port configuration. [Sysname] irf-port-configuration active Device D reboots to join the IRF fabric. A four-chassis IRF fabric is formed. Configure LACP MAD on the IRF fabric: # Set the domain ID of the IRF fabric to 1. <Sysname>...
Page 42
• Disable the spanning tree feature on the ports used for BFD MAD, because the two features conflict with each other. Figure 16 Network diagram Device E XGE1/0/1 XGE1/0/2 XGE1/0/4 XGE1/0/3 Device B Device A XGE1/0/1 XGE2/0/1 XGE1/0/47 XGE2/0/47 XGE2/0/45 XGE1/0/45 XGE1/0/48 XGE2/0/48...
Page 43
[Sysname] interface range ten-gigabitethernet 1/0/45 to ten-gigabitethernet 1/0/48 [Sysname-if-range] undo shutdown [Sysname-if-range] quit [Sysname] save # Activate the IRF port configuration. [Sysname] irf-port-configuration active Configure Device B: # Change the member ID of Device B to 2 and reboot the device to validate the change. <Sysname>...
Page 44
# Connect Device C to Device A as shown in Figure 16, and log in to Device C. This example uses the SFP+ port group that contains Ten-GigabitEthernet 3/0/45 to Ten-GigabitEthernet 3/0/48 for IRF links. # Shut down the physical interfaces. <Sysname>...
Page 45
[Sysname-irf-port4/2] port group interface ten-gigabitethernet 4/0/47 [Sysname-irf-port4/2] port group interface ten-gigabitethernet 4/0/48 [Sysname-irf-port4/2] quit # Bring up the SFP+ ports and save the configuration. [Sysname] interface range ten-gigabitethernet 4/0/45 to ten-gigabitethernet 4/0/48 [Sysname-if-range] undo shutdown [Sysname-if-range] quit [Sysname] save # Activate the IRF port configuration. [Sysname] irf-port-configuration active Device D reboots to join the IRF fabric.
ARP MAD-enabled IRF configuration example Network requirements As shown in Figure 17, set up a four-chassis IRF fabric in the enterprise network. • Configure ARP MAD in the IRF fabric and use the links connected to Device E for transmitting ARP MAD packets.
Page 47
[Sysname-irf-port1/2] port group interface ten-gigabitethernet 1/0/48 [Sysname-irf-port1/2] quit # Bring up the SFP+ ports and save the configuration. [Sysname] interface range ten-gigabitethernet 1/0/45 to ten-gigabitethernet 1/0/48 [Sysname-if-range] undo shutdown [Sysname-if-range] quit [Sysname] save # Activate the IRF port configuration. [Sysname] irf-port-configuration active Configure Device B: # Change the member ID of Device B to 2 and reboot the device to validate the change.
Page 48
[Sysname] quit <Sysname> reboot # Connect Device C to Device A as shown in Figure 17, and log in to Device C. This example uses the SFP+ port group that contains Ten-GigabitEthernet 3/0/45 to Ten-GigabitEthernet 3/0/48 for IRF links. # Shut down the physical interfaces. <Sysname>...
Page 49
# Bind Ten-GigabitEthernet 4/0/47 and Ten-GigabitEthernet 4/0/48 to IRF-port 4/2. [Sysname] irf-port 4/2 [Sysname-irf-port4/2] port group interface ten-gigabitethernet 4/0/47 [Sysname-irf-port4/2] port group interface ten-gigabitethernet 4/0/48 [Sysname-irf-port4/2] quit # Bring up the SFP+ ports and save the configuration. [Sysname] interface range ten-gigabitethernet 4/0/45 to ten-gigabitethernet 4/0/48 [Sysname-if-range] undo shutdown [Sysname-if-range] quit [Sysname] save...
<DeviceE> system-view [DeviceE] stp global enable [DeviceC] stp region-configuration [DeviceC-mst-region] region-name arpmad [DeviceC-mst-region] instance 1 vlan 3 [DeviceC-mst-region] active region-configuration [DeviceC-mst-region] quit # Create VLAN 3, and assign ports Ten-GigabitEthernet 1/0/1, Ten-GigabitEthernet 1/0/2, Ten-GigabitEthernet 1/0/3, and Ten-GigabitEthernet 1/0/4 to VLAN 3 for forwarding ARP MAD packets.
Page 51
# Shut down the physical interfaces used for IRF links. This example uses the SFP+ port group that contains Ten-GigabitEthernet 1/0/45 to Ten-GigabitEthernet 1/0/48 for IRF links. <Sysname> system-view [Sysname] interface range ten-gigabitethernet 1/0/45 to ten-gigabitethernet 1/0/48 [Sysname-if-range] shutdown [Sysname-if-range] quit # Bind Ten-GigabitEthernet 1/0/45 and Ten-GigabitEthernet 1/0/46 to IRF-port 1/1.
Page 52
# Bring up the SFP+ ports and save the configuration. [Sysname] interface range ten-gigabitethernet 2/0/45 to ten-gigabitethernet 2/0/48 [Sysname-if-range] undo shutdown [Sysname-if-range] quit [Sysname] save # Activate the IRF port configuration. [Sysname] irf-port-configuration active The two devices perform master election, and the one that has lost the election reboots to form an IRF fabric with the master.
Page 53
<Sysname> reboot # Connect Device D to Device B and Device C as shown in Figure 18, and log in to Device D. This example uses the SFP+ port group that contains Ten-GigabitEthernet 4/0/45 to Ten-GigabitEthernet 4/0/48 for IRF links. # Shut down the physical interfaces.
Page 54
# Create VLAN-interface 3, assign it an IPv6 address, and enable ND MAD on the interface. [Sysname] interface vlan-interface 3 [Sysname-Vlan-interface3] ipv6 address 2001::1 64 [Sysname-Vlan-interface3] mad nd enable You need to assign a domain ID (range: 0-4294967295) [Current domain is: 1]: The assigned domain ID is: 1 Configure Device E as the intermediate device:...
Document conventions and icons Conventions This section describes the conventions used in the documentation. Port numbering in examples The port numbers in this document are for illustration only and might be unavailable on your device. Command conventions Convention Description Boldface Bold text represents commands and keywords that you enter literally as shown.
Network topology icons Convention Description Represents a generic network device, such as a router, switch, or firewall. Represents a routing-capable device, such as a router or Layer 3 switch. Represents a generic switch, such as a Layer 2 or Layer 3 switch, or a router that supports Layer 2 forwarding and other Layer 2 features.
Support and other resources Accessing Hewlett Packard Enterprise Support • For live assistance, go to the Contact Hewlett Packard Enterprise Worldwide website: www.hpe.com/assistance • To access documentation and support services, go to the Hewlett Packard Enterprise Support Center website: www.hpe.com/support/hpesc Information to collect •...
For more information and device support details, go to the following website: www.hpe.com/info/insightremotesupport/docs Documentation feedback Hewlett Packard Enterprise is committed to providing documentation that meets your needs. To help us improve the documentation, send any errors, suggestions, or comments to Documentation Feedback (docsfeedback@hpe.com). When submitting your feedback, include the document title,...
Page 59
part number, edition, and publication date located on the front cover of the document. For online help content, include the product name, product version, help edition, and publication date located on the legal notices page.
Need help?
Do you have a question about the FlexFabric 5700 Series and is the answer not in the manual?
Questions and answers