Page 1 ® ® Broadcom NetXtreme BCM57XX User Guide Last revised: April 2017 2CS57XX-CDUM514-R...
Page 2 The term “Broadcom” refers to Broadcom Limited and/or its subsidiaries. For more information, please visit www.broadcom.com. Broadcom reserves the right to make changes without further notice to any products or data herein to improve reliability, function, or design. Information furnished by Broadcom is believed to be accurate and reliable.
Page 3: Table Of Contents
Adaptive Interrupt Frequency ......................14 Dual DMA Channels........................14 ASIC with Embedded RISC Processor ..................15 Broadcom Advanced Control Suite ....................15 Supported Operating Environments......................15 Network Link and Activity Indication......................15 Section 3: Windows Driver and Management Application Installation ......17 Installing the Driver Software ........................
Page 4 Step 2: Start CIM Server on the Server ..................41 Step 3: Configure OpenPegasus on the Server ................41 Step 4: Install Broadcom CMPI Provider ..................42 Step 5: Perform Linux Firewall Configuration, If Required............. 43 Step 6: Install BACS and Related Management Applications............44 Installing WS-MAN or CIM-XML on Linux Client...................
Page 5 NetXtreme User Guide Section 6: Using Broadcom Advanced Control Suite 4..........51 Broadcom Advanced Control Suite Overview ..................51 Starting Broadcom Advanced Control Suite ................... 52 BACS Interface............................52 Explorer View Pane ..........................53 Context View Selector ........................... 54 Filter View............................54 Context View Pane ..........................
Page 6 Limitations of Smart Load Balancing and Failover/SLB (Auto-Fallback Disable) Types of Teams..100 LiveLink™ Functionality ........................101 Teaming and Large Send Offload/Checksum Offload Support............101 Section 8: Broadcom Gigabit Ethernet Teaming Services .......... 102 Introduction .............................. 103 Teaming Glossary ..........................103 Teaming Concepts ..........................
Page 7 NetXtreme User Guide Architecture ............................113 Outbound Traffic Flow ........................114 Inbound Traffic Flow (SLB Only) ....................114 Protocol Support...........................115 Performance..........................115 Driver Support by Operating System....................116 Supported Teaming Speeds........................117 Teaming and Other Advanced Networking Properties ................118 Checksum Offload ..........................119 IEEE 802.1p QoS Tagging ........................119 Large Send Offload ..........................119 Jumbo Frames.............................119 IEEE 802.1Q VLANs ...........................119...
Page 8 NetXtreme User Guide Section 9: iSCSI Protocol and Broadcom Boot Agent Software ......... 139 iSCSI Boot..............................139 Supported Operating Systems for iSCSI Boot ..................139 iSCSI Boot Setup ..........................139 Configuring the iSCSI Target ....................... 139 Configuring iSCSI Boot Parameters .................... 140 MBA Boot Protocol Configuration ....................
Page 9 Running a Cable Length Test ........................164 Testing Network Connectivity .........................165 Windows ..............................165 Linux ..............................165 Broadcom Boot Agent..........................165 Broadcom Advanced Server Program (BASP) ..................166 Kernel Debugging over Ethernet......................166 Miscellaneous ............................166 Section 13: Regulatory Information ................167 FCC Class B Notice ..........................167 VCCI Class B Notice ..........................168...
Page 10: Section 1: Installing The Hardware
Installing the Adapter • Connecting the Network Cables Note: This section applies only to add-in NIC models of Broadcom NetXtreme Gigabit Ethernet adapters. Safety Precautions Caution! The adapter is being installed in a system that operates with voltages that can be lethal.
Page 11: Preinstallation Checklist
Installing the Adapter The following instructions apply to installing the Broadcom NetXtreme Gigabit Ethernet adapter (add-in NIC) in most servers. Refer to the manuals that were supplied with your server for details about performing these tasks on your particular server.
Page 12: Connecting The Network Cables
Installing the Hardware Connecting the Network Cables Copper The Broadcom NetXtreme Gigabit Ethernet adapter has one or more RJ-45 connectors used for attaching the system to an Ethernet copper-wire segment. Note: The Broadcom NetXtreme Gigabit Ethernet adapter supports Automatic MDI Crossover (MDIX), which eliminates the need for crossover cables when connecting machines back-to-back.
Page 13: Section 2: Functionality And Features
1 gigabit per second—10 times the rate of Fast Ethernet adapters. Using the Broadcom teaming software, you can split your network into virtual LANs (VLANs) as well as group multiple network adapters together into teams to provide network load balancing and fault tolerance functionality.
Page 14: Power Management
When traffic is heavy, the adapter issues one host interrupt for multiple, back-to-back incoming packets, preserving host CPU cycles. Dual DMA Channels The PCIe interface on Broadcom NetXtreme Gigabit Ethernet adapters contains two independent DMA channels for simultaneous read and write operations. Broadcom ®...
Page 15: Asic With Embedded Risc Processor
For copper-wire Ethernet connections, the state of the network link and activity is indicated by the LEDs on the RJ-45 connector, as described in Table 2: “Network Link and Activity Indicated by RJ-45 Port LEDs,” on page 15. Broadcom Advanced Control Suite also provides information about the status of the network link and activity (see Viewing Adapter Information).
Page 16 NetXtreme User Guide Functionality and Features Broadcom ® April 2017 • 2CS57XX-CDUM514-R Page 16...
Page 17: Section 3: Windows Driver And Management Application Installation
Repairing or Reinstalling the Driver Software • Removing the Device Drivers • Viewing or Changing the Properties of the Adapter • Setting Power Management Options • Configuring the Communication Protocol To Use With BACS4 Broadcom ® April 2017 • 2CS57XX-CDUM514-R Page 17...
Page 18: Installing The Driver Software
If your controller was installed at the factory, the driver software has been installed for you. When Windows first starts after a hardware device (such as a Broadcom NetXtreme Adapter) has been installed, or after the existing device driver has been removed, the operating system automatically detects the hardware and prompts you to install the driver software for that device.
Page 19: Using Silent Installation
To modify the driver software 1. In Control Panel, double-click Add or Remove Programs. 2. Click Broadcom Drivers and Management Applications, and then click Change. 3. Click Next to continue. 4. Click Modify, Add, or Remove to change program features. This option does not install drivers for new adapters.
Page 20: Repairing Or Reinstalling The Driver Software
To remove the device drivers 1. In Control Panel, double-click Add or Remove Programs. 2. Click Broadcom Drivers and Management Applications, and then click Remove. Follow the on-screen prompts. 3. Reboot your system to completely remove the drivers. If you fail to reboot your system, you will not be able to successfully install the drivers.
Page 21: Viewing Or Changing The Properties Of The Adapter
Windows Driver and Management Application Installation Viewing or Changing the Properties of the Adapter To view or change the properties of the Broadcom network adapter 1. In Control Panel, click Broadcom Control Suite 4. 2. Click the Advanced section of the Configurations tab.
Page 22: Configuring The Communication Protocol To Use With Bacs4
On the following operating systems, WinRM 2.0 is preinstalled: • Windows 7 • Windows 8 • Windows 8.1 • Windows Server 2008 R2 • Windows Server 2012 • Windows 2012 R2 • Windows Server 2016 Broadcom ® April 2017 • 2CS57XX-CDUM514-R Page 22...
Page 23 6. Under WinRM Client, double-click Trusted Hosts. 7. In the TrustedHostsList, enter the host names of the clients. If all clients are trusted then enter an asterisk (*) only. 8. Select WinRM Service. 9. Enable Allow Basic Authentication. Broadcom ® April 2017 • 2CS57XX-CDUM514-R Page 23...
Page 24 Openssl on Windows can be used to generate the self-signed certificate, as follows: 1. Enter the following command to generate a private key: openssl genrsa -des3 -out server.key 1024 2. You are prompted to enter a passphrase. Be sure to remember the passphrase. Broadcom ® April 2017 • 2CS57XX-CDUM514-R Page 24...
Page 25 • State or Province Name (full name) []: California • Locality Name (e.g., city) []: Irvine • Organization Name (e.g., company) []: Broadcom Corporation • Organizational Unit Name (e.g., section) []: Engineering • Common Name (e.g., YOUR name) []: Enter the host name or IP address of the Windows server. For iPv6, enter the Common Name in the format [xyxy:xxx:….::xxx], including the brackets [ ].
Page 26 The certificate is shown as installed on the right side of the window. The name will be the name you specified while creating a self-signed certificate. 15. Right-click on the certificate and select Properties. A dialog box displays, as follows: Broadcom ® April 2017 • 2CS57XX-CDUM514-R Page 26...
Page 27 Select and copy the thumbprint in the Details window so you can insert it in the next step. h. Return to the command prompt. i. Enter the following command: winrm create winrm/config/Listener?Address=*+Transport= HTTPS @{Hostname="<HostName or IPAddress>"; CertificateThumbprint="<paste from the previous step and remove the spaces>"} Broadcom ® April 2017 • 2CS57XX-CDUM514-R Page 27...
Page 28 9. Ensure that the new rule and is enabled (the green check box is selected). Windows XP 1. Click Start > Control Panel, and then double-click Windows Firewall. 2. Click the Exceptions tab Broadcom ® April 2017 • 2CS57XX-CDUM514-R Page 28...
Page 29: Ws-Man Windows Client Installation
Enable Allow Basic Authentication and click OK. j. Run the following command from the command prompt to test the connection: winrm id -remote:<remote machine Hostname or IP Address> 2. Perform HTTPS Configuration (if you plan to use HTTPS) Broadcom ® April 2017 • 2CS57XX-CDUM514-R Page 29...
Page 30 Note: It is important to use switch in the command line testing, as the certificate -skipCAcheck winrm is self-generated and not imported on the client. Otherwise, the following error message displays: WSManFault. Broadcom ® April 2017 • 2CS57XX-CDUM514-R Page 30...
Page 31: Using Wmi
BACS4 client GUI may not always have the domain administrator account privilege. It is necessary to configure WMI security access on the remote host to allow the user to connect to it using the BACS4 client GUI. Broadcom ® April 2017 • 2CS57XX-CDUM514-R...
Page 32 In the Permissions for User area, select Allow for Remote Launch and Remote Activation, and then click OK. Figure 1: Launch and Activation Permission For more information, see Securing a Remote WMI Connection on the Microsoft Developer Network site. Broadcom ® April 2017 • 2CS57XX-CDUM514-R Page 32...
Page 33: Special Configuration For Wmi On Different Systems
Special Configuration for WMI on Different Systems In Windows Vista and Windows 7, in order to let all users in the administrator group connect using the WMI namespace, the user might need to change the LocalAccountTokenFilterPolicy as needed. Broadcom ® April 2017 • 2CS57XX-CDUM514-R...
Page 34: Section 4: Linux Driver And Management Application Installation
Compressed tar (tg3-version.tar.gz) Identical source files to build the driver are included in both RPM and TAR source packages. The tar file contains additional utilities such as patches and driver disk images for network installation. Broadcom ® April 2017 • 2CS57XX-CDUM514-R...
Page 35: Installing Tg3 Driver Software
Depending on the kernel, the driver is installed to the following path: 2.6.x kernels: /lib/modules/kernel_version/kernel/drivers/net/tg3.ko 4. Load the driver. modprobe tg3 To configure the network protocol and address, refer to the Linux version-specific documentation. Broadcom ® April 2017 • 2CS57XX-CDUM514-R Page 35...
Page 36: Building The Driver From The Source Tar File
If there is an interface configuration that is related to the tg3 driver, then bring the interface down first by using ifconfig ethx down and then rmmod tg3. Broadcom ® April 2017 • 2CS57XX-CDUM514-R...
Page 37: Driver Messages
Teaming with Channel Bonding With the TG3 driver, you can team adapters together using the bonding kernel module and a channel bonding interface. Refer to your Linux documentation for more information on Linux Channel Bonding. Broadcom ® April 2017 • 2CS57XX-CDUM514-R...
Page 38: Linux Management Application Installation
Installing the Broadcom Advanced Control Suite Overview The Broadcom Advanced Control Suite version 4 (BACS4) is a management application for configuring the NetXtreme I families of adapters. BACS4 GUI software operates on Windows and BACS CLI is used on Linux server operating systems.
Page 39: Installing Ws-Man Or Cim-Xml On Linux Server
Note that in inbox Pegasus, HTTP is not enabled by default. After Inbox OpenPegasus is installed successfully, if no further configuration is required, then follow the instructions in Step 4: Install Broadcom CMPI Provider. To enable HTTP, see Enable HTTP.
Page 40 For WS-MAN Support, add the following environment variable: • export PEGASUS_ENABLE_PROTOCOL_WSMAN=true CIM-XML and WSMAN in OpenPegasus use the same ports for HTTP or HTTPS. The default port numbers for HTTP and HTTPS are 5989 and 5989, respectively. Broadcom ® April 2017 • 2CS57XX-CDUM514-R Page 40...
Page 41: Step 2: Start Cim Server On The Server
-s <property name>=<value> -p Find out more about the command. cimconfig --help CIM server must be started before running , and must be restarted for configuration changes to take cimconfig effect. Broadcom ® April 2017 • 2CS57XX-CDUM514-R Page 41...
Page 42: Step 4: Install Broadcom Cmpi Provider
Linux Driver and Management Application Installation Enable Authentication The following OpenPegasus properties have to be set as described in this section. Otherwise, the Broadcom CIM Provider will not work properly. Ensure the following are set before launching BACS and connecting to the provider.
Page 43: Step 5: Perform Linux Firewall Configuration, If Required
NetXtreme User Guide Linux Driver and Management Application Installation Ensure that OpenPegasus is installed properly before installing CMPI Provider. Install Enter following command to install Broadcom CMPI Provider. % rpm -i BRCM_CMPIProvider-{version}.{arch}.rpm Uninstall Enter following command to uninstall Broadcom CMPI Provider:...
Page 44: Step 6: Install Bacs And Related Management Applications
• Source Network: 0/0 (means all) • Protocol: TCP • Destination Port: 5988:5989 • Source Port: Leave blank. Step 6: Install BACS and Related Management Applications Installing the Broadcom Advanced Control Suite. Broadcom ® April 2017 • 2CS57XX-CDUM514-R Page 44...
Page 45: Installing Ws-Man Or Cim-Xml On Linux Client
• State or Province Name (full name) []: California • Locality Name (e.g., city) []: Irvine • Organization Name (e.g., company) []: Broadcom Corporation • Organizational Unit Name (e.g., section) []: Engineering • Common Name (e.g., YOUR name) []: Enter the host name or IP address of the Windows server. For iPv6, enter the Common Name in the format [xyxy:xxx:….::xxx], including the brackets [ ].
Page 46 To generate a self-signed certificate which is active for 365 days, enter the following command: openssl x509 -req -days 365 -in server.csr -signkey server.key -out server.crt The following output displays: Signature ok subject=/C=US/ST=California/L=Irvine/O=Broadcom Corporation/OU=Engineering/CN=MGMTAPP- LAB3/emailAddress= Getting Private key 6. Enter the following command to verify the generated self-signed certificate.
Page 47: Installing The Broadcom Advanced Control Suite
If this fails, then the certificate is not installed correctly and an error message displays, indicating to take corrective action. Installing the Broadcom Advanced Control Suite The Broadcom Advanced Control Suite (BACS) software can be installed on a Linux system using the Linux RPM package. This installation includes a CLI client. Before you begin: •...
Page 48: Section 5: Vmware Driver Software
• tg3 NIC 0: Use the default number of NetQueues. • tg3 NIC 1: Disable the NetQueue feature. • tg3 NIC 2: Use 1 NetQueue. • tg3 NIC 3: Use 2 NetQueues. Broadcom ® April 2017 • 2CS57XX-CDUM514-R Page 48...
Page 49: Driver Parameters
Most systems are set to dmesg -n <level> level 6 by default. To see all messages, set the level higher. Driver Sign On tg3.c:v3.118g (Jan 4, 2012) NIC Detected Broadcom ® April 2017 • 2CS57XX-CDUM514-R Page 49...
Page 50 Link Up and Speed Indication tg3: vmnic0: Link is up at 1000 Mbps, full duplex. tg3: vmnic0: Flow control is on for TX and on for RX. Link Down Indication tg3: vmnic0: Link is down. Broadcom ® April 2017 • 2CS57XX-CDUM514-R Page 50...
Page 51: Section 6: Using Broadcom Advanced Control Suite 4
Broadcom Advanced Server Program (BASP), which runs within Broadcom Advanced Control Suite, is used to configure teams for load balancing, fault tolerance, and virtual local area networks (VLANs). BASP functionality is available only on systems that use at least one Broadcom network adapter. BASP operates on Windows operating systems only.
Page 52: Starting Broadcom Advanced Control Suite
Using Broadcom Advanced Control Suite 4 Starting Broadcom Advanced Control Suite In Control Panel, click Broadcom Control Suite 4, or click the BACS icon in the taskbar located at the bottom of the Windows or Windows Server desktop. On Linux systems, you can double-click the BACS4 desktop icon, or access the BACS program from the task bar under System Tools.
Page 53: Explorer View Pane
NetXtreme User Guide Using Broadcom Advanced Control Suite 4 Explorer View Pane You can dock and pin the Explorer View pane on the left side, right side, top, or bottom of the main window. The Explorer View pane lists the objects that can be viewed, analyzed, tested, or configured by BACS. When an item is selected in the Explorer View pane, the tabs showing the information and options that are available for the item appear in the Context View pane.
Page 54: Context View Selector
• Tool Bar: Displays/hides the tool bar. • Status Bar: Displays/hides the status bar. • Broadcom Logo: Displays/hides the Broadcom Logo on BACS to optimize the maximum viewable space. Tools menu • Options: Used for configuring BACS preferences. Broadcom ®...
Page 55: Description Pane
NetXtreme User Guide Using Broadcom Advanced Control Suite 4 Teams (Windows only) • Create Teams: Creates new teams with either the Teaming Wizard or in Advanced mode. • Manage Teams: Manages existing teams with either the Teaming Wizard or in Advanced mode.
Page 56: Connecting To A Host
NetXtreme User Guide Using Broadcom Advanced Control Suite 4 Connecting to a Host You can add one or more Windows or Linux hosts to manage from BACS. To add a local host 1. From the Action menu, click Add Host.
Page 57: Managing The Host
NetXtreme User Guide Using Broadcom Advanced Control Suite 4 Managing the Host At the host level, you can view host information and configure parameters from the following tabs: • Information • Configuration To view host information Select the host in the Explorer View pane, and then select the Information tab to view host-level information.
Page 58 NetXtreme User Guide Using Broadcom Advanced Control Suite 4 Broadcom ® April 2017 • 2CS57XX-CDUM514-R Page 58...
Page 59: Managing The Network Adapter
Select the network adapter in the Explorer View pane, and then select the Information tab to view adapter- level information. Notes: • Information about Broadcom network adapters may be more comprehensive than information about network adapters made by others. • Some information may not be available for all Broadcom network adapters.
Page 60: Viewing Driver Information
NetXtreme User Guide Using Broadcom Advanced Control Suite 4 Viewing Driver Information The Driver Information section of the Information tab displays data about the driver for the selected network adapter. To view Driver Information for any installed network adapter, click the name of the adapter listed in the Explorer View pane, then click the Information tab.
Page 61: Viewing Resource Information
To view Resources for any installed network adapter, click the name of the adapter listed in the Explorer View pane, then click the Information tab. Note: Some information may not be available for all Broadcom network adapters. The type of input/output (I/O) interconnect used by the adapter.
Page 62: Viewing Hardware Information
To view Hardware for any installed network adapter, click the name of the adapter listed in the Explorer View pane, then click the Information tab. Note: Some information may not be available for all Broadcom network adapters. Broadcom ®...
Page 63: Testing The Network
NetXtreme User Guide Using Broadcom Advanced Control Suite 4 The chip version of the Broadcom adapter (this information is not available for adapters made by ASIC Version. others). The firmware version of the Broadcom adapter (this information is not available for adapters Firmware Version.
Page 64: Running Diagnostic Tests
The Diagnostic Tests option on the Diagnostics tab lets you check the state of the physical components on a Broadcom network adapter. You can trigger the tests manually, or choose to have BACS 3 continuously perform them. If the test are performed continuously, then the number of passes and fails in the Result field for each test increments every time the tests are performed.
Page 65: Analyzing Cables
• The network connection is temporarily lost during an analysis. • For Broadcom NetXtreme adapters, the cable analysis test can only run for gigabit link speed connections and when there is no connection. • This option is not available for all Broadcom network adapters.
Page 66: Setting Adapter Properties
The list of available properties for your particular adapter may be different. • Some properties may not be available for all Broadcom network adapters. To set adapter properties 1. Click the name of the adapter in the Explorer View pane, and click the Configurations tab.
Page 67 Wake Up Capabilities. network wake-up frame. Two types of wake-up frames are possible: Magic Packet and Wake Up Frame. This property is only available for Broadcom NetXtreme adapters. • Both (default). Selects both Magic Packet and Wake Up Frame as wake-up frames.
Page 68: Viewing Statistics
VLAN membership. Since support for VLAN tagging on Broadcom's NDIS 6.0 driver is limited to transmit (Tx) traffic only, there is a risk of inbound traffic (Rx) from a different VLAN being passed up to the operating system. However, based on the premise of a properly configured network above, the IP segmentation and/or the switch VLAN configuration may provide additional filtration to limit the risk.
Page 69: General Statistics
The benefit of this approach is that it enables load balancing and failover. Teaming is done through the Broadcom Advanced Server Program (BASP) software. For a comprehensive description of the technology and implementation considerations of the teaming software, refer to the "Broadcom Gigabit Ethernet Teaming Services"...
Page 70: Team Types
BCM57XX User Guide. Using the Broadcom Teaming Wizard You can use the Broadcom Teaming Wizard to create a team, configure an existing team if a team has already been created, or create a VLAN. 1. Create or edit a team: To create a new team, select Create a Team from the Team menu, or right-click one of the devices in the “Unassigned Adapters”...
Page 71 NetXtreme User Guide Using Broadcom Advanced Control Suite 4 Note: If you prefer to work without the wizard for now, click Expert Mode. If you want to always use Expert Mode to create a team, select Default to Expert Mode on next start. See Using Expert Mode.
Page 72 NetXtreme User Guide Using Broadcom Advanced Control Suite 4 4. Select the type of team you want to create. If the team type is an SLB type team, click Next. If the team type is not an SLB type team, then a dialog box appears. Verify that the network switch connected to the team members is configured correctly for the team type, click OK, and continue.
Page 73 Team Members list by clicking the adapter and then clicking Remove. Click Next. Note: There must be at least one Broadcom network adapter assigned to the team. The Large Send Offload (LSO) and Checksum Offload (CO) columns indicate if the LSO, and/or the CO properties are supported for the adapter.
Page 74 NetXtreme User Guide Using Broadcom Advanced Control Suite 4 6. If you want to designate one of the adapters as a standby member (optional), select Use the following member as a standby member, then choose the standby member from the list of adapters.
Page 75 NetXtreme User Guide Using Broadcom Advanced Control Suite 4 8. If you want to configure LiveLink, select Yes, otherwise select No, then click Next. Broadcom ® April 2017 • 2CS57XX-CDUM514-R Page 75...
Page 76 NetXtreme User Guide Using Broadcom Advanced Control Suite 4 9. Select the probe interval (the number of seconds between each retransmission of a link packet to the probe target) and the maximum number of probe retries (the number of consecutively missed responses from a probe target before a failover is triggered).
Page 77 VLANs enable you to add multiple virtual adapters that are on different subnets. The benefit of this is that your system can have one network adapter that can belong to multiple subnets. Note: VLANs can only be created when all team members are Broadcom adapters. 14. Type the VLAN name and then click Next.
Page 78 NetXtreme User Guide Using Broadcom Advanced Control Suite 4 15. To tag the VLAN, select Tagged and then click Next. Otherwise, click Untagged, click Next, and continue with the wizard to add additional VLANs (see Step 17 on page 80 of this procedure).
Page 79 NetXtreme User Guide Using Broadcom Advanced Control Suite 4 16. Type the VLAN tag value and then click Next. The value must be between 1 and 4094. Broadcom ® April 2017 • 2CS57XX-CDUM514-R Page 79...
Page 80 NetXtreme User Guide Using Broadcom Advanced Control Suite 4 17. Select Yes to add or manage another VLAN and then click Next. Repeat until you do not want to add or manage any additional VLANs. Note: You can define up to 64 VLANs per team (63 VLANs that are tagged and 1 VLAN that is not tagged).
Page 81 NetXtreme User Guide Using Broadcom Advanced Control Suite 4 Note: At any point in the Broadcom Teaming Wizard procedure, click Preview to get a visual representation of what the team will look like before committing any changes. Broadcom ® April 2017 • 2CS57XX-CDUM514-R...
Page 82 NetXtreme User Guide Using Broadcom Advanced Control Suite 4 19. Click the team name in the Team Management pane to view the team's properties in the Information tab, transfer and receive data in the Statistics tab. Broadcom ® April 2017 • 2CS57XX-CDUM514-R...
Page 83: Using Expert Mode
NetXtreme User Guide Using Broadcom Advanced Control Suite 4 Using Expert Mode Use Expert Mode to create a team, modify a team, add a VLAN, and configure LiveLink for a Smart Load Balance and Failover and SLB (Auto-Fallback Disable) team. To create a team using the wizard, see...
Page 84 7. You can assign any other available adapter to be a standby member by selecting it from the Standby Member list. Note: There must be at least one Broadcom network adapter assigned to the team. The Large Send Offload (LSO), Checksum Offload (CO), and RSS indicate if the LSO, CO, and/or RSS properties are supported for the team.
Page 85 NetXtreme User Guide Using Broadcom Advanced Control Suite 4 Note: Adding a network adapter to a team where its driver is disabled may negatively affect the offloading capabilities of the team. This may have an impact on the team’s performance. Therefore, it is recommended that only driver-enabled network adapters be added as members to a team.
Page 86: Modifying A Team
NetXtreme User Guide Using Broadcom Advanced Control Suite 4 Modifying a Team After you have created a team, you can modify the team in the following ways: • Change the type of team • Change the members assigned to the team •...
Page 87: Adding A Vlan
You can define up to 64 VLANs per team (63 VLANs that are tagged and 1 VLAN that is not tagged). VLANs can only be created when all teams members are Broadcom adapters. If you try to create a VLAN with a non- Broadcom adapter, an error message is displayed.
Page 88: Viewing Vlan Properties And Statistics And Running Vlan Tests
NetXtreme User Guide Using Broadcom Advanced Control Suite 4 1. From the Teams menu, select Add VLAN. 2. The Welcome screen appears. 3. Click Expert Mode. 4. On the Create Team tab of the Manage Teams window, click Manage VLAN(s).
Page 89: Deleting A Vlan
NetXtreme User Guide Using Broadcom Advanced Control Suite 4 Deleting a VLAN The procedure below applies when you are in Expert Mode. To delete a VLAN 1. Select the VLAN to delete. 2. From the Teams menu, select Remove VLAN.
Page 90: Configuring Livelink For A Smart Load Balancing And Failover And Slb (Auto-Fallback Disable) Team
NetXtreme User Guide Using Broadcom Advanced Control Suite 4 Configuring LiveLink for a Smart Load Balancing and Failover and SLB (Auto-Fallback Disable) Team LiveLink is a feature of BASP that is available for the Smart Load Balancing (SLB) and SLB (Auto-Fallback Disable) type of teaming.
Page 91: Saving And Restoring A Configuration
NetXtreme User Guide Using Broadcom Advanced Control Suite 4 Note: All of the member IP addresses must be in the same subnet as the probe targets. 9. Click Update. Repeat these steps for each of the other listed team members.
Page 92: Viewing Basp Statistics
NetXtreme User Guide Using Broadcom Advanced Control Suite 4 Viewing BASP Statistics The Statistics section shows performance information about the network adapters that are on a team. To view BASP Statistics information for any team member adapter or the team as a whole, click the name of the adapter or team listed in the Team Management pane, then click the Statistics tab.
Page 93: Configuring With The Command Line Interface Utility
An alternate method to BACS for configuring Broadcom network adapters is with BACSCLI, which is a Broadcom utility that allows you to view information and configure network adapters using a console in either a non-interactive command line interface (CLI) mode or an interactive mode. As with BACS, BACSCLI provides information about each network adapter, and enables you to perform detailed tests, run diagnostics, view statistics, and modify property values.
Page 94: Managing Vlans
Up to 64 VLANs (63 tagged and 1 untagged) can be defined for each Broadcom adapter on your server, depending on the amount of memory available in your system.
Page 95: Adding Vlans To Teams
PC #4 switch port. PC #5 A member of both VLANs #1 and #2, PC #5 has an Broadcom adapter installed. It is connected to switch port #10. Both the adapter and the switch port are configured for VLANs #1 and #2 and have tagging enabled.
Page 96: Troubleshooting Bacs
NetXtreme User Guide Using Broadcom Advanced Control Suite 4 Troubleshooting BACS Problem: When attempting to open BACS on a Linux System, the following error message displays: “Another instance of the BACS client appears to be running on this system. Only one instance of the BACS client can be running at a time.
Page 97: Section 7: Teaming
Teaming Se cti on 7: T ea min g • Overview • Load Balancing and Fault Tolerance Note: See Broadcom Gigabit Ethernet Teaming Services for detailed information on the following topics: • Glossary of Terms and Acronyms • Teaming Concepts •...
Page 98: Overview
VLANs. Broadcom Advanced Server Program (BASP) is the Broadcom teaming software. For Windows operating systems, BASP is configured through the Broadcom Advanced Control Suite (BACS) utility.
Page 99: Smart Load Balancing™ And Failover
See your Linux documentation for more information. Smart Load Balancing™ and Failover Smart Load Balancing™ and Failover is the Broadcom implementation of load balancing based on IP flow. This feature supports balancing IP traffic across multiple adapters (team members) in a bidirectional manner. In this type of team, all adapters in the team have separate MAC addresses.
Page 100: Slb (Auto-Fallback Disable)
Limitations of Smart Load Balancing and Failover/SLB (Auto- Fallback Disable) Types of Teams Smart Load Balancing™ (SLB) is a protocol-specific scheme. Table 7: Smart Load Balancing Operating System Failover/Fallback — All Broadcom Failover/Fallback — Multivendor Protocol Windows Server 2008 Windows Server 2008 R2 Windows Server 2012 Operating System Load Balance —...
Page 101: Livelink™ Functionality
Other protocol packets are sent and received through one primary interface only. Failover for non-IP traffic is supported only for Broadcom network adapters. The Generic Trunking type of team requires the Ethernet switch to support some form of port trunking mode (for example, Cisco's Gigabit EtherChannel or other switch vendor's Link Aggregation mode).
Page 102: Section 8: Broadcom Gigabit Ethernet Teaming Services
NetXtreme User Guide Broadcom Gigabit Ethernet Teaming Services S e c t i o n 8 : B r o a d c o m G i g a b i t E t h e r n e t T e a m i n g S e r v i c e s •...
Page 103: Introduction
This section describes the technology and implementation considerations when working with the network teaming services offered by the Broadcom software shipped with systems. The goal of Broadcom teaming services is to provide fault tolerance and link aggregation across a team of two or more adapters. The information in this document is provided to assist IT professionals during the deployment and troubleshooting of system applications that require network fault tolerance and load balancing.
Page 104: Teaming Concepts
NetXtreme User Guide Broadcom Gigabit Ethernet Teaming Services Table 8: Teaming Glossary Item Definition Smart Load Balancing (SLB) Switch-independent load balancing and failover type of team, in which the intermediate driver manages outgoing/incoming traffic. Transmission Control Protocol User Datagram Protocol...
Page 105: Teaming And Network Addresses
NetXtreme User Guide Broadcom Gigabit Ethernet Teaming Services Teaming and Network Addresses A team of adapters function as a single virtual network interface and does not appear any different to other network devices than a non-teamed adapter. A virtual network adapter advertises a single Layer 2 and one or more Layer 3 addresses.
Page 106 NetXtreme User Guide Broadcom Gigabit Ethernet Teaming Services Table 9: Available Teaming Types Switch-Dependent Link Aggregation (Switch must Control Protocol support specific support is required Teaming Type type of team) on the switch Load Balancing Failover Generic Trunking (FEC/GEC)/802.3ad- Draft Static Smart Load Balancing and Failover The Smart Load Balancing™...
Page 107 NetXtreme User Guide Broadcom Gigabit Ethernet Teaming Services When the clients and the system are on different subnets, and incoming traffic has to traverse a router, the received traffic destined for the system is not load balanced. The physical adapter that the intermediate driver has selected to carry the IP flow carries all of the traffic.
Page 108 NetXtreme User Guide Broadcom Gigabit Ethernet Teaming Services Link Aggregation (IEEE 802.3ad LACP) Link Aggregation is similar to Generic Trunking except that it uses the Link Aggregation Control Protocol to negotiate the ports that will make up the team. LACP must be enabled at both ends of the link for the team to be operational.
Page 109: Software Components
Windows Vista and later x64 driver b57nd60a.sys The Broadcom Advanced Control Suite (BACS) utility is designed to run in 32-bit and 64-bit Windows Server operating system. BACS is used to configure load balancing and fault tolerance teaming, and VLANs. In addition, it displays the MAC address, driver version, and status information about each network adapter.
Page 110: Hardware Requirements
Supported Features by Team Type Table 11 provides a feature comparison across the team types supported by Broadcom NICs. Use this table to determine the best type of team for your application. The teaming software supports up to eight ports in a single team and up to 16 teams in a single system.
Page 111 Load balancing by IP address No Load balancing by MAC Yes (used for no- address IP/IPX) SLB with one primary and one standby member. Requires at least one Broadcom adapter in the team. Broadcom ® April 2017 • 2CS57XX-CDUM514-R Page 111...
Page 112: Selecting A Team Type
NetXtreme User Guide Broadcom Gigabit Ethernet Teaming Services Selecting a Team Type The following flow chart provides the decision flow when planning for teaming. The primary rationale for teaming is the need for additional network bandwidth and fault tolerance. Teaming offers link aggregation and fault tolerance to meet both of these requirements.
Page 113: Teaming Mechanisms
Driver Support by Operating System • Supported Teaming Speeds Architecture The Broadcom Advanced Server Program is implemented as an NDIS intermediate driver (see Figure 4). It operates below protocol stacks such as TCP/IP appears as a virtual adapter. This virtual adapter inherits the MAC Address of the first port initialized in the team.
Page 114: Outbound Traffic Flow
Inbound Traffic Flow (SLB Only) The Broadcom intermediate driver manages the inbound traffic flow for the SLB teaming mode. Unlike outbound load balancing, inbound load balancing can only be applied to IP addresses that are located in the same subnet as the load-balancing server.
Page 115: Protocol Support
NetXtreme User Guide Broadcom Gigabit Ethernet Teaming Services Protocol Support ARP and IP/TCP/UDP flows are load balanced. If the packet is an IP protocol only, such as ICMP or IGMP, then all data flowing to a particular IP address will go out through the same physical adapter. If the packet uses TCP or UDP for the L4 protocol, then the port number is added to the hashing algorithm, so two separate L4 flows can go out through two separate physical adapters to the same IP address.
Page 116: Driver Support By Operating System
NetXtreme User Guide Broadcom Gigabit Ethernet Teaming Services Driver Support by Operating System As previously noted, BASP is supported in Windows Server 2008 and 2012 operating system environments. The various teaming mode features are summarized in the table below. Table 12: Teaming Mode Features...
Page 117: Supported Teaming Speeds
NetXtreme User Guide Broadcom Gigabit Ethernet Teaming Services Table 12: Teaming Mode Features (Cont.) Features Windows Support User interface BACS Number of teams Number of adapters per team Hot replace Hot add Hot remove Link speed support Different speeds Frame protocol...
Page 118: Teaming And Other Advanced Networking Properties
NetXtreme User Guide Broadcom Gigabit Ethernet Teaming Services Teaming and Other Advanced Networking Properties • Checksum Offload • IEEE 802.1p QoS Tagging • Large Send Offload • Jumbo Frames • IEEE 802.1Q VLANs • Wake on LAN • Preboot Execution Environment (PXE) Before creating a team, adding or removing team members, or changing advanced settings of a team member, make sure each team member has been configured similarly.
Page 119: Checksum Offload
The BASP intermediate driver does not support IEEE 802.1p QoS tagging. Large Send Offload Large Send Offload (LSO) is a feature provided by Broadcom network adapters that prevents an upper level protocol such as TCP from breaking a large data packet into a series of smaller packets with headers appended to them.
Page 120: Wake On Lan
NetXtreme User Guide Broadcom Gigabit Ethernet Teaming Services Wake on LAN Wake on LAN (WOL) is a feature that allows a system to be awakened from a sleep state by the arrival of a specific packet over the Ethernet interface. Because a virtual adapter is implemented as a software only device, it lacks the hardware features to implement Wake on LAN and cannot be enabled to wake the system from a sleeping state via the virtual adapter.
Page 121: General Network Considerations
In other words, frames for a given conversation can go out and be received on different interfaces in the team. This is true for all types of teaming supported by Broadcom. Therefore, an interconnect link must be provided between the switches that connect to ports in the same team.
Page 122 NetXtreme User Guide Broadcom Gigabit Ethernet Teaming Services Figure 5: Teaming Across Switches Without an Interswitch Link Blue Gray ARP Table ARP Table SLB Team SLB Team 100 = 49:C9 100 = 49:C9 192.168.1.101 192.168.1.102 Cannot ping 102 = 5E:CA...
Page 123: Spanning Tree Algorithm
NetXtreme User Guide Broadcom Gigabit Ethernet Teaming Services Figure 7 represents a failover event in which the cable is unplugged on the Top Switch port 4. This is a successful failover with all stations pinging each other without loss of connectivity.
Page 124: Topology Change Notice (Tcn)
NetXtreme User Guide Broadcom Gigabit Ethernet Teaming Services After a stable network topology has been established, all bridges listen for hello BPDUs (Bridge Protocol Data Units) transmitted from the root bridge. If a bridge does not get a hello BPDU after a predefined interval (Max Age), the bridge assumes that the link to the root bridge is down.
Page 125: Teaming With Microsoft Nlb/Wlbs
NetXtreme User Guide Broadcom Gigabit Ethernet Teaming Services Teaming with Microsoft NLB/WLBS The SLB mode of teaming does not work in Microsoft’s Network Load Balancing (NLB) unicast mode, only in multicast mode. Due to the mechanism used by the NLB service, the recommended teaming configuration in this environment is Failover (SLB with a standby NIC) as load balancing is managed by NLB.
Page 126: Application Considerations
Multiple adapters may be used for each of these purposes: private, intracluster communications and public, external client communications. All Broadcom teaming modes are supported with Microsoft Cluster Software for the public adapter only. Private network adapter teaming is not supported. Microsoft indicates that the use of teaming on the private interconnect of a server cluster is not supported because of delays that could possibly occur in the transmission and receipt of heartbeat packets between the nodes.
Page 127: Load Balancing And Failover
1. Client-Server ARP cache; which points to the backup server MAC address. This is determined by the Broadcom intermediate driver inbound load balancing algorithm. 2. The physical adapter interface on Client-Server Red will be used to transmit the data. The Broadcom intermediate driver outbound load balancing algorithm determines this (see...
Page 128: Fault Tolerance
If a network link fails during tape backup operations, all traffic between the backup server and client stops and backup jobs fail. If, however, the network topology was configured for both Broadcom SLB and switch fault tolerance, then this would allow tape backup operations to continue without interruption during the link failure.
Page 129 NetXtreme User Guide Broadcom Gigabit Ethernet Teaming Services Figure 8: Network Backup With SLB Teaming Across Two Switches Tape Backup Backup Server #1 Client Server - Blue NIC Team NIC Team GE Switch #1 GE Switch #2 LACP or GEC...
Page 130: Troubleshooting Teaming Problems
NetXtreme User Guide Broadcom Gigabit Ethernet Teaming Services Troubleshooting Teaming Problems • Teaming Configuration Tips • Troubleshooting Guidelines When running a protocol analyzer over a virtual adapter teamed interface, the MAC address shown in the transmitted frames may not be correct. The analyzer does not show the frames as constructed by BASP and shows the MAC address of the team and not the MAC address of the interface transmitting the frame.
Page 131: Troubleshooting Guidelines
Disabling the device driver of a network adapter participating in an LACP or GEC/FEC team may have adverse affects with network connectivity. Broadcom recommends that the adapter first be physically disconnected from the switch before disabling the device driver in order to avoid a network connection loss.
Page 132: Frequently Asked Questions
Question: What network protocols are load balanced when in a team? Answer: Broadcom’s teaming software only supports IP/TCP/UDP traffic. All other traffic is forwarded to the primary adapter. Question: Which protocols are load balanced with SLB and which ones are not? Answer: Only IP/TCP/UDP protocols are load balanced in both directions: send and receive.
Page 133 Setup installer. Question: How can I determine the performance statistics on a virtual adapter (team)? Answer: In Broadcom Advanced Control Suite, click the BASP Statistics tab for the virtual adapter. Question: Can I configure NLB and teaming concurrently? Answer: Yes, but only when running NLB in a multicast mode (NLB is not supported with MS Cluster Services).
Page 134 LiveLink™ Functionality. Question: Where do I monitor real time statistics for an adapter team in a Windows system? Answer: Use the Broadcom Advanced Control Suite (BACS) to monitor general, IEEE 802.3, and custom counters. Broadcom ® April 2017 • 2CS57XX-CDUM514-R...
Page 135: Event Log Messages
Intermediate Driver (Virtual Adapter/Team) Windows System Event Log Messages The known base driver and intermediate driver Windows System Event Log status messages for the Broadcom NetXtreme Gigabit Ethernet adapters are listed in the following section. As a Broadcom adapter driver loads, Windows places a status code in the system event viewer.
Page 136 NetXtreme User Guide Broadcom Gigabit Ethernet Teaming Services Table 15: Base Driver Event Log Messages (Cont.) Message Number Message Cause Corrective Action Network controller configured for The adapter has been Informational message only. 10Mb full-duplex link. manually configured for the No action is required.
Page 137: Intermediate Driver (Virtual Adapter/Team)
NetXtreme User Guide Broadcom Gigabit Ethernet Teaming Services Table 15: Base Driver Event Log Messages (Cont.) Message Number Message Cause Corrective Action Driver initialization failed. Unspecified failure during Reinstall the driver, update driver initialization. to a newer driver, run Broadcom Advanced Control Suite diagnostics, or replace the adapter.
Page 138 NetXtreme User Guide Broadcom Gigabit Ethernet Teaming Services Table 16: Intermediate Driver Event Log Messages (Cont.) System Event Message Number Message Cause Corrective Action Network adapter is The physical adapter is not Check that the network cable is disconnected. connected to the network connected, verify that the (it has not established link).
Page 139: Section 9: Iscsi Protocol And Broadcom Boot Agent Software
Broadcom Boot Agent Driver Software iSCSI Boot Broadcom NetXtreme Gigabit Ethernet adapters support iSCSI boot to enable network boot of operating systems to diskless systems. The iSCSI boot allows a Windows or Linux operating system boot from an iSCSI target machine located remotely over a standard IP network.
Page 140: Configuring Iscsi Boot Parameters
• Target LUN • Initiator IQN • CHAP ID and secret Configuring iSCSI Boot Parameters Configure the Broadcom iSCSI boot software for either static or dynamic configuration. Refer to Table 17 configuration options available from the General Parameters screen. Table 17 lists parameters for both IPv4 and IPv6.
Page 141: Mba Boot Protocol Configuration
NetXtreme User Guide iSCSI Protocol and Broadcom Boot Agent Software Table 17: Configuration Options (Cont.) Option Description Link Up Delay Time Controls how long the iSCSI boot host software waits, in seconds, after an Ethernet link is established before sending any data over the network. The valid values are 0 to 255.
Page 142 NetXtreme User Guide iSCSI Protocol and Broadcom Boot Agent Software • iSCSI parameters via DHCP: Disabled • CHAP Authentication: Disabled • Boot to iSCSI target: Disabled • DHCP Vendor ID: BRCM ISAN • Link Up Delay Time: 0 • Use TCP Timestamp: Enabled (for some targets such as the Dell/EMC AX100i, it is necessary to enable Use TCP Timestamp) •...
Page 143 NetXtreme User Guide iSCSI Protocol and Broadcom Boot Agent Software In a dynamic configuration, you only need to specify that the system’s IP address and target/initiator information are provided by a DHCP server (see IPv4 and IPv6 configurations in Configuring the DHCP Server to Support iSCSI Boot).
Page 144 NetXtreme User Guide iSCSI Protocol and Broadcom Boot Agent Software Note: Information on the Initiator Parameters, and 1st Target Parameters screens are ignored and do not need to be cleared. 3. Select Exit and Save Configurations. Broadcom ® April 2017 • 2CS57XX-CDUM514-R...
Page 145: Enabling Chap Authentication
DHCP iSCSI Boot Configuration for IPv6 DHCP iSCSI Boot Configurations for IPv4 The DHCP protocol includes a number of options that provide configuration information to the DHCP client. For iSCSI boot, Broadcom adapters support the following DHCP configurations: • DHCP Option 17, Root Path •...
Page 146 IQN Using DHCP option 43 requires more configuration than DHCP option 17, but it provides a richer environment and provides more configuration options. Broadcom recommends that customers use DHCP option 43 when performing dynamic iSCSI boot configuration. Configuring the DHCP Server Configure the DHCP server to support option 17 or option 43.
Page 147 NetXtreme User Guide iSCSI Protocol and Broadcom Boot Agent Software Note: If using Option 43, you also need to configure Option 60. The value of Option 60 should match the DHCP Vendor ID value. The DHCP Vendor ID value is BRCM ISAN, as shown in General Parameters of the iSCSI Boot Configuration menu.
Page 148: Dhcp Iscsi Boot Configuration For Ipv6
DHCPv6 Option 16, Vendor Class Option • DHCPv6 Option 17, Vendor-Specific Information Note: The DHCPv6 standard Root Path option is not yet available. Broadcom suggests using Option 16 or Option 17 for dynamic iSCSI Boot IPv6 support. DHCPv6 Option 16, Vendor Class Option DHCPv6 Option 16 (vendor class option) must be present and must contain a string that matches your configured DHCP Vendor ID parameter.
Page 149: Preparing The Iscsi Boot Image
2. Load the latest Broadcom MBA and iSCSI boot images onto NVRAM of the adapter. 3. Configure the BIOS on the remote system to have the Broadcom MBA as the first bootable device, and the DVDROM as the second device.
Page 150 2. Load the latest Broadcom MBA and iSCSI boot images into the NVRAM of the adapter. 3. Configure the BIOS on the remote system to have the Broadcom MBA as the first bootable device and the DVDROM as the second device.
Page 151 NetXtreme User Guide iSCSI Protocol and Broadcom Boot Agent Software 14. After Windows 2012 boots to the OS, Broadcom recommends running the driver installer to complete the Broadcom driver and application installation. Linux iSCSI Boot Setup Linux iSCSI boot is supported on Red Hat Enterprise Linux 6.9, 7.1 and later and SUSE Linux Enterprise Server (SLES) 11 SP4, or SLES 12 SP2 and later.
Page 152: Booting
NetXtreme User Guide iSCSI Protocol and Broadcom Boot Agent Software 20. Install bibt package. 21. Remove ifcfg-eth*. 22. Reboot. 23. For SUSE 11.1, follow the remote DVD installation workaround shown below. 24. After the system reboots, log in, change to the /opt/bcm/bibt folder, and run iscsi_setup.sh script to create the initrd image.
Page 153: Virtual Lans
The following troubleshooting tips are useful for iSCSI boot. Problem: The Broadcom iSCSI Crash Dump utility will not work properly to capture a memory dump when the link speed for iSCSI boot is configured for 10 Mbps or 100 Mbps.
Page 154: Broadcom Boot Agent Driver Software
2. Setting up the BIOS for the boot order. Configuring the MBA Driver This section pertains to configuring the MBA driver on add-in NIC models of the Broadcom network adapter. For configuring the MBA driver on LOM models of the Broadcom network adapter, check your system documentation.
Page 155 NetXtreme User Guide iSCSI Protocol and Broadcom Boot Agent Software 3. Use the UP ARROW and DOWN ARROW keys to move to the Boot Protocol menu item. Then use the RIGHT ARROW or LEFT ARROW key to select the boot protocol of choice if other boot protocols besides Preboot Execution Environment (PXE) are available.
Page 156: Setting Up The Bios
NetXtreme User Guide iSCSI Protocol and Broadcom Boot Agent Software 5. Use the drop-down menu to select the boot protocol of choice, if boot protocols other than Preboot Execution Environment (PXE) are available. If available, other boot protocols include iSCSI and Bootstrap Protocol (BOOTP).
Page 157: Section 10: Manageability
Broadcom Advanced Server Program provides events through event logs. Users can use the “Event Viewer” provided by Windows Server 2008, or use CIM to inspect or monitor these events. Broadcom CIM provider will also provide event information through the CIM generic event model. These events are __InstanceCreationEvent, __InstanceDeletionEvent and __InstanceModificationEvent, and are defined by CIM.
Page 158: Snmp
The BASP subagent allows an SNMP manager software to actively monitor the configurations and performance of the Broadcom Advanced Server features. The subagent also provides an alarm trap to an SNMP manager to inform the manager of any changes to the conditions of the BASP component.
Page 159 Device number • Function number To monitor this information, a SNMP manager needs to load the Broadcom Extended information MIB file to allow monitoring of the information described above. This file, bcmif.mib, is included on the Broadcom NetXtreme adapter installation CD.
Page 160: Section 11: Specifications
Feature Specification PCI Express™ Type Controllers (BCM57XX Controllers) PCI Express Interface x1, x2, x4 link width PCI Express Aggregated Bandwidth (transmit 2.5 Gbps or 5.0 Gbps and receive) 10/100/1000BASE-T 10/100/1000 Mbps (full-duplex) Broadcom ® April 2017 • 2CS57XX-CDUM514-R Page 160...
Page 161: Section 12: Troubleshooting
Running a Cable Length Test • Testing Network Connectivity • Broadcom Boot Agent • Broadcom Advanced Server Program (BASP) • Kernel Debugging over Ethernet • Miscellaneous Hardware Diagnostics Loopback diagnostic tests are available for testing the adapter hardware. These tests provide access to the adapter internal/external diagnostics, where packet information is transmitted across the physical link.
Page 162: Bacs Network Test Failures
4. Verify that the IP address is assigned correctly using the command "ipconfig" or by checking the OS IP assigning tool. 5. Verify that the IP address is correct for the network to which the adapter(s) is connected. Broadcom ® April 2017 • 2CS57XX-CDUM514-R...
Page 163: Troubleshooting Checklist
Caution! Before you open the case of your system, review Safety Precautions. The following checklist provides recommended actions to take to resolve problems installing the Broadcom NetXtreme Gigabit Ethernet adapter or running it in your system. • Inspect all cables and connections. Verify that the cable connections at the network adapter and the switch are attached properly.
Page 164: Checking If Current Drivers Are Loaded
Table 23: Linux Driver Module Size Used by size Running a Cable Length Test In Windows environments, a cable length test can be run. See Analyzing Cables for information about running a cable length test. Broadcom ® April 2017 • 2CS57XX-CDUM514-R Page 164...
Page 165: Testing Network Connectivity
Use the ping command to determine if the network connection is working. Note: Network connectivity can also be tested using the Testing the Network feature in Broadcom Advanced Control Suite 2. 1. Verify that the drivers are loaded and enabled.
Page 166: Broadcom Advanced Server Program (Basp)
NetXtreme User Guide Troubleshooting Broadcom Advanced Server Program (BASP) Problem: After physically removing a NIC that was part of a team and then rebooting, the team did not perform as expected. Solution: To physically remove a teamed NIC from a system, you must first delete the NIC from the team. Not doing this before shutting down could result in breaking the team on a subsequent reboot, which may result in unexpected team behavior.
Page 167: Section 13: Regulatory Information
Consult the dealer or an experienced radio/TV technician for assistance. Do not make mechanical or electrical modifications to the equipment. Note: If you change or modify the adapter without permission of Broadcom, you may void your authority to operate the equipment.
Page 168: Vcci Class B Notice
Caution! The potential exists for this equipment to become impaired in the presence of conducted radio frequency energy between the frequency range of 59–66 MHz. Normal operation will return upon removal of the RF energy source. VCCI Class B Statement (Japan) CE Notice Broadcom ® April 2017 • 2CS57XX-CDUM514-R Page 168...
Page 169 NetXtreme User Guide Regulatory Information Broadcom ® April 2017 • 2CS57XX-CDUM514-R Page 169...
Page 170 NetXtreme User Guide Regulatory Information Broadcom ® April 2017 • 2CS57XX-CDUM514-R Page 170...
Page 171 NetXtreme User Guide Regulatory Information Broadcom ® April 2017 • 2CS57XX-CDUM514-R Page 171...
Page 172: Canadian Regulatory Information (Canada Only)
Cet appareil numérique de la classe B est conforme à la norme NMB-003 du Canada. Avis : Dans le cadre des réglementations d'Industry Canada, vos droits d'utilisation de cet équipement peuvent être annulés si des changements ou modifications non expressément approuvés par Broadcom y sont apportés. Broadcom ®...
Page 173: Mic Notice (Republic Of Korea Only)
NetXtreme User Guide Regulatory Information MIC Notice (Republic of Korea Only) B CLASS Device Broadcom NetXtreme Gigabit Ethernet Controller BCM95721A211 BCM95722A2202 Note that this device has been approved for non-business purposes and may be used in any environment, including residential areas.
Page 174: Bsmi
NetXtreme User Guide Regulatory Information BSMI Broadcom ® April 2017 • 2CS57XX-CDUM514-R Page 174...

Broadcom NetXtreme BCM57 Series User Manual

Section 1: Installing the Hardware

Safety Precautions

Preinstallation Checklist

Installing the Adapter

Connecting the Network Cables

Section 2: Functionality and Features

Functional Description

Features

Supported Operating Environments

Network Link and Activity Indication

Section 3: Windows Driver and Management Application Installation

Installing the Driver Software

Modifying the Driver Software

Repairing or Reinstalling the Driver Software

Removing the Device Drivers

Viewing or Changing the Properties of the Adapter

Setting Power Management Options

Configuring the Communication Protocol to Use with BACS4

Section 4: Linux Driver and Management Application Installation

Packaging

Installing TG3 Driver Software

Network Installations

Unloading/Removing the TG3 Driver

Driver Messages

Teaming with Channel Bonding

Linux Management Application Installation

Section 5: Vmware Driver Software

Packaging

Drivers

Section 6: Using Broadcom Advanced Control Suite 4

Broadcom Advanced Control Suite Overview

Starting Broadcom Advanced Control Suite

BACS Interface

Configuring Preferences in Windows

Connecting to a Host

Managing the Host

Managing the Network Adapter

Viewing Statistics

Configuring Teaming

Configuring with the Command Line Interface Utility

Managing Vlans

Troubleshooting BACS

Section 7: Teaming

Overview

Load Balancing and Fault Tolerance

Section 8: Broadcom Gigabit Ethernet Teaming Services

Introduction

Teaming Mechanisms

Teaming and Other Advanced Networking Properties

General Network Considerations

Application Considerations

Troubleshooting Teaming Problems

Frequently Asked Questions

Event Log Messages

Section 9: Iscsi Protocol and Broadcom Boot Agent Software

Iscsi Boot

Broadcom Boot Agent Driver Software

Section 10: Manageability

CIM

Snmp

Section 11: Specifications

10/100/1000BASE-T Cable Specifications

Performance Specifications

Section 12: Troubleshooting

Hardware Diagnostics

Troubleshooting Checklist

Checking for Network Link and Activity

Checking if Current Drivers Are Loaded

Running a Cable Length Test

Testing Network Connectivity

Broadcom Boot Agent

Broadcom Advanced Server Program (BASP)

Kernel Debugging over Ethernet

Miscellaneous

Section 13: Regulatory Information

FCC Class B Notice

VCCI Class B Notice

CE Notice

Canadian Regulatory Information (Canada Only)