Nvidia ConnectX-6 User Manual
  1. Manuals
  2. Brands
  3. Nvidia Manuals
  4. Adapter
  5. Mellanox ConnectX-6 Dx Series
  6. User manual

Nvidia ConnectX-6 User Manual

Lx ethernet adapter cards for ocp spec 3.0
Hide thumbs Also See for ConnectX-6:
Table of Contents

Advertisement

Quick Links

Download this manual
NVIDIA ConnectX-6 Lx Ethernet Adapter Cards for OCP Spec 3.0
User Manual
Exported on Oct/30/2023 03:53 PM

Advertisement

Table of Contents
loading
Need help?

Need help?

Do you have a question about the ConnectX-6 and is the answer not in the manual?

Questions and answers

Related Manuals for Nvidia ConnectX-6

Summary of Contents for Nvidia ConnectX-6

  • Page 1 NVIDIA ConnectX-6 Lx Ethernet Adapter Cards for OCP Spec 3.0 User Manual Exported on Oct/30/2023 03:53 PM...

  • Page 2: Table Of Contents

    Table of Contents Introduction............................9 Products Overview ............................... 9 ConnectX-6 Lx 25GbE Adapter Cards for OCP 3.0 ....................... 9 ConnectX-6 Lx 50GbE Adapter Cards for OCP 3.0 ...................... 10 Features and Benefits ............................11 Operating Systems/Distributions ..........................14 Connectivity ..............................14 Interfaces ............................. 15 ConnectX-6 Lx IC ..............................16...
  • Page 3 Installation Procedure Overview..........................20 System Requirements ............................21 Hardware Requirements ........................... 21 Airflow Requirements ............................21 Software Requirements ............................ 22 Safety Precautions ..............................22 Pre-Installation Checklist ............................23 OCP 3.0 Bracket Replacement Instructions .........................23 OCP 3.0 Adapter Card Installation Instructions......................23 Cables and Modules............................23 Identifying the Card in Your System........................
  • Page 4 Performance Tuning ............................ 60 VMware Driver Installation ............................60 Hardware and Software Requirements ........................61 Installing NATIVE ESXi Driver for VMware vSphere ..................... 61 Removing Earlier NVIDIA Drivers .......................... 62 Firmware Programming ............................ 62 Updating Adapter Firmware ........................64 Troubleshooting ............................65 General Troubleshooting ............................65...
  • Page 5 Thermal Sensors..............................74 Heatsink ................................74 Finding the MAC and Serial Number on the Adapter Card ..................75 Document Revision History ......................... 77    ...
  • Page 6 About This Manual This is the User Guide for Ethernet adapter cards based on the NVIDIA® ConnectX®-6 Lx integrated circuit device for Open Compute Project Spec 3.0. These adapters connectivity provide the highest performing low latency and most flexible interconnect solution for servers supporting OCP spec 3.0 adapter cards used in Enterprise Data Centers and High-Performance Computing environments.
  • Page 7 URL: https://www.nvidia.com > Support • E-mail: enterprisesupport@nvidia.com Customers who purchased NVIDIA Global Support Services, please see your contract for details regarding Technical Support. Customers who purchased NVIDIA products through an NVIDIA-approved reseller should first seek assistance through their reseller. Related Documentation User Manual and Release Notes describing MLNx_OFED features, performance, band diagnostic, tools content and configuration.
  • Page 8 40GbE, 56GbE, 100GbE, 200GbE and 400GbE cables, including Direct Attach Copper cables (DACs), copper splitter cables, Active Optical Cables (AOCs) and transceivers in a wide range of lengths from 0.5m to 10km. In addition to meeting Ethernet standards, NVIDIA tests every product in an end-to-end environment ensuring a Bit Error Rate of less than 1E-15. Read more at LinkX Cables and...

  • Page 9: Introduction

    Performance Computing environments.  Providing up to two ports of 25GbE or a single-port of 50GbE connectivity, and PCIe Gen 3.0/4.0 x8 host connectivity, ConnectX-6 Lx is a member of NVIDIA’s world-class, award-winning, ConnectX family of network adapters. Continuing NVIDIA’s consistent innovation in networking, ConnectX-6 Lx provides agility and efficiency at every scale.

  • Page 10: Connectx-6 Lx 50Gbe Adapter Cards For Ocp 3.0

    ✓ Crypto ✓ ✓ Secure Boot Device ID 4127 for Physical Function (PF) 4128 for Virtual Function (VF) ConnectX-6 Lx 50GbE Adapter Cards for OCP 3.0  MCX631435AN-GDAB MCX631435AE-GDAB MCX631435AC-GDAB Network Connector Type Single-port QSFP28 Single-port QSFP28 Single-port QSFP28 Ethernet Data Rate...

  • Page 11: Features And Benefits

    Uses PCIe Gen 4.0 (16GT/s) through x8 edge connector. Up to 200 Gigabit Ethernet NVIDIA adapters comply with the following IEEE 802.3 standards: • 200GbE / 100GbE / 50GbE / 25GbE / 10GbE / 1GbE • IEEE 802.3bj, 802.3bm 100 Gigabit Ethernet •...
  • Page 12 Band and Ethernet networks. Leveraging data center bridging (DCB) capabilities, as well as ConnectX®-6 Lx, advanced congestion control hardware mechanisms, RoCE provides efficient low-latency RDMA services over Layer 2 and Layer 3 networks. NVIDIA PeerDirect® PeerDirect® communication provides high-efficiency RDMA access by eliminating unnecessary internal data copies between components on the PCIe bus (for example, from GPU to CPU), and therefore significantly reduces application run time.
  • Page 13 NIC hardware while maintaining the line rate. Secure Boot (Hardware Root Of Trust) ConnectX-6 Lx delivers supply chain protection with hardware Root-of-Trust (RoT) for Secure Boot as well as Secure Firmware Update using RSA cryptography and cloning protection, via a device-unique key, to guarantee firmware authenticity...

  • Page 14: Operating Systems/Distributions

    Operating Systems/Distributions • RHEL/CentOS • Windows • FreeBSD • VMware • OpenFabrics Enterprise Distribution (OFED) • OpenFabrics Windows Distribution (WinOF-2) Connectivity • Interoperable with 1/10/25/50 Gb/s Ethernet switches • Passive copper cable with ESD protection • Powered connectors for optical and active cable support...

  • Page 15: Interfaces

    Interfaces The below figures show the component side of the NVIDIA ConnectX-6 Lx adapter card. Each numbered interface that is referenced in the figures is described in the following table with a link to detailed information.  The ConnectX-6 Lx adapter card includes special circuits to protect from ESD shocks to the card/server when plugging copper cables ...

  • Page 16: Connectx-6 Lx Ic

    Applies to Crypto-enabled OPNs. ConnectX-6 Lx brings security to every end-point, including: • Purpose-built inline acceleration engines that offload IPsec and TLS data-in-motion and XTS-AES data-at-rest cryptographic operations. • Stateful firewall solution acceleration, powered by Open vSwitch connection tracking and NVIDIA’s ASAP2 technology.

  • Page 17: Ethernet Sfp28/Qsfp28 Interfaces

    • Embedded hardware root-of-trust and support for RSA-based secure firmware update and secure boot, providing guaranteed integrity of the network adapter. Ethernet SFP28/QSFP28 Interfaces  The network ports of the ConnectX®-6 Lx adapter card are compliant with the IEEE 802.3 Ethernet standards listed in Features and Benefits.
  • Page 18  Link Indications  LED and State Description 1Hz blinking Yellow Beacon command for locating the adapter card 4Hz blinking Yellow  Indicates an error with the link. The error can be one of the following: Error Type Description LED Behavior Blinks until the error is fixed C access to the networking ports fails ...

  • Page 19: Fru Eeprom

    ConnectX®-6 Lx technology maintains support for manageability through a BMC. ConnectX®-6 Lx OCP 3.0 adapter can be connected to a BMC using MCTP over SMBus or MCTP over PCIe protocols as if it is a standard NVIDIA OCP 3.0 adapter. For configuring the adapter for the specific manageability solution in use by the server, please contact NVIDIA Support.

  • Page 20: Hardware Installation

    Hardware Installation Installation and initialization of ConnectX-6 Lx adapter cards for OCP Spec 3.0 require attention to the mechanical attributes, power specification, and precautions for electronic equipment. Safety Warnings  Safety warnings are provided here in the English language. For safety warnings in other languages, refer to the...

  • Page 21: System Requirements

    A system with a PCI Express x16 slot for OCP spec 3.0 is required for installing the card.  Airflow Requirements ConnectX-6 Lx adapter cards are offered with two airflow patterns: from the heatsink to the network ports, and vice versa, as shown below. Please refer to the "Specifications" chapter for airflow numbers for each specific card model.

  • Page 22: Software Requirements

    • See Operating Systems/Distributions section under the Introduction section. • Software Stacks - NVIDIA OpenFabric software package MLNX_OFED for Linux, WinOF-2 for Windows, and VMware. See the Driver Installation section. Safety Precautions  The adapter is being installed in a system that operates with voltages that can be lethal. Before opening the case of the system, observe the following precautions to avoid injury and prevent damage to system components.

  • Page 23: Pre-Installation Checklist

    Pre-Installation Checklist Unpack the ConnectX-6 Lx adapter card. Unpack and remove the ConnectX-6 Lx card. Check the parts for visible damage that may have occurred during shipping. Please note that the cards must be placed on an antistatic surface.  ...

  • Page 24: Identifying The Card In Your System

    To remove a cable, disengage the locks and slowly pull the connector away from the port receptacle. LED indicator will turn off when the cable is unseated. To uninstall the adapter card, see Uninstalling the Card. Identifying the Card in Your System On Linux Get the device location on the PCI bus by running lspci and locating lines with the string “NVIDIA Technologies”:...
  • Page 25 In the Value display box, check the fields VEN and DEV (fields are separated by ‘&’). In the display example above, notice the sub-string “PCI\VEN_15B3&DEV_1003”: VEN is equal to 0x15B3 – this is the Vendor ID of NVIDIA Technologies; and DEV is equal to 1018 (for ConnectX-6 Lx) – this...

  • Page 26: Extraction Instructions

     If the PCI device does not have a NVIDIA adapter ID, return to Step 2 to check another device.  The list of  NVIDIA Technologies PCI Device IDs can be found in the PCI ID repository at http://pci-ids.ucw.cz/read/PC/15b3. Extraction Instructions...

  • Page 27: Driver Installation

    • VMware Driver Installation Windows Driver Installation For Windows, download and install the latest WinOF-2 for Windows software package available via the NVIDIA website at: WinOF-2 webpage. Follow the installation instructions included in the download package (also available from the download page).

  • Page 28: Downloading Winof-2 Driver

    On an x64 (64-bit) machine, the output will be “AMD64”. Go to the WinOF-2 web page at: https://www.nvidia.com/en-us/networking/ > Products > Software > InfiniBand Drivers (Learn More) > Nvidia WinOF-2. Download the .exe image according to the architecture of your machine (see Step...

  • Page 29: Attended Installation

    • Attended Installation An installation procedure that requires frequent user intervention. • Unattended Installation An automated installation procedure that requires no user intervention. Attended Installation The following is an example of an installation session. Double click the .exe and follow the GUI instructions to install MLNX_WinOF2. [Optional] Manually configure your setup to contain the logs option (replace “LogFile”...
  • Page 30 Click Next in the Welcome screen. Read and accept the license agreement and click Next.
  • Page 31 8. Select the target folder for the installation.
  • Page 32 • If the user has a standard NVIDIA® card with an older firmware version, the firmware will be updated accordingly. However, if the user has both an OEM card and a NVIDIA® card, only the NVIDIA® card will be updated.
  • Page 33 10. Select a Complete or Custom installation, follow Step a onward.
  • Page 34 Select the desired feature to install: • Performances tools - install the performance tools that are used to measure performance in user environment • Documentation - contains the User Manual and Release Notes • Management tools - installation tools used for management, such as mlxstat •...
  • Page 35 b. Click Next to install the desired tools.
  • Page 36 Click Install to start the installation. In case firmware upgrade option was checked in Step 7, you will be notified if a firmware upgrade is required (see  ). ...

  • Page 38: Unattended Installation

    Click Finish to complete the installation. Unattended Installation  If no reboot options are specified, the installer restarts the computer whenever necessary without displaying any prompt or warning to the user. To control the reboots, use the /norestart or /forcerestart standard command-line options. The following is an example of an unattended installation session.
  • Page 39 Install the driver. Run: MLNX_WinOF2-[Driver/Version]_<revision_version>_All_-Arch.exe /S /v/qn [Optional] Manually configure your setup to contain the logs option: MLNX_WinOF2-[Driver/Version]_<revision_version>_All_-Arch.exe /S /v/qn /v”/l*vx [LogFile]" [Optional] if you wish to control whether to install ND provider or not (i.e., MT_NDPROPERTY default value is True). MLNX_WinOF2-[Driver/Version]_<revision_version>_All_Arch.exe /vMT_NDPROPERTY=1 [Optional] If you do not wish to upgrade your firmware version (i.e.,MT_SKIPFWUPGRD default value is False).

  • Page 40: Firmware Upgrade

    Manual. Attach the adapters back to VM with the DDA tools. Linux Driver Installation This section describes how to install and test the NVIDIA OFED for Linux package on a single server with a NVIDIA ConnectX-6 Lx adapter card installed. Prerequisites Requirements...

  • Page 41: Installing Mlnx_Ofed

            The image’s name has the format MLNX_OFED_LINUX-<ver>-<OS label><CPU arch>.iso .          You can download and install the latest OpenFabrics Enterprise Distribution (OFED) software package available via the NVIDIA web site at nvidia.com/ en-us/networking → Products → Software → InfiniBand Drivers → NVIDIA MLNX_OFED...
  • Page 42 files, by running --fw-image-dir. Using this option, the firmware version embedded in the MLNX_OFED package will be ignored. Example:  ./mlnxofedinstall --fw-image-dir /tmp/my_fw_bin_files  If the driver detects unsupported cards on the system, it will abort the installation procedure. To avoid this, make sure to add --skip- flag during installation.
  • Page 43 In such cases, the installer will recommend running the following command to update the initramfs: dracut -f On some OSs,   might result in the following error message which can be safely ignore. dracut -f libkmod: kmod_module_new_from_path: kmod_module 'mdev' already exists with different path The “mlnx_add_kernel_support.sh”...
  • Page 44 For the list of installation options, run: ./mlnxofedinstall --h Installation Procedure This section describes the installation procedure of MLNX_OFED on NVIDIA adapter cards.  Log in to the installation machine as root. Mount the ISO image on your machine.  host1# mount -o ro,loop MLNX_OFED_LINUX-<ver>-<OS label>-<CPU arch>.iso /mnt Run the installation script.
  • Page 45  MLNX_OFED for Ubuntu should be installed with the following flags in chroot environment: ./mlnxofedinstall --without-dkms --add-kernel-support --kernel <kernel version in chroot> --without-fw-update --force For example: ./mlnxofedinstall --without-dkms --add-kernel-support --kernel 3.13.0-85-generic --without-fw-update --force Note that the path to kernel sources (--kernel-sources) should be added if the sources are not in their default location. ...
  • Page 46 Status: No matching image found Error message #2: The firmware for this device is not distributed inside NVIDIA driver: 0000:01:00.0 (PSID: IBM2150110033) To obtain firmware for this device, please contact your HW vendor. Case A: If the installation script has performed a firmware update on your network adapter, you need to either restart the driver or reboot your system before the firmware update can take effect.
  • Page 47 In case your machine has an unsupported network adapter device, no firmware update will occur and the error message below will be printed. "The firmware for this device is not distributed inside NVIDIA driver: 0000:01:00.0 (PSID: IBM2150110033) To obtain firmware for this device, please contact your HW vendor."...

  • Page 48: Driver Load Upon System Boot

    Logs dir: /tmp/MLNX_OFED_LINUX-4.4-1.0.0.0.IBMM2150110033.logs Driver Load Upon System Boot Upon system boot, the NVIDIA drivers will be loaded automatically.  To prevent the automatic load of the NVIDIA drivers upon system boot: Add the following lines to the "/etc/modprobe.d/mlnx.conf" file.  blacklist mlx5_core blacklist mlx5_ib Set “ONBOOT=no”...
  • Page 49 In case your machine has an unsupported network adapter device, no firmware update will occur and the error message below will be printed. "The firmware for this device is not distributed inside NVIDIA driver: 0000:01:00.0 (PSID: IBM2150110033) To obtain firmware for this device, please contact your HW vendor."...

  • Page 50: Additional Installation Procedures

    Mount the ISO image on your machine and copy its content to a shared location in your network. # mount -o ro,loop MLNX_OFED_LINUX-<ver>-<OS label>-<CPU arch>.iso /mnt Download and install NVIDIA's GPG-KEY: The key can be downloaded via the following link:  http://www.mellanox.com/downloads/ofed/RPM-GPG-KEY-Mellanox # wget http://www.mellanox.com/downloads/ofed/RPM-GPG-KEY-Mellanox...
  • Page 51 Saving to: ?RPM-GPG-KEY-Mellanox? 100%[=================================================>] 1,354 --.-K/s in 0s 2018-01-25 13:52:30 (247 MB/s) - ?RPM-GPG-KEY-Mellanox? saved [1354/1354] Install the key.  # sudo rpm --import RPM-GPG-KEY-Mellanox warning: rpmts_HdrFromFdno: Header V3 DSA/SHA1 Signature, key ID 6224c050: NOKEY Retrieving key from file:///repos/MLNX_OFED/<MLNX_OFED file>/RPM-GPG-KEY-Mellanox Importing GPG key 0x6224C050: Userid: "Mellanox Technologies (Mellanox Technologies - Signing Key v2) <support@mellanox.com>"...
  • Page 52 repo id repo name status mlnx_ofed MLNX_OFED Repository rpmforge RHEL 6Server - RPMforge.net - dag 4,597 repolist: 8,351 Setting up MLNX_OFED YUM Repository Using --add-kernel-support Log into the installation machine as root. Mount the ISO image on your machine and copy its content to a shared location in your network. # mount -o ro,loop MLNX_OFED_LINUX-<ver>-<OS label>-<CPU arch>.iso /mnt Build the packages with kernel support and create the tarball. ...
  • Page 53 name=MLNX_OFED Repository baseurl=file:///<path to extracted MLNX_OFED package>/RPMS enabled=1 gpgcheck=0 Check that the repository was successfully added.  # yum repolist Loaded plugins: product-id, security, subscription-manager This system is not registered to Red Hat Subscription Management. You can use subscription-manager to register. repo id repo name status mlnx_ofed...
  • Page 54 (User Space packages only where:  mlnx-ofed-all Installs all available packages in MLNX_OFED mlnx-ofed-basic Installs basic packages required for running NVIDIA cards mlnx-ofed-guest Installs packages required by guest OS mlnx-ofed-hpc Installs packages required for HPC mlnx-ofed-hypervisor Installs packages required by hypervisor OS...
  • Page 55 Note: MLNX_OFED provides kernel module RPM packages with KMP support for RHEL and SLES. For other operating systems, kernel module RPM packages are provided only for the operating system's default kernel. In this case, the group RPM packages have the supported kernel version in their package's name. ...
  • Page 56 This type of installation is applicable to Debian and Ubuntu operating systems. Setting up MLNX_OFED apt-get Repository Log into the installation machine as root. Extract the MLNX_OFED package on a shared location in your network. It can be downloaded from https://www.nvidia.com/en-us/networking/ →  Products →  Software→  InfiniBand Drivers.
  • Page 57 Create an apt-get repository configuration file called "/etc/apt/sources.list.d/mlnx_ofed.list" with the following content:  deb file:/<path to extracted MLNX_OFED package>/DEBS ./ Download and install NVIDIA's Technologies GPG-KEY.  # wget -qO - http://www.mellanox.com/downloads/ofed/RPM-GPG-KEY-Mellanox | sudo apt-key add - Verify that the key was successfully imported. ...
  • Page 58 Building MLNX_OFED_LINUX RPMS . Please wait... Creating metadata-rpms 3.10.0-957.21.3.el7.x86_64 ... WARNING: If you are going to configure this package as a repository, then please note WARNING: that it contains unsigned rpms, therefore, you need to disable the gpgcheck WARNING: by setting 'gpgcheck=0' in the repository conf file.
  • Page 59 mlnx-ofed-dpdk-user-only - MLNX_OFED dpdk-user-only installer package (User Space packages only) mlnx-ofed-all-exact - MLNX_OFED all installer package (with DKMS support) (exact) mlnx-ofed-all - MLNX_OFED all installer package (with DKMS support) mlnx-ofed-vma-vpi-user-only - MLNX_OFED vma-vpi-user-only installer package (User Space packages only) mlnx-ofed-eth-only-user-only - MLNX_OFED eth-only-user-only installer package (User Space packages only) mlnx-ofed-vma-user-only - MLNX_OFED vma-user-only installer...

  • Page 60: Performance Tuning

    Depending on the application of the user's system, it may be necessary to modify the default configuration of network adapters based on the ConnectX® adapters. In case that tuning is required, please refer to the Performance Tuning Guide for NVIDIA Network Adapters.

  • Page 61: Hardware And Software Requirements

    Hardware and Software Requirements Requirement Description Platforms A server platform with an adapter card based on ConnectX®-6 Lx (EN) (firmware: fw-ConnectX6 Lx) Operating System ESXi 6.5 Installer Privileges The installation requires administrator privileges on the target machine. Installing NATIVE ESXi Driver for VMware vSphere ...

  • Page 62: Removing Earlier Nvidia Drivers

    PartnerSupported 2017-01-31  After the installation process, all kernel modules are loaded automatically upon boot. Removing Earlier NVIDIA Drivers  Please unload the previously installed drivers before removing them. To remove all the drivers: Log into the ESXi server with root permissions.
  • Page 63  The following procedure requires custom boot image downloading, mounting and booting from a USB device.

  • Page 64: Updating Adapter Firmware

    To check that your card is programmed with the latest available firmware version, download the mlxup firmware update and query utility. The utility can query for available NVIDIA adapters and indicate which adapters require a firmware update. If the user confirms, mlxup upgrades the firmware using embedded images.

  • Page 65: Troubleshooting

    Troubleshooting General Troubleshooting • Ensure that the adapter is placed correctly Server unable to find the adapter • Make sure the adapter slot and the adapter are compatible Install the adapter in a different PCI Express slot • Use the drivers that came with the adapter or download the latest •...

  • Page 66: Linux Troubleshooting

    -d <mst_device> q ibstat Ports Information ibv_devinfo To download the latest firmware version, refer to the NVIDIA Update and Query Utility. Firmware Version Upgrade cat /var/log/messages Collect Log File dmesg >> system.log journalctl (Applicable on new operating systems)

  • Page 67: Windows Troubleshooting

    Windows Troubleshooting From the Windows desktop choose the Start menu and run:  msinfo32 Environment Information To export system information to a text file, choose the Export option from the File menu. Assign a file name and save. Download and install MFT: MFT Documentation Mellanox Firmware Tool (MFT) Refer to the User Manual for installation instructions.

  • Page 68: Specifications

    Specifications  Please make sure to install the ConnectX-6 Lx OCP 3.0 card in a PCIe slot that is capable of supplying the power levels mentioned below for the appropriate use case  In Standby mode only port0 is available.
  • Page 69 CE / FCC / VCCI / ICES / RCM RoHS RoHS compliant a. ConnectX-6 Lx adapters supplement the auto-negotiation specification to get better bit error rates and longer cable reaches. This supplemental feature only initiates when connected to another NVIDIA Ethernet product.  b. Typical power for ATIS traffic load.

  • Page 70: Mcx631435Ac-Gdab / Mcx631435Ae-Gdab / Mcx631435An-Gdab Specifications

    c. Airflow is measured in wind tunnel. d. The non-operational storage temperature specifications apply to the product without its package. MCX631435AC-GDAB / MCX631435AE-GDAB / MCX631435AN-GDAB Specifications Form Factor: Small Form Factor (SFF) OCP 3.0 Physical Size: 4.52 in. x 2.99 in (115.00mm x 76.00mm) Connector: Single QSFP28 Ethernet (copper and optical) Retention Mechanism: Thumbscrew (Pull Tab) Bracket Ethernet: 50GBASE-R2, 50GBASE-R4, 25GBASE-R, 20GBASE-KR2, 10GBASE-LR,10GBASE-ER, 10GBASE-CX4, 10GBASE-CR, 10GBASE-KR, SGMII, 1000BASE-CX, 1000BASE-KX,...

  • Page 71: Board Mechanical Drawing And Dimensions

    CE / FCC / VCCI / ICES / RCM RoHS RoHS compliant a. ConnectX-6 Lx adapters supplement the auto-negotiation specification to get better bit error rates and longer cable reaches. This supplemental feature only initiates when connected to another NVIDIA Ethernet product.  b. Typical power for ATIS traffic load.

  • Page 72: Bracket Mechanical Drawings And Dimensions

    ConnectX-6 Lx Dual-Port SFP56 OCP 3.0  ConnectX-6 Lx Single-Port QSFP28 OCP 3.0  Bracket Mechanical Drawings and Dimensions   All dimensions are in millimeters. The bracket's mechanical tolerance is +/- 0.25mm.
  • Page 73 Dual-port SFP28 Thumbscrew Bracket  Single-port QSFP28 Thumbscrew Bracket ...

  • Page 74: Monitoring

    Monitoring Thermal Sensors The adapter card incorporates the ConnectX IC, which operates in the range of temperatures between 0°C and 105°C. Three thermal threshold definitions impact the overall system operation state: • Warning – 105°C: On managed systems only: When the device crosses the 105°C threshold, a Warning Threshold message is issued by the management SW, indicating to system administration that the card has crossed the warning threshold.

  • Page 75: Finding The Mac And Serial Number On The Adapter Card

    Finding the MAC and Serial Number on the Adapter Card Each NVIDIA adapter card has a different identifier printed on the label: serial number and the card MAC for the Ethernet protocol.  The product revisions indicated on the labels in the following figures do not necessarily represent the latest revisions of the cards.

  • Page 77: Document Revision History

    Document Revision History Date Description of Changes May. 2023 Updated Specifications to include non-operational storage temperature specifications  Nov. 2022 Updated Specifications tables Oct. 2022 Updated Finding the MAC and Serial Number on the Adapter Card Sep. 2022 Added MCX631432AS-ADAB to the relevant sections Feb.
  • Page 78 NVIDIA product and may result in additional or different conditions and/or requirements beyond those contained in this document. NVIDIA accepts no liability related to any default, damage, costs, or problem which may be based on or attributable to: (i) the use of the NVIDIA product in any manner that is contrary to this document or (ii) customer product designs.
  • Page 79 INDIRECT, SPECIAL, INCIDENTAL, PUNITIVE, OR CONSEQUENTIAL DAMAGES, HOWEVER CAUSED AND REGARDLESS OF THE THEORY OF LIABILITY, ARISING OUT OF ANY USE OF THIS DOCUMENT, EVEN IF NVIDIA HAS BEEN ADVISED OF THE POSSIBILITY OF SUCH DAMAGES. Notwithstanding any damages that customer might incur for any reason whatsoever, NVIDIA’s aggregate and cumulative liability towards customer for the products described herein shall be limited in...

This manual is also suitable for:

900-9x625-0053-sb0900-9x625-0083-sb0900-9x659-0015-sb1900-9x659-0045-sb0900-9x625-0073-sb1900-9x625-0063-sb0 ... Show all

Table of Contents