Mellanox Technologies ConnectX-3 User Manual
  1. Manuals
  2. Brands
  3. Mellanox Technologies Manuals
  4. Adapter
  5. ConnectX-3 Pro
  6. User manual
Mellanox Technologies ConnectX-3 User Manual

Mellanox Technologies ConnectX-3 User Manual

Ethernet dual sfp+ port adapter
Hide thumbs Also See for ConnectX-3:
Table of Contents

Advertisement

Quick Links

Download this manual
ConnectX®-3 Ethernet Dual SFP+ Port Adapter
Card User Manual
P/N:
MCX312A-XCBT
Rev 1.4
www.mellanox.com

Advertisement

Table of Contents
loading
Need help?

Need help?

Do you have a question about the ConnectX-3 and is the answer not in the manual?

Questions and answers

Related Manuals for Mellanox Technologies ConnectX-3

Summary of Contents for Mellanox Technologies ConnectX-3

  • Page 1 ConnectX®-3 Ethernet Dual SFP+ Port Adapter Card User Manual P/N: MCX312A-XCBT Rev 1.4 www.mellanox.com...
  • Page 2 THIS HARDWARE, SOFTWARE OR TEST SUITE PRODUCT (“PRODUCT(S)”) AND ITS RELATED DOCUMENTATION ARE PROVIDED BY MELLANOX TECHNOLOGIES “AS-IS” WITH ALL FAULTS OF ANY KIND AND SOLELY FOR THE PURPOSE OF AIDING THE CUSTOMER IN TESTING APPLICATIONS THAT USE THE PRODUCTS IN DESIGNATED SOLUTIONS. THE CUSTOMER'S MANUFACTURING TEST ENVIRONMENT HAS NOT MET THE STANDARDS SET BY MELLANOX TECHNOLOGIES TO FULLY QUALIFY THE PRODUCT(S) AND/OR THE SYSTEM USING IT.

  • Page 3: Table Of Contents

    A.1 MCX312A-XCBT Specifications ........... . . 31 Mellanox Technologies...
  • Page 4 Appendix E Sicherheitshinweise (Warnings in German)....... 42 Appendix F Advertencias de seguridad para la instalación (Warnings in Spanish) ..44 Mellanox Technologies...

  • Page 5: List Of Tables

    SFP+ Connector Pinout ..........37 Mellanox Technologies...

  • Page 6: List Of Figures

    Figure 15: Placing the Bracket on the Card ......... . . 39 Mellanox Technologies...

  • Page 7: Revision History

    Section 2.1.3, “LED Assignment,” on page 15 • Formatted specification tables in Appendix A, “Specifications,” on page 31 October 2011 Added new OPNs based on ConnectX-3 Step A1 devices July 2011 Minor edits July 2011 0.10 First Release Mellanox Technologies...

  • Page 8: About This Manual

    Rev 1.4 About this Manual This User Manual describes Mellanox Technologies ConnectX®-3 10 Gigabit Ethernet Dual SFP+ port PCI Express x4 or x8 adapter cards. It provides details as to the interfaces of the board, specifications, required software and firmware for operating the board, and relevant documenta- tion.

  • Page 9: Firmware And Software Updates

    The Mellanox support downloader contains software, firmware and knowledge database informa- tion for Mellanox products. Access the data base from the Mellanox Support web page, http://www.mellanox.com => Support or use the following link to go directly to the Mellanox Support Download Assistant page, http://www.mellanox.com/supportdownloader/. Mellanox Technologies...

  • Page 10: Chapter 1 Overview

    Rev 1.4 Overview Overview This document is a User Manual for Mellanox Technologies Ethernet cards based on the Con- nectX®-3 EN integrated circuit device. The cards described in this manual have the following main features: • IEEE Std. 802.3 compliant •...

  • Page 11: Adapter Cards Covered In This Manual

    MAC for the Ethernet protocol. Figure 1: Card Product Label (Example) Safety Warnings Below is a list of safety warnings in English. For safety warnings in other languages, please refer to the appendices in this user manual. Mellanox Technologies...
  • Page 12 This equipment should be installed, replaced, or serviced only by trained and qualified personnel. Equipment Disposal Disposal of this equipment should be in accordance to all national laws and regula- tions. Local and National Electrical Codes This equipment should be installed in compliance with local and national electrical codes. Mellanox Technologies...
  • Page 13 Caution – Use of controls or adjustment or performance of procedures other than those specified herein may result in hazardous radiation exposure. CLASS 1 LASER PRODUCT and reference to the most recent laser standards: IEC 60 825-1:1993 + A1:1997 + A2:2001 and EN 60825-1:1994+A1:1996+ A2:2001 Mellanox Technologies...

  • Page 14: Chapter 2 Adapter Card Interfaces

    • PCI Express (PCIe) x4 or x8 edge connector • I/O panel LEDs • I C-compatible connector (for debug) Figure 2: MCX312A-XCBT Card The adapter cards include special circuits to protect from ESD shocks to the card/server when plugging copper cables. Mellanox Technologies...

  • Page 15: Ethernet Sfp+ Interface

    The device can be either a master initiating the PCI Express bus operations or a slave responding to PCI bus operations. 2.1.3 LED Assignment There are two I/O LEDs per port in dual-port designs. . See Table 4 for different LED functions. Mellanox Technologies...

  • Page 16: I2C-Compatible Interface

    SFP+ Power Level The adapter cards support power levels according to SFF Committee SFF-8431 Specification for SFP+ (Small Form-factor Pluggable) Transceiver. Memory The adapter cards support multiple memory devices through the PCIe, SPI (Flash) and I C inter- faces. Mellanox Technologies...

  • Page 17: System Memory

    The PCI VPD (Vital Product Data) layout for each of the adapter cards complies with the format defined in the PCI 3.0 Specification, Appendix I. Table 6 - MCX312A-XCBT VPD Layout Offset Item Value Format Description (Decimal) Large Resource Type ID 0x82 String Tag (0x02) Length [7:0] LSB 0x18 Length [15:8] MSB Mellanox Technologies...
  • Page 18 VPD Keyword Remaining read/write area Length 0xfd Data STR_ZERO Reserved (0x00) VPD Keyword Remaining read/write area Length 0xfd Data STR_ZERO Reserved (0x00) VPD Keyword Remaining read/write area Length 0xfd Data STR_ZERO Reserved (0x00) 1024 VPD Keyword Remaining read/write area Mellanox Technologies...
  • Page 19 Reserved (0x00) 3584 VPD Keyword Remaining read/write area 3586 Length 0xfd 3587 Data STR_ZERO Reserved (0x00) 3840 VPD Keyword Remaining read/write area 3842 Length 0xfc 3843 Data STR_ZERO Reserved (0x00) 4095 Small Resource Type END 0x78 Tag (0x11) Mellanox Technologies...
  • Page 20 Rev 1.4 Adapter Card Interfaces Mellanox Technologies...

  • Page 21: Chapter 3 Ethernet Adapter Card Installation

    3.3.1 On Windows Open Device Manager on the server. Click start => Run, and then enter “devmgmt.msc”. Expand System Devices and locate your Mellanox ConnectX-3 adapter card. Select Properties to display the adapter card properties window. Click the Details tab and select Device Instance Id (Windows 2003) or Hardware Ids (Windows 2008/R2) from the Property pull-down menu.

  • Page 22: On Linux

    In the Value display box, check the fields VEN and DEV (fields are separated by ‘&’). In the display example above, notice the sub-string “PCI\VEN_15B3&DEV_1003”: VEN is equal to 0x15B3 – this is the Vendor ID of Mellanox Technologies; and DEV is equal to 1003 – this is a valid Mellanox Technologies PCI Device ID.

  • Page 23: Cables And Modules

    After plugging in a cable, lock the connector using the latching mechanism particular to the cable vendor. When a logical connection is made the YELLOW LED will come on. When data is being transferred the yellow led will blink. Mellanox Technologies...
  • Page 24 Both LED indicators will turn off when the cable is unseated. Cables, especially long copper cables, can weigh a substantial amount. Make sure that the weight of the cable is supported on its own and is not hanging from the adapter card. Mellanox Technologies...

  • Page 25: Chapter 4 Driver Software And Firmware

    => Products => Software/Drivers => Ethernet SW/ Drivers => ConnectX® EN 10GigE Windows Driver => Download. Follow the installation instructions included in the download package (also available from the download page). To ensure that communication has been established follow the instructions below. Mellanox Technologies...

  • Page 26: Figure 8: Device Manager (Example)

    Step 1: Display the Device Manager Figure 8: Device Manager (Example) Step 2: Right-click a Mellanox ConnectX Ethernet adapter (under “Network adapters list) and left- click Properties. Mellanox Technologies...

  • Page 27: Flexboot

    This capability is enabled when using the Mellanox OFED or WinOF VPI drivers. ConnectX®-3 EN with RoCE based network management is the same as that for any Ethernet and DCB-based network management, eliminating the need for IT managers to learn new technolo- gies. Mellanox Technologies...

  • Page 28: Hardware And Software Requirements

    Enter: mst start. c. Get the Mellanox mst device name using the command "mst status". The mst device name will be of the form: /dev/mst/mt4099_pci_cr0. d. Get the PSID (firmware identification) and programmed firmware version using the command. Mellanox Technologies...

  • Page 29: Figure 9: Support Download Assistant

    If a newer firmware version exists for your adapter card, update the firmware as follows: a. Download the firmware image zip file from the Download Center (see Step 2a above). b. Unzip the firmware image. c. Burn the firmware image. Enter: Mellanox Technologies...
  • Page 30 > flint -d /dev/mst/mt4099_pci_cr0 -i <binary image> burn d. Reboot the computer. e. Enter: mst start. f. Verify that the card firmware was updated successfully. > flint -d /dev/mst/mt4099_pci_cr0 Image type: ConnectX FW Version: 2.9.4100 Device ID: 4099 Mellanox Technologies...

  • Page 31: Appendix A Specifications

    Please refer to "Mellanox Products Approved Cable Lists" at www.mellanox.com/related- Cable Support docs/user_manuals/Mellanox_approved_cables.pdf a. For both operational and non-operational states b. Air flow is measured ~1” from the heat sink between the heat sink and the cooling air inlet. Mellanox Technologies...

  • Page 32: Board Mechanical Drawing And Dimensions

    All the mechanical tolerances are +/- 0.1mm Figure 10: Mechanical Drawing of the Dual-port MCX312A-XCBT Adapter Card J1 - I C Connector Flash Jumper 142.25 64.4 56.15 50.00 68.90 12.75 45.96 Regulatory Statements For regulatory statements for all ConnectX®-3 cards please refer to: http://www.mellanox.com/related-docs/user_manuals/Regulatory_and_Compliance_Guide.pdf Mellanox Technologies...
  • Page 33 ConnectX®-3 Ethernet Dual SFP+ Port Adapter Card User Manual Rev 1.4 Mellanox Technologies...

  • Page 34: Appendix B Interface Connectors Pinout

    Connector Pin Number Signal Name SPSDA SPSCL PCI Express x8 Connector Pinout The adapter cards use a standard PCI Express x4 or x8 edge connector and the PCI Express x8 standard pinout according to the PCI Express 3.0 specification. Mellanox Technologies...

  • Page 35: Figure 12: Pcie Connector Pinout

    ConnectX®-3 Ethernet Dual SFP+ Port Adapter Card User Manual Rev 1.4 Figure 12: PCIe Connector Pinout Mellanox Technologies...

  • Page 36: Sfp+ Connector Pinout

    Rev 1.4 SFP+ Connector Pinout Figure 13: Rear View of Module With Pin Placement Mellanox Technologies...

  • Page 37: Table 9: Sfp+ Connector Pinout

    LOS is open collector output. Should be pulled up with 4.7kΩ – 10kΩ on host board to a voltage between 2.0V and 3.6V. Logic 0 indicates normal operation; logic 1 indicates loss of signal. Mellanox Technologies...

  • Page 38: Appendix C Replacing A Tall Bracket With A Short Bracket

    Figure 14: Bracket Screws Screws Remove the two screws holding the bracket in place. The bracket comes loose from the card. Be careful not to put stress on the LEDs. Save the two screws and the two fiber washers. Mellanox Technologies...

  • Page 39: Installing The New Bracket

    Screw on the bracket using the screws and washers saved from the procedure above step 1. Figure 15: Placing the Bracket on the Card Make sure that the LEDs are aligned onto the bracket holes. Use a torque driver to apply up to 2 lbs-in torque on the screws. Mellanox Technologies...

  • Page 40: Appendix D Avertissements De Sécurité D'installation (Warnings In French)

    Ce matériel ne doit être installé, remplacé ou entretenu que par du personnel formé et qualifié. 6. Elimination du matériel L’élimination de ce matériel doit s’effectuer dans le respect de toutes les législations et réglementations nationales en vigueur. Mellanox Technologies...
  • Page 41 PRODUIT LASER DE CLASSE 1 » et références aux normes laser les plus récentes CEI 60 825-1:1993 + A1:1997 + A2:2001 et NE 60825- 1:1994+A1:1996+ A2:2001 Mellanox Technologies...

  • Page 42: Appendix E Sicherheitshinweise (Warnings In German)

    6. Geräteentsorgung Die Entsorgung dieses Geräts sollte unter Beachtung aller nationalen Gesetze Bestim- mungen erfolgen. 7. Regionale und nationale elektrische Bestimmungen Dieses Gerät sollte unter Beachtung der regionalen und nationalen elektrischen Bestimmungen installiert werden. Mellanox Technologies...
  • Page 43 Achtung – Nutzung von Steuerungen oder Einstellungen oder Ausführung von Prozeduren, die hier nicht spezifiziert sind, kann zu gefährlichem Strahlenkon- takt führen.. Klasse 1 Laserprodukt und Referenzen zu den aktuellsten Lasterstandards : ICE 60 825-1:1993 + A1:1997 + A2:2001 und EN 60825-1:1994+A1:1996+ A2:2001 Mellanox Technologies...

  • Page 44: Appendix F Advertencias De Seguridad Para La Instalación (Warnings In Spanish)

    La instalación, el reemplazo y el mantenimiento de este equipo estarán a cargo única- mente de personal capacitado y competente. 6. Eliminación de equipos La eliminación definitiva de este equipo se debe efectuar conforme a todas las leyes y reglamentaciones nacionales. Mellanox Technologies...
  • Page 45 Precaución: el uso de controles o ajustes o la realización de procedimientos distintos de los que aquí se especifican podrían causar exposición a niveles de radiación peligrosos. PRODUCTO LÁSER DE CLASE 1 y referencia a las normas de láser más recientes: IEC 60825-1:2007/03 y EN 60825-1:2007 Mellanox Technologies...

This manual is also suitable for:

Mcx312a-xcbt

Table of Contents