Supermicro SuperServer 620C-TN12R User Manual
  1. Manuals
  2. Brands
  3. Supermicro Manuals
  4. Server
  5. SuperServer 620C-TN12R
  6. User manual

Supermicro SuperServer 620C-TN12R User Manual

Hide thumbs
Table of Contents

Advertisement

Quick Links

Download this manual
SuperServer
®
620C-TN12R
USER'S MANUAL
Revision 1.0

Advertisement

Table of Contents
loading
Need help?

Need help?

Do you have a question about the SuperServer 620C-TN12R and is the answer not in the manual?

Questions and answers

Related Manuals for Supermicro SuperServer 620C-TN12R

Summary of Contents for Supermicro SuperServer 620C-TN12R

  • Page 1 SuperServer ® 620C-TN12R USER’S MANUAL Revision 1.0...
  • Page 2 State of California, USA. The State of California, County of Santa Clara shall be the exclusive venue for the resolution of any such disputes. Supermicro's total liability for all claims will not exceed the price paid for the hardware product.
  • Page 3 If you have any questions, please contact our support team at: support@supermicro.com This manual may be periodically updated without notice. Please check the Supermicro website for possible updates to the manual revision level. Secure Data Deletion A secure data deletion tool designed to fully erase all data from storage devices can be found on our website: https://www.supermicro.com/about/policies/disclaimer.cfm?url=/wdl/utility/...

  • Page 4: Table Of Contents

    Contents Contents Chapter 1 Introduction 1.1 Overview ..........................9 Network Connection Options ....................9 1.2 System Features .......................10 Front View .........................10 Drive Carrier Indicators ....................10 Control Panel .........................11 Rear View ..........................12 Power Supply Indicators ....................13 Top View ..........................14 1.3 System Architecture ......................15 1.4 Motherboard Layout ......................16 Quick Reference .......................17 Motherboard Block Diagram .....................19...
  • Page 5 Contents 2.5 Installing the Server into the Rack ..................27 Removing the Chassis from the Rack ................28 Chapter 3 Maintenance and Component Installation 3.1 Removing Power .......................29 3.2 Accessing the System ......................30 Removing the Top Cover ....................30 3.3 Processor and Heatsink Installation ...................31 The Processor Carrier Assembly ..................32 The Processor Heatsink Module (PHM) ................34 Installing the PHM into the CPU Socket ................35...
  • Page 6 Contents 3.10 PCIe Expansion Cards ......................57 Limitations for Slots 1, 2, 4, and 5 ..................57 Configurations of PCIe Connections .................57 Installing Expansion Cards....................59 PCIe Bifurcation Settings ....................60 3.11 Cable Routing ........................61 Chapter 4 Motherboard Connections 4.1 Power Connections ......................65 4.2 Headers and Connectors ....................66 Control Panel .........................69 4.3 Input/Output Ports ......................72 4.4 Jumpers ..........................73...
  • Page 7 7.9 Where to Get Replacement Components ................107 7.10 Reporting an Issue ......................107 Technical Support Procedures ..................107 Returning Merchandise for Service .................107 Vendor Support Filing System ..................108 7.11 Feedback .........................108 7.12 Contacting Supermicro ....................109 Appendix A Standardized Warning Statements for AC Systems Appendix B System Specifications...
  • Page 8 Super Micro Computer, Inc. 980 Rock Ave. San Jose, CA 95131 U.S.A. Tel: +1 (408) 503-8000 Fax: +1 (408) 503-8008 Email: marketing@supermicro.com (General Information) support@supermicro.com (Technical Support) Website: www.supermicro.com Europe Address: Super Micro Computer B.V. Het Sterrenbeeld 28, 5215 ML...

  • Page 9: Chapter 1 Introduction

    2U; 17.2” x 3.5” x 25.5” (depth) (43.7 x 8.9 x 64.7 cm) A Quick Reference Guide can be found on the product page of the Supermicro website. The following safety models associated with the SBA-4119S-(C/T)2N have been certified as compliant with UL or CSA: LA26TS-R12X12, LA26-12, LA26TS-12...

  • Page 10: System Features

    Chapter 1: Introduction 1.2 System Features The following views of the system display the main features. Refer to Appendix B for additional specifications. Front View Service/Asset Tag with BMC Password Control Panel Figure 1-1. System Front View Logical Storage Drive Numbers Item Description 0-11...

  • Page 11: Control Panel

    Chapter 1: Introduction Control Panel Power Button Reset Button Power LED HDD LED NIC LED NIC LED Power Fail LED Information LED Figure 1-2. Control Panel Control Panel Features Features Description The main power switch applies or removes primary power from the power supply to the Power Button server but maintains standby power.

  • Page 12: Rear View

    Chapter 1: Introduction Information LED Color, Status Description UID has been activated locally to locate the Blue, solid server in a rack environment. UID has been activated using the BMC to locate Blue, blinking at 1Hz the server in a rack environment. Blue, blinking at 2Hz BMC is resetting Blue, blinking at 4Hz...

  • Page 13: Power Supply Indicators

    Indicates that the power supply has a warning condition and continues to operate. Indicates that the power supply is plugged in, and is in an abnormal state. The Solid Amber system might need service. Please contact Supermicro technical support. No AC power to modules...

  • Page 14: Top View

    Chapter 1: Introduction Top View Power Supply Modules M.2 Slots SATA Ports USB 2.0 Header Dual Processors DIMM Slots Power Distributor System Fans Figure 1-4. System: Top View System Features: Top Feature Description M.2 Slots Two slots for PCIe 3.0 x2 M.2 NVMe Power Supplies Dual redundant modules SATA ports allow for one Disk-on-Module SSD mounted directly on the motherboard...

  • Page 15: System Architecture

    Chapter 1: Introduction 1.3 System Architecture This section covers the locations of the system electrical components. Riser Card Slot Riser Card Slot RSC-D2R-668G4 RSC-D2-668G4 Motherboard BH12SSi-M25 Storage Backplane BPN-SAS3-LA26A-N12 Figure 1-5. Main Component Locations...

  • Page 16: Motherboard Layout

    Chapter 1: Introduction 1.4 Motherboard Layout Below is a layout of the BH12SSi-M25 motherboard with jumper, connector and LED locations shown. See the following page for descriptions. For detailed descriptions, pinout information and jumper settings, refer to Chapter 4 or the Motherboard Manual.

  • Page 17: Quick Reference

    Chapter 1: Introduction Quick Reference Jumper Description Default Setting JBT1 CMOS Clear Open (Normal) Pins 1-2 (Reset JFP1 Signals for JRU1 Front Control Board (JFP1) Signal Resent Jumper Power Button Use) Connector Description Battery (BT1) Onboard CMOS battery COM1 (JCOM1) Rear I/O COM port CPU1 LUIO2 (JLUIO2) Left side PCIe 4.0 x16 riser card slot supported by CPU1...
  • Page 18 Chapter 1: Introduction Connector Description Serial Link General Purpose I/O connection header (for S-SATA4/5 SuperDOM S-SGPIO2 support) SUM-13/14 BMC firmware SUM-15/16 System BIOS USB0/1 (2.0) (J35) Front Accessible USB header with two USB 2.0 connections USB2/3 (3.0) Rear I/O USB Port 2/ Port 3 (USB 3.0) (JUSBRJ45) UID (JUIDB1) Unit Identifier (UID) button...

  • Page 19: Motherboard Block Diagram

    Chapter 1: Introduction Motherboard Block Diagram CPU1-B1 CPU1-A1 CPU1-D1 CPU1-C1 CPU2-C1 CPU2-D1 CPU2-A1 CPU2-B1 10.4/11.2G CPU1 CPU2 DDR4 DDR4 PECI : 31 PECI : 30 CPU1-F1 CPU1-E1 CPU1-H1 CPU1-G1 CPU2-G1 CPU2-H1 CPU2-E1 CPU2-F1 SOCKET ID: 1 SOCKET ID: 0 DMI3 PCIe GEN4 X16 JAIOM1 PCIe GEN4 X16...

  • Page 20: Chapter 2 Server Installation

    Chapter 2: Server Installation Chapter 2 Server Installation 2.1 Overview This chapter provides advice and instructions for mounting your system in a server rack. If your system is not already fully integrated with processors, system memory, etc., refer to Chapter 3 for details on installing those specific components.

  • Page 21: Rack Precautions

    Chapter 2: Server Installation Rack Precautions • Ensure that the leveling jacks on the bottom of the rack are extended to the floor so that the full weight of the rack rests on them. • In single rack installations, stabilizers should be attached to the rack. In multiple rack in- stallations, the racks should be coupled together.

  • Page 22: Mechanical Loading

    Chapter 2: Server Installation Mechanical Loading Equipment should be mounted into a rack so that a hazardous condition does not arise due to uneven mechanical loading. Circuit Overloading Consideration should be given to the connection of the equipment to the power supply circuitry and the effect that any possible overloading of circuits might have on overcurrent protection and power supply wiring.

  • Page 23: Installing The Rails

    Chapter 2: Server Installation 2.4 Installing the Rails There are a variety of rack units on the market, which may require a slightly different assembly procedure. This rail set fits a rack between 26.8" and 36.4" deep. The following is a basic guideline for installing the system into a rack with the rack mounting hardware provided.

  • Page 24: Releasing The Inner Rail

    Chapter 2: Server Installation Releasing the Inner Rail Each inner rail has a locking latch. This latch prevents the server from coming completely out of the rack when when the chassis is pulled out for servicing. To mount the rail onto the chassis, first release the inner rail from the outer rails. Releasing Inner Rail from the Outer Rails 1.

  • Page 25: Installing The Inner Rails On The Chassis

    Chapter 2: Server Installation Installing the Inner Rails on the Chassis Installing the Inner Rails 1. Identify the left and right inner rails. They are labeled. 2. Place the inner rail firmly against the side of the chassis, aligning the hooks on the side of the chassis with the holes in the inner rail.

  • Page 26: Installing The Outer Rails Onto The Rack

    Chapter 2: Server Installation Installing the Outer Rails onto the Rack 1. Press upward on the locking tab at the rear end of the middle rail. 2. Push the middle rail back into the outer rail. 3. Hang the hooks on the front of the outer rail onto the square holes on the front of the rack.

  • Page 27: Installing The Server Into The Rack

    Chapter 2: Server Installation 2.5 Installing the Server into the Rack Once rails are attached to the chassis and the rack, you can install the server. 1. Pull the middle rail out of the front of the outer rail and make sure that the ball bearing shuttle is locked at the front of the middle rail.

  • Page 28: Removing The Chassis From The Rack

    Chapter 2: Server Installation Removing the Chassis from the Rack Caution! It is dangerous for a single person to off-load the heavy chassis from the rack without assistance. Be sure to have sufficient assistance supporting the chassis when removing it from the rack.

  • Page 29: Chapter 3 Maintenance And Component Installation

    Chapter 3: Maintenance and Component Installation Chapter 3 Maintenance and Component Installation This chapter provides instructions on installing and replacing main system components. To prevent compatibility issues, only use components that match the specifications and/or part numbers given. Installation or replacement of most components require that power first be removed from the system.

  • Page 30: Accessing The System

    Chapter 3: Maintenance and Component Installation 3.2 Accessing the System The system features a removable top cover, which allows access to the inside of the system. Removing the Top Cover 1. Press the two release buttons and slide the cover toward the rear. 2.

  • Page 31: Processor And Heatsink Installation

    • Thermal grease is pre-applied on new heatsinks. No additional thermal grease is needed. • Refer to the Supermicro website for updates on processor support. • Graphics in this manual are for illustration only. Your components may look different.

  • Page 32: The Processor Carrier Assembly

    Chapter 3: Maintenance and Component Installation The Processor Carrier Assembly The processor carrier assembly is comprised of the processor and the processor carrier. 1. Hold the processor with the land grid array (LGA, gold contacts) facing down. Locate the gold triangle at the corner of the processor and the corresponding hollowed triangle on the processor carrier as shown below.
  • Page 33 Chapter 3: Maintenance and Component Installation 3. Locate the lever on the carrier and, if necessary, press it down as shown below. Lever 4. Align the CPU keys on the processor (A & B) with those on the carrier (a & b) as shown below.

  • Page 34: The Processor Heatsink Module (Phm)

    Chapter 3: Maintenance and Component Installation The Processor Heatsink Module (PHM) After creating the processor carrier assembly, mount the heatsink onto the carrier assembly to form the processor heatsink module (PHM). Note: If this is a new heatsink, the thermal grease has been pre-applied. Otherwise, apply the proper amount of thermal grease to the underside of the heatsink.

  • Page 35: Installing The Phm Into The Cpu Socket

    Chapter 3: Maintenance and Component Installation Installing the PHM into the CPU Socket 1. Remove the plastic protective cover from the CPU socket. Gently squeeze the grip tabs then pull the cover off. CPU Socket with Plastic Protective Cover Grip Tabs...
  • Page 36 Chapter 3: Maintenance and Component Installation 2. Locate four threaded fasteners (a, b, c, d) on the CPU socket. CPU Socket Threaded Fastener (a, b, c, d: Threaded Fasteners) CPU Socket Pin1 3. Locate four PEEK nuts (A, B, C, D) and four rotating wires (1, 2, 3, 4) on the heatsink as shown below.
  • Page 37 Chapter 3: Maintenance and Component Installation 5. Align nut A (next to the triangles and pin 1) on the heatsink with threaded fastener "a" on the CPU socket. Also align nuts B, C, D on the heatsink with threaded fasteners b, c, d on the CPU socket.

  • Page 38: Removing The Phm From The Cpu Socket

    Chapter 3: Maintenance and Component Installation Removing the PHM from the CPU Socket Be sure the system is shut down and all AC power cords are unplugged. 1. Use a t30-bit screwdriver to loosen the four PEEK nuts on the heatsink in the sequence of A, B, C, and D.

  • Page 39: Removing The Processor Carrier Assembly From The Phm

    Chapter 3: Maintenance and Component Installation Removing the Processor Carrier Assembly from the PHM Detach the four plastic clips (a, b, c, d) on the processor carrier assembly from the four corners of the heatsink (A, B, C, D) as shown below, and lift off the processor carrier assembly. Processor Carrier Assembly Pin1 Pin1...

  • Page 40: Removing The Processor From The Carrier Assembly

    Chapter 3: Maintenance and Component Installation Removing the Processor from the Carrier Assembly Unlock the lever from its locked position and push it upwards to disengage the processor from the carrier as shown below right. Carefully remove the processor from the carrier. Processor Carrier Assembly Lever Note: Handle the processor with care to avoid damage.

  • Page 41: Memory

    Chapter 3: Maintenance and Component Installation 3.4 Memory Memory Support The X12DDW-A6 has 16 DIMM slots for up to 4TB of 3DS LRDIMM/LRDIMM/3DS RDIMM/ RDIMM DDR4 ECC memory or Intel Optane PMem 200 Series with speeds of 3200MHz. Intel Optane PMem is supported by the Intel Xeon Scalable Processors Platinum, Gold and selected Silver processors only.
  • Page 42 Chapter 3: Maintenance and Component Installation Use the DIMM slots listed below for memory modules. This memory population table is based on guidelines provided by Intel to support Supermicro motherboards. Memory Population for the X12 DP Motherboard, 16 DIMM Slots...

  • Page 43: Optane Pmem Population

    Chapter 3: Maintenance and Component Installation Optane PMem Population Intel Optane PMem 200 Series, up to 8TB of PMem and 4TB DDR4. Symmetric Population for Each CPU with PMem DIMM DIMMs & AD interl- Modes PMem leve 1 - x4 DDR4 DDR4 DDR4...

  • Page 44: Memory Population Guidelines

    Balance memory. Using unbalanced memory topology, such as populating two DIMMs in one channel while populating one DIMM in another channel, reduces performance. It is not recommended for Supermicro systems. • In single-CPU configurations, memory must be installed in the DIMM slots associated with the installed CPU.

  • Page 45: Installing Memory

    Chapter 3: Maintenance and Component Installation Installing Memory Electrostatic Discharge (ESD) can damage electronic com ponents including memory modules. To avoid damaging DIMM modules, it is important to handle them carefully. The following measures are generally sufficient. • Use a grounded wrist strap designed to prevent static discharge. •...

  • Page 46: Motherboard Battery

    Chapter 3: Maintenance and Component Installation 3.5 Motherboard Battery The motherboard uses non-volatile memory to retain system information when system power is removed. This memory is powered by a lithium battery residing on the motherboard. Replacing the Battery Begin by removing power from the system.

  • Page 47: Storage Drives

    NVMe or SAS/SATA. Drive carrier status indicators are described in Section 1.2 Note: Enterprise level hard disk drives are recommended for use in Supermicro servers. For compatible storage drives, see the X12DDW-A6 motherboard web page.
  • Page 48 Chapter 3: Maintenance and Component Installation Removing a Hot-Swap Drive Carrier from the System 1. Press the release button on the drive carrier, which will extend the drive carrier handle. 2. Use the drive carrier handle to pull the drive out of the chassis. Handle Release Button Figure 3-7.

  • Page 49: Drive

    Chapter 3: Maintenance and Component Installation Installing a 3.5" Drive 1. Remove the dummy drive, which comes pre-installed in the drive carrier. Pull out the two locking clasps on the right outside of the carrier and lift out the dummy drive. 2.

  • Page 50: Drive

    Chapter 3: Maintenance and Component Installation Insert this side second Figure 3-9. Installing a 3.5" Drive into a Carrier Installing a 2.5" Drive 1. Remove the dummy drive, which comes pre-installed in the drive carrier. Pull out the two locking clasps on the left outside of the carrier and lift out the dummy drive. 2.

  • Page 51: Hot-Swap For Nvme Drives

    Chapter 3: Maintenance and Component Installation Hot-Swap for NVMe Drives Supermicro servers support NVMe surprise hot-swap. For even better data security, NVMe orderly hot-swap is recommended. NVMe drives can be ejected and replaced remotely using the BMC Dashboard. Note: If you are using VROC, see the VROC section in this manual instead.

  • Page 52: Checking The Temperature Of An Nvme Drive

    Chapter 3: Maintenance and Component Installation Checking the Temperature of an NVMe Drive There are two ways to check using the BMC Dashboard. Checking a Drive • BMC Dashboard > Server Health > NVMe SSD – Shows the temperatures of all NVMe drives.

  • Page 53: System Cooling

    Chapter 3: Maintenance and Component Installation 3.7 System Cooling Three 4-cm fans provide the cooling for the system. Make sure the chassis top cover makes a good seal so the cooling air circulates properly through the chassis Changing a System Fan 1.

  • Page 54: Installing An Air Shroud

    3.8 Power Supply The chassis features redundant power supplies. The power modules can be changed without powering down the system. New units can be ordered directly from Supermicro or authorized distributors. These power supplies are auto-switching capable. This feature enables them to automatically...

  • Page 55: Power Supply Leds

    • Solid Amber: When illuminated, indicates that the power supply is plugged in, and is in an abnormal state. The system might need service. Please contact Supermicro technical support. Replacing the Power Supply 1. Unplug the AC cord from the module to be replaced.

  • Page 56: Aiom Network Cards

    Chapter 3: Maintenance and Component Installation 3.9 AIOM Network Cards The system provides network connection by means of two advanced I/O modules (AIOMs). Figure 3-15. AIOM Chassis Slots AIOM Slots Item Description from CPU1 from CPU2 Installing AIOM Cards 1. Remove the blank cover plate ( ), unscrewing the thumbscrew.

  • Page 57: Pcie Expansion Cards

    Chapter 3: Maintenance and Component Installation 3.10 PCIe Expansion Cards The system can accommodate six PCIe 4.0 cards or two double-width GPUs and two PCIe cards. Limitations for Slots 1, 2, 4, and 5 The expansion card capability varies depending on your NVMe storage drive configuration. Due to PCIe 4.0 requirements, riser card slots 1 and 2 are connected by cable to P1_PCIE0/1, and slots 4 and 5 are connected by cable to P2_PCIE0/1 headers on the motherboard.
  • Page 58 Chapter 3: Maintenance and Component Installation Figure 3-18. Rear View of Riser Card RSC-D2-668G4 The same relationships apply for slots 4 and 5, and headers P2-PCIE0 and P2-PCIE1. Slots 4 and 5 on riser card on RSC-D2R-668G4 (see picture below) can be connected for use in several ways using motherboard headers P2-PCIE0 and P2-PCIE1.

  • Page 59: Installing Expansion Cards

    Chapter 3: Maintenance and Component Installation Installing Expansion Cards 1. Power down the system and remove the cover. 2. Lift the riser card bracket(s) out of the chassis using the pull-tabs. 3. In the rear of the chassis, remove the blank PCI shields that covers the chassis slot. Left Riser Card Bracket Right Riser...

  • Page 60: Pcie Bifurcation Settings

    Chapter 3: Maintenance and Component Installation PCIe Bifurcation Settings By default, the BIOS will set bifurcation according to the detected PCIe card. Bifurcation settings can be found in the BIOS under Advanced > Chipset Configuration > North Bridge > IIO Configuration > CPU1/CPU2 Configuration. Before modifying bifurcation settings, verify that the riser card cables (if any) are connected correctly, as described in the riser card cable routing table.

  • Page 61: Cable Routing

    Chapter 3: Maintenance and Component Installation 3.11 Cable Routing Use this section to route or reroute cables. Proper routing is important to maintain airflow through the system. Cable part numbers and descriptions are available at the Online Cable Matrix. Data Cables Routing No.
  • Page 62 Chapter 3: Maintenance and Component Installation Big-4-pin NVME6 NVME2 NVME1 NVME4 NVME3 NVME5 BPN-SAS3-LA26A-N12 Figure 3-23. Backplane Cable Routing Diagram Backplane BPN-SAS3-LA26A-N12 (manual) NVMe (67cm) CBL-SAST-1267FLP-85 NVMe (40cm) CBL-SAST-1236LP-85 SATA Cable (57cm) CBL-SAST-1285LP-100 SATA Cable (68/76cm) CBL-SAST-1274LP-100 Figure 3-24. Storage Cable Routing Diagram...
  • Page 63 Chapter 3: Maintenance and Component Installation RSC-D2-668G4 RSC-D2R-668G4 Riser (8cm) CBL-SAST-1208LP-85 Figure 3-25. Riser Card Cable Routing Diagram...
  • Page 64 Chapter 3: Maintenance and Component Installation MB Power Cables, 24 and 8-pin Backplane Power Cable, 4-pin PMBus Cable, 5-pin Fan Cable, 4-pin Front Panel Control Cable, 16-pin Chassis Intrusion Cable, 2-pin Figure 3-24. Non-Storage Cable Routing Diagram...

  • Page 65: Chapter 4 Motherboard Connections

    Chapter 4: Motherboard Connections Chapter 4 Motherboard Connections This section describes the jumpers, connections and LEDs on the motherboard and provides pinout definitions. Some connections might not be used in this system. A motherboard layout indicating component locations may be found in Chapter 1.

  • Page 66: Headers And Connectors

    The JTPM1 header is used to connect a Trusted Platform Module (TPM)/Port 80, which is available from Supermicro. A TPM/Port 80 connector is a security device that supports encryption and authentication in hard drives. It allows the motherboard to deny access if the TPM associated with the storage drive is not installed in the system.
  • Page 67 Chapter 4: Motherboard Connections RAID Key Header An Intel VROC RAID Key header is located at JRK1. It supports VMD used in creating optional advanced NVMe RAID configurations. RAID Key Header Pin Definitions Pin# Definition Ground RAID_KEY_PU Ground PCH_RAID_KEY VROC Key Note: This drawing is for illustration only.
  • Page 68 4, S-SATA 5) supported by the Intel PCH C621A chipset. S-SATA 4/S-SATA 5 can be used with Supermicro SuperDOMs which are orange SATA DOM connectors with power pins built in, and do not require external power cables. S-SATA 4/S-SATA- 5 ports are compatible with...

  • Page 69: Control Panel

    Chapter 4: Motherboard Connections Control Panel JF1 contains header pins for various control panel connections. See the figure below for the pin locations and definitions of the control panel buttons and LED indicators. All JF1 wires have been bundled into a single cable to simplify this connection. Make sure the red wire plugs into pin 1 as marked on the motherboard.
  • Page 70 Chapter 4: Motherboard Connections Power Fail LED The Power Fail LED connection is located on pins 5 and 6 of JF1. Power Fail LED Pin Definitions (JF1) Pin# Definition 3.3V PWR Supply Fail Overheat (OH)/Fan Fail Connect an LED cable to pins 7 and 8 of JF1 to use the Overheat/Fan Fail LED connections. The LED on pin 8 provides warnings of overheat or fan failure.
  • Page 71 Chapter 4: Motherboard Connections Power LED The Power LED connection is located on pins 15 and 16 of JF1. Power LED Pin Definitions (JF1) Pin# Definition 3.3V Power LED NMI Button The non-maskable interrupt button header is located on pins 19 and 20 of JF1. NMI Button Pin Definitions (JF1) Pin#...

  • Page 72: Input/Output Ports

    Chapter 4: Motherboard Connections 4.3 Input/Output Ports Figure 4-2. Rear I/O Ports Rear I/O Ports Description Description Dedicated BMC LAN USB (3.0) COM Port USB (3.0) UID Switch LAN Ports There is a dedicated BMC LAN port on the I/O back panel. There can also be two or more network LAN ports depending on the option you purchased.

  • Page 73: Jumpers

    Chapter 4: Motherboard Connections 4.4 Jumpers Explanation of Jumpers To modify the operation of the motherboard, jumpers are used to choose between optional settings. Jumpers create shorts between two pins to change the function associated with it. Pin 1 is identified with a square solder pad on the printed circuit board. See the motherboard layout page for jumper locations.

  • Page 74: Led Indicators

    Chapter 4: Motherboard Connections 4.5 LED Indicators Network LAN LEDs The Ethernet ports each have two LEDs. One LED indicates activity when flashing green. The other may be green, amber or off to indicate the speed of the connection. BMC-Dedicated LAN LEDs A dedicated BMC LAN port provided a connection to the BMC.

  • Page 75: Chapter 5 Software

    If you will be using RAID, you must configure RAID settings before installing the Windows OS and the RAID driver. Refer to the RAID Configuration User Guides posted on our website at www.supermicro.com/support/manuals. Installing the OS 1. Create a method to access the MS Windows installation ISO file. That might be a DVD, perhaps using an external USB/SATA DVD drive, or a USB flash drive, or the BMC KVM console.
  • Page 76 Chapter 5: Software 3. During Windows Setup, continue to the dialog where you select the drives on which to install Windows. If the disk you want to use is not listed, click on “Load driver” link at the bottom left corner. Figure 5-2.

  • Page 77: Driver Installation

    The Supermicro website contains drivers and utilities for your system at https://www. supermicro.com/wdl/driver. Some of these must be installed, such as the chipset driver. After accessing the website, go into the CDR_Images (in the parent directory of the above link) and locate the ISO file for your motherboard. Download this file to to a USB flash drive or a DVD.

  • Page 78: Superdoctor ® 5

    5.3 SuperDoctor ® The Supermicro SuperDoctor 5 is a program that functions in a command-line or web-based interface for Windows and Linux operating systems. The program monitors such system health information as CPU temperature, system voltages, system power consumption, fan speed, and provides alerts via email or Simple Network Management Protocol (SNMP).

  • Page 79: Bmc

    There are several BIOS settings that are related to BMC. For general documentation and information on BMC, visit our website at: www.supermicro.com/en/solutions/management-software/bmc-resources BMC ADMIN User Password For security, each system is assigned a unique default BMC password for the ADMIN user.

  • Page 80: Chapter 6 Optional Components

    Intel VROC RAID Key 6.1 Storage Control Cards Supermicro offers controller cards for some storage options. Storage Protocols Supported The storage drive bays can support SATA or SAS. SATA – The default configuration supports SATA drives. SAS – An add-on controller card can support up to SAS (or SATA) drives. Additional cables are required.

  • Page 81: Gpu Support

    Chapter 6: Optional Components 6.2 GPU Support The system can accommodate two FHFL double-width x16 GPUs and two PCIe cards, or up to six FHHL x8 single-width GPUs cards. GPU Support Quantity Two to six Slot 2 (On RSC-D2R-668G4, connect P2_PCIE0 to CN3, P2_ PCIE1 to CN2) Available Slots Slot 3...
  • Page 82 Chapter 6: Optional Components Installing the Cable Management Arm 1. Slide CMA connector #1 forward onto the two posts on the rear of the right inner rail (right side when viewed from the front). It snaps into place. 2. Slide CMA connector #2 forward onto the two posts on the rear of the right middle rail. It snaps into place.
  • Page 83 Chapter 6: Optional Components 3. Slide CMA connector #3 forward onto the two posts on the rear of the left middle rail. It snaps into place. 4. For CMA connector #4, align the metal tabs with the slots on the rear of the left outer rail and push it forward.
  • Page 84 Chapter 6: Optional Components Figure 6-4. Routing the Cables 5. Open the four red plastic caps and route the cables into the wire carrier. 6. If necessary, adjust the U-brackets to clear chassis components. Figure 6-5. Adjusting the U-Brackets...

  • Page 85: Tpm Security Module

    It enables the motherboard to deny access if the TPM associated with the hard drive is not installed in the system. Details and installation procedures are at: http://www.supermicro.com/manuals/other/TPM.pdf. • AOM-TPM-9670V •...

  • Page 86: Intel Virtual Raid On Cpu (Vroc)

    Chapter 6: Optional Components 6.5 Intel Virtual RAID on CPU (VROC) Intel Virtual RAID on CPU (Intel VROC) is an enterprise RAID solution for NVMe SSDs ® directly attached to Intel Xeon Scalable processors. Intel Volume Management Device (VMD) is an integrated controller inside the CPU PCI-E root complex. •...

  • Page 87: Additional Information

    Chapter 6: Optional Components Additional Information Additional information is available on the product page for the Supermicro add-on card and the linked manuals. www.supermicro.com/en/products/accessories/addon/AOC-VROCxxxMOD.php Hardware Key The Intel VROC hardware key is a license key that detects the Intel VROC SKU and activates the function accordingly.

  • Page 88: Configuring Nvme Raid Manually

    Chapter 6: Optional Components Configuring NVMe RAID Manually RAID for NVMe SSDs is enabled by default when Intel VROC Raid Key is populated. It may be managed manually through the UEFI BIOS. 1. Reboot the server and press [DEL] key to access the BIOS options. 2.
  • Page 89 Chapter 6: Optional Components Figure 6-8. BIOS, Manual Mode (Example—your server may look different.) 3. Select the desired PStack# to Enable or Disable the corresponding Intel VMD controller Figure 6-9. BIOS, Enabling VMD for Pstack0...
  • Page 90 Chapter 6: Optional Components 4. Select the desired PCIe slot to Enable or Disable Intel VMD functionality according to the current hardware configuration being used. Hot Plug Capability can also be Enabled or Disabled. Figure 6-10. BIOS, Enabling VMD Functionality per Slot 5.
  • Page 91 Chapter 6: Optional Components Figure 6-12. BIOS, Enabling CPU2 Example 6. Press [F4] to save the configuration and reboot the system and press [DEL] to enter BIOS. Note: Disabling the VMD controller without first deleting the associated existing RAID volume can lead to unexpected behavior. This action is strongly not recommended. Note: The effects of physically changing or swapping a CPU on the VMD controller enablement has not yet been thoroughly tested or documented.
  • Page 92 Chapter 6: Optional Components 10. If cross-controller RAID is required, select Enable RAID spanned over VMD Controller. Figure 6-13. Created Volume without Figure 6-14. Created Volume with enabling RAID spanned over VMD enabling RAID spanned over VMD controller controller 11. Select specific disks for RAID with an [X]. •...

  • Page 93: Status Indications

    Chapter 6: Optional Components Status Indications An LED indicator on the drive carrier shows the RAID status of the drive. Drive Carrier Status LED Indicator Status State (red) Normal function Locating 4 Hz blink Fault Solid on Rebuilding 1 Hz Blink IBPI SFF 8489 Defined Status LED States Hot Swap Drives Intel VMD enables hot-plug and hot-unplug for NVMe SSDs, whether from Intel or other...

  • Page 94: Troubleshooting And Support

    Chapter 7 Troubleshooting and Support 7.1 Information Resources Website A great deal of information is available on the Supermicro website, supermicro.com. Figure 7-1. Supermicro Website • Specifications for servers and other hardware are available by clicking the Products option. •...

  • Page 95: Bmc Interface

    Security Center for recent security notices Supermicro Phone and Addresses 7.2 BMC Interface The system supports a Baseboard Management Controller (BMC) interface. It provides remote access, monitoring and management. There are several BIOS settings related to the BMC.

  • Page 96: No Power

    Chapter 7: Troubleshooting and Support No Power 1. As you try to power up the system, note any beep codes. Refer to the next section for details on beep codes. 2. Check that the power LED on the motherboard is on. COM1 USB2/3(3.0) JUIDB1...

  • Page 97: No Video

    Chapter 7: Troubleshooting and Support 9. Verify that all jumpers are set to their default positions. 10. Check that the power supplies’ input voltage operate at 100-120v or 180-240v. 11. Turn the power switch on and off to test the system No Video 1.

  • Page 98: When The System Becomes Unstable

    2. Memory support: Make sure that the memory modules are supported by testing the modules using memtest86 or a similar utility. Note: Refer to the product page on our website at http://www.supermicro.com for memory and CPU support and updates. 3. HDD support: Make sure that all hard disk drives (HDDs) work properly. Replace the bad HDDs with good ones.

  • Page 99: Bios Error Beep (Post) Codes

    When BIOS performs the Power On Self Test, it writes checkpoint codes to I/O port 0080h. If the computer cannot complete the boot process, a diagnostic card can be attached to the computer to read I/O port 0080h (Supermicro p/n AOC-LPC80-20). For information on AMI updates, please refer to http://www.ami.com/products/.

  • Page 100: Crash Dump Using The Bmc Dashboard

    In the event of a processor internal error (IERR) that crashes your system, you may want to provide information to support staff. You can download a crash dump of status information using the BMC Dashboard. The BMC manual is available at www.supermicro.com/manuals/ other/BMC_Users_Guide_X12_H12.pdf. Check Error Log 1.

  • Page 101: Uefi Bios Recovery

    Warning: Do not upgrade the BIOS unless your system has a BIOS-related issue. Flashing the wrong BIOS can cause irreparable damage to the system. In no event shall Supermicro be liable for direct, indirect, special, incidental, or consequential damages arising from a BIOS update.
  • Page 102 USB device or a writable CD/DVD. Note 1: If you cannot locate the "Super.ROM" file in your drive disk, visit our website at www.supermicro.com to download the BIOS package. Extract the BIOS binary image into a USB flash device and rename it "Super.ROM" for the BIOS recovery use.
  • Page 103 Chapter 7: Troubleshooting and Support Note: At this point, you may decide if you want to start the BIOS recovery. If you decide to proceed with BIOS recovery, follow the procedures below. 4. When the screen as shown above displays, use the arrow keys to select the item "Proceed with flash update"...
  • Page 104 Chapter 7: Troubleshooting and Support 7. Press <Del> continuously during system boot to enter the BIOS Setup utility. From the top of the tool bar, select Boot to enter the submenu. From the submenu list, select Boot Option #1 as shown below. Then, set Boot Option #1 to [UEFI AP:UEFI: Built-in EFI Shell]. Press <F4>...
  • Page 105 Chapter 7: Troubleshooting and Support Note: Do not interrupt this process until the BIOS flashing is complete. 9. The screen above indicates that the BIOS update process is complete. When you see the screen above, unplug the AC power cable from the power supply, clear CMOS, and plug the AC power cable in the power supply again to power on the system.

  • Page 106: Cmos Clear

    Chapter 7: Troubleshooting and Support 7.7 CMOS Clear JBT1 is used to clear CMOS, which will also clear any passwords. Instead of pins, this jumper consists of contact pads to prevent accidentally clearing the contents of CMOS. To Clear CMOS 1.

  • Page 107: Where To Get Replacement Components

    7.9 Where to Get Replacement Components If you need replacement parts for your system, to ensure the highest level of professional service and technical support, purchase exclusively from our Supermicro Authorized Distributors/System Integrators/Resellers. A list can be found at: http://www.supermicro.com.

  • Page 108: Vendor Support Filing System

    For issues related to Red Hat Enterprise Linux, since it is a subscription based OS, contact your account representative. 7.11 Feedback Supermicro values your feedback as we strive to improve our customer experience in all facets of our business. Please email us at techwriterteam@supermicro.com to provide feedback on our manuals.

  • Page 109: Contacting Supermicro

    Chapter 7: Troubleshooting and Support 7.12 Contacting Supermicro Headquarters Address: Super Micro Computer, Inc. 980 Rock Ave. San Jose, CA 95131 U.S.A. Tel: +1 (408) 503-8000 Fax: +1 (408) 503-8008 Email: marketing@supermicro.com (General Information) support@supermicro.com (Technical Support) Website: www.supermicro.com Europe Address: Super Micro Computer B.V.

  • Page 110: Appendix A Standardized Warning Statements For Ac Systems

    Supermicro's Technical Support department for assistance. Only certified technicians should attempt to install or configure components. Read this appendix in its entirety before installing or configuring components in the Supermicro chassis. These warnings may also be found on our website at http://www.supermicro.com/about/...
  • Page 111 Appendix A: Warning Statements Warnung WICHTIGE SICHERHEITSHINWEISE Dieses Warnsymbol bedeutet Gefahr. Sie befinden sich in einer Situation, die zu Verletzungen führen kann. Machen Sie sich vor der Arbeit mit Geräten mit den Gefahren elektrischer Schaltungen und den üblichen Verfahren zur Vorbeugung vor Unfällen vertraut. Suchen Sie mit der am Ende jeder Warnung angegebenen Anweisungsnummer nach der jeweiligen Übersetzung in den übersetzten Sicherheitshinweisen, die zusammen mit diesem Gerät ausgeliefert wurden.
  • Page 112 Appendix A: Warning Statements . ٌ ‫ا ك ً ف حالة و ٌ يك أى تتسبب ف اصابة جسذ ة ٌ هذا الزهز ع ٌ خطز !تحذ ز‬ ‫قبل أى تعول عىل أي هعذات،يك عىل علن بالوخاطز ال ا ٌجوة عي الذوائز‬ ٍ...
  • Page 113 Appendix A: Warning Statements Warnung Vor dem Anschließen des Systems an die Stromquelle die Installationsanweisungen lesen. ¡Advertencia! Lea las instrucciones de instalación antes de conectar el sistema a la red de alimentación. Attention Avant de brancher le système sur la source d'alimentation, consulter les directives d'installation. .‫יש...
  • Page 114 Appendix A: Warning Statements Warnung Dieses Produkt ist darauf angewiesen, dass im Gebäude ein Kurzschluss- bzw. Überstromschutz installiert ist. Stellen Sie sicher, dass der Nennwert der Schutzvorrichtung nicht mehr als: 250 V, 20 A beträgt. ¡Advertencia! Este equipo utiliza el sistema de protección contra cortocircuitos (o sobrecorrientes) del edificio.
  • Page 115 Appendix A: Warning Statements Power Disconnection Warning Warning! The system must be disconnected from all sources of power and the power cord removed from the power supply module(s) before accessing the chassis interior to install or remove system components. 電源切断の警告 システムコンポーネントの取り付けまたは取り外しのために、...
  • Page 116 Appendix A: Warning Statements ‫אזהרה מפני ניתוק חשמלי‬ ‫!אזהרה‬ ‫יש לנתק את המערכת מכל מקורות החשמל ויש להסיר את כבל החשמלי מהספק‬ ‫.לפני גישה לחלק הפנימי של המארז לצורך התקנת או הסרת רכיבים‬ ‫يجب فصم اننظاو من جميع مصادر انطاقت وإ ز انت سهك انكهرباء من وحدة امداد‬ ‫انطاقت...
  • Page 117 Appendix A: Warning Statements Equipment Installation Warning! Only trained and qualified personnel should be allowed to install, replace, or service this equipment. 機器の設置 トレーニングを受け認定された人だけがこの装置の設置、 交換、 またはサービスを許可されていま す。 警告 只有经过培训且具有资格的人员才能进行此设备的安装、更换和维修。 警告 只有經過受訓且具資格人員才可安裝、更換與維修此設備。 Warnung Das Installieren, Ersetzen oder Bedienen dieser Ausrüstung sollte nur geschultem, qualifiziertem Personal gestattet werden.
  • Page 118 Appendix A: Warning Statements Restricted Area Warning! This unit is intended for installation in restricted access areas. A restricted access area can be accessed only through the use of a special tool, lock and key, or other means of security. (This warning does not apply to workstations). アクセス制限区域...
  • Page 119 Appendix A: Warning Statements ‫אזור עם גישה מוגבלת‬ !‫אזהרה‬ ‫יש להתקין את היחידה באזורים שיש בהם הגבלת גישה. הגישה ניתנת בעזרת‬ (.‫'כלי אבטחה בלבד (מפתח, מנעול וכד‬ . ‫تخصيص هذه انىحذة نترك ب ُ ها ف مناطق محظورة تم‬ ‫، م َ كن انىصىل إن منطقت محظورة فقط من خالل استخذاو أداة خاصت‬ ‫أو...
  • Page 120 Appendix A: Warning Statements Warnung Bei Einsetzen einer falschen Batterie besteht Explosionsgefahr. Ersetzen Sie die Batterie nur durch den gleichen oder vom Hersteller empfohlenen Batterietyp. Entsorgen Sie die benutzten Batterien nach den Anweisungen des Herstellers. Attention Danger d'explosion si la pile n'est pas remplacée correctement. Ne la remplacer que par une pile de type semblable ou équivalent, recommandée par le fabricant.
  • Page 121 Appendix A: Warning Statements Redundant Power Supplies Warning! This unit might have more than one power supply connection. All connec- tions must be removed to de-energize the unit. 冗長電源装置 このユニッ トは複数の電源装置が接続されている場合があります。 ユニッ トの電源を切るためには、 すべての接続を取り外さなければなりません。 警告 此部件连接的电源可能不止一个，必须将所有电源断开才能停止给该部件供电。 警告 此裝置連接的電源可能不只一個，必須切斷所有電源才能停止對該裝置的供電。 Warnung Dieses Gerät kann mehr als eine Stromzufuhr haben. Um sicherzustellen, dass der Einheit kein trom zugeführt wird, müssen alle Verbindungen entfernt werden.
  • Page 122 Appendix A: Warning Statements ‫אם קיים יותר מספק אחד‬ !‫אזהרה‬ ‫ליחדה יש יותר מחיבור אחד של ספק. יש להסיר את כל החיבורים על מנת לרוקן‬ .‫את היחידה‬ . ‫قد يكون لهذا الجهاز عدة اتصاالت بوحدات امداد الطاقة‬ ‫يجب إ ز الة كافة االتصاالت لعسل الوحدة عن الكهرباء‬ 경고! 이...
  • Page 123 Appendix A: Warning Statements Warnung Wenn das System in Betrieb ist, treten auf der Rückwandplatine gefährliche Spannungen oder Energien auf. Vorsicht bei der Wartung. ¡Advertencia! Cuando el sistema está en funcionamiento, el voltaje del plano trasero es peligroso. Tenga cuidado cuando lo revise. Attention Lorsque le système est en fonctionnement, des tensions électriques circulent sur le fond de panier.
  • Page 124 Appendix A: Warning Statements Comply with Local and National Electrical Codes Warning! Installation of the equipment must comply with local and national electrical codes. 地方および国の電気規格に準拠 機器の取り付けはその地方および国の電気規格に準拠する必要があります。 警告 设备安装必须符合本地与本国电气法规。 警告 設備安裝必須符合本地與本國電氣法規。 Warnung Die Installation der Geräte muss den Sicherheitsstandards entsprechen. ¡Advertencia! La instalacion del equipo debe cumplir con las normas de electricidad locales y nacionales.
  • Page 125 Appendix A: Warning Statements Product Disposal Warning! Ultimate disposal of this product should be handled according to all national laws and regulations. 製品の廃棄 この製品を廃棄処分する場合、 国の関係する全ての法律 ・ 条例に従い処理する必要があります。 警告 本产品的废弃处理应根据所有国家的法律和规章进行。 警告 本產品的廢棄處理應根據所有國家的法律和規章進行。 Warnung Die Entsorgung dieses Produkts sollte gemäß allen Bestimmungen und Gesetzen des Landes erfolgen.
  • Page 126 Appendix A: Warning Statements Hot Swap Fan Warning Warning! Hazardous moving parts. Keep away from moving fan blades. The fans might still be turning when you remove the fan assembly from the chassis. Keep fingers, screwdrivers, and other objects away from the openings in the fan assembly's housing. ファン...
  • Page 127 Electrical Appliance and Material Safety Law prohibits the use of UL or CSA -certified cables (that have UL/CSA shown on the cord) for any other electrical devices than products designated by Supermicro only. 電源コードとACアダプター...
  • Page 128 Verbindungskabeln, Stromkabeln und/oder Adapater, die Ihre örtlichen Sicherheitsstandards einhalten. Der Gebrauch von anderen Kabeln und Adapter können Fehlfunktionen oder Feuer verursachen. Die Richtlinien untersagen das Nutzen von UL oder CAS zertifizierten Kabeln (mit UL/CSA gekennzeichnet), an Geräten oder Produkten die nicht mit Supermicro gekennzeichnet sind. ¡Advertencia! Cuando instale el producto, utilice la conexión provista o designada o procure cables, Cables...
  • Page 129 ‫.قيرح وأ لطع يف ببستي دق ىرخأ تالوحمو تالباك يأ مادختسا .ميلسلا سباقلاو لصوملا مجح‬ ‫ لبق نم ةدمتعملا تالباكلا مادختسا تادعملاو ةيئابرهكلا ةزهجألل ةمالسلا نوناق رظحي‬UL ‫ وأ‬CSA ‫( ةمالع لمحت يتلاو‬UL/CSA) ‫ لبق نم ةددحملاو ةينعملا تاجتنملا ريغ ىرخأ تادعم يأ عم‬Supermicro. 전원 케이블 및 AC 어댑터...

  • Page 130: Appendix B System Specifications

    Appendix B: System Specifications Appendix B System Specifications Processors Dual 3rd Gen Intel Xeon Scalable processors in P+ (LGA-4189) sockets with up to 40 cores and a thermal design power (TDP) of up to 270W Chipset Intel PCH C621A BIOS AMI BIOS, ACPI 3.0 or later, PCI firmware 4.0 support, BIOS rescue hot-key, SPI dual/quad speed support, RTC (Real Time Clock) wakeup, and SMBIOS 3.0 or later Memory...
  • Page 131 Appendix B: System Specifications Certified Safety Models Compliant with UL or CSA: LA26TS-R12X12, LA26-12, LA26TS-12 Regulatory Compliance FCC, ICES, CE, VCCI, RCM, UKCA, NRTL, CB Applied Directives, Standards EMC/EMI: 2014/30/EU (EMC Directive) Electromagnetic Compatibility Regulations 2016 FCC Part 15 Subpart B ICES-003 VCCI-CISPR 32 AS/NZS CISPR 32...

Table of Contents