Page 2
State of California, USA. The State of California, County of Santa Clara shall be the exclusive venue for the resolution of any such disputes. Supermicro's total liability for all claims will not exceed the price paid for the hardware product.
Page 3
If you have any questions, please contact our support team at: support@supermicro.com This manual may be periodically updated without notice. Please check the Supermicro website for possible updates to the manual revision level. Secure Data Deletion A secure data deletion tool designed to fully erase all data from storage devices can be found on our website: https://www.supermicro.com/about/policies/disclaimer.cfm?url=/wdl/utility/...
Preface Contents Chapter 1 Introduction 1.1 Overview ..........................9 1.2 System Features ........................10 Front View .........................10 Control Panel .........................11 Rear View ..........................12 1.3 System Architecture ......................14 Main Components ......................14 System Block Diagram ......................16 1.4 Motherboard Layout ......................17 Quick Reference Table ......................18 Chapter 2 Server Installation 2.1 Overview ..........................20 2.2 Unpacking the System .......................20...
Page 5
Preface Chapter 3 Maintenance and Component Installation 3.1 Removing Power .......................29 3.2 Accessing the System ......................30 Removing the Top Cover ....................30 Removing the Bezel ......................31 Installing the Bezel ......................31 3.3 Processor and Heatsink Installation ...................32 CPU Carrier ........................33 Installation Overview ......................33 Removal Overview ......................33 Creating the Processor Carrier Assembly .................34 Creating the PHM ......................38...
Page 6
Preface Chapter 4 Motherboard Connections 4.1 Power Connections ......................62 4.2 Headers and Connectors ....................63 Control Panel .........................65 4.3 Input/Output Ports ......................69 I/O Ports.........................69 4.4 Jumpers ..........................71 4.5 LED Indicators ........................73 4.6 Storage Ports ........................74 Chapter 5 Software 5.1 Microsoft Windows OS Installation ..................76 5.2 Driver Installation ........................78 5.3 SuperDoctor 5 ........................79...
Page 7
Preface Hot-unplug ........................98 Hot-plug .........................98 Related Information Links ....................98 Chapter 7 Troubleshooting and Support 7.1 Information Resources .......................99 Website ..........................99 Direct Links for the SYS-121H-TNR System ..............99 Direct Links for General Support and Information ............99 7.2 Baseboard Management Controller (BMC) ..............100 7.3 Troubleshooting Procedures ...................101 General Technique ......................101 No Power ........................101...
1U Rackmount 1.7 x 17.2 x 29.3in. / 43 x 437 x 746mm (HxWxD) Notes: A Quick Reference Guide can be found on the product page of the Supermicro website. The following safety models associated with the SYS-121H-TNR have been certified as compliant with UL or CSA: HS119-R12X13, HS119-R16X13, HS119-R20X13, HS119-R26X13, HS119-R13DX13, HS119-R16DX13, HS119-12, HS119-16, HS119-20, HS119-26, HS119-13D, HS119-16D.
Chapter 1: Introduction 1.2 System Features The following views of the system display the main features. Refer to Appendix B for additional specifications. Front View Control Panel USB Port Service/Asset Tag Storage I/O Bay with BMC Password Figure 1-1. Front View System Features: Front Feature Description...
Chapter 1: Introduction Control Panel Information LED U I D B u t t o n / NIC LED Power LED Power BMC Reset Figure 1-2. Control Panel Control Panel Features Feature Description The unit identification (UID) button turns on or off the blue light function of the Information UID button/ LED.
Chapter 1: Introduction Rear View USB Ports VGA Port BMC LAN Power Supplies Figure 1-3. System: Rear View System Features: Rear Feature Description Power Supplies Two redundant power supply modules, PWS1 on the left, PWS2 on the right Two USB 2.0 ports BMC LAN Port One RJ45 dedicated BMC LAN port VGA Port...
Page 13
Chapter 1: Introduction Power Supply Indicators Power Supply Condition Green LED Amber LED No AC Power to Power Supply Power Supply critical events causing a shutdown/ failure/ OCP/ OVP/ Fan Fail/ Amber LED OTP/ UVP Power Supply Warning Events Where the power supply continues to operate;...
Chapter 1: Introduction 1.3 System Architecture This section covers the locations of the system's main components and a system block diagram. Main Components IO Mezzanine Board Slot 1 Riser Cage Power Supply Modules Slot 2-3 Riser Cage Dual Processors DIMM Slots System Fans Backplane Asset Tag...
Page 15
Chapter 1: Introduction System Features: Top Feature Description Power Supply Dual redundant modules, PWS-1K24A-1R DIMM slots 32 DIMM memory slots Processors Dual Intel Xeon® Scalable Processors with heatsinks, SNK-P0087V System Fans Eight 4-cm dual counter-rotating PWM fans, FAN-0216L4-1 Pull Tag Pull tag with serial number / BMC ADMIN password Backplane Eight SAS3/SATA3/NVMe4 storage device backplane, BPN-NVME5-HS119N-S8L...
Chapter 1: Introduction System Block Diagram The block diagram below shows the connections and relationships between the subsystems and major components of the overall system. Rear PCI-E Slots 2-3 RSC-H-66G5L Rear PCI-E Slot 1 Rear AIOM Slot A1 RSC-H-6G5L CBL-GNZ5-1307 Optional P2_PE1 15-0 (JPCIE4)
Chapter 1: Introduction 1.4 Motherboard Layout Below is a layout of the X13DEM motherboard with a jumper, connector, and LED locations shown. See the table on the following page for descriptions. For detailed descriptions, pinout information, and jumper settings, refer to Chapter 4 or the Motherboard Manual.
FAN1-FAN8, FAN9/ Eight 6-pin cooling fan headers (FAN1~FAN 8) and two 4-pin cooling fan headers FAN10 (FAN9-FAN10) Supermicro Advanced Input/Output Module (AIOM) PCIe 5.0 x16 connector for rear JAIOM1 (P1_PE0 15-0) I/O support JAIOM2SB1 Supermicro Advanced Input/Output Module (AIOM2) sideband connector JFP1 Front Control Panel header with I²C...
Page 19
Chapter 1: Introduction Mounting holes for built-in thumbscrews used to securely attach the motherboard to MH1/MH9 the chassis (Refer to page 14 for mounting hole detailed information.) MH2/MH3/MH4/MH5/ Mounting holes for T-pins used to help lock the motherboard to the proper location in MH10/MH11/MH12 the chassis (Refer to page 14 for mounting hole detailed information.) Mounting holes for standoffs used for heatsink support (Refer to page 14 for mounting...
Chapter 2: Server Installation Chapter 2 Server Installation 2.1 Overview This chapter provides advice and instructions for mounting your system in a server rack. If your system is not already fully integrated with processors, system memory, etc., refer to Chapter 3 for details on installing those specific components.
Chapter 2: Server Installation • This product is not suitable for use with visual display workplace devices according to §2 of the German Ordinance for Work with Visual Display Units. Rack Precautions • Ensure that the leveling jacks on the bottom of the rack are extended to the floor so that the full weight of the rack rests on them.
Chapter 2: Server Installation Airflow Equipment should be mounted into a rack so that the amount of airflow required for safe operation is not compromised. Mechanical Loading Equipment should be mounted into a rack so that a hazardous condition does not arise due to uneven mechanical loading.
Chapter 2: Server Installation 2.4 Installing the Rails This section provides information on installing the chassis into a rack unit with the rails provided. There are a variety of rack units on the market, which may mean that the assembly procedure will differ slightly from the instructions provided.
Chapter 2: Server Installation Releasing the Inner Rail Each inner rail has a locking latch. This latch prevents the chassis from coming completely out of the rack when the chassis is pulled out for servicing. To mount the rail onto the chassis, first release the inner rail from the outer rails. 1.
Chapter 2: Server Installation Installing the Inner Rails Begin the rack mounting procedure by installing the inner rails to the chassis. 1. Identify the left and right inner rails. They are labeled. 2. Place the inner rail firmly against the side of the chassis, aligning the hooks on the side of the chassis with the holes in the inner rail.
Chapter 2: Server Installation Installing the Outer Rails onto the Rack Installing the Outer Rails 1. Press upward on the locking tab at the rear end of the middle rail. 2. Push the middle rail back into the outer rail. 3.
Chapter 2: Server Installation 2.5 Installing the Chassis into a Rack Once rails are attached to the chassis and the rack, you can install the chassis. 1. Pull the middle rail out of the front of the outer rail and make sure that the ball bearing shuttle is locked at the front of the middle rail.
Chapter 2: Server Installation Removing the Chassis from the Rack Caution! It is dangerous for a single person to off-load the heavy chassis from the rack without assistance. Be sure to have sufficient assistance supporting the chassis when removing it from the rack.
Chapter 3: Maintenance and Component Installation Chapter 3 Maintenance and Component Installation This chapter provides instructions on installing and replacing main system components. To prevent compatibility issues, only use components that match the specifications and/or part numbers given. Installation or replacement of most components requires that power first be removed from the system.
Chapter 3: Maintenance and Component Installation 3.2 Accessing the System The CSE-HS119-R1K24P2 chassis features a removable top cover, which allows easy access to the inside of the chassis. Removing the Top Cover 1. Press the release button and slide the cover toward the rear. 2.
Chapter 3: Maintenance and Component Installation Figure 3-2. Front Bezel Removing the Bezel 1. Unlock the bezel with a key. 2. Press the red release lever and remove the bezel from the chassis. Installing the Bezel 1. Align the bezel with the pins at the left of the chassis. 2.
Thermal grease is pre-applied on a new heatsink. No additional thermal grease is needed. • Refer to the Supermicro website for updates on processor and memory support. • All graphics in this manual are for illustrations only. Your components may look different.
Chapter 3: Maintenance and Component Installation CPU Carrier The following CPU carrier has been successfully tested in our labs and is available from Supermicro. Please order the CPU carrier with the CPU heatsink. XCC carrier SKT-1333L-0000-FXC MCC carrier SKT-1424L-001B-FXC HBM carrier...
Chapter 3: Maintenance and Component Installation Creating the Processor Carrier Assembly Process Carrier Assembly 1. Hold the processor with the gold pins (LGA lands) facing down. Locate the gold triangle at the corner of the processor and the corresponding hollowed triangle on the processor carrier as shown below.
Page 35
Chapter 3: Maintenance and Component Installation 2. Turn the processor over (with the gold pins up). Locate the CPU keys on the processor and the four latches on the carrier as shown below. SP XCC Latch CPU Key Latch CPU Key Latch Latch CPU Key...
Page 36
Chapter 3: Maintenance and Component Installation 3. Locate the lever on the CPU socket and press it down as shown below. Lever Lever Carrier E1B Carrier E1A 4. Using Pin 1 as a guide, carefully align the CPU keys (A and B) on the processor against the CPU keys on the carrier (a and b) as shown in the drawing below.
Page 37
Chapter 3: Maintenance and Component Installation 6. After the processor is placed inside the carrier, examine the four sides of the processor, making sure that the processor is properly seated on the carrier. SP XCC (Top View) (Component View) CPU Carrier Assembly (Top View) (Component View) CPU Carrier Assembly...
Chapter 3: Maintenance and Component Installation Creating the PHM After creating the processor carrier assembly, please follow the instructions below to mount the processor carrier into the heatsink to form the PHM. Note: If this is a new heatsink, the thermal grease has been pre-applied on the un- derside.
Page 39
Chapter 3: Maintenance and Component Installation CPU Carrier Assembly (CPU Component Side and Heatsink Bottom Side) SP XCC Pin 1 Pin 1 SP MCC Pin 1 Processor Heatsink Module (PHM)
Chapter 3: Maintenance and Component Installation Preparing the CPU Socket for Installation This motherboard comes with a plastic protective cover installed on the CPU socket. Remove it from the socket by following the instructions below: 1. Press the tabs inward. 2.
Chapter 3: Maintenance and Component Installation Installing the PHM into the CPU Socket 1. Locate four threaded fasteners (a, b, c, d) on the CPU socket. 2. Align PEEK nut A, which is next to the triangle (Pin 1) on the heatsink, against threaded fastener a on the CPU socket.
Chapter 3: Maintenance and Component Installation Removing the PHM from the CPU Socket Before removing the PHM from the motherboard, be sure to shut down the system and unplug the power cables from the power supply. Then follow the steps below: 1.
Chapter 3: Maintenance and Component Installation Removing the Processor Carrier Assembly from the PHM To remove the processor carrier assembly from the PHM, please follow the steps below: 1. Detach the four plastic clips (marked a, b, c, d) on the processor carrier assembly from the four corners of the heatsink (marked A, B, C, D) as shown in the drawings below.
Chapter 3: Maintenance and Component Installation Removing the Processor from the Processor Carrier Assembly Once you have removed the processor carrier assembly from the PHM, you are ready to remove the processor from the processor carrier by following the steps below. 1.
Chapter 3: Maintenance and Component Installation 3.4 Memory Support and Installation Note: Check the Supermicro website for recommended memory modules. Important: Exercise extreme care when installing or removing memory modules to prevent any possible damage. Memory Support This motherboard supports up to 8TB of 3DS RDIMM/RDIMM DDR5 (288-pin) memory with speeds up to 4800MT/s.
Page 46
2 CPUs & 24 DIMMs DIMME1/P1-DIMME2/P1-DIMMF1/P1-DIMMF2/P1-DIMMG1/P1-DIMMG2/P1-DIMMH1/P1-DIMMH2 CPU2: P2-DIMMA1/P2-DIMMB1/P2-DIMMC1/P2-DIMMD1/P2-DIMME1/P2-DIMMF1/P2-DIMMG1/P2-DIMMH1 CPU1: P1-DIMMA1/P1-DIMMA2/P1-DIMMB1/P1-DIMMB2/P1-DIMMC1/P1-DIMMC2/P1-DIMMD1/P1-DIMMD2/P1- DIMME1/P1-DIMME2/P1-DIMMF1/P1-DIMMF2/P1-DIMMG1/P1-DIMMG2/P1-DIMMH1/P1-DIMMH2 2 CPUs & 32 DIMMs CPU2: P2-DIMMA1/P2-DIMMA2/P2-DIMMB1/P2-DIMMB2/P2-DIMMC1/P2-DIMMC2/P2-DIMMD1/P2-DIMMD2/P2- DIMME1/P2-DIMME2/P2-DIMMF1/P2-DIMMF2/P2-DIMMG1/P2-DIMMG2/P2-DIMMH1/P2-DIMMH2 Note: This memory configuration is recommended by Supermicro for optimal memory performance. Please use this configuration to maximize your memory performance.
Page 47
Chapter 3: Maintenance and Component Installation DDR5 Memory Population Table (with Max Series ((HBM)) CPUs and 32 DIMMs Installed) 1 CPU: Memory Population Sequence P1-DIMMA1 1 CPU & 1 DIMM P1-DIMME1 P1-DIMMA1/P1-DIMMG1 1 CPU & 2 DIMMs P1-DIMMC1/P1-DIMME1 1 CPU & 4 DIMMs P1-DIMMA1/P1-DIMMC1/P1-DIMME1/P1-DIMMG1 1 CPU &...
Page 48
Chapter 3: Maintenance and Component Installation Pin 1 CPU1 Pin 1 CPU2 Memory Population on X13DP Motherboards with 32 DIMMs Installed Note: All graphics shown in this user document are for illustration only. The components installed in your system may look different from the graphics shown here.
Chapter 3: Maintenance and Component Installation DIMM Installation 1. Insert the desired number of DIMMs into the slots based on the recommended DIMM population tables shown above. 2. Push the release tabs on both ends of the DIMM slot outwards to unlock it. 3.
Chapter 3: Maintenance and Component Installation 3.5 Motherboard Battery The motherboard uses non-volatile memory to retain system information when system power is removed. This memory is powered by a lithium battery residing on the motherboard. Replacing the Battery Begin by removing power from the system.
Chapter 3: Maintenance and Component Installation 3.6 Storage Drives The storage drives are mounted in tool-less drive carriers that simplify their removal from the chassis. These carriers also help promote proper airflow. For compatible storage drives, see SYS-121H-TNR product page. Installing Drives Figure 3-4.
Page 52
Chapter 3: Maintenance and Component Installation Installing a Drive 1. Position the drive above the carrier with the PCB side facing down and the connector end toward the rear of the carrier. 2. Tilt the drive to insert it onto the two posts on the right inside of the carrier. Locking Clasps Post Figure 3-6.
Chapter 3: Maintenance and Component Installation Hot-Swap for NVMe Drives Supermicro servers support NVMe surprise hot-swap. For even better data security, NVMe orderly hot-swap is recommended. NVMe drives can be ejected and replaced remotely using BMC. Note: If you are using VROC, see the VROC appendix in this manual instead.
Chapter 3: Maintenance and Component Installation 3.7 System Cooling Fans Eight 4-cm heavy-duty fans provide cooling for the system. Fans are hot-swapped and can be replaced without powering down the system. The electrical connections are automatically made when a fan is inserted into its slot. Make sure the chassis cover is only off for a short time and makes a good seal when replaced for the cooling air to circulate properly through the system.
Chapter 3: Maintenance and Component Installation Air Shrouds Air shrouds concentrate airflow to maximize fan efficiency. The SYS-121H-TNR includes one air shroud for each CPU. Air Shroud for Memory (CPU1/2) Two air shrouds cool the DIMM slots controlled by CPUs 1 and 2 (see figure below). 1.
Chapter 3: Maintenance and Component Installation 3.8 Expansion Cards The SYS-121H-TNR includes two riser cards to support the use of expansion (add-on) cards. Figure 3-10. Expansion Card Chassis Slots Riser Cards This system include riser cards that provide PCIe capabilities. PCIe Slots per Riser Card Riser Card Part Number...
Page 57
Chapter 3: Maintenance and Component Installation Before following the procedure below to install expansion cards, first turn off and remove power from the system as described in section 3.1 then remove the top cover. Installing Expansion Cards 1. Open any clips next to the slots and remove the PCI shield. 2.
Chapter 3: Maintenance and Component Installation Installing M.2 Solid State Drives on Motherboard The X13DEM motherboard has two hybrid PCIe 3.0 and NVMe or SATA M.2 slots (M.2-H1, M.2-H2). M.2 allows for a variety of card sizes, increased functionality, and spatial efficiency. The M.2 slot on the motherboard supports PCIe 3.0 x2 or SATA 3.0 devices in the 2280 and 22110 form factors.
Up to 15W OCP 3.0 Note: AIOM cards exceeding the 15W slot power envelope may require restricted conditions to meet thermal specifications of the AIOM card. Contact your Supermicro account representative for more information. Figure 3-13. AIOM Chassis Slot Installing AIOM 1.
Failed power supply modules can be replaced without powering down the system. Replacement modules can be ordered directly from Supermicro. An amber light on the power supply is illuminated when the power is switched off. A green light indicates that the power supply is operating.
Description CPU1: P1-DIMMA1/P1-DIMMG1, CPU2: P2-DIMMA1/P2-DIMMG1 components, refer to the diagrams so you can reroute them in the same manner. BMC card) reset by the Supermicro IPMICFG tool. 2 CPUs & 4 DIMMs CPU1: P1-DIMMC1/P1-DIMME1, CPU2: P2-DIMMC1/P2-DIMME1 (Unlatched) (Latched) USB 3.0 Port...
Chapter 4: Motherboard Connections Chapter 4 Motherboard Connections This section describes the connections on the motherboard and provides pinout definitions. Note that depending on how the system is configured, not all connections are required. The LEDs on the motherboard are also described here. A motherboard layout indicating component locations may be found in Chapter 1.
The JTPM1 header is used to connect a Trusted Platform Module (TPM)/Port 80, which is available from Supermicro (optional). A TPM/Port 80 connector is a security device that supports encryption and authentication in hard drives. It allows the motherboard to deny access if the TPM associated with the hard drive is not installed in the system.
Page 64
Chapter 4: Motherboard Connections Chassis Intrusion A Chassis Intrusion header is located at JL1 on the motherboard. Attach the appropriate cable from the chassis to inform you when the chassis is opened. Refer to the table below for pin definitions. Chassis Intrusion Pin Definitions Pin#...
These connectors are designed specifically for use with Supermicro chassis. See the figure below for the descriptions of the front control panel buttons and LED indicators.
Page 66
Chapter 4: Motherboard Connections Power On and BMC/BIOS Status LED Button The Power On and BMC/BIOS Status LED button is located on Pin 1 of the front control panel header located at JFP1. Momentarily contacting Pin 1 of JFP1 will power on/off the system or display BMC/BIOS status.
Page 67
Chapter 4: Motherboard Connections LAN1/LAN2 (NIC1/NIC2) The NIC (Network Interface Controller) LED connection for LAN Port 1 is located on Pin 6 of JFP1, and LAN Port 2 is on Pin 5. Refer to the table below. LAN1/LAN2 LED LED States Color State NIC 2: Blinking green...
Page 68
Chapter 4: Motherboard Connections Power Fail LED Indicators Power Failure LED Indicators are located on Pin 15 and Pin 19 of JFP1. Refer to the table below for pin definitions. FP Power LED Pin Definitions (JFP1) Pin# Definition PWR Failure LED-Positive PWR Failure LED-Negative FP USB Power Front Panel USB power connections are located on Pin 16 ~ Pin 18 of JFP1 to provide power...
Chapter 4: Motherboard Connections 4.3 Input/Output Ports I/O Ports The low-profile slimSAS I/O connector, located at JIO1, is used to connect the motherboard to an I/O mezzanine board, AOM-HS119-IO, to provide VGA/COM/BMC/USB connections. I/O Ports from AOM-HS119-IO Description BMC_LAN Port USB 0 (2.0) USB 1 (2.0) VGA Port...
Page 70
JAIOM1 on the motherboard. This AIOM slot provides support for AIOM sideband connections. Advanced I/O Module (AIOM) for Rear I/O Support (JAIOM1) An Supermicro proprietary Advanced I/O Module (AIOM) connector used for a PCIe 5.0 x16 add-on module is located at JAIOM1. This AIOM connector (P1_PE0 15-0), supported by CPU1, provides input/output connections on the rear side of your system.
Chapter 4: Motherboard Connections 4.4 Jumpers Explanation of Jumpers To modify the operation of the motherboard, jumpers can be used to choose between optional settings. Jumpers create shorts between two pins to change the function of the connector. Pin 1 is identified with a square solder pad on the printed circuit board. See the diagram below for an example of jumping pins 1 and 2.
Page 72
Chapter 4: Motherboard Connections BMC and PCH I²C/SDA to VRM/BMC and PCH I²C/SCl to VRM Select Jumper Use jumper JVRM1 to select between BMC and PCH I²C/SDA for VRM support or BMC and PCH I²C/SCl for VRM support. Connect a cable to JVRM1 to enable BMC and PCH I²C/SDA for VRM support.
Chapter 4: Motherboard Connections 4.5 LED Indicators BMC LAN LEDs A dedicated BMC LAN connection is provided on the low-profile Slim SAS I/O connector (JIO1) located on the rear side of the motherboard. The LED on the right indicates activity, and the LED on the left indicates the speed of the connection.
C) header (JNVI2C1), used for PCIe SMBus clock and data connections, provides hot-plug support via a dedicated SMBus interface. This feature is only available for a Supermicro complete system with an Supermicro proprietary NVMe add-on card and a proper cable installed. See the table below for pin definitions.
Page 75
Chapter 4: Motherboard Connections NVMe VPP Bus Connector A NVMe VPP Bus connector is located at JNVVPP1 on the motherboard. The NVMe VPP connector provides hot plug support for the NVMe devices, which will allow the user to replace NVMe devices without shutting down and powering off the system. PCIe 3.0 M.2-H1/M.2-H2 Slots Two PCIe 3.0/SATA3 Hybrid M.2 slots are located at M.2-H1 and M.2-H2 on the motherboard.
1. Create a method to access the Microsoft Windows installation ISO file. That can be a USB flash or media drive. 2. Retrieve the proper RST/RSTe driver. Go to the Supermicro web page for your motherboard and click on "Download the Latest Drivers and Utilities", select the proper driver, and copy it to a USB flash drive.
Page 77
Chapter 5: Software 4. During Windows Setup, continue to the dialog where you select the drives on which to install Windows. If the disk you want to use is not listed, click on “Load driver” link at the bottom left corner. Figure 5-2.
Chapter 5: Software 5.2 Driver Installation The Supermicro website contains drivers and utilities for your system at https:// www. supermicro. com/wdl/driver. Some of these must be installed, such as the chipset driver. After accessing the website, go into the CDR_Images (in the parent directory of the above link) and locate the ISO file for your motherboard.
5.3 SuperDoctor ® The Supermicro SuperDoctor 5 is a program that functions in a command-line or web-based interface for Windows and Linux operating systems. The program monitors such system health information as CPU temperature, system voltages, system power consumption, fan speed, and provides alerts via email or Simple Network Management Protocol (SNMP).
This can be found on a sticker on the chassis and a sticker on the motherboard. The sticker also displays the BMC MAC address. If necessary, the password can be reset using the Supermicro IPMICFG tool. Figure 5-5. BMC Password Label The sticker can be found on the pull-out service tag at the front of the chassis.
Chapter 6: Optional Components Chapter 6 Optional Components This chapter describes alternate configurations and optional system components. Optional Parts Storage drive options Power options Cable Management Arm TPM security module Intel VROC RAID Key 6.1 Storage Drive Options The storage drive bays can support SATA, SAS, and NVMe in any combination. To enable SAS, SATA, and NVMe, additional hardware is required.
Chapter 6: Optional Components 6.3 Configuration Ordering Information 8 Drive Bay Configurations The following details show the possible configurations and the part numbers of the cables required. 8 NVMe Drive Bay Number Drive Type Part Numbers CBL-MCIO-1216M5FD1 Drive Bays 0-3 NVMe (CPU1) CBL-MCIO-1220M5FD2 CBL-MCIO-1244M5FD3 Drive Bays 4-7 NVMe (CPU2) CBL-MCIO-1239M5FD4 8 SAS/SATA Drive Bay Number...
Chapter 6: Optional Components 12 Drive Bay Configurations The following details show the possible configurations and the part numbers of the cables required. 12 NVMe Drive Bay Number Drive Type Part Numbers MCP-220-00178-0B (x4) Drive Bays 0-3 NVMe (CPU1) BPN-NVME5-HS119N-S4R CBL-MCIO-1216M5FD1 CBL-MCIO-1220M5FD2 CBL-MCIO-1244M5FD3 Drive Bays 4-11 NVMe (CPU2) CBL-MCIO-1239M5FD4 CBL-MCIO-1233M5FF5...
Page 85
Chapter 6: Optional Components 8 SATA + 4 NVMe Drive Bay Number Drive Type Part Numbers MCP-220-00178-0B (x4) Drive Bays 0-7 SATA BPN-NVME5-HS119N-S4R CBL-MCIO-1233M5FF5 CBL-MCIO-1225M5FF6 CBL-SAST-1237LP-100 Drive Bays 8-11 NVMe (CPU2) CBL-PWEX-1136-40 CBL-CDAT-1062 LBL-0967-BULK 8 NVMe + 4 SAS/SATA Drive Bay Number Drive Type Part Numbers MCP-220-00178-0B (x4) Drive Bays 0-3 NVMe (CPU1)
Chapter 6: Optional Components 6.4 Power Supply Modules Power Supply Module Options Watts Part Number 80Plus Level 1200 PWS-1K24A-1R (default) Titanium 1600 PWS-1K63A-1R Titanium 2000 PWS-2K07A-1R Titanium 2600 PWS-2K63A-1R Titanium 6.5 Cable Management Arm The system supports a cable management arm (CMA), which keeps the rear cables organized and clear of the rail mechanisms when the system is extended out the front of the rack for maintenance.
Page 87
Chapter 6: Optional Components Figure 6-2. Installing the Connectors 3. Slide CMA connector #3 forward onto the two posts on the rear of the left middle rail. It snaps into place. 4. For CMA connector #4, align the metal tabs with the slots on the rear of the left outer rail and push it forward.
It enables the motherboard to deny access if the TPM associated with the hard drive is not installed in the system. Details and installation procedures are at: http://www.supermicro.com/manuals/other/TPM.pdf. • AOM-TPM-9670V •...
Chapter 6: Optional Components 6.7 Intel Virtual RAID on CPU (VROC) Intel Virtual RAID on CPU (Intel VROC) is an enterprise RAID solution for NVMe SSDs ® directly attached to Intel Xeon Scalable processors. Intel Volume Management Device (VMD) is an integrated controller inside the CPU PCIe root complex. •...
Chapter 6: Optional Components Additional Information Additional information is available on the product page for the Supermicro add-on card and the linked manuals. www.supermicro.com/products/accessories/addon/AOC-VROCxxxMOD.cfm Hardware Key The Intel VROC hardware key is a license key that detects the Intel VROC SKU and activates the function accordingly.
Chapter 6: Optional Components Configuring Intel VMD VMD must be enabled on PCIe ports which have NVMe drives attached to them in order for those drives to be added to a VROC RAID configuration. The default BIOS setting for the NVMe Mode Switch is Auto which automatically enables VMD on all installed NVMe drives. NVMe Mode Switch : •...
Page 92
Chapter 6: Optional Components This table identifies the NVMe Port Resources in the X13 Hyper servers. Enable VMD on the NVMe drive’s corresponding hardware stack according to the VMD BIOS Settings table. Intel VMD BIOS Settings for X13 Hyper Systems Model CPU1 NVMe Slots CPU2 NVMe Slots VMD Config for IOU 0: VMD Config for PCH ports: Socket 1 IOU0 port A...
Page 93
Chapter 6: Optional Components Intel VMD BIOS Settings for X13 Hyper Systems Model CPU1 NVMe Slots CPU2 NVMe Slots VMD Config for PCH ports: PCH Root Port 8 M.2 A,B PCH Root Port 9 VMD Config for IOU 3: SYS-621H-TN12R Socket 0 IOU3 port E NVMe 0,1. 4 NVMe Socket 0 IOU3 port G VMD Config for IOU 4:...
Page 94
Chapter 6: Optional Components Caution: VMD must only be enabled on NVMe port resources. If VMD is enabled on other PCIe ports, the functionality of those ports will be impacted. See the table below. 1. Select “Intel VMD for Volume Management Device on” on Socket 0 (CPU1) or Socket 2 (CPU2) to enable VMD for devices under the respective CPU.
Page 95
Chapter 6: Optional Components Figure 6-10. BIOS, Enabling VMD on Socket 1 (Example) 3. Enable the NVMe port resource according to table above for the NVMe drives that will be used in a RAID configuration. Figure 6-11. BIOS, Enabling Socket 1 (Example)
Page 96
Chapter 6: Optional Components 4. Choose whether to make the NVMe drives in this IOU Hot Plug Capable by selecting Enabled or Disabled. 5. Repeat steps 4 through 7 for each IOU # on each CPU to enable VMD on the desired NVMe ports.
Chapter 6: Optional Components Creating NVMe RAID Configurations 1. Open Advanced > Intel(R) Virtual RAID on CPU > All Intel VMD Controllers > Create RAID Volume. Figure 6-13. Created Volume without Figure 6-14. Created Volume with enabling RAID spanned over VMD enabling RAID spanned over VMD controller controller 2. Set Name. 3. Set RAID Level. 4. If cross-controller RAID is required, select Enable RAID spanned over VMD Controller. 5. Select specific disks for RAID with an [X]. • RAID0: Select at least two [2 - 24] disks •...
Chapter 6: Optional Components Status Indications An LED indicator on the drive carrier shows the RAID status of the drive. Drive Carrier Status LED Indicator Status State (red) Normal function Locating 4 Hz blink Fault Solid ON Rebuilding 1 Hz Blink IBPI SFF 8489 Defined Status LED States Hot-Swap Drives Intel VMD enables hot-plug and hot-unplug for NVMe SSDs, whether from Intel or other manufacturers.
Chapter 7: Troubleshooting and Support Chapter 7 Troubleshooting and Support 7.1 Information Resources Website A great deal of information is available on the Supermicro website, supermicro.com. Figure 7-1. Supermicro Website • Specifications for servers and other hardware are available by the Products option. •...
Security Center for recent security notices Supermicro Phone and Addresses 7.2 Baseboard Management Controller (BMC) The system supports the Baseboard Management Controller (BMC). BMC is used to provide remote access, monitoring and management. There are several BIOS settings that are related to BMC.
Chapter 7: Troubleshooting and Support 7.3 Troubleshooting Procedures Use the following procedures to troubleshoot your system. If you have followed all of the procedures below and still need assistance, refer to the Technical Support Procedures Returning Merchandise for Service section(s) in this chapter. Power down the system before changing any non hot-swap hardware components.
• Memory: Make sure that the memory modules are supported. Refer to the product page on our website at www.supermicro.com. Test the modules using memtest86 or a similar utility. • Storage drives: Make sure that all drives work properly. Replace if necessary.
Page 103
Also check the Control panel Overheat LED. • Adequate power supply: Make sure that the power supply provides adequate power to the system. Make sure that all power connectors are connected. Refer to the Supermicro website for the minimum power requirements. •...
In the event of a processor internal error (IERR) that crashes your system, you may want to provide information to support staff. You can download a crash dump of status information using BMC. The BMC manual is available at https://www.supermicro.com/manuals/other/ BMC_Users_Guide_X13.pdf. Check BMC Error Log 1.
Warning: Do not upgrade the BIOS unless your system has a BIOS-related issue. Flashing the wrong BIOS can cause irreparable damage to the system. In no event shall Supermicro be liable for direct, indirect, special, incidental, or consequential damages arising from a BIOS update.
Page 106
USB flash or media drive. Note 1: If you cannot locate the "Super.ROM" file in your drive disk, visit our website at www.supermicro.com to download the BIOS package. Extract the BIOS binary image into a USB flash device and rename it "Super.ROM" for the BIOS recovery use.
Page 107
Chapter 7: Troubleshooting and Support Note: At this point, you may decide if you want to start the BIOS recovery. If you decide to proceed with BIOS recovery, follow the procedures below. 4. When the screen as shown above displays, use the arrow keys to select the item "Proceed with flash update"...
Page 108
Chapter 7: Troubleshooting and Support 7. Press <Del> continuously during system boot to enter the BIOS Setup utility. From the top of the tool bar, select Boot to enter the submenu. From the submenu list, select Boot Option #1 as shown below. Then, set Boot Option #1 to [UEFI AP:UEFI: Built-in EFI Shell]. Press <F4>...
Page 109
Chapter 7: Troubleshooting and Support Note: Do not interrupt this process until the BIOS flashing is complete. 9. The screen above indicates that the BIOS update process is complete. When you see the screen above, unplug the AC power cable from the power supply, clear CMOS, and plug the AC power cable in the power supply again to power on the system.
Chapter 7: Troubleshooting and Support 7.6 CMOS Clear JBT1 is used to clear CMOS, which will also clear any passwords. Instead of pins, this jumper consists of contact pads to prevent accidentally clearing the contents of CMOS. To Clear CMOS 1.
7.7 Where to Get Replacement Components If you need replacement parts for your system, to ensure the highest level of professional service and technical support, purchase exclusively from our Supermicro Authorized Distributors/System Integrators/Resellers. A list can be found at: http://www.supermicro.com.
(http://www.supermicro.com/ support/rma/). Whenever possible, repack the chassis in the original Supermicro carton, using the original packaging material. If these are no longer available, be sure to pack the chassis securely, using packaging material to surround the chassis so that it does not shift within the carton and become damaged during shipping.
For issues related to Red Hat Enterprise Linux, since it is a subscription based OS, contact your account representative. 7.10 Feedback Supermicro values your feedback as we strive to improve our customer experience in all facets of our business. Please email us at techwriterteam@supermicro.com to provide feedback on our manuals.
Supermicro's Technical Support department for assistance. Only certified technicians should attempt to install or configure components. Read this appendix in its entirety before installing or configuring components in the Supermicro chassis. These warnings may also be found on our website at http://www.supermicro.com/about/...
Page 115
Appendix A: Warning Statements Warnung WICHTIGE SICHERHEITSHINWEISE Dieses Warnsymbol bedeutet Gefahr. Sie befinden sich in einer Situation, die zu Verletzungen führen kann. Machen Sie sich vor der Arbeit mit Geräten mit den Gefahren elektrischer Schaltungen und den üblichen Verfahren zur Vorbeugung vor Unfällen vertraut. Suchen Sie mit der am Ende jeder Warnung angegebenen Anweisungsnummer nach der jeweiligen Übersetzung in den übersetzten Sicherheitshinweisen, die zusammen mit diesem Gerät ausgeliefert wurden.
Page 116
Appendix A: Warning Statements . ٌ ا ك ً ف حالة و ٌ يك أى تتسبب ف اصابة جسذ ة ٌ هذا الزهز ع ٌ خطز !تحذ ز قبل أى تعول عىل أي هعذات،يك عىل علن بالوخاطز ال ا ٌجوة عي الذوائز ٍ...
Page 117
Appendix A: Warning Statements Warnung Vor dem Anschließen des Systems an die Stromquelle die Installationsanweisungen lesen. ¡Advertencia! Lea las instrucciones de instalación antes de conectar el sistema a la red de alimentación. Attention Avant de brancher le système sur la source d'alimentation, consulter les directives d'installation. .יש...
Page 118
Appendix A: Warning Statements Warnung Dieses Produkt ist darauf angewiesen, dass im Gebäude ein Kurzschluss- bzw. Überstromschutz installiert ist. Stellen Sie sicher, dass der Nennwert der Schutzvorrichtung nicht mehr als: 250 V, 20 A beträgt. ¡Advertencia! Este equipo utiliza el sistema de protección contra cortocircuitos (o sobrecorrientes) del edificio.
Page 119
Appendix A: Warning Statements Power Disconnection Warning Warning! The system must be disconnected from all sources of power and the power cord removed from the power supply module(s) before accessing the chassis interior to install or remove system components. 電源切断の警告 システムコンポーネントの取り付けまたは取り外しのために、...
Page 120
Appendix A: Warning Statements אזהרה מפני ניתוק חשמלי !אזהרה יש לנתק את המערכת מכל מקורות החשמל ויש להסיר את כבל החשמלי מהספק .לפני גישה לחלק הפנימי של המארז לצורך התקנת או הסרת רכיבים يجب فصم اننظاو من جميع مصادر انطاقت وإ ز انت سهك انكهرباء من وحدة امداد انطاقت...
Page 121
Appendix A: Warning Statements Attention Il est vivement recommandé de confier l'installation, le remplacement et la maintenance de ces équipements à des personnels qualifiés et expérimentés. !אזהרה .צוות מוסמך בלבד רשאי להתקין, להחליף את הציוד או לתת שירות עבור הציוד واملدربيه...
Page 122
Appendix A: Warning Statements Warnung Diese Einheit ist zur Installation in Bereichen mit beschränktem Zutritt vorgesehen. Der Zutritt zu derartigen Bereichen ist nur mit einem Spezialwerkzeug, Schloss und Schlüssel oder einer sonstigen Sicherheitsvorkehrung möglich. ¡Advertencia! Esta unidad ha sido diseñada para instalación en áreas de acceso restringido. Sólo puede obtenerse acceso a una de estas áreas mediante la utilización de una herramienta especial, cerradura con llave u otro medio de seguridad.
Page 123
Appendix A: Warning Statements Battery Handling Warning! There is the danger of explosion if the battery is replaced incorrectly. Replace the battery only with the same or equivalent type recommended by the manufacturer. Dispose of used batteries according to the manufacturer's instructions 電池の取り扱い...
Page 124
Appendix A: Warning Statements هناك خطر من انفجار يف حالة اسحبذال البطارية بطريقة غري صحيحة فعليل اسحبذال البطارية فقط بنفس النىع أو ما يعادلها مام أوصث به الرشمة املصنعة جخلص من البطاريات املسحعملة وفقا لحعليامت الرشمة الصانعة 경고! 배터리가 올바르게 교체되지 않으면 폭발의 위험이 있습니다. 기존 배터리와 동일하거나 제 조사에서...
Page 125
Appendix A: Warning Statements ¡Advertencia! Puede que esta unidad tenga más de una conexión para fuentes de alimentación. Para cortar por completo el suministro de energía, deben desconectarse todas las conexiones. Attention Cette unité peut avoir plus d'une connexion d'alimentation. Pour supprimer toute tension et tout courant électrique de l'unité, toutes les connexions d'alimentation doivent être débranchées.
Page 126
Appendix A: Warning Statements Backplane Voltage Warning! Hazardous voltage or energy is present on the backplane when the system is operating. Use caution when servicing. バックプレーンの電圧 システムの稼働中は危険な電圧または電力が、 バックプレーン上にかかっています。 修理する際には注意く ださい。 警告 当系统正在进行时,背板上有很危险的电压或能量,进行维修时务必小心。 警告 當系統正在進行時,背板上有危險的電壓或能量,進行維修時務必小心。 Warnung Wenn das System in Betrieb ist, treten auf der Rückwandplatine gefährliche Spannungen oder Energien auf.
Page 127
Appendix A: Warning Statements هناك خطز مه التيار الكهزبايئ أوالطاقة املىجىدة عىل اللىحة عندما يكىن النظام يعمل كه حذ ر ا عند خدمة هذا الجهاس 경고! 시스템이 동작 중일 때 후면판 (Backplane)에는 위험한 전압이나 에너지가 발생 합니다. 서비스 작업 시 주의하십시오. Waarschuwing Een gevaarlijke spanning of energie is aanwezig op de backplane wanneer het systeem in gebruik is.
Page 128
Appendix A: Warning Statements תיאום חוקי החשמל הארצי !אזהרה .התקנת הציוד חייבת להיות תואמת לחוקי החשמל המקומיים והארציים تركيب املعدات الكهربائية يجب أن ميتثل للقىاويه املحلية والىطىية املتعلقة بالكهرباء 경고! 현 지역 및 국가의 전기 규정에 따라 장비를 설치해야 합니다. Waarschuwing Bij installatie van de apparatuur moet worden voldaan aan de lokale en nationale elektriciteitsvoorschriften.
Page 129
Appendix A: Warning Statements Attention La mise au rebut ou le recyclage de ce produit sont généralement soumis à des lois et/ou directives de respect de l'environnement. Renseignez-vous auprès de l'organisme compétent. סילוק המוצר !אזהרה .סילוק סופי של מוצר זה חייב להיות בהתאם להנחיות וחוקי המדינה التخلص...
Page 130
Appendix A: Warning Statements Warnung Gefährlich Bewegende Teile. Von den bewegenden Lüfterblätter fern halten. Die Lüfter drehen sich u. U. noch, wenn die Lüfterbaugruppe aus dem Chassis genommen wird. Halten Sie Finger, Schraubendreher und andere Gegenstände von den Öffnungen des Lüftergehäuses entfernt.
Page 131
Verbindungskabeln, Stromkabeln und/oder Adapater, die Ihre örtlichen Sicherheitsstandards einhalten. Der Gebrauch von anderen Kabeln und Adapter können Fehlfunktionen oder Feuer verursachen. Die Richtlinien untersagen das Nutzen von UL oder CAS zertifizierten Kabeln (mit UL/CSA gekennzeichnet), an Geräten oder Produkten die nicht mit Supermicro gekennzeichnet sind.
Page 133
사항을 준수하여 제공되거나 지정된 연결 혹은 구매 케이블, 전원 케이블 및 AC 어댑터를 사용하십시오. 다른 케이블이나 어댑터를 사용하면 오작동이나 화재가 발생할 수 있습니다. 전기 용품 안전법은 UL 또는 CSA 인증 케이블 (코드에 UL / CSA가 표시된 케이블)을 Supermicro 가 지정한 제품 이외의 전기 장치에 사용하는 것을 금지합니다. Stroomkabel en AC-Adapter...
Appendix B: System Specifications Appendix B System Specifications Processors Supports dual Intel Xeon Scalable Family 4th Gen Series Processors (Socket E E1A LGA4677, Socket E E1B LGA4677, or Socket E E1C LGA4677) with a thermal design power (TDP) of up to 350W and four UPIs (UltraPath Interconnect) of up to 16 GT/s Note: Refer to the motherboard specifications pages on our website for updates to supported processors.
Page 135
Appendix B: System Specifications Power Supply Model: (default) PWS-1K24A-1R 1200W redundant modules, 80Plus Titanium level; AC Input 800W: 100-127Vac/50-60 Hz 1200W: 200-240Vac/50-60 Hz +12V Max: 83A (100Vac-127Vac) Max: 166A (200Vac-240Vac) 12V SB Max: 2.1A / Min: 0A Operating Environment Operating Temperature: 10º to 35º C (50º to 95º F) Non-operating Temperature: -40º...
Page 136
Appendix B: System Specifications Perchlorate Warning California Best Management Practices Regulations for Perchlorate Materials: This Perchlorate warning applies only to products containing CR (Manganese Dioxide) Lithium coin cells. “Perchlorate Material-special handling may apply. See www. dtsc. ca. gov/ hazardouswaste/perchlorate”...
Need help?
Do you have a question about the SuperServer SYS-121H-TNR and is the answer not in the manual?
Questions and answers