Download
Share
Print this page
Cisco UCS C480 M5 Maintaining The Server
  1. Manuals
  2. Brands
  3. Cisco Manuals
  4. Server
  5. UCS C480 M5
  6. Maintaining the server
Cisco UCS C480 M5 Maintaining The Server

Cisco UCS C480 M5 Maintaining The Server

Hide thumbs Also See for UCS C480 M5:

Advertisement

Quick Links

Download this manual
Maintaining the Server
This chapter contains the following sections:
•
•
•
•
•
•
•
•
Status LEDs and Buttons
This section contains information for interpreting LED states.
Front-Panel LEDs
Figure 1: Front Panel LEDs
Status LEDs and Buttons, on page 1
Recycling the PCB Assembly (PCBA), on page 101
Service DIP Switches, on page 111
Maintaining the Server
1

Advertisement

loading

Related Manuals for Cisco UCS C480 M5

Summary of Contents for Cisco UCS C480 M5

  • Page 1: Table Of Contents

    Maintaining the Server This chapter contains the following sections: • Status LEDs and Buttons, on page 1 • Preparing For Component Installation, on page 6 • Serviceable Component Locations, on page 11 • Replacing Components Inside the Main Chassis, on page 17 •...
  • Page 2 Power button/LED • Off—There is no AC power to the server. • Amber—The server is in standby power mode. Power is supplied only to the Cisco IMC and some motherboard functions. • Green—The server is in main power mode. Power is supplied to all server components.
  • Page 3 Maintaining the Server Front-Panel LEDs Fan status • Green—All fan modules are operating properly. • Amber, steady—Fan modules are in a degraded state. One fan module has a fault. • Amber, blinking—Two or more fan modules have faults. Network link activity •...
  • Page 4 Maintaining the Server Rear-Panel LEDs NVMe SSD activity • Off—No drive activity. NVMe • Green, blinking—There is drive activity. CPU module power status • Green—The CPU module is correctly seated and receiving power. • Off—There is no power to the CPU module or it is incorrectly seated.
  • Page 5 Maintaining the Server Internal Diagnostic LEDs 1-Gb/10-Gb Ethernet link speed (on both LAN1 and • Off—Link speed is 100 Mbps. LAN2) • Amber—Link speed is 1 Gbps. These ports auto-negotiate link speed based on the • Green—Link speed is 10 Gbps. link-partner capability.

  • Page 6: Preparing For Component Installation

    Maintaining the Server Preparing For Component Installation • The CPU module has internal fault LEDs for CPUs and DIMMs on the CPU module board. POST and runtime error detection routines are stored in on-board registers. The contents of the registers are preserved for a limited time by a supercap voltage source.
  • Page 7 Maintaining the Server Required Equipment For Service Procedures Required Equipment For Service Procedures The following tools and equipment are used to perform the procedures in this chapter: • T-30 Torx driver (supplied with replacement CPUs for heatsink removal) • #1 flat-head screwdriver (supplied with replacement CPUs for heatsink removal) •...
  • Page 8 If a service procedure instructs you to completely remove power from the server, disconnect all power cords from the power supplies in the server. Shutting Down Using The Cisco UCS Manager Equipment Tab You must log in with user or admin privileges to perform this task.
  • Page 9 Maintaining the Server Shutting Down Using The Cisco UCS Manager Service Profile The operating system performs a graceful shutdown and the server goes to standby mode, which is indicated by an amber Power button/LED. Step 7 If a service procedure instructs you to completely remove power from the server, disconnect all power cords from the power supplies in the server.
  • Page 10 Maintaining the Server Serial Number Location Figure 4: Removing the Top Cover Top cover Serial number location on label Locking cover latch Serial Number Location The serial number for the server is printed on a label on the top of the server, near the front. Hot Swap vs Hot Plug Some components can be removed and replaced without shutting down and removing power from the server.

  • Page 11: Serviceable Component Locations

    This topic shows the locations of the field-replaceable components and service-related items. The Technical Specifications Sheets for all versions of this server, which include supported component part numbers, are at Cisco UCS Servers Technical Specifications Sheets (scroll down to Technical Specifications). •...
  • Page 12 Maintaining the Server Serviceable Component Locations Serviceable Components Inside the Main Chassis Figure 5: Serviceable Component Locations Inside the Main Chassis Maintaining the Server...
  • Page 13 Maintaining the Server Serviceable Component Locations RAID controller card for front-loading drives. PCIe slot 01: Primary slot for Cisco UCS VIC adapter card. (not visible in this view; position is near chassis floor under CPU modules) (Secondary slot for Cisco UCS VIC is slot 02.)
  • Page 14 Maintaining the Server Serviceable Component Locations Internal USB 2.0 socket on motherboard Right bay module, supports either: • Drive bays 17 - 24 (shown) • Bays 17, 18, 23, 24 support SAS/SATA or NVMe drives. Front NVMe drives are not supported in a single-CPU module system.
  • Page 15 Maintaining the Server Serviceable Component Locations Serviceable Components Inside a CPU Module Figure 6: Serviceable Component Locations Inside a CPU Module CPU number differs depending on the CPU module DIMM sockets controlled by CPU 1 or 3 (channels location: A, B, C, D, E, F.) •...
  • Page 16 • SD card module with two SD card slots • M.2 module with slots for either two SATA M.2 drives or two NVMe M.2 drives • Cisco Boot-Optimized M.2 RAID Controller (module with two slots for SATA M.2 drives, plus an integrated SATA RAID controller that can control the two M.2 drives in a RAID 1...

  • Page 17: Replacing Components Inside The Main Chassis

    You can also activate these LEDs remotely by using the Cisco IMC interface. This section describes how to install and replace main chassis components. See also: •...
  • Page 18 Maintaining the Server Replacing a CPU Module • Only four double-wide GPUs are supported, in PCIe slots 1, 2, 8, and 10. • No front NVMe drives are supported. • The optional NVMe-only drive bay module UCSC-C480-8NVME is not supported. •...
  • Page 19 Maintaining the Server Replacing Front-Loading SAS/SATA Drives c) Push down evenly on the top corners of the DIMM until it is fully seated and the ejector levers on both ends lock into place. Step 5 Install a new CPU module to the chassis: a) With the two ejector levers open, align the new CPU module with an empty bay.
  • Page 20 Maintaining the Server 4K Sector Format SAS/SATA Drives Considerations Note Front NVMe drives are not supported in a system with only one CPU module. • Center drive bay module: Bays 9, 10, 15, 16 support SAS/SATA or NVMe drives; bays 11, 12, 13, 14 support SAS/SATA drives only.
  • Page 21 Under Boot Option Priorities, verify that the OS you installed is listed as your Boot Option #1. Setting Up UEFI Mode Booting in the Cisco IMC GUI Step 1 Use a web browser and the IP address of the server to log into the Cisco IMC GUI management interface. Step 2 Navigate to Server > BIOS.
  • Page 22 Maintaining the Server Replacing Rear (Internal) SAS/SATA Drives Figure 10: Replacing a Drive in a Drive Tray Ejector lever Drive tray screws (two on each side) Release button Drive removed from drive tray Replacing Rear (Internal) SAS/SATA Drives Note You do not have to shut down the server or drive to replace SAS/SATA hard drives or SSDs because they are hot-swappable.
  • Page 23 Rear SAS/SATA Drive Requirements Observe these requirements: • The optional, rear drive module (UCSC-C480-8HDD). • The rear drive module requires minimum Cisco IMC and BIOS 3.1(3) or later. • The rear drive-bay module must have air-diffuser UCSC-DIFF-C480M5 installed when SAS/SATA drives are installed.
  • Page 24 Maintaining the Server Replacing a Rear (Internal) SAS/SATA Drive • For RAID support: RAID controller card (UCSC-SAS9460-8i) installed in PCIe slot 11. Note In a system with only one CPU module, this RAID controller must be installed in PCIe slot 10 and a blank filler is required in slot 11 to ensure adequate air flow. •...
  • Page 25 Maintaining the Server Replacing Front-Loading NVMe SSDs Figure 12: Replacing a Drive in a Drive Tray Ejector lever Drive tray screws (two on each side) Release button Drive removed from drive tray Replacing Front-Loading NVMe SSDs Note OS-informed hot-insertion and hot-removal must be enabled in the system BIOS. See Enabling Hot-Plug Support in the System BIOS, on page Note...
  • Page 26 Maintaining the Server Front-Loading NVMe SSD Population Guidelines This section is for replacing 2.5-inch form-factor NVMe solid-state drives (SSDs) in front-panel drive bays. Front-Loading NVMe SSD Population Guidelines The front drive bay support for 2.5-inch NVMe SSDs differs, depending on what type of drive bay module is installed (NVMe-only or SAS/SATA/NVMe), and the number of CPU modules in the system: Figure 13: Drive Bay Numbering Note...
  • Page 27 Setting Up UEFI Mode Booting in the BIOS Setup Utility, on page 20 Setting Up UEFI Mode Booting in the Cisco IMC GUI, on page • You cannot control NVMe PCIe SSDs with a SAS RAID controller because NVMe SSDs interface with the server via the PCIe bus.
  • Page 28 Save your changes and exit the utility. Enabling Hot-Plug Support Using the Cisco IMC GUI Step 1 Use a browser to log in to the Cisco IMC GUI for the server. Step 2 Navigate to Compute > BIOS > Advanced > PCI Configuration.
  • Page 29 Maintaining the Server Replacing a Front-Loading NVMe SSD Step 3 Observe the drive-tray LED and wait until it returns to solid green before accessing the drive: • Off—The drive is not in use. • Green, blinking—the driver is initializing following hot-plug insertion. •...
  • Page 30 Maintaining the Server Replacing Rear NVMe SSDs Replacing Rear NVMe SSDs Note OS-surprise removal is not supported. OS-informed hot-insertion and hot-removal are supported on all supported operating systems except VMware ESXi. Note OS-informed hot-insertion and hot-removal must be enabled in the system BIOS. See Enabling Hot-Plug Support in the System BIOS, on page This section is for replacing 2.5-inch form-factor NVMe solid-state drives (SSDs) in the internal, rear drive-bay...
  • Page 31 Setting Up UEFI Mode Booting in the BIOS Setup Utility, on page 20 Setting Up UEFI Mode Booting in the Cisco IMC GUI, on page • You cannot control NVMe PCIe SSDs with a SAS RAID controller because NVMe SSDs interface with the server via the PCIe bus.
  • Page 32 Maintaining the Server Replacing a Rear (Internal) NVMe Drive Step 2 Remove the drive that you are replacing or remove a blank drive tray from the bay: a) Shut down the NVMe SSD to initiate an OS-informed removal. Use your operating system interface to shut down the drive, and then observe the drive-tray LED: •...
  • Page 33 Maintaining the Server Replacing HHHL Form-Factor NVMe Solid State Drives Figure 16: Replacing a Drive in a Drive Tray Ejector lever Drive tray screws (two on each side) Release button Drive removed from drive tray Replacing HHHL Form-Factor NVMe Solid State Drives This section is for replacing half-height, half-length (HHHL) form-factor NVMe SSDs in the PCIe slots.
  • Page 34 Maintaining the Server HHHL Form-Factor NVME SSD Restrictions Note Other installed components affect how many PCIe slots are open to use. For example: • If the auxiliary, internal drive module is installed, PCIe slot 12 is not available because of internal clearance. •...
  • Page 35 Maintaining the Server Replacing a Front Drive Bay Module Use your fingertips to pull back on the wire locking-latches at each end of the retainer bar, and then hinge the bar open to expose the tops of the PCIe slots. b) Pull both ends of the HHHL drive's card vertically to disengage the card from the socket, and then set it aside.
  • Page 36 Maintaining the Server Replacing a Front Drive Bay Module • NVMe only (UCSC-C480-8NVME) Note Mixing these two module types in the same chassis is not supported. Step 1 Shut down and remove power from the server as described in Shutting Down and Removing Power From the Server, on page Step 2 Slide the server out the front of the rack far enough so that you can remove the top cover.
  • Page 37 Maintaining the Server Replacing a Front Drive Bay Module Figure 18: Front Drive-Bay Module Securing Screws (CPU Modules Removed) Maintaining the Server...
  • Page 38 Host Upgrade Utility (HUU) for your firmware release to bring it to a compatible level. See the HUU guide for your Cisco IMC release for instructions on downloading and using the utility to bring server components to compatible levels: Guides.
  • Page 39 Fully power on the server by pressing the Power button. Step 9 If your server is running in standalone mode, use the Cisco UCS Host Upgrade Utility to update the controller firmware and program the correct suboem-id for the controller.
  • Page 40 Maintaining the Server Replacing the Front RAID Supercap Unit Figure 19: Front RAID Controller Card Location (CPU Modules removed) Location of front RAID card in dedicated Card ejector lever (magnified view) horizontal socket (view of the front compartment shown with the CPU modules removed) Metal retainer plate securing screws Replacing the Front RAID Supercap Unit...
  • Page 41 Maintaining the Server Replacing the Front RAID Supercap Unit The supercap provides approximately three years of backup for the disk write-back cache DRAM in the case of a sudden power loss by offloading the cache to the NAND flash. Step 1 Prepare the server for component installation: a) Shut down and remove power from the server as described in Shutting Down and Removing Power From the Server,...
  • Page 42 Maintaining the Server Replacing the Front RAID Supercap Unit Figure 20: Front Supercap Bracket Location (Below CPU Modules) Maintaining the Server...
  • Page 43 Maintaining the Server Replacing the Front RAID Supercap Unit Maintaining the Server...
  • Page 44 Maintaining the Server Replacing a Rear (Internal) Drive-Bay Module Supercap bracket location on inner chassis wall (view of the front compartment shown is with the CPU modules removed) Replacing a Rear (Internal) Drive-Bay Module The optional, rear drive-bay module provides eight drive bays. Note When the rear drive-bay module is used, PCIe slot 12 is not available because there is not enough clearance.
  • Page 45 Maintaining the Server Replacing an Air Diffuser on the Rear Drive Module Step 6 Replace the top cover to the server. Step 7 Reconnect power cords to all power supplies and then allow the server to boot to standby power mode (indicated when the front panel Power button LED lights amber).
  • Page 46 Maintaining the Server Replacing an Air Diffuser on the Rear Drive Module Step 1 Prepare the server for component installation: a) Shut down and remove power from the server as described in Shutting Down and Removing Power From the Server, on page b) Slide the server out the front of the rack far enough so that you can remove the top cover.
  • Page 47 Maintaining the Server Replacing the Rear RAID Supercap Unit Figure 22: Rear Drive Module Air Diffuser Air diffuser top view Rear RAID supercap unit location on the inside surface of the diffuser This diffuser is required when SAS/SATA drivs are installed in the rear drive module. Diffuser alignment points against the chassis Alignment flange on chassis floor mid-brace...
  • Page 48 Maintaining the Server Replacing the Rear RAID Supercap Unit b) Slide the server out the front of the rack far enough so that you can remove the top cover. You might have to detach cables from the rear panel to provide clearance. Caution If you cannot safely view and access the component, remove the server from the rack.
  • Page 49 Maintaining the Server Replacing a Rear RAID Controller Card Figure 23: Rear Drive Module Air Diffuser and Supercap Unit Location Air diffuser top view Rear RAID supercap unit location on the inside surface of the diffuser This diffuser is required when SAS/SATA drivs are installed in the rear drive module.
  • Page 50 Host Upgrade Utility (HUU) for your firmware release to bring it to a compatible level. See the HUU guide for your Cisco IMC release for instructions on downloading and using the utility to bring server components to compatible levels: Guides.
  • Page 51 Replacing a Rear NVMe Switch Card Step 7 If your server is running in standalone mode, use the Cisco UCS Host Upgrade Utility to update the controller firmware and program the correct suboem-id for the controller. For servers running in standalone mode only: After you replace rear controller hardware, you must run the...
  • Page 52 Maintaining the Server Replacing a Rear NVMe Switch Card Note If a rear NVMe switch card is used, it must be installed in PCIe slot 10. Step 1 Prepare the server for component installation: a) Shut down and remove power from the server as described in Shutting Down and Removing Power From the Server, on page b) Slide the server out the front of the rack far enough so that you can remove the top cover.
  • Page 53 Maintaining the Server Replacing Fan Modules Figure 25: Rear NVMe Switch Card Location (PCIe 10) NVMe switch card in required location (PCIe Replacing Fan Modules The four hot-swappable fan modules in the server are numbered as shown in Figure 1. Each fan module contains two fans.
  • Page 54 Maintaining the Server Replacing an Internal USB Drive b) Remove the top cover from the server as described in Removing the Server Top Cover, on page c) Grasp and squeeze the fan module release latches on its top. Lift straight up to disengage its connector from the motherboard.
  • Page 55 Maintaining the Server Replacing a USB Drive Caution We do not recommend that you hot-swap the internal USB drive while the server is powered on because of the potential for data loss. Step 1 Remove an existing internal USB drive: a) Shut down and remove power from the server as described in Shutting Down and Removing Power From the Server, on page...
  • Page 56 Maintaining the Server Enabling or Disabling the Internal USB Port Location of horizontal USB socket on motherboard Enabling or Disabling the Internal USB Port The factory default is that all USB ports on the server are enabled. However, the internal USB port can be enabled or disabled in the server BIOS.
  • Page 57 Maintaining the Server Installing TPM Hardware 3. Enabling the Intel TXT Feature in the BIOS Installing TPM Hardware Note For security purposes, the TPM is installed with a one-way screw. It cannot be removed with a standard screwdriver. Step 1 Prepare the server for component installation: a) Shut down and remove power from the server as described in Shutting Down and Removing Power From the Server,...
  • Page 58 Maintaining the Server Enabling the TPM in the BIOS Figure 28: TPM Socket Location TPM socket location on motherboard Enabling the TPM in the BIOS After hardware installation, you must enable TPM support in the BIOS. Note You must set a BIOS Administrator password before performing this procedure. To set this password, press the F2 key when prompted during system boot to enter the BIOS Setup utility.
  • Page 59 Maintaining the Server Enabling the Intel TXT Feature in the BIOS b) Log into the BIOS Setup utility with your BIOS Administrator password. c) Choose the Advanced tab. d) Choose Trusted Computing to open the TPM Security Device Configuration window. e) Verify that TPM SUPPORT and TPM State are Enabled.
  • Page 60 Maintaining the Server Replacing a Chassis Intrusion Switch Replacing a Chassis Intrusion Switch The chassis intrusion switch in an optional security feature that logs an event in the system event log (SEL) whenever the cover is removed from the chassis. Step 1 Prepare the server for component installation: a) Shut down and remove power from the server as described in...
  • Page 61 Maintaining the Server Replacing Power Supplies Figure 29: Chassis Intrusion Switch Intrusion switch location Replacing Power Supplies The server requires four power supplies. When four power supplies are installed they are redundant as 2+2 by default. You can change this to 3+1 redundancy in the system BIOS. Note The power supplies are hot-swappable and are accessible from the external rear of the server, so you do not have to pull the server out from the rack or remove the server cover.
  • Page 62 Replacing a PCIe Card Note Cisco supports all PCIe cards qualified and sold by Cisco. PCIe cards not qualified or sold by Cisco are the responsibility of the customer. Although Cisco will always stand behind and support the C-Series rack-mount servers, customers using standard, off-the-shelf, third-party cards must go to the third-party card vendor for support if any issue with that particular card occurs.
  • Page 63 PCIe Slot Specifications and Restrictions Figure 31: PCIe Slot Numbering PCIe Slot Specifications Table 3: PCIe Slot Specifications Slot Electrical Lane Connector Maximum Card Card Height NCSI GPU Card Cisco VIC Number Width Length Length (Rear Panel Support Support Card Support Opening) Gen-3 x16...
  • Page 64 Maintaining the Server Replacing a PCIe Card Gen-3 x16 x24 connector Full length Full height (secondary slot) Gen-3 x8 x24 connector Full length Full height Gen-3 x16 x24 connector Full length Full height Gen-3 x8 x24 connector Full length Full height Gen-3 x16 x24 connector Full length...
  • Page 65 Maintaining the Server Replacing a PCIe Card Step 1 Prepare the server for component installation: a) Shut down and remove power from the server as described in Shutting Down and Removing Power From the Server, on page b) Slide the server out the front of the rack far enough so that you can remove the top cover. You might have to detach cables from the rear panel to provide clearance.
  • Page 66 Cisco Virtual Interface Card (VIC) Considerations This section describes VIC card support and special considerations for this server. If you want to use the Cisco UCS VIC card for Cisco UCS Manager integration, see also the Installation For Cisco UCS Manager Integration for details about supported configurations, cabling, and other requirements.
  • Page 67 The minimum software and firmware versions required for this server to support Second Generation Intel Xeon Scalable processors are as follows: Table 5: Minimum Requirements For Second Generation Intel Xeon Scalable processors Software or Firmware Minimum Version Server Cisco IMC 4.0(4) Server BIOS 4.0(4) Cisco UCS Manager (UCS-integrated servers only) 4.0(4) Maintaining the Server...
  • Page 68 • If your server's firmware and Cisco UCS Manager software are already at the required minimums shown above (or later), you can replace the CPU hardware by using the procedure in this section. • If your server's firmware and Cisco UCS Manager software are earlier than the required levels, use the instructions in the...
  • Page 69 One cleaning kit can clean up to four CPUs. • Thermal interface material (TIM)—Syringe supplied with replacement CPU. Use only if you are reusing your existing heatsink (new heatsinks have a pre-applied pad of TIM). Orderable separately as Cisco PID UCS-CPU-TIM=.
  • Page 70 Maintaining the Server Replacing a CPU and Heatsink Replacing a CPU and Heatsink Caution CPUs and their sockets are fragile and must be handled with extreme care to avoid damaging pins. The CPUs must be installed with heatsinks and thermal interface material to ensure cooling. Failure to install a CPU correctly might result in damage to the server.
  • Page 71 Maintaining the Server Replacing a CPU and Heatsink Figure 34: Removing the CPU/Heatsink Assembly Heatsink CPU socket on motherboard Heatsink captive nuts (two on each side) T-30 Torx driver CPU carrier (below heatsink in this view) Step 4 Separate the heatsink from the CPU assembly (the CPU assembly includes the CPU and the plastic CPU carrier): a) Place the heatsink with CPU assembly so that it is oriented upside-down as shown in the following figure.
  • Page 72 Maintaining the Server Replacing a CPU and Heatsink Figure 35: Separating the CPU Assembly From the Heatsink CPU carrier CPU-carrier inner-latch nearest to the TIM breaker slot #1 flat-head screwdriver inserted into TIM breaker slot TIM BREAKER slot in CPU carrier b) Pinch inward on the CPU-carrier clip that is nearest the TIM breaker slot and then push up to disengage the clip from its slot in the heatsink corner.
  • Page 73 Maintaining the Server Replacing a CPU and Heatsink Step 5 The new CPU assembly is shipped on a CPU assembly tool. Take the new CPU assembly and CPU assembly tool out of the carton. If the CPU assembly and CPU assembly tool become separated, note the alignment features shown in the following figure for correct orientation.
  • Page 74 Maintaining the Server Replacing a CPU and Heatsink • If you are installing a new heatsink, it is shipped with a pre-applied pad of TIM. Go to step 5. • If you are reusing a heatsink, you must remove the old TIM from the heatsink and then apply new TIM to the CPU surface from the supplied syringe.
  • Page 75 Maintaining the Server Replacing a CPU and Heatsink Figure 38: Installing the Heatsink/CPU Assembly to the CPU Socket Guide hole in assembly (two) Angled corner on heatsink (pin 1 alignment feature) CPU socket alignment post (two) Angled corner on socket (pin 1 alignment feature) CPU socket leaf spring c) Set the heatsink with CPU assembly down onto the CPU socket.
  • Page 76 Additional CPU-Related Parts to Order with RMA Replacement CPUs When a return material authorization (RMA) of the CPU is done on a Cisco UCS C-Series server, additional parts might not be included with the CPU spare. The TAC engineer might need to add the additional parts to the RMA to help ensure a successful replacement.
  • Page 77 Maintaining the Server Additional CPU-Related Parts to Order with RMA Replacement CPU Modules New heatsink spares come with a pre-applied pad of TIM. It is important to clean any old TIM off of the CPU surface prior to installing the heatsinks. Therefore, even when you are ordering new heatsinks, you must order the heatsink cleaning kit.
  • Page 78 Maintaining the Server Moving an M5 Generation CPU Figure 39: Removing the CPU/Heatsink Assembly Heatsink CPU socket on motherboard Heatsink captive nuts (two on each side) T-30 Torx driver CPU carrier (below heatsink in this view) Step 2 Transfer the CPU socket covers from the new system to the system that you are returning: a) Remove the socket covers from the replacement system.
  • Page 79 Maintaining the Server Moving an M5 Generation CPU Figure 40: Removing a CPU Socket Dust Cover Finger-grip areas marked "REMOVE" b) With the wording on the dust cover facing up, set it in place over the CPU socket. Make sure that all alignment posts on the socket plate align with the cutouts on the cover.
  • Page 80 Maintaining the Server Moving an M5 Generation CPU Figure 41: Installing a CPU Socket Dust Cover Press down on the two circular marks next to the word INSTALL. Step 3 Install the CPUs to the new system: a) On the new board, align the assembly over the CPU socket, as shown below. Note the alignment features.
  • Page 81 Maintaining the Server Moving an M5 Generation CPU Figure 42: Installing the Heatsink/CPU Assembly to the CPU Socket Guide hole in assembly (two) Angled corner on heatsink (pin 1 alignment feature) CPU socket alignment post (two) Angled corner on socket (pin 1 alignment feature) CPU socket leaf spring b) On the new board, set the heatsink with CPU assembly down onto the CPU socket.
  • Page 82 DIMMs and their sockets are fragile and must be handled with care to avoid damage during installation. Caution Cisco does not support third-party DIMMs. Using non-Cisco DIMMs in the server might result in system problems or damage to the motherboard.
  • Page 83 Maintaining the Server DIMM Population Rules and Memory Performance Guidelines • Each channel has two DIMM sockets (for example, channel A = slots A1, A2). • For optimal performance, populate DIMMs in the order shown in the following table, depending on the number of DIMMs per CPU.
  • Page 84 Maintaining the Server Replacing DIMMs Table 7: DIMM Mixing Rules DIMM Parameter DIMMs in the Same Channel DIMMs in the Same Bank DIMM Capacity You can mix different capacity You cannot mix DIMM capacities in DIMMs in the same channel (for a bank (for example A1, B1).
  • Page 85 Maintaining the Server Replacing Intel Optane DC Persistent Memory Modules a) Locate the DIMM that you are removing, and then open the ejector levers at each end of its DIMM slot. Step 4 Install a new DIMM: Note Before installing DIMMs, see the memory population rules for this server: DIMM Population Rules and Memory Performance Guidelines, on page Note...
  • Page 86 Maintaining the Server Intel Optane DC Persistent Memory Module Population Rules and Performance Guidelines • Memory Mode (default): The module operates as 100% memory module. Data is volatile and DRAM acts as a cache for DCPMMs. This is the factory default mode. •...
  • Page 87 Maintaining the Server Installing Intel Optane DC Persistent Memory Modules Figure 45: Supported DCPMM Configurations for Quad-CPU Configurations Installing Intel Optane DC Persistent Memory Modules Note DCPMM configuration is always applied to all DCPMMs in a region, including a replacement DCPMM. You cannot provision a specific replacement DCPMM on a preconfigured server.
  • Page 88 Maintaining the Server Installing Intel Optane DC Persistent Memory Modules You do not have to pull the server out of the rack or remove the server cover because the CPU modules Note are accessible from the front of the server. Step 2 Remove an existing CPU module from the chassis: Note...
  • Page 89 Potential data loss: If you change the mode of a currently installed DCPMM from App Direct or Mixed Mode to Memory Mode, any data in persistent memory is deleted. DCPMMs can be configured by using the server's BIOS Setup Utility, Cisco IMC, Cisco UCS Manager, or OS-related utilities.
  • Page 90 Maintaining the Server Replacing Components Inside an I/O Module • : Displays namespaces and allows you to create or delete them when persistent memory is Namespaces used. Namespaces can also be created when creating goals. A namespace provisioning of persistent memory applies only to the selected region.
  • Page 91 The real-time clock (RTC) battery retains system settings when the server is disconnected from power. The battery type is CR2032. Cisco supports the industry-standard CR2032 battery, which can be purchased from most electronic stores. Caution Never remove an I/O module without shutting down and removing power from the server.
  • Page 92 Maintaining the Server Replacing a Micro SD Card Figure 46: RTC Battery Socket Location Inside an I/O Module RTC battery in vertical socket Step 5 Return the I/O module to the chassis: a) With the ejector-handle open, align the I/O module with the empty bay. b) Push the module into the bay until it engages with the midplane connector.
  • Page 93 Maintaining the Server Replacing a Mini-Storage Module Step 3 Remove an existing Micro SD card: a) Locate the Micro SD card. b) Push horizontally on the Micro SD card and release it to make it spring out from the socket. c) Grasp the Micro SD card and lift it from the socket.
  • Page 94 The Cisco IMC firmware does not include an out-of-band management interface for the M.2 drives installed in the M.2 version of this mini-storage module (UCS-MSTOR-M2). The M.2 drives are not listed in Cisco IMC inventory, nor can they be managed by Cisco IMC. This is expected behavior.
  • Page 95 • You can use one or two SD cards in the carrier. • Dual SD cards can be configured in a RAID 1 array through the Cisco IMC interface. • SD socket 1 is on the top side of the carrier; SD socket 2 is on the underside of the carrier (the same side as the carrier's motherboard connector).
  • Page 96 Maintaining the Server Replacing an M.2 SSD in a Mini-Storage Carrier For M.2 Caution Never remove an I/O module without shutting down and removing power from the server. Step 1 Power off the server and then remove the mini-storage module carrier from the I/O module as described in Replacing a Mini-Storage Module Carrier, on page Step 2...
  • Page 97 The Cisco Boot-Optimized M.2 RAID Controller is not supported when the server is used as a compute-only node in Cisco HyperFlex configurations. • The minimum version of Cisco IMC and Cisco UCS Manager that support this controller is 4.0(4) and later.
  • Page 98 • Hot-plug replacement is not supported. The server must be powered off. • Monitoring of the controller and installed SATA M.2 drives can be done using Cisco IMC and Cisco UCS Manager. They can also be monitored using other utilities such as UEFI HII, PMCLI, XMLAPI, and Redfish.
  • Page 99 Replacing a Cisco Boot-Optimized M.2 RAID Controller This topic describes how to remove and replace a Cisco Boot-Optimized M.2 RAID Controller. The controller board has one M.2 socket on its top (Slot 1) and one M.2 socket on its underside (Slot 2).
  • Page 100 Install the single screw that secures the end of the M.2 SSD to the carrier. g) Turn the controller over and install the second M.2 drive. Figure 50: Cisco Boot-Optimized M.2 RAID Controller, Showing M.2 Drive Installation Step 5...
  • Page 101 Maintaining the Server Recycling the PCB Assembly (PCBA) Recycling the PCB Assembly (PCBA) The PCBA is secured to the server's sheet metal. To recycle the PCBA, you will need to remove a large assembly of components from the server, then breakdown the large assembly into its smaller sub assemblies and components.
  • Page 102 Maintaining the Server Recycling the PCB Assembly (PCBA) Figure 51: Location of Exterior Mounting Screws (Horizontal View) Step 2 Remove the top-level screws and fobs. a) Using a screwdriver, rotate each of the screws counter clockwise until it disengages. b) When all screws are removed, grasp the plastic fobs and remove them by hand. The following image shows the locations of the screws and components.
  • Page 103 Maintaining the Server Recycling the PCB Assembly (PCBA) a) Grasp the ribbon cable connector and disconnect it by hand. b) Using a screwdriver, remove the interior mounting screws. Six screws to the right of the fan cage can be partially covered by the top sheet metal flange of the Note Midplane assembly.
  • Page 104 Maintaining the Server Recycling the PCB Assembly (PCBA) Figure 54: Location of the I/O Module Step 5 Remove the RAID card (if present). a) Disconnect the supercap cable and remove battery pack (if present) that is connected to it. b) Using a screwdriver, rotate each of the screws for the cable management bracket counter-clockwise until it disengages. c) Remove the cable bracket.
  • Page 105 Maintaining the Server Recycling the PCB Assembly (PCBA) Figure 55: Location of Cable Management Bracket d) Pull the blue RAID card lever towards you to unseat the RAID card from its socket. e) Keeping the RAID card level, slide it toward you, then lift it out of the RAID card bracket. f) Using a screwdriver, rotate each of the RAID card bracket screws counter-clockwise until it disengages.
  • Page 106 Maintaining the Server Recycling the PCB Assembly (PCBA) Figure 56: Location of RAID Card Bracket and Supercap Bracket Step 6 Remove the KVM card. a) Using a screwdriver, rotate the KVM card's security screw counter-clockwise until it disengages. b) Placing your fingers on the metal card guide near the socket connector, pull to disconnect the KVM card and slide it out of the chassis.
  • Page 107 Maintaining the Server Recycling the PCB Assembly (PCBA) Figure 57: Location of KVM Card and Security Screw Step 7 Remove the mounting screws and Bridge card from the Midplane assembly: a) Using a screwdriver, rotate each of the screws counter clockwise until it disengages. b) Grasp the Bridge card (the vertical card) and remove it by hand.
  • Page 108 Maintaining the Server Recycling the PCB Assembly (PCBA) Figure 59: Location of Bridge Card Screws Step 9 Grasp the Midplane assembly handle and the Midplane frame and lift the entire midplane assembly out of the chassis. The following illustration shows where to grasp the Midplane Assembly. Figure 60: Location of Hand Holds for Removing the Midplane Assembly (Horizontal View) Step 10 Remove the rear sub assembly.
  • Page 109 Maintaining the Server Recycling the PCB Assembly (PCBA) Figure 61: Location of Mounting Screws for Rear Sub Assembly Step 11 Remove the PCBA, which includes additional components. a) Using a screwdriver, rotate each of the screws counter clockwise until it disengages, then detach the motherboard from the sheet metal tray.
  • Page 110 Maintaining the Server Recycling the PCB Assembly (PCBA) Figure 62: Location of Mounting Screws, Baffle, and PCBA Bracket (Top Down View) Step 12 Disassemble the power distribution board. a) Flip the PCBA over so that the component-side is facing down. This step exposes the Power Distribution board and its mounting screws.
  • Page 111 Properly dispose of the PCBA and all the components you disassembled. Service DIP Switches This server includes a block of DIP switches (SW1) that you can use for certain service and Cisco IMC debug functions. The block is located on the chassis motherboard, as shown in the following figure.
  • Page 112 Figure 64: Location of DIP Switches on Chassis Motherboard Location of DIP switch block SW1 DIP Switch Function Pin Numbers (Open - Closed) Boot from alternate Cisco IMC image 8 - 9 Reset Cisco IMC to factory defaults 7 - 10...
  • Page 113 • If it is a non-BootBlock corruption, a message similar to the following is displayed: ****BIOS FLASH IMAGE CORRUPTED**** Flash a valid BIOS capsule file using Cisco IMC WebGUI or CLI interface. IF Cisco IMC INTERFACE IS NOT AVAILABLE, FOLLOW THE STEPS MENTIONED BELOW.
  • Page 114 During the BIOS update, Cisco IMC shuts down the server and the screen goes blank for about 10 minutes. Do not unplug the power cords during this update. Cisco IMC powers on the server after the update is complete. Procedure 2: Use BIOS Recovery Switch and bios.cap File Step 1 Download the BIOS update package and extract it to a temporary location.
  • Page 115 Reconnect power cords to all power supplies and allow the server to boot to standby power. You do not have to return the server to main power for the change to take effect. Only Cisco IMC (the BMC) must reboot. The change takes effect after Cisco IMC finishes booting.
  • Page 116 Power LED on the front panel is amber. You do not have to return the server to main power for the change to take effect. Only Cisco IMC (the BMC) must reboot. The change takes effect after Cisco IMC finishes booting.
  • Page 117 Power LED on the front panel is amber. You do not have to return the server to main power for the change to take effect. Only Cisco IMC (the BMC) must reboot. The change takes effect after Cisco IMC finishes booting.
  • Page 118 Power LED on the front panel is amber. You do not have to return the server to main power for the change to take effect. Only Cisco IMC (the BMC) must reboot. The change takes effect after Cisco IMC finishes booting.