Page 1 HP SureStore E Disk Array FC60 Service Manual h p H H Edition E0900 Printed in U.S.A.
Page 2: Safety Notices
Notice Safety Notices © Hewlett-Packard Company, 1999, 2000. All rights reserved. Warning Hewlett-Packard Company makes no warranty of any kind with regard to this document, including, but Weight Exceeds 100 lbs. (45 kg.) not limited to, the implied warranties of merchant- Do NOT lift unassisted.
Page 3 Format Conventions Denotes A hazard that can cause personal injury WARNING A hazard that can cause hardware or software damage Caution Significant concepts or operating instructions Note this font Text to be typed verbatim: all commands, path names, file names, and directory names Text displayed on the screen this font Printing History...
Page 4: About This Book
About This Book This guide is intended for use by system administrators and others involved in operating and managing the HP SureStore E Disk Array FC60. It is organized into the following chapters and section. Chapter 1, Product Description Describes the features, controls, and operation of the disk array.
Page 5 Related Documents and Information The following items contain information related to the installation and use of the HP SureStore E Disk Array and its management software. • HP SureStore E Disk Array FC60 Advanced User’s Guide - this is the expanded version of the book you are reading.
Page 7: Table Of Contents
1 Product Description Product Description ........... . 16 Operating System Support .
Page 8 Dynamic Capacity Expansion ........64 2 Topology and Array Planning Overview .
Page 9 Environmental Requirements ........114 Electrical Requirements .
Page 10 Adding Disk Enclosures to Increase Capacity ......174 General Rules for Adding Disk Enclosures to the Disk Array ... . . 174 Step 1.
Page 11 Disk Array Installation/Troubleshooting Checklist ......211 Power-Up Troubleshooting ..........213 Controller Enclosure Troubleshooting .
Page 12 Disk Enclosure SC10 ..........304 Front Cover Door Removal/Replacement .
Page 13 Limitation of Warranty ..........379 Hewlett-Packard Software License Terms......381 Regulatory Compliance .
Page 14 Harmonics Conformance (Japan)........386 Class A Warning Statement (Taiwan).
Page 15 PRODUCT DESCRIPTION Product Description ........... . 16 Disk Enclosure Components .
Page 16: Product Description
Product Description The HP SureStore E Disk Array FC60 (Disk Array FC60) is a disk storage system that features high data availability, high performance, and storage scalability. To provide high availability, the Disk Array FC60 uses redundant, hot swappable modules, which can be replaced without disrupting disk array operation should they fail.
Page 17 Array Controller FC60 SureStore E Disk System SC10 Figure 1 HP SureStore E Disk Array FC60 (Controller with Six Disk Enclosures) Product Description...
Page 18: Operating System Support
Operating System Support The Disk Array FC60 is currently supported on the following operating systems: • Windows NT 4.0 • Windows 2000 Management Tools The following tools are used to manage the Disk Array FC60 on Windows NT and Windows 2000.
Page 19: Scalable Storage Capacity
Scalable Storage Capacity The Disk Array FC60 is designed to provide maximum scalability, simplifying the process of adding storage capacity as required. Storage capacity can be added in three ways: – By adding additional disk modules to a disk enclosure –...
Page 20: Disk Enclosure Components
Disk Enclosure Components The SureStore E Disk System SC10, or disk enclosure, is a high availability Ultra2 SCSI storage product. It provides an LVD SCSI connection to the controller enclosure and ten slots on a single-ended backplane for high-speed, high-capacity LVD SCSI disks. Six disk enclosures fully populated with 9.1 Gbtye disks provide 0.54 Tbytes of storage in a 2-meter System/E rack.
Page 21 BCC Modules Power Supply Modules Fan Modules Disk Modules Chassis (and Backplane) (Front Door Not Shown) Figure 2 Disk Enclosure Components, Exploded View Disk Enclosure Components...
Page 22: Operation Features
Operation Features The disk enclosure is designed to be installed in a standard 19-inch rack and occupies 3.5 EIA units (high). Disk drives mount in the front of the enclosure. Also located in the front of the enclosure are a power switch and status LEDs. A lockable front door shields RFI and restricts access to the disk drives and power button (Figure 3 on page 23).
Page 23: Power Switch
A system LEDs B power button C disk module D disk module LEDs E door lock F ESD plug G mounting ear H power supply I BCCs J fans K component LEDs Figure 3 Disk Enclosure Front and Back View Power Switch The power switch (B in Figure...
Page 24: Disk Enclosure Sc10 Modules
Disk Enclosure SC10 Modules The disk enclosure hot-swappable modules include the following: • Disks and fillers • Fans • Power supplies Disks and Fillers Hot-swappable disk modules make it easy to add or replace disks. Fillers are required in all unused slots to maintain proper airflow within the enclosure.
Page 25 A bezel handle B cam latch E circuit board C carrier frame F insertion guide D standoffs G capacity label Figure 4 Disk Module Disks fit snugly in their slots. The cam latch (B in Figure 4) is used to seat and unseat the connectors on the backplane.
Page 26 BCCs Two Backplane Controller Cards, BCCs, control the disks on one or two buses according to the setting of the Full Bus switch. When the Full Bus switch is set to on, BCC A, in the top slot, accesses the disks in all ten slots. When the Full Bus switch is off, BCC A accesses disks in the even-numbered slots and BCC B accesses disks in the odd-numbered slots.
Page 27 Each BCC provides two LVD SCSI ports (B in Figure 5) for connection to the controller enclosure. The EEPROM on each BCC stores 2 bytes of configuration information and user-defined data, including the manufacturer serial number, World Wide Name, and product number. The following are additional features of the BCC: •...
Page 28 Fans Redundant, hot-swappable fans provide cooling for all enclosure components. Each fan has two internal high-speed blowers (A in Figure 6), an LED (B), a pull tab (C), and two locking screws (D). A internal blowers B LED C pull tab D locking screws Figure 6 Internal circuitry senses blower motion and triggers a fault when the speed of either...
Page 29: Power Supplies
Power Supplies Redundant, hot-swappable 450-watt power supplies convert wide-ranging AC voltage from an external main to stable DC output and deliver it to the backplane. Each power supply has two internal blowers, an AC receptacle (A in Figure 7), a cam handle (B) with locking screw, and an LED (C).
Page 30 Power supplies share the load reciprocally; that is, each supply automatically increases its output to compensate for reduced output from the other. If one power supply fails, the other delivers the entire load. Internal circuitry triggers a fault when a power supply fan or other power supply part fails. If a power supply failure occurs, the amber fault LED will go on.
Page 31: Array Controller Enclosure Components
Array Controller Enclosure Components The array controller enclosure, like the disk enclosure, consists of several modules that can be easily replaced, plus several additional internal assemblies. See Figure 8. Together, these removable modules and internal assemblies make up the field replaceable units (FRUs).
Page 32 Power Supply Fan Module Power Supply Modules Controller Chassis Controller Fan Controller Mo dule A Controller Mo dule B (Front Cover Not Shown) Figure 8 Controller Enclosure Exploded View During operation, controller enclosure status is indicated by five LEDs on the front left of the controller enclosure.
Page 33 Figure 9 Controller Enclosure Front View Array Controller Enclosure Components...
Page 34: Front Cover
Figure 10 Controller Enclosure Rear View Front Cover The controller enclosure has a removable front cover which contains slots for viewing the main operating LEDs. The cover also contains grills that aid air circulation. The controller modules, controller fan, and battery backup unit are located behind this cover. This cover must be removed to gain access to these modules, and also, to observe the controller status and BBU LEDs.
Page 35: Controller Modules
Controller Modules The controller enclosure contains two controller modules. See Figure 11. These modules provide the main data and status processing for the Disk Array FC60. The controller modules slide into two controller slots (A and B) and plug directly into the backplane. Two handles lock the modules in place.
Page 36 Each controller module has ten LEDs. See Figure 12. One LED identifies the controller module’s power status. A second LED indicates when a fault is detected. The remaining eight LEDs provide detailed fault condition status. The most significant LED, the heartbeat, flashes approximately every two seconds beginning 15 seconds after power-on.
Page 37: Controller Fan Modules
Controller Memory Modules Each controller module contains SIMM and DIMM memory modules. Two 16-Mbyte SIMMs (32 Mbytes total) store controller program and other data required for operation. The controller includes two DIMMs, which provide 256 Mbytes of cache. Cache memory serves as temporary data storage during read and write operations, improving I/O performance.
Page 38 Figure 13 Controller Fan Module Array Controller Enclosure Components...
Page 39: Power Supply Modules
Power Supply Modules Two separate power supplies provide electrical power to the internal components by converting incoming AC voltage to DC voltage. Both power supplies are housed in removable power supply modules that slide into two slots in the back of the controller and plug directly into the power interface board.
Page 40: Power Supply Fan Module
Each power supply is equipped with a power switch to disconnect power to the supply. Turning off both switches turns off power to the controller. This should not be performed unless I/O activity to the disk array has been stopped, and the write cache has been flushed as indicated by the Fast Write Cache LED being off.
Page 41 Figure 15 Power Supply Fan Module Array Controller Enclosure Components...
Page 42: Battery Backup Unit
Battery Backup Unit The controller enclosure contains one removable battery backup unit (BBU) that houses two rechargeable internal batteries (A and B) and a battery charger board. The BBU plugs into the front of the controller enclosure where it provides backup power to the controller’s cache memory during a power outage.
Page 43 The BBU contains four LEDs that identify the condition of the battery. Internally, the BBU consists of two batteries or banks, identified as bank “A” and bank “B.” During normal operation both of the Full Charge LEDs (Full Charge-A and Full Charge-B) are on and the two amber Fault LEDs are off.
Page 44 • If the BBU is removed, do not shut off power to the array unless the Fast Write Cache LED is off. Data in write cache will be posted to disk 10 seconds after the BBU is removed. Array Controller Enclosure Components...
Page 45: Disk Array High Availability Features
Disk Array High Availability Features High availability systems are designed to provide uninterrupted operation should a hardware failure occur. Disk arrays contribute to high availability by ensuring that user data remains accessible even when a disk or other component within the Disk Array FC60 fails.
Page 46: Data Parity
The disk array uses hardware mirroring, in which the disk array automatically synchronizes the two disk images, without user or operating system involvement. This is unlike the software mirroring, in which the host operating system software (for example, LVM) synchronizes the disk images. Disk mirroring is used by RAID 1 and RAID 0/1 volume groups.
Page 47: Data Striping
Data Data Data Data Parity If this bit is now written as 1... This bit will also be changed to a 1 so the total still equals 0. Figure 17 Calculating Data Parity Data Striping Data striping, which is used on RAID 0, 0/1, 3 and 5 volume groups, is the performance- enhancing technique of reading and writing data to uniformly sized segments on all disks in a volume group simultaneously.
Page 48: Raid Levels
using a 5-disk RAID 5 volume group, a stripe segment size of 32 blocks (16 B) would ensure that an entire I/O would fit on a single stripe (16 B on each of the four data disks). The total stripe size is the number of disks in a volume group multiplied by the stripe segment size.
Page 49 Figure 18 Volume Group RAID 0 RAID 1 RAID 1 uses mirroring to achieve data redundancy. RAID 1 provides high availability and good performance, but at the cost of storage efficiency. Because all data is mirrored, a RAID 1 volume group has a storage efficiency of 50%. A RAID 1 volume group consists of exactly two disks configured as a mirrored pair.
Page 50 Figure 19 shows the distribution of data on a RAID 1 volume group. Note that all data on the data disk is replicated on the disk mirror. Figure 19 Volume Group RAID 1 RAID 0/1 RAID 0/1 uses mirroring to achieve data redundancy and disk striping to enhance performance.
Page 51 of the pair. If both disks fail or become inaccessible simultaneously, the data on the volume group becomes inaccessible. Figure 20 illustrates the distribution of data in a four-module RAID 0/1 volume group. The disk block addresses in the stripe proceed sequentially from the first pair of mirrored disks (disks 1 and 2) to the second pair of mirrored disks (disks 3 and 4), then again from the first mirrored disks, and so on.
Page 52 disk. The rebuilt volume group contains an exact replica of the information it would have contained had the disk not failed. Until a failed disk is replaced (or a rebuild on a global hot spare is completed), the volume group operates in degraded mode. The volume group must now use the data and parity on the remaining disks to recreate the content of the failed disk, which reduces performance.
Page 53 RAID 3 works well for single-task applications using large block I/Os. It is not a good choice for transaction processing systems because the dedicated parity drive is a performance bottleneck. Whenever data is written to a data disk, a write must also be performed to the parity drive.
Page 54 Figure 22 Volume Group RAID 5 With its individual access characteristics, RAID 5 provides high read throughput for small block-size requests (2 B to 8 B) by allowing simultaneous read operations from each disk in the volume group. During a write I/O, the disk array must perform four individual operations, which affects the write performance of a RAID 5 volume group.
Page 55: Raid Level Comparisons
RAID Level Comparisons To help you decide which RAID level to select for a volume group, the following tables compare the characteristics for the supported RAID levels. Where appropriate, the relative strengths and weakness of each RAID level are noted. Table 1 RAID Level Comparison: Data Redundancy Characteristics Handle multiple disk...
Page 56 Table 3 RAID Level Comparison: Relative Performance Compared to an Individual Disk* Volume Group Relative Read Performance Relative Write Performance Configuration for Large Sequential Access for Large Sequential Access RAID 0 The read and write performance of a RAID 0 volume group increases as the multiple of the number of disks in the volume group.
Page 57 Table 4 RAID Level Comparison: General Performance Characteristics RAID Level General Performance Characteristics RAID 0 – Simultaneous access to multiple disks increases I/O performance. In general, the greater the number of mirrored pairs, the greater the increase in performance. RAID 1 –...
Page 58 Table 5 RAID Level Comparison: Application and I/O Pattern Performance Characteristics RAID level Application and I/O Pattern Performance RAID 0 RAID 0 is a good choice in the following situations: – Data protection is not critical. RAID 0 provides no data redundancy for protection against disk failure.
Page 59: Global Hot Spare Disks
Global Hot Spare Disks A global hot spare disk is reserved for use as a replacement disk if a data disk fails. Their role is to provide hardware redundancy for the disks in the array. To achieve the highest level of availability, it is recommended that one global hot spare disk be created for each channel.
Page 60 Settings that give a higher priority to the rebuild process will cause the rebuild to complete sooner, but at the expense of I/O performance. Lower rebuild priority settings favors host I/Os, which will maintain I/O performance but delay the completion of the rebuild. The rebuild priority settings selected reflect the importance of performance versus data availability.
Page 61 Data and parity from the remaining disks are used to rebuild the contents of disk 3 on the hot spare disk. The information on the hot spare is copied to the replaced disk, and the hot spare is again available to protect against another disk failure.
Page 62: Capacity Management Features
Capacity Management Features The disk array uses a number of features to manage its disk capacity efficiently. Volume groups allow you to partition the total disk capacity into smaller, functional entities. Caching improves disk array performance by using controller RAM to temporarily store data during I/Os.
Page 63: Disk Array Caching
Disk Array Caching Disk caching is the technique of storing data temporarily in RAM while performing I/Os to the disk array. Using RAM as a temporary storage medium can significantly improve the response time for many types of I/O operations. From the host’s perspective the data transfer is complete, even if the disk media was not involved in the transaction.
Page 64: Dynamic Capacity Expansion
In the event of an unexpected disk array shutdown or loss of power, the BBU provides power to cache memory to maintain the cache for 120 hours (5 days). Dynamic Capacity Expansion If slots are available in the disk enclosures, you can increase the capacity of the disk array without disrupting operation.
Page 65 TOPOLOGY AND ARRAY PLANNING Overview ............. 66 Array Design Considerations .
Page 66: Overview
Overview This chapter provides information to assist you in configuring a storage system that meets your application needs using the Disk Array FC60. In designing the storage system, two things must be considered: the configuration of the disk array and how the array will fit into the system (topology).
Page 67: Array Design Considerations
Array Design Considerations The Disk Array FC60 is a versatile storage system that can be configured to meet varying application storage needs. To meet a specific application need, the array should be configured to optimize the features most important for the application. Array features include: •...
Page 68: Raid, Volume Groups, And Global Hot Spares
Ultra2 SCSI Channel Operations The disk array controller enclosure provides six Ultra2 SCSI channel connections for up to six disk enclosures. Six separate channels provide several options. One is that the disk arrays can be added incrementally as storage capacity is needed. It also allows six disk enclosures to be connected, as mentioned above, to provide a high volume storage capacity array.
Page 69: High Availability
High Availability If your application requires high availability, you should implement the options discussed here. To configure the array for high availability, there must be no single points of failure. This means that the configuration must have at least these minimum characteristics: •...
Page 70 disk enclosure). This configuration also offers full sequential performance and is more economical to implement. To scale up sequential transfer performance from the host, configure additional disk arrays. This will increase the total I/O bandwidth available to the server. Performance can also be measured by the number of I/O operations per second a system can perform.
Page 71: Storage Capacity
Storage Capacity For configurations where maximum storage capacity at minimum cost is a requirement, consider configuring the disk array in RAID 5 (using the maximum number of data drives per parity drives) and only supplying one or two hot spare drives per disk array. Also, purchase the lowest cost/Mbyte drive available (typically the largest capacity drives available at the time of purchase).
Page 72 another, two or one disk enclosures, respectively, can be added by using split-bus mode. However, if you are adding up to four, five, or six enclosure, the enclosures configuration will need to be switched from split-bus to full-bus (refer to “Disk Enclosure Bus Configuration”...
Page 73: Recommended Disk Array Configurations
This section presents recommended configurations for disk arrays using one to six disk enclosures. Configurations are provided for achieving high availability/high performance, and maximum capacity. The configuration recommended by Hewlett-Packard is the high availability/ high performance configuration. The configurations identify the number of disk enclosures, cable connections, disk enclosure bus modes, RAID level, and volume groupstructure.
Page 74: One Disk Enclosure Configuration
• Global hot spares - although none of the configurations use global hot spares, their use is recommended to achieve maximum protection against disk failure. For more information, see "Global Hot Spare Disks" on page • Split bus operation - With three or fewer disk enclosures, increased performance can be achieved by operating the disk enclosures in split bus mode, which increases the number of SCSI busses available for data transfer.
Page 75 • Data Availability – Not recommended for maximum high availability. – Handles a single disk failure, single BCC failure, a single channel failure, or a single controller failure – Expansion requires powering down the disk array, removing terminators and/or cables from the enclosures, and cabling additional disk enclosures. •...
Page 76: Two Disk Enclosure Configurations
Two Disk Enclosure Configurations High Availability/ High Performance • Hardware Configuration – Two disk array controllers connected directly to host Fibre Channel adapters – Two disk enclosures with ten 73 GByte disk modules (20 disks total) – Disk enclosures configured for split-bus mode (two SCSI channels per enclosure) •...
Page 77 Figure 25 Two Disk Enclosure High Availability/ High Performance Configuration Recommended Disk Array Configurations...
Page 78 Maximum Capacity This configuration is not recommended for environments where high Note availability is critical. To achieve high availability each disk in a volume group should be in a different disk enclosure. This configuration does not achieve that level of protection. •...
Page 79 Figure 26 Two Disk Enclosure Maximum Capacity Configuration Recommended Disk Array Configurations...
Page 80: Three Disk Enclosure Configurations
Three Disk Enclosure Configurations High Availability/ High Performance • Hardware Configuration – Two disk array controllers connected directly to host Fibre Channel adapters – Three disk enclosures with ten 73 GByte disks each (30 disks total) – Disk enclosures configured for split-bus mode (two SCSI channels per enclosure) •...
Page 81 Figure 27 Three Disk Enclosure High Availability/ High Performance Configuration Recommended Disk Array Configurations...
Page 82 Maximum Capacity • Hardware Configuration – Two disk array controllers connected directly to host Fibre Channel adapters – Three disk enclosures with ten 73 GByte disks each (30 disks total) – Disk enclosures configured for split-bus mode (two SCSI channels per enclosure) •...
Page 83 Figure 28 Three Disk Enclosure Maximum Capacity Configuration Recommended Disk Array Configurations...
Page 84: Four Disk Enclosure Configurations
Four Disk Enclosure Configurations High Availability/High Performance • Hardware Configuration – Two disk array controllers connected directly to host Fibre Channel adapters – Four disk enclosures with ten 73 GByte disks each (40 disks total) – Disk enclosures configured for full-bus mode (one SCSI channel per enclosure) •...
Page 85 Figure 29 Four Disk Enclosure High Availability/High Performance Configuration Recommended Disk Array Configurations...
Page 86 Maximum Capacity • Hardware Configuration – Two disk array controllers connected directly to host Fibre Channel adapters – Four disk enclosures with ten 73 GByte disks each (40 disks total) – Disk enclosures configured for full-bus mode (one SCSI channel per enclosure) •...
Page 87 Figure 30 Four Disk Enclosure Maximum Capacity Configuration Recommended Disk Array Configurations...
Page 88: Five Disk Enclosure Configurations
Five Disk Enclosure Configurations High Availability/High Performance • Hardware Configuration – Two disk array controllers connected directly to host Fibre Channel adapters – Five disk enclosures with ten 73 GByte disks each (50 disks total) – Disk enclosures configured for full-bus mode (one SCSI channel per enclosure) •...
Page 89 Figure 31 Five Disk Enclosure High Availability/High Performance Configuration Recommended Disk Array Configurations...
Page 90 Maximum Capacity • Hardware Configuration – Two disk array controllers connected directly to host Fibre Channel adapters – Five disk enclosures with ten 73 GByte disks each (50 disks total) – Disk enclosures configured for full-bus mode (one SCSI channel per enclosure) •...
Page 91 Figure 32 Five Disk Enclosure Maximum Capacity Configuration Recommended Disk Array Configurations...
Page 92: Six Disk Enclosure Configurations
Six Disk Enclosure Configurations High Availability/High Performance • Hardware Configuration – Two disk array controllers connected directly to host Fibre Channel adapters – Six disk enclosures with ten 73 GByte disks each (60 disks total) – Disk enclosures configured for full-bus mode (one SCSI channel per enclosure) •...
Page 93 Figure 33 Six Disk Enclosure High Availability/High Performance Configuration Recommended Disk Array Configurations...
Page 94 Maximum Capacity • Hardware Configuration – Two disk array controllers connected directly to host Fibre Channel adapters – Six disk enclosures with ten 73 GByte disks each (60 disks total) – Disk enclosures configured for full-bus mode (one SCSI channel per enclosure) •...
Page 95 Figure 34 Six Disk Enclosure High Maximum Capacity Configuration Recommended Disk Array Configurations...
Page 96: Total Disk Array Capacity
Total Disk Array Capacity The total capacity provided by the disk array depends on the number and capacity of disks installed in the array, and the RAID levels used. RAID levels are selected to optimize performance or capacity. Table 6 lists the total capacities available when using fully loaded disk enclosures configured for optimum performance.
Page 97: For High-Availability, One Disk Per Scsi Channel Is Used As A Global Hot Spare
For high-availability, one disk per SCSI channel is used as a global hot spare. Table 6 Capacities for Optimized Performance Configurations Number Total Capacity (with indicated disks) of disk RAID No. of Disks enclosures Level LUNs per LUN 9.1 GB 18.2 GB 36.4 GB 73 GB...
Page 98: Topologies For Windows Nt And Windows 2000
Topologies for Windows NT and Windows 2000 The topology of a network or a Fibre Channel Arbitrated Loop (Fibre Channel-AL) is the physical layout of the interconnected devices; that is, a map of the connections between the physical devices. The topology of a Fibre Channel-AL is extremely flexible because of the variety and number of devices, or nodes, that can be connected to the Fibre Channel- AL.
Page 99 Unsupported Windows Topology Because this topology provides four paths from the host to each disk array, it is not supported. Any topology that provides more than two paths from a host to the disk array is not supported. Path 1 Path 2 Path 3 Path 4...
Page 100: Non-High Availability Topologies
Non-High Availability Topologies Figure 36 through Figure 38 illustrate non-high availability topologies. These topologies do not achieve the highest level of data availability because they have a hardware component that represents a single point of failure. That is, if the critical component fails, access to the data on the disk array will be interrupted.
Page 101 Figure 36 Four Host/Single Hub/ Single Disk Array Non-HA Topology Topologies for Windows NT and Windows 2000...
Page 102 Figure 37 Four Host/Cascaded Hubs/ Dual Disk Array Non-HA Topology Topologies for Windows NT and Windows 2000...
Page 103 Figure 38 Four Host/Single Switch/ Dual Disk Array Non-HA Topology Topologies for Windows NT and Windows 2000...
Page 104: High Availability Topologies
High Availability Topologies Figure 39 through Figure 42 illustrate high availability topologies. These topologies achieve the highest level of availability because they have fully redundant hardware data paths to each disk array. There are no single points of failure in these topologies. These topologies are more complex and expensive to implement than non-high availability topologies.
Page 105 Figure 39 Direct Connect Single Host/Single Disk Array HA Topology Topologies for Windows NT and Windows 2000...
Page 106 Figure 40 Dual Host/Dual Hub/Four Disk Array HA Topology Topologies for Windows NT and Windows 2000...
Page 107 Figure 41 Four Host/Dual Hub/Dual Disk Array HA Topology Topologies for Windows NT and Windows 2000...
Page 108 Figure 42 Four Host/Dual Cascaded-Hubs/Four Disk Array HA Topology Topologies for Windows NT and Windows 2000...
Page 109 Topologies for Windows NT and Windows 2000...
Page 110 Topologies for Windows NT and Windows 2000...
Page 111: Installation
INSTALLATION Host System Requirements..........113 Site Requirements .
Page 112: Overview
Overview This chapter explains how to install the Disk Array FC60 enclosures into a cabinet and how to configure and connect the controller enclosure to the disk enclosures. It also covers the Fibre Cable connection to the host. Finally this chapter provides power up instructions and initial software installation requirements for operation of the disk array.
Page 113: Host System Requirements
Host System Requirements Windows NT and Windows 2000 For information on Windows NT and Windows 2000 host system requirements, see the HP Storage Manager 60 User’s Guide included with the HP Storage Manager 60 software (A5628A). Host System Requirements...
Page 114: Site Requirements
Site Requirements Environmental Requirements The area around the array must be cooled sufficiently so it does not overheat. Chapter 8, Reference and Regulatory, contains environmental specifications for the Disk Array FC60. Refer to that section for the required environmental specifications. Electrical Requirements The site must be able to provide sufficient power to meet the needs of the devices in the cabinet(s).
Page 115 Table 8 Total Operating and In-Rush Currents Operating Operating In-Rush Current Current Power @ 110v @ 220v Current Cords Controller w/ 6 Disk Enclosures 41.3A 20.4A 124A Controller w/ 5 Disk Enclosures 34.8A 17.2A 104A Controller w/ 4 Disk Enclosures 28.3A 14.0A Controller w/ 3 Disk Enclosures...
Page 116 Table 10 Disk Enclosure Electrical Requirements Measurement Value Voltage – Range 220-240V 100 - 127V – Frequency 50-60Hz Current – Typical 2.9 - 3.2A Maximum Operating – 100 - 120 V 2.6 - 3.2A – 200 - 240 V 5.3 - 6.7A –...
Page 117: Power Distribution Units (Pdu/Pdru)
Power Distribution Units (PDU/PDRU) PDUs provide a sufficient number of receptacles for a large number of devices installed in a cabinet. A PDU connects to the site power source and distributes power to its ten receptacles. The disk array power cords are connected to the PDUs and each PDU is connected to a separate UPS.
Page 118 The following tables show recommended PDU/PDRU combinations for one or more components in a rack. Data assumes 220V AC nominal power and redundant PDU/PDRUs. For nonredundant configurations, divide the number of recommended PDU/PDRUs by 2. Table 12 Recommended PDU/PDRUs for HP Legacy Racks Number of Components 1.1-meter (21 U) Rack...
Page 119: Installing Pdus
Refer to the documentation supplied with the PDU/PDRU for installation instructions. Recommended UPS Models The following Hewlett-Packard Power Trust models are recommended for use with the HP SureStore E Disk Array FC60. Each UPS supplies up to 15 minutes of standby power.
Page 120 PDU 16 Amp or PDU 16 Amp or PDRU 30 Amp PDRU 30 Amp Figure 43 PDU Placement in 1.6-Meter Rack Power Distribution Units (PDU/PDRU)
Page 121 PDU (16 Amp)or PDU (16 Amp) or PDRU (30 Amp) PDRU (30 Amp) Figure 44 PDRU Placement in 2.0-Meter Rack Power Distribution Units (PDU/PDRU)
Page 122: Installing The Disk Array Fc60
The HP SureStore E Disk Array FC60 has been tested for proper operation in Note supported Hewlett-Packard cabinets. If the disk array is installed in an untested rack configuration, care must be taken to ensure that all necessary environmental requirements are met. This includes power, airflow, temperature, and humidity.
Page 123 Table 15 EIA Spacing for Racks and Array Enclosures Component Measure (EIA Units) Legacy Cabinets (1 EIA Unit = 1.75”) 1.1 Meter Cabinet 21 EIA Units, Total Available 1.6 Meter Cabinet 32 EIA Units, Total Available 2.0 Meter Cabinet 41 EIA Units, Total Available Controller Enclosure FC60 5 EIA Units Used (includes 1/2 rail space below and remaining 1/2 EIA unit above enclosure)
Page 124 installation to utilize 1/2 EIA units available from the disk system SC10’s 3.5 EIA unit height. Figure 46 shows rack locations for installation of six disk enclosures and one controller enclosure (positioned on top) for legacy racks. When disk enclosures are installed in legacy racks, an unusable 1/2-EIA space is left at the bottom of the enclosures.
Page 125 Figure 45 Enclosure EIA Positions for System/E Racks Installing the Disk Array FC60...
Page 126 Figure 46 Enclosure EIA Positions for Legacy Cabinets Installing the Disk Array FC60...
Page 127: Installing The Disk Enclosures
Installing the Disk Enclosures Disk enclosures should be installed in the rack starting at the bottom and proceeding upward. When all disk enclosures are installed, the controller enclosure is installed at the top, directly above the disk enclosure. Installation instructions for the disk enclosure SC10 are provided below;...
Page 128 Figure 47 Disk Enclosure Contents Installing the Disk Enclosures...
Page 129: Step 3: Install Mounting Rails
Step 3: Install Mounting Rails Select the rail kit for the appropriate rack and follow the instructions included with the rail kit to install the rails in the rack. The following rail kits are available for use with the disk enclosure: •...
Page 130 A Front Mounting Ears C Rail B Chassis D Rail clamp Figure 48 Mounting the Disk Enclosure (Rack System/E shown) Installing the Disk Enclosures...
Page 131 To protect the door, do not lift or move the disk enclosure with the door open. AUTION Unlock and open the disk enclosure door, using a thin flat-blade screwdriver to turn the lock (Figure 49). Figure 49 Door Lock Ensure that one hole in each mounting ear (A in Figure 48) aligns with the sheet metal nuts previously installed on the rack front columns.
Page 132 If using an HP rack, fasten the back of the disk enclosure to the rails using the rear hold-down clamps from the rail kit. a. If you are installing the disk enclosure in an HP legacy rack, set the clamp (A in Figure 50) on top of the rail (B) so that the tabs point up and the screw holes are on the slotted side of the rail.
Page 133: Step 5: Install Disks And Fillers
Step 5: Install Disks and Fillers Touching exposed areas on the disk can cause electrical AUTION discharge and disable the disk. Be sure you are grounded and be careful not to touch exposed circuits. Disks are fragile and ESD sensitive. Dropping one end of the disk two inches is enough to cause permanent damage.
Page 134 Open the disk enclosure door. Put on the ESD strap (provided with the accessories) and insert the end into the ESD plug-in (D in Figure 51) near the upper left corner of the disk enclosure. Disks are fragile. Handle them carefully. AUTION Remove the bagged disk from the disk pack.
Page 135: Moving A Disk Enclosure From One Disk Array To Another
Open the cam latch (C Figure 51) by pulling the tab toward you. Align the disk insertion guide (F) with a slot guide (G) and insert the disk into the slot. Typically, install disk modules on the left side of the enclosure and fillers on the right Installing disks left to right allows you to insert the disk completely without Note releasing your grip on the handle.
Page 136: Installing The Controller
Installing the Controller This procedure describes how to install the Disk Array FC60 controller enclosure into an HP legacy rack or an HP System/E Rack. Step 1: Gather Required Tools • Torx T25 screwdriver • Torx T15 screwdriver • Small flat-blade screwdriver Step 2: Unpack the Product Lift off the overcarton and verify the contents (see Table 17...
Page 137 Table 17 Controller Package Contents Figure Label Part Description (See) Controller chassis with pre-installed modules Filler panel, 1/2 EIA unit, 2ea. Rail kit (A5251A) for System/E racks Rail kit (A5656A) for Rittal racks SCSI Cables (length depends on option ordered) 2 meter (5064-2492) or 5 meter (5064-2470) 2 ea.
Page 138 Figure 53 Controller Enclosure Package Contents Installing the Controller...
Page 139: Step 3: Install Mounting Rails
Step 3: Install Mounting Rails Select the rail kit for the appropriate rack and follow the instructions included with the rail kit to install the rails in the rack. The following rail kits are available for use with the controller enclosure: •...
Page 140 Figure 54 Mounting the Controller Enclosure Installing the Controller...
Page 141 If installing in an HP rack, secure the back of the enclosure to the rails using the two rail clamps from the rail kit. In legacy HP racks: a. Align screw holes and insert the clamp tab into the slot in the upper surface of the rail.
Page 142: Configuration Switches
Configuration Switches This section describes the configuration switches on the controller enclosure and the disk enclosures. Configuration switch settings must be set to support the configuration (full-bus ore split-bus) being installed (as planned for from chapter 2, Topology and Array Planning). Controller enclosure and the disk enclosures configuration switches include: –...
Page 143 Note that one BCC is inverted with respect to the other. Thus, the open and Note closed settings on one BCC are inverted and in reverse order from the other. Tray ID Tray ID Configuration DIP switch Configuration DIP switch Tray ID Tray ID Configuration DIP switch...
Page 144 Table 18 Disk Enclosure Switches Setting Switch Operation Full-Bus Mode 1 - Full-/Split Bus Mode Split-Bus Mode 2 - Stand-Alone/Array Mode Always set to Off (Array Mode) 3 - Bus Reset on Power Fail Must be set to 0 4 - High/Low Bus Addressing Set to 0 (Low addressing) 5 - Not Used Not used;...
Page 145: Fibre Channel Host Id Address Setting
a low range of IDs (0, 1, 2, 3, and 4) and a high range of IDs (8, 9, 10, 11, and 12). (BCCs are also provided addresses as shown in Table 19). Note that the SCSI IDs do not correspond to the physical slot number.
Page 146 controller module A (Fibre Channel connector J3) and Host ID BD2 SW2 selects the address for controller module B (Fibre Channel connector J4). Each Fibre Channel Host ID DIP switch contains a bank of seven switches that select the address using a binary value, 000 0000 (0) through 111 1111 (126). To set an address, set the switches in the up position for “1”...
Page 147 Fibre Channel Host ID Switch ( 0 1 0 1 0 1 0 = 42) Figure 56 Fibre Channel Connectors and Fibre Channel Host (Loop) ID Switches Occasionally two or more ports in an arbitrated loop will arbitrate Note simultaneously. Priorities are decided according to the loop IDs. The higher the loop ID, the higher the priority.
Page 148 Table 20 Fibre Channel Addresses Decimal Binary Decimal Binary Decimal Binary Decimal Binary 000 0000 010 0110 100 1100 111 0010 000 0001 010 0111 100 1101 111 0011 000 0010 010 1000 100 1110 111 0100 000 0011 010 1001 100 1111 111 0101 000 0100...
Page 149: Attaching Power Cords
Attaching Power Cords Each enclosure (controller and disk enclosures) contains dual power supplies that must be connected to the power source (PDU). When connecting power cords for high availability installations, connect one enclosure power cord to one source (PDU) and the other power cord to an alternate source (PDU).
Page 150 letters among all disk enclosures. “Cascading” refers to overload faults that occur on a backup PDU as a result of power surges after the primary PDU fails. – Serviceability. Choose PDU locations that prevent power cords from interfering with the removal and replacement of serviceable components. Also leave a 6-inch service loop to allow for the rotation of PDRUs.
Page 151 AC IN AC IN 30A PDRU 30A PDRU Figure 57 Wiring Scheme for 1.6-Meter Rack Attaching Power Cords...
Page 152 30A PDRU 30A PDRU AC IN AC IN 30A PDRU 30A PDRU AC IN AC IN Figure 58 Wiring Scheme for 2.0-Meter Rack Attaching Power Cords...
Page 153: Attaching Scsi Cables And Configuring The Disk Enclosure Switches
Attaching SCSI Cables and Configuring the Disk Enclosure Switches NOTE! It is critical that all SCSI cables be tightened securely. Use the following steps to ensure the cable connectors are seated properly. 1. Connect the cable to the enclosure connector and tighten the mounting screws finger tight.
Page 154: Full-Bus Cabling And Switch Configuration
Full-Bus Cabling and Switch Configuration Cabling for a full bus configuration requires connecting one SCSI cable from the controller to the disk enclosure and setting the configuration switches. Figure 60 illustrates full-bus cabling connections for a six disk enclosure array. It is possible to configure any number of disk enclosures, from one to six, using this method.
Page 155 Segment 1 set to “1” Segment 1 set to “1” Segment 1 set to “1” Segment 1 set to “1” All other segments set to “0” All other segments set to “0” All other segments set to “0” All other segments set to “0” Tray ID set to unique value Tray ID set to unique value Tray ID set to unique value...
Page 156 Figure 60 Full-Bus Cabling Attaching SCSI Cables and Configuring the Disk Enclosure Switches...
Page 157: Split-Bus Switch And Cabling Configurations
Split-Bus Switch and Cabling Configurations Split-bus cabling requires two SCSI cables from each disk enclosure to the controller enclosure. Split-bus cabling is typically used for installations with 3 or fewer disk enclosures. Cabling for a split-bus configuration is shown in Figure For consistency and ease of managment, it is recommended that you observe Note...
Page 158 All segments set to “0” All segments set to “0” All segments set to “0” All segments set to “0” Tray ID set to unique value Tray ID set to unique value Tray ID set to unique value Tray ID set to unique value for each enclosure for each enclosure for each enclosure...
Page 159 Figure 62 Split-Bus Cabling Attaching SCSI Cables and Configuring the Disk Enclosure Switches...
Page 160 Bus Addressing Examples Each disk module within the disk array is identified by its channel number and SCSI ID. These values will differ depending on which type of configuration is used for the disk array. "How are disk modules in the array identified?" on page 190 for more information.
Page 161 Figure 64 Full-Bus Addressing Example Attaching SCSI Cables and Configuring the Disk Enclosure Switches...
Page 162: Connecting The Fibre Channel Cables
Connecting the Fibre Channel Cables Fibre Channel cables provide the I/O path to the disk array. The Fibre Channel cable connects the controller enclosure directly to a host, or to a hub. For information on Fibre Channel host adapters supported on Windows NT and Windows 2000, check the Host Adapter folder on the HP Storage Manager 60 CD.
Page 163 Figure 65 MIA, RFI Gasket, and Fibre Channel Installation Connect the Fibre Channel connectors to the controller MIAs. a. Remove the optical protectors from the ends of the MIAs and the Fibre Channel cables (Figure 65). b. Insert the Fibre Channel connectors into the MIAs. The fibre optic cable connector is keyed to install only one way.
Page 164: Applying Power To The Disk Array
Applying Power to the Disk Array Once the hardware installation is complete, the disk array can be powered up. It is important that the proper sequence be followed when powering up the components of the disk array. To ensure proper operation, power should be applied to the disk enclosures first and then to the controller enclosure, or all components can be powered up simultaneously.
Page 165 Figure 66 Disk Enclosure Power Switch and System LEDs Check the LEDs on the front of the disk enclosures (see Figure 68). The System Power LED (B in Figure 66) should be on and the Enclosure Fault LED (C) should be off. It is normal for the Enclosure Fault LED (amber) to go on momentarily when the enclosure is first powered on.
Page 166 Power Switches Figure 67 Controller Enclosure Power Switches Check the controller enclosure LEDs (see Figure 69). The Power LED should be on and the remaining LEDs should be off. If any fault LED is on, an error has been detected. Refer to "Troubleshooting"...
Page 167 Table 21 Normal LED Status for the Disk Enclosure Module Normal State Front Enclosure System Fault System Power On (green) Disk Activity Flashing (green) when disk is being accessed. Disk Fault LED Power Supply Power Supply On (green) BCC Module Term.
Page 168 A System fault LED B System power LED C Disk activity LED D Disk fault LED E Power On LED F Term. Pwr. LED G Full Bus LED H BCC Fault LED I Bus Active LED J LVD LED K Fan Fault LED Figure 68 Disk Enclosure LEDs Applying Power to the Disk Array...
Page 169 Table 22 Normal LED Status for Controller Enclosure Module Normal State Controller Power On On (green) Enclosure Power Fault Fan Fault Controller Fault Fast Write Cache On (green) while data is in cache Controller Controller Power On (green) Controller Fault Heartbeat Blink (green) Status...
Page 170 A Power On LED B Power Fault LED C Fan Fault LED D Controller Fault LED E Fast Write Cache LED F Controller Power LED G Controller Fault LED H Heartbeat LED I Status LEDs J Fault B LED K Full Charge B LED L Fault A LED M Full Charge A LED N Power 1 LED...
Page 171 Powering Down the Array When powering down the disk array, the controller enclosure should be powered down before the disk enclosures. To power down the disk array: Stop all I/Os from the host to the disk array. Wait for the Fast Write Cache LED to go off, indicating that all data in cache has been written to the disks.
Page 172: Verifying Disk Array Connection
Verifying Disk Array Connection The HP Storage Manager 60 software is used to verify that the disk array is visible to the Windows host. See the HP Storage Manager 60 User’s Guide for instructions on installing and using the HP Storage Manager 60 software. If there are any hardware enablement bundles installed on the host from a Note release prior to 9912, you must deinstall these bundles and install the updated...
Page 173: Configuring The Disk Array
Configuring the Disk Array Windows NT and Windows 2000 Perform the following steps to configure the disk for operation on a Windows NT or Windows 2000 host. Refer to the HP Storage Manager 60 User’s Guide for detailed instructions on performing each of these tasks. Add the disk array to the SM60 management topology.
Page 174: Adding Disk Enclosures To Increase Capacity
Adding Disk Enclosures to Increase Capacity Scalability is an important part of the design of the HP SureStore E Disk Array FC60. The capacity of the disk array can be increased in a variety of ways to meet growing storage needs.
Page 175: Step 1. Plan The Expanded Configuration
• Consider Adding More Than One Disk Enclosure - Because the process of adding disk enclosures involves backing up data and powering off the disk array, you should consider adding more than one enclosure to meet your future capacity needs. This will avoid having to redo the procedure each time you add another disk enclosure.
Page 176: Step 2. Backup All Disk Array Data
Identify the expanded disk array layout by performing the following tasks: a. Create a detailed diagram of the expanded HP FC60 array layout. Include all Fibre Channel and SCSI cabling connections. This diagram will serve as your configuration guide as you add the new enclosures. The Capacity Expansion Map on page should assist you in identifying where disk will be moved in the new configuration.
Page 177: Step 4. Add The New Disk Enclosures
Do not proceed to the next step if any volume group is not in an optimal state AUTION and you intend to move any of the disks which comprise the volume group. Contact HP Support if the volume groups cannot be made OPTIMAL before the moving disk drives.
Page 178 Configure the necessary disk enclosures for full-bus operation. See "Configuration Switches" on page 142. Set the disk enclosure DIP switches on both BCC A and BCC B to the following settings for full-bus operation: sw1=1 (This switch is set to 0 for split-bus mode.) sw2=0 sw3=0 sw4=0...
Page 179 Set the disk Enclosure (Tray) ID switches. See "Disk Enclosure (Tray) ID Switch" on page 142. a. Set the Enclosure ID switches on both BCC A and BCC B cards to identify the disk enclosure. The Enclosure ID switch setting must be the same for both BCC A and BCC B.
Page 180: Step 5. Completing The Expansion
Step 5. Completing the Expansion The disk array components must be powered up in the specified sequence - AUTION disk enclosures first, followed by the controller enclosure. Failure to follow the proper sequence may result in the host not recognizing volume groups on the disk array.
Page 181 taken not to cross the cables, as this may cause problems with applications that depend on a specific path. This completes the process of expanding the disk array. You can now make the capacity provided by the new disks available to the host by creating volume groups. Adding Disk Enclosures to Increase Capacity...
Page 182: Capacity Expansion Example
Capacity Expansion Example An example of expanding an Disk Array FC60 is shown in Figure 70. In this example, three new disk enclosures are added to a disk array with three fully loaded enclosures. The disk array is configured with five 6-disk volume groups. The original enclosures were operating in split-bus mode, and have been reconfigured to full-bus mode.
Page 183 Disks are moved to the slot that corresponds to their original channel:ID. High availability is maintained by having no more than one disk per LUN or volume group on each channel. Figure 70 Capacity Expansion Example Adding Disk Enclosures to Increase Capacity...
Page 184 Adding Disk Enclosures to Increase Capacity...
Page 185 Full-bus IDs Full-bus IDs Full-bus IDs Full-bus IDs 0 0 0 0 8 8 8 8 1 1 1 1 9 9 9 9 2 2 2 2 10 10 10 10 3 3 3 3 11 11 11 11 4 4 4 4 12 12 12 12 Split-bus IDs...
Page 186 Full-bus IDs Full-bus IDs Full-bus IDs Full-bus IDs 0 0 0 0 8 8 8 8 1 1 1 1 9 9 9 9 2 2 2 2 10 10 10 10 3 3 3 3 11 11 11 11 4 4 4 4 12 12 12 12 Split-bus IDs...
Page 187: Managing The Disk Array
MANAGING THE DISK ARRAY Tools for Managing the Disk Array FC60 ........188 Managing Disk Array Capacity .
Page 188: Tools For Managing The Disk Array Fc60
Tools for Managing the Disk Array FC60 On Windows NT and Windows 2000, the disk array is managed using the HP Storage Manager 60 software. See the HP Storage Manager 60 User’s Guide for information on managing the disk array on Windows NT and Windows 2000. The information in this chapter provides supplemental topics that will help you manage the disk array efficiently.
Page 189: Managing Disk Array Capacity
Managing Disk Array Capacity During installation, a volume structure is created on the disk array. This structure may meet your initial storage requirements, but at some point additional capacity may be required. This involves adding disks and creating new volumes. Careful volume planning will ensure that you achieve the desired levels of data protection and performance from your disk array.
Page 190 When selecting disks for a volume group, consider the following: • To maximize high availability, select disks in different disk enclosures or on different channels. Multiple disks in the same enclosure make a RAID 3 or RAID 5 volume group vulnerable to an enclosure failure.
Page 191 using full-bus configuration, the even-numbered slots are assigned SCSI IDs 0 - 4, and the odd-numbered slots are assigned IDs 8 - 12. (The gap in addresses is necessary for internal management of enclosure components.) If the disk enclosure is configured for split-bus operation, the both the even-numbered slots and the odd-numbered slots are assigned IDs of 0 - 4.
Page 192 Disk Module Addressing Parameters Disk enclosure ID set to 3 Enclosure connected to channel 2 Slot Numbers SCSI IDs Full bus configuration Split bus configuration This disk module uses the following address parameters: Channel 2 SCSI ID 10 (full bus) or 2 (split bus) Enclosure 3 Slot 5 Figure 72...
Page 193: Assigning Volume Group Ownership
Assigning Volume Group Ownership When a volume group is bound, you must identify which disk array controller (A or B) owns the volume group. The controller that is assigned ownership serves as the primary I/O path to the volume group. The other controller serves as the secondary or alternate path to the volume group.
Page 194: Global Hot Spares
• Storage Efficiency - the storage efficiency can range from 50% for RAID 1 and 0/1 up to > 80% for RAID 5. The higher the efficiency, the less cost per megabyte for storing your data. Global Hot Spares Global hot spares provide additional protection against disk failures. The number of global hot spares you use will reflect how much protection you need.
Page 195 When setting stripe segment size, consider the following: • Stripe segment size can affect disk array performance. The smaller the stripe segment size, the more efficient the distribution of data read or written across the stripes in the volume. However, if the stripe segment is too small for a single I/O operation, the operation requires access to two disk.
Page 196: Evaluating Performance Impact
Evaluating Performance Impact Several disk array configuration settings have a direct impact on I/O performance of the array. When selecting a setting, you should understand how it may affect performance. Table 23 identifies the settings that impact disk array performance and what the impact is. Table 23 Performance Impact of Configuration Settings RAID level Setting:...
Page 197 Table 23 Performance Impact of Configuration Settings (cont’d) Cache flush threshold (default 80%) Setting: Function: Sets the level at which the disk array controller begins flushing write cache content to disk media. The setting is specified as the percentage of total available cache that can contain write data before flushing begins.
Page 198 Table 23 Performance Impact of Configuration Settings (cont’d) Cache flush limit (default 100%) Setting: Function: Determines how much data will remain in write cache when flushing stops. It is expressed as a percentage of the cache flush threshold. For optimum performance this value is set to 100% by default.
Page 199 Table 23 Performance Impact of Configuration Settings (cont’d) Cache read ahead (prefetch) Setting: Function: Sets the number of additional sequential blocks transferred into read cache each time a read I/O is performed. Read ahead can be set for each volume. Performance Impact: Read ahead can significantly improve read performance for sequential I/O transactions.
Page 200: Adding Capacity To The Disk Array
Adding Capacity to the Disk Array As your system storage requirements grow, you may need to increase the capacity of your disk array. Disk array capacity can be increased in any of the following ways: • You can add new disk modules to the disk array if there are empty slots in the disk enclosures.
Page 201: Adding Additional Disk Enclosures
Moving Disks from One Disk Array to Another Before moving disks from one array to another, ensure that there is no AUTION important data on the disks. All data on the disks will be lost when they are installed in the new disk array. If you have more than one HP SureStore E Disk Array FC60, you can move disks from one array to another to balance capacity.
Page 202 To increase capacity by replacing disk modules: Identify the volume group impacted by the replacement of the disk modules. Make sure you replace all the disks in the volume group with the higher-capacity disks. Backup all data on the volume group. From the host, stop all I/O activity to the volume group and unmount the file system.
Page 203: Moving A Volume Group From One Disk Array To Another
Moving a Volume Group from One Disk Array to Another It is possible to move an entire volume group from one HP SureStore E Disk Array FC60 to another by moving all the disk in the volume group. However, this is not the recommended procedure for moving LUN data from one array to another.
Page 204: Controller Firmware Components
preserved. If the number is already in use on the array, a new number will be assigned. The next lowest available number will be used. Controller Firmware Components The disk array controller firmware includes three components: • Bootware - executed when the unit is powered on, this code tests controller functions and begins execution of the firmware.
Page 205 case, the controller with the higher firmware version number will be used as the firmware source and its code will be copied to the other controller. Note Can I use ACS to create the controller firmware configuration I need? It is not recommended that you rely on ACS to alter the firmware on a controller.
Page 206 Note When is the NVSRAM information on the disks overwritten by the NVSRAM settings on the controller? The NVSRAM settings on the controller are copied to the disks in the following situations. Each of these operation initiates a Start-Of-Day process, during which the controller NVSRAM settings are copied to the disks.
Page 207: Troubleshooting
TROUBLESHOOTING Introduction ............208 Disk Array Installation/Troubleshooting Checklist .
Page 208: Introduction
Introduction The modular design of the Disk Array FC60 simplifies the isolation and replacement of failed hardware components. Most disk array components are hot-swappable Field Replaceable Units (FRUs), which can be replaced while the disk array is operating. Some of the FRUs are customer replaceable. Other array components can be replaced in the field, but only by a trained service representative.
Page 209: About Field Replaceable Units (Frus)
About Field Replaceable Units (FRUs) The Disk Array FC60 consists of a Controller Enclosure and one or more SureStore E Disk System SC10 enclosures. Table 24 identifies the disk array FRUs and whether they are customer replaceable. See "Removal and Replacement" on page 287 for more information.
Page 210: Windows Nt And Windows 2000 Troubleshooting Tools
Windows NT and Windows 2000 Troubleshooting Tools The HP Storage Manager 60 software includes a set of tools for troubleshooting the disk array. See the HP Storage Manager 60-NT User’s Guide for information on using the HP Storage Manager 60 software. Introduction...
Page 211: Disk Array Installation/Troubleshooting Checklist
Disk Array Installation/Troubleshooting Checklist The following checklist is intended to help isolate and solve problems that may occur when installing the disk array. • Check for Physical Damage: – Disk array packaging and disk array components undamaged – Cabinet packaging and cabinet undamaged •...
Page 212 • Check Fibre Optic and SCSI Cables and SCSI Terminators: – No damaged fibre optic cables – No damaged or loose screws on connectors – All cables tightly secured to the connectors on the Fibre Channel Interconnect PCA – Shortest possible fibre optic cable lengths between disk arrays and host adaptors •...
Page 213: Power-Up Troubleshooting
Power-Up Troubleshooting When the disk array is powered up, each component perform an internal self-test, to ensure it is operating properly. Visual indications of power-up are: • The green Power LED on the controller enclosure is on • The green Power LED on each disk enclosures is on •...
Page 214 If no LEDs are ON and the fans are not running, it indicates that no AC power Note is being supplied to the disk array power supply modules. Check the input AC power to the disk array. "Applying Power to the Disk Array" on page 164 for information on powering up the disk array.
Page 215: Controller Enclosure Troubleshooting
Controller Enclosure Troubleshooting Introduction This chapter discusses how to identify interface problems, how to identify a controller failure, and how to service the controller modules and the memory modules within the controller enclosure as shown in Figure 73. For troubleshooting procedures, refer to the "Master Troubleshooting Table"...
Page 216: Controller Enclosure Leds
Controller Enclosure LEDs Figure 74 shows the locations of the status LEDs for the controller enclosure. Table 25 summarizes the operating LED states for all components within the controller enclosure. A Power On LED B Power Fault LED C Fan Fault LED D Controller Fault LED E Fast Write Cache LED F Controller Power LED...
Page 217 Table 25 Normal LED Status for Controller Enclosure Module Normal State Controller Power On On (green) Enclosure Power Fault Fan Fault Controller Fault Fast Write Cache On (green) while data is in cache Controller Controller Power On (green) Controller Fault Heartbeat Blink (green) Status...
Page 218: Controller Status Leds
Controller Status LEDs A bank of eight status LEDs plus a Fault LED and a Power LED on the controller module display status information. Each controller module displays only its own status and fault information; it does not display information about the other controller module, if it is installed.
Page 219 Errors During Normal Operations It is possible for the controller to encounter errors from which it is unable to recover during normal operations. Specific status LED patterns are used to give a visual indication of any problem. The error pattern returns to the normal setting after the problem has been fixed.
Page 220 Hardware Initialization Hardware initialization codes are displayed on the LED bank as the hardware is initialized during a power up or reset sequence. If the controller encounters errors during hardware initialization, error patterns are displayed on the LEDs. These error patterns are listed in Table 30 on page 229.
Page 221 These status codes are displayed only momentarily and are typically not visible Note if the controller is operating normally. They are only visible if the firmware “hangs” while executing these functions. ernel Initialization After the hardware is initialized, and the Boot Menu has been given a chance to be invoked, the controller will initialize the kernel as the final part of the Boot Firmware initialization.
Page 222 0x3F 0x7F 0xFF 0x7F 0x3F 0x1F 0x0F 0x07 0x03 0x01 0x03, etc... LED patterns are also displayed when the controller programs Flash EEPROM with downloaded code. See Table 28. Different patterns are displayed when the download occurs. These LED patterns are also displayed during automatic code synchronization. ! ! ! ! indicates the LED is On or Flashing.
Page 223 Verifying erase of file flash segments 0x8B Verifying write of file flash segments 0x8C Controller Start-Of-Day Process During a reset the controller performs a complete internal selftest sequence known as “Start Of Day”. The following is an overview of the processes that occur during a Start-Of- Day.
Page 224 sense data indicating that a power-on or reset has occurred. The Sense Key, ASC, and ASCQ will be 0x06, 0x29, and 0x00 respectively. Mode Select Commands disabled: The controller will now disable Mode Select Commands until the Start-Of-Day process is complete. This is required so that subsystem configuration changes are prohibited until the controller has finished booting.
Page 225 and the appropriate structures are created in memory. If these logical units had dirty data in cache, the controller will flush the data to the drive media. If the controller believes that it’s Battery Backup Unit has failed, it will attempt to recover any mirrored data from the alternate controller.
Page 226 24. Spin down Failed Drives: Drives that are marked Failed, are now spun down, and their Fault LEDs are lighted. 25. Restart LUN binding: The controller will discover and restart LUNs that were in the process of being bound when the reset or power fail occurred. 26.
Page 227 Errors During / After Firmware Download Different patterns are displayed after downloading firmware. The patterns are shown in Table ! ! ! ! indicates the LED is On or Flashing. Note that a Note Table 29 Firmware Download LEDs Error LED Pattern Download file is lacking header record.
Page 228 Table 29 Firmware Download LEDs (cont’d) Kernel missing, or kernel CRC mismatch. The user must download a 0xE7 matching combination of controller Bootware and controller Application Firmware. Application Firmware missing, or Application CRC mismatch. The user 0xE8 must download a version of controller Application Firmware that matches the currently loaded controller Bootware.
Page 229 Controller Status LED Codes Summary Table 30 lists a summary of the various controller Status LED codes. ! ! ! ! indicates the LED is On or Flashing. Note that a Note Table 30 Controller Status LEDs codes Code Description Comments Cause / Solution 0x20...
Page 230 Table 30 Controller Status LEDs codes (cont’d) Code Description Comments Cause / Solution 0x36 Processor DRAM diagnostics HW Diag. status Controller module / 0x00 running reseat or replace 0x37 RPA DRAM diagnostics running 0x00 0x38 Processor Level 2 Cache 0x00 diagnostics running 0x44 CDC diagnostics running...
Page 231 Table 30 Controller Status LEDs codes (cont’d) Code Description Comments Cause / Solution 0x6B Drive SCSI Channel 1 (53C810) HW Diag. status Controller module / 0x01 diagnostics running reseat or replace 0x6B Drive SC SI Channel 2 (53C810) 0x02 diagnostics running 0x6B Drive SCSI Channel 3 (53C810) 0x03...
Page 232 Table 30 Controller Status LEDs codes (cont’d) Code Description Comments Cause / Solution 0x6C Drive SCSI Channel 1 HW Diag. status Controller module / 0x01 Turnaround diagnostics running reseat or replace 0x6C Drive SCSI Channel 2 0x02 Turnaround diagnostics running 0x6C Drive SCSI Channel 3 0x03...
Page 233 Table 30 Controller Status LEDs codes (cont’d) Code Description Comments Cause / Solution 0x91 Intermodule error call to flash Firmware file is bad / Download Firmware function passed bad flash type with a good file. Attempt to download Firmware again. If the problem persists, replace the controller module.
Page 234 Table 30 Controller Status LEDs codes (cont’d) Code Description Comments Cause / Solution 0xAC Load Boot Menu Boot Funct. Status Controller module / reseat or replace 0xAD Invoke Boot Menu 0xAE Exit Boot Menu 0xAF Test Diagnostics Manager Memory problem / memory reseat or replace 0xB0...
Page 235 Table 30 Controller Status LEDs codes (cont’d) Code Description Comments Cause / Solution 0xE6 Software load failure Firmware file is bad / Download Firmware 0xE7 Kernel missing, or kernel CRC with a good file. mismatch 0xE8 Application Firmware missing, or Application CRC mismatch Controller is in wrong 0xEA...
Page 236: Identifying Interface Problems
Identifying Interface Problems Types of Interface Problems Interface problems include any malfunctions that delay, interrupt, or prevent successful input/output (I/O) activity between the hosts and other devices. This includes transmissions between the controller enclosure and disk enclosures attached to it. For the purpose of this discussion, the controller enclosure’s interface components include the following: •...
Page 237 Hints for Troubleshooting Interface Problems The first step in troubleshooting interface problems is determining whether the problem is caused by hardware or software. The following information should aid in making this determination: • If the problem occurred during or immediately following a software activity, try to undo whatever the software did, then step through each software function (in smaller increments) until the problem occurs again.
Page 238 • Replacing the disk array controller module (including memory). • Replacing the controller enclosure midplane (controller card cage). Controller Servicing Notes Here are a few suggestions to consider when servicing disk array controller modules: • Always use proper precautions against electrostatic discharge when removing and handling disk array components.
Page 239 • A controller fault may be due to a failed memory module. Memory Module Servicing Notes Memory modules must be serviced by a trained service technician AUTION ONLY. Before replacing a failed SIMM or DIMM, remember the following tips: • Always use proper precautions against electrostatic discharge before removing and handling controller modules, SIMMs, and DIMMs.
Page 240: Controller Enclosure Troubleshooting
Controller Enclosure Troubleshooting Introduction This section describes procedures to troubleshoot the controller enclosure. See Figure For troubleshooting procedures, refer to Table 32 or the "Master Troubleshooting Table" on page 275. Figure 76 Controller FRU, Slots and LEDs Controller Enclosure Troubleshooting...
Page 241 Table 31 Controller Enclosure Troubleshooting Flowchart (Sheet 1 of 5) Start Look at the Array Controller's Power LED on? FRONT PANEL LEDs Array Enclosure Power Problem Check for: 1. Power Cords Power is being 2. Power Switch applied to the Array 3.
Page 242 Table 31 Controller Enclosure Troubleshooting Flowchart (Sheet 2 of 5) Is the Go to FRONT PANEL Controller Fault LED Controller Subsystem FAULT. Open door and look at each Controller module for: Contact the - Power LED - Fault LED Response - 8 Status LEDs Center THIS Controller is unseated...
Page 243 Table 31 Controller Enclosure Troubleshooting Flowchart (Sheet 3 of 5) Is the FRONT COVER Fan Fault LED on? Go To Subsystem FAULT. Bad Power Supply Fan Power Supply Fan module. Replace the power supply fan module. Fault LED on? Reseat the Power Front Cover Supply fan Module Fan Fault?
Page 244 Table 31 Controller Enclosure Troubleshooting Flowchart (Sheet 4 of 5) Is the FRONT COVER Power Supply Fault LED Inspect both power supply module power LEDs. Is the FRONT COVER power supply Fault LED on? Power Supply A power LED on? Go to Possible Causes: 1.
Page 245 Table 31 Controller Enclosure Troubleshooting Flowchart (Sheet 5 of 5) Go to Is the Fault-A Has the new The BBU has failed. or Fault-B BBU BBU fully charged Replace the BBU LED on? in 7 hours? Full Charge-A Has the BBU Wait 7 hours been charging for for BBU to fully...
Page 246 Table 32 Controller Troubleshooting Symptom Possible Cause Procedure Controller LED (front A Controller missing or Check the Power LEDs on both controller cover) is ON and the unplugged modules. If one Power LED is off, make fan LED is off. sure that the module is plugged in correctly and its handles are locked in place.
Page 247: Controller Midplane Troubleshooting
Controller Midplane Troubleshooting Introduction This section describes procedures to troubleshoot the controller enclosure midplane. See Figure 77. For troubleshooting procedures, refer to Table 33, or the "Master Troubleshooting Table" on page 275. Controller Slots Controller Midplane 5 Volt Connectors 12 Volt Connector Battery Connector SCSI Drive...
Page 248 Controller Enclosure Midplane Servicing Notes The controller enclosure’s chassis must be serviced by a trained AUTION service technician ONLY. To replace the controller enclosure midplane, replace the entire chassis, not just the board. Servicing the chassis is a major task that requires removing and disassembly. Before assuming that the midplane is defective, make sure you have thoroughly investigated all other possibilities, including: •...
Page 249 Troubleshooting Controller Enclosure Midplane Problems Table 33 Troubleshooting Controller Enclosure Midplane Problems Symptom Possible Cause Procedure Power LEDs (front and A Other FRUs are missing – Check all FRUs in the controller power supply FRUs) or not installed correctly. enclosure and make sure they are are ON but all other installed securely.
Page 250 Table 33 Troubleshooting Controller Enclosure Midplane Problems (cont’d) Symptom Possible Cause Procedure Software errors occur A Software function or – Check the appropriate software and when attempting to configuration problems documentation to make sure the system access controller or is set up correctly or that the proper disks command was executed.
Page 251: Cooling System
Cooling System Introduction This section describes procedures to troubleshoot the controller enclosure cooling system. Figure 78. For troubleshooting procedures. refer to the "Master Troubleshooting Table" on page 275 Controller Fan CRU Ventilation Holes Power Supply Fan CRU Figure 78 Controller Enclosure Cooling System Controller Enclosure Troubleshooting...
Page 252 Servicing the Cooling System Cooling problems include any malfunctions or obstructions that impede air flow and cause one or more components in the controller enclosure to overheat. To avoid cooling problems, always keep the air vents free of obstructions. Also, make sure that the ambient air temperature is within the environmental limits.
Page 253 Determining Which Fan Failed If the Fan Fault LED on the front cover is on, one of the fans in the controller enclosure has failed. To determine whether the controller fan module or power supply fan module has failed, check the LEDs on the power supply fan module. –...
Page 254 Controller Fan Fault Controller Enclosure Power Supply Fan Module Power Supply Fan Fault LED Figure 80 Controller Enclosure and Power Supply Fan Fault LEDs Controller Enclosure Troubleshooting...
Page 255: Controller Fan Module
Controller Fan Module Introduction This section describes procedures to troubleshoot the controller fan module. See Figure 81. For troubleshooting procedures. refer to Table 34, or the "Master Troubleshooting Table" on page 275. Figure 81 Controller Fan Module and Status LEDs Controller Enclosure Troubleshooting...
Page 256 Servicing Notes • When replacing the controller fan module, make sure you have the replacement module available before removing the defective module. Once you remove the controller fan module, you have approximately 15 minutes to install the new fan module. Operating the disk array without a controller fan module for more than 15 minutes may cause a thermal shutdown.
Page 257 Troubleshooting Table 34 Troubleshooting Controller Fan Module Problems Symptom Possible Cause Procedure Controller Fan Module Fan Fault LED is on One or both of the fans in Replace the controller fan module. the controller fan module has failed. The power supply fan 1.
Page 258: Controller Enclosure Power Supply Fan Module
Controller Enclosure Power Supply Fan Module Introduction This section describes procedures to troubleshoot the controller enclosure power supply fan module. See Figure 82. For troubleshooting procedures. refer to the "Master Troubleshooting Table" on page 275. Figure 82 Controller Enclosure Power Supply Fan Module Servicing Notes •...
Page 259 • Both fans in the fan module failing simultaneously is unlikely. Such a failure could cause one or both controller enclosure power supply modules to overheat and shutdown. If this occurs, the amber power supply Fault LED on the front cover turns ON, and the Power LED on the overheated power supply turns off.
Page 260: Power System
Power System Introduction This section describes procedures to troubleshoot the controller enclosure power system. Figure 83. For troubleshooting procedures. refer to the "Master Troubleshooting Table" on page 275. Figure 83 Controller Enclosure Power System FRUs Servicing the Power System Power system problems include any malfunctions that delay or interrupt power distribution to the controller enclosure and its components;...
Page 261 The BBU has a two-year life expectancy. The BBU is a sealed unit and must be Note replaced as an entire assembly. The batteries inside the BBU are not separately replaceable. Types of Power System Problems Some electrical problems are difficult to trace, especially if they involve complex site wiring in a large facility.
Page 262 Introduction This section describes procedures to troubleshoot the controller enclosure Battery Backup Units (BBU). See Figure 84. For troubleshooting procedures. refer to Table 35 or the "Master Troubleshooting Table" on page 275. Figure 84 Battery Backup Unit (BBU) Servicing Notes The BBU should be replaced every two years, or whenever it fails to hold a charge.
Page 263 Use proper facilities to recycle the used BBUs. The BBU contains lead acid Note batteries that may be considered a hazardous material. You must handle this unit in accordance with all applicable local and federal regulations. The BBU is a sealed unit. There are no user-serviceable parts inside. When AUTION servicing the BBU, replace the entire BBU, not individual batteries or parts.
Page 264 Table 35 Troubleshooting BBU Problems (cont’d) Symptom Possible Cause Procedure A Battery charger board will not hold – Replace the failure a charge – Allow the system to operate for at least 7 hours in order to properly charge the batteries.
Page 265 Checking the Battery Service Date Under normal circumstances, replace the BBU every two years. Operating the Note º disk array in a environment with elevated temperature (above 35 C or 95 º lowers the life expectancy of the BBU. Under these conditions you may need to replace the battery every six months.
Page 266 Check replacement date here Figure 85 Battery FRU Service Label If the used BBU is physically damaged and is leaking electrolyte gel, DO NOT AUTION ship it to a recycling center. Handle damaged batteries according to your local regulations, which may include procedures for handling batteries as a hazardous waste.
Page 267: Power Supply Module
Power Supply Module Introduction This section describes procedures to troubleshoot the controller enclosure power supply modules. See Figure 86. For troubleshooting procedures, refer to Table 36, or the "Master Troubleshooting Table" on page 275. Figure 86 Power Supply FRU Controller Enclosure Troubleshooting...
Page 268 Power Supply Thermal Shutdown The power supply module has a built-in temperature sensor designed to prevent the power supply from overheating. If a temperature sensor detects an over-temperature condition (>= 70 º C (158 º F)) the power supply module automatically shuts down. The remaining power supply module continues operating as long as its sensor does not detect an over- temperature condition.
Page 269 Troubleshooting Table 36 Troubleshooting Power Supply Module Problems Symptom Possible Cause Procedure No power to the controller Power switches are turned Turn on both power switches on the module (all Power LEDs off. controller enclosure. off) Turn on the main circuit breakers in the rack, if applicable.
Page 270 If the air temperature inside the rack is hot enough to cause the power AUTION supplies to shutdown (>= 70º C (158º F), there is a serious problem in the rack. Remove all panels from the rack immediately to help cool the controller enclosure.
Page 271: Battery Harness
Battery Harness Introduction This section describes procedures to troubleshoot the controller enclosure battery harness. See Figure 87. For troubleshooting procedures, refer to the "Master Troubleshooting Table" on page 275 Battery Harness Figure 87 Battery Harness Servicing Notes An intermittent or complete loss of battery power to the controller modules or batteries not charging properly may indicate a defective battery harness or controller enclosure midplane.
Page 272: Dc Power Harnesses
DC Power Harnesses Introduction This section describes procedures to troubleshoot the controller enclosure DC Power Harness. See Figure 88. For troubleshooting procedures, refer to the "Master Troubleshooting Table" on page 275. DC Power Supply Harnesses Figure 88 DC Power Harnesses Servicing Notes An intermittent or complete loss of power to the controller modules, Battery Backup Unit, or controller enclosure fan module may indicate either a defective power harness or power...
Page 273 When replacing a defective DC power harnesses, you must: Stop all host I/O activity to the disk array. Make sure that all data is out of write cache memory. The Fast Cache Write LED will be off when all data has been written from write cache to the disk. Turn OFF all power to the disk array.
Page 274: Power Interface Board
Power Interface Board Introduction This section describes procedures to troubleshoot the controller enclosure power interface board. For troubleshooting procedures, refer to the "Master Troubleshooting Table" on page 275 Servicing Notes The controller enclosure’s power supply assembly must be serviced by a AUTION trained service technician ONLY.
Page 275: Master Troubleshooting Table
Master Troubleshooting Table Table 37 contains troubleshooting information for the controller enclosure and modules. Table 37 Master Troubleshooting Controller Enclosure Master Troubleshooting Table Symptom Possible Cause Procedure Controller Controller LED (front A Controller missing or Check the power LEDs on both controller cover) is on and the unplugged modules.
Page 276 Table 37 Master Troubleshooting Controller Enclosure Master Troubleshooting Table (cont’d) Symptom Possible Cause Procedure Controller enclosure Controller enclosure fan 1. Stop all activity to the controller module and Fan Fault LED failure caused one or both and turn off the power. (front cover) are on controller(s) to overheat 2.
Page 277 Table 37 Master Troubleshooting Controller Enclosure Master Troubleshooting Table (cont’d) Symptom Possible Cause Procedure Software errors occur A Software function or Check the appropriate software and when attempting to configuration problems documentation to make sure the system is access controller or set up correctly or that the proper command disks was executed.
Page 278 Table 37 Master Troubleshooting Controller Enclosure Master Troubleshooting Table (cont’d) Symptom Possible Cause Procedure Controller Fan Module Fan Fault LED is on One or both of the fans in Replace the controller fan module. the controller fan module has failed. The power supply fan 1.
Page 279 Table 37 Master Troubleshooting Controller Enclosure Master Troubleshooting Table (cont’d) Symptom Possible Cause Procedure “Battery Low” error Power turned OFF for Turn ON the power and allow controller issued by software extended period and module to run 7 hours to recharge the drained battery power.
Page 280 Table 37 Master Troubleshooting Controller Enclosure Master Troubleshooting Table (cont’d) Symptom Possible Cause Procedure Power Supply LED A Power supply module is Insert and lock the power supply module (front cover) is on missing or not plugged into place. If the Fault LED is still on, go to in properly.
Page 281: Surestore E Disk System Sc10 Troubleshooting
SureStore E Disk System SC10 Troubleshooting The following steps should be performed in the indicated sequence when isolating problems with the Disk System SC10 enclosure: Gather information from the following sources: – Hardware Event notifications – LED status indicators – Online status information and error logs (SAM/STM) Isolate the cause of the problem.
Page 282 A System fault LED B System power LED C Disk activity LED D Disk fault LED E Power On LED F Term. Pwr. LED G Full Bus LED H BCC Fault LED I Bus Active LED J LVD LED K Fan Fault LED Figure 89 Disk Enclosure LEDs Table 38 Disk Enclosure LED Functions...
Page 283 Table 38 Disk Enclosure LED Functions (cont’d) State Indication BCC Fault Amber Self-test / Fault Normal operation Flashing Peer BCC DIP switch settings do not match Green Bus operating in LVD mode Bus operating in single-ended mode Term. Pwr. Green Termination power is available from the host.
Page 284: Isolating Causes
It is normal for the amber Fault LED on a component to go on briefly when the Note component initially starts up. However, if the Fault LED remains on for more than a few seconds, a fault has been detected. Isolating Causes Table 39 lists the probable causes and solutions for problems you may detect on the disk...
Page 285 Table 39 Disk Enclosure Troubleshooting Table (cont’d) Problem Description LED State Probable Cause/Solution Power Supply LED is Amber – An incompatible or defective component amber caused a temporary fault. – Power supply hardware is faulty. Unplug the power cord and wait for the LED to turn off.
Page 286 SureStore E Disk System SC10 Troubleshooting...
Page 287: Removal And Replacement
REMOVAL AND REPLACEMENT Overview ............288 Required Tools and Equipment.
Page 288: Overview
The HP SureStore E Disk Array FC60 is fully covered by a warranty from Hewlett-Packard. Additional support services may have also been purchased for the disk array. During the warranty period, or if the product is covered by a service contract, it is recommended that you contact your service representative for all service and support issues.
Page 289 Table 40 Field Replaceable Units (FRUs) Customer Field Replaceable Units Hot swappable Replaceable Disk Enclosure Disk & Filler Modules Disk Fan Modules Power Supply Modules BCC (Bus Controller Card) Modules Disk Enclosure (from rack) Front Cover Door Top Cover (Enclosure) Power Button Assembly Backplane/Mezzanine Assembly Disk Carrier Assembly...
Page 290: Required Tools And Equipment
Required Tools and Equipment • Small flat-blade screwdriver • Torx T-10 screwdriver • Torx T-15 screwdriver • Torx T-25 screwdriver • Phillips #1 screwdriver • Phillips #2 screwdriver • ESD wrist strap • ESD mat Required Tools and Equipment...
Page 291: Disk Enclosure Modules
Disk Enclosure Modules This section describes the procedures for replacing the hot swappable modules in the disk enclosure. Disk Module or Filler Module " Hot Swappable Component! This procedure describes how to add or replace disk modules and disk slot filler modules. When adding or replacing disk filler modules use the same procedure, ignoring any steps or information that applies to disk modules only.
Page 292 When a disk module is replaced, the new disk inherits the group properties of Note the original disk. For example, if you replace a disk that was part of volume group 1, the replacement will also become part of volume group 1. If the disk is a replacement for a global hot spare or an unassigned disk, the replacement will become a global hot spare or an unassigned disk.
Page 293 A ESD plug-in B cam latch C handle Figure 90 Disk Module Removal Installing a Disk Module or Filler Module Touching the disk circuit board can cause high energy AUTION discharge and damage the disk. Disks modules are fragile and should be handled carefully. Disk Enclosure Modules...
Page 294 If the disk module you are installing has been removed from another Disk Array Note FC60, you should ensure that the module has a status of Unassigned. This is done by deleting the volume group the disk module was a part of in the original disk array.
Page 295 Close the cam latch to seat the module firmly into the backplane. An audible click indicates the latch is closed properly. Check the LEDs (D in Figure 92) above the disk module for the following behavior: – Both LEDs should turn on briefly. –...
Page 296: Disk Enclosure Fan Module
Disk Enclosure Fan Module " Hot Swappable Component! A failed fan module should be replaced as soon as possible. There are two fan modules in the enclosure. If a fan fails, the remaining fan module will maintain proper cooling. However, if the remaining fan module fails before the defective fan is replaced, the disk enclosure must be shut down to prevent heat damage.
Page 297: Installing The Fan Module
A - Locking screw B - Pull tab Figure 93 Disk Enclosure Fan Module Removal and Replacement Installing the Fan Module Slide the replacement fan module into the empty slot (C in Figure 93). Tighten the locking screws (A). Check the fan module LED for the following behavior: –...
Page 298: Disk Enclosure Power Supply Module
Disk Enclosure Power Supply Module " Hot Swappable Component! A failed power supply module should be replaced as soon as possible. When one power supply fails, the remaining power supply will maintain the proper operating voltage for the disk enclosure. However, if the remaining power supply fails before the first power supply is replaced, all power will be lost to the disk enclosure.
Page 299 A - cam handle B - locking screw C - power supplies D - power supply slot Figure 94 Disk Enclosure Power Supply Module Removal and Replacement Installing the Power Supply Module With the handle down, slide the replacement power supply into the empty slot (D in Figure 94).
Page 300: Bcc Module Removal/Replacement
BCC Module Removal/Replacement The BCC is not a hot-swappable component. The disk enclosure must be powered off when removing or replacing the BCC. Powering down the disk enclosure will impact the operation of any LUNs using disks in the enclosure. The loss of the disks may initiate a rebuild for any LUN included on the disks.
Page 301 A - Locking screw B - Cam Lever C - BCC Slot Figure 95 BCC Removal and Replacement Remove the replacement BCC from its ESD bag. Set the Enclosure (Tray) ID and the DIP configuration switches to the same settings as on the original BCC.
Page 302 11. Connect the SCSI cable to the BCC connector. 12. Connect the other end of the SCSI cable to the controller enclosure SCSI connector. 13. Disconnect all disk modules from the disk enclosure backplane connectors by releasing the locking levers and pulling each module out approximately one inch. This step is required to ensure the disk modules return to normal operation.
Page 303 A - Tray ID switch B - DIP switch C - Fault LED Figure 96 BCC Encloser (Tray) ID and DIP Configuration Switches Once the disk enclosure is powered up, check the status of the disk modules using one of the software management tools.
Page 304: Internal Disk Enclosure Assemblies
Internal Disk Enclosure Assemblies This section describes removal and replacement procedures for the disk enclosure’s internal assemblies. Prior to replacing any of these assemblies, the disk enclosure will need to be loosened or removed from the rack. This procedure is described first followed by the individual assembly removal procedures.
Page 305 Removing the Disk Enclosure To remove the disk enclosure, complete the following steps: Stop all host I/Os to the array. Power down the controller enclosure. Set both switches at the rear of the controller enclosure to off. Use a flat-blade screwdriver to unlock and open all disk enclosure doors (Figure 97).
Page 306 Figure 98 Disk Enclosure Removal/Replacement Close and lock the door. WARNING The disk enclosure weighs approximately 80 lbs. (36kgs.) without disks. If you choose to remove the disk enclosure from the rack, use two people or a lift device. Push the disk enclosure forward then, using two people, lift it out of the rack. If you are removing the front door, you only need to slide the enclosure out of the rack about four inches.
Page 307 Installing the Disk Enclosure SC10 This procedure provides installation steps to reinstall a disk enclosure into a rack. This procedure is a shortened version of the installation procedure provided in Chapter 3, Installation. To replace the disk enclosure into the rack, complete the steps below. Using two people, lift the enclosure into the rack.
Page 308: Front Cover Door Removal/Replacement
Front Cover Door Removal/Replacement The front door is required for regulatory compliance. Replace the door immediately if it is damaged. The door must be replaced by a trained service representative. The disk enclosure will need to be powered down to complete this procedure. Turning the power off and disconnecting power and SCSI cables eliminates the possibility of inadvertently pulling out live cables and causing an unplanned shutdown when you move the disk enclosure forward in the rack.
Page 309 front mount screws B door lock C hinge block D door flange E mounting ears F hinge arm Figure 99 Disk Enclosure Front Door Removal and Replacement To replace the door, insert the bottom flange (D in Figure 99) of the disk enclosure chassis between the gasket and bottom edge of the new door.
Page 310: Top Cover Removal/Replacement
Top Cover Removal/Replacement The disk enclosure top cover is not a replaceable part, however it must be removed when replacing the power button assembly, the backplane, or the mezzanine board. The disk enclosure must be powered down to perform this procedure. The top cover must be replaced by a trained service representative only.
Page 311 A - cover plate B - power switch C - cover tabs Figure 100 Disk Enclosure Top Cover Assembly Removal and Replacement Slide the cover to the middle of the chassis. The push rod automatically engages the internal switch (B in Figure 100).
Page 312: Power Button Assembly Removal/Replacement
Power Button Assembly Removal/Replacement The power button assembly is located in the top cover and consists of the on/off button and push rod. These components operate the electrical switch located on the mezzanine board. If the button or rod is broken, replace the power button assembly. If the internal switch is broken, replace the mezzanine board (described following this procedure).
Page 313 A - on/off button B - cover plate (bottom view) C - push rod D - standoffs Figure 101 Power Button Assembly Removal and Replacement Internal Disk Enclosure Assemblies...
Page 314: Backplane/Mezzanine Removal/Replacement
Backplane/Mezzanine Removal/Replacement Replace the backplane when troubleshooting determines it is the source of the problem. Disks, BCCs, fans, and power supplies connect to the backplane. The backplane also contains the mezzanine board, which can be replaced independently if it is damaged or the power switch requires replacement.
Page 315 A - mezzanine board B - backplane C - pin connector Figure 102 Disk Enclosure Mezzanine Assembly Removal and Replacement If you are removing the backplane: a. Remove screw from the cam handle, open the handle, and pull power supplies free of the backplane (see p.
Page 316 To replace the backplane: a. Stand the new backplane inside the chassis and push it over the alignment pins (B in Figure 103). Connectors automatically align with floating fan connectors inside the chassis. b. Insert and tighten ten screws into the backplane and chassis. To replace the mezzanine: a.
Page 317 A - Torx T-15 screws B - alignment pin C - backplane-mezzanine Figure 103 Disk Enclosure Backplane Assembly Removal and Replacement Internal Disk Enclosure Assemblies...
Page 318: Disk Module Carrier Removal/Replacement
Disk Module Carrier Removal/Replacement If the disk module carrier has been damaged, it can be replaced without replacing the disk drive inside. If the damage to the carrier is a result of dropping it, the disk drive inside may be damaged as well. Disk carriers must be replaced by a trained service representative only.
Page 319 A carrier B insertion guide C cam latch D disk drive E standoffs F bezel Figure 104 Disk Carrier Assembly Removal and Replacement Remove the four screws holding the insertion guides (B) and carrier (A) to the disk. Working near the edge of the table improves the angle of the screwdriver. Note Lift the carrier off the disk drive.
Page 320 Align the holes in the carrier with the holes in the disk drive. When properly installed there is about ½ inch between the inside edge of the latch and the disk drive. Set the insertion guides (B) on the sides of the carrier, aligning holes in the guide with holes in the carrier and disk drive.
Page 321: Controller Enclosure Modules
Controller Enclosure Modules This section provides removal and replacement procedures for the controller enclosure modules, plus the controller enclosure front cover. Most controller modules are hot swappable, however certain restrictions need to be observed for some modules, as identified in these descriptions. The controller modules, the controller fan module, and the BBU are accessed from the front of the controller enclosure.
Page 322: Front Cover Removal/Replacement
Front Cover Removal/Replacement " Hot Swappable Component! To gain access to the front of the controller module, the controller fan module, or the battery backup unit (BBU), the front cover must be removed. Removing the Front Cover Pull the bottom of the cover out about one inch to release the pins. See Figure 105.
Page 323: Controller Fan Module
Installing the Front Cover Slide the top edge of the cover up under the lip of the chassis. Push the cover up as far as it will go, then push the bottom in until the pins snap into the mounting holes. Controller Fan Module "...
Page 324 To Remove: Loosen captive screw, pull firmly on handle, and remove CRU. To Install: Push controller fan CRU firmly into slot and tighten captive screw. Figure 106 Controller Fan Module Removal and Replacement Installing the Controller Fan Module. Slide the new module into the slot and tighten the screw. The captive screw is spring- loaded and will not tighten unless it is inserted all the way into the chassis.
Page 325: Battery Backup Unit (Bbu) Removal/Replacement
Battery Backup Unit (BBU) Removal/Replacement " Hot Swappable Component! If the Fast Write Cache LED is on when the BBU is removed from the enclosure Note (or if the BBU fails), write caching will be disabled and the write cache data will be written to disk.
Page 326 Figure 107 BBU Removal and Replacement Controller Enclosure Modules...
Page 327: Installing The Bbu
Installing the BBU Unpack the new BBU. Save the shipping material for transporting the used BBU to the disposal facility. Fill in the following information on the “Battery Support Information” label on the front of the battery. See Figure 108. a.
Page 328: Power Supply Fan Module Removal/Replacement
Dispose of the old BBU. Dispose of the used BBU according to local and federal regulations, which may Note include hazardous material handling procedures. Power Supply Fan Module Removal/Replacement " Hot Swappable Component! Do not operate the enclosure without adequate ventilation and cooling to the AUTION power supplies.
Page 329 Figure 109 Power Supply Fan Module Removal and Replacement Installing the Power Supply Fan Module Slide the power supply fan module into the enclosure. The latch will snap down when the module is seated properly. If the latch remains up, lift up on the ring/latch and push in on the module until it snaps into place.
Page 330: Power Supply Module Removal/Replacement
Power Supply Module Removal/Replacement " Hot Swappable Component! A power supply should be replaced as quickly as possible to avoid the possibility of the remaining supply failing and shutting down the disk array. Removing the Power Supply Module Turn off the power switch and unplug the power cord from the failed power supply module.
Page 331 Figure 111 Power Supply Module Removal and Replacement Installing the Power Supply Module Slide the supply into the slot until it is fully seated and the latch snaps into place. Plug in the power cord and turn on the power. See Figure 110.
Page 332: Controller Module
Controller Module " Hot Swappable Component! This procedure describes the removal and replacement of the controller modules. This procedure should also be used in the following situations: • When installing the A5278A Controller Module to upgrade a single controller disk array to a dual controller configuration.
Page 333 Removing a Controller Module Electrostatic charges can damage sensitive components. Use a grounding AUTION wrist strap before removing or handling the controller modules and place the controller module on an antistatic mat when working on it. Removing a controller module that is operating normally (not failed) could result in data loss.
Page 334 Ensure handles are not extended more than 90 degrees when installing the module. Figure 112 Controller Module Removal and Replacement Installing the DIMM Card on the New Controller If you are upgrading a single controller disk array by installing an add-on Note A5278A Controller Module, you do not need to perform the following procedure.
Page 335 Place the failed controller module next to the replacement module, on the antistatic mat. Transfer the DIMM memory from the failed controller module to the replacement controller module. a. Remove the six screws from each controller module cover (see Figure 113), and lift the cover off the module, b.
Page 336 DIMM Figure 113 Controller Module DIMM Replacement Installing the Controller Module When a new controller module is installed, the resident controller checks the Note firmware version of the new controller. If the versions do not match, the resident controller downloads its firmware to the new controller module. This procedure, called Auto Code Synchronization (ACS), ensures that both controllers are operating with the same version of firmware.
Page 337 If Auto Code Synchronization (ACS) occurs when the new controller module AUTION is installed. DO NOT turn array power off, reset the controller modules, or reseat the controller module for approximately 15 minutes after initial insertion. Performing any of these actions during ACS may damage the controller and it will have to be replaced.
Page 338: Scsi Cables
the controller module LEDs do indicate a normal operating state, refer to chapter 6, for troubleshooting information. Figure 114 Identifying the ACS Process SCSI Cables Replacing SCSI cables requires that the disk enclosure be shut down. Shutting down the enclosure will degrade the performance of the array during the replacement. When the replacement is completed and the disk enclosure is powered up, the array will perform a rebuild (since I/O has occurred to the array while the disk enclosure was powered off).
Page 339 Remove the SCSI cable from the BCC Connect the SCSI cable to the BCC connector. Connect the other end of the SCSI cable to the controller enclosure SCSI connector. Disconnect all disk modules from the backplane connectors by releasing the locking levers and pulling module out, about one inch.
Page 340: Mia
" Hot Swappable Component! This section describes how to replace the MIA. Replacing the MIA requires that the Fibre Channel cable be removed. If the Disk Array FC60 contains two controllers, the system may not need to be shut down provided LVM will route data the through the other fibre channel loop to the other array controller.
Page 341 Figure 115 MIA Removal and Replacement Controller Enclosure Modules...
Page 342: Internal Controller Enclosure Assemblies
Internal Controller Enclosure Assemblies This section describes how to replace the controller enclosure internal assemblies. Since removal of these assemblies requires the controller enclosure be powered down and removed from the rack, host I/O activity to the disk array should be stopped before performing this procedure.
Page 343 Figure 116 Door Lock Switch off power to the disk enclosures. Disconnect the Fibre Channel cables. Use a label to identify which MIA (upper “A” or lower “B”) the cable is connected to. This will ensure that each cable is reconnected to the correct MIA connector on the controller enclosure.
Page 344 WARNING The controller enclosure weighs 75 pounds. Do not attempt to lift the enclosure without the help of another person or a lift device. 11. Remove the enclosure from the rack. Pull the enclosure out about four inches then, using two people, each grab a side of the controller and pull it from the rack. To reinstall the enclosure, perform the above steps in reverse.
Page 345 Figure 117 Controller Enclosure Removal and Installation Internal Controller Enclosure Assemblies...
Page 346: Dimm/Simm Memory Cards
DIMM/SIMM Memory Cards This procedure describes how to remove and replace the DIMM (cache) memory card and SIMM memory card contained in the controller modules. This procedure is required when replacing failed DIMM/SIMM, or transferring the DIMM to a replacement controller module.
Page 347 Figure 118 Controller Module Cover Removal Install the DIMM/SIMM card (Figure 119): – Replace the DIMM - If you are transferring the DIMM to a new replacement module or installing a new DIMM into the existing controller module - by pressing the card into the front DIMM connector until it snaps in place.
Page 348 DIMM SIMM Figure 119 Replacing Memory in Controller Module Replace the top plate on the controller modules (Figure 118) by replacing the six cover screws. Replace the controller module into the controller enclosure. Refer to the "Controller Module" on page 332 for the required installation procedure (observe the LEDs, as described in that section, for correct operation.) Replace the controller enclosure front cover.
Page 349: Harness Cover Plate
Harness Cover Plate To gain access to the power harnesses and the battery harness (one end), remove the harness cover plate. This plate must also be removed when removing either the controller cage/midplane assembly or the power supply cage/midplane assembly. Loosen the four screws which secure the harness cover plate to the rear shield.
Page 350: Dc Power Harnesses
DC Power Harnesses The controller enclosure contains three DC Power harnesses (Figure 121): two +5 VDC and one +12 VDC. The power harnesses provide power connections between the power interface board and the controller enclosure backpanel (midplane). Removal and replacement of these harnesses requires removal of the controller enclosure from the rack. To replace the DC power harnesses, complete the following steps: +5 VDC Power Harnesses +12 VDC Power Harness...
Page 351 If disconnecting the cable is difficult, the power supply cage/ midplane assembly may need to be loosened and moved forward (Figure 123). To loosen power supply cage: a. Remove the eight screws, four each side, from the power supply cage/ midplane assembly (see Figure 123).
Page 352: Power Supply Cage/Midplane Assembly
Power Supply Cage/Midplane Assembly The power supply cage/ midplane assembly houses both the power supply modules and the power supply fan module. These modules plug into the midplane board located at the back of the power supply cage. The midplane board also provides connectors for the power supply harnesses that distribute power to the controller cable midplane.
Page 353 Remove the power supply cage/ midplane assembly. See Figure 123. a. Remove the eight screws, four each side, from the controller chassis. b. Pull the cage back a couple of inches to gain access to the power harness connectors and disconnect the connectors from the back of the power supply cage. c.
Page 354: Battery Harness
Slide the power supply cage/ midplane assembly all the way into the chassis and install the eight screws (four each side). See Figure 123. Install the controller enclosure into the rack (reverse the procedure "Controller Enclosure" on page 342). Battery Harness The controller module contains one battery harness.
Page 355: Controller Cage/ Midplane Assembly / Battery Harness
Controller Cage/ Midplane Assembly / Battery Harness Inside the chassis is the controller enclosure cage/midplane assembly (Figure 125), a modular structure consisting of controller module slots and the controller midplane. Both controller modules plug directly into the midplane. The midplane provides interface and power connections between the components inside the controller cage (controller modules, power interface board, and fans), as well as to LVD-SCSI connections to the disk enclosures, and Fibre Channel connections to the Fibre Channel network.
Page 356 This removal procedure also includes the procedure on the removal and replacement of the battery harness. Disconnect or reconnect harness Figure 126 Removing and Installing the Battery Harness To remove the controller cage/ midplane assembly, or the battery harness, complete the following steps: Electrostatic charges can damage sensitive components.
Page 357 Remove the eight screws, four from each side, of the controller cage (see Figure 127). Figure 127 Controller Cage/ Midplane Assembly Removal Remove the cage from the chassis: lift the top, front edge of the controller cage/ midplane assembly slightly upward (Figure 127), then pull the cage firmly toward the front until the connectors on the controller backplane exit the holes in the rear shield,...
Page 358 If replacing the battery harness, complete this step; if replacing the controller cage/ midplane assembly, skip to Step 7. (Note, observe the routing of this cable so you can route the new cable in this manner.) a. Disconnect the battery harness from the battery connector bracket, located at the back of the battery compartment by removing the two screw from the battery harness connector and remove the harness.
Page 359: Reference / Legal / Regulatory
REFERENCE / LEGAL / REGULATORY Models and Options ........... 361 PDU/PDRU Products .
Page 360: System Requirements
System Requirements Host Systems Windows NT 4.0 and Windows 2000 Any host running Windows NT 4.0 or Windows 2000. Supported Operating Systems • Windows NT 4.0 (with Service Pack 4, 5, or 6) • Windows 2000 Fibre Channel Host Adapters Windows NT 4.0 and /2000 See the HP Storage Manager 60 User’s Guide for a list of supported host adapters.
Page 361: Models And Options
Models and Options The HP SureStore E Disk Array FC60 consists of two products: theA5635A controller enclosure and theA5636A SureStore E Disk System SC10, or disk enclosure. Each of these products have their own options as indicated below. A5635A Controller Enclosure The A5635A controller enclosure is integrated into the disk array by qualified service - trained personnel.
Page 362 Table 42 A5635A Product Options Option Description Host Connect Cable Options 2-meter Fibre Channel cable 16-meter Fibre Channel cable 50-meter Fibre Channel cable 100-meter Fibre Channel cable Replace 1.5M VHDCI SCSI cable with 5M VHDCI SCSI cable Models and Options...
Page 363: A5636A Disk Enclosure Sc10
A5636A Disk Enclosure SC10 The A5636A Sure Store E Disk System SC10 is integrated into the disk array by service- trained personnel. This product is ordered in conjunction with A5635A controller enclosure. The A5636A includes the following components: – SC10 Rack-mount enclosure (accommodates 10, 1.6” or 1,” disk modules) –...
Page 364: Disk Array Fc60 Upgrade And Add-On Products
Disk Array FC60 Upgrade and Add-On Products Order the following parts to expand or reconfigure your original purchase: Table 43 Upgrade Products Order No. Description A5637A 9.2-Gbyte disk drive module 10K rpm Ultra 2 LVD A5638A 18.2-Gbyte disk drive module 10K rpm Ultra 2 LVD A5639A 36-Gbyte disk drive module 10K rpm Ultra 2 LVD A5640A...
Page 365: Pdu/Pdru Products
PDU/PDRU Products Hewlett-Packard offers the following PDUs and PDRUs, with US and international power options, for meeting electrical requirements: Table 44 PDU/PDRU Products Order No. Description Supported on Original Racks E7676A 19 inch, 100-240 V, 16 Amp, 1 C20 inlet, 10 C20 outlets E7671A 19 inch, 100-240 V, 16 Amp, 1 C20 inlet, 2 C19 &...
Page 366: Replaceable Parts
Replaceable Parts A5635A Controller Enclosure Replaceable Parts Table 45 Controller Enclosure Replaceable Parts Exchange Part Number Field Replaceable Units Part # A5635-60002 A5635-69002 Windows NT Controller Module w/32 MB SIMM (no cache DIMMs) Includes Windows NT NVSRAM settings A5278-60002 128 MB DIMM A5278-60004 16MB SIMM Module A5277-60009...
Page 367 A5636A Disk Enclosure Replaceable Parts Table 46 Disk Enclosure Replaceable Parts Replacement Part Exchange Part Order No. Part Description Order No. 0588-001MH 20 top cover screws 6-32x3/16 T10 8120-6514 Power cord A5236-60019 Fan cable A5236-60003 A5272-67014 Door assembly A5236-60023 Power supply A5236-69023 A5272-67003 Backplane and mezzanine assy.
Page 368: A5635A Controller Enclosure Specifications
A5635A Controller Enclosure Specifications Dimensions: Height Width Depth 6.75 inches (17.1 cm) 17.5 inches (44.5 cm) 24 inches (61 cm) Weight: Weight of Each Component (lbs) Quantity Subtotal (lbs) Controller modules 13.2 Controller Fan Battery 21.4 21.4 Power Supply Power Supply Fan Front Cover Chassis 31.6...
Page 369: Ac Power
AC Power: AC Voltage and Frequency: • 120 VAC (100 - 127 VAC), 50 to 60 Hz single phase • 230 VAC (220 - 240 VAC), 50 to 60 Hz single phase • Auto-ranging Current: Voltage Typical Maximum In-Rush Current Operating Operating Current Current...
Page 370: Environmental Specifications
The HP SureStore E Disk Array FC60 has been tested for proper operation in Note supported Hewlett-Packard cabinets. If the disk array is installed in an untested rack configuration, care must be taken to ensure that all necessary environmental requirements are met. This includes power, airflow, temperature, and humidity.
Page 371: Acoustics
Non-operating Environmental (shipping and storage): • Temperature: -40º C to 70º C (-40º F to 158º F) • Maximum gradient: 20º C per hour (68º F per hour) • Relative humidity: 10% to 90% RH @ 28º C (wet bulb) •...
Page 372: A5636A Disk Enclosure Specifications
A5636A Disk Enclosure Specifications Dimensions: Height Width Depth 5.91 in. (15.0 cm) 18.9 in. (48.0 cm) 27.2 in. (69.1 cm) Weight: Component Weight of Each (lbs) Quantity Subtotal (lbs) Disk Drive (HH) 3 .3 Power Supply 10.6 Midplane-Mezzanine Door Chassis Total, Approx.
Page 373: Ac Power
AC Power: AC Voltage and Frequency: • 100 - 127 VAC, 50 to 60 Hz single phase • 220 - 240 VAC, 50 to 60 Hz single phase: Current: Voltage Typical Current Maximum Current 100 - 127 VAC 4.8 a 6.5 a 220 - 240 VAC 2.4 a...
Page 374: Environmental Specifications
The HP SureStore E Disk Array FC60 has been tested for proper operation in Note supported Hewlett-Packard cabinets. If the disk array is installed in an untested rack configuration, care must be taken to ensure that all necessary environmental requirements are met. This includes power, airflow, temperature, and humidity.
Page 375: Acoustics
For continuous, trouble-free operation, the disk enclosure should NOT be Note operated at its maximum environmental limits for extended periods of time. Operating within the recommended operating range, a less stressful operating environment, ensures maximum reliability. The environmental limits in a nonoperating state (shipping and storage) are wider: •...
Page 376: Warranty And License Information
– Three year limited warranty – Next day on-site service for certain repairs (not available in certain geographic areas) See the "Hewlett-Packard Hardware Limited Warranty" on page 378 for a complete description of the standard warranty. Warranty Upgrades HP offers SupportPack warranty upgrades to provide a higher level of response or repair time commitment for your HP SureStore E Disk Array FC60.
Page 377 Preparing for a If you must call for assistance, gathering the following information before placing the call will expedite the support process: Support Call – Product model name and number – Product serial number – Applicable error messages from system or diagnostics –...
Page 378: Hewlett-Packard Hardware Limited Warranty
Hewlett-Packard Hardware Limited Warranty HP warrants to you, the end-user Customer, that HP SureStore E Disk Array FC60 hardware components and supplies will be free from defects in material and workmanship under normal use after the date of purchase for three years. If HP or Authorized Reseller receives notice of such defects during the warranty period, HP or Authorized Reseller will, at its option, either repair or replace products that prove to be defective.
Page 379: Limitation Of Warranty
software warranty terms that may be found in any documentation or other materials contained in the computer product packaging with respect to covered Software. Ninety-Day Limited Software Warranty. HP warrants for a period of NINETY (90) DAYS from the date of the purchase that the Software will execute its programming instructions when all files are properly installed.
Page 380 operation or storage outside the environmental specifications for the product, in-transit damage, improper maintenance, or defects resulting from use of third-party software, accessories, media, supplies, consumables, or such items not designed for use with the product. The HP warranty does not cover errors, malfunctions, or problems caused by or related to third-party products that are external to your HP SureStore E Disk Array FC60.
Page 381: Hewlett-Packard Software License Terms
ADDITION TO THE MANDATORY STATUTORY RIGHTS APPLICABLE TO THE SALE OF THIS PRODUCT TO YOU. Hewlett-Packard Software License Terms The disk array hardware described herein uses Licensed Internal Code ("LIC"). The LIC, including any updates or replacements, any LIC utility software, and Supplier's software are collectively referred to as "Software".
Page 382 (c)(1)(ii) of the Rights in Technical Data and Computer Software clause of DFARS 252.227-7013. Hewlett-Packard Company 3000 Hanover Street Palo Alto, Ca 94304 U.S.A. Copyright © 1997, 1998 Hewlett-Packard Company. All Rights Reserved. Warranty and License Information...
Page 383 2.) Customer further agree that Software is delivered and Licensed as "Commercial Computer Software" as defined in DFARS 252.227-7013, or "restricted computer software" as defined in FAR 52.227-19 c(1,2) if used, respectively, in the performance of a Department of Defense on non-Department of Defense U.S. Government contract. c.
Page 384: Regulatory Compliance
Regulatory Compliance Safety Certifications: • UL listed • CUL certified • TUV certified with GS mark • Gost Certified • CE-Mark EMC Compliance • US FCC, Class A • CSA, Class A • VCC1, Class A • BCIQ, Class A •...
Page 385: Fcc Statements (Usa Only)
FCC Statements (USA Only) The Federal Communications Commission (in 47 CFR 15.105) has specified that the following notice be brought to the attention of the users of this product. This equipment has been tested and found to comply with the limits for a Class A digital device, pursuant to Part 15 of the FCC Rules.
Page 386: Vcci Statement (Japan)
VCCI Statement (Japan) This equipment is in the Class A category information technology equipment based on the rules of Voluntary Control Council For Interference by Information Technology Equipment (VCCI). When used in a residential area, radio interference may be caused. In this case, user may be required to take appropriate Harmonics Conformance (Japan) Class A Warning Statement (Taiwan)
Page 387: Spécification Ati Classe A (France Seulement)
Spécification ATI Classe A (France Seulement) DECLARATION D'INSTALLATION ET DE MISE EN EXPLOITATION d'un matèriel de traitement de l'information (ATI), classé A en fonction des niveaux de perturbations radioélectriques émis, définis dans la norme européenne EN 55022 concernant la Compatibilité Electromagnétique. Cher Client, Conformément à...
Page 388: Geräuschemission (For Germany Only)
Geräuschemission (For Germany Only) • LpA: 45.0 dB (suchend) • Am fiktiven Arbeitsplatz nach DIN 45635 T. 19. • Die Daten sind die Ergebnisse von Typprüfungen an Gerätekonfigurationen mit den höchsten Geräuschemissionen:12 Plattenlaufwerke. • Alle andere onfigurationen haben geringere Geräuschpegel. •...
Page 389: Declaration Of Conformity
1.)This product was tested with Hewlett-Packard Unix server host computer system. Boise Idaho U.S.A., 03/22/99 Dan T. Michauld / QA Manager European Contact: Your local Hewlett-Packard Sales and Service office or Hewlett-Packard GmbH, Department HQ-TRE, Herrenberger Straße 130, D-71034 Boblingen (FAX +49-7031-14-3143) FCC Statements (USA Only)
Page 390 FCC Statements (USA Only)
Page 391: Auto Failover
GLOSSARY adapter A printed circuit assembly that transmits user data (I/Os) between the host system’s internal bus and the external Fibre Channel link and vice versa. Also called an I/O adapter, FC adapter, or host bus adapter (HBA). ArrayID The value used to identify a disk array when using Array Manager 60. The ArrayID can be either the disk array S/N, or an alias assigned to the disk array.
Page 392 bind The process of configuring unassigned disks into a LUN disk group. Disks can be bound into one of the following LUN disk groups: RAID 5, RAID 1 (single mirrored pair), RAID 0/1 (multiple mirrored pairs). bootware This controller firmware comprises the bring-up or boot code, the kernel or executive under which the firmware executes, the firmware to run hardware diagnostics, initialize the hardware and to upload other controller firmware/software from Flash memory, and the XMODEM download functionality.
Page 393 Class of Service The types of services provided by the Fibre Channel topology and used by the communicating port. controller A removable unit that contains an array controller. dacstore A region on each disk used to store configuration information. During the Start Of Day process, this information is used to configure controller NVSRAM and to establish other operating parameters, such as the current LUN configuration.
Page 394: Disk Striping
disk array controller A printed-circuit board with memory modules that manages the overall operation of the disk array. The disk array controllers manage all aspects of disk array operation, including I/O transfers, data recovery in the event of a failure, and management of disk array capacity.
Page 395 EPROM Erasable Programmable Read-Only Memory. fabric A Fibre Channel term that describes a crosspoint switched network, which is one of three existing Fibre Channel topologies. A fabric consists of one or more fabric elements, which are switches responsible for frame routing. A fabric can interconnect a maximum of 244 devices.
Page 396 25 MB/s (quarter speed), or 12.5 MB/s (eighth speed) over distances of up to 100 m over copper media, or up to 10 km over optical links. The disk array operates at full speed. Fibre Channel Arbitrated Loop (FC-AL) One of three existing Fibre Channel topologies in which two to 126 ports are interconnected serially in a single loop circuit.
Page 397 FRU (Field Replaceable Unit) A disk array hardware component that can be removed and replaced by a customer or Hewlett-Packard service representative. global hot spare A disk that is powered up and electrically connected to a disk array but not used until a disk failure occurs.
Page 398 host A processor that runs an operating system using a disk array for data storage and retrieval. hot swappable Hot swappable components can be removed and replaced while the disk array is online without disrupting system operation. Disk array controller modules, disk modules, power supply modules, and fan modules are all hot swappable components.
Page 399 created on the same disk array. A numeric value is assigned to a LUN at the time it is created. LVD-SCSI Low voltage differential implementation of SCSI. Also referred to as Ultra2 SCSI. LVM (Logical Volume Manager) The default disk configuration strategy on HP-UX. In LVM one or more physical disk modules are configured into volume groups that are then configured into logical volumes.
Page 400 parity A data protection technique that provides data redundancy by creating extra data based on the original data. Parity is calculated on each write I/O by doing a serial binary exclusive OR (XOR) of the data segments in the stripe written to the data disks in the LUN.
Page 401 and parity to implement data redundancy. The RAID levels supported by the disk array include RAID 1, RAID 3, and RAID 5. RAID 1 A RAID level in which the LUN uses a single mirrored pair of disks. One disk serves as the data disk, and the other serves as the mirror disk.
Page 402 SCSI An acronym for “Small Computer System Interface”, SCSI is an industry-standard protocol for connecting peripherals and hosts over a bus topology. SCSI-2 bus A bus that complies with the SCSI standard. The six channel that connect the disk array controller system to the disk systems are SCSI 2 busses.
Page 403 stripe boundary crossing In disk striping, if the stripe segment size is too small for a single I/O operation, the operation requires access to two stripes. Called a stripe boundary crossing, this event reduces I/O performance. stripe segment size The amount of information simultaneously read from or written to each disk in a LUN using disk striping.
Page 404 Uninterruptible Power Supply (UPS) An Uninterruptible Power Supply is a power supply that is capable of maintaining power even if the input ac mains supply loses its source of power. VHDCI Very high density cable interface. volume set addressing (VSA) An enhanced technique for addressing disk array LUNs.
Page 405 INDEX auto code synchronization AC power specifications 373 described 204 disk enclosure 369 acoustics See back cover or controller backpanel. controller enclosure 371 disk enclosure 375 backpanel See auto-code synchronization See BCC module backplane controller card. adapter backplane/mezzanine, disk enclosure Fibre Channel host 360 removal and replacement 314 adapter, host 236...
Page 406 warranty 263 managing 189 See battery backup module maximum 71 battery charger channel number battery harness, controller enclosure disk module 190 illustration of 271 chassis removal and replacement 354 air flow 252 service notes 271 circuit board battery module controller backpanel 247 illustration of 262 circuit breakers, European 116 life expectancy 261...
Page 407 removal and replacement 342 troubleshooting 253 specifications 368 current voltage 369 disk enclosure 373 weight 368 inrush 114 controller enclosure modules steady state 114 described 31 total operating and in-rush 115 controller fan module described 37 data hot swapping 256 protection during power outage 261 removal and replacement 323 data channel, verifying 172...
Page 408 power input specifications 373 power on switch 165 power-down sequence 171 removal and replacement 304 power-up sequence 164 specifications 372 rebuild process 59 status indicators 22 upgrade and add-on products 364 status indicators, described 22 ventilation 328 voltage 373 disk array capacity weight 372 maximum 71 disk enclosure modules...
Page 409 electrical 114 fast write cache LED 37 power distribution units (PDUs/ FC-AL, See Fibre Channel Arbitrated Loop PDRUs) 117 Fibre Channel recommended European circuit controller modules 36 breakers 116 controllers 236, 240 recommended PDU/PDRU for HP System/E host racks 118 connections 240 site 114 ID 237...
Page 410 initialization global hot spare LEDs 221 tips for selecting disks 60 in-rush current 114 global hot spare disks installation described 59 controller enclosure 136 disk enclosures 127 disk enclosures into rack 129 Hardware Event Monitor 281 disk module 133 hardware path filler mdoule 133 interpreting 172 interface...
Page 411 managing disk array capacity 189 order numbers 365 memory recommended for HP System/E racks 118 battery backup for 261 troubleshooting 284 DIMMs 239 performance servicing notes 239 array configuration 69 SIMMs 239 I/Os per second 70 impact of configuration settings 196 installation 163 rebuild 59 removal and replacement 340...
Page 412 power supply power, controller enclosure troubleshooting 285 redundancy, controller enclosure 39 power supply assembly power-down sequence 171 described 274 powering up the disk array 164 illustrated 274 power-up servicing notes 274 controller 213 power supply cage/midplane assy, controller LEDs 213 enclosure self tests 213 removal and replacement 352...
Page 413 storage capacity 71 enclosure 349 three disk enclosure array 82 MIA 340 two disk enclosure array 78 power button assy, disk enclosure 312 RAID level comparison power supply cage/midplane assy, controller application and I/O pattern performance enclosure 352 characteristics 58 power supply fan module, controller data redundancy characteristics 55 enclosure 328...
Page 414 servicing Status LEDs battery backup module 263 Controller Subsystem 218 battery harness 271 status LEDs, controller enclosure controller backpanel 248 normal operation 169, 217 controller card cage 248 status LEDs, disk enclosure controller fan 256 normal operation 167 memory 239 steady state current 114 power harness 272 power interface board 274...
Page 415 unsupported Windows 98 selecting disks for 189 troubleshooting selecting RAID level for 193 battery backup module problems 263 setting stripe segment size 194 checklist 211 controller backpanel problems 249 warranty information 376 controller fan problems 257 weight controller problems 257 controller enclosure 368 cooling problems 252 disk enclosure 372...
Page 416 Index...

This manual is also suitable for:

Surestore e disk array fc60

HP Surestore Disk Array 12h - And FC60 Service Manual

1 Product Description

2 Topology and Array Planning

3 Installation

4 Managing the Disk Array

5 Troubleshooting

6 Removal and Replacement

7 Reference / Legal / Regulatory

Quick Links

Troubleshooting

Related Manuals for HP Surestore Disk Array 12h - And FC60

Summary of Contents for HP Surestore Disk Array 12h - And FC60