Related Manuals for EMC ATMOS
Summary of Contents for EMC ATMOS
- Page 1 EMC A TMOS Hardware Guide Revision 1.6 EMC C ORPORATION Corporate Headquarters: Hopkinton, MA 01748‐9103 ‐ ‐ ‐ 1000 www.EMC.com...
- Page 2 © 2009 EMC Corporation. All rights reserved. EMC believes the information in this publication is accurate as of its publication date. The information is subject to change without notice. The information in this publication is provided “as is.” EMC Corporation makes no representations or warranties of any kind with respect to the information in this publication, and specifically disclaims implied warranties of merchantability or fitness for a particular purpose. Use, copying, and distribution of any EMC software described in this publication requires an applicable software license. EMC is a registered trademark and Atmos is a trademark of EMC Corporation. All other trademarks used herein are the property of their respective owners.
-
Page 3: Table Of Contents
Contents Preface ............5 Documentation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5 InfiniFlex Documentation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6 Introduction . - Page 4 Promo Code 3 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 24 Promo Code 5 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 25 Network Diagrams . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 26 Promo Code 1 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 26 Promo Code 3 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 27 Promo Code 5 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 28 Power Connections . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 29 Promo Code 1 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 29 Promo Code 3 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 30 Promo Code 5 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 31 Troubleshooting ............32 Servers ...
-
Page 5: Preface
Preface ® ™ This document describes the hardware components of the EMC Atmos platform. Documentation The following documents comprise the Atmos documentation set. You can find them at EMCʹs Powerlink Web site (powerlink.emc.com). After logging in, select Support > Technical Documentation and Advisories, then the links to software or hardware documentation for Atmos. Document Description Intended Audience EMC Atmos Release Notes Presents summary information about Anyone preparing for a new changes in a given release. Atmos release. EMC Atmos Conceptual Presents a high‐level overview of All Atmos users. Overview Atmos. EMC Atmos Installer’s Explains how to install and configure Anyone who installs and Guide Atmos on VMware and physical configures Atmos software hardware. Also, introduces the Atmos and plans to access their installable file system, and provides Atmos system via a file installation and configuration system. instructions for it. EMC Atmos System Describes how to use the Atmos system managers. ... -
Page 6: Infiniflex Documentation
InfiniFlex Documentation The following hardware documentation is available online: DS‐9924T Installation and Replacement Guide (P/N 300‐006‐885, rev 1) DS‐F20P‐10GigE Installation and Replacement Guide (P/N 300‐006‐884, rev 1) Replacing a Blower Module in an InfiniFlex DAE Replacing a Disk Module in an InfiniFlex DAE Replacing a Link Control Card in an InfiniFlex DAE Replacing a Power Supply/System Cooling Module in an InfiniFlex DAE SVR‐D1U‐1950 SVR‐D2U1950 Installation and Replacement Guide (P/N 300‐006‐688, A02) InfiniFlex 44U Cabinet Unpacking and Setup Guide (P/N 300‐006‐918, A01) Site Preparation Guide for InfiniFlex Storage Systems in a 44U Cabinet (P/N 300‐005‐849‐03) Preface... -
Page 7: Introduction
Introduction ® ™ The EMC Atmos platform address customers’ requirements for storage of active content. Atmos hardware is a server‐based JBOD storage platform that is optimized to run Atmos software. Atmos hardware comprises the hardware components necessary to support a JBOD‐based, bulk‐storage platform. The system optionally supports high‐availability (HA) power end to end. To support JBOD, Atmos hardware includes 1U Intel‐based Dell 1950 servers with an LSI SAS HBA that provides the connection to SATA disks. To achieve the highest density, disk enclosures (disk‐enclosure DAEs) are mounted in a specially designed 44U Atmos hardware rack. This rack is designed as a standard IT cabinet, holds two DAEs in a single 3U shelf height, and supports the weight of 360 disks and associated disk enclosures, servers, and network switches. Customers connect to the Atmos system over Gbe ports or 10 Gbe ports based on switch configurations. Customers provide their own interconnect cables. Atmos hardware has the following features and benefits: Provides configuration flexibility: you can vary server‐to‐drive ratios. Uses 1U servers, which allow data‐in‐place server upgrades. 30 drives in 3U. Leverages CLARiiON UltraPoint design and reliability. Enables rapid deployment on a petabyte scale, worldwide. Uses EMC factory‐direct configurations. Adopts the anytime, anywhere service model (by customers, EMC, or both). Applies EMC engineering best practices and product quality. Requires no special power and cooling requirements. Dense and standard racks, with customizable configurations. Storage on a massive scale. Hardware is managed by Atmos software. -
Page 8: General Specifications
General Specifications Power Some HA configurations (3‐6) 220V L6‐30 single phase Max 10,300W Infrastructure Gbe or 10Gbe 1:15 or 1:60 server‐to‐drive ratio 240‐360 TB (Atmos hardware rack configuration) 120 TB (Titan rack configuration) Servers Dell 1950 Dual hardware RAID1 internal disks Storage and Server Elements Server-platform Features Server Configuration Disk-enclosure DAE Platform Features 64‐bit dual‐core Intel Xeon Harpertown 2.33 Ghz 15 SATA drive JBOD processor 5100 on 65nm technology 4GB FBD memory Cost‐efficient, native SATA drive deployment Quad‐core processor DVD ROM (5400 technology) UltraPoint chassis, power, Dual 250GB SATA 3ʺ HDD ... -
Page 9: General Operational Information
General Operational Information Data protection is accomplished with data replication on multiple servers. The system does not require or support RAID for customer data; data is protected by redundant copies. Servers contain an LSI 3801 simple SAS/SATA HBA for customer data. Servers support hardware RAID1 mirrors for the internal operating‐system drives. Disk configuration is based on ratios of 1:15 or 1:60 per cabinet. No RAID is used, so 15 or 60 physical disks are presented to the operating system. A server failure causes the system to lose access to all drives. There is no caching, so there is no potential for data loss. The system supports email home, depending on customer‐service levels. Disk drives and DAE LEDs can be blinked manually. 1: Introduction General Operational Information... -
Page 10: Configurations
Configurations Configuration Overview Atmos has three promo‐code configurations for deployment. Promo codes 1 and 3 leverage the InfiniFlex 20000 hardware components and rack enclosure; Promo 5 uses InfiniFlex hardware in a NEMA‐standard 40U rack. The promo‐code configurations are listed below. Promo 1 Promo 3 Promo 5 General specifications: TB/cabinet Server:drive ratio 1:60 1:15 1:15 Disk drives Hitachi 1TB, 7200rpm Hitachi 1TB, Hitachi 1TB, (see notes following 7200rpm 7200rpm this table) Network Redundancy PDU, PS, fan PDU, PS, fan Servers (1U Dell 1950s) 3U disk‐enclosure DAEs 24 (12 trays) 16 (8 trays) Gbe switches 1 Allied Telesis ... -
Page 11: All Configurations
All Configurations Atmos software is loaded in the field (not in manufacturing). Servers ship to customers with no operating system. Promo Codes 1 and 3 Standard 44U Atmos hardware racks IA X86 open‐standards architecture Disk‐enclosure SAS/SATA DAEs In‐line configuration, 30 drives in 3U Ships pre‐racked and pre‐configured 44U 19ʺ NEMA rack enclosure Full service accessibility Front‐to‐back cooling Clean cabling design Promo code 1 will be shipped with 5400rpm Western Digital drives as soon as those drives are qualified; this will lower the power consumption of this configuration. Promo Code 5 40U rack Designed to 4900 Watts/rack Includes HA power; 2 PDUs/rack for HA, each fed by 220v, L6‐30, single‐phase Power requirements: Server (8): 1920W DAE (8): 2880 W GbE Switch (1): 80W 2: Configurations Configuration Overview... -
Page 12: Views Of Cabinets
Views of Cabinets Front and Back of Promo Code 1 The rack front on the left has trim and front door intact. The rack front in the middle has trim and front door removed and storage tray pulled out. 2: Configurations Views of Cabinets... -
Page 13: Front And Back Of Promo Code 3
Front and Back of Promo Code 3 The rack front on the left has trim and front door intact. The rack front in the middle has trim and front door removed and storage tray pulled out. Front and Back of Promo Code 5 2: Configurations Views of Cabinets... -
Page 14: Hardware Details
Hardware Details Data Unavailable (DU) A failure on most system components causes a Data Unavailable (DU) until the component is replaced. This section describes general operating behavior with respect to DU conditions. Atmos software tolerates failed components, and depending on the customer’s policy, the loss or one or more components would not make data unavailable at the system level. For example, if there are three replicas and one fails, the customer’s data would still be available. All Configurations There is one server connected to the DAEs; there is no HA path. The SAS cables contain four lanes of SAS communication. The DAEs contain a single LCC board with no hardware failover capabilities. Promo Code 1 All components in the system contain one power supply. Any power supply failure causes a DU. The SAS cables to the DAEs are serially chained. A failure on the rear DAE causes a DU on the entire server. The switches also could be a single‐point failure which causes a DU. The switches do have redundant, field‐replaceable power supplies. -
Page 15: Block Diagram: Promo Code 1
Block Diagram: Promo Code 1 3: Hardware Details Block Diagram: Promo Code 1... -
Page 16: Server Details
Server Details Front View Power button NMI button (do not use) System identification button (blinks a blue status indicator in front and back) LCD display (shows status and error messages): Blue (solid) — Everything is okay. Amber — An error was detected. Blue (blinking) — The system identification button was selected. Two USB connections Video connection Two 250GB 3.5” SATA HD Slim DVD drive 3: Hardware Details Server Details... -
Page 17: Rear View
Rear View Serial connection Video connection Two USB connections NIC1 connection (ETH0) NIC2 connection (ETH1) Power supply 1 Power supply 2 (optional) NMI button System identification button System status indicator (same function as front LED display) PCI expansion slot 2 PCI expansion slot 1 : Promo Code 1 — Servers have one power supply. O T E Promo Codes 3 and 5 — Servers have two power supplies. 3: Hardware Details Server Details... -
Page 18: Disk-Enclosure Dae
Disk-enclosure DAE Disk‐drive access for both the front and rear DAE is from the front of the cabinet. Front DAE LCC, blowers, and power supply are serviced from the front. Rear DAE LCC, blowers, and power supply are serviced from the rear. DAE tray has two service positions: Extend forward to service front DAE LCC, PS, blower, and rear DAE disk drives. Extend backward to remove the rear DAE from the rails. SAS cable and AC cord are routed along the side rails of the disk‐enclosure tray. : Promo Code 1 — DAEs have one power supply and one blower module. O T E Promo Code 3 — DAEs have two power supplies LED Activity Conditions for Disk-enclosure Front DAE Chassis Fault LED (amber) – DAE Speed LED (green/blue) – Solid = Fault in any FRU in chassis Currently, this has no function. -
Page 19: Led Activity Conditions For Disk-Enclosure Rear
LED Activity Conditions for Disk-enclosure Rear Blower Only Module Power Supply Module Fan Fault (solid amber) PS Status (green) Fan Power Fault (solid amber) PS Power Fault (solid amber) Blower status (green) PS Fan Fault (solid amber) LCC Status (green) Address Rotary Switch LCC fault (solid amber) Chassis Address 0-7 (blue) –... -
Page 20: Switches
Switches Gbe Switch: Allied Telesis AT-9924T 24 RJ‐45 connectors for 10BASE‐T, 100BASE‐T, and 1000BASE‐T (Auto Uplink™ on all ports) 4 small form‐factor pluggable (SFP) modules for fiber gigabit Ethernet interfaces, shared with copper ports 1/2 and 9/10 — customer supplied, if needed RS‐232 console port Dual power supplies Switch LED indicators: Per port: speed, link, activity Per device: power, fan status, stack ID, RPS, master The SFP modules are not populated in the factory. AC cords are routed along the side of the switch through the rail. 3: Hardware Details Switches... -
Page 21: 10Gbe Switch: Fujitsu Xg2000C
These ports comply with XFP MSA. The connection method varies depending on which XFP modules are installed. Ports 5-20 These ports comply with 10GBASE CX4 and are available for feeding Rated 3.3V/500mA. 20 ports, 10Gbps wire‐speed switching performance Ports 1‐4 comply with XFP MSA. Connection method varies, depending on which XFP modules are installed. Ports 5‐20 comply with 10GBASE‐CS4 and are available for feeding rated 2.2V/500mA. L2+ features (QoS aware) 16‐port CX4 plus 4‐port XFP optical (XG2000C) Flexible XFP interface (CX4, SR or LR) 4 XFP‐SR interfaces supplied by EMC 400+ Gbps non‐blocking throughput performance 300ns ultra‐low latency (including SerDes function) On‐chip 2.9MB multi‐stream buffer for full bandwidth performance 3: Hardware Details Switches... - Page 22 Support for 15KB jumbo frames Power consumption < 145W 1U form factor Rear Fan Unit Power Supply Unit Fan 2/3 Label PWR 1 Label PWR 0 Label Rear Fan LED Power Inlet Fan 0/1 Label Power Supply LED : Power supplies are field‐replaceable units or customer‐replaceable units. Fans are not O T E replaceable. 3: Hardware Details Switches...
-
Page 23: Sas Cabling And Disk-Enclosure Configurations
SAS Cabling and Disk-enclosure Configurations Promo Code 1 Each SAS cable has 4 lanes of 3Gb/sec SAS signals—12Gb/s total. Each DAE contains one power supply and one blower module. Each DAE contains one SAS LCC board. The LCC is in slot A on rear DAE and in slot B on the front DAE. 3: Hardware Details SAS Cabling and Disk‐enclosure Configurations... -
Page 24: Promo Code 3
Promo Code 3 Each SAS cable has four lanes of 3Gb/sec SAS signals—12Gb/s total. Each DAE contains two power supplies. Each DAE contains one SAS LCC board. The LCC is in slot A on rear DAE and in slot B on the front DAE. 3: Hardware Details SAS Cabling and Disk‐enclosure Configurations... -
Page 25: Promo Code 5
Promo Code 5 Each DAE contains two power supplies. Each server contains two power supplies. Each DAE contains one SAS LCC board. 3: Hardware Details SAS Cabling and Disk‐enclosure Configurations... -
Page 26: Network Diagrams
Network Diagrams Promo Code 1 3: Hardware Details Network Diagrams... -
Page 27: Promo Code 5
Promo Code 3 3: Hardware Details Network Diagrams... - Page 28 Promo Code 5 3: Hardware Details Network Diagrams...
-
Page 29: Power Connections
Power Connections Promo Code 1 3: Hardware Details Power Connections... -
Page 30: Promo Code 3
Promo Code 3 3: Hardware Details Power Connections... -
Page 31: Promo Code 5
Promo Code 5 3: Hardware Details Power Connections... -
Page 32: Troubleshooting
Troubleshooting This section includes tables for “Servers” on page 32, “Servers/Switches” on page 33, and “Disk Configurations” on page 35. Servers Symptom Probable Cause Recommended Actions (A) Server is not available or Bad or no AC power to the If System Status LED is on, cannot boot. server. proceed to symptom B. Server not responding to If all server LEDS are off, requests from clients. check AC cord. Verify it is plugged in to the power Server does not respond to supply on the back of the ping. server and the PDU. Server System Status LED Push the Server Power is off, blinking, or amber. button on the front panel. If no LEDS turn on, replace the server. If the System Status LED turns on but is blinking or Amber, proceed to symptom B. If the System Status LED turns on blue (takes ~10 seconds to stop blinking after AC power is restored) and the server is still unavailable, proceed to symptom B. -
Page 33: Servers/Switches
Symptom Probable Cause Recommended Actions (B) Server is not available or Server failed in BIOS or If the System Status LED is cannot boot and System Status operating system not present. amber and is scrolling an LED is on. error code, follow the directions under symptom Server not responding to requests from clients or other servers. If System Status LED is blue, continue with Server does not respond to network problems, ping. proceed to symptom C. System Status LED is amber with error code. (C) No ping/network response Server, network cables, or Verify the instructions on any of the subnet addresses switch. from symptom A were of one server. completed. No response to ping of This is an HA path. If none server on any network IP of the networks assigned addresses from another to a server responds to a server in the system. Ping, replace the server. - Page 34 Symptom Probable Cause Recommended Actions (E) No response to ping on Switch N OT E: It is important that multiple servers on some but multiple servers are exhibiting not all IP addresses. issues with networking. If only one server is having issues, see No response to ping on one or symptoms C and D. more IP addresses of multiple servers from another server Ensure all switches have inside the system. AC power—the POWER LED is green. If not, ensure AC is applied by swapping cords and AC outlets. If the FAULT LED is illuminated on a switch, reset the switch by removing and reinstalling the AC cord. If these steps do not resolve the problem, replace the switch. (F) Servers can be pinged from Switch, 10G links : It is important that the O T E other servers in the system but ...
-
Page 35: Disk Configurations
Disk Configurations Symptom Probable Cause Recommended Actions (G) Only 1 to 14 disk drives are Disk drive(s) If one drive is missing or accessible. faulty, physically locate the bad drive and replace Drive is unavailable. Drive is reporting faulted : To locate drives, O T E or is missing. look for Amber Fault LEDs. If a DAE fault LED is on blinking, the fault is in the DAE behind the blinking enclosure. If a DAE fault LED is on solid, the failure is in that enclosure. If more than one drive is faulted or not visible, power down the server and power‐cycle the DAEs. After DAEs are back up, power on the server. If multiple disks still remain faulted or missing, physically locate disks and replace. 4: Troubleshooting Disk Configurations... - Page 36 Symptom Probable Cause Recommended Actions (H) No disk drives accessible DAE LCC Check to see if the SAS from a server Cable link LED is DAE power supply illuminated. All 15 Drives are unavailable DAE blower module Power down the server. SAS cable Ensure SAS and power cords are fully seated. DAE midplane Check DAE LCC LED SAS controller status; if faulted, replace LCC. Check Power Supply LED status; if faulted or off, replace power supply. If DAEs have blower‐only modules, check blower LED status; if faulted, replace blower module. Power‐cycle the DAE. Power‐up the server. If troubles persist, replace cable and/or DAE as a last resort. 4: Troubleshooting Disk Configurations...
-
Page 37: Disk 1:60 Configuration
Disk 1:60 Configuration Symptom Probable Cause Recommended Actions (I) Only 46 to 60 disk drives are Disk drive(s) If one drive is faulty, accessible. physically locate the bad drive and replace it. Drive is unavailable. : To locate drives, O T E Drive is reporting faulted look for Amber Fault or is missing in Adaptec LEDs. If a DAE fault LED Storage Manager. is on blinking, the fault is in the DAE behind the blinking enclosure. If a DAE fault LED is on solid, the failure is in that enclosure. If more than one disk is faulted, power down the server and power cycle the DAEs. After DAEs are back up, power on the server. If multiple disks still remain faulted or missing, physically locate disks and ... - Page 38 Symptom Probable Cause Recommended Actions (J) Only 31 to 45 disk drives are Front DAE LCC Check to see if the SAS accessible. Cable link LED is Front DAE Power supply illuminated. 15 Drives are unavailable Either DAE Blower module Power down the server. Drives are only seen under 3 enclosures Cable between DAEs Ensure SAS and power cords are fully seated. Either DAE midplane Ensure Enclosure Addresses are set correctly: (0), (2) Rear DAEs, (1), (3) Front DAEs Check both front DAE LCC LEDs; if faulted, replace LCC. Check both front Power Supply LEDs; if faulted or off, replace power supply(ies) If DAEs have blower‐only modules, check both front and rear blowers LEDs; if faulted, replace blower module. Power‐cycle the DAEs. Power‐up the server; if troubles persist, replace ...
Need help?
Do you have a question about the ATMOS and is the answer not in the manual?
Questions and answers