Page 1
Oracle® Exadata Database Machine Installation and Configuration Guide 18c (18.1) E81011-08 November 2017...
Page 2
Oracle Corporation and its affiliates disclaim any liability for any damages caused by use of this software or hardware in dangerous applications.
Contents Preface Audience Documentation Accessibility Related Documentation Conventions Site Requirements for Oracle Exadata Database Machine and Oracle Exadata Storage Expansion Rack General Environmental Requirements 1.1.1 General Environmental Requirements for Oracle Exadata Database Machine X6-2, X6-8, and Later 1.1.2 General Environmental Requirements for Oracle Exadata Database Machine X5-2 1.1.3...
Page 4
2.2.1 Oracle Exadata Database Machine X7-2 Database Server 2.2.2 Oracle Exadata Database Machine X5-2 and X6-2 Database Server 2.2.3 Oracle Exadata Database Machine X5-8 and X6-8 Full Rack Database Server 2.2.4 Oracle Exadata Database Machine X4-2 Database Server 2.2.5 Oracle Exadata Database Machine X4-8 Full Rack Database Server 2.2.6...
Page 5
2.2.7 Oracle Exadata Database Machine X3-8 Full Rack and Oracle Exadata Database Machine X2-8 Full Rack Database Server Using Network VLAN Tagging with Oracle Exadata Database Machine 2-10 Network Channel Bonding Support 2-11 2.4.1 Bonded Network Configurations 2-11 2.4.1.1 Bonded Network Configuration for Oracle Exadata Database...
Page 6
Cell Alerting Configuration Page 3-24 3.2.16 Platinum Configuration Page 3-25 3.2.17 Auto Service Request Configuration Page 3-27 3.2.18 Oracle Configuration Manager Configuration Page 3-28 3.2.19 Grid Control Agent Configuration Page 3-29 OEDA Command Line Interface 3-30 3.3.1 About the OEDA Command Line Interface 3-30 3.3.2...
Page 7
Configuring Sun Datacenter InfiniBand Switch 36 Switch 5.1.1 Setting the Subnet Manager Master on Oracle Exadata Database Machine Full Rack and Oracle Exadata Database Machine Half Rack Configuring the Cisco Ethernet Switch 5.2.1 Configuring the Cisco Catalyst 4948 Ethernet Switch 5.2.2...
Page 8
5.3.1.8 PDU Thresholds for Oracle Exadata Database Machine X2-8 Full Rack 5-47 5.3.1.9 PDU Thresholds for Oracle Exadata Storage Expansion Rack with Exadata Storage Server with Sun Fire X4270 M2 Servers 5-49 Checking Exadata Storage Servers 5-55 Checking Oracle Database Servers...
Page 9
Database High Availability Checklist Index...
Audience This guide is intended for Oracle Exadata Database Machine customers and those responsible for data center site planning, configuration, and maintenance of Oracle Exadata Database Machine. Documentation Accessibility...
Page 11
Sun Flash Accelerator F40 PCIe Card User's Guide at http://docs.oracle.com/cd/ E29748_01/html/E29741/index.html • Sun Flash Accelerator F80 PCIe Card User's Guide at http://docs.oracle.com/cd/ E41278_01/html/E41251/index.html • Oracle Flash Accelerator F160 PCIe Card User Guide at http:// docs.oracle.com/cd/E54943_01/html/E54947/index.html • Oracle Flash Accelerator F320 PCIe Card User Guide at http:// docs.oracle.com/cd/E65386_01/html/E65387/index.html...
1.1.1 General Environmental Requirements for Oracle Exadata Database Machine X6-2, X6-8, and Later For Oracle Exadata Database Machine X6-2 and later environmental requirements, such as weight, acoustic level, power, cooling, and air flow, use the Oracle Exadata Configuration Assistant, available on Oracle Technology Network: http://www.oracle.com/technetwork/database/exadata/oeca-download-2817713.html 1.1.2 General Environmental Requirements for Oracle Exadata...
(page 1-47)" 1.1.3 General Environmental Requirements for Oracle Exadata Database Machine X5-8 Table 1-2 (page 1-4) shows the general environmental requirements for Oracle Exadata Database Machine X5-8. Other sections in this chapter provide detailed information. Table 1-2 Environmental Requirements for Oracle Exadata Database Machine...
The environmental requirements for Oracle Exadata Database Machine X4-2 depend on the size of the system. Table 1-3 (page 1-6) shows the general environmental requirements for Oracle Exadata Database Machine X4-2. The other sections in this chapter provide detailed information.
1.1.5 General Environmental Requirements for Oracle Exadata Database Machine X4-8 with Exadata Storage Server X5-2 Servers Table 1-4 (page 1-9) shows the general environmental requirements for Oracle Exadata Database Machine X4-8 with Exadata Storage Server X5-2 Servers. The other sections in this chapter provide detailed information.
Page 21
Chapter 1 General Environmental Requirements Table 1-4 Environmental Requirements for Oracle Exadata Database Machine X4-8 Racks with Exadata Storage Server X5-2 Servers Environmental Component Oracle Exadata Database Oracle Exadata Database Machine X4-8 Full Rack with Machine X4-8 Half Rack Exadata Storage Server...
1.1.6 General Environmental Requirements for Oracle Exadata Database Machine X4-8 Full Rack Table 1-5 (page 1-10) shows the general environmental requirements for Oracle Exadata Database Machine X4-8 Full Rack. The other sections in this chapter provide detailed information. Table 1-5...
The environmental requirements for Oracle Exadata Database Machine X3-2 depend on the size of the system. Table 1-6 (page 1-12) shows the general environmental requirements for Oracle Exadata Database Machine X3-2. The other sections in this chapter provide detailed information. 1-11...
Database Machine X3-8 Full Rack with Exadata Storage Server X4-2L Servers Table 1-7 (page 1-15) shows the general environmental requirements for Oracle Exadata Database Machine X3-8 Full Rack with Exadata Storage Server X4-2L Servers. The other sections in this chapter provide detailed information.
Page 27
Chapter 1 General Environmental Requirements Table 1-7 Environmental Requirements for Oracle Exadata Database Machine X3-8 Full Rack with Exadata Storage Server X4-2L Servers Environmental Component Oracle Exadata Database Machine X3-8 Full Rack with Exadata Storage Server X4-2L Servers Weight 911.27 kg (2009 lbs) See Also: "Flooring Requirements...
Page 28
Database Machine X3-8 Full Rack with Exadata Storage Server X3-2 Servers Table 1-8 (page 1-16) shows the general environmental requirements for Oracle Exadata Database Machine X3-8 Full Rack with Exadata Storage Server X3-2 Servers. The other sections in this chapter provide detailed information.
The environmental requirements for Oracle Exadata Database Machine X2-2 depend on the size of the system. Table 1-9 (page 1-17) shows the general environmental requirements for Oracle Exadata Database Machine X2-2. The other sections in this chapter provide detailed information. Table 1-9 Environmental Requirements for Oracle Exadata Database Machine...
(page 1-47)" 1.1.11 General Environmental Requirements for Oracle Exadata Database Machine X2-8 Full Rack Table 1-10 (page 1-19) shows the general environmental requirements for Oracle Exadata Database Machine X2-8 Full Rack. The other sections in this chapter provide detailed information. 1-18...
Page 31
Chapter 1 General Environmental Requirements Table 1-10 Environmental Requirements for Oracle Exadata Database Machine X2-8 Full Rack Environmental Component Oracle Exadata Database Oracle Exadata Database Machine X2-8 Full Rack Machine X2-8 Full Rack (Sun Fire X4800 Oracle (Sun Server X2-8 Oracle...
1.1.12 General Environmental Requirements for Oracle Exadata Storage Expansion Rack X6-2 and later For Oracle Exadata Storage Expansion Rack X6-2 and more recent systems, to get the environmental requirements, such as weight, acoustic level, power, cooling, and air flow, use the Oracle Exadata Configuration Assistant, available on Oracle...
Page 34
The environmental requirements for Oracle Exadata Storage Expansion Rack X4-2 depend on the size of the system. Table 1-12 (page 1-22) shows the general environmental requirements for each type of Oracle Exadata Storage Expansion Rack X4-2. Table 1-12 Environmental Requirements for Oracle Exadata Storage Expansion...
The environmental requirements for Oracle Exadata Storage Expansion Rack X3-2 depend on the size of the system. Table 1-13 (page 1-23) shows the general environmental requirements for each type of Oracle Exadata Storage Expansion Rack X3-2. Table 1-13 Environmental Requirements for Oracle Exadata Storage Expansion...
Exadata Storage Server with Sun Fire X4270 M2 Servers depend on the size of the system. Table 1-14 (page 1-25) shows the general environmental requirements for each type of Oracle Exadata Storage Expansion Rack with Exadata Storage Server with Sun Fire X4270 M2 Servers. Table 1-14 Environmental Requirements for Oracle Exadata Storage Expansion...
Oracle Exadata Racks up to Oracle Exadata Database Machine X6-8 All Oracle Exadata Racks up to Oracle Exadata X6-8 use the same rack, and have the same space requirements. The space requirements are as follows: •...
1.2.1 Receiving and Unpacking Requirements Before your Oracle Exadata Rack arrives, ensure that the receiving area is large enough for the package. Use the following package dimensions for Oracle Exadata Rack: •...
Page 42
Chapter 1 Space Requirements Table 1-19 (Cont.) Rack Weights for Oracle Exadata Database Machine Type of Rack Shipping Weight Net Weight Oracle Exadata Database Extreme Flash: 871.1 kg Extreme Flash: 794.5 kg Machine X6-2 Full Rack (1920.5 lbs) (1751.5 lbs) High Capacity: 941.0 kg...
Page 43
Chapter 1 Space Requirements Table 1-19 (Cont.) Rack Weights for Oracle Exadata Database Machine Type of Rack Shipping Weight Net Weight Oracle Exadata Database High performance drives: 951 High performance drives: 867 Machine X4-8 Full Rack kg (2097 lbs) kg (1912 lbs)
Page 44
Chapter 1 Space Requirements Table 1-20 (Cont.) Rack Weights for Oracle Exadata Storage Expansion Rack Type of Rack Shipping Weight Net Weight Oracle Exadata Storage Extreme Flash: 430.7 kg Extreme Flash: 364.5 kg Expansion X7-2 Quarter Rack (949.5 lbs) (803.5 lbs) High Capacity: 450.6 kg...
You can also request that the rack be shipped in a truck with a lift gate. When Oracle Exadata Rack arrives, leave the rack in its shipping packaging until it arrives at its installation site. Use a conditioned space to remove the packaging material to reduce particles before entering the data center.
914 mm (36 inches) 1.3 Flooring Requirements Oracle recommends that Oracle Exadata Rack be installed on raised flooring. The site floor and the raised flooring must be able to support the total weight of Oracle Exadata Rack. Table 1-23 (page 1-34) lists the floor load requirements.
Page 47
Chapter 1 Electrical Power Requirements The following are the PDUs that Exadata currently supports or has supported in the past: • Table 1-24 (page 1-35) Low-voltage 15 kVA Single Phase PDUs for North America, South America, Japan and Taiwan (2 PDUs per Rack) •...
Page 48
Data center receptacle 15kVA, with three 30A/250V 2-pole/3-wire NEMA L6-30P plugs The following are needed to connect an Oracle Exadata system to a low-voltage one- phase power source: • 6 power cords for two PDUs, 30 amperes at 200 - 240 VAC •...
Page 49
Chapter 1 Electrical Power Requirements • 2 power cords for two PDUs, 60 amperes at 190 - 220 VAC three-phase • 2 receptacles to connect the PDUs to 2 IEC 60309 60A 4-pin 250VAC 3ph IP67 data center receptacles Figure 1-2 (page 1-37) shows the low-voltage, three phase PDU power connector for North America, South America, Japan and Taiwan.
Page 50
Data center receptacle 15kVA, three phase, 5-pin, IEC 60309 32A, 5- pin 230/400V, three phase IP44 The following are needed to connect an Oracle Exadata system to a high-voltage three-phase power source: • 2 power cords for two PDUs, 25 amperes at 220/380 - 240/415 VAC three-phase •...
Page 51
Outlet groups Group protection (UL489 2-pole circuit breaker) Data center receptacle Hubbell CS8265C The following are needed to connect an Oracle Exadata system to a low-voltage single-phase power source: • 3 power cords for two PDUs • 6 receptacles to connect the PDUs...
Page 52
The high-voltage 15kVA single phase PDU is no longer available. The high- voltage 22kVA is a compatible replacement with the same receptacle and breaker requirements The following are needed to connect an Oracle Exadata system to a high-voltage one- phase power source: •...
Page 53
Group protection (UL489 2-pole circuit breaker) Data center receptacle IEC309-3P4W-IP67 60A 250VAC 3ph (Hubbell equivalent is HBL460R9W) The following are needed to connect an Oracle Exadata system to a low-voltage three- phase power source: • 4 power cords for two PDUs •...
Page 54
20 A breaker) Data center receptacle IEC 309-3P4W-IP67 plugs The following are needed to connect an Oracle Exadata system to a low-voltage three- phase power source: • 3 power cords for each PDU, 60 amperes at 190 - 220 VAC three-phase •...
Chapter 1 Electrical Power Requirements The following are needed to connect an Oracle Exadata system to a low-voltage three- phase power source: • 2 power cords for two PDUs, 60 amperes at 190 - 220 VAC three-phase • 3 receptacles to connect the PDUs to 2 IEC 60309 60A 4-pin 250VAC 3ph IP67 data center receptacles •...
1.5 Temperature and Humidity Requirements Airflow through Oracle Exadata Rack is from front to back. Refer to General Environmental Requirements (page 1-1) for information on cooling and airflow.
Chapter 1 Ventilation and Cooling Requirements Operating in this temperature range provides a safety buffer in the event that the air conditioning system goes down for a period of time. The ambient relative humidity range of 45 to 50 percent is suitable for safe data processing operations.
Page 58
Distribution of the temperature and humidity across the entire room is uneven. Oracle Exadata Racks have been designed to function while mounted in a natural convection air flow. The following requirements must be followed to meet the environmental specification: •...
1.7 Network Connection and IP Address Requirements for Oracle Exadata Database Machine The network cables must be run from your network equipment to the location of Oracle Exadata Database Machine. The requirements to connect to your existing Ethernet network infrastructure are described in the following sections: 1.7.1 Network Connection Requirements for Oracle Exadata Database...
Page 60
This network is optional. A cable is not required unless the network is configured during deployment. Oracle Exadata Database Machine X2-8 Full Rack has a total of 16 Ethernet ports per server. The additional networks for Oracle Exadata Database Machine X2-8 Full Rack are NET2 through NET15.
Page 61
Chapter 1 Network Connection and IP Address Requirements for Oracle Exadata Database Machine Table 1-35 (Cont.) Examples of Network Configurations and Connection Requirements for Oracle Exadata Database Machine 2-Socket Systems X3-2 and Later Scenario Network Requirements Non-bonded network configuration, and •...
The assistant-generated file defines the SCAN as a single name with three IP addresses on the client access network. The three SCAN addresses provide service access for clients to Oracle Exadata Database Machine. Configure DNS for round robin resolution for the SCAN name to these three SCAN addresses.
1.7.3 IP Address Requirements for Oracle Exadata Database Machine Oracle Exadata Database Machine requires a large number of host names and IP addresses during initial configuration. The number of IP addresses required for a particular network, such as the management network, depends on the type of system.
Page 64
Chapter 1 Network Connection and IP Address Requirements for Oracle Exadata Database Machine Table 1-37 IP Address Requirements for Oracle Exadata Database Machine X5-2 and Later Systems Type of Oracle Management Client Access Additional InfiniBand Private Exadata Database Network Network...
Page 65
Chapter 1 Network Connection and IP Address Requirements for Oracle Exadata Database Machine Table 1-37 (Cont.) IP Address Requirements for Oracle Exadata Database Machine X5-2 and Later Systems Type of Oracle Management Client Access Additional InfiniBand Private Exadata Database Network...
Page 66
Chapter 1 Network Connection and IP Address Requirements for Oracle Exadata Database Machine Table 1-37 (Cont.) IP Address Requirements for Oracle Exadata Database Machine X5-2 and Later Systems Type of Oracle Management Client Access Additional InfiniBand Private Exadata Database Network...
Page 67
Chapter 1 Network Connection and IP Address Requirements for Oracle Exadata Database Machine Table 1-37 (Cont.) IP Address Requirements for Oracle Exadata Database Machine X5-2 and Later Systems Type of Oracle Management Client Access Additional InfiniBand Private Exadata Database Network...
Page 68
InfiniBand, and 1 for Ethernet • 2 IP addresses for monitoring electric current of the PDUs The following table lists the IP address requirements for Oracle Exadata Database Machine X4-2, and Oracle Exadata Database Machine X4-8 Full Rack: 1-56...
Page 69
Chapter 1 Network Connection and IP Address Requirements for Oracle Exadata Database Machine Table 1-38 IP Address Requirements for Oracle Exadata Database Machine X4-2 and X4-8 Full Rack Type of Oracle Management Client Access Additional InfiniBand Private Exadata Database Network...
Page 70
Chapter 1 Network Connection and IP Address Requirements for Oracle Exadata Database Machine Table 1-38 (Cont.) IP Address Requirements for Oracle Exadata Database Machine X4-2 and X4-8 Full Rack Type of Oracle Management Client Access Additional InfiniBand Private Exadata Database...
Page 71
Chapter 1 Network Connection and IP Address Requirements for Oracle Exadata Database Machine Table 1-38 (Cont.) IP Address Requirements for Oracle Exadata Database Machine X4-2 and X4-8 Full Rack Type of Oracle Management Client Access Additional InfiniBand Private Exadata Database...
Page 72
InfiniBand, and 1 for Ethernet • 2 IP addresses for monitoring electric current of the PDUs The following table lists the IP address requirements for Oracle Exadata Database Machine X3-2 and Oracle Exadata Database Machine X3-8 Full Rack: 1-60...
Page 73
Chapter 1 Network Connection and IP Address Requirements for Oracle Exadata Database Machine Table 1-39 IP Address Requirements for Oracle Exadata Database Machine X3-2 and Oracle Exadata Database Machine X3-8 Full Rack Type of Oracle Management Client Access Additional InfiniBand Private...
Page 74
Chapter 1 Network Connection and IP Address Requirements for Oracle Exadata Database Machine Table 1-39 (Cont.) IP Address Requirements for Oracle Exadata Database Machine X3-2 and Oracle Exadata Database Machine X3-8 Full Rack Type of Oracle Management Client Access Additional...
Page 75
Chapter 1 Network Connection and IP Address Requirements for Oracle Exadata Database Machine Table 1-39 (Cont.) IP Address Requirements for Oracle Exadata Database Machine X3-2 and Oracle Exadata Database Machine X3-8 Full Rack Type of Oracle Management Client Access Additional...
Page 76
Chapter 1 Network Connection and IP Address Requirements for Oracle Exadata Database Machine Table 1-39 (Cont.) IP Address Requirements for Oracle Exadata Database Machine X3-2 and Oracle Exadata Database Machine X3-8 Full Rack Type of Oracle Management Client Access Additional...
Page 77
InfiniBand, and 1 for Ethernet • 2 IP addresses for monitoring electric current of the PDUs The following table lists the IP address requirements for Oracle Exadata Database Machine X2-2 and Oracle Exadata Database Machine X2-8 Full Rack: 1-65...
Page 78
Chapter 1 Network Connection and IP Address Requirements for Oracle Exadata Database Machine Table 1-40 IP Address Requirements for Oracle Exadata Database Machine X2-2 and Oracle Exadata Database Machine X2-8 Full Rack Type of Oracle Management Client Access Additional InfiniBand Private...
Page 79
Chapter 1 Network Connection and IP Address Requirements for Oracle Exadata Database Machine Table 1-40 (Cont.) IP Address Requirements for Oracle Exadata Database Machine X2-2 and Oracle Exadata Database Machine X2-8 Full Rack Type of Oracle Management Client Access Additional...
Page 80
Chapter 1 Network Connection and IP Address Requirements for Oracle Exadata Database Machine Table 1-40 (Cont.) IP Address Requirements for Oracle Exadata Database Machine X2-2 and Oracle Exadata Database Machine X2-8 Full Rack Type of Oracle Management Client Access Additional...
The number of IP addresses depends on the physical deployment, as well as the number of virtual user domains. The following equations show how to calculate the number of IP addresses required for the physical deployment and Oracle VM deployment.
Page 82
Chapter 1 Network Connection and IP Address Requirements for Oracle Exadata Database Machine (number of Ethernet switches) Number of client access network IP addresses = (number of database servers)*2 + 3 Number of InfiniBand network IP addresses = (number of database servers)*2 +...
Page 83
Chapter 1 Network Connection and IP Address Requirements for Oracle Exadata Database Machine Table 1-41 IP Address Requirements by Component Component Management Client Access Additional InfiniBand Network Network Networks (NET2 Private Network and NET3) Database server Physical Physical Physical Physical...
Chapter 1 Network Connection and IP Address Requirements for Oracle Exadata Storage Expansion Rack Table 1-42 Examples of IP Address Requirements when Using Oracle VMs Deployment IP Address Requirements Oracle Exadata Database Machine X6-2 • 19 IP addresses for the management...
Page 85
Chapter 1 Network Connection and IP Address Requirements for Oracle Exadata Storage Expansion Rack – 1 Ethernet connection for each Sun Datacenter InfiniBand Switch 36. – 1 Ethernet connection for each Exadata Storage Server. For Oracle Exadata Storage Expansion Full Rack, there are 18 connections, for Oracle Exadata Storage Expansion Half Rack there are 9 connections, and for Oracle Exadata Storage Expansion Quarter Rack there are 4 connections.
Page 86
Chapter 1 Network Connection and IP Address Requirements for Oracle Exadata Storage Expansion Rack Table 1-43 IP Address Requirements for Oracle Exadata Storage Expansion Rack Type of Oracle Exadata Storage Expansion Network Requirements Rack Oracle Exadata Storage Expansion X4-2 Full...
PDUs • 4 IP addresses for the private InfiniBand network 1.9 Ensuring Site is Ready Before Oracle Exadata Rack is delivered to the site, the following tasks must be performed to ensure the site is ready: 1-75...
Page 88
Review the safety guidelines. Note problems or peculiarities at the site that require special equipment. For example, ensure the doors are tall enough and wide enough for Oracle Exadata Rack. Verify that the installation site flooring has a strength rating to withstand the combined weight of Oracle Exadata Rack and any other installed equipment.
The information in this section should be used in conjunction with Oracle Exadata Deployment Assistant to configure your environment for Oracle Exadata Database Machine.
Page 90
– Oracle Exadata Database Machine Two-Socket systems, use either: The embedded NET1 and NET2 ports The two 10 GbE ports or two 10/25GbE ports on Oracle Exadata Database Machine X7-2 – Oracle Exadata Database Machine Eight-Socket systems, X4-8 or higher Use two ports, with each port on a different PCIe card –...
Page 91
The file contains a mapping between the NUMA node numbers and the IP address of the network interface card closest to each node. Oracle Database uses the file to select the closest network interface card when communicating with Exadata Storage Servers, thereby optimizing performance.
Page 92
The following image shows the default network diagram for Oracle Exadata Database Machine X4-2 and later models. Use the files from Oracle Exadata Database Machine Deployment Assistant to verify the cable connections when cabling Oracle Exadata...
Page 93
Additional network 1 (optional) The following image shows the default network diagram for Oracle Exadata Database Machine X3-2 and Oracle Exadata Database Machine X2-2. Use the files from Oracle Exadata Database Machine Deployment Assistant to verify the cable connections when cabling Oracle Exadata Database Machine to the existing network.
Page 94
Database Machine X2-8 Full Rack have BONDIB0, BONDIB1, and so on for the InfiniBand private network. • The KVM switch is only available in Oracle Exadata Database Machine X2-2 racks. • Additional configuration, such as defining multiple virtual local area...
Network Components and Interfaces 2.2.5 Oracle Exadata Database Machine X4-8 Full Rack Database Server Each Oracle Exadata Database Machine X4-8 Full Rack database server consists of the following network components and interfaces: • 4 dual-port 4x QDR (40 Gb/s) InfiniBand Host Channel Adapter (HCA) •...
Virtual deployments do not support IPv6 VLANs. • If your system will use more than 10 VIP addresses in the Oracle RAC cluster and you have VLAN configured for the Oracle Clusterware client network, then you must use 3 digit VLAN ids. Do not use 4 digit VLAN ids because the VLAN name can exceed the 15 character operating system interface name limit.
Network Channel Bonding Support 2.4.1.1 Bonded Network Configuration for Oracle Exadata Database Machine Two-Socket Systems When using a bonded network configuration for database client access on Oracle Exadata Database Machine Two-Socket Systems, the database servers are configured as follows: •...
Oracle Exadata Database Machine database server. 2.4.1.2 Bonded Network Configuration for Oracle Exadata Database Machine X7-8 When using a bonded network configuration for database client access on Oracle Exadata Database Machine X7-8, the database servers are configured as follows: •...
GbE switches 2.4.1.3 Bonded Network Configuration for Oracle Exadata Database Machine X4-8, X5-8, and X6-8 When using a bonded network configuration for database client access on Oracle Exadata Database Machine X4-8, X5-8, and X6-8, the database servers are configured as follows: •...
2.4.1.4 Bonded Network Configuration for Oracle Exadata Database Machine X3-8 Full Rack and Oracle Exadata Database Machine X2-8 Full Rack When using a bonded network configuration for database client access on Oracle Exadata Database Machine X3-8 Full Rack and Oracle Exadata Database Machine X2-8 Full Rack, the database servers are configured as follows: •...
ETH0 interface. • Port NET1: Provides access to the database using the client access network through the ETH1 interface. The Oracle RAC SCAN and VIP addresses are defined on this interface. • Port NET MGT: Provides access to the Integrated Lights Out Manager (ILOM) using the management network.
ETH0 interface. • Port NET1: Provides access to the database using the client access network through the ETH1 interface. The Oracle RAC SCAN and VIP addresses are defined on this interface. • Port NET MGT: Provides access to the ILOM using the management network.
ETH0 interface. • Port NET1: Provides access to the database using the client access network through the ETH1 interface. The Oracle RAC SCAN and VIP addresses are defined on this interface. • Port NET MGT: Provides access to the ILOM using the management network.
Bonded network configuration— There are 15 open ports (7 1 GbE ports and 8 open 10 GbE ports) on each database server • On Oracle Exadata Database Machine X3-8 Full Rack and X2-8 Full Rack: – Non-bonded network configuration— There are 14 open ports (NEM0/NET2,...
2.5 Default IP Addresses Starting with Oracle Exadata Storage Server Software release 12.1.2.1.0, the NET0 IP addresses are assigned dynamically by the elastic configuration procedure during the first start of the system. The addresses are in the 172.16.2.1 to 172.16.7.254 range. In earlier releases, Oracle Exadata Database Machine had default IP addresses set at the factory, and the range of IP addresses was 192.168.1.1 to 192.168.1.203.
Page 109
Chapter 2 Default IP Addresses Table 2-6 (Cont.) Default IP Addresses for Oracle Exadata Database Machine X5-2 and Higher Component NET0 IP Addresses ILOM IP Addresses InfiniBand Active Bonded IP Addresses Exadata Storage Assigned during first 192.168.1.116 Not applicable Server 8...
Page 110
Chapter 2 Default IP Addresses The following table lists the default IP addresses for Oracle Exadata Database Machine X4-2. The subnet mask is 255.255.252.0. Table 2-7 Default IP Addresses for Oracle Exadata Database Machine X4-2 Component NET0 IP Addresses ILOM IP Addresses...
Page 111
Ethernet switch 192.168.1.200 Not applicable Not applicable The following table lists the default IP addresses for Oracle Exadata Database Machine X3-2 and Oracle Exadata Database Machine X2-2. Table 2-8 Default IP Addresses for Oracle Exadata Database Machine X3-2 and Oracle Exadata Database Machine X2-2...
Page 112
Chapter 2 Default IP Addresses Table 2-8 (Cont.) Default IP Addresses for Oracle Exadata Database Machine X3-2 and Oracle Exadata Database Machine X2-2 Component NET0 IP Addresses ILOM IP Addresses InfiniBand Bonded IP Addresses Exadata Storage 192.168.1.19 192.168.1.119 192.168.10.19 Server 11 (Oracle...
Page 113
Chapter 2 Default IP Addresses Table 2-8 (Cont.) Default IP Addresses for Oracle Exadata Database Machine X3-2 and Oracle Exadata Database Machine X2-2 Component NET0 IP Addresses ILOM IP Addresses InfiniBand Bonded IP Addresses Oracle Database 192.168.1.10 192.168.1.110 192.168.10.10 server 3 (Oracle...
Page 114
192.168.1.200 Not applicable Not applicable The following table lists the default IP addresses for Oracle Exadata Database Machine X5-8, X6-8, and X7-8 Full Rack. The subnet mask is 255.255.252.0. Table 2-9 Default IP Addresses for Oracle Exadata Database Machine X5-8 and...
Page 115
Ethernet switch 192.168.1.200 Not applicable Not applicable The following table lists the default IP addresses for Oracle Exadata Database Machine X4-8 Full Rack. The subnet mask is 255.255.252.0. Note: For Oracle Exadata Database Machine X4-8 racks with Exadata Storage Server X5-2 Servers, the NETO IP addresses are assigned during the elastic configuration process.
Page 116
Chapter 2 Default IP Addresses Table 2-10 Default IP Addresses for Oracle Exadata Database Machine X4-8 Full Rack Component NET0 IP Addresses ILOM IP Addresses InfiniBand Bonded IP Addresses Exadata Storage 192.168.1.22 192.168.1.122 192.168.10.43 Server 14 192.168.10.44 Exadata Storage 192.168.1.21 192.168.1.121...
Page 117
Not applicable Not applicable The following table lists the default IP addresses for Oracle Exadata Database Machine X3-8 Full Rack and Oracle Exadata Database Machine X2-8 Full Rack. The subnet mask is 255.255.252.0. Table 2-11 Default IP Addresses for Oracle Exadata Database Machine X3-8...
Page 118
InfiniBand Switch 36 switch 2 Sun Datacenter 192.168.1.201 Not applicable Not applicable InfiniBand Switch 36 switch 1 Ethernet switch 192.168.1.200 Not applicable Not applicable The following table lists the default IP addresses for Oracle Exadata Storage Expansion Rack X4-2. 2-30...
Page 119
Chapter 2 Default IP Addresses Table 2-12 Default IP Addresses for Oracle Exadata Storage Expansion Rack X4-2 Component NET0 IP Addresses ILOM IP Addresses InfiniBand Active Bonded IP Addresses Exadata Storage 192.168.1.68 192.168.1.168 192.168.10.86 Server 18 192.168.10.85 Exadata Storage 192.168.1.67 192.168.1.167...
Page 120
PDU-B 192.168.1.213 Not applicable Not applicable The following table lists the default IP addresses for Oracle Exadata Storage Expansion Rack X3-2, and Oracle Exadata Storage Expansion Rack with Exadata Storage Server with Sun Fire X4270 M2 Servers. Table 2-13 Default IP Addresses for Oracle Exadata Storage Expansion Rack...
Not applicable 2.6 Port Assignments When Using a Firewall The following table lists the ports used by services on Oracle Exadata Database Machine. When network communication requires access through a firewall, review the list and open the necessary ports. All ports are on the management network, except for port 1521 which is on the client network.
Page 122
Chapter 2 Port Assignments When Using a Firewall Table 2-14 Open Ports for Firewall Source Target Protocol Port Network Application Database SSH over Management servers, storage cells, and ILOMs for database servers, Exadata Storage Servers, and InfiniBand switches SSH over Management SSH for serial sessions to...
Page 123
SNMP over Management SNMP (user configurable) Exadata SNMP SNMP Management SNMP version Storage subscriber 1 (SNMPv1) Servers such as outgoing traps Oracle (user- Enterprise configurable) Manager Grid Control or an SNMP manager Database ASR Manager SNMP Management Telemetry servers, messages Exadata...
Page 124
Chapter 2 Port Assignments When Using a Firewall Table 2-14 (Cont.) Open Ports for Firewall Source Target Protocol Port Network Application ASR Manager ASR backend HTTPS Management Telemetry messages sent to ASR backend ILOMs for HTTPS Management Web (user database configurable) servers, Exadata...
Page 125
Chapter 2 Port Assignments When Using a Firewall Table 2-14 (Cont.) Open Ports for Firewall Source Target Protocol Port Network Application evnd Management partitiond Management Database 1521 Client Database servers listener 2068 Management KVM session data for keyboard and mouse transmission, or for video transmission...
Page 126
Chapter 2 Port Assignments When Using a Firewall Table 2-14 (Cont.) Open Ports for Firewall Source Target Protocol Port Network Application Oracle 6200 Management Oracle Notification Notification Service Service ASR Manager ILOMs for HTTP 6481 Management Service tag database listener for...
Page 127
Protocol Port Network Application Java agent 42034 (IPv6) Management Java agent (sveerana) (sveerana) Java EM 47632 Management Agent See Also: Appendix E, "Managing Oracle Database Port Numbers", in the Oracle Real Application Clusters Installation Guide for Linux and UNIX. 2-39...
Using Oracle Exadata Deployment Assistant Oracle Exadata Deployment Assistant creates the Oracle Exadata Rack configuration file. The file automates the installation process. The utility is available from My Oracle Support. Refer to My Oracle Support note 888828.1 for additional information. Note: For ease of reading, the name "Oracle Exadata Rack"...
Review this information when using Oracle Exadata Deployment Assistant (OEDA). Note the following when using Oracle Exadata Deployment Assistant: • Oracle Exadata Rack ships with the Oracle Linux operating system installed on the database servers, with the Oracle Linux as the default. •...
A valid time zone name is required for Oracle Exadata Database Machine installation. Time zone data provided with Oracle Exadata Database Machine and Oracle Linux comes from the zoneinfo database. A valid time zone name is suitable as a value for the TZ environment variable consisting of form Area/ Location.
Machine names • DNS information • NTP information for the rack The following buttons are available on each Oracle Exadata Deployment Assistant page: • Help: View context-sensitive help. • Import: Import an existing configuration file. The file format is XML.
Page 132
Explanations for each field on the pages are provided in the other sections of this chapter. Ensure the machine that is used to run Oracle Exadata Deployment Assistant has Oracle JRE 1.6 or later. Accessibility Note: For screen reader and screen magnifier users: Accessibility testing is conducted only on the Windows platform.
Page 133
Configuration Manager page, and click Next. (Optional) Enter the Auto Service Request (ASR) information on the Auto Service Request page, and click Next. (Optional) Enter the Oracle Enterprise Manager Grid Control information on the Grid Control Agent page, and click Next.
Enter a file name, and click OK to create the file, or Cancel to not create the file. Copy the configuration files to a directory in the /u01 directory, such as the /u01/ oeda directory, on the first database server in Oracle Exadata Rack. The file is located in the /tmp/OneCommand directory on Linux, Apple, and UNIX systems, and the directory on Microsoft Windows systems.
Chapter 3 OEDA Graphical User Interface Table 3-2 (Cont.) Customer Details Page Customer Details Field Description Name Prefix Defines the prefix for network interfaces. Note: The prefix can contain any alphanumeric character. The prefix cannot contain spaces. The maximum length is 20 characters. The field cannot be empty.
Page 136
Chapter 3 OEDA Graphical User Interface Table 3-3 (Cont.) Customer Network Configuration Page Customer Details Field Description Gateway Sets the IP address for the gateway. Client or Backup Network Format Selects the Ethernet cards, based on cable type. Options prior to X7-2: •...
Each IP address pool should consist of consecutive IP addresses. If consecutive IP addresses are not available, then modify the IP addresses at the end of the Oracle Exadata Deployment Assistant process. 3.2.6 Administration Network Configuration Page Each database server and Exadata Storage Server has two network interfaces for administration.
Table 3-5 (page 3-12) lists the administration network format mask fields. Note: • Oracle recommends using the same starting IDs for the servers and server ILOMs. • All fields must be filled in. • The percent signs (%) in the names are replaced by the numbers entered into the Starting ID fields.
Page 139
Chapter 3 OEDA Graphical User Interface Table 3-5 Administration Network Format Masks Page Administration Network Format Masks Description Field Compute Node Name Sets the administration name for the first database server in this rack. Note: The name contains alphanumeric characters. Compute Node Starting ID Defines the starting numeric ID for the first database server in this rack.
Applications access the database through the client Ethernet network using Single Client Access Name (SCAN) and Oracle RAC Virtual IP (VIP) addresses. If VLAN tagging is to be used, then it must be enabled by the customer after the initial deployment.
Enabling 802.1Q VLAN Tagging in Exadata Database Machine over client networks (My Oracle Support Doc ID 1423676.1) • Implementing Tagged VLAN Interfaces in Oracle VM Environments on Exadata (My Oracle Support Doc ID 2018550.1) 3.2.7.1 Modifying the Default Client Ethernet Network Names Default client network names are usually changed to meet corporate naming standards or compatibility with existing systems.
Chapter 3 OEDA Graphical User Interface 3.2.8 InfiniBand Network Configuration Page The InfiniBand network is the private network between database servers and storage servers. The following table lists the InfiniBand network fields. Note: Sample name formats are based on the prefix entered on the Customer Details page.
Chapter 3 OEDA Graphical User Interface Table 3-9 (Cont.) Private (IB) Network Format Masks Page Private (IB) Network Format Masks Field Description Compute Private Starting ID Sets the starting ID for the InfiniBand access name for the database servers. Note: The ID contains numeric characters. This field cannot be empty.
3.2.10 Identify Compute Node OS and Enable Capacity-on-Demand Configuration Page Operating system configuration is based on processor type. Oracle Exadata Racks with Intel processors support Oracle Linux. Click Enable Capacity-on-Demand to reduce the initial number of active cores on the servers, and then set the number of active cores.
DNS. 3.2.12 Define Clusters More than one cluster can be defined for Oracle Exadata Rack environments. Larger environments support multiple clusters. Each cluster requires a minimum of two physical database servers, and three Exadata Cells.
Page 146
/u01/app/grid This option is available when using role- separated authentication. ASM DBA Group Sets the Oracle ASM DBA group name. The default value is asmdba. Membership in this group enables access to the files managed by Oracle ASM. This option is available when using role- separated authentication.
Page 147
ASM Home Admin Group Sets the Oracle ASM administration group name. The default value is asmadmin. This group uses SQL to connect to an Oracle ASM instance as SYSASM using operating system authentication. The SYSASM privileges permit mounting and dismounting of disk groups, and other storage administration tasks.
Page 148
ID. The default value is 1003. This option is available when using role- separated authentication. OINSTALL group Sets the Oracle Inventory group name. The default value is oinstall. OINSTALL Group ID Assigns the Oracle Inventory group ID. The default value is 1001.
Page 149
DATA Disk Group Sets the DATA disk group name, redundancy and size. The redundancy options are NORMAL and HIGH. Note: Oracle recommends the use of HIGH redundancy disk groups for mission critical applications. RECO Disk Group Sets the RECO name, redundancy and size.
See Also: • "Understanding Data Security for Oracle Exadata Storage Server Software" in the Oracle Exadata System Software User's Guide for additional information about Oracle ASM and database-scoped security • "Setting up Oracle Exadata Storage Snapshots" chapter in the Oracle...
Chapter 3 OEDA Graphical User Interface For ACFS Volume Name, accept the default volume name, or enter a new ACFS volume name. The volume name must be between 1 and 11 alphanumeric characters, and must start with an alphabetic character. For ACFS Volume Size, enter the desired size of the ACFS volume.
Oracle Exadata System Software User's Guide 3.2.16 Platinum Configuration Page Oracle Platinum Service provides enhanced support at no additional cost for qualified engineered systems. This is a connected service and requires Oracle Advanced Support Gateway (OASG) to be provisioned within the environment. The configuration for OASG is defined with the user information that is used by the Platinum Service monitoring agent.
Page 153
The address must be in the OASG This field is available after clicking Modify. primary IP subnet. Gateway machine has an ILOM Specifies that OASG is an Oracle system with an ILOM service processor. ILOM IP Address Sets the ILOM IP address.
Oracle Advanced Support Gateway Documentation Library 3.2.17 Auto Service Request Configuration Page Auto Service Request (ASR) is designed to automatically open service requests when specific Oracle Exadata Rack hardware faults occur. The following table lists the ASR configuration options. Table 3-15...
• Oracle Exadata Database Machine Maintenance Guide 3.2.18 Oracle Configuration Manager Configuration Page Oracle Configuration Manager is used to collect configuration information and upload it to the Oracle repository. The following table lists the Oracle Configuration Manager configuration options. Table 3-16...
Oracle Enterprise Manager Grid Control installs agents on the database servers and points the agents to an existing Oracle Enterprise Manager Grid Control environment, or installs a new Oracle Enterprise Manager Grid Control infrastructure on a separate host. Table 3-17 (page 3-29) lists the Oracle Enterprise Manager Grid Control configuration options.
Resize Oracle ASM disk groups • Add or remove additional Databases • Add or remove additional database homes to an Oracle VM cluster An Action can have many sub commands, however most actions are single commands. Examples of multi-command steps are - CLONE GUEST...
Page 158
Used to edit an es.xml file after you have run the install.sh command steps – Can be used to Clone Oracle VM Guests or grow or shrink Oracle ASM Disk groups – Has a smaller list of supported changes than Edit mode –...
Save the memory copy of the es.xml, overwriting the input file or writing to a new file that you specify. SAVE FILE [name=new_es.xml] 3.3.2 Starting the OEDACLI Utility Starting with August 2017 Release of Oracle Exadata Deployment Assistant (OEDA), a command-line utility — — can be used for various routine tasks on Exadata. oedacli...
Chapter 3 OEDA Command Line Interface Example 3-1 Help Output for OEDACLI This example shows the help output listing the available objects and command for the OEDACLI 18c (18.1.0) release: oedacli> HELP HELP [topic] Available Objects: ACFSVOLUME LIST ACFSVOLUMES CELL LIST CELLS CLUSTER LIST CLUSTERS...
Example 3-3 Loading a File into OEDACLI for Editing oedacli> LOAD FILE NAME=Oracle-test12.xml SUCCESS - file loaded OK Customer : testadm01 - Oracle 3.3.3.1.2 SAVE ACTION Use this command to save the current action to engineered system XML memory copy.
Page 163
Chapter 3 OEDA Command Line Interface 3.3.3.1.3 MERGE ACTIONS Use this command to merge the current actions into the other actions in the Engineered System model. Syntax MERGE ACTIONS [FORCE] Arguments Specify if you do not want this action to be processed by a FORCE DEPLOY ACTIONS command.
CLUSTERNUMBER = cluster_number DISKGROUPNAME = diskgroup_name | CLUSTERNAME = cluster_name DISKGROUPNAME diskgroup_name | CLUSTERID = cluster_id DISKGROUPNAME = diskgroup_name Arguments You can specify the following attributes for the new Oracle ACFS volume: • : Specifies a unique name for the new volume VOLUMENAME •...
Page 165
CLUSTERID es.xml • : Specifies the name of the container disk group DISKGROUPNAME 3.3.3.2.2 ALTER ACFSVOLUME This command alters an existing Oracle ASM Cluster File System (Oracle ACFS) volume. Syntax ALTER ACFSVOLUME VOLUMENAME = volume_name | VOLUMESIZE = volume_size |...
Page 166
DISKGROUPNAME • : Specifies the name of the existing Oracle ACFS volume VOLUMENAME 3.3.3.2.4 LIST ACFSVOLUME This command lists the Oracle ASM Cluster File System (Oracle ACFS) volumes. Syntax LIST ACFSVOLUMES WHERE ID = id | DISKGROUPID = diskgroup_id |...
OEDA Command Line Interface Example 3-6 Example Title (Optional) Describe the example here. Enter the example code here. 3.3.3.3 CELL You can clone, delete, or list Oracle Exadata storage cells. • CLONE CELL (page 3-40) • DELETE CELL (page 3-40) •...
OEDA Command Line Interface 3.3.3.3.3 LIST CELLS This command lists the storage cells. Syntax LIST CELLS 3.3.3.4 CLUSTER You can alter or list the Oracle RAC Clusters on the Oracle Exadata Database Machine. • ALTER CLUSTER (page 3-41) • LIST CLUSTERS (page 3-41) 3.3.3.4.1 ALTER CLUSTER...
: Specifies the ID of the cluster CLUSTERID es.xml Usage Notes clause is optional. WHERE 3.3.3.5 DISKGROUP You can add, alter, delete, or list the Oracle ASM disk groups. • ADD DISKGROUP (page 3-42) • ALTER DISKGROUP (page 3-43) •...
Page 170
Chapter 3 OEDA Command Line Interface Arguments You can specify the following attributes for the new Oracle ASM disk group: • : Specifies the name for the Oracle ACFS volume on this diskgroup ACFSNAME • : Specifies the path for the Oracle ACFS file system ACFSPATH •...
Page 171
Arguments You can modify the following attributes of an Oracle ASM disk group: • : Specifies a new name for the Oracle ACFS volume on this diskgroup ACFSNAME • : Specifies the new path for the Oracle ACFS file system ACFSPATH •...
Page 172
Chapter 3 OEDA Command Line Interface oedacli> LOAD FILE NAME=Oracle-test.xml SUCCESS - file loaded OK Customer : ora07adm01 - Oracle Use the command to view the disk group details. LIST DISKGROUPS oedacli> LIST DISKGROUPS version : "PhysicalLayoutLegacy" diskGroupName : "DBFS_DG"...
Page 173
Original Grid Disk Size 2953 GB, new size 138 GB on node1celadm01.us.oracle.com Updated/New Disk Group size 2484 GB, original size 53154 GB. Done... Done 3.3.3.5.3 ALTER DISKGROUPS This command alters disk group sizing attributes for existing Oracle ASM disk groups. Syntax ALTER DISKGROUPS DATASPLIT=data_split_percent RECOSPLIT=reco_split_percent...
Page 174
• : Specifies the ID of the cluster CLUSTERID es.xml 3.3.3.5.4 DELETE DISKGROUP This command deletes an existing Oracle ASM disk group. Syntax DELETE DISKGROUP WHERE ID = diskgroup_id| CLUSTERNUMBER = cluster_number DISKGROUPNAME = diskgroup_name| CLUSTERNAME = cluster_name DISKGROUPNAME = diskgroup_name|...
(page 3-51) • LIST DATABASES (page 3-53) 3.3.3.6.1 ADD DATABASE This command adds an Oracle database, or a CDB or PDB to an existing CDB. Syntax ADD DATABASE [ BLOCKSIZE = blocksize ] [ CHARSET = database_character_set DATADG = data_diskgroup...
Page 176
DATA and RECO disk groups that the new database should use. Also, use the ID retrieved in the previous step to specify the Oracle Home in which to create this database. oedacli> ADD DATABASE DBNAME='testdb' DATADG='DATAC1' RECODG='RECOC1' WHERE DBHOMEID='c0_databaseHome' Save the action.
Page 177
CLUSTERNUMBER = cluster_number DATABASENAME = database_name | CLUSTERNAME = cluster_name DATABASENAME = database_name | CLUSTERID = cluster_id DATABASENAME = database_name Arguments You can modify the following attributes for the Oracle database: • : Specifies the new block size for the database. The default value is BLOCKSIZE 8192.
Page 178
CLUSTERID es.xml • : Specifies the name of the database in the cluster DATABASENAME 3.3.3.6.3 DELETE DATABASE This command deletes an existing Oracle database. Syntax DELETE DATABASE WHERE ID = database_id | CLUSTERNUMBER = cluster_number DATABASENAME = database_name | CLUSTERNAME = cluster_name DATABASENAME = database_name |...
Page 179
Chapter 3 OEDA Command Line Interface List the databases contained in the XML configuration file, so that you can identify the database ID associated with the database you want to delete. oedacli> LIST DATABASES version : "2" databaseOwner : "c0_oracle" databaseSid : "dbm01"...
WHERE { CLUSTERNUMBER = cluster_number | CLUSTERNAME = cluster_name | CLUSTERID = cluster_id } Arguments You can specify the following attributes for the new Oracle database home: • : (Mandatory) Specifies the operating system user that owns the Oracle OWNER home.
Page 181
: Specifies the location of the Oracle inventory directory. The default value INVLOC is derived from the cluster home. • : Specifies the language to use with the Oracle home. The default value is DBLANG all_langs • : Specifies a list of nodes to create the Oracle home on. The default MACHINELIST value is list of nodes registered with the Grid home.
Page 182
BASEDIR = base_directory WHERE ID = database_home_id | CLUSTERNUMBER = cluster_number DBHOMELOC = database_home_path | CLUSTERNAME = cluster_name DBHOMELOC = database_home_path | CLUSTERID = cluster_id DBHOMELOC = database_home_path Arguments You can modify the following attributes for the Oracle database home: 3-55...
Page 183
: Specifies the version of the software in the database home, including DBVERSION the bundle patch, for example 12.1.0.2.170418. • : Specifies the file system path for the new Oracle database home DBHOMELOC directory. • : Specifies the new name of the database home. The database home DBHOMENAME name must be unique within a cluster.
Page 184
Chapter 3 OEDA Command Line Interface Example 3-11 Removing an Existing Oracle Database Home This example shows how to delete an existing Oracle Database home directory. oedacli> LOAD FILE NAME=Oracle-test12.xml SUCCESS - file loaded OK Customer : ora07adm01 - Oracle oedacli>...
• : Specifies the customer name. CUSTOMERNAME • : Specifies the customer department. CUSTOMERDEPT 3.3.3.9 GUEST You can clone or delete an Oracle VM guest. • CLONE GUEST (page 3-58) • DELETE GUEST (page 3-59) 3.3.3.9.1 CLONE GUEST This command clones an existing Oracle VM guest.
SET INTERCONNECT InfiniBand security (PKEYS). 3.3.3.9.2 DELETE GUEST This command deletes an existing Oracle VM guest, removing the instance, home, and Oracle Clusterware from the cluster. Syntax DELETE GUEST WHERE SRCNAME = node_name Arguments is used to specify the host name of an existing DomU that you want to delete.
Chapter 3 OEDA Command Line Interface • : Specifies the ID for the target ILOM es.xml • : Specifies the current host name of the target machine HOSTNAME • : Specifies the current host name of the ILOM ILOMNAME 3.3.3.10.2 LIST ILOMS This command lists the ILOMs in the es.xml file.
Page 188
Chapter 3 OEDA Command Line Interface Arguments You can specify the following attributes for the machine: • : Specifies a comma-separated list of DNS servers that is enclosed in DNSSERVERS single quotes. • : Specifies the network adapter to use as the machine gateway. GATEWAYADAPTER Valid values are ADMIN...
Chapter 3 OEDA Command Line Interface Usage Notes If you do not specify a clause, then this command lists all the machines defined WHERE in the file. es.xml 3.3.3.12 NETWORK You can add, alter, delete, or list the networks defined in the XML configuration file. •...
Page 190
Chapter 3 OEDA Command Line Interface • : Specifies a space-separated list of slave devices for a bonded network, SLAVE enclosed in single quotes • : (For Private networks only) Specifies the pkey PKEY • : (For Private networks only) Specifies the pkey name PKEYNAME •...
Page 191
Chapter 3 OEDA Command Line Interface • : Specifies the short host name for the network HOSTNAME • : Specifies the IP address of the network • : Specifies the netmask of the network NETMASK • : Specifies the domain name of the network DOMAINNAME •...
Page 192
Chapter 3 OEDA Command Line Interface 3.3.3.12.3 DELETE NETWORK This command removes a network record for a machine. Syntax DELETE NETWORK WHERE { ID = network_id | HOSTNAME = network_hostname NETWORKTYPE = network_type | CLUSTERNAME = cluster_name { COMPUTENUMBER=compute_number | STORAGENUMBER=storage_number } NETWORKTYPE = network_type | CLUSTERNUMBER = cluster_number { COMPUTENUMBER=compute_number | STORAGENUMBER=storage_number } NETWORKTYPE = network_type |...
Chapter 3 OEDA Command Line Interface • : Specifies the ID for the network object in the XML configuration file. • : Specifies the host name for an existing compute node HOSTNAME • : Specifies the type of network, which can be NETWORKTYPE ADMIN CLIENT...
Page 194
Chapter 3 OEDA Command Line Interface 3.3.3.13.2 ALTER SCAN This command modifies the attributes of a SCAN for an individual cluster. Syntax ALTER SCAN { SCANNAME=scan_name | SCANPORT=scan_port | SCANIPS='scan_ip_addrs' } WHERE CLUSTERNAME = cluster_name | CLUSTERNUMBER = cluster_number | CLUSTERID = cluster_id } Arguments You can modify the following attributes for the SCAN:...
Chapter 3 OEDA Command Line Interface Syntax LIST SCANS [ WHERE SCANID = scan_id | CLUSTERNAME = cluster_name | CLUSTERNUMBER = cluster_number | CLUSTERID = cluster_id } ] Arguments The following arguments are available in the clause: WHERE • : Specifies the ID of the SCAN object in the XML configuration file SCANID •...
Chapter 3 OEDA Command Line Interface • : Specifies the host name of the switch HOSTNAME 3.3.3.14.2 LIST SWITCHES This command lists the switch details for all switches or for an individual switch. Syntax LIST SWITCHES [ WHERE { ID = switch_id | HOSTNAME = switch_name } ] Arguments The following arguments are available in the...
Page 197
Chapter 3 OEDA Command Line Interface • : Specifies the domain name for the VIP DOMAINNAME • : Specifies the IP address for the VIP The following arguments are available in the clause: WHERE • : Specifies the host name for the compute node in the cluster HOSTNAME •...
Page 198
Chapter 3 OEDA Command Line Interface HOSTNAME = hostname | CLUSTERNAME = cluster_name COMPUTENUMBER = compute_number | CLUSTERNUMBER = cluster_number COMPUTENUMBER = compute_number | CLUSTERID = cluster_id COMPUTENUMBER = compute_number } Arguments The following arguments are available in the clause: WHERE •...
• Do not block ventilation openings. • Do not install Oracle Exadata Rack in a location that is exposed to direct sunlight or near a device that may become hot. • Do not install Oracle Exadata Rack in a location that is exposed to excessive dust, corrosive gases, or air with high salt concentrations.
Chapter 4 Unpacking Oracle Exadata Rack • Do not place anything on top of Oracle Exadata Rack or perform any work directly above the rack. • Do not let the room temperature rise sharply, especially in winter. Sudden temperature changes can cause condensation to form inside Oracle Exadata Rack.
Page 201
Chapter 4 Unpacking Oracle Exadata Rack Figure 4-1 Oracle Exadata Rack in Shipping Crate The shipping kit contains the following tools and equipment to install and service Oracle Exadata Rack: • 16 mm long No. 2 Phillips screw • T30 Torx cranked wrench key •...
Page 202
WARNING: Oracle strongly recommends that you use professional movers when unpacking and installing Oracle Exadata Rack. Unpack Oracle Exadata Rack carefully from the packaging and shipping pallet as follows: Note: Before unpacking the rack from the shipping carton, refer to the labels on the carton and to the instructions that they provide.
Ensure the leveling and stabilizing feet on the rack are raised and out of the way. Push Oracle Exadata Rack from behind to the installation site. When moving Oracle Exadata Rack to the installation site, the front casters do not turn; you must steer the unit by moving the rear casters. You can safely maneuver Oracle Exadata Rack by carefully pushing it.
Figure 4-2 Carefully Push Oracle Exadata Rack from Behind Oracle recommends having two people to move the rack: one person in front and one person in back to help guide the rack. When transporting configured racks from one location to another, take care to move them slowly, 0.65 meters per second (2.13 feet per second) or slower.
• Casters and leveling feet To adjust the leveling feet, do the following: Locate the four leveling feet located at the bottom corners of Oracle Exadata Rack. Figure 4-3 (page 4-7) shows the location of the leveling feet on the bottom of Oracle Exadata Rack.
To adjust the leveling feet, do the following: Locate the four leveling feet located at the bottom corners of Oracle Exadata Rack. The following figure shows the location of the leveling feet on the bottom of Oracle Exadata Rack.
Page 207
Chapter 4 Placing Oracle Exadata Rack in Its Allocated Space Figure 4-5 Location of Leveling Feet on Oracle Exadata Rack X7 • 1: Distance from the edge of the feet to the Front door surface is 58 mm (2.3 inches) •...
Final chassis ground is achieved by way of the ground prong when you connect the power cord to a socket. For additional grounding, attach a chassis earth ground cable to Oracle Exadata Rack. The additional ground point enables electrical current leakage to dissipate more efficiently.
Figure 4-7 (page 4-11). The attachment point is an adjustable bolt that is inside the rear of the Oracle Exadata Rack cabinet on the right side. Figure 4-7 Earth Ground Attachment Bolt Location...
Check the network data cables. Check the site location tile arrangement for cable access and airflow. Check the data center airflow that leads in to the front of Oracle Exadata Rack. Related Topics: •...
The circuit breakers are on the rear of the Oracle Exadata Rack cabinet as shown in the following figure. Press the ON (|) side of the toggle switch. When the breaker is in the ON position, the breakers are flush with the side of the PDU.
Page 212
InfiniBand switches: Left LED (viewed from front) labeled PS0, or right LED (viewed from front) labeled PS1 • KVM switch on Oracle Exadata Database Machine X2-2: Lower LED B • KMM switch on Oracle Exadata Database Machine X2-2: Only supplied by PDU B Connect power to PDU A.
Configuring Oracle Exadata Database Machine This chapter describes how to configure the system, accounts, and software for Oracle Exadata Database Machine. Note: • For ease of reading, the name "Oracle Exadata Rack" is used when information refers to both Oracle Exadata Database Machine and Oracle Exadata Storage Expansion Rack.
Page 214
Restart the switch. Examine the firmware version using the following command: # version Refer to My Oracle Support Note 888828.1 for the current firmware version. Check the health of the switch using the following command: # showunhealthy OK - No unhealthy sensors...
Page 215
Set the Subnet Manager Master as described in "Setting the Subnet Manager Master on Oracle Exadata Database Machine Full Rack and Oracle Exadata Database Machine Half Rack (page 5-4)". This step is needed for Oracle Exadata Database Machine Half Rack and Oracle Exadata Database Machine Full Rack.
Oracle Exadata Database Machine Two-Socket Systems (X3-2 and later): rack unit 20 (U20) and rack unit 22 (U22) • Oracle Exadata Database Machine X2-2 racks: rack unit 20 (U20) and rack unit 24 (U24) • Oracle Exadata Database Machine Eight-Socket Systems (X2-8 and later) Full Racks: Rack unit 21 (U21) and rack unit 23 (U23) The spine switch is the Subnet Manager Master for the InfiniBand subnet.
Page 217
Chapter 5 Configuring Sun Datacenter InfiniBand Switch 36 Switch Note: Oracle Exadata Database Machine Half Rack with Sun Fire X4170 Oracle Database Servers include two Sun Datacenter InfiniBand Switch 36 switches, which are set to priority 5. To determine the Subnet Manager Master, log in as the...
Performing the Initial Switch Configuration for the Cisco Nexus 93108-1G Ethernet Switch (page 5-14) 5.2.1 Configuring the Cisco Catalyst 4948 Ethernet Switch The Cisco Catalyst 4948 Ethernet switch supplied with Oracle Exadata Rack is minimally configured during installation. The minimal configuration disables IP routing, and sets the following: •...
Page 219
Connect a serial cable from the Cisco switch console to a laptop or similar device. An Oracle supplied rollover cable is pre-installed on the Cisco serial console port. Obtain the appropriate adapter and connect it at the end of the rollover cable. An Oracle P/N 530-3100 RJ45-DB9 adapter as used on ILOM ports will also work, connected at the end of the network cable.
Page 220
Chapter 5 Configuring the Cisco Ethernet Switch Switch# configure terminal Enter configuration commands,one per line.End with CNTL/Z. Switch(config)# interface vlan 1 Switch(config-if)# ip address 10.7.7.34 255.255.255.0 Switch(config-if)# end Switch# *Sep 15 14:12:06.309:%SYS-5-CONFIG_I:Configured from console by console Switch# write memory Building configuration... Compressed configuration from 2474 bytes to 1066 bytes [OK ] (Optional) Disable the default IP routing setting, and configure the default gateway.
Page 221
Chapter 5 Configuring the Cisco Ethernet Switch Building configuration... Compressed configuration from 2603 bytes to 1158 bytes [OK ] If you do not have DNS service available, you must still set the domain-name for the SSH keys to be configurable. (Optional) Set the password.
Page 222
Chapter 5 Configuring the Cisco Ethernet Switch exa1sw-ip(config)#ip ssh authentication-retries 3 exa1sw-ip(config)#ip ssh version 2 exa1sw-ip(config)#end *Sep 15 14:26:37.045: %SYS-5-CONFIG_I: Configured from console by console exa1sw-ip#write memory Building configuration... Compressed configuration from 2603 bytes to 1158 bytes[OK] If the login command returns output as shown above, then telnet access has been disabled.
Page 223
Chapter 5 Configuring the Cisco Ethernet Switch exa1sw-ip#write memory Building configuration... Compressed configuration from 3784 bytes to 1465 bytes [OK ] exa1sw-ip#show clock 21:00:06.643 EST Mon Aug 9 2017 After setting the local time zone, you can configure up to two NTP servers. exa1sw-ip#configure terminal Enter configuration commands,one per line.End with CNTL/Z.
Page 224
Chapter 5 Configuring the Cisco Ethernet Switch ip name-server 10.8.160.1 ip vrf mgmtVrf vtp mode transparent power redundancy-mode redundant spanning-tree mode pvst spanning-tree extend system-id vlan internal allocation policy ascending interface FastEthernet1 ip vrf forwarding mgmtVrf no ip address speed auto duplex auto interface GigabitEthernet1/1 spanning-tree portfast...
The Cisco switch must not be connected to the management network at this stage. The switch will be connected later after Oracle has configured the systems with the necessary IP addresses and you have worked with the field service engineer to make any additional changes necessary for connecting to the network.
• The Cisco Ethernet switch should not be connected to the customer network until the IP addresses on all components have been configured in Oracle Exadata Rack. This is to prevent any duplicate IP address conflicts which are possible due to the default addresses set in the components when shipped.
Page 227
Chapter 5 Configuring the Cisco Ethernet Switch CISCO SWITCH Ver7.59 Device detected on 0:1:2 after 0 msecs Switch to normal setup and, when asked if you want to enforce secure password standard, enter , then enter a new password for the user.
Page 228
Chapter 5 Configuring the Cisco Ethernet Switch Enter the destination prefix and mask, and other values as prompted. Destination prefix : 10.100.100.0 Destination prefix mask : 255.255.255.0 Next hop IPv4 address : 10.100.100.1 Skip configuring the DNS IPv4 addresses (this will be configured later). Configure the DNS IPv4 address? (yes/no) [n]: no Skip configuring the default domain name (this will be configured later).
Ensure you have the following before connecting the PDU to the network: • Static IP address • Subnet mask • Default gateway • Ethernet cables • Laptop computer with either Oracle Solaris or Microsoft Windows 5-17...
Page 230
Disconnect the power leads from the power source. Select an unused LAN network connection from the available network connections on the laptop as follows: • For Oracle Solaris: Log in as a super user. Use the command to find an unused Ethernet interface.
The PDU current can be monitored directly or with Oracle Enterprise Manager Grid Control. Configure the threshold settings to monitor the PDUs. The threshold settings depend on the size of Oracle Exadata Rack and type PDU. The configurable threshold values for each metering unit module and phase are...
5.3.1.1 PDU Thresholds for Oracle Exadata Database Machine X5-2 and Later Starting with Oracle Exadata Database Machine X5-2, Oracle Exadata Configuration Assistant (OECA) is the only source for PDU thresholds. OECA is available on Oracle Technology Network at http://www.oracle.com/technetwork/database/exadata/oeca- download-2817713.html...
Page 233
(page 5-22) Threshold Values for Oracle Exadata Database Machine X4-2 Full Rack with Three-phase, High-voltage PDU Table 5-1 (page 5-21) lists the threshold values for Oracle Exadata Database Machine X4-2 Full Rack using a single-phase, low-voltage PDU. Table 5-1 Threshold Values for Oracle Exadata Database Machine X4-2 Full...
Page 234
Module 1, phase A and B Module 1, phase 5.3.1.2.2 PDU Thresholds for Oracle Exadata Database Machine X4-2 Half Rack The following tables list the threshold values for Oracle Exadata Database Machine X4-2 Half Rack: • Table 5-5 (page 5-23) Threshold Values for Oracle Exadata Database Machine X4-2 Half Rack with Single-phase, Low-voltage PDU •...
Page 235
Module 1, phase Module 1, phase Module 1, phase Table 5-6 (page 5-23) lists the threshold values for Oracle Exadata Database Machine X4-2 Half Rack using a three-phase, low-voltage PDU. Table 5-6 Threshold Values for Oracle Exadata Database Machine X4-2 Half...
Page 236
Module 1, phase A and B Module 1, phase 5.3.1.2.3 PDU Thresholds for Oracle Exadata Database Machine X4-2 Quarter Rack The following tables list the threshold values for Oracle Exadata Database Machine X4-2 Quarter Rack: • Table 5-9 (page 5-25) Threshold Values for Oracle Exadata Database Machine X4-2 Quarter Rack with Single-phase, Low-voltage PDU •...
Page 237
Module 1, phase Module 1, phase Module 1, phase Table 5-10 (page 5-25) lists the threshold values for Oracle Exadata Database Machine X4-2 Quarter Rack using a three-phase, low-voltage PDU. Table 5-10 Threshold Values for Oracle Exadata Database Machine X4-2...
A and B Module 1, phase 5.3.1.3 PDU Thresholds for Oracle Exadata Database Machine X3-2 This section contains the PDU thresholds for Oracle Exadata Database Machine X3-2. Note: The values listed here are reliable for use on systems in the configuration received upon deployment and delivery from the Oracle Factory.
Page 239
X3-2 Full Rack with Single-phase, High-voltage PDU • Table 5-16 (page 5-28) Threshold Values for Oracle Exadata Database Machine X3-2 Full Rack with Three-phase, High-voltage PDU Table 5-13 (page 5-27) lists the threshold values for Oracle Exadata Database Machine X3-2 Full Rack using a single-phase, low-voltage PDU.
Page 240
Module 1, phase A and B Module 1, phase 5.3.1.3.2 PDU Thresholds for Oracle Exadata Database Machine X3-2 Half Rack The following tables list the threshold values for Oracle Exadata Database Machine X3-2 Half Rack: • Table 5-17 (page 5-29) Threshold Values for Oracle Exadata Database Machine X3-2 Half Rack with Single-phase, Low-voltage PDU •...
Page 241
Module 1, phase Module 1, phase Module 1, phase Table 5-18 (page 5-29) lists the threshold values for Oracle Exadata Database Machine X3-2 Half Rack using a three-phase, low-voltage PDU. Table 5-18 Threshold Values for Oracle Exadata Database Machine X3-2 Half...
Page 242
Module 1, phase A and B Module 1, phase 5.3.1.3.3 PDU Thresholds for Oracle Exadata Database Machine X3-2 Quarter Rack The following tables list the threshold values for Oracle Exadata Database Machine X3-2 Quarter Rack: • Table 5-21 (page 5-31) Threshold Values for Oracle Exadata Database Machine X3-2 Quarter Rack with Single-phase, Low-voltage PDU •...
Page 243
Module 1, phase Module 1, phase Module 1, phase Table 5-22 (page 5-31) lists the threshold values for Oracle Exadata Database Machine X3-2 Quarter Rack using a three-phase, low-voltage PDU. Table 5-22 Threshold Values for Oracle Exadata Database Machine X3-2...
Module 1, phase 5.3.1.4 PDU Thresholds for Oracle Exadata Database Machine X2-2 (with X4170 M2 and X4270 M2 servers) This section contains the PDU thresholds for Oracle Exadata Database Machine X2-2 (with X4170 M2 and X4270 M2 servers). Note: The values listed here are reliable for use on systems in the configuration received upon deployment and delivery from the Oracle Factory.
Page 245
X2-2 (with X4170 M2 and X4270 M2 servers) Full Rack with Three-phase, High- voltage PDU Table 5-25 (page 5-33) lists the threshold values for Oracle Exadata Database Machine Full Rack using a single-phase, low-voltage PDU. Table 5-25 Threshold Values for Oracle Exadata Database Machine X2-2 (with...
Page 246
Module 1, phase A and B Module 1, phase 5.3.1.4.2 PDU Thresholds for Oracle Exadata Database Machine X2-2 (with X4170 M2 and X4270 M2 servers) Half Rack The following tables list the threshold values for Oracle Exadata Database Machine Half Rack: •...
Page 247
X2-2 (with X4170 M2 and X4270 M2 servers) Half Rack with Three-phase, High- voltage PDU Table 5-29 (page 5-35) lists the threshold values for Oracle Exadata Database Machine Half Rack using a single-phase, low-voltage PDU. Table 5-29 Threshold Values for Oracle Exadata Database Machine X2-2 (with...
Page 248
Module 1, phase A and B Module 1, phase 5.3.1.4.3 PDU Thresholds for Oracle Exadata Database Machine X2-2 (with X4170 M2 and X4270 M2 servers) Quarter Rack The following tables list the threshold values for Oracle Exadata Database Machine Quarter Rack: •...
Page 249
X2-2 (with X4170 M2 and X4270 M2 servers) Quarter Rack with Three-phase, High-voltage PDU Table 5-33 (page 5-37) lists the threshold values for Oracle Exadata Database Machine Quarter Rack using a single-phase, low-voltage PDU. Table 5-33 Threshold Values for Oracle Exadata Database Machine X2-2 (with...
Module 1, phase A and B Module 1, phase 5.3.1.5 PDU Thresholds for Oracle Exadata Database Machine X2-2 (with X4170 and X4275 servers) This section contains the PDU thresholds for Oracle Exadata Database Machine X2-2 (with X4170 and X4275 servers). 5-38...
Page 251
Assistant (OECA), and the PDU thresholds listed in OECA should then be used. OECA can be downloaded from Oracle Technology Network. 5.3.1.5.1 PDU Thresholds for Oracle Exadata Database Machine X2-2 (with X4170 and X4275 servers) Full Rack The following tables list the threshold values for Oracle Exadata Database Machine X2-2 (with X4170 and X4275 servers) Full Rack: •...
Page 252
Chapter 5 Configuring the Power Distribution Units Table 5-38 (page 5-40) lists the threshold values for Oracle Exadata Database Machine Full Rack using a three-phase, low-voltage PDU. Table 5-38 Threshold Values for Oracle Exadata Database Machine X2-2 (with X4170 and X4275 servers) Full Rack with Three-phase, Low-voltage PDU...
Page 253
Chapter 5 Configuring the Power Distribution Units 5.3.1.5.2 PDU Thresholds for Oracle Exadata Database Machine X2-2 (with X4170 and X4275 servers) Half Rack The following tables list the threshold values for Oracle Exadata Database Machine Half Rack: • Table 5-41...
Page 254
Module 1, phase A and B Module 1, phase Table 5-43 (page 5-42) lists the threshold values for Oracle Exadata Database Machine Half Rack using a single-phase, high-voltage PDU. Table 5-43 Threshold Values for Oracle Exadata Database Machine X2-2 (with...
Page 255
Chapter 5 Configuring the Power Distribution Units 5.3.1.5.3 PDU Thresholds for Oracle Exadata Database Machine X2-2 (with X4170 and X4275 servers) Quarter Rack The following tables list the threshold values for Oracle Exadata Database Machine Quarter Rack: • Table 5-45...
Page 256
Module 1, phase A and B Module 1, phase Table 5-47 (page 5-44) lists the threshold values for Oracle Exadata Database Machine Quarter Rack using a single-phase, high-voltage PDU. Table 5-47 Threshold Values for Oracle Exadata Database Machine X2-2 (with...
This section contains the PDU thresholds for Oracle Exadata Database Machine Eight-Socket systems for X4-8 and later. Oracle Exadata Configuration Assistant (OECA) is the only source for PDU thresholds for Oracle Exadata Database Machine X4-8 and later systems. OECA is available on Oracle Technology Network at http://www.oracle.com/technetwork/database/exadata/ oeca-download-2817713.html...
Page 258
Module 2, phase Module 2, phase Table 5-51 (page 5-46) lists the threshold values for Oracle Exadata Database Machine X3-8 Full Rack using a single-phase, high-voltage 22 kVA PDU. Table 5-51 Threshold Values for Oracle Exadata Database Machine X3-8 Full...
5.3.1.9 PDU Thresholds for Oracle Exadata Storage Expansion Rack with Exadata Storage Server with Sun Fire X4270 M2 Servers This section contains the PDU thresholds for Oracle Exadata Storage Expansion Rack with Exadata Storage Server with Sun Fire X4270 M2 Servers.
Page 262
Module 1, phase Module 1, phase Module 1, phase Table 5-58 (page 5-50) lists the threshold values for Oracle Exadata Storage Expansion Full Rack with Exadata Storage Server with Sun Fire X4270 M2 Servers using a three-phase, low-voltage PDU. Table 5-58...
Page 263
Module 1, phase A and B Module 1, phase 5.3.1.9.2 PDU Thresholds for Oracle Exadata Storage Expansion Half Rack with Exadata Storage Server with Sun Fire X4270 M2 Servers The following tables list the threshold values for Oracle Exadata Storage Expansion Half Rack with Exadata Storage Server with Sun Fire X4270 M2 Servers: •...
Page 264
Half Rack with Exadata Storage Server with Sun Fire X4270 M2 Servers with Three-phase, High-voltage PDU Table 5-61 (page 5-52) lists the threshold values for Oracle Exadata Storage Expansion Half Rack with Exadata Storage Server with Sun Fire X4270 M2 Servers using a single-phase, low-voltage PDU.
Page 265
5.3.1.9.3 PDU Thresholds for Oracle Exadata Storage Expansion Quarter Rack with Exadata Storage Server with Sun Fire X4270 M2 Servers The following tables list the threshold values for Oracle Exadata Storage Expansion Quarter Rack with Exadata Storage Server with Sun Fire X4270 M2 Servers: •...
Page 266
Quarter Rack with Exadata Storage Server with Sun Fire X4270 M2 Servers with Three-phase, High-voltage PDU Table 5-65 (page 5-54) lists the threshold values for Oracle Exadata Storage Expansion Quarter Rack with Exadata Storage Server with Sun Fire X4270 M2 Servers using a single-phase, low-voltage PDU.
Module 1, phase Module 1, phase Module 1, phase Table 5-68 (page 5-55) lists the threshold values for Oracle Exadata Storage Expansion Quarter Rack with Exadata Storage Server with Sun Fire X4270 M2 Servers using a three-phase, high-voltage PDU. Table 5-68...
Page 268
Log in as the user to the first Exadata Storage Server. root Note: If you do not have the password for the user, then contact Oracle Support root Services. Verify the SysSN label for the cell matches the value using...
Proceed to the next Exadata Storage Server. 5.5 Checking Oracle Database Servers The following procedure describes how to check the Oracle Database servers. At this point, the operating system is Linux. Log in as the user to the first database server.
Page 270
In the preceding command, group_file is the file with the server IP addresses. Verify the hardware profile is correct using the following command. The command checks CPU type and count, component firmware, and so on. # dcli -l root -g group_file "/opt/oracle.SupportTools/CheckHWnFWProfile \ -c strict" > /tmp/checkhwfw.out # more /tmp/checkhwfw.out The following is an example of a check that failed: 172.108.1.6:[WARNING ]The hardware and firmware are not supported.
-p 5.6 Performing Additional Checks and Configuration The following procedure describes additional checks and configuration steps for Oracle Exadata Rack: (Oracle Exadata Database Machine only) Log in to the first database server as the user. root Change to the...
/SP system_identifier'" > /tmp/show-rack-csn.out # more /tmp/show-rack-csn.out If none of the serial numbers are set, then contact Oracle Support Services. If one serial number is not set correctly, then run the following command to correct it: ipmitool sunoem cli 'set /SP system_identifier= \ "Exadata Database Machine rack_type xxxxAKyyyy"'...
Page 273
Check if each rack has an valid internal ring....[SUCCESS ] In the preceding command, rack_size is the size of the rack. The -t rack_size option is needed if the rack is Oracle Exadata Database Machine Half Rack or Oracle Exadata Database Machine Quarter Rack. Use for Oracle...
In release 12.1.2.2.0 and above, the installation media has been simplified, and it is no longer necessary to build files using the ImageMaker process. Refer to My Oracle Support note 2038073.1 for additional details on valid options for imaging 12.1.2.1.0 and above.
Page 275
To prepare a new Exadata system for deployment using ISO images, perform the following steps: Obtain the latest Oracle Exadata Deployment Assistant (OEDA). Run the OEDA configuration tool to generate the configuration files. You will need the configuration files when you run later.
Page 276
Do not skip this step. Skipping this step results in unused space that can no longer be reclaimed by reclaimdisks.sh For example: # /opt/oracle.SupportTools/reclaimdisks.sh -free -reclaim Model is ORACLE SERVER X5-2 Number of LSI controllers: 1 Physical disks found: 4 (252:0 252:1 252:2 252:3) Logical drives found: 1 Linux logical drive: 0...
Elastic configuration is now the standard methodology for all new deployments, and applies to Oracle Exadata X5, X5-2L, and X4-8b (with X5 storage cells) servers. You can also use the same process to add additional database servers or cells to an existing configuration.
Page 278
To prepare a new Exadata system for deployment using the elastic configuration method, perform the following steps: Obtain the latest Oracle Exadata Deployment Assistant (OEDA). Run the OEDA configuration tool to generate the configuration files. Power on all the servers.
Page 279
Chapter 5 Imaging a New System [INFO ] End sector of the last partition on the system device /dev/sda: 3509759000 [INFO ] Unmount /EXAVMIMAGES from ocfs2 partition on /dev/sda3 [INFO ] Mount ocfs2 partition /dev/sda3 to /EXAVMIMAGES [INFO ] Remove inactive system logical volume /dev/VGExaDb/LVDbSys1 [INFO ] Remove logical volume /dev/VGExaDbOra/LVDbOra1 [INFO...
Chapter 5 Imaging a New System See My Oracle Support note 1953915.1 for further details on how the elastic configuration process works, and specific examples of how to apply customer IP addresses to the rack. and verify that all nodes show the correct IP addresses and host ibhosts names.
Page 281
The relevant PXE, ISO, and USB image files imagemaker have already been created in the patches themselves. Simply download the patch containing the prebuilt image file from Oracle Software Delivery Cloud and place the downloaded ISO image file in the appropriate location. For 12.1.2.2.0 the .iso...
Page 282
Download the kit to prepare and create the files for the USB drive. imagemaker This kit is available publicly on the Oracle Software Delivery Cloud ) site under “Oracle Database Products -> Linux x86-64”. edelivery.oracle.com There are separate ImageMaker files for database nodes and cells.
Page 283
Chapter 5 Imaging a New System # ./makeImageMedia.sh -factory -stit -reboot-on-success -nodisktests -preconf preconf.csv computenode.iso [Info]: ipconf command line: /root/imagemaker/compute/initrd/opt/oracle.cellos/ ipconf.pl -preconf preconf.csv -verify -nocodes [Done]: Pre config verification OK Please wait. Calculating md5 checksums for cellbits ... Calculating md5 checksum for exaos.tbz ...
Page 284
Attach the ISO as virtual media to the ILOM of the database server to be reimaged, and select CDROM as the next boot device. Reboot the database node or cell to start the imaging process from the ISO. If you are using Oracle VM, run on each database server. The switch_to_ovm.sh database servers will reboot.
Page 285
Chapter 5 Imaging a New System [INFO ] Remove partition /dev/sda4 [INFO ] Re-calculate end sector of the last partition after removing of /dev/ sda4 partition [INFO ] End sector of the last partition on the system device /dev/sda: 3300035608 [INFO ] Check for existing first boot system image /EXAVMIMAGES/ System.first.boot.12.1.2.1.0.141205.2.img...
19. Resecure Machine Related Topics: • Oracle Software Delivery Cloud • Exadata 12.1.2.2.0 release and patch (20131726) (My Oracle Support Doc ID 2038073.1) • Exadata Database Machine and Exadata Storage Server Supported Versions (My Oracle Support Doc ID 888828.1) 5.8.4 Using PXE to Image a New System...
Page 287
PXE image files from Oracle Software Delivery Cloud and place them into the appropriate directories on the PXE server. For 12.1.2.2.0 the patch numbers can be obtained from My Oracle Support note 2038073.1 . There are separate ImageMaker files for database nodes and cells.
Page 288
Chapter 5 Imaging a New System (For 12.2.1.1.0 and above) Change directory to the directory. cell compute Make PXE build using: ./makeImageMedia.sh -pxe -pxeout ImageName This creates four files in the subdirectory: ./PXE • For 12.1.2.2.0 up to 12.2.1.1.0: kernel: vmlinux-version-ImageName-{DL180|DL360} initrd: initrd-version-ImageName-{DL180|DL360}.img image: nfsimg-version-ImageName-{DL180|DL360}.tar image: nfsimg-version-ImageName-{DL180|DL360}.tar.md5...
Page 289
Chapter 5 Imaging a New System # ipmitool chassis bootdev pxe # reboot If you are using Oracle VM, run on each database server. The switch_to_ovm.sh database servers will reboot. For example: # /opt/oracle.SupportTools/switch_to_ovm.sh 2014-12-07 11:58:36 -0800 [INFO] Switch to DOM0 system partition /dev/VGExaDb/...
Page 290
Chapter 5 Imaging a New System [INFO ] Check for existing first boot system image /EXAVMIMAGES/ System.first.boot.12.1.2.1.0.141205.2.img [INFO ] Saving /EXAVMIMAGES/System.first.boot.12.1.2.1.0.141205.2.img in /var/log/exadatatmp ... [INFO ] First boot system image saved in /var/log/exadatatmp/ System.first.boot.12.1.2.1.0.141205.2.img [INFO ] Unmount /EXAVMIMAGES from /dev/sda3 [INFO ] Remove partition /dev/sda3 [INFO...
). For example, if the MAC address is 00:10:E0:69:34:52: orhb42-b08-01,us.oracle.com,db,eth0,eth0,Management,00:10:E0:69:34:52, 10.196.3.106,255.255.224.0,10.196.31.250,orhb42-b08-01-priv,Private:active-bond- 192.168.10.15,255.255.255.0,,,America/Los_Angeles to verify the generated file. This can be done on any ipconf preconf.csv Oracle Exadata server, and although not required, it is useful to ensure the file is valid before proceeding. preconf.csv 5-79...
Page 292
# partprobe Verify that the USB is mountable as long as the system supports ext4 file system. This must be an Oracle Linux 6 system for this step even if the previous command was run on an Oracle Linux 5 system.
Page 293
Download the ImageMaker kit to prepare and create the files for the USB drive. This kit is available publicly on the Oracle Software Delivery Cloud (edelivery) site under “Oracle Database Products -> Linux x86-64”. There are separate ImageMaker files for database nodes and cells.
Page 294
Do not skip this step. Skipping this step results in unused space that can no longer be reclaimed by reclaimdisks.sh For example: # /opt/oracle.SupportTools/reclaimdisks.sh -free -reclaim Model is ORACLE SERVER X5-2 Number of LSI controllers: 1 Physical disks found: 4 (252:0 252:1 252:2 252:3) Logical drives found: 1 Linux logical drive: 0...
• Exadata 12.1.2.2.0 release and patch (20131726) (My Oracle Support Doc ID 2038073.1) • Exadata reimaging using USB fails to boot USB (My Oracle Support Doc ID 1919001.1) • Exadata Database Machine and Exadata Storage Server Supported Versions (My Oracle Support Doc ID 888828.1) 5.8.6 Updates to Imaging Parameters...
This topic provides background information on elastic configuration and describes how to perform the initial configuration of Oracle Exadata Database Machine. You need the configuration file generated by Oracle Exadata Database Machine Deployment Assistant. Elastic configuration is new in Exadata version 12.1.2.1.0. It applies to all rack configurations, such as the following: •...
Page 298
. This is necessary in all deployment reclaimdisks.sh scenarios. # /opt/oracle.SupportTools/reclaimdisks.sh -free -reclaim If Oracle VM was chosen, this step locks in the image as Oracle VM. Going back and forth will not be possible. performs partition reconfiguration and a few other necessary reclaimdisks.sh configuration changes that take typically less than a minute to complete.
Page 299
Chapter 5 Performing Initial Elastic Configuration of Oracle Exadata Database Machine Valid. Booted: Linux. Layout: Linux. If the system is an Oracle VM deployment, the last line of output will be the following: Valid. Booted: DOM0. Layout: DOM0. Copy Oracle Exadata Database Machine Deployment Assistant to the database server using one of the following methods.
Page 300
• Using a temporary network connection: This option is only needed if there were IP address conflicts, and Oracle Exadata Database Machine is not already connected to the network. Connect a network cable to the Ethernet port labeled NET0 on the back of the first database server.
Page 301
• Download the version of Oracle Exadata Deployment Assistant for the relevant platform. Use Oracle Exadata Deployment Assistant to install and configure the software for Oracle Exadata Database Machine. See Also: • Oracle Exadata Database Machine System Overview for rack layout information •...
5.11 Loading the Configuration Information and Installing the Software Oracle Exadata Deployment Assistant loads the network settings, creates the user accounts, installs Oracle Database software, and secures the system based on the information the configuration files. You can also choose to do the process manually. Note: •...
Oracle Support root Services. Copy the configuration file from the machine that was used to run Oracle Exadata Deployment Assistant to the /opt/oracle.SupportTools/onecommand directory on the first database server of the Oracle Exadata Rack. Create a directory named on the first database server.
Page 304
Note: The preceding steps are correct for the current release. However, the steps may differ for other releases. Always use the latest Oracle Exadata Deployment Assistant patch listed in My Oracle Support note 888828.1. Refer to the README in the patch for the latest steps.
(default) or TYPICAL FULL When installing Oracle Database, you must select the Oracle ASM storage option. If you are installing Oracle Real Application Clusters (Oracle RAC), then refer to the platform-specific Oracle Clusterware and Oracle RAC installation guides, such as Oracle Grid Infrastructure Installation and Upgrade Guide and Oracle Real Application Clusters Installation Guide.
Page 306
Guide, and the database and Oracle ASM instances are installed, the instances must be configured to use the cells as part of an Oracle ASM disk group. The required configuration involves updating the initialization parameter file of both the database and Oracle ASM instances.
Chapter 5 Loading the Configuration Information and Installing the Software • List of Critical Patches Required For Oracle 11.2 DBFS and DBFS Client (My Oracle Support Doc ID 1150157.1) • Configuring DBFS on Oracle Exadata Database Machine (My Oracle Support Doc ID 1054431.1)
If you edit the ALTER SYSTEM ASM_DISKSTRING initialization parameter in the initialization parameter file when the Oracle ASM instance is running, then the Oracle ASM instance must be shut down and restarted for the change to take effect. See Also: •...
Page 309
Chapter 5 Installing Oracle Enterprise Manager Cloud Control • How to Configure Oracle Configuration Manager for Oracle Exadata Database Machine (My Oracle Support Doc ID 1319476.1) • MAA Best Practices website 5-97...
Site Checklists Complete the checklists in this appendix to ensure the site is prepared for Oracle Exadata Database Machine or Oracle Exadata Cloud Machine. Note: For ease of reading, the name "Oracle Exadata Rack" is used when information refers to both Oracle Exadata Database Machine and Oracle Exadata Storage Expansion Rack.
Appendix A System Components Checklist System Comment Components Checklist Items If an Oracle Exadata Database Machine will be connected to other Oracle racks using the InfiniBand network, then have a Sun Datacenter InfiniBand Switch 36 (spine switch) and cables been...
Page 312
If yes, has the customer arranged for the replacement switch installation? Will additional equipment be attached to or installed in the rack? If so, ensure that the additional equipment falls within Oracle guidelines and sufficient power and cooling exist for it.
Appendix A Data Center Room Checklist See Also: "Oracle Exadata Rack Restrictions" in Oracle Exadata Database Machine System Overview for more details on allowed hardware modifications A.2 Data Center Room Checklist Use this checklist to ensure that the data center room requirements have been addressed.
Space Requirements (page 1-28) • Flooring Requirements (page 1-34) • Stabilize Oracle Exadata Rack with Leveling Feet (page 4-7) A.3 Data Center Environment Checklist Use this checklist to ensure that the data center environment requirements have been addressed. Data Center...
Appendix A Access Route Checklist Data Center Comment Environment Considerations If the room cooling is from a raised floor, then: • Are the perforated floor tiles each rated at 400 CFM or greater? • additional perforated floor tiles be obtained if required for additional cooling?
Page 316
Appendix A Access Route Checklist Access Route Comment Considerations Has the access route been checked for clearances of the rack, in particular, the minimum width and height requirements for all doors on the route? Dimensions of the packaged rack: • Height: 2159 mm (85 inches)
Page 317
Appendix A Access Route Checklist Access Route Comment Considerations Are all the surfaces acceptable for rolling the new unpacked and packed equipment? If a pallet jack is to be used: • Can the pallet jack support the weight of the rack? •...
Table: Access Route Requirements. (page 1-33) • Table: Rack Weights for Oracle Exadata Database Machine (page 1-29) • Table: Rack Weights for Oracle Exadata Storage Expansion Rack (page 1-31) • Flooring Requirements (page 1-34) A.5 Facility Power Checklist Use this checklist to ensure that the facility power requirements have been addressed.
Page 319
Appendix A Facility Power Checklist Facility Power Comment Considerations Do the power outlets have appropriate socket receptacles for the PDU option ordered? Options are low voltage or high voltage, single-phase or 3-phase. Will optional ground cables be attached to the rack? Are the circuit breakers for the...
• Temperature and Humidity Requirements (page 1-44) See Also: "Powering On and Off Oracle Exadata Rack" in the Oracle Exadata Database Machine Maintenance Guide A.7 Logistics Checklist Use this checklist to ensure that the logistics requirements have been addressed. Logistics...
Page 321
Oracle personnel to access the data center? If yes, then provide the process for Oracle to follow. How many days in advance must background checks be completed? Are there any additional security access issues?
Page 322
Appendix A Logistics Checklist Logistics Comment Checklist Considerations Is inside delivery planned (direct to the final rack location in the data center room)? If the delivery is not inside, then is the site prepared for uncrating? Is the delivery/ unpacking/ staging area protected from the elements?
Page 323
Appendix A Logistics Checklist Logistics Comment Checklist Considerations Is uncrating of cabinet and cabinet packaging removal required? Are there any restrictions on delivery truck length, width or height? Is there storage space (cabinet) for the ride along spares? If not, does the customer allow cardboard boxes...
Will the required network cables be laid from the network equipment to the location where the Oracle Exadata Rack will be installed? Will the network cables that will connect to the Oracle Exadata Rack be labeled?
Related Topics: • Understanding the Network Requirements for Oracle Exadata Database Machine (page 2-1) A.9 Auto Service Request Checklist Use this checklist if you are planning to use Auto Service Request with the Oracle Exadata Database Machine. Auto Service Comment Request...
"Understanding Auto Service Request" in the Oracle Exadata Database Machine Maintenance Guide A.10 Reracking Checklists Reracking of Oracle Exadata Database Machine Half Rack or Oracle Exadata Database Machine Quarter Rack is allowed when the customer site requires a specialized infrastructure.
Page 327
Appendix A Reracking Checklists Note: • Customer must purchase both the Oracle Reracking Service and Oracle Installation Service. • Oracle does not provide support for customer-supplied equipment. Reracking Comment Considerations Has the customer purchased the Oracle Reracking Service? Is there a cart...
Page 328
Appendix A Reracking Checklists Reracking Comment Considerations Do the target rack dimensions meet the following requirements? • Height: 42 • Width: 600 mm (23.62 inches) • Depth: 1112 mm (43.78 inches) without front and rear doors If the rack is less than 42 RU, then the rack must be at least 30 RU...
Page 329
ANSI/EIA 310- D-1992 or IEC 60297 standards? Does the target rack have RETMA rail support? Note: Oracle Exadata Rack requires 19 inches (483 mm) for RETMA rail spacing width. The minimum rack width of 600 mm (23.63 inches) is...
Page 330
Appendix A Reracking Checklists Reracking Comment Considerations Does the target rack support Oracle cable management arms (CMAs)? Does the target rack support installation of Oracle vented and solid filler panels? Can the target rack provide tie- downs along the left rear side of...
Appendix A Reracking Checklists PDU Reracking Comment Considerations Does the target rack support installation of standard Oracle PDUs? If not, then complete this checklist. Can the customer provide an equivalent pair of PDUs? Can the customer provide two PDUs with...
Page 332
Appendix A Reracking Checklists Recycling Comment Considerations Does the customer want Oracle to take back and recycle the empty rack? If yes, then the Oracle service engineer can pack the empty rack for recycling. If Oracle is recycling the rack, then has...
Page 333
Database High Availability Checklist Use this checklist to ensure the requirements for high availability are met for Oracle Exadata Database Machine. Database High Comment Availability Considerations Have high redundancy disk groups been configured for best protection against different storage failures...
Page 334
• Oracle Exadata Database Machine exachk or HealthCheck (My Oracle Support Doc ID 1070954.1) • Exadata Health and Resource Usage Monitoring White Paper (My Oracle Support Doc ID 1920255.1) • Exadata Database Machine and Exadata Storage Server Supported Versions (My Oracle Support Doc ID 888828.1)
Page 335
3-38 InfiniBand interface, ALTER CLUSTER, 3-41 initialization parameter files, 5-93 ALTER DATABASE, 3-50 instances, 5-93 OEDACLI command, 3-33 Oracle Automatic Storage Management, 5-93 ALTER DATABASEHOME, 3-55 PDUs, 5-18 ALTER DISKGROUP, 3-43 conventions for naming, ALTER DISKGROUPS, 3-46 ALTER ES, 3-58...
Page 336
5-93 InfiniBand, IP addresses management, 1-47, 1-72, default IP addresses, 2-20 non-bonding, 2-16 Oracle Exadata Database Machine, 1-3, 1-8, normal redundancy, 1-9, 1-11, 1-14–1-16, 1-18, 1-19, NUMA node numbers, 1-51 Oracle Exadata Storage Expansion HC Rack, 1-72 Oracle Exadata Storage Expansion Rack,...
Page 337
3-32 shipping weights OEDACLI Oracle Exadata Database Machine, 1-29 ALTER DATABASE command example, 3-33 Oracle Exadata Storage Expansion Rack, help output, 3-32, 3-33 1-29 OEDACLI command Small Form-Factor Pluggable (SFP) modules, ADD DATABASEHOME, 3-53 2-1, open ports,...
Need help?
Do you have a question about the EXADATA X6-2 and is the answer not in the manual?
Questions and answers