1. Manuals
  2. Brands
  3. HP Manuals
  4. Server
  5. Cluster Platform Introduction v2010
  6. Introduction manual

HP Cluster Platform Introduction v2010 Introduction Manual

Hp cluster platform site preparation guide
Hide thumbs Also See for Cluster Platform Introduction v2010:
Table of Contents

Advertisement

Quick Links

Download this manual See also: Reference, Introduction Manual
HP Cluster Platform
Site Preparation Guide
HP Part Number: A-CPSPG- 1 D
Published: August 2007
Edition: 1.3

Advertisement

Table of Contents
loading

Related Manuals for HP Cluster Platform Introduction v2010

Summary of Contents for HP Cluster Platform Introduction v2010

  • Page 1 HP Cluster Platform Site Preparation Guide HP Part Number: A-CPSPG- 1 D Published: August 2007 Edition: 1.3...
  • Page 2 © Copyright 2007 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. The only warranties for HP products and services are set forth in the express warranty statements accompanying such products and services. Nothing herein should be construed as constituting an additional warranty. HP shall not be liable for technical or editorial errors or omissions contained herein.

  • Page 3: Table Of Contents

    Table of Contents About This Manual......................7 Audience..............................7 How To Use This Guide..........................7 Organization............................8 Related Documentation..........................8 HP Cluster Platform Documentation....................8 Cross-Platform Documents......................8 Platform-Specific Documents.......................8 HP BladeSystems.........................9 Component Documentation......................9 World-Wide Web Resources......................9 Warranty, Service, and Support Options....................10 Contact Information and Providing Feedback..................10 Symbols on Equipment.........................10 Text Annotations...........................11 Safety Considerations.....................12...
  • Page 4 2.4 Inspecting the Racks........................42 2.5 Leveling the Racks...........................43 2.6 Connecting the Racks........................43 2.7 Installing Side Panels........................44 A Planning Checklist......................46 A.1 Preinstallation Survey........................46 A.2 Installation Schedule........................46 A.3 Site Inspection..........................46 A.3.1 Customer and HP Information Worksheet................46 A.3.2 Site Inspection Checklists.......................47 A.4 Delivery Survey ..........................48 B Cluster Interconnect Topology..................50 C General Guidelines for the Computer Room............51 C.1 Power and Safety..........................51...
  • Page 5 List of Figures Maximum Rack Configuration Using a 1:1 Ratio of HP SFS20 Enclosures to ProLiant DL360 Object Storage Servers........................19 HP 10000 Series Rack........................22 Thee-Rack Cluster Footprint......................23 Rack Clearances for Servicing.......................24 Cable Routing Calculation......................29 PDU Connectors..........................31 Unpacking the Rack........................39 Ramp Extension and Installation....................40 Shipping Bolt and Bracket......................41 Dismounting a Rack from a Pallet....................42 Leveler Foot...........................43...
  • Page 6 List of Tables Dense Cluster Using 1U Server.....................16 Dense Cluster Using 2U Server.....................16 Number of Object Storage Servers in a Cabinet Using ProLiant DL360 Servers......17 Number of Object Storage Servers in a Cabinet Using ProLiant DL380 Servers......18 Task and Time List.........................20 HP Rack 10000 Series Rack Callouts and Dimensions..............22 42U Rack Dimensions and Weight....................22 Recommended Minimum Clearances...................24...

  • Page 7: About This Manual

    About This Manual This manual provides an overview of the HP Cluster Platform hardware and describes how to plan for the receipt and installation of cluster hardware in a dedicated computer facility. Audience This guide is intended for experienced hardware administrators of large-scale computer systems, and for HP Global Deployment representatives.

  • Page 8: Organization

    • Performing a site inspection • Performing a delivery survey See the outline and checklists provided in Appendix Organization This manual is organized as follows: Chapter 1 Describes how to plan for the installation of a cluster. Chapter 2 Describes how to unpack and assemble the cluster racks. Appendix A Provides planning checklists.

  • Page 9: Hp Bladesystems

    HP BladeSystems For HP Cluster Platform BladeSystem configurations, see the HP BladeSystem Site Planning Guide http://h71028.www7.hp.com/enterprise/cache/499697-0-0-0-121.html Component Documentation An HP Cluster Platform is integrated from existing components such as servers, network switches, and high-speed interconnects. If you need to know about the features of particular cluster components, you can obtain component documentation from the following URL: http://docs.hp.com/ A cluster's documentation kit includes two sets of documentation for each of the cluster...

  • Page 10: Warranty, Service, And Support Options

    The home page for the InfiniBand Trade Association (location of the specifications) is: http://www.infinibandta.org/home The home page for the Voltaire Infiniband Interconnect is: http://www.voltaire.com/index.html Warranty, Service, and Support Options HP Cluster Platform solutions warranties and service options are based on the offerings of the underlying components.

  • Page 11: Text Annotations

    These symbols, on power supplies or systems, indicate that the equipment is supplied by multiple sources of power. Sample wording follows: WARNING: To reduce the risk of injury from electric shock, remove all power cords to completely disconnect power from the system. ZK-2075 This symbol indicates that the component exceeds the recommended weight for one individual ZK-2076...

  • Page 12: Safety Considerations

    Safety Considerations To avoid bodily harm and damage to electronic components, read the following safety and comfort guidelines before unpacking and configuring the cluster components. Heed the following additional warnings and refer to the Preface section titled “HP Cluster Platform Documentation” to obtain specific information on safety issues for any cluster component: Avoiding Electrical Shocks To avoid electrical shock, do not open the power supplies...
  • Page 13 If you need to remove more than one component from a rack for any reason, always start from the top of the rack and remove the lightest items first. When reloading the rack, start from the bottom of the rack and replace the heaviest items first.

  • Page 14: Information On Ergonomics

    Information on Ergonomics Ergonomics and safety information is provided with all components. HP recommends that you read and ensure that you understand all such information before using a component. Safety and comfort information is provided at the following URL: http://www.hp.com/ergo/checklist.html Recycling Shipping an integrated cluster generates far less packaging than the individual components that it contains.

  • Page 15: Installation Planning

    1 Installation Planning This chapter describes the following preparation work and information gathering that is typically required to write an installation plan: • The delivery status of the cluster, (see Section 1.1). • An overview of the installation process, (see Section 1.2).

  • Page 16: Determining The Number Of Racks

    After configuration, the individual racks are disconnected and are mounted on shock pallets for shipment. Some cables that run between racks are connected to their origin ports, and then looped and secured within the rack cabinet. This ensures that the cluster is complete and allows for quick installation of the equipment at the installation site.

  • Page 17: Hp Storageworks Scalable File Share Rack Configurations

    of modules in relation to the number of nodes. To find documentation resources, see the section titled Section in the Preface of this guide. 1.2.1 HP StorageWorks Scalable File Share Rack Configurations HP SFS An typical system can consist of a base rack which contains: •...

  • Page 18: Example Hp Sfs System Rack Configurations

    Table 1-4 Number of Object Storage Servers in a Cabinet Using ProLiant DL380 Servers Ratio Cabinet Base Expansion The maximum configuration requires 4 racks. The maximum configuration requires 6 racks. The maximum configuration requires 9 racks. 1.2.3 Example HP SFS System Rack Configurations An HP SFS for HP SFS20 Enclosure system has a minimum of one base rack.

  • Page 19: Site Preparation And Planning Overview

    Figure 1-1 Maximum Rack Configuration Using a 1:1 Ratio of HP SFS20 Enclosures to ProLiant DL360 Object Storage Servers Expansion Expansion Rack 2 Rack 1 Expansion Expansion Rack 4 Rack 3 Base Rack MDS & Admin Servers SFS20 Enclosures SFS20-M0A, SFS20-M0B, SFS20-M1A, SFS20-M1B...

  • Page 20: Time And Labor Requirements

    • Optimizing Data Centers for High-Density Computing is available at the following location: http://h18000.www1.hp.com/products/servers/proliantstorage/racks/10000series/documentation.html • Power and Cooling Trends in the Datacenter available at the following location: http://techcomm.cca.cpqcorp.net/whitepapers/tc030203tb.pdf • Power Calculator (ProLiant) http://h18001.www1.hp.com/partners/microsoft/utilities/power.html • For HP Cluster Platform BladeSystem configurations, see the HP BladeSystem Site Planning Guide at the following location: http://h71028.www7.hp.com/enterprise/cache/499697-0-0-0-121.html You can find other white papers of interest at the following URL:...

  • Page 21: Physical Layout Requirements

    • Shipping room personnel for relocating the pallets, if needed. Shipping room personnel might also be required if there are problems locating items in a shipment or if there are damaged items. • Key personnel who are involved in the installation hand-off. When the installation and hardware verification process is complete, trained administrators might need to be present to boot the cluster and then begin verifying its operation.

  • Page 22: Hp 10000 Series Rack

    Figure 1-2 HP 10000 Series Rack Table 1-6 HP Rack 10000 Series Rack Callouts and Dimensions Callout Numbers — Descriptions 42U Wide Cabinet 1 — Rack width (with side panels) 612.77 mm 612.77 mm 815.47 mm 2 — Rack height 1113.48 mm 2002.50 mm 2002.50 mm...

  • Page 23: Unpacking Space

    Table 1-7 42U Rack Dimensions and Weight (continued) Metric Unpacked Characteristics Shipping Characteristics Packed on Shock Pallet Model Width (footprint) 603 mm 24 in 813 mm 32 in Weight (empty) 114.84 kg 253 lb 129 kg 284 lb Maximum weight 907.18 kg 2000 lb For both dynamic and static loading considerations.

  • Page 24: Access Space Requirements

    1.5.3 Access Space Requirements The access space requirement includes the following minimum clearances for servicing. Table 1-8 shows the recommended minimum clearances. You might need to take into account the location and access requirements of existing adjacent equipment. You might also need to leave additional clearance to enable service representatives to step around doors and over floor-routed cables.

  • Page 25: Estimating Power And Cooling

    1.5.4 Estimating Power and Cooling Power consumed by a cluster is converted to heat, which is expressed in British thermal units per hour (BTU/hr). You can calculate the heat load for a system by using the following equation: Heat Load = Power (Watts) x 3.413 BTU/hr per Watt In the preceding equation, 1 Watt equals 3.413 BTU/hr.

  • Page 26: Estimating The Total Weight Of A Custom Or Modular Installation

    The following considerations also apply when planning for an HP Cluster Platform: • The cluster's layout configuration. The layout of a cluster is determined by cable length limits and the cluster layout is generally established and fixed during the process of ordering a cluster.

  • Page 27: Planning For Connections

    Open the HTML document (or download and open the PDF) to the specifications section to obtain its weight Consider additional options that might not be included in the server's base specifications. For example, an additional disk drive per server in a dense cluster rack containing 32 servers can add over 60 lb to the cabinet.

  • Page 28: General Considerations For Connections

    utilized in the cluster. Other inter-rack cabling considerations also apply, as specified in the cluster's installation and operation guide. If you have specific layout requirements for your installation, you must specify the layout at the time of ordering the system so that the appropriate cable lengths are calculated as part of the order.

  • Page 29: Cable Routing

    1.6.3 Cable Routing Depending on your computer room layout and cable routing provisions (such as overhead raceways), You might need to estimate cable routes and plan the routing of cables. Note that the order configuration rules for a cluster do not provide you with much flexibility. The cable lengths are determined by the configuration rules, which select the cables from a limited set of predetermined lengths.
  • Page 30 An HP Cluster Platform is provided with industry-standard power connections that typically do not require direct connection (hard wiring) to a power supply. However, hard wiring might be required for the following reasons: • Local electrical standards explicitly require such wiring. •...

  • Page 31: Data And Communication Connections

    Figure 1-6 PDU Connectors L6-30P 309-32A Warning! For installations in computer rooms with overhead power supplies, the maximum available power cable length when routed to the top of the rack is approximately 36". Never extend the power cable emerging from the rack in any way. If you need to supply power from overhead outlets, relocate the power supply outlets so that they are closer to the racks.

  • Page 32: Grounding Requirements

    Section 1.5.4 (page 25) for information about calculating the power requirements for a cluster module (rack). Warning! To reduce the risk of personal injury, fire, or damage to the equipment, do not overload the AC supply branch circuit that provides power to the rack. Consult the electrical authority that has jurisdiction over your facility's wiring and installation procedures.

  • Page 33: Acoustics

    in a single, straight-row configuration. The temperature in the room where an HP Cluster Platform is located should never exceed 32°C (95°F), and should comply with the American Society of Heating, Refrigerating and Air-Conditioning Engineers (ASHRAE) requirements specified in Table 1-11.

  • Page 34: Other Environmental Considerations

    1.9.3 Other Environmental Considerations The following environmental factors might also be important when planning an installation. Electrostatic Discharge (ESD) Static charges (voltage levels) occur when objects are separated or rubbed together. Low humidity also contributes to undesirably high levels of electrostatic charges by increasing the electrostatic discharge (ESD) voltage potential.

  • Page 35: Tools And Resources

    might be required for installation and service work. This is particularly important at the rear of racks and for racks placed adjacent to walls, where ambient lighting might not be effective. For example, it is difficult to see cable connection points on the hardware if there is not enough light. Adequate lighting reduces the chances of connector damage when cables are installed or removed.
  • Page 36 As part of your site planning and preparation, walk the delivery route and note any potential problems. Any changes that require physical modification to walls and doors must be scheduled into your delivery and installation plan. Consider the following items: •...

  • Page 37: Unpacking And Assembling The Racks

    2 Unpacking and Assembling the Racks This chapter describes the following procedures related to unpacking and assembling the racks when they arrive at your site: • Thermal stabilization (see Section 2.1). • Removing packaging from the racks (see Section 2.2). •...
  • Page 38 however, you should follow the instructions in this manual to ensure your safety and to prevent damage to the cluster components. Before unpacking the racks, perform the following steps: Ensure that the racks are as close as possible to their final destination, and that enough room is available to roll the racks off of their pallets.

  • Page 39: Removing A Rack From A Pallet

    Figure 2-1 Unpacking the Rack ZK-2083 Item Description Top cover Ramps Corrugated front and rear covers Corner posts Antistatic plastic bag 2.3 Removing a Rack from a Pallet When you finish verifying the contents of the shipment, you can remove the rack from its pallet. Warning! Serious personal injury or equipment damage might result if correct safety precautions are not taken during the unpacking procedure.

  • Page 40: Ramp Extension And Installation

    that are attached with straps of fabric; be careful that the pieces do not swing out and hurt you or anybody else. Extend the ramps to their full length, if necessary, as shown in Figure 2-2. Figure 2-2 Ramp Extension and Installation Left unloading ramp...

  • Page 41: Shipping Bolt And Bracket

    Figure 2-3 Shipping Bolt and Bracket Leveler Shipping Bolt Shipping Bracket HPTC-0007 Loosen the leveler locking nuts, and screw the four rack levelers all the way up into the rack (see Step 3 in Figure 2-4). Carefully roll the rack off the pallet and down the ramps to the floor (see Step 4 in Figure 2-4).

  • Page 42: Inspecting The Racks

    Figure 2-4 Dismounting a Rack from a Pallet 2.4 Inspecting the Racks Before moving the racks into their final positions, inspect each rack using the following guidelines: Verify that all components within the rack are securely fastened, and that there are no loose pieces present in the rack interior.

  • Page 43: Leveling The Racks

    Verify that the circuit breaker on each power distribution unit is in the OFF position. Remove all shipping brackets and screws; save them for later use should the system need to be moved. 2.5 Leveling the Racks Level each rack in its final position as follows: Loosen the locknuts on all four leveler feet.

  • Page 44: Installing Side Panels

    Figure 2-6 Installing the Standard Baying Kit Brackets Threaded Holes in the Cabinet Frame Baying Bracket T-30 Torx Flat-Head Screw HPTC-0008 2.7 Installing Side Panels The cluster ships with two side panels for each row of racks. Multiple rack clusters are coupled and only need a side panel on either end of the grouping.
  • Page 45 Note: Newer 42U rack models have three side panel sections for each end of a row of racks. This means that there are six side panels to install in all. The new side panels are easier to handle and install. 2.7 Installing Side Panels...

  • Page 46: A Planning Checklist

    Preinstallation checklists – Verify the customer site is ready for the equipment installation. • Preinstallation survey information sheets – List customer name, address, and corresponding Hewlett-Packard sales and service personnel. • Preinstallation survey information forms – List delivery information and special instructions.

  • Page 47: Site Inspection Checklists

    Table A-1 Customer and HP Information Worksheet (continued) Secondary customer Telephone: E-mail: contact: Traffic coordinator: Telephone: E-mail: HP Information Order No: Sales representative: Telephone: E-mail: Site Surveyor: Telephone: E-mail: Survey Date: Delivery Date: A.3.2 Site Inspection Checklists Use the worksheet in Table A-2 to perform a site inspection.

  • Page 48: Delivery Survey

    Table A-2 Site Inspection Worksheet (continued) Item Check Comment or Date Is the dedicated branch circuit less than 250 ft (72.5 Are the input circuit breakers adequate for equipment loads? Safety Is there an emergency power shut-off switch? Is there a telephone available for emergency purposes? Is there a fire protection system in the computer room?
  • Page 49 Table A-3 Delivery Survey Worksheet (continued) Width of access door checked. Unloading permits checked. Permit agency address. Elevator Elevator capacity checked. Depth Height Width Stairs Number of flights. Width Height A.4 Delivery Survey...

  • Page 50: B Cluster Interconnect Topology

    B Cluster Interconnect Topology Methods of connecting individual servers into clusters are referred to as cluster topologies. The HP Cluster Platform uses a fat tree topology. This topology is represented by a network tree where the network capacity increases closest to the root of the tree than at its leaves, thereby making the network nonblocking.

  • Page 51: C General Guidelines For The Computer Room

    C General Guidelines for the Computer Room This appendix addresses some general site-planning topics that you might want to call out explicitly in your site plan. Caution: Wire colors referenced in this section apply to installations in the USA. Substitute the appropriate wire coding for your locale.

  • Page 52: Distribution Hardware

    Having these ground connections tied to metal chassis parts that might be touched protects computer room personnel against shock hazard from current leakage and fault conditions. Power distribution systems consist of several parts. Hewlett-Packard recommends that these parts be solidly interconnected to provide an potential ground to all points: •...

  • Page 53: Wiring Connections

    C.1.3.4 Wiring Connections Expansion and contraction rates vary among different metals. Therefore, the integrity of an electrical connection depends on the restraining force applied. Connections that are too tight can compress or deform the hardware and causes it to weaken. This usually leads to high impedance, which can cause circuit breakers to trip.

  • Page 54: Air Conditioning Equipment

    C.2.2 Air Conditioning Equipment The cooling capacity of the installed air conditioning equipment for the computer room should be sufficient to offset the computer equipment dissipation loads, as well as any space envelope heat gain. This equipment should include: • Air filtration •...

  • Page 55: Dust And Pollution Control

    Although this problem is relatively rare, it might be an issue within your computer room. Since metallic contamination can cause permanent or intermittent failures on your electronic equipment, Hewlett-Packard strongly recommends that your site be evaluated for metallic particulate contamination before installation.

  • Page 56: D Calculating Noise Levels

    D Calculating Noise Levels Use the following formulas to calculate noise levels: • Formula 1: The declared A-weighted sound power level according to ISO 9296 and ISO 7779 = log[N *10^(L ) + N *10^(L ) + …..] in bels. WAdT WAd1 WAd2...

  • Page 57: E Preventing Electrostatic Damage

    E Preventing Electrostatic Damage To avoid damaging the system, you must follow the configuration procedures and be aware of the standard precautions for handling electronic parts. A discharge of static electricity from a finger or other conductor might damage system boards or other static-sensitive devices. This type of damage can reduce the life expectancy of the device.

  • Page 58: Index

    Index documentation, 9 component access space, 24 documentation, 9 acoustics, 33 symbols and labels, 10 administrator, 20 component covers, 13 air conditioning, 54 components air filtration, 54 hot, 13 air quality, 55 computer room airflow general guidelines, 51 minimum clearances for, 25 conduit, 52 airflow space, 24 configuration...
  • Page 59 online, 9 conductive, 34 planning references, 19 footprint, rack, 21 related, 8 reporting errors in, 10 web resources, 9 general guidelines dust, 55 building distribution, 52 dynamic loading, 36 building power, 52 computer room, 51 cooling, 54 electrical environmental, 53 general guidelines, 51 fire protection, 51 standard, 32...
  • Page 60 illumination, 35 important information, 11 NEC standard, 32 InfiniBand network cables, 28 topology, 31 InfiniBand Trade Association NFPA, 51 URL, 10 NFPA standards, 32 information, customer, 46 noise inspection, site, 8 calculating levels, 56 installation level, 33 estimating total weight of, 26 noise levels, 13 human resources, 20 overview, 16...
  • Page 61 power supply, 31 ground, 53 preinstallation survey, 46 inspecting racks, 42 rack layout, 27 installing side panels, 44 site inspection, 46 leveling, 43 site inspection checklist, 47 limits, 35 site preparation, 19 number of, 16 TCP/IP address, 31 physical characteristics of, 21 tools and resources, 35 planning for delivery, 35 trucking, 26...
  • Page 62 safety considerations, 12 tools and resources required, 35 safety symbols, 10 trucking, 26 schedule unpacking space requirements, 23 delivery, 7 UPS, 30 installation, 7 weight, 26 security, 20 weight worksheet, 26 service space minimum clearances for, 24 air circulation, 24 service options, 10 space requirement, 23 shipping, 21...
  • Page 63 URL, 10 WAN, 31 warning hazard, 10, 11 warning labels, 10 warranty terms of, 10 web resources, 9 weight, 21 estimating, 26 wire, 52 wireless devices, 13, 34 wiring connections, 53 worksheet customer information, 46 delivery survey, 48 power and cooling, 25 site inspection, 46, 47 weight, 26 wrist strap, 34, 57...
  • Page 64 *A-CPSPG-1D* Printed in the US...

This manual is also suitable for:

Cluster platform

Table of Contents