Fujitsu PRIMEHPC FX700 Upgrade And Maintenance Manual

Fujitsu PRIMEHPC FX700 Upgrade And Maintenance Manual

Supercomputer
Hide thumbs Also See for PRIMEHPC FX700:
Table of Contents

Advertisement

Quick Links

FUJITSU Supercomputer
PRIMEHPC FX700
Upgrade and Maintenance
Manual
C120-0090-04EN

Advertisement

Table of Contents
loading

Summary of Contents for Fujitsu PRIMEHPC FX700

  • Page 1 FUJI T SU Super c o m pute r PRI M EHPC FX7 0 0 Upg r ade and Ma i nt e nance Manual FUJITSU Supercomputer PRIMEHPC FX700 Upgrade and Maintenance Manual C120-0090-04EN...
  • Page 2: Preface

    Preface Preface This document describes the upgrade procedures and maintenance of the FUJITSU Supercomputer PRIMEHPC FX700: - Upgrading the configuration by adding optional hardware parts - Upgrading the configuration by replacing existing hardware parts - Updating HCP firmware through software operations - Replacing faulty hardware parts The work procedures contained in this manual vary in degree of difficulty.
  • Page 3 Preface This chapter describes the handling of the BMCIFU.   Appendix A External Views of the Device This appendix shows external views of the device as well as the LEDs and buttons. Warning and Important Notice Symbols This manual uses the following symbols to provide warnings and indicate useful information to the user, to prevent personal injury and property damage.
  • Page 4 Preface Edition Date Changed Location (Change Description Classification)(*1) November 24, 2020 Preface Updated "Safety, Radio, and Harmonics (North America)," "Safety, Radio, and Harmonics (Europe)," and "Caution Labels" Chapter 2 Updated "2.1 Installation Precautions" Chapter 4 Updated "4.6.2 Displaying Configuration Information" Chapter 10 Updated "10.1 Basic...
  • Page 5 Be sure to keep this manual in a safe and convenient location for quick reference. Fujitsu makes every effort to prevent injury to users and bystanders as well as property damage. Be sure to use the product in accordance with the instructions in the manual.
  • Page 6 Safety Precautions Safety, Radio, and Harmonics (North America) (continued) Certified Standard Number Safety Radio Harmonics Standard CAN/CSA C22.2 No. 60950-1-07, 2nd Ed., 2014-10 ✓ CAN/CSA C22.2 No. 62368-1-14, 2nd Ed., 2014-12 ICES ICES-003 Issue 6 (2017) ✓ Environmental Substances (North America) Standard Number Energy-Saving Environmental...
  • Page 7 Safety Precautions Safety, Radio, and Harmonics (Europe) (continued) Certified Standard Number Safety Radio Harmonics Standard EN 62479 (2010) ✓ EN 55035 (2017) EN 55032 (2012); Class A EN 55024 (2010)  EN 61000-4-2 (2009)  EN 61000-4-3 (2006), +A1, +A2  EN 61000-4-4 (2012)  EN 61000-4-5 (2014), +A1  EN 61000-4-6 (2014)  EN 61000-4-8 (2010)
  • Page 8 Safety Precautions Japan Safety, Radio, and Harmonics (Japan) Certified Standard Number Safety Radio Harmonics Standard Act on Product Safety of Electrical Appliances and ✓ Materials VCCI VCCI (2016)/VCCI-CISPR 32 (2016) ✓ JIS C 61000-3-2 (2019) ✓ Energy-Saving, Environmental Substances, and Recycling/Disposal (Japan) Standard Number Energy-Saving Environmental...
  • Page 9 Safety Precautions Export Related (South Korea) Standard Number IATA Dangerous Goods Regulations 58th Edition (2017) (Regulations on transport of lithium, lithium-ion batteries, and electric double layer capacitors) Foreign Exchange and Foreign Trade Control Law of Japan Export Administration Regulations (EAR) Australia/New Zealand Safety, Radio, and Harmonics (Australia/New Zealand) Certified...
  • Page 10 Fujitsu is not responsible for any radio or television interference caused by unauthorized modification of this equipment or the substitution or attachment of connecting cables and equipment other than those specified by Fujitsu. The user shall be responsible for correcting the interference caused by such unauthorized modification, substitution, or attachment.
  • Page 11 M.2 Slot Device Status: PASS in boxes. Italics Indicates the name of a referenced manual. See the FUJITSU Supercomputer PRIMEHPC FX700 BMC User's Guide. " " Indicates the title of a referenced chapter, section, or See "Chapter 4 Operation." subsection.
  • Page 12 Company names and product names are the trademarks or registered trademarks of their respective owners. Trademark indications (TM, (R)) are omitted for some system and product names in this document. This document shall not be reproduced or copied without the permission of the publisher. All Rights Reserved, Copyright FUJITSU LIMITED 2020 C120-0090-04EN...
  • Page 13: Notes On Product Handling

    Ask a certified service engineer or our sales representative to perform the inspection and repair work for this product and the optional products provided by Fujitsu. The work must not be done by the customer under any circumstances. Otherwise, electric shock, injury, or fire may result.
  • Page 14: Table Of Contents

    Contents Contents Preface ……………………………………………………………………………………… Notes on Product Handling ……………………………………………………………… Chapter 1 Preliminary Work ……………………………………………… 1.1 Work Procedure Classification …………………………………………………………… 1.1.1 Customer Replaceable Unit (CRU) ………………………………………………………… 1.1.2 Field Replaceable Unit (FRU) ……………………………………………………………… 1.1.3 Upgrade and Repair Unit (URU) …………………………………………………………… 1.2 Work Time ………………………………………………………………………………… 1.3 Required Tools …………………………………………………………………………… Chapter 2 Important Information ………………………………………… 2.1 Installation Precautions ……………………………………………………………………...
  • Page 15 Contents 3.7 Removing the PSU ………………………………………………………………………… 3.8 Removing the Dummy PSU ……………………………………………………………… 3.9 Removing the FANU ……………………………………………………………………… 3.10 Removing the FX700 Main Unit From the Rack ……………………………………… 3.11 Removing the Top Cover ………………………………………………………………… 3.12 Installing the Top Cover ………………………………………………………………… 3.13 Installing the FX700 Main Unit in the Rack ……………………………………………...
  • Page 16 Contents 4.6.2 Displaying Configuration Information ……………………………………………………… 4.7 Installing the OS …………………………………………………………………………… 4.8 Installing the InfiniBand Driver …………………………………………………………… Chapter 5 Blade …………………………………………………………… 38 5.1 Basic Information ………………………………………………………………………… 5.2 Replacing the Blade ……………………………………………………………………… 5.2.1 Preliminary Steps …………………………………………………………………………… 5.2.2 Removing the Blade ………………………………………………………………………… 5.2.3 Removing the Riser Module and M.2 SSD ……………………………………………… 5.2.4 Installing the Riser Module and M.2 SSD …………………………………………………...
  • Page 17 Contents Chapter 8 InfiniBand Card ……………………………………………… 53 8.1 Basic Information ………………………………………………………………………… 8.2 Replacing an InfiniBand Card …………………………………………………………… 8.2.1 Preliminary Steps …………………………………………………………………………… 8.2.2 Removing an InfiniBand Card ……………………………………………………………… 8.2.3 Installing an InfiniBand Card ……………………………………………………………… 8.2.4 Final Steps …………………………………………………………………………………… 8.3 Adding an InfiniBand Card ………………………………………………………………… 8.3.1 Preliminary Steps …………………………………………………………………………… 8.3.2 Removing a Slot Cover ……………………………………………………………………… 8.3.3 Installing an InfiniBand Card ………………………………………………………………...
  • Page 18 Contents Appendix A External Views of the Device ……………………………… 73 A.1 External Views of the Device …………………………………………………………… A.1.1 Front Configuration of the FX700 Main Unit ……………………………………………… A.1.2 Rear Configuration of the FX700 Main Unit ……………………………………………… A.1.3 LANs of the FX700 Main Unit ……………………………………………………………… A.1.4 Internal Configuration of the FX700 Main Unit …………………………………………… A.1.5 Internal Blade Configuration ………………………………………………………………...
  • Page 19 Contents Figure Table Contents Figure Contents Figure 3.1 Riser Module Numbers (Top View of the Blade) ……………………………… Figure 3.2 Riser Module Guide (for PCIECARD#00) ……………………………………… Figure 3.3 Riser Module Suspended (Problem) …………………………………………… Figure 3.4 Riser Module Not Suspended (No Problem) ……………………………………   Figure 4.1 [Maintenance] Screen ……………………………………………………………...
  • Page 20 Contents Figure 9.4 Installing the M.2 SSD …………………………………………………………… Figure 9.5 Securing the M.2 SSD ……………………………………………………………   Figure 10.1 BAREBONE of the FX700 Main Unit ……………………………………………   Figure 11.1 BMCIFU of the FX700 Main Unit ……………………………………………… Figure 11.2 Removing the BMCIFU (Top View of the FX700 Main Unit) ………………… Figure 11.3 Removing the BMCIFU …………………………………………………………...
  • Page 21 Contents Table Contents Table 1.1 Part Handled as a Customer Replaceable Unit ………………………………… Table 1.2 Parts Handled as Field Replaceable Units ……………………………………… Table 1.3 Parts Handled as Upgrade Parts ………………………………………………… Table 1.4 Work Time Calculation …………………………………………………………… Table 1.5 Tools Required and Screws Used for FX700 Maintenance Work ………………  ...
  • Page 22: Chapter 1 Preliminary Work

    The installation and removal of field replaceable units involve complex maintenance procedures for components essential to the device. Only Fujitsu service personnel and Fujitsu-trained technicians are capable of performing maintenance procedures related to field replaceable units. Please be aware that illegally tampering with the system voids the warranty and exempts the manufacturer from liability.
  • Page 23: Upgrade And Repair Unit (Uru)

    CMU (blade) InfiniBand card M.2 SSD Only Fujitsu service personnel and Fujitsu-trained technicians are capable of performing installation procedures related to these units. Please be aware that illegally tampering with the system voids the warranty and exempts the manufacturer from liability.
  • Page 24: Required Tools

    Chapter 1 Preliminary Work 1.3 Required Tools Table 1.4 Work Time Calculation (continued) Step Included? Description Start up The startup time varies greatly depending on the hardware and software configurations. Required Tools When preparing for maintenance work, confirm that you have all the required tools according to the following table.
  • Page 25: Chapter 2 Important Information

    Chapter 2 Important Information 2.1 Installation Precautions Chapter 2   Important Information This chapter contains important information for using this product correctly and safely. Installation Precautions - Do not install this product in a place where the floor is unstable. Doing so may cause the floor to collapse.
  • Page 26: Power, Voltage, And Connection Precautions

    Contact your facilities manager or a qualified electrician if you are not sure what type of power is supplied to your building. - Do not use household extension cords with your Fujitsu product. Household extension cords do not have overload protection and are not meant for use with computer systems. Using household extension cords may lead to fire or electric shock.
  • Page 27: Precautions On Handling Optional Equipment

    - Mount or remove optional equipment only after disconnecting the power plugs of the FX700 main unit and connected equipment from the outlets. Otherwise, electric shock may result. - Only connect Fujitsu-recommended products to this product. Doing so may cause malfunctions, fire, or electric shock.
  • Page 28: Fcc Class A Declaration Of Conformity

    Fujitsu is not responsible for any radio or television interference caused by unauthorized modification of this equipment or the substitution or attachment of connecting cables and equipment other than those specified by Fujitsu. The user shall be responsible for correcting the interference caused by such unauthorized modification, substitution, or attachment.
  • Page 29 EU. When returning your used device, please use the return and collection systems available to you. Details regarding the return and recycling of devices and consumables within Europe can also be found in the Returning used devices manual. This manual is available at your local Fujitsu branch. C120-0090-04EN...
  • Page 30: Chapter 3 Basic Hardware Procedures

    You can determine the error level from [level] in the format of the SNMP trap notification. Using the Web GUI, you can also identify the error level from the [FRU information] screen. For details on how to log in, see "3.1.1 FRU Information" in the FUJITSU Supercomputer PRIMEHPC FX700 BMC User's Guide (C120-0091EN).
  • Page 31: Shutting Down The Fx700 Main Unit

    Disconnecting Cables From the BMCIFU The following is the procedure for disconnecting cables from the BMCIFU. Disconnect LAN cables from the BMCIFU. Removing the Blade See "3.9 Installing/Removing the Blade" in the FUJITSU Supercomputer PRIMEHPC FX700 Operating Manual (C120-0089EN). C120-0090-04EN...
  • Page 32: Removing The Dummy Blade

    When hot-swapping a blade, transfer the M.2 SSDs and InfiniBand cards from the old blade to the new blade. Removing the Dummy Blade See "3.11 Installing/Removing the Dummy Blade" in the FUJITSU Supercomputer PRIMEHPC FX700 Operating Manual (C120-0089EN). To perform active addition of a blade, see "Chapter 5...
  • Page 33: Removing The Fx700 Main Unit From The Rack

    FANU." Remove it from the rack and disassemble. See "4.2 Removing the Chassis" in the FUJITSU Supercomputer PRIMEHPC FX700 Operating Manual (C120-0089EN). Two or more people are required to remove the chassis from the rack. Be careful that your fingers and clothes do not get trapped when pulling out or returning the chassis.
  • Page 34: Installing The Top Cover

    Chapter 3 Basic Hardware Procedures 3.12 Installing the Top Cover Lift (1) and remove (2) the top cover. 3.12 Installing the Top Cover Before installing the cover, confirm that no unnecessary parts or tools have been left in the chassis. - See "Chapter 2 Important Information."...
  • Page 35: Installing The Fx700 Main Unit In The Rack

    Chapter 3 Basic Hardware Procedures 3.13 Installing the FX700 Main Unit in the Rack Secure the top cover with screws. 3.13 Installing the FX700 Main Unit in the Rack - When installing the FX700 main unit, be careful not to allow the rack to topple. C120-0090-04EN...
  • Page 36: Installing The Blade

    Chapter 3 Basic Hardware Procedures 3.18 Installing the FANU See "3.8.2 Mounting the Chassis in the Rack" in the FUJITSU Supercomputer PRIMEHPC FX700 Operating Manual (C120-0089EN). 3.14 Installing the Blade See "3.9 Installing/Removing the Blade" in the FUJITSU Supercomputer PRIMEHPC FX700 Operating Manual (C120-0089EN).
  • Page 37: Connecting External Cables

    See "3.15 Connecting Cables" in the FUJITSU Supercomputer PRIMEHPC FX700 Operating Manual (C120-0089EN). 3.20 Connecting Power Cords See "3.15.3 Connecting the Power Cord" in the FUJITSU Supercomputer PRIMEHPC FX700 Operating Manual (C120-0089EN). 3.21 Powering On the FX700 Main Unit The following is the procedure for powering on the FX700 main unit.
  • Page 38: Removing The Riser Module (For Pcie#00)

    Chapter 3 Basic Hardware Procedures 3.22 Handling the Riser Module Figure 3.1 Riser Module Numbers (Top View of the Blade) Location Component PCIECARD#00 PCIECARD#01 3.22.1 Removing the Riser Module (for PCIE#00) If necessary, remove cables from the blade. Remove the fixing screw. (Circled part) Lift and remove the riser module.
  • Page 39: Installing The Riser Module (For Pcie#00)

    Chapter 3 Basic Hardware Procedures 3.22 Handling the Riser Module 3.22.2 Installing the Riser Module (for PCIE#00) Mount the riser module in the blade, and push the green touchpoints down. (Circled parts) Secure it with a fixing screw. (Circled part) C120-0090-04EN...
  • Page 40 Chapter 3 Basic Hardware Procedures 3.22 Handling the Riser Module If necessary, connect cables to other components. Referring to "Figure 3.2 Riser Module Guide (for PCIECARD#00)," confirm that the riser module is correctly inserted in the guide. (Circled part) C120-0090-04EN...
  • Page 41 Chapter 3 Basic Hardware Procedures 3.22 Handling the Riser Module Figure 3.2 Riser Module Guide (for PCIECARD#00) After inserting the module, confirm that the riser module is not suspended. Figure 3.3 Riser Module Suspended (Problem) Suspended, which is not acceptable C120-0090-04EN...
  • Page 42: Installing The Slot Cover On The Riser Module

    Chapter 3 Basic Hardware Procedures 3.22 Handling the Riser Module Figure 3.4 Riser Module Not Suspended (No Problem) Not suspended 3.22.3 Installing the Slot Cover on the Riser Module Insert the slot cover in the direction of the arrow into the opening at the front of the riser module. Secure the slot cover to the riser module with a screw.
  • Page 43: Removing The Front Bezel

    Chapter 3 Basic Hardware Procedures 3.24 Installing the Front Bezel 3.23 Removing the Front Bezel The following is the procedure for removing the front bezel. Remove the front bezel fixing screws (circled parts), and remove the front bezel. 3.24 Installing the Front Bezel The following is the procedure for installing the front bezel.
  • Page 44: Chapter 4 Basic Software Procedures

    4.1.1 Setting Maintenance Mode Log in to the Web GUI. For details on how to log in, see "2.1 Login and Logout" in the FUJITSU Supercomputer PRIMEHPC FX700 BMC User's Guide (C120-0091EN). Select [Maintenance] from the menu. The [Maintenance] screen appears.
  • Page 45: Clearing Maintenance Mode

    4.1.2 Clearing Maintenance Mode Log in to the Web GUI. For details on how to log in, see "2.1 Login and Logout" in the FUJITSU Supercomputer PRIMEHPC FX700 BMC User's Guide (C120-0091EN). Select [Maintenance] from the menu. The [Maintenance] screen appears.
  • Page 46: Precaution On Maintenance Mode

    Chapter 4 Basic Software Procedures 4.2 Updating HCP Firmware The Information area at the top of the screen turns clear, and the location LED of the part requiring maintenance is turned off. 4.1.3 Precaution on Maintenance Mode If a failure occurs in the FANU, maintenance mode cannot be set for the CMU. Also, the following message will appear.
  • Page 47 Chapter 4 Basic Software Procedures 4.2 Updating HCP Firmware Figure 4.3 [Firmware Update] Screen Click the [Browse] button, and select the HCP firmware to be registered. Click the [Register] button. A dialog box appears and displays a message about overwriting the already registered HCP firmware. Figure 4.4 Confirmation Dialog Box Click the [OK] button.
  • Page 48: Applying Hcp Firmware

    Chapter 4 Basic Software Procedures 4.2 Updating HCP Firmware 4.2.2 Applying HCP Firmware Confirm that [Registered] in [HCP Version] displays the version number of the HCP firmware to be applied. Click the [Apply] button. A confirmation dialog box appears. Figure 4.5 Confirmation Dialog Box Click the [OK] button.
  • Page 49: System Event Log (Sel)

    Chapter 4 Basic Software Procedures 4.3 System Event Log (SEL) Figure 4.6 Error Message (at Upload) Start the HCP firmware registration procedure again from the beginning. System Event Log (SEL) 4.3.1 Displaying SEL From the system event log, the [System Event Logs] screen displays the 3,000 most recent events that occurred in the FX700 main unit.
  • Page 50 Chapter 4 Basic Software Procedures 4.3 System Event Log (SEL) Figure 4.7 Displayed SEL List Table 4.1 SEL Display Items and Displayed Contents Display Item Details of Display Page(s) Displays the number of registered log entries and the number of pages in the log. You can move between pages by using the [<] button and [>] button.
  • Page 51: Specifying Filter Conditions

    Chapter 4 Basic Software Procedures 4.3 System Event Log (SEL) Remarks You can display log details from a log column by double-clicking on the column. 4.3.2 Specifying Filter Conditions To filter the display of SEL in [Logs:], specify filter conditions in [Event type Filter:] on the [System Event Logs] screen.
  • Page 52: Collecting A Snapshot

    4.3.3 Collecting a Snapshot A snapshot is used to investigate in detail a hardware failure. Before collecting a snapshot, contact your local Fujitsu service center. Click the [Collect] button under [Snapshot Files:]. The [Collect Settings] dialog box appears. Figure 4.9 Clicking the [Collect] Button Specify settings in [Type] and [Encrypt], and click the [Collect] button.
  • Page 53 Chapter 4 Basic Software Procedures 4.3 System Event Log (SEL) Table 4.3 Specifying Settings in [Type] and [Encrypt] Input Item Description Type Specify the type of snapshot to collect: - Partial: Reduced-size snapshot - Full: Maximum-size log snapshot Encrypt To encrypt the snapshot, check the check box. Click the [OK] button.
  • Page 54: Collecting An Environment Log

    Collecting an Environment Log An environment log is used to investigate in detail a hardware failure. Before collecting an environment log, contact your local Fujitsu service center. Specify a node number and log type in [Environment Logs:], and click the [Download] button.
  • Page 55 Chapter 4 Basic Software Procedures 4.4 Controlling Nodes Figure 4.15 [Power Control] Screen Specify an operation in [Power Control] for a node. For a powered-off node, you can specify either of the following: - Power On: Issues a power-on instruction. - (Not specified): Does nothing. (Selected by default) For a powered-on node, you can specify any of the following: - Stop: Stops the node.
  • Page 56 Chapter 4 Basic Software Procedures 4.4 Controlling Nodes Table 4.5 Specifying a Start Mode Input Item Description Disk boot Not supported For OS installation Force boot into EFI Boot Manager Stops at UEFI. (Default) Auto select Boot Script Number Automatically select DISK boot. Click the [Apply] button at the bottom of the screen.
  • Page 57: Setting The Time

    Chapter 4 Basic Software Procedures 4.6 Checking the I/O Configuration Setting the Time Set the date and time and display the settings as shown below. Figure 4.17 Setting the Date and Time Table 4.7 Setting the Date and Time Input/Display Item Description Date: Specify a date with the pulldown menus. Time: Specify a time in the 24-hour format.
  • Page 58: Displaying Configuration Information

    PCI Slot Device Status: PASS ・ Installing the OS See "3.17 Installing the OS" in the FUJITSU Supercomputer PRIMEHPC FX700 Operating Manual (C120-0089EN). Installing the InfiniBand Driver See "3.18 Installing the InfiniBand Driver" in the FUJITSU Supercomputer PRIMEHPC FX700 Operating Manual (C120-0089EN).
  • Page 59: Chapter 5 Blade

    Chapter 5 Blade 5.1 Basic Information Chapter 5   Blade This chapter describes the handling of the blades. - Do not damage or manipulate the internal cables and devices. Doing so may damage parts or cause fire or electric shock. - Even after shutdown, the internal devices and components of the blade remain hot for a while. After shutting down a blade, wait until the hot components are cool before installing or removing an internal option.
  • Page 60: Replacing The Blade

    Chapter 5 Blade 5.2 Replacing the Blade Table 5.1 Mounting Order in Blade Installation CMU#00 CMU#01 CMU#02 CMU#03 Number of blades: 1 Number of blades: 2 Number of blades: 3 Number of blades: 4 - At any of these locations where no blade will be mounted, always install a dummy blade in order to comply with applicable EMC directives.
  • Page 61: Installing The Riser Module And M.2 Ssd

    Chapter 5 Blade 5.3 Adding a Blade 5.2.4 Installing the Riser Module and M.2 SSD Install the removed riser modules and M.2 SSDs in the new blade. "3.22.2 Installing the Riser Module (for PCIE#00)." "9.2.3 Installing the M.2 SSD." 5.2.5 Installing the Blade "3.14 Installing the Blade."...
  • Page 62: Removing The Dummy Blade

    Card." "9.2.3 Installing the M.2 SSD." Install the blade in the chassis. See "3.9.1 Installing the Blade in the Chassis" in the FUJITSU Supercomputer PRIMEHPC FX700 Operating Manual (C120-0089EN). 5.3.4 Final Steps Perform the following procedure to put everything back together.
  • Page 63: Chapter 6 Psu (Power Supply Unit)

    Chapter 6 PSU (Power Supply Unit) 6.1 Basic Information Chapter 6   PSU (Power Supply Unit) This chapter describes the handling of the PSUs (power supply units). Safety Precautions - Do not dismantle the PSUs. Otherwise, electric shock may result. - Even after shutdown, the temperature around the PSUs remains high. After turning off a PSU, wait until the hot components are cool before removing the PSU.
  • Page 64: Replacing A Psu

    Chapter 6 PSU (Power Supply Unit) 6.2 Replacing a PSU - Mount the PSUs in order of priority, which is PSU#00 to PSU#01 to PSU#02. - At any of these locations where no PSU will be mounted, always install a dummy PSU in order to comply with applicable EMC directives.
  • Page 65: Installing The Psu

    Chapter 6 PSU (Power Supply Unit) 6.2 Replacing a PSU 6.2.3 Installing the PSU This section describes how to install the PSU. Lift up the handle on the PSU halfway in the direction of the arrow. Push in the PSU (1) until the latch clicks and locks in place. Fold back the handle on the PSU (2). C120-0090-04EN...
  • Page 66: Final Steps

    Chapter 6 PSU (Power Supply Unit) 6.3 Adding a PSU Confirm that the PSU has been firmly inserted and is secured. 6.2.4 Final Steps From the Web GUI, power on the newly installed PSU. Select [PSU On] from [Power Control] in [PSU Maintenance] on the [Maintenance] screen. From the Web GUI, clear maintenance mode.
  • Page 67: Installing The Psu

    Chapter 6 PSU (Power Supply Unit) 6.3 Adding a PSU - When performing warm maintenance, mount the PSU within 1 minute after removing the dummy PSU. - Keep the dummy PSU, considering that it may be used the future. While pushing the latch (1), remove the dummy PSU in the direction of the arrow (2). 6.3.3 Installing the PSU This section describes how to install the PSU.
  • Page 68: Chapter 7 Fanu (Fan Unit)

    Chapter 7 FANU (Fan Unit) 7.2 Replacing a FANU Chapter 7   FANU (Fan Unit) This chapter describes the handling of the FANUs (fan units). - Do not damage or manipulate the internal cables and devices. Doing so may damage parts or cause fire or electric shock.
  • Page 69: Preliminary Steps

    Chapter 7 FANU (Fan Unit) 7.2 Replacing a FANU - Be careful when unlocking the FANU lock while the device is running because the FANU may then be ejected with great force. - When inserting a FANU during warm maintenance, you need to push the FANU forcefully against (60 N or more) and quickly past (within about 1 second) the flap.
  • Page 70 Chapter 7 FANU (Fan Unit) 7.2 Replacing a FANU The following shows the places to hold a FANU when removing it. Example Thumb Index Finger Operation with right hand Operation with left hand While the second lock for fall prevention is unlocked (3), pull out the FANU. C120-0090-04EN...
  • Page 71: Installing The Fanu In The Chassis

    Chapter 7 FANU (Fan Unit) 7.2 Replacing a FANU - Be careful when unlocking the FANU lock while the device is running because the FANU may then be ejected with great force. - Even after you remove the FANU from the FX700 main unit, the fan is still spinning from momentum. Do not insert your fingers, hands, etc.
  • Page 72 Chapter 7 FANU (Fan Unit) 7.2 Replacing a FANU Before mounting the FANU, confirm that its fan has definitely stopped rotating. From the moment that the FANU starts pushing back the flap as you insert the FANU during warm maintenance, push the FANU forcefully (60 N or more) and quickly (within about 1 second) into the chassis.
  • Page 73: Final Steps

    Chapter 7 FANU (Fan Unit) 7.2 Replacing a FANU ! FAN alarm LED Install the front bezel. 7.2.4 Final Steps From the Web GUI, clear maintenance mode. "4.1.2 Clearing Maintenance Mode." C120-0090-04EN...
  • Page 74: Chapter 8 Infiniband Card

    Chapter 8 InfiniBand Card 8.2 Replacing an InfiniBand Card Chapter 8   InfiniBand Card This chapter describes the handling of InfiniBand cards. - Do not damage or manipulate the internal cables and devices. Doing so may damage parts or cause fire or electric shock. - Even after shutdown, the internal devices and components of the FX700 main unit remain hot for a while.
  • Page 75: Removing An Infiniband Card

    Mode." Remove all external cables from the InfiniBand card. Remove the blade from the chassis. See "3.9.2 Removing the Blade From the Chassis" in the FUJITSU Supercomputer PRIMEHPC FX700 Operating Manual (C120-0089EN). Remove the riser module from the blade. "3.22.1 Removing the Riser Module (for PCIE#00)."...
  • Page 76: Final Steps

    Install the riser module. "3.22.2 Installing the Riser Module (for PCIE#00)." Install the blade in the chassis. See "3.9.1 Installing the Blade in the Chassis" in the FUJITSU Supercomputer PRIMEHPC FX700 Operating Manual (C120-0089EN). Connect all the external cables. "3.19 Connecting External Cables."...
  • Page 77: Adding An Infiniband Card

    Mode." Remove all external cables from the blade. Remove the blade from the chassis. See "3.9.2 Removing the Blade From the Chassis" in the FUJITSU Supercomputer PRIMEHPC FX700 Operating Manual (C120-0089EN). Remove the riser module from the blade. "3.22.1 Removing the Riser Module (for PCIE#00)."...
  • Page 78: Final Steps

    Chapter 8 InfiniBand Card 8.3 Adding an InfiniBand Card 8.3.4 Final Steps "8.2.4 Final Steps." C120-0090-04EN...
  • Page 79: Chapter 9 M.2 Ssd

    Chapter 9 M.2 SSD 9.1 Basic Information Chapter 9   M.2 SSD This chapter describes the handling of the M.2 SSDs. - Do not damage or manipulate the internal cables and devices. Doing so may damage parts or cause fire or electric shock. - Even after shutdown, the internal devices and components of the FX700 main unit remain hot for a while.
  • Page 80: Replacing An M.2 Ssd

      Remove all external cables from the blade. Remove the blade from the chassis. See "3.9.2 Removing the Blade From the Chassis" in the FUJITSU Supercomputer PRIMEHPC FX700 Operating Manual (C120-0089EN). Remove the riser module from the blade. "3.22 Handling the Riser Module."...
  • Page 81: Installing The M.2 Ssd

    Chapter 9 M.2 SSD 9.2 Replacing an M.2 SSD Figure 9.2 Removing the M.2 SSD 9.2.3 Installing the M.2 SSD Figure 9.3 M.2 SSD   With the M.2 SSD slightly tilted and the label facing up, insert the M.2 SSD into the M.2 slot. Figure 9.4 Installing the M.2 SSD Secure the M.2 SSD to the standoff spacer with one screw.
  • Page 82: Final Steps

    Install the riser module. "3.22.2 Installing the Riser Module (for PCIE#00)." Install the blade in the chassis. See "3.9.1 Installing the Blade in the Chassis" in the FUJITSU Supercomputer PRIMEHPC FX700 Operating Manual (C120-0089EN). Connect all the external cables. "3.19 Connecting External Cables."...
  • Page 83: Adding An M.2 Ssd

    Mode." Remove all external cables from the blade. Remove the blade from the chassis. See "3.9.2 Removing the Blade From the Chassis" in the FUJITSU Supercomputer PRIMEHPC FX700 Operating Manual (C120-0089EN). Remove the riser module from the blade. "3.22.1 Removing the Riser Module (for PCIE#00)."...
  • Page 84: Chapter 10 Barebone (Barebones Server)

    Chapter 10 BAREBONE (Barebones Server) 10.1 Basic Information Chapter 10   BAREBONE (Barebones Server) This chapter describes the handling of the BAREBONE (barebones server). - Do not damage or manipulate the internal cables and devices. Doing so may damage parts or cause fire or electric shock. - Even after shutdown, the internal devices and components of the FX700 main unit remain hot for a while.
  • Page 85: Replacing The Barebone

    Chapter 10 BAREBONE (Barebones Server) 10.2 Replacing the BAREBONE Figure 10.1 BAREBONE of the FX700 Main Unit 10.2 Replacing the BAREBONE If you have done the work in "3.1.3 Identifying a Faulty Part" and identified the BMCU, replace the BAREBONE. Work contents: Field replaceable unit (FRU) Work time: 40 minutes for hardware Tools: Phillips PH2/(+) No.2 screwdriver  ...
  • Page 86: Removing The Barebone

    Chapter 10 BAREBONE (Barebones Server) 10.2 Replacing the BAREBONE Remove each mounted unit. "3.5 Removing the Blade." "3.6 Removing the Dummy Blade." "3.7 Removing the PSU." "3.8 Removing the Dummy PSU." "3.9 Removing the FANU." 10.2.2 Removing the BAREBONE Remove the faulty chassis from the rack. "3.10 Removing the FX700 Main Unit From the Rack."...
  • Page 87: Final Steps

    Chapter 10 BAREBONE (Barebones Server) 10.2 Replacing the BAREBONE 10.2.4 Final Steps Update HCP firmware. "4.2 Updating HCP Firmware." From the Web GUI, configure chassis replacement in maintenance mode. If maintenance mode is set, go to the next step. "4.1.1 Setting Maintenance Mode."...
  • Page 88: Chapter 11 Bmcifu

    Chapter 11 BMCIFU 11.2 Replacing the BMCIFU Chapter 11   BMCIFU This chapter describes the handling of the BMCIFU. - Do not damage or manipulate the internal cables and devices. Doing so may damage parts or cause fire or electric shock. - Even after shutdown, the internal devices and components of the FX700 main unit remain hot for a while.
  • Page 89: Preliminary Steps

    Chapter 11 BMCIFU 11.2 Replacing the BMCIFU 11.2.1 Preliminary Steps Perform the following procedure to prepare for BMCIFU replacement. Look for the target BMCIFU. "3.1 Using Diagnostic Information." Shut down the FX700 main unit. "3.2 Shutting Down the FX700 Main Unit." From the Web GUI, configure chassis replacement in maintenance mode. Disconnect power cords.
  • Page 90 Chapter 11 BMCIFU 11.2 Replacing the BMCIFU Figure 11.2 Removing the BMCIFU (Top View of the FX700 Main Unit) - Be sure to hold the body of the connector when disconnecting the connector. Do not pull any part of the cable to disconnect it. - Take sufficient care not to damage the parts around the connector when disconnecting the connector.
  • Page 91: Installing The Bmcifu

    Chapter 11 BMCIFU 11.2 Replacing the BMCIFU Be careful that no cable gets caught when you pull out the BMCIFU. 11.2.3 Installing the BMCIFU From the rear of the FX700 main unit, insert the BMCIFU. Figure 11.4 Installing the BMCIFU Be careful that the BMCIFU cable does not get caught when you insert the BMCIFU. Install the BMCIFU fixing screw (1).
  • Page 92: Final Steps

    Chapter 11 BMCIFU 11.2 Replacing the BMCIFU Figure 11.5 Securing the BMCIFU (Top View of the FX700 Main Unit) Pass the cable under the bus bar (2). Connect the cable connector (3). Take sufficient care not to damage the parts around the connector when connecting the connector. 11.2.4 Final Steps After replacing the BMCIFU, perform the following procedure to put everything back together.
  • Page 93 Chapter 11 BMCIFU 11.2 Replacing the BMCIFU Connect the power cords. "3.20 Connecting Power Cords." From the Web GUI, configure chassis replacement in maintenance mode. If maintenance mode is set, go to the next step. "4.1.1 Setting Maintenance Mode." Confirm startup. Start the node from the power button on the operation panel. Check the I/O configuration.
  • Page 94: Appendix A External Views Of The Device

    Appendix A External Views of the Device A.1 External Views of the Device Appendix A   External Views of the Device This appendix shows external views of the device as well as the LEDs and buttons. External Views of the Device A.1.1 Front Configuration of the FX700 Main Unit This section shows the front of the FX700 main unit.
  • Page 95: A.1.3 Lans Of The Fx700 Main Unit

    Appendix A External Views of the Device A.1 External Views of the Device Figure A.3 Rear Configuration of the FX700 Main Unit Location Component CMU#00 CMU#01 CMU#02 CMU#03 PSU#00 PSU#01 PSU#02 BMCIF#00 A.1.3 LANs of the FX700 Main Unit This section shows the locations of the BMC maintenance port, BMC control port, and node management ports.
  • Page 96: A.1.4 Internal Configuration Of The Fx700 Main Unit

    Appendix A External Views of the Device A.1 External Views of the Device A.1.4 Internal Configuration of the FX700 Main Unit This section shows the internal configuration of the FX700 main unit. Figure A.5 Internal Configuration of the FX700 Main Unit Location Component PSU x 3, BMCIFU (not visible) FX700 blade (not visible) BMCU...
  • Page 97: A.2 Indicator Lamps And Controls

    Appendix A External Views of the Device A.2 Indicator Lamps and Controls Location Component CPU#01 M.2 SSD (not visible because it is under riser module) CPU#01 riser module CPU#01 and heat sink CPU#00 M.2 SSD (not visible because it is under riser module) CPU#00 riser module CPU#00 and heat sink Indicator Lamps and Controls...
  • Page 98 Appendix A External Views of the Device A.2 Indicator Lamps and Controls Location Display State Description System This device not selected as maintenance identification target LED (front) On, blue This device selected as maintenance target Blinking, blue Maintenance in progress on this device System alarm No failure On, orange...
  • Page 99 Appendix A External Views of the Device A.2 Indicator Lamps and Controls A.2.1.2 Front Panel Buttons Resetting the BMC during operation may result in abnormal system operation. Figure A.8 Front Panel Buttons Location Display Button Description Power on/off button Press the button to power on or off the server. - Short press the button to power on all nodes (only if all the nodes in the device are off).
  • Page 100: A.2.2 Server Rear

    Appendix A External Views of the Device A.2 Indicator Lamps and Controls A.2.1.3 FANU LED Figure A.9 Locations of the Front LEDs on the FX700 Main Unit Location State Description FAN alarm LED No failure On, orange This FANU failed A.2.2 Server Rear A.2.2.1 BMCIFU LEDs Figure A.10 BMCIFU LED (ID)
  • Page 101 Appendix A External Views of the Device A.2 Indicator Lamps and Controls Location Display State Description System identification This device not selected as LED (rear) maintenance target On, blue This device selected as maintenance target Blinking, blue Maintenance in progress on this device Figure A.11 BMCIFU LAN LEDs Location...
  • Page 102 Appendix A External Views of the Device A.2 Indicator Lamps and Controls A.2.2.2 Hot-Plug PSU LED Figure A.12 Hot-Plug PSU LED (AC PSU) Location State Description Green LED Orange LED PSU status LED No AC output from any PSU connected to device One of following states: - Output stopped due to PSU failure - No AC connection to other PSUs mounted in device, or no AC input to this PSU...
  • Page 103: A.2.3 Blade Rear

    Appendix A External Views of the Device A.2 Indicator Lamps and Controls A.2.3 Blade Rear A.2.3.1 Rear LEDs on the Blade Figure A.13 Rear LEDs on the Blade (1) (2) (3) Location Display State Description Power LED This blade node powered off On, green This blade node powered on Alarm LED No failure...
  • Page 104 Appendix A External Views of the Device A.2 Indicator Lamps and Controls Location State Description LAN speed LED On, orange Indicates data traffic at a transmission speed of 1 Gbit/s. On, green Indicates data traffic at a transmission speed of 100 Mbit/s. Indicates data traffic at a transmission speed of 10 Mbit/s.

Table of Contents