Summary of Contents for Dell EMC VxFlex Ready Node 13G
Page 1
Dell EMC VxFlex Ready Node 13G Hardware Configuration and Operating System Installation Guide - Windows Servers P/N 302-003-058 REV 08...
Page 2
MERCHANTABILITY OR FITNESS FOR A PARTICULAR PURPOSE. USE, COPYING, AND DISTRIBUTION OF ANY DELL SOFTWARE DESCRIBED IN THIS PUBLICATION REQUIRES AN APPLICABLE SOFTWARE LICENSE. Dell, EMC, and other trademarks are trademarks of Dell Inc. or its subsidiaries. Other trademarks may be the property of their respective owners. Published in the USA.
CONTENTS Figures Tables Chapter 1 Introduction Overview.....................12 VxFlex OS component requirements............12 VxFlex OS cluster components............12 Physical server requirements............13 Supported operating systems............13 VxFlex OS Gateway server requirements........14 Prerequisites....................14 Connectivity...................14 Java....................15 Hardware and operating systems........... 15 VxFlex OS packages...............15 Supported Internet browsers............
Page 4
Where to go from here................71 Chapter 9 Reference material Reference material..................74 DTK - Hardware Update Bootable ISO............74 Dell OpenManage DRAC Tools (RACADM)........74 Update the SATADOM firmware ........... 77 Recommended BIOS and firmware settings........77 Troubleshooting the Hardware ISO..........80 Additional resources..............82...
FIGURES Single-node R730xd (2U1N) server (storage only) typical connection diagram...31 Single-node R730xd (2U1N) server (converged) typical connection diagram..... 31 Single-node R630 (1U1N) server typical connection diagram........32 Network Adapters - Windows 2012................38 Network Adapters - Windows 2016................38 Adapter Properties with Location - Windows 2012............. 39 Adapter Properties with Location - Windows 2016.............
Page 6
FIGURES Hardware Configuration and Operating System Installation Guide - Windows Servers...
Page 7
TABLES Server physical requirements..................13 Supported operating systems -VxFlex OS components..........13 VxFlex OS management IP network................33 VxFlex OS data IP network for Subnet #1..............33 VxFlex OS data IP network for Subnet #2..............33 Single-node server configuration (2U1N Converged)..........36 Single-node server configuration (2U1N Storage Only)..........37 Single-node server configuration (1U1N)..............
Page 8
TABLES Hardware Configuration and Operating System Installation Guide - Windows Servers...
Page 9
Preface As part of an effort to improve its product lines, Dell EMC periodically releases revisions of its software and hardware. Therefore, some functions described in this document might not be supported by all versions of the software or hardware currently in use.
Page 10
EMC products, go to Dell EMC Online Support at https://support.emc.com. Technical support Go to Dell EMC Online Support and click Service Center. You will see several options for contacting Dell EMC Technical Support. Note that to open a service request, you must have a valid support agreement. Contact your Dell EMC sales representative for details about obtaining a valid support agreement or with questions about your account.
CHAPTER 1 Introduction The following topics describe the prerequisites for configuring the hardware and the operating system in a Dell EMC VxFlex Ready Node environment. Overview......................12 VxFlex OS component requirements..............12 Prerequisites.......................14 Supported hardware configurations..............15 Introduction...
Introduction Overview To prepare a server to be part of a VxFlex Ready Node environment, you are required to perform the following steps. 1. Ensure that the environment meets the prerequisites. 2. Configure the hardware, including the BIOS, BMC (iDRAC) IP address, and ISO installation.
Introduction Physical server requirements Table 1 Server physical requirements Component Requirement Port specifications The following TCP ports are not used by any other application, and are open in the local firewall of the server: MDM: 6611 and 9011 SDS: 7072 (for multiple SDS, ports 7073-7076) VxFlex OS Gateway (includes REST Gateway, VxFlex OS Installation Manager, and SNMP trap sender): 80 and 443 Light Installation Agent (LIA): 9099...
Introduction Table 2 Supported operating systems -VxFlex OS components (continued) Operating system Requirement Hypervisors Hyper-V VxFlex OS Gateway server requirements Component Requirement Supported operating systems Windows 2008 R2, 2012 R2, or 2016, including the Visual C++ redistributable 2010 package, 64-bit. Server Core editions are not supported. Every server requires 2 cores and a minimum of 3 GB available RAM.
Introduction All root and administrator passwords that you plan to set or use on the server and BMC (iDRAC). To connect via a service PC or laptop computer using SSH/RDP: Ensure that the computer has a functional network port and an available IP address, subnet, and gateway on the management network.
Page 16
Introduction The following points apply, as well: Boot drive - All configurations have a 64 GB SATADOM boot drive. Switch requirements One 10 GbE switch is required. Two or more 10 GbE switches may be used for high availability and load balancing purposes. Separate (one or more) 1 GbE switches may be used for the management network.
CHAPTER 2 Configuring the Hardware The following topics describe how to configure the hardware, set BMC (iDRAC) IP addresses, and map the ISO for servers in a VxFlex Ready Node environment. Set up the BMC (iDRAC) IP address and BIOS...........18 Verify the status of the system hardware, storage controller, and disks - 13G servers.......................
Configuring the Hardware Set up the BMC (iDRAC) IP address and BIOS Set up the BMC (iDRAC) IP address and set up or validate the BIOS on the VxFlex Ready Node servers. Before you begin Ensure that you have access to, or have the details for: The KVM console The server BMC (iDRAC) IP address The server BMC (iDRAC) subnet mask...
Page 19
Configuring the Hardware Enable IP IPv4 = Enabled Enable DHCP = Disabled Static IP Address = Static IP address Static Gateway = Gateway IP address Static Subnet Mask = Subnet mask IP address d. From the IPv6 Settings pane, configure the IPv6 parameter values for the BMC (iDRAC) port.
Procedure <BMC/iDRAC_IP_address> . 1. From a browser, go to http:// 2. In the DELL Console Login window, type the user name and password, and then click Login. The System Summary dashboard displays the high-level status of all hardware devices in the Server Health pane.
<iDRAC_IP_address> . 1. From your Internet browser, go to https:// 2. In the DELL Console Login window, type the user name and password, and click Login. 3. In the main KVM console window, select the Server node in the navigation pane.
Updating the BIOS, firmware and settings VxFlex Ready Node deployments require specific versions of drivers, BIOS, and firmware that have been qualified by Dell EMC. If the servers do not have the correct versions, you must update them. A variety of factors can influence a mismatch between the required versions and the versions installed on the servers, such as firmware updates post server shipment, or a FRU replacement with a different firmware version than in the warehouse.
Configuring the Hardware For additional information regarding the Hardware ISO, see the reference section, DTK - Hardware Update Bootable ISO on page 74. Update the hardware using the iDRAC virtual console The iDRAC Virtual KVM console and Virtual CDROM features, provided by the iDRAC Enterprise license, eliminate the need for physical access to the VxFlex Ready Node servers.
Page 24
12. For each VxFlex Ready Node server, after the updates are finalized, clear the iDRAC job queue using the iDRAC GUI: <iDRAC_IP_address> . a. From your Internet browser, go to https:// b. In the DELL Console Login window, type these credentials: username: root <password> (for Dell-supplied nodes) or password (for EMC- password: supplied nodes) c.
CHAPTER 3 Installing the Operating System The following topics describe the procedures for installing the operating system on a VxFlex Ready Node server. System requirements..................26 Map the ISO file on a VxFlex Ready Node server..........26 Installing the Windows OS on a VxFlex Ready Node server........
5. To verify the ISO file selection, click Virtual Media and view the ISO selection in the drop down list. 6. Reset the server: a. In the main DELL System Setup console window, select Power Rest > System (warm boot) to display the list of keyboard keys with related functionality.
Procedure 1. Open a console to the server. 2. Boot the server by using the DELL Life Cycle Controller feature. 3. During the Windows OS installation, when prompted to select the disk for OS installation, select the 64 GB SATADOM device.
Page 28
Installing the Operating System Hardware Configuration and Operating System Installation Guide - Windows Servers...
CHAPTER 4 Network Architecture and Physical Connectivity The following topics provide networking requirements and connectivity information for VxFlex Ready Node. Networking connectivity architecture and cabling best practice......30 Network prerequisites..................32 Network Architecture and Physical Connectivity...
Network Architecture and Physical Connectivity Networking connectivity architecture and cabling best practice This topic describes connectivity architecture, cabling best practice information, and cable connection examples from typical VxFlex Ready Node configurations in order to help you plan your network. Where possible, it is recommended that you use dedicated network adapters for VxFlex OS traffic.
Page 31
Network Architecture and Physical Connectivity Figure 1 Single-node R730xd (2U1N) server (storage only) typical connection diagram Figure 2 Single-node R730xd (2U1N) server (converged) typical connection diagram Networking connectivity architecture and cabling best practice...
Network Architecture and Physical Connectivity Figure 3 Single-node R630 (1U1N) server typical connection diagram Network prerequisites Ensure that you have the following network resources and equipment available before installing VxFlex Ready Node servers. Note In addition to the requirements below for connecting VxFlex Ready Node servers to one or more switches, ensure that you have prepared the items described in Prerequisites on page 14 .
Network Architecture and Physical Connectivity Management network switches: One, 1 GbE and one BMC (iDRAC) port per node. IP addresses Virtual IP and AMS features are not supported by VxFlex Ready Node v2.0, but it is recommended to take the corresponding configurations into account when planning your network, to streamline future support for these features.
Page 34
Network Architecture and Physical Connectivity Table 5 VxFlex OS data IP network for Subnet #2 (continued) Item Description Comments IP address The pools of IP addresses used for static allocation for For clarity, the pool for the following groups: second subnet is Subnet #2 referred to as 1.
CHAPTER 5 Port Configuration The following topics describe the port designations for VxFlex Ready Node servers and provide instructions for configuring the ports. Determine the 2U1N node type................36 Server node port designations................36 Port Configuration...
Procedure 1. From your Internet browser, go to http:// <BMC/iDRAC_IP_address> . 2. In the DELL Console Login window, type the user name and password, and click Login. 3. In the navigation pane, select the CPU node under Hardware. 4. Count the number of lines in the Processor Information table.
Page 37
Port Configuration Table 6 Single-node server configuration (2U1N Converged) (continued) Descriptio VxFlex VxFlex OS VxFlex OS VxFlex OS VxFlex OS Not in (iDRAC) OS Data1 Client Client Data2 Management Monitoring Network Network Network Port1 Port2 Physical Onboard Onboard PCI 10G Right PCI 10G Left Onboard 1G Left Onboard 1G port on node...
Port Configuration Table 8 Single-node server configuration (1U1N) (continued) Descriptio VxFlex VxFlex OS VxFlex OS VxFlex OS VxFlex OS Not in (iDRAC) OS Data1 Client Client Data2 Management Monitoring Network Network Network Port1 Port2 Physical Mgmt Data Data Data Switch2 Data Switch2 Mgmt Switch Not in use...
Page 39
Port Configuration Figure 6 Adapter Properties with Location - Windows 2012 Configure the ports...
Page 40
Port Configuration Figure 7 Adapter Properties with Location - Windows 2016 2. Change the names of the network adapters to match each one's VxFlex OS role: a. Open the Windows Start menu, and select Network Connections. b. Right-click on the network adapter to be modified, select Properties and match the output under Connect Using: to the appropriate network adapter identified in the previous step.
Page 41
Port Configuration Figure 8 Connection Properties - Windows 2012 Configure the ports...
Page 42
Port Configuration Figure 9 Connection Properties - Windows 2016 c. Once you know the VxFlex OS role of the network adapter, right-click the network adapter, and select Rename. d. Type the appropriate name from the server node port designation tables, and then press ENTER.
Page 43
Port Configuration Figure 10 Connection Properties - Windows 2012 Configure the ports...
Page 44
Port Configuration Figure 11 Connection Properties - Windows 2016 c. Select the option Use the following IP address: and type the IP address and Subnet mask in the appropriate fields, and click OK twice. Note: For the "Public" network adapter, in addition, type the Default gateway address and at least one DNS server address in the appropriate fields, so that this computer can join a domain later on.
Page 45
Port Configuration 5. Repeat steps 1-4 for every node. 6. When all IP addresses are configured on all the nodes, run a sanity check: a. Open the Windows Start menu, and select Command Prompt. b. Ping all Data IP addresses of the other nodes to make sure you have the correct connectivity on each node, using the command: ping x.x.x.x (where x.x.x.x represents the Data IP address).
Page 46
Port Configuration Hardware Configuration and Operating System Installation Guide - Windows Servers...
CHAPTER 6 Installing the drivers The following topics contain information regarding VxFlex OS drivers. Clear the OEMDRV memory................48 Install the VxFlex OS drivers................48 Uninstall the FCoE drivers when Intel x520 drivers are used......49 Installing the drivers...
Installing the drivers Clear the OEMDRV memory If you installed the operating system on the VxFlex Ready Node server using the Dell Lifecycle Controller, clear the OEMDRV memory before installing any drivers. Note Failure to clear the OEMDRV memory immediately after installing the OS using the Lifecycle Controller will cause driver installation to fail.
Installing the drivers Note If you are installing Intel NIC drivers for Windows 2012 R2, you must include IANS (Intel Advanced Network Services) if you intend to use VLANs. If the drive installation requires a server reboot, the installation wizard will prompt you to do so.
Page 50
Installing the drivers Hardware Configuration and Operating System Installation Guide - Windows Servers...
CHAPTER 7 Preparing Disks The following topics describe how to prepare disks so that they can be added to VxFlex OS SDS devices. Adding disks to a VxFlex OS SDS............... 52 Retrieve device paths in a Windows server with HBA330 controller....
Procedure <BMC/iDRAC_IP_address> . 1. From your Internet browser, go to http:// 2. In the DELL Console Login window, type the user name and password, and click Login. The Integrated Remote Access Controller screen appears. 3. In the navigation pane, select Storage Controllers.
Root access to the server on which PERCCLI is to be installed Internet access to enable you to download the PERCCLI utility Procedure 1. Download PERCCLI from http://downloads.dell.com/FOLDER03559396M/1/ perccli-1.17.10-1.noarch.rpm. 2. Copy the installation file, perccli-1.17.10-1.noarch.rpm, to the /tmp folder on the node.
Page 54
Preparing Disks When creating virtual devices, note the following: Create one virtual device for each kind of disk, HDD or SSD. When DAS Cache is not used, configure the VDs for HDD with Direct IO, write- back, and read-ahead enabled (abbreviated in PERCCLI as RWBD). When DAS Cache is used, configure the VDs for HDD with Direct IO, write- through, and read-ahead enabled (abbreviated in PERCCLI as RWTD).
Page 55
Preparing Disks The output shows the following: Enclosure ID (EID): Used in a later step when creating VDs Slot ID (SLT) of each drive: Used in a later step when creating VDs Drive type: Displays SSD or HDD as the device type. (SSD drives are smaller —744 GB in this case.) Drive state: Should be UGood (unused and good) 3.
Page 56
Preparing Disks Create virtual devices for HDD with PERCCLI Use PERCCLI to create virtual devices (VDs) for HDDs on a VxFlex Ready Node server. The devices can be used as part of a Storage Pool or to provide caching. Before you begin Ensure that the PERCCLI disk utility is installed.
Preparing Disks Output similar to the following is displayed: Controller = 0 Status = Success Description = Add VD Succeeded Results The VD was created successfully. Create virtual devices for SSD with PERCCLI Use PERCCLI to create virtual devices (VDs) for SSDs on a VxFlex Ready Node server.
Page 58
Preparing Disks 3. Verify that all the devices have a virtual device created on them. In the Drive Information output, the device state displayed as "Onln" in the State column shows that the device has a virtual device created on it. 4.
Preparing Disks Cache = RWTD (for HDDs with DAS Cache) Cache = NRWTD (for SSDs) Cache = RWBD (for HDDs) After you finish After creating VD on Windows servers, proceed with the instructions for retrieving the device path that match the type of controller card in your server (HBA330 or H730). Retrieve device paths in a Windows server with HBA330 controller Retrieve the device paths in a Windows-based VxFlex Ready Node server with...
Preparing Disks e. Change the state of each device that is not initialized by right-clicking it and selecting Initialized. WARNING Do not change the state of an Initialized device. Contact your Administrator for support. Retrieve device paths in a Windows server with an H730 controller Retrieve the device paths in a Windows-based VxFlex Ready Node server with an H730 controller card.
Page 61
Preparing Disks a. Run: wmic diskdrive get deviceid,scsitargetid,interfacetype | findstr /c:"SCSI" Output similar to the following is displayed: b. In the SCSITargetId column, find the VD number. c. Match PhysicalDriveX under DeviceI D on the same line. In the above output, the PHYSICALDRIVE6 attribute shows the SCSITargetId value as 3.
Page 62
Preparing Disks Hardware Configuration and Operating System Installation Guide - Windows Servers...
CHAPTER 8 Additional Configurations The following topics describe additional configurations that are required for the installation process. Additional configurations..................64 Enabling DAS Cache..................64 Stop SanDisk DAS Cache Policy Service............70 Where to go after installing DAS Cache.............. 71 Install OpenManage Essentials................71 Where to go from here..................71 Additional Configurations...
Procedure <BMC/iDRAC_IP_address> . 1. From your Internet browser, go to http:// 2. In the DELL Console Login window, type the username and password, and click Login. 3. In the navigation pane, select the Physical Disks node under Storage. A table located under Health and Properties displays the physical disk information.
Additional Configurations Figure 12 Example of a mixed SSD and HDD configuration Install the DAS Cache utility in a Windows server Install the DAS Cache utility in a Windows-based VxFlex Ready Node server. Before you begin Ensure that you have: Administrator access to the server on which DAS Cache is to be installed Internet access for downloading the DAS Cache utility Procedure...
Additional Configurations Results You can use the DAS Cache utility, either from the console or via RDP. To run fiocli: Open a command line window with administrator's privileges and switch to the C: \Program Files\SanDisk DAS Cache directory. Open a command line window through Windows Explorer: 1.
Page 67
Additional Configurations b. In the lower pane, view the desired disk's details. If the disk displays a RAW hard drive and primary partition, as shown below, skip to Step on page 69. If the disk is unallocated, proceed to the next step to create a partition for DAS Cache: 3.
Page 68
Additional Configurations 4. In the Specify Volume Size window, set the volume size to the maximum (762493 MB), and then click Next. 5. In the Assign Drive Letter or Path window, select Do not assign a drive letter or drive path, and then click Next. 6.
Page 69
Additional Configurations 7. Continue scrolling through the wizard, and then click Finish to complete it. A partition is created for use with DAS Cache. 8. From the Windows Start menu, open Windows PowerShell. 9. Verify that caching was enabled in-software defined storage environments during installation: (Get-ItemProperty -Path "HKLM:\SYSTEM\CurrentControlSet \Services\fiodrv\parameters"...
Additional Configurations Note Ensure that you have copied and pasted the case level and symbols exactly as they appear in the above text. b. Save the file with the name fiodrv-params.reg. c. Double-click the fiodrv-params.reg file, and at the prompt click Yes. The registry values are added to the system.
FRU, return to the specific FRU guidelines for the next step. Install OpenManage Essentials Dell EMC OpenManage Essentials (OME) is a web-based console that simplifies hardware monitoring and firmware maintenance on VxFlex Ready Node servers. If your system does not use AMS, it is recommended that you install OME.
Page 72
Additional Configurations Hardware Configuration and Operating System Installation Guide - Windows Servers...
CHAPTER 9 Reference material This section contains additional information that may be required for the procedures described in this document. Reference material..................... 74 DTK - Hardware Update Bootable ISO............... 74 Reference material...
Guide. Update the hardware using remote RACADM You can install and execute the Dell RACADM tool from any management system with access to the iDRAC network. The remote RACADM command set is useful in this situation to mount and execute the Hardware ISO to a large number of VxFlex Ready Node servers.
Page 75
BIOS and firmware updates and configuration. All servers can be updated in parallel. 11. Wait for the configuration and firmware updates to complete. The server console screen will indicate when the script is complete. Dell OpenManage DRAC Tools (RACADM)
Page 76
Reference material WARNING Do not reboot the VxFlex Ready Node server while the update process is being performed! The iDRAC will be reset several times during the update process. This causes the iDRAC virtual console viewer to close, virtual media to disconnect, and the iDRAC browser window to be unavailable for several minutes during each reset.
Reference material Update the SATADOM firmware The Dell factory should provide the SATADOM boot device with the correct firmware already loaded. However, in some cases, it may be necessary to update the firmware loaded on the SATADOM boot device. For convenience, SATADOM firmware version S130710K is included on the VxFlex Ready Node Hardware ISO.
RACADM command: racadm -r <dracIP> -u root -p calvin update –f <filename.exe> Where: <dracIP> is the iDRAC IP address <filename.exe> is the name of the Dell Windows update packages Note The default password is calvin. Configuration settings The Hardware ISO runs a script that automatically configures the BIOS and iDRAC settings listed in the table below.
Page 79
Reference material Table 10 Hardware ISO configuration settings (continued) Description Setting Value Disk.SATAEmbedded.D-1,RAI D.Integrated.1-1 Server Boot Mode BIOS.BiosBootSettings.Boot Bios Mode SRIOV Global Enablement BIOS.IntegratedDevices.Sriov Enabled GlobalEnable Memory Performance Tuning BIOS.MemSettings.SnoopMo EarlySnoop System Change Tracking BIOS.MiscSettings.InSystem Disabled Characterization CPU Virtualization Features BIOS.ProcSettings.ProcVirtu Enabled alization...
Reference material Note When setting the BIOS configuration, include this command: racadm -r <dracIP> -u root -p <password> jobqueue create BIOS.Setup.1-1 <value> Troubleshooting the Hardware ISO This section describes troubleshooting procedures for problems you may encounter while using the Hardware ISO. Troubleshoot general iDRAC failures When problems occur with iDRAC or Lifecycle Controller jobs, you can delete all jobs with a single iDRAC command.
Page 81
2. Open the log to check the contents for errors: less /bundleapplicationlogs/apply_components.log 3. You can also view the script for the Hardware ISO, which is useful in helping to identify and troubleshoot log entries: less /opt/dell/toolkit/systems/drm_files/apply_bundles.sh Troubleshooting the Hardware ISO...
Reference material Results The script attempts to configure several boot order commands, regardless of the hardware configuration of the VxFlex Ready Node server. This allows the script to support multiple hardware platform configurations. Therefore, it is normal to see these error messages within the logs: Firmware updates may also display and log the following message: This update is not compatible with your system configuration.
Page 83
Dell OpenManage Deployment Toolkit (DTK) The Dell OpenManage Deployment Toolkit (DTK) includes a set of utilities, sample scripts, and sample configuration files that you can use to deploy and configure Dell systems. You can use the DTK to build script-based and RPM-based installation for deploying large number of systems on a pre-operating system environment in a reliable way, without changing their current deployment processes.
Page 84
Reference material Hardware Configuration and Operating System Installation Guide - Windows Servers...