Cisco UCS S3260 M5 Design Manual

Server with cloudian hyperstore object storage

Advertisement

Cisco UCS S3260 M5 Server with
Cloudian HyperStore Object Storage
Design Guide
January 24, 2019
Last Updated:
1

Advertisement

Table of Contents
loading

Summary of Contents for Cisco UCS S3260 M5

  • Page 1 Cisco UCS S3260 M5 Server with Cloudian HyperStore Object Storage Design Guide January 24, 2019 Last Updated:...
  • Page 2 CCDE, CCENT, Cisco Eos, Cisco Lumin, Cisco Nexus, Cisco StadiumVision, Cisco TelePresence, Cisco WebEx, the Cisco logo, DCE, and Welcome to the Human Network are trademarks; Changing the Way We Work, Live, Play, and Learn and Cisco Store are service marks; and Access Registrar, Aironet, AsyncOS, Bringing the Meeting...
  • Page 3: Table Of Contents

    Cisco UCS Manager ..................................8 Cisco UCS 6300 Fabric Interconnects ............................9 Cisco UCS 9332 Nexus Switches ............................. 10 Cisco UCS S3260 M5 Storage Server ............................11 Cisco UCS C220 M5 Rack-Mount Server ..........................12 Cisco UCS Virtual Interface Card 1387 ............................. 13 Red Hat Enterprise Linux 7.5 ................................
  • Page 4 Design Criteria ....................................26 Requirements ....................................26 Physical Infrastructure Considerations ............................27 Single Node versus Dual Node Cisco UCS S3260 ........................27 Replication versus Erasure Coding ..............................27 Replication ....................................27 Erasure Coding ..................................27 Supported Erasure Coding Configurations ..........................28 Flash Storage .....................................
  • Page 5: Executive Summary

    The purpose of this document is to describe the design of Cloudian HyperStore on Red Hat Enterprise Linux on the latest generation of Cisco UCS S3260 M5 Servers. This validated design provides the framework of designing and deploying Cloudian SDS software on Cisco UCS S3260 storage servers. The Cisco Unified Computing System provides the compute, network, and storage access components for the Cloudian HyperStore, deployed as a single cohesive system.
  • Page 6: Solution Overview

    Together with Cisco UCS, Cloudian Hyperstore can deliver a fully enterprise-ready solution that can manage dif- ferent workloads and still remain flexible. The Cisco UCS S3260 Storage Server is an excellent platform to use with the main types of Object and File workloads, such as capacity-optimized and performance-optimized workloads. It is best suited for sequential access, as opposed to random access to unstructured data, and to whatever data size.
  • Page 7 Cisco Unified Computing System  Cisco UCS 6332 Series Fabric Interconnects  Cisco UCS S3260 M5 storage servers  Cisco S3260 system IO controller with VIC 1380  Cisco C220M5 servers with VIC 1387  Cisco Nexus C9332PQ Series Switches ...
  • Page 8: Technology Overview

    UCS C-Series Rack-Mount Servers, and Cisco UCS Mini, as well as the associated storage resources and networks. Cisco UCS Manager is embedded on a pair of Cisco UCS 6300 or 6200 Series Fabric Interconnects using a clustered, active-standby configuration for high availability. The manager participates in server provisioning, device discovery, inventory, configuration, diagnostics, monitoring, fault detection, auditing, and statistics collection.
  • Page 9: Cisco Ucs 6300 Fabric Interconnects

    Cisco UCS Manager manages Cisco UCS systems through an intuitive HTML 5 or Java user interface and a CLI. It can register with Cisco UCS Central Software in a multi-domain Cisco UCS environment, enabling centralized management of distributed systems scaling to thousands of servers.
  • Page 10: Cisco Ucs 9332 Nexus Switches

    10 Gigabit Ethernet SFPs. The breakout feature can be configured on ports 1 to 12 and ports 15 to 26 on the Cisco UCS 6332UP fabric interconnect. Ports 17 to 34 on the Cisco UCS 6332 16-UP fabric interconnect support the breakout feature.
  • Page 11: Cisco Ucs S3260 M5 Storage Server

    Extending the capability of the Cisco UCS C3000 portfolio, the Cisco UCS S3260 helps you achieve the highest levels of data availability. With dual-node capability that is based on the Intel Xeon scalable processors, it features up to 600 TB of local storage in a compact 4-rack-unit (4RU) form factor.
  • Page 12: Cisco Ucs C220 M5 Rack-Mount Server

    TCO and increase their business agility. The Cisco UCS C220 M5 server extends the capabilities of the Cisco UCS portfolio in a 1-Rack-Unit (1RU) form factor. It incorporates the Intel® Xeon Scalable processors, supporting up to 20 percent more cores per socket, twice the memory capacity, 20 percent greater storage density, and five times more PCIe NVMe Solid-State Disks (SSDs) compared to the previous generation of servers.
  • Page 13: Cisco Ucs Virtual Interface Card 1387

    PCI slot, in addition to 2 x 10Gbase-T Intel x550 embedded (on the motherboard) LOM ports. The Cisco UCS C220 M5 server can be used standalone, or as part of the Cisco Unified Computing System, which unifies computing, networking, management, virtualization, and storage access into a single integrated architecture enabling end-to-end server visibility, management, and control in both bare metal and virtualized environments.
  • Page 14 Technology Overview  Delivers high-performance, reliability, and security  Is certified by the leading hardware and software vendors  Scales from workstations, to servers, to mainframes  Provides a consistent application environment across physical, virtual, and cloud deployments Designed to help organizations make a seamless transition to emerging datacenter models that include virtualization and cloud computing, Red Hat Enterprise Linux includes support for major hardware architectures, hypervisors, and cloud providers, making deployments across physical and different virtual environments predictable and secure.
  • Page 15: Cloudian Hyperstore

    Cloudian S3 scale-out storage. Use policies you define to automatically tier data to the public cloud. It’s simple to manage and limitlessly scalable. Get all the benefits of using the Cisco UCS platform while managing your data through a single pane of glass.
  • Page 16: Cloudian Hyperstore Design

    Cloudian HyperStore Cloudian HyperStore Design Cloudian HyperStore is an Amazon S3-compliant multi-tenant object storage system. The system utilizes a “non- SQL” (NoSQL) storage layer for maximum flexibility and scalability. The Cloudian HyperStore system enables any service provider or enterprise to deploy an S3-compliant multi-tenant storage cloud. The Cloudian HyperStore system is designed specifically to meet the demands of high volume, multi-tenant data storage: ...
  • Page 17: Cloudian Management Console

    Cloudian HyperStore Cloudian Management Console The Cloudian Management Console (CMC) is a web-based user interface for Cloudian HyperStore system administrators, group administrators, and end users. The functionality available through the CMC depends on the user type associated with a user’s login ID (system administrative, group administrative, or regular user). As a Cloudian HyperStore system administrator, you can use the CMC to perform the following tasks: ...
  • Page 18: S3 Compatible

    Cloudian HyperStore S3 Compatible With Amazon setting the cloud storage standard making it the largest object storage environment, and Amazon S3 API becoming the de facto standard for developers writing storage applications for cloud, it is imperative every Cloud, hybrid storage solution is S3 compliant. Cloudian HyperStore, in addition to being S3 compliant, also offers the flexibility to be on-premises object storage as well as hybrid tier to Amazon and Google clouds.
  • Page 19: Cloudian Features

    Cloudian HyperStore users or groups for a selected service period. The CMC has a function to display a single user’s bill report in a browser; HyperStore Admin API can be used to generate user or group billing data that can be ingested a third- party billing application.
  • Page 20: Cisco And Cloudian

    Cisco and Cloudian Cisco and Cloudian Cisco and Cloudian developed a solution that meets the challenges of scale-out storage. This solution uses Cloudian HyperStore Object Storage software with Cisco UCS S-Series Storage Servers powered by Intel Xeon processors. The Cisco UCS S3260 hardware platform and Cloudian’s HyperStore Object solution combines robust availability with system management control, monitoring capabilities and reporting.
  • Page 21: Solution Design

    Server Chassis'; each with two Cisco UCS S3260 M5 nodes configured as storage servers and one Cisco UCS C220 M5S rack server as Supervisor node. The whole solution is connected to a pair of Cisco UCS 6332 Fabric Interconnects and a pair of upstream network Cisco Nexus 9332PQ switches.
  • Page 22: System Hardware And Software Specifications

     Per Server Node  2 x Intel Xeon Silver 4114 (2.2GHz/10cores), 192 GB RAM  Cisco 12G RAID Controller  2 x SSD for OS  28 x 10TB HDDs for Data,  1 NVMe for metadata per node.
  • Page 23: Physical Topology And Configuration

     2 x Intel Xeon Silver 4110 (2.1GHz/8 Cores), 96GB RAM Node M5S Rack server  Cisco 12G SAS RAID Controller (Optional)  2 x 600GB SAS for OS  Dual-port 40 Gbps VIC UCS Fabric Intercon- Cisco UCS 6332...
  • Page 24: Network Topology

    Solution Design Network Topology Figure 14 illustrates the Network Topology used in the setup. High Availability As part of the hardware and software resiliency, the following tests will be conducted on the test bed. The results of the tests will be included in the deployment guide (to be published).
  • Page 25 Solution Design...
  • Page 26: Design Criteria

    Design Criteria Design Criteria There are several use cases and target industries where you can use the Cisco UCS and Cloudian SDS solution. The use cases and industries are several, but not limited to the following (Table 1 ). Use Cases...
  • Page 27: Physical Infrastructure Considerations

    Single Node versus Dual Node Cisco UCS S3260 Cisco UCS S3260 is offered with single node and dual node configurations for a full chassis in a 4RU rack space. Cluster may be categorized as capacity-based or performance-based depending on the requirements. A dual server offers double the CPU and memory for the same set of disks.
  • Page 28: Supported Erasure Coding Configurations

    Design Criteria fragments which are stored on 6 different nodes, and the object can be decoded and read so long as any 4 of those 6 fragments are available. Erasure coding requires less storage overhead (the amount of storage required for data redundancy) and results in somewhat longer request latency than replication.
  • Page 29: Flash Storage

    Design Criteria Nodes in the DC 12+4  Replicated EC This configuration requires a minimum of two Data Centers (DC). Each DC consists of 3 nodes each. This supports the minimum data and parity fragments of (2+1) where 1 is the parity. Table 4 lists the default replicated EC configuration and the default number of nodes per DC.
  • Page 30: Jbod Versus Raid0 Disks

    Cisco UCS and segregate them. A client-access network and private-cluster network are required for the operation. Cisco UCS S3260 has two physical ports of 40G each and the VIC allows you to create out many Virtual interfaces on each physical port.
  • Page 31: Expansion Of The Cluster

     Cisco UCS 6332 Fabric Interconnects have 32 ports each. Each server is connected to either of the FI’s. Leaving the uplinks and any other clients directly connected to the Fabrics, 24-28 server nodes can be connected to FI pairs. If more servers are required, you should plan for a multi-domain system.
  • Page 32 Design Criteria  Cisco UCS is a template and policy based infrastructure management tool. All the identity of the servers is stored through Service Profiles that are cloned from templates. When a template is created, a new service profile for the additional server, can be created and applied on the newly added hardware. Cisco UCS makes Infrastructure readiness, extremely simple, for any newly added storage nodes.
  • Page 33: Deployment Guide

    Deployment Guide Deployment Guide The test bed was deployed with 6 x Cisco UCS S3260 storage nodes. While a few functional tests were completed, more in-depth tests will follow. The findings of these tests and the resulting best practices will be...
  • Page 34: Summary

    Cisco UCS Infrastructure for Cloudian Software Defined Storage is an integrated solution to deploy Cloudian HyperStore and combines the value of Intel Xeon architecture, Cisco data center hardware and software, along with Red Hat Linux. This solution increases the speed of deployment and reduces the risk of scaling from proof- of-concept to full-enterprise production, and is validated and supported by Cisco and Cloudian.
  • Page 35: About The Authors

    About the Authors Muhammad Ashfaq, Cisco Systems, Inc. Muhammad Ashfaq is a Technical Marketing Engineer in Cisco UCS and Data Center Solutions Group. He has over 10 years of experience in IT Infrastructure, Server Virtualization, and Cloud Computing. His current role includes building Cloud Computing, Software defined Storage, Automation and Management, Converged and Hyper-Converged Solutions on Cisco UCS platforms.

Table of Contents