Page 1
Cisco UCS S3260 M5 Server with Cloudian HyperStore Object Storage Design Guide January 24, 2019 Last Updated:...
Page 2
CCDE, CCENT, Cisco Eos, Cisco Lumin, Cisco Nexus, Cisco StadiumVision, Cisco TelePresence, Cisco WebEx, the Cisco logo, DCE, and Welcome to the Human Network are trademarks; Changing the Way We Work, Live, Play, and Learn and Cisco Store are service marks; and Access Registrar, Aironet, AsyncOS, Bringing the Meeting...
The purpose of this document is to describe the design of Cloudian HyperStore on Red Hat Enterprise Linux on the latest generation of Cisco UCS S3260 M5 Servers. This validated design provides the framework of designing and deploying Cloudian SDS software on Cisco UCS S3260 storage servers. The Cisco Unified Computing System provides the compute, network, and storage access components for the Cloudian HyperStore, deployed as a single cohesive system.
Together with Cisco UCS, Cloudian Hyperstore can deliver a fully enterprise-ready solution that can manage dif- ferent workloads and still remain flexible. The Cisco UCS S3260 Storage Server is an excellent platform to use with the main types of Object and File workloads, such as capacity-optimized and performance-optimized workloads. It is best suited for sequential access, as opposed to random access to unstructured data, and to whatever data size.
Page 7
Cisco Unified Computing System Cisco UCS 6332 Series Fabric Interconnects Cisco UCS S3260 M5 storage servers Cisco S3260 system IO controller with VIC 1380 Cisco C220M5 servers with VIC 1387 Cisco Nexus C9332PQ Series Switches ...
UCS C-Series Rack-Mount Servers, and Cisco UCS Mini, as well as the associated storage resources and networks. Cisco UCS Manager is embedded on a pair of Cisco UCS 6300 or 6200 Series Fabric Interconnects using a clustered, active-standby configuration for high availability. The manager participates in server provisioning, device discovery, inventory, configuration, diagnostics, monitoring, fault detection, auditing, and statistics collection.
Cisco UCS Manager manages Cisco UCS systems through an intuitive HTML 5 or Java user interface and a CLI. It can register with Cisco UCS Central Software in a multi-domain Cisco UCS environment, enabling centralized management of distributed systems scaling to thousands of servers.
10 Gigabit Ethernet SFPs. The breakout feature can be configured on ports 1 to 12 and ports 15 to 26 on the Cisco UCS 6332UP fabric interconnect. Ports 17 to 34 on the Cisco UCS 6332 16-UP fabric interconnect support the breakout feature.
Extending the capability of the Cisco UCS C3000 portfolio, the Cisco UCS S3260 helps you achieve the highest levels of data availability. With dual-node capability that is based on the Intel Xeon scalable processors, it features up to 600 TB of local storage in a compact 4-rack-unit (4RU) form factor.
TCO and increase their business agility. The Cisco UCS C220 M5 server extends the capabilities of the Cisco UCS portfolio in a 1-Rack-Unit (1RU) form factor. It incorporates the Intel® Xeon Scalable processors, supporting up to 20 percent more cores per socket, twice the memory capacity, 20 percent greater storage density, and five times more PCIe NVMe Solid-State Disks (SSDs) compared to the previous generation of servers.
PCI slot, in addition to 2 x 10Gbase-T Intel x550 embedded (on the motherboard) LOM ports. The Cisco UCS C220 M5 server can be used standalone, or as part of the Cisco Unified Computing System, which unifies computing, networking, management, virtualization, and storage access into a single integrated architecture enabling end-to-end server visibility, management, and control in both bare metal and virtualized environments.
Page 14
Technology Overview Delivers high-performance, reliability, and security Is certified by the leading hardware and software vendors Scales from workstations, to servers, to mainframes Provides a consistent application environment across physical, virtual, and cloud deployments Designed to help organizations make a seamless transition to emerging datacenter models that include virtualization and cloud computing, Red Hat Enterprise Linux includes support for major hardware architectures, hypervisors, and cloud providers, making deployments across physical and different virtual environments predictable and secure.
Cloudian S3 scale-out storage. Use policies you define to automatically tier data to the public cloud. It’s simple to manage and limitlessly scalable. Get all the benefits of using the Cisco UCS platform while managing your data through a single pane of glass.
Cloudian HyperStore Cloudian HyperStore Design Cloudian HyperStore is an Amazon S3-compliant multi-tenant object storage system. The system utilizes a “non- SQL” (NoSQL) storage layer for maximum flexibility and scalability. The Cloudian HyperStore system enables any service provider or enterprise to deploy an S3-compliant multi-tenant storage cloud. The Cloudian HyperStore system is designed specifically to meet the demands of high volume, multi-tenant data storage: ...
Cloudian HyperStore Cloudian Management Console The Cloudian Management Console (CMC) is a web-based user interface for Cloudian HyperStore system administrators, group administrators, and end users. The functionality available through the CMC depends on the user type associated with a user’s login ID (system administrative, group administrative, or regular user). As a Cloudian HyperStore system administrator, you can use the CMC to perform the following tasks: ...
Cloudian HyperStore S3 Compatible With Amazon setting the cloud storage standard making it the largest object storage environment, and Amazon S3 API becoming the de facto standard for developers writing storage applications for cloud, it is imperative every Cloud, hybrid storage solution is S3 compliant. Cloudian HyperStore, in addition to being S3 compliant, also offers the flexibility to be on-premises object storage as well as hybrid tier to Amazon and Google clouds.
Cloudian HyperStore users or groups for a selected service period. The CMC has a function to display a single user’s bill report in a browser; HyperStore Admin API can be used to generate user or group billing data that can be ingested a third- party billing application.
Cisco and Cloudian Cisco and Cloudian Cisco and Cloudian developed a solution that meets the challenges of scale-out storage. This solution uses Cloudian HyperStore Object Storage software with Cisco UCS S-Series Storage Servers powered by Intel Xeon processors. The Cisco UCS S3260 hardware platform and Cloudian’s HyperStore Object solution combines robust availability with system management control, monitoring capabilities and reporting.
Server Chassis'; each with two Cisco UCS S3260 M5 nodes configured as storage servers and one Cisco UCS C220 M5S rack server as Supervisor node. The whole solution is connected to a pair of Cisco UCS 6332 Fabric Interconnects and a pair of upstream network Cisco Nexus 9332PQ switches.
Per Server Node 2 x Intel Xeon Silver 4114 (2.2GHz/10cores), 192 GB RAM Cisco 12G RAID Controller 2 x SSD for OS 28 x 10TB HDDs for Data, 1 NVMe for metadata per node.
Solution Design Network Topology Figure 14 illustrates the Network Topology used in the setup. High Availability As part of the hardware and software resiliency, the following tests will be conducted on the test bed. The results of the tests will be included in the deployment guide (to be published).
Design Criteria Design Criteria There are several use cases and target industries where you can use the Cisco UCS and Cloudian SDS solution. The use cases and industries are several, but not limited to the following (Table 1 ). Use Cases...
Single Node versus Dual Node Cisco UCS S3260 Cisco UCS S3260 is offered with single node and dual node configurations for a full chassis in a 4RU rack space. Cluster may be categorized as capacity-based or performance-based depending on the requirements. A dual server offers double the CPU and memory for the same set of disks.
Design Criteria fragments which are stored on 6 different nodes, and the object can be decoded and read so long as any 4 of those 6 fragments are available. Erasure coding requires less storage overhead (the amount of storage required for data redundancy) and results in somewhat longer request latency than replication.
Design Criteria Nodes in the DC 12+4 Replicated EC This configuration requires a minimum of two Data Centers (DC). Each DC consists of 3 nodes each. This supports the minimum data and parity fragments of (2+1) where 1 is the parity. Table 4 lists the default replicated EC configuration and the default number of nodes per DC.
Cisco UCS and segregate them. A client-access network and private-cluster network are required for the operation. Cisco UCS S3260 has two physical ports of 40G each and the VIC allows you to create out many Virtual interfaces on each physical port.
Cisco UCS 6332 Fabric Interconnects have 32 ports each. Each server is connected to either of the FI’s. Leaving the uplinks and any other clients directly connected to the Fabrics, 24-28 server nodes can be connected to FI pairs. If more servers are required, you should plan for a multi-domain system.
Page 32
Design Criteria Cisco UCS is a template and policy based infrastructure management tool. All the identity of the servers is stored through Service Profiles that are cloned from templates. When a template is created, a new service profile for the additional server, can be created and applied on the newly added hardware. Cisco UCS makes Infrastructure readiness, extremely simple, for any newly added storage nodes.
Deployment Guide Deployment Guide The test bed was deployed with 6 x Cisco UCS S3260 storage nodes. While a few functional tests were completed, more in-depth tests will follow. The findings of these tests and the resulting best practices will be...
Cisco UCS Infrastructure for Cloudian Software Defined Storage is an integrated solution to deploy Cloudian HyperStore and combines the value of Intel Xeon architecture, Cisco data center hardware and software, along with Red Hat Linux. This solution increases the speed of deployment and reduces the risk of scaling from proof- of-concept to full-enterprise production, and is validated and supported by Cisco and Cloudian.
About the Authors Muhammad Ashfaq, Cisco Systems, Inc. Muhammad Ashfaq is a Technical Marketing Engineer in Cisco UCS and Data Center Solutions Group. He has over 10 years of experience in IT Infrastructure, Server Virtualization, and Cloud Computing. His current role includes building Cloud Computing, Software defined Storage, Automation and Management, Converged and Hyper-Converged Solutions on Cisco UCS platforms.