Composable Infrastructure for Data Intensive Workloads Solution Overview
Composable Infrastructure for Data Intensive Workloads Solution Overview December 2018 1
Drive. Scale Founders and Key Advisors F O U N D E R S Satya Nishtala, Chief Architect • Fellow, System Architect: Nuova (Cisco UCS) • Lead architect: Sun - Ultra. SPARC workstations and work-group servers, Storage Tom Lyon, Chief Scientist • Founder: Nuova (Cisco UCS) • Founder: Ipsilon (Nokia) • Emp #8: Sun Micro – Sun. OS, SPARC, Sun. Screen ADVISOR S Amr Awadallah Founder/CTO Cloudera Herb Cunitz President Hortonworks Scott Mc. Nealy Founder, CEO Sun Microsystems Whit Diffie Pioneer of Public Key Cryptograhy James Gosling Creator of Java 2
Drive. Scale Purpose DAS Drive. Scale was founded to radically transform how the modern compute platform is deployed in the data center. Seeing how the Cloud Giants were reaping the benefits of analytics and AI with massive data sets on their scale-out compute infrastructure, Drive. Scale set out to make it viable for any company to deploy data-intensive applications on premise and reap the same reward. Composable Drive. Scale designed a software platform that creates adaptable compute infrastructure out of heterogeneous components with cloud scale and agility at a significantly lower cost than traditional options: Composable Infrastructure 3
New Gartner Hype Cycle for Infrastructure, July 2018 Composable Infrastructure will be main- stream in 2 -5 years with High Benefit to enterprises. Gartner Definition: “Composable infrastructure provisions physical infrastructure from a set of pooled resources consisting of disaggregated heterogeneous compute, storage and fabric components. Infrastructure can be quickly assembled and disassembled through APIs and reusable templates, with a single interface that enables resource discovery, inventory and configuration. ” Why Enterprises Need Composable Infrastructure: - Enables data centers to achieve higher resource utilization and faster application deployment - Increases utilization on high-cost resources - Centralizes resource control and monitoring to enable higher utilization and more predictive capacity planning 4
IDC Forecasts Composable Infrastructure Market to Reach $4. 7 B in 2023 CDI Market $B The application-centric approach to IT — building environments that require new levels of scale, automation, and flexibility — can be effectively delivered via composable/ disaggregated infrastructure (CDI), a new class of converged infrastructure that brings together compute, storage, and networking elements and enabling software to provide an on-premises cloud-like experience. $5. 0 $4. 5 $4. 0 $3. 5 $3. 0 $2. 5 $2. 0 $1. 5 $1. 0 2018 2019 2020 2021 2022 2023 "New IT on-premises infrastructure deployments, mostly in the form of private cloud, will fuel aggressive investments in composable/disaggregated infrastructure, " said Ashish Nadkarni, group VP for IDC's Worldwide Infrastructure practice. "The maturity of newer low-latency and high-bandwidth fabrics and interconnects will accelerate the development of newer CDI products and solutions. " Worldwide Composable/Disaggregated Infrastructure Forecast, 2018– 2023, August 31, IDC 5
Data is Growing Exponentially Data Intensive Workloads Traditional Workloads IDC Forecast 6 Drive. Scale Confidential & Proprietary 2017
Examples of Data Intensive Workloads Big Data & AI Containers No. SQL Storage MPP 7
App ESX Spark Server Server Kubernetes Server Server Cassandra Server Server Hadoop Server Shared Storage – NAS Or SAN Server VM App VM VM App App VM VM App Large Apps Running on Clusters of Servers / Local Storage App Many Apps Managed on Each Server / Shared Storage App Data Intensive Workloads: App Traditional Workloads: VM VM App Data Center Architecture Transition Required ESX v. Sphere X 100 s or 1, 000 s 8 Drive. Scale Confidential & Proprietary 2017
You Want Choice AND Elasticity cargo plane COMPUTE sports car minivan cargo truck moped STORAGE 9
Composable Infrastructure Public Cloud Agility with Private Cloud Control, Performance, Security, Cost Dynamically change your infrastructure to match individual workload requirements 10
What is Composable Infrastructure? Two Simple Steps: 1) Disaggregate servers into… • Compute resources (diskless servers) • Storage resources (JBODs, NVMe EBOFs) 2) Compose nodes and clusters by… • Combining servers with storage via software • Dynamically re-compose as needs change 11
Step 1: Disaggregate the Servers Diskless Servers Start Instead buying of buying diskless servers with external internal drives… HDD or Flash Storage Typical Rack Server Configuration Drive. Scale Pooled Resources
Step 2: Dynamically Compose Servers and Clusters Ø Easily compose software-defined physical nodes and clusters on-the-fly Diskless Servers Ø Combine just the compute and storage resources needed for each workload Ø Easily add, remove or balance resources, even between clusters – no more silos! Ø No changes needed to the application stack Ø Performance equivalent to bare metal servers with direct attached storage Drive. Scale Pooled Resources HDD or Flash Storage
Composable Infrastructure is a better option Storage Type DAS (Direct Attached Storage) Composable Infrastructure Centralized Storage NAS or SAN Cost Performance Utilization Flexibility Scalability The best of both worlds! The performance and scale of DAS with the utilization of NAS/SAN at the lowest possible cost. 14 Drive. Scale Confidential & Proprietary 2017
Drive. Scale Composable Platform Drive. Scale Composer 3 rd Party Orchestration GUI Cloud Central API Compute pool • Adapter Agents Data Path Network switches Data Path Collects inventory from Agents Node and cluster composition and configuration Constraint management View cluster/server/drive status and health Encryption, RAID, drive shredding Drive. Scale Agents Composer Server Agents • • HDD, SSD pools Lightweight agent runs on Linux servers and storage systems Provides server and storage inventory to Composer Executes drive mounts, encryption, file system under Composer direction Includes configuration details and monitors status Drive. Scale Central • • Cloud-based portal for administration of all sites Download software updates, view log files, documentation, etc. 15
Compute and Storage Vendor Agnostic Drive. Scale works with your choice of compute and storage solutions Compute Options • Rack Servers • Blade Servers • Modular Servers Storage Options • SAS HDD/SSD in JBODs • NVMe EBOF (Ethernet-attached Bunch of Flash) • 3 rd party storage servers SAS JBOD w/ Drive. Scale SAS Adapter Cisco UCS S 3260 Drive. Scale NVMe Adapter Western Digital Ultrastar® Serv 24 -HA 16
To. R Switches 10 GE Drive. Scale SAS Adapter § High Performance SAS-Ethernet Bridge Node 1 Diskless Servers … Node N – 1 RU appliance w/ dual power supplies – 4 controllers (2 x 10 GE, 2 x 12 Gb 4 lane SAS) – 80 Gb throughput 10 GE SAS Card 1 Card 2 Card 3 Card 4 Controller 2 Controller 1 § Leverages Ethernet for optimal performance and cost Drive. Scale SAS Adapter § Multiple paths from any server to any drive for redundancy and performance SAS JBOD § Patented traffic balancing algorithms 17
To. R Switches 100/25/10 Gb. E Drive. Scale NVMe Adapter § High Performance NVMe Flash System Node 1 Diskless Servers … – – – Node N – 2 RU appliance w/ dual x 86 controllers 24 x 2. 5” form factor SSD drive bays 4 x 100 Gb ethernet (2 per controller; 200 Gb total throughput) High availability design (dual controller / power supplies) 10/25 GE 100 GE X 86 Ctrl 1 X 86 Ctrl 2 Drive. Scale NVMe Adapter § Supports i. SCSI and NVMe. OF (via Ro. CEv 2) protocols § Drives can be sliced and portions attached to servers § Works with single and dual-port drives – Single port uses interposer card for HA § Commodity pricing for drives (customer provided)
Benefits of Software Composable Infrastructure Reduce Costs Spend less on infrastructure and operation Respond Faster Operate your data center with the agility of a public cloud • • • Achieve higher utilization Avoid overprovisioning De-couple compute and storage lifecycles Reduce data center footprint Simplified management with fewer SKUs • • • Spin-up clusters in minutes instead of weeks Respond quickly to changing workloads Share resources across clusters and applications; no more silos Recompose servers and clusters on-demand via software Recover quickly from disk or server failures • • • Integrates quickly and easily • into your environment • Deploy with Confidence No changes required to the application stack Use servers and storage of your choice Same performance as bare metal servers w/ direct attached storage Redundant architecture for high availability Data security with encryption at rest and in flight 25
Drive. Scale Does for Clusters, What VMware Did for Servers Drive. Scale Solves Cluster Utilization Inefficiencies and Flexibility Limitations ESX VM App App VM VM App VM App VM VM App VMware Solved Server Utilization Inefficiencies and Flexibility Limitations Shared Storage – NAS Or SAN S e r v e r S e r v e r S e r v e r S e r v e r S e r v e r ESX Drive. Scale Composable Infrastructure v. Sphere 26 © 2017 Drive. Scale Proprietary & Confidential
Composable Infrastructure for Data Intensive Workloads Give your data center the agility of the public cloud at a fraction of the cost. 27
- Slides: 21