Ich Bin Ein Stacker Accelerate Open Stack Deployment
Ich Bin Ein Stacker: Accelerate Open. Stack Deployment with Dell EMC Arkady Kanevsky Service Provider Solutions, Dell EMC
Our design philosophy IT Open Architectures Maximum choice, flexibility and investment protection, without forklift upgrades 2 © Copyright 2018 Dell Inc. Modern Portfolio Modular Systems IT Modern systems and technologies no vested interest in legacy systems Open building blocks enabling mix-andmatch interoperability up and down the stack Scalable Solutions IT Systems tailored to your workloads and designed to grow with your business and extensible for your needs
Dell EMC Ready Architecture for Red Hat Open. Stack Platform Tested reference architecture design to simplify and accelerate production deployments for CSPs (& x. SP) Pre-validated with Dell EMC cloud infrastructure hardware and Red Hat Open. Stack Platform software, the Dell EMC Ready Architecture for Red Hat Open. Stack Platform reduces the time it takes to procure, validate, and integrate components. 3 © Copyright 2018 Dell Inc. Key Values: • Fully validated and documented • Enables CSPs to rapidly launch their own services • Prescriptive yet customizable to meet workload needs of CSPs • Leverage expertise from Dell EMC Consulting Services and Professional Services to help customize your deployment
Dell EMC Ready Architecture for Red Hat Open. Stack Platform Components Red Hat Open. Stack Platform • • • Kernel-based Virtual Machine Red Hat Ceph Storage Open v. Switch and Neutron plugins Red Hat Enterprise Linux Cinder storage plugins Dell EMC infrastructure • Dell EMC Networking • 2+ x S 5248 -ON • 1 x S 3048 T-ON • Power. Edge Rack Servers • 7+ x R 640/R 740 • 3+ x R 740 XD • SC series storage (optionally) 4 © Copyright 2018 Dell Inc.
Dell EMC Ready Architecture for Red Hat Open. Stack Platform Advantages Ready-to-use solution Long lifecycle support • Fully validated and tested by Dell EMC • Long-life Intel® Xeon® processors on Dell EMC Power. Edge servers • Decreases your deployment risk • Enables faster deployment time • Reduces your investment risk • Protects your investment for the longhaul World-class professional services • Dell EMC professional services available • Consulting, deployment, and design support • Guides you to customize your deployment Customizable solution • Prescriptive solution yet not restrictive • Customize to address your unique VNF workload requirements • Extensible and repeatable utilizing profiles Delivers exceptional scalability and agility in an integrated, optimized, and cost-effective package 5 © Copyright 2018 Dell Inc.
Dell EMC NFV Ready Architecture for Red Hat: 13. 0 Summary Hardware Support Ø Server: R 640, R 740 xd Ø Networking: S 3048, S 4048, S 6100, Z 9100, S 5048 & Ø Ø S 5248 NICs: 25 Gb. E NICs Support via Intel XXV 710 Storage: SDS w/ RH Ceph Storage (v 3. 1) (SC Series) BIOS: UEFI Support (with legacy BIOS for older HW) Misc: BOSS Support Service Provider Features Ø Ø 25 Gb. E Networking Cumulus Linux Network OS Jet. Pack Profiles (x. SP, CSP) OVS-DPDK, SR-IOV, MTU support, Neutron DVR, VLAN aware VMs Enhancements Validated Software, Certifications Dell EMC NFV Ready Architecture for Red Hat 6 © Copyright 2018 Dell Inc. ü ü ü ü Red Hat OSP 13 (Including Latest Updates) Red Hat Enterprise Linux (v 7. 6) SDS w/ RH Ceph Storage (v 3. 1) Tempest Validation & Market Certification Jet. Pack for OSP 13 1 st Red Hat bare metal certification Dell EMC storage RHOSP certification: Unity/VNX, XIO, Power. Max, SC series Technical Documentation ü 13. 0 Architecture Guide ü Hardware Deployment Guide ü Validation results ü Release notes ü 13. 0 Software Deployment Guide in Jet. Pack Knowledge Management ü Solution Specification Sheet ü Solution Brief ü Overview Presentation
Jet. Pack and Deployment Automation 7 © Copyright 2018 Dell Inc.
Dell EMC Jet. Pack Automation Toolkit Rapid, automated Open. Stack deployment <50% Automates workload-optimized Open. Stack cloud deployment and configuration deployment time for Dell EMC Power. Edge R-series Works with Red Hat Open. Stack Platform (RHOSP) director and Open. Stack Ironic Use for both initial deployments and in-place updates/upgrades *Based on Dell EMC internal testing, April 2017 8 © Copyright 2018 Dell Inc.
Dell EMC Jet. Pack Automation Toolkit Automate deployment, lifecycle ops, and maintenance 9 © Copyright 2018 Dell Inc. Deployment templates for Red Hat Open. Stack Platform director Role-based node optimization Hardware configuration management Update and upgrade management
Dell EMC Jet. Pack Automation Toolkit Automate deployment, lifecycle ops, and maintenance Workload Profiles Automatic node discovery and proposed role assignment <2 Support for composable roles 10 © Copyright 2018 Dell Inc. Orchestration of Ironic administration hours per rack* Rapid Open. Stack deployment Preconfigured for Life Migration support
Workload Optimized? 1. 2. 3. Choice of HW components specific for Workload 1. NIC with PF support and offload for NFV workload 2. Combination of NVMe and HDDs for Hadoop 3. GPUs and FPGAs for Machine Learning or HPC HW configuration 1. BIOS setting for virtualization acceleration 2. Processor off-load for encryption, Secure Boot 3. MTU on switches and port grouping Open. Stack configuration 1. 4. 11 Huge Page, NUMA pinning, DVR, MTU size, SR-IOV, DPDK, Orchestrate and coordinate across all of them © Copyright 2018 Dell Inc.
How do you put it all together? – Jet. Pack and Triple. O Open Source Project - https: //github. com/dsp-jetpack/Jet. Pack Deployment and Lifecycle Flexibility specific to a workload Predefined Profiles for specific Workloads: Telco/NFV, Generic Service Provider/x. SP Flexibility to customize all features beyond predefined profiles Layered on top of Triple. O and Ironic 12 © Copyright 2018 Dell Inc.
How do you put it all together? – Jet. Pack and Triple. O Technical: Deployment and Lifecycle Flexibility Feature set In-place Upgrades Part of Open. Stack project / standards Business: Partner Ecosystem Award winning, follow the sun support Entire Stack ownership Know-how 13 © Copyright 2018 Dell Inc.
Jet. Pack Overview The Context The Approach • Red Hat OSP • Day-0 Enablement embedded within standard deployment – by Jet. Pack • Red Hat OSP Director • Dell EMC Jetstream Jet. Pack automated life-cycle management software • https: //github. com/dsp-jetpack/Jet. Pack Feature Set specific to Workload – part of Jet. Pack profile Jet. Pack configures servers in optimized way for Workload defined by Profile 14 © Copyright 2018 Dell Inc. • Day-N Compute and Storage node addition or removal and Cloud updates – by Jet. Pack
What is Profile? A profile is basically a fixed set of configuration options in the automation files For the deployment of a particular workload, there are certain features that need to be set in a pre-specified way; all other features/settings are set to defaults. Sample features: IP Addresses, v. LAN IDs, NIC Configuration, MTU size, Huge. Page size/count vcpu pin set, Ceph OSD/Journal choices, OVS enabled to use DPDK SR-IOV for external-facing networks, choice of PFs (physical functions aka ports) for use with SR-IOV, NIC Alignment for external-facing SR-IOV networks, DVR IPv 6 for tenant network only 15 © Copyright 2018 Dell Inc.
Network Automation Addition for JS-13. 0 • Using a standardized planning worksheet Dell EMC’s Professional Services engage with the customer to assist customer’s understanding of Open. Stack Deployments. Once filled in, the key/value pairs are exported and through the use python scripts and solution template files the deployment configurations files are created to drive the automation tools for clustered solutions while eliminating errors, reducing time and effort. Planning worksheet Export Key/Value Pair File Python Script Template Files 16 © Copyright 2018 Dell Inc. Generated Configuration Files
VLANs Public API Management/OOB Provisioning Tenant-Tunneling (GRE/VXLAN) Private API Storage Network Storage Clustering External Tenants (Floating IP) Internal Tenants 100. 10. 128/26 393 255. 192. 168. 110. 0/24 110 255. 0 192. 168. 120. 0/24 120 255. 0 192. 168. 130. 0/24 130 255. 0 192. 168. 140. 0/24 140 255. 0 192. 168. 170. 0/24 170 255. 0 192. 168. 180. 0/24 180 255. 0 100. 10. 192/26 394 255. 192. 168. [201 -250]. 0/24 201 -250 255. 0 100. 10. 129 100. 10. 150 100. 10. 189 192. 168. 110. 1 192. 168. 110. 22 192. 168. 110. 40 192. 168. 120. 12 192. 168. 120. 50 192. 168. 120. 150 192. 168. 120. 200 192. 168. 130. 150 192. 168. 130. 200 192. 168. 140. 1 (opt) 192. 168. 140. 150 192. 168. 140. 200 192. 168. 170. 1 (opt) 192. 168. 170. 150 192. 168. 170. 200 192. 168. 180. 1 (opt) 192. 168. 180. 150 192. 168. 180. 200 100. 10. 193 100. 10. 200 100. 10. 250 VLAN Information Network VLan. ID Net. Mask Gateway DHCP allocation_pool_start DHCP allocation_pool_end Discovery range_start Discovery range_end Network Tag Information MTU Settings Network / VLANS Provisioning Public API External Tenants Private API Internal Tenants Tenant Tunneling Storage Network Storage Clustering SAH Tagged Not Connected Tagged Not Connected Open. Stack Controller Un. Tagged Tagged Not Connected Open. Stack Compute Un. Tagged Not Connected Tagged Not Connected Red Hat Ceph Storage Un. Tagged Not Connected Not Connected Tagged Network / VLANS Enable Global MTU Size Public API MTU External Tenants MTU Private API MTU Internal Tenants MTU Tenant Tunneling MTU Storage Network MTU Management/OOB Network VLAN i. DRAC Un. Tagged Not Connected Un. Tagged Storage Clustering MTU The 1 Gbe port for each node is only used for provisioning the node during installation. It can be disconnected after installation. MTU TRUE 1500 1500 MTU Global sections is either True or False. If false the individual network MTU sizes are used. Otherwise the "Global MTU size" is used. NIC Interface Bonding Settings Node Type SAH Public Bond 1 Private Bond Provisioner Anaconda Bond 0 -NIC 1 Bond 0 -NIC 2 Bond 1 -NIC 1 Bond 1 -NIC 2 Bond 0 em 3 em 4 em 1 p 2 p 1 em 2 p 2 p 2 mode=802. 3 ad miimon=100 xmit_hash_policy=layer 3+4 lacp_rate=1 Bonding Options Controller Bond 1 Bond 0 em 3 NA em 1 p 2 p 1 em 2 p 2 p 2 mode=802. 3 ad miimon=100 xmit_hash_policy=layer 3+4 lacp_rate=1 Compute Bond 1 Bond 0 em 3 NA em 1 p 2 p 1 em 2 p 2 p 2 mode=802. 3 ad miimon=100 xmit_hash_policy=layer 3+4 lacp_rate=1 Storage Bond 1 Bond 0 em 3 NA em 1 p 1 p 1 em 2 p 1 p 2 mode=802. 3 ad miimon=100 xmit_hash_policy=layer 3+4 lacp_rate=1 DPDK-Bond-Nic 5 NA NA DPDK-Bond-Nic 6 NA NA SR-IOV Bonding Settings Node Type SAH Controller Compute Storage SR-IOV-Bond-NIC 1 NA NA SR-IOV-Bond-NIC 2 NA NA Node Type SAH Controller Compute Storage DPDK-Bond-Nic 3 NA NA DPDK Bonding Settings DPDK-Bond-Nic 4 NA NA 17 © Copyright 2018 Dell Inc.
Takeaways • In order to provide complete solution – hardware and software need to be developed and integrated together • Minimize deployment and solution life-cycle risk by selecting good partners with know-how • Look for value-add features that enhance Open. Stack experience • Stay on open source, flexible, extensible, yet optimized solution(s) 18 © Copyright 2018 Dell Inc.
- Slides: 19