VMware Virtual SAN Hyperconverged infrastructure software Simon Todd

  • Slides: 39
Download presentation
VMware Virtual SAN Hyper-converged infrastructure software Simon Todd (@Mr. Virtual. SAN) EMEA SE Specialist

VMware Virtual SAN Hyper-converged infrastructure software Simon Todd (@Mr. Virtual. SAN) EMEA SE Specialist - VSAN mrvsan@vmware. com

Agenda 1 Introduction 2 Virtual SAN, what is it? 3 Virtual SAN, a bit

Agenda 1 Introduction 2 Virtual SAN, what is it? 3 Virtual SAN, a bit of a deeper dive 4 Virtual SAN Recent Enhancements 5 Wrapping up 2

The Software Defined Data Center • All infrastructure services virtualized: compute, networking, storage Management

The Software Defined Data Center • All infrastructure services virtualized: compute, networking, storage Management • Underlying hardware abstracted, resources are pooled • Control of data center automated by software (management, security) Compute Networking Storage • Virtual Machines are first class citizens of the SDDC • Today’s session will focus on one aspect of the SDDC - storage 3

Hardware evolution started the storage revolution

Hardware evolution started the storage revolution

What is our goal with Virtual SAN? $ SIMPLICITY PERFORMANCE AND SCALABILITY COST CHOICE

What is our goal with Virtual SAN? $ SIMPLICITY PERFORMANCE AND SCALABILITY COST CHOICE AGILITY 3

Sky is a Cross European company providing satellite broadcasting, on demand internet streaming media

Sky is a Cross European company providing satellite broadcasting, on demand internet streaming media and broadband / telephone services. It is Europe’s biggest and leading media company and largest pay-TV broadcaster, with over 21 million customers and over 30, 000 employees Business Driver: Innovation to maintain competitiveness for Sky service offerings CONFIDENTIAL 6

Business Driver: Innovation to maintain competitiveness for Sky service offerings $ Ability to spin

Business Driver: Innovation to maintain competitiveness for Sky service offerings $ Ability to spin up environments for our developers within minutes rather than hours, days or even weeks Time to market is now a much lower cost exercise and brings forward revenue realization and improved profitability Our platform now delivers on performance and scalability and as a “Grow as you go” means we can increase as and when we need to 7

A water utilities company in the UK which manages the regulated water and waste

A water utilities company in the UK which manages the regulated water and waste water in an area of England has over 5000 direct employees, it has a customer base of over 7 million customers Business Driver: IT could not respond to the speed of the business and new projects stalled due to high cost of incremental investment Business Risks: Heavy Government fines and reputation 8

Business Driver: IT could not respond to the speed of the business and new

Business Driver: IT could not respond to the speed of the business and new projects stalled due to high cost of incremental investment $ Our procurement cycle on existing infrastructure was between 13 and 26 weeks, with Virtual SAN our procurement cycle has reduced to just 7 days Spinning up of a new environment now takes at most 2 hours versus 7 days previously Compared to our previous storage, our Virtual Machine storage cost reduced significantly between 66% and 74% making IT more cost effective to the business 90% reduction in procurement time 98. 5% reduction in deployment time 86% Reduction in billing cycle processing Our billing cycle for over 7 million customers used to take 22 hours prior to it being virtualised, when we virtualised it we got that down to 16 hours. When we moved the same billing cycle onto Virtual SAN it now completes in just 3 hours 9

Most Broadly Deployed HCI Solution in the Market Over 3500 customers within 24 months

Most Broadly Deployed HCI Solution in the Market Over 3500 customers within 24 months and growing rapidly

Virtual SAN, what is it? 11

Virtual SAN, what is it? 11

Virtual SAN, what is it? Hyper-Converged Infrastructure Software-Defined Storage Distributed, Scale-out Architecture v. Sphere

Virtual SAN, what is it? Hyper-Converged Infrastructure Software-Defined Storage Distributed, Scale-out Architecture v. Sphere & Virtual SAN Integrated with v. Sphere platform Ready for today’s v. Sphere use cases 12

But what does that really mean? Exposing a single shared datastore Virtual SAN Leveraging

But what does that really mean? Exposing a single shared datastore Virtual SAN Leveraging local storage resources VMware v. Sphere & Virtual SAN Integrated with your Hypervisor Generic x 86 hardware VSAN network 13

Virtual SAN Use Cases Business Critical Apps End User Computing DR / DA Test/Dev

Virtual SAN Use Cases Business Critical Apps End User Computing DR / DA Test/Dev DMZ Management Staging ROBO VMware v. Sphere + Virtual SAN 14

Broadest Deployment Options from HCI to SDDC Built on Industry-Leading VMware Hyper-Converged Software (HCS)

Broadest Deployment Options from HCI to SDDC Built on Industry-Leading VMware Hyper-Converged Software (HCS) EVO SDDC v. Realize Certified Solutions Engineered Appliances NSX VMware HCS Virtual SAN + v. Sphere + v. Center Lifecycle Management EVO SDDC Manager Virtual SAN Ready Nodes EMC Federation HCI Appliance Certified Partner Hardware 15

Tiered Hybrid vs All-Flash Hybrid SSD PCIe Ultra DIMM Caching SSD PCIe Ultra DIMM

Tiered Hybrid vs All-Flash Hybrid SSD PCIe Ultra DIMM Caching SSD PCIe Ultra DIMM Writes cached first, Reads from capacity tier Read and Write Cache Data Persistence Virtual SAN Capacity Tier SAS / NL-SAS / SATA 40 K IOPS per Host Capacity Tier Flash Devices Reads go directly to capacity tier 100 K IOPS per Host + sub-millisecond latency 16

Really Simple Setup Deduplication and Compression Enable? Manual or Automatic Disk Claiming Fault Domains,

Really Simple Setup Deduplication and Compression Enable? Manual or Automatic Disk Claiming Fault Domains, 2 node or stretched cluster? 17

Virtual SAN, a bit of a deeper dive 18

Virtual SAN, a bit of a deeper dive 18

Virtual Machine as a set of Objects on VSAN VM Home VM Swap VMDK

Virtual Machine as a set of Objects on VSAN VM Home VM Swap VMDK Snap delta Snap memory • VM Home Namespace • VM Swap Object • Virtual Disk (VMDK) Object • Snapshot (delta) Object • Snapshot (delta) Memory Object Snapshot 19

Define a policy first… Virtual SAN currently surfaces multiple storage capabilities to v. Center

Define a policy first… Virtual SAN currently surfaces multiple storage capabilities to v. Center Server What If APIs New Capabilities in VSAN 6. 2 20

VMDK Object Virtual SAN Objects and Components RAID-1 VSAN is an object store! •

VMDK Object Virtual SAN Objects and Components RAID-1 VSAN is an object store! • Object Tree with Branches • Each Object has multiple Components – This allows you to meet availability and performance requirements • Here is one example of “Distributed RAID” using RAID-0 stripe-1 a stripe-2 a stripe-1 b stripe-2 b Mirror Copy ESXi Host 2 techniques: – Striping (RAID-0) – Mirroring (RAID-1) • Data is distributed based on VM Storage Policy witness ESXi Host 21

Number of Failures to Tolerate/Failure Tolerance Method • Defines the number of hosts, disk

Number of Failures to Tolerate/Failure Tolerance Method • Defines the number of hosts, disk or network failures a storage object can tolerate. • RAID-1 Mirroring used when Failure Tolerance Method set to Performance (default). • For “n” failures tolerated, “n+1” copies of the object are created and “ 2 n+1” host contributing storage are required! esxi-01 esxi-02 esxi-03 ~50% of I/O vmdk esxi-04 RAID-1 witness Virtual SAN Policy: “Number of failures to tolerate = 1” 22

Assign it to a new or existing VM When the policy is selected, Virtual

Assign it to a new or existing VM When the policy is selected, Virtual SAN uses it to place / distribute the VM to guarantee availability and Performance 23

Fault Domains, increasing availability through rack awareness • Create fault domains to increase availability

Fault Domains, increasing availability through rack awareness • Create fault domains to increase availability • 8 node cluster with 4 defined fault domains (2 nodes in each) FD 1 = esxi-01, esxi-02 FD 3 = esxi-05, esxi-06 FD 2 = esxi-03, esxi-04 FD 4 = esxi-7, esxi-08 • To protect against one rack failure only 2 replicas are required and a witness across 3 failure domains! FD 2 FD 3 esxi-01 esxi-03 esxi-05 esxi-07 esxi-02 esxi-04 esxi-06 esxi-08 vmdk witness FD 1 FD 4 RAID-1 24 24

Virtual SAN, Recent Enhancements 25

Virtual SAN, Recent Enhancements 25

Deduplication and Compression RAID 5/6 support Software Checksum Qo. S via IOPS Limits IPv

Deduplication and Compression RAID 5/6 support Software Checksum Qo. S via IOPS Limits IPv 6 Performance Service Enhanced Capacity Views VSAN 6. 2 March 2016 VSAN 6. 1 September 2015 VSAN 6. 0 March 2015 Stretched Cluster Replication - 5 Minutes RPO 2 -node ROBO Health Monitoring & Remediation All Flash Configuration 64 node VSAN cluster x 2 Hybrid Performance VSAN Snapshots/Clones Health UI Rack Awareness VSAN 5. 5 March 2014 26

Today Virtual SAN – Stretched Cluster Active-Active data centers Site Recovery Manager v. Sphere

Today Virtual SAN – Stretched Cluster Active-Active data centers Site Recovery Manager v. Sphere & Virtual SAN witness v. Sphere witness s n ta y An di ce >5 m in O RP • Virtual SAN cluster split across 2 sites! • Each site is a Fault Domain (FD) • Site-level protection with zero data loss and near-instantaneous recovery • Support for up to 5 ms RTT latency between data sites – 10 Gbps bandwidth expectation • Witness VM can reside anywhere – 200 ms RTT latency – 100 Mbps bandwidth required at most VMware v. Sphere & Virtual SAN vmdk • Automated failover 5 ms RTT, 10 Gb. E 27

Advanced Troubleshooting with VSAN Health Check CONFIDENTIAL 28

Advanced Troubleshooting with VSAN Health Check CONFIDENTIAL 28

Virtual SAN 6. 2 specifics 29

Virtual SAN 6. 2 specifics 29

in w Ne 6. 2 All Flash Only Beta Deduplication and Compression for Space

in w Ne 6. 2 All Flash Only Beta Deduplication and Compression for Space Efficiency • Nearline deduplication and compression per disk group level. – Enabled on a cluster level – Deduplicated when de-staging from cache tier to capacity tier – Fixed block length deduplication (4 KB Blocks) esxi-01 esxi-02 esxi-03 • Compression after deduplication – If block is compressed <= 2 KB – Otherwise full 4 KB block is stored v. Sphere & Virtual SAN Significant space savings achievable, making the economics of an all-flash VSAN very attractive vmdk 30

All Flash Only in w Ne 6. 2 RAID-5/6 (Inline Erasure Coding) • When

All Flash Only in w Ne 6. 2 RAID-5/6 (Inline Erasure Coding) • When Number of Failures to Tolerate = 1 and Failure Tolerance Method = Capacity RAID-5 – 3+1 (4 host minimum) – 1. 33 x overhead for RAID-5 instead of 2 x compared to FTT=1 with RAID-1 • When Number of Failures to Tolerate = 2 and Failure Tolerance Method = Capacity RAID-6 – 4+2 (6 host minimum) – 1. 5 x overhead for RAID-6 instead of 3 x compared to FTT=2 with RAID-1 RAID-5 parity data data parity data parity ESXi Host 31

in w Ne 6. 2 Software Checksum and disk scrubbing Overview • End-to-end checksum

in w Ne 6. 2 Software Checksum and disk scrubbing Overview • End-to-end checksum of the data to detect and resolve silent disk errors due to faulty hardware/firmware • Checksum is enabled by default (policy driven) • If checksum verification fails on a read: – VSAN fetches the data from another copy in RAID-1 – VSAN recreates the data from other components in RAID-5/6 stripe Virtual SAN Datastore • Disk scrubbing is run in the background Benefits • Provide additional level of data integrity • Automatic detection and resolution of silent disk errors 32

in w Ne 6. 2 Other new improvements Client Cache • Write through read

in w Ne 6. 2 Other new improvements Client Cache • Write through read memory cache – 0. 4% of total host memory, up to 1 GB per host • “Local” to the virtual Machine • Low overhead, big impact! Sparse Swap • Reclaim Space used by memory swap • Host advanced option enables setting policy for swap to no space reservation IOPS limit on object • Policy driven capability • Limit IOPS per VM/Virtual Disk • Eliminate noisy neighbor issues • Manage performance SLAs 33

in w Ne 6. 2 Enhanced Virtual SAN Management with New Health Service Performance

in w Ne 6. 2 Enhanced Virtual SAN Management with New Health Service Performance Monitoring Capacity Monitoring Built-in performance monitoring Health and performance APIs and SDK Storage capacity reporting And many more health checks… 34

in w Ne 6. 2 Performance, Scale and Availability for Any Application BUSINESS-CRITICAL APPLICATIONS

in w Ne 6. 2 Performance, Scale and Availability for Any Application BUSINESS-CRITICAL APPLICATIONS SAP Horizon Oracle SAP Core Ready Tightly integrated cloud management Oracle RAC supported Testing and validated deployments Bundles Virtual SAN licenses for lowest cost VDI storage Testing and validated deployments 35

Wrapping up 36

Wrapping up 36

37

37

on si Vi VMware Virtual SAN: Generic Object Storage Platform VMFS File Block Rest

on si Vi VMware Virtual SAN: Generic Object Storage Platform VMFS File Block Rest Virtual SAN VMware v. Sphere 38