IBM Total Storage Virtualise for Tiered Storage Ken
IBM Total. Storage® Virtualise for Tiered Storage Ken Mc. Kenna © 2006 IBM Corporation
Tivoli Storage Management Software – Technical Conference Infrastructure Simplification Some terminology § Consolidation Leverage advances in storage density to consolidate many older devices into fewer – or one – newer device. § Virtualisation Separate the logical representation of a resource from its physical implementation – improving flexibility and simplifying management. 3 Information On Demand | Information Assets and Systems © 2006 2004 IBM Corporation
Tivoli Storage Management Software – Technical Conference Logical Steps To Implementing ILM – Compliance and Tiered Storage § Step 1: Planning and Assessment Identify, evaluate, predict trends Data categorization Establish policies Knowing your data § Step 2: Active Data Management Virtualise physical storage Pooling of storage by class of service Policy based file allocation and placement Policy based file migration Simplify and consolidate file systems Automation and Efficiency § Step 3: Inactive Data Management Business continuity Email, Database, File Archive Retention or destruction Long term retention for compliance 4 Information On Demand | Information Assets and Systems Long Term Disposition © 2006 2004 IBM Corporation
Tivoli Storage Management Software – Technical Conference What is the SAN Volume Controller (SVC)? § The SVC is a Block Storage Virtualisation product § The SVC is an Enterprise-class Storage Server § The SVC allows storage systems from different vendors to coexist in the same virtual ‘pool’ of storage § The SVC is NOT a RAID controller 5 Information On Demand | Information Assets and Systems © 2006 2004 IBM Corporation
Tivoli Storage Management Software – Technical Conference SVC - Terminology Virtual Disks: Max 4096 disks total (16 MB – 2 TB each) Each virtual disk assigned to: • Specific Node-pair • Specific Managed Disk Group I/O Group A I/O Group B Cluster: • Max 4 Node-pairs (8 Nodes total) SAN Volume Controllers nodes MDG 1 MDG 3 MDG 2 6 Information On Demand | Information Assets and Systems Managed Disks: • Select LUNs from up to 64 physical disk subsystems • Max 128 Managed Disk Groups • Max 128 LUNs per group © 2006 2004 IBM Corporation
Tivoli Storage Management Software – Technical Conference Hardware Infrastructure A hierarchy from high quality-of-service to low-cost Enterprise-class Disk Cost per MB Mid-range Disk with Fibre Channel Mid-range Disk with S-ATA Quality of Service 7 Information On Demand | Information Assets and Systems © 2006 2004 IBM Corporation
Tivoli Storage Management Software – Technical Conference Why Virtualisation? Lower TCO • Initial purchase price is significant SAN • With software and maintenance, 4 year TCO can easily double Hitachi Lightning 8 EMC DMX Hitachi EMC CLARii. ON Thunder Information On Demand | Information Assets and Systems © 2006 2004 IBM Corporation
Tivoli Storage Management Software – Technical Conference Why Virtualisation? Lower TCO However, multivendor disk environments come with problems… • Multi-path drivers • Management software • Copy service APIs 9 Driver Driver SAN Hitachi Lightning EMC DMX Shadow. Image True. Copy Hitachi Hi. Command EMC Control. Center Symmetrix Manager EMC Control. Center Navisphere Hitachi EMC CLARii. ON Thunder Time. Finder SRDF Information On Demand | Information Assets and Systems © 2006 2004 IBM Corporation
Tivoli Storage Management Software – Technical Conference Virtualise the Disks SAN 10 Information On Demand | Information Assets and Systems Traditionally, host systems were aware of physical changes in the storage infrastructure. © 2006 2004 IBM Corporation
Tivoli Storage Management Software – Technical Conference Virtualise the Disks SDD SDD Total. Storage Productivity Center SAN Volume Controller 11 Information On Demand | Information Assets and Systems Single set of copy services © 2006 2004 IBM Corporation
Tivoli Storage Management Software – Technical Conference Virtualise the Disks SDD SDD SAN Volume Controller 12 Information On Demand | Information Assets and Systems SDD Total. Storage Productivity Center Single set of copy services © 2006 2004 IBM Corporation
Tivoli Storage Management Software – Technical Conference SVC – Online Demo Virtual Disks: Max 4096 disks total (16 MB – 2 TB each) Each virtual disk assigned to: • Specific Node-pair • Specific Managed Disk Group I/O Group A I/O Group B Cluster: • Max 4 Node-pairs (8 Nodes total) SAN Volume Controllers nodes MDG 1 MDG 3 MDG 2 13 Information On Demand | Information Assets and Systems Managed Disks: • Select LUNs from up to 64 physical disk subsystems • Max 128 Managed Disk Groups • Max 128 LUNs per group © 2006 2004 IBM Corporation
Tivoli Storage Management Software – Technical Conference Improved Application Availability Traditional SAN 1. Stop the application 2. Move data 3. Re-establish host connections 4. Start application SAN 14 Information On Demand | Information Assets and Systems SAN Volume Controller 1. Move data § Host systems and applications are not affected. Virtual Disk SAN Volume Controller © 2006 2004 IBM Corporation
Tivoli Storage Management Software – Technical Conference Reduced Cost and Improved Flexibility for Copy Services Traditional SAN § Replication service API’s differ by vendor, making it difficult to integrate applications § Lower-cost disks offer primitive, or no replication services Flash. Copy Metro Mirror SAN HP IBM DS 8000 DS 6000 EVA 15 Business Copy Continuous Access HP EVA Information On Demand | Information Assets and Systems SAN Volume Controller § Common replication API, SANwide, that does not change as storage hardware changes § Replication targets can be on lower-cost disks, reducing the overall cost of exploiting replication services SAN SVC SAN Volume Controller IBM EMC IBM DS 8000 DS 4300 Sym FC HP EVA IBM DS 4100 S-ATA © 2006 2004 IBM Corporation
Tivoli Storage Management Software – Technical Conference Optimised Storage Resource Utilisation Traditional SAN § Shared physical network § Limited capacity sharing § Capacity purchased for, and owned by individual processors § Poor capacity utilisation 25% capacity SAN 50% capacity 55% capacity SAN Volume Controller 95% capacity 16 SAN Volume Controller § Hosts own “virtual” disks § Capacity can be more easily reallocated § Capacity purchases can be deferred until the physical capacity of the SAN reaches a trigger point. Information On Demand | Information Assets and Systems © 2006 2004 IBM Corporation
Tivoli Storage Management Software – Technical Conference Total. Storage SAN Volume Controller Copy Services SAN Volume Controller DMX DS 4300 FC DS 6000 DS 4100 S-ATA SAN Data Migration “outside the box” 17 Information On Demand | Information Assets and Systems © 2006 2004 IBM Corporation
Tivoli Storage Management Software – Technical Conference Total. Storage SAN Volume Controller Copy Services SAN Volume Controller DS 8000 Clariion DS 4100 S-ATA SAN Metro Mirror SAN Flash. Copy “outside the box” 18 Information On Demand | Information Assets and Systems © 2006 2004 IBM Corporation
Tivoli Storage Management Software – Technical Conference Total. Storage SAN Volume Controller Copy Services SAN Volume Controller Symmetrix DS 6000 9900 DS 4100 S-ATA Cross-device consistency groups 19 Information On Demand | Information Assets and Systems © 2006 2004 IBM Corporation
Tivoli Storage Management Software – Technical Conference Performance – node pair § IOPs Read (cache hit) 140, 000 IO/s per node pair Read (cache miss) 50, 000 Write 20, 000 § Bandwidth Read (cache hit) 1. 5 GB/s Read (cache miss) 1. 0 GB/s Write 400 MB/s § Scales linearly with number of node pairs 20 Information On Demand | Information Assets and Systems © 2006 2004 IBM Corporation
Tivoli Storage Management Software – Technical Conference SAN Volume Controller SPC-1 Benchmark www. storageperformance. org §SVC delivers record-breaking results in industry-recognized storage performance test § Treble the next closest virtualisation submission §Comparisons: Data. Core 50 K; HP EVA 24 K; Sun 6920 49 K § Workloads representative of real-life applications § SVC is one of only five products to achieve > 100, 000 IOPS in the SPC-1 benchmark § Others: IBM DS 8300; Texas Memory Ram. SAN; Fujitsu Eternus; 3 PAR In. Serv S 800 § EMC and Hitachi have chosen to not participate in objective performance measurements 21 Information On Demand | Information Assets and Systems © 2006 2004 IBM Corporation
Tivoli Storage Management Software – Technical Conference Three Architectures for Block Virtualisation In-band Appliance • Caching enhances performance • Consolidates Copy Services Array Based • No additional HW req’d • Array-based Copy Svcs Host Zone Storage Zone SAN Volume Controller 22 HDS Tagma. Store Information On Demand | Information Assets and Systems Intelligent Switch • Scales to very large networks • Array- or Switch-based Copy Services Storag e Zone EMC in 2005/6 © 2006 2004 IBM Corporation
Tivoli Storage Management Software – Technical Conference Architectural Differences – General Observations § Customers don’t buy based on theoretical differences, they buy proven implementations that solve their problems § Advantages of SVC implementation of cached appliance Modular design – flexible for customers, not tied to monolithic arrays or Director-switches SAN agnostic – interoperates with existing SAN fabric Horizontal scaling – low entry cost yet grows to large Data Centres Proven HW platform – Failover based on proven storage controller designs Cache for network-based copy services and to balance across disparate storage § Theoretical concerns overcome by SVC implementation Performance Optimised SW Stack means additional latency in the worst case of 60 microseconds - ~0. 5% degradation Efficient cache algorithms means improved performance for many customers 155, 000 SPC-1 Benchmark far exceeding virtualisation alternative or traditional arrays Scalability Horizontal scaling while maintaining a common storage pool – unique in the industry Linear scaling in IO/s and bandwidth submitted with SPC-1 Benchmark 100 X scaling proven with customers from a few Tera. Bytes to hundreds § The proof is in the customer experiences of 1700+ customers and 50+ Customer Testimonials 23 Information On Demand | Information Assets and Systems © 2006 2004 IBM Corporation
Tivoli Storage Management Software – Technical Conference Total. Storage SAN Volume Controller Supported Environments (SVC v 3. 1) Novell VMWare Microsoft MSCS Net. Ware Win / NW Clustering guests IBM AIX Intended as an overview only. For the most complete information, visit ibm. com/storage/so Linux IBM HP/UX (Intel/Power/z. OS) RHEL/SUSE Blade. Center HACMP/XDVCS Clustering. Service. Guard MPIO, VSS, GDSGPFS / VIO Sun Solaris SUN Cluster 1024 Hosts Clustering W / LVMWin/Linux/VMWare/AIX OPM/FCS/IBS Cisco Mc. Data . . . i. SCSI to hosts Via Cisco IPS SAN Point-in-time Copy Continuous Copy Full volume Copy on write Synchronous Asynchronous (Kashya and other 3 rd party solutions) SAN Volume Controller IBM ESS F 20 750 800 24 IBM STK Hitachi HP HP DS Flexline Lightning Thunder EVA MA/EMA 9200 8000 3000 Family D-Series 9980 V 9970 V 95 xx. V 12000 5000 9910/9960 9520 V 16000 Information On Demand | Information Assets and Systems 4 K / 6 K / 8 K HP XP 48 / 128 512 1024 Array-based copy services EMC/Dell Sun Symm CLARii. ON 8000 FC 4700 9910/9960 DMX CX 2/3/4/5/6/700 9970/9980 © 2006 2004 IBM Corporation
Tivoli Storage Management Software – Technical Conference SAN Volume Controller Storage Software Roadmap Futures V 4. 1 1 Q 04 NAS 500 G S-ATA EXP-100 Veritas DMP support DWDM FC Extenders SVC 4 MDS w/FC-IP 3 Q 03 SVC appliance SIS SAN-in-a-Can V 1. 1 EMC Clariion/Symm HDS 9500 V/9900 V HP MA/EMA (full spt) 4 Q 03 Increase #hosts Data Migration, Flash. Copy, W 2 K 3 w/clustering Metro Mirror, ICAT, SMI-S VMWare, Solaris 9, UNIX, Windows w/ MSCS, Red. Hat 3. 0 LINUX, AIX with HACMP, Blade. Center OPM HP MA/EMA (single path) Heterogeneous storage: ESS, HDS, HP, EMC 25 2 Q 06 V 2. 1 4 Q 05 V 1. 2. 1 V 1. 2 2 Q 04 SVC for MDS 9000 Blade V 3. 1 1 Q 05 4 Q 04 8 node scalability #vdisks scalability HP EVA, 9960/9910 DS 6000 / DS 8000 SUSE SLES 8 EMC DMX Enable Array Copy Srvs Scalability: 1 K Hosts Hardware upgrade x 336, 8 GB cache Cust Ease of Use Enh Interop Enhancements: storage, hosts #Hosts Scalability Solaris & HP-UX clustering HP-UX lift 8 LUN limit Netware 6. 5 w/clustering New FASt. T, New LCRB W 2 K 3 -MPIO, VSS, GDS Image Mode Data Migration SW-Master Console option Adv Copy Services Global Mirror Hardware upgrade: 4 Gb/s HBA, Ro. HS Customer Install HW/SW Interop Enhancemts: storage, hosts Adv Copy Services SEFC Multiple FC Tgts Overallocation Incremental FC 2 X Scaling: nodes, hosts Interoperability Enh Embedded CIMOM ESS/DS Copy Srvs & Interop Converg UPS smaller package (2 x 1 U) Note: States IBM's future product plans and general intentions only. It is subject to change or cancellation without notice and should not be relied on for any purpose. Information On Demand | Information Assets and Systems © 2006 2004 IBM Corporation
Tivoli Storage Management Software – Technical Conference A Tiered Storage Infrastructure Multi-vendor storage environment SDD SDD SAN Volume Controller Hitachi IBM EMC HP Lightning DS 8000 DMX EVA 26 Total. Storage Productivity Center Single set of copy services Hitachi IBM EMC DS 4000 DS 6000 CLARii. ON Thunder Information On Demand | Information Assets and Systems © 2006 2004 IBM Corporation
Backup © 2006 IBM Corporation
Tivoli Storage Management Software – Technical Conference SAN Volume Controller - optimised software stack 28 Information On Demand | Information Assets and Systems © 2006 2004 IBM Corporation
Tivoli Storage Management Software – Technical Conference SVC Performance Scaling : 8 node cluster Workload 8 -Way x-335 SVC cluster 8 -Way x-336 SVC Cluster* IOP/s MB/s Read Hit 560, 000 6, 000 1, 000 10, 800 Read Miss 200, 000 4, 000 340, 000 8, 000 Write cache hit 160, 000 2, 400 240, 000 - 80, 000 1, 600 100, 000 2, 500 70/30 R/W 140, 000 2, 800 168, 000 4, 400 50/50 R/W 112, 000 2, 200 144, 000 - 70/30/50 180, 000 3, 200 280, 000 - Write cache miss * Targets, based on extrapolation of measured latency and utilisation on x 335. 29 Information On Demand | Information Assets and Systems © 2006 2004 IBM Corporation
- Slides: 28