HP App System for SQL Server PDW Steve






























- Slides: 30
HP App. System for SQL Server PDW Steve Tramack Sr. Engineering Manager HP/Microsoft I 2 A Solutions April 2013 © Copyright 2013 Hewlett-Packard Development Company, L. P. The information herein is subject to change without notice. HP Restricted.
The world of Data has changed 10 x 4. 3 increase every five years connected devices per adult 85% from new data types 2 Data explosion Consumerization of IT © Copyright 2013 Hewlett-Packard Development Company, L. P. The information contained herein is subject to change without notice. HP Confidential. 27% using social media input
But current “big data” options are limiting Keep legacy investment Limited scalability 3 Buy new tier one hardware appliance Acquire “Big Data” solution High costs Significant training © Copyright 2013 Hewlett-Packard Development Company, L. P. The information contained herein is subject to change without notice. HP Confidential. Acquire Business Intelligence Solution complexity
Introducing SQL Server 2012 Parallel Data Warehouse Insights on any data of any size Built For Big Data 4 Next-generation Performance At Scale © Copyright 2013 Hewlett-Packard Development Company, L. P. The information contained herein is subject to change without notice. HP Confidential. Engineered For Optimal Value
Introducing Poly. Base Fundamental breakthrough in data processing Single Query; Structured and Unstructured SQL Server 2012 PDW Powered by Poly. Base Database 5 HDFS (Hadoop) • Query and join Hadoop tables with Relational Tables • Use Standard S SQL language • Select, From Where Existing SQL Skillset No IT Intervention © Copyright 2013 Hewlett-Packard Development Company, L. P. The information contained herein is subject to change without notice. HP Confidential. Save Time and Costs Analyze All Data Types
Existing Excel skillset with big data Familiar tools to analyze structured/unstructured data Familiar Tools Analyze Big Data • Native Microsoft BI Integration to PDW • Structured and unstructured data in same spread sheet • Widely adopted and familiar user tools Hadoop Data Structured Data 6 High Adoption Of Excel No IT Intervention © Copyright 2013 Hewlett-Packard Development Company, L. P. The information contained herein is subject to change without notice. HP Confidential. Analyze All Data Types
Xvelocity gives next-gen performance Lighting fast data query processing Country Supplier Sales Products Customer Columnstore Provides Dramatic Performance Updateableand andclusteredx. Velocitycolumnstore • • Updateable • Stores data in columnar format Memory-optimized for next-generation performance • • Stores data in columnar format • Updateable to support bulk and/or trickle loading • Memory-optimized for next-generation performance • Updateable to support bulk and/or trickle loading Upto to Up 50 XFaster 50 X 7 Upto to 15 x Up compression © Copyright 2013 Hewlett-Packard Development Company, L. P. The information contained herein is subject to change without notice. HP Confidential. Save Time and Costs Real-Time DW
Seamlessly Add Capacity Start Small With A Few TB and Linearly Scale OUT Smallest (0 TB) To Largest (6 PB) Add Capacity • Start small with a few Terabyte warehouse • Add capacity up to 6 Petabytes Add Capacity Start Small And Grow 75 TB 8 6 PB © Copyright 2013 Hewlett-Packard Development Company, L. P. The information contained herein is subject to change without notice. HP Confidential. Largest Warehouse PB No Downtime
Hardware and Software engineered together The ease of an Appliance Pre-Built Hardware + Software Appliance • Co-engineered with HP • Pre-built and configured hardware • Pre-installed software “Plug and Play” 9 Built-in Best Practices © Copyright 2013 Hewlett-Packard Development Company, L. P. The information contained herein is subject to change without notice. HP Confidential. Save Time
HP App. System for PDW v 2 © Copyright 2013 Hewlett-Packard Development Company, L. P. The information contained herein is subject to change without notice. HP Restricted.
Deep integration for rapid time to value HP App. System for Parallel Data Warehouse Onsite deployment services Microsoft Windows® 2012 and Microsoft SQL Server 2012 Parallel Data Warehouse software* Hadoop integration HP management tools and utilities HP Converged Infrastructure: servers, storage and networking Collaborative support services from HP and Microsoft** HP and partner assessment, design, and planning services 11 © Copyright 2013 Hewlett-Packard Development Company, L. P. The information contained herein is subject to change without notice. HP Confidential. * Priced separately ** HP Proactive Care. Microsoft support priced and purchased separately
Highly scalable HP App. System for Parallel Data Warehouse components FDR Infini. Band 2 x HP 5120 EI switches • Infini. Band (data network) and Ethernet (management network) connectivity Passive Server Block • Passive Server Block (2) • Optional passive server (3) • Virtualized control and management node; failover node for HA Base Scale Unit 12 © Copyright 2013 Hewlett-Packard Development Company, L. P. The information contained herein is subject to change without notice. HP Confidential. Active Server Block (2) and Storage Block (1)
HP App. System for PDW v 2 64 total node (active + passive) limitation (Windows 2012 clustering) 13 © Copyright 2013 Hewlett-Packard Development Company, L. P. The information contained herein is subject to change without notice. HP Confidential.
HP App. System for PDW – normal mode Passive server (#1) Control and management functionality Dual Infini. Band Private Ethernet network Passive server (#2) Compute nodes access their local D 6000 in their respective scale unit D 6000 Compute nodes SAS Node 1 Node 2 Base scale unit 14 © Copyright 2013 Hewlett-Packard Development Company, L. P. The information contained herein is subject to change without notice. HP Confidential. Storage 1 Storage 2
HP App. System for PDW – HA, Failover Control and management functionality Passive server (#1) Compute node takes over (SQL Server) • SQL Server runs in new compute node • Data is accessed via Infini. Band RDMA access Dual Infini. Band Private Ethernet network Passive server (#2) • Minimal performance impact on remote server • Most CPU utilization is in the new compute node D 6000 Compute nodes SAS Node 1 Node 2 Base scale unit 15 © Copyright 2013 Hewlett-Packard Development Company, L. P. The information contained herein is subject to change without notice. HP Confidential. Storage 1 Storage 2
HP Support Pack Utility Suite HP App. System for PDW exclusive! Updated for HP App. System for PDW v 2 Unique HP tools ensure that HP App. System for PDW runs at optimal performance and delivers expected return on investment (ROI) Up to 2, 000 device drivers and firmware locations updated with a single click Reports all serial numbers and rack locations of all devices; hard disk data and qualified component versions Manage device password updates from a single script 16 Validates the running of known-good, consistentlyimplemented, tested recipe of drivers and firmware Quickly identifies hardware issues from shipment or component failure © Copyright 2013 Hewlett-Packard Development Company, L. P. The information contained herein is subject to change without notice. HP Confidential.
HP Proactive Care for HP App. System for PDW Complete proactive and reactive support reduces risk 17 Advisory support • Semi-annual firmware, patch, and software update recommendations • Semi-annual proactive scan and recommendation • Quarterly incident and trend reporting Hardware and software support • Direct connection to level two expertise • Documented, jointly agreed HP/Microsoft collaborative support processes • Single point of contact for end-to-end case ownership and call management • Enhanced response time and choice of HW on-site support levels Insight remote support • Secure 24 x 7 monitoring, diagnostics, and notifications • Required (installation assistance provided) © Copyright 2013 Hewlett-Packard Development Company, L. P. The information contained herein is subject to change without notice. HP Confidential.
HP App. System for PDW Assessment, deployment, and start services Assessment • Existing process review • Optimize for EDW: ETL and reporting • Integration needs assessment • Two-week duration Onsite deployment services* • System set-up • Installation • Delivery project management Start service • ETL readiness and test • Reporting, migration, and testing • Performance tune and test • Data center integration • Operations review • Two-week duration Full lifecycle of Data Warehouse/business intelligence consulting *Included in App. System price 18 © Copyright 2013 Hewlett-Packard Development Company, L. P. The information contained herein is subject to change without notice. HP Confidential.
HP and Microsoft Information and Data Management Solutions Portfolio HP App. System for Microsoft SQL Server 2012 Parallel Data Warehouse A complete, all-in-one data warehouse appliance for mission-critical environments. HP SQL Server 2012 Fast Track Data Warehouse Reference Architectures (RA’s) Full portfolio of high performing, end-to-end solutions designed for efficient, predictable deployment and optimized for near real-time data delivery. HP Universal Database Solution for Mission-Critical x 86 RA – Microsoft SQL Server 2012 HP Database Consolidation RA Built for data management applications that require high levels IO / second support. Designed to deliver cost savings and efficiency through database and application virtualization. HP and Partner Services for Data Management Solutions Built on HP Converged Infrastructure 19 © Copyright 2013 Hewlett-Packard Development Company, L. P. The information contained herein is subject to change without notice. HP Confidential.
HP Differentiation Leveraging HP Data Center Expertise through Converged Infrastructure Mission Critical Support : • Truly integrated support beyond standard break/fix • HP-unique 7 x 24 “phone home” capabilities included in standard support offering Data Integration Platform • Only HP offers a combination Landing Zone / Backup / Remote Support scale unit designed for PDW More Scalability Options • HP PDW scales in increments of 2 servers • Allows for ¼, ½, ¾, full and (with AU 1) “Texas Edition” (10+3) configurations • HP starts smaller and grows larger within a rack than competition Support Pack Utility Suite: • HP Exlusive offering that reduces customer’s operational costs and eases maintenance, with tools such as the one-button update which can update 2, 000 components with a single click Factory-Installed and Integrated for Rapid Time –to-Business-Value: • HP’s App. System PDW is a true mission critical appliance, fully configured at the factory, with extensive HP developed installation documentation 20 © Copyright 2013 Hewlett-Packard Development Company, L. P. The information contained herein is subject to change without notice. HP Confidential.
HP App. System for PDW v 2 Summary Max TB/ft 2 • 2. 5 x more TB (vs. v 1) • 70 -210 TB in ¼ rack • 6 PB max 21 $ / Performance • 35% less $ (vs. v 1) • Sub-$300 k ¼ rack • +10 -30% scan rate © Copyright 2013 Hewlett-Packard Development Company, L. P. The information contained herein is subject to change without notice. HP Confidential. SW + Management • 10 -100 x faster (x. Velocity) • 5 x better compression • Enhanced HP-only Utilities
Key Questions What do you see as being the most compelling aspects of an Appliance solution (versus a reference architecture)? If HP had $100 dollars to spend on App. System for PDW Development, how much would you spend on: • • 22 Additional hardware architectures Manageability advancements BI infrastructure Industry-specific data models Additional Support and Maintenance automation Performance and Scalability optimization Workload management (and other traditional DW capabilities) Other aspects © Copyright 2013 Hewlett-Packard Development Company, L. P. The information contained herein is subject to change without notice. HP Confidential.
Backup © Copyright 2013 Hewlett-Packard Development Company, L. P. The information contained herein is subject to change without notice. HP Restricted.
HP Enterprise Data Warehouse (EDW) V 1. 4 - Recap Data rack 2 x FDR Infiniband Compute Nodes (10 active DL 360, 1 passive DL 360) Control rack 2 x FDR Infiniband Backup storage (2 x MSA P 2000 each w/ 3 storage shelves) 2 x Storage. Works 8/40 SAN switches 2 x Pro. Curve 2810/48 G switches Compute Node Storage (10 x MSA P 2000) Backup server (DL 380) 2 x Storage. Works 8/8 SAN switches 2 x Pro. Curve 2810/24 G switches Control Nodes (2 x DL 380) Control Node Storage (MSA P 2000) Management nodes (2 x DL 360) Landing Zone (DL 380) 24 © Copyright 2013 Hewlett-Packard Development Company, L. P. The information contained herein is subject to change without notice. HP Confidential.
Agenda SQL Server PDW 2012 Software Overview HP App. System for PDW v 2 Overview • • • Comparison of EDW v 1 and PDW v 2 Key component drill down Scalability / capacity options HA functionality V 1 V 2 upgrade Support Pack Overview Bundled Services HP Differentiation Summary 25 © Copyright 2013 Hewlett-Packard Development Company, L. P. The information contained herein is subject to change without notice. HP Confidential.
HP App. System for PDW v 2 Control rack HP App. System for PDW V 2 eliminates Landing Zone and Backup nodes as part of the appliance (offered as part of HP “Landing Zone and Backup Platform” RA / SKU option) 26 © Copyright 2013 Hewlett-Packard Development Company, L. P. The information contained herein is subject to change without notice. HP Confidential.
Landing Zone and Backup platform Provides key appliance functionality Landing Zone / ETL Functions • • PDW supports SSIS and bulk file loads through INSERT statements and dwloader program (PDW-specific) Parallel loading supported, but all pass through single control node VM Dedicated Appliance Backup Target • • • Provides file share for PDW Backup and Restore • Full and differential backups (no incremental) Appliance backup through TSQL command, similar to standard SQL Server (CLI or GUI; can be scheduled) Supports multiple backup devices, but single backup or restore operation at any time. IO goes straight from all compute nodes to the backup location Insight Remote Support Server Host • • • 27 24 x 7 monitoring “Phone home” support Part of Proactive Care, bundled with appliance © Copyright 2013 Hewlett-Packard Development Company, L. P. The information contained herein is subject to change without notice. HP Confidential.
HP App. System for PDW v 2 Base Scale unit 2+2, or “Quarter rack” Data rack Control rack FDR Infiniband Ethernet switches Passive server (#1) Passive server (#2) Co te pu m no s de te ln od ef un c tio na lit en e y ity al ion ct un ef od tn rag m sto ge no de ro na pu nt Ma Co m Co 28 V 1 V 2 © Copyright 2013 Hewlett-Packard Development Company, L. P. The information contained herein is subject to change without notice. HP Confidential. V 1
HP App. System for PDW v 2 8+2, or “Full rack” Data rack Control rack FDR Infiniband Ethernet switches Passive server (#1) Passive server (#2) Co Active Scale Unit ro ln od ef Ma un c tio na ge na Active Scale Unit lit y od tn en m Active Scale Unit ity al ion ct un ef 8 Compute node functionality nt Base Scale Unit 29 V 1 V 2 © Copyright 2013 Hewlett-Packard Development Company, L. P. The information contained herein is subject to change without notice. HP Confidential. V 1
Resources Hewlett Packard Microsoft Joint HP-Microsoft HP Enterprise Data Warehouse Appliance www. hp. com/solutions/microsoft /edw HP Active. Answers www. hp. com/solutions/activeans wers Microsoft Parallel Data Warehouse http: //www. microsoft. com/pdw SQL Server Developer Center http: //www. sqlserverlaunch. com/ ww/Home SQL Server Team Blog http: //blogs. technet. com/b/datap latforminsider SQL Server Product News http: //www. microsoft. com/sqlser ver/en/us/news-reports. aspx HP/Microsoft Joint Sales Portal www. winthedatacenter. com 30 HP & Microsoft Frontline Partnership Portal www. hp-microsoft. com © Copyright 2013 Hewlett-Packard Development Company, L. P. The information contained herein is subject to change without notice. HP Confidential.