HPE Storm Runner Load Cloud Agile Load Testing

HPE Storm. Runner Load Cloud Agile Load Testing Vivit : Mid Atlantic User Group Presenter: Robert Linton Cor. Techs, Inc. VP ALM Date: April 27 th, 2016 © Copyright 2014 Hewlett-Packard Development Company, L. P. The information contained herein is subject to change without notice. © Copyright 2016 HPE. The information contained herein is subject to change without notice. 1

HPE Storm. Runner Load Performance Testing in the Cloud for Web & Mobile Apps Simple Design & create load test under 10 minutes Smart Intelligent & predictive analytics for fast problem detection Scalable 1 user to 1 M+ Geographically distributed 2 © Copyright 2016 HPE. The information contained herein is subject to change without notice.

Customer Feedback 3 © Copyright 2016 HPE. The information contained herein is subject to change without notice.

How Storm. Runner works 1 Create and run a load test using your favorite scripting tool 2 Load Generators spin up in AWS EC 2 or MS Azure 3 Results and app insights are available in real time New 4 © Copyright 2016 HPE. The information contained herein is subject to change without notice. Soon New

SRL 1. 8 – Jan 2016 release Dynatrace AWS Code Pipeline Test from CSV file Advanced scheduling NV Network breakdown report Dynamic ramp up View RTS Custom reports

Ice Climber – 1. 9 – March release Gatling LR Java protocols Vusers license Edit RTS Real time breakdown Usage reporting Linux OPLG (tech preview) Usability improvements

Protocol support LR Java Edit RTS Gatling 7

License usage report Cloud or On Prem VUH or Vusers 8

How it is Priced Just Load © Copyright 2013 Hewlett-Packard Development Company, L. P. The information contained herein is subject to change without notice. © Copyright 2013 Hewlett-Packard Development Company, L. P. The information contained herein is subject to 9 change without notice.

Compare TCO - Traditional Costs vs. Cloud Hosted Taa. S Typical - separate Costs and Effort • TOTAL COST to Test • Tool Admin = $ • Hardware = $ • OS , DB = $ • License = $$ • Lab Space = $ • O&M = $ • C&A = $ • Outages = $ • Training = $ • Staff = $$ • Time to run scripts = $ 10 Cloud Hosted All included in ONE price • TOTAL COST for DTaa. S • Tool Admin - included • Hardware - included • OS , DB - included • Test Lab Space - included • O&M - included • C&A - included • SLAs – included • HP Software Licenses - inc • Test Executions • Test Reports • Test results Analysis © Copyright 2013 Hewlett-Packard Development Company, L. P. The information contained herein is subject to change without notice.

Pricing options: A B 11 VUser based pricing for testing internal applications using own LGs or own AWS account VUH based pricing for testing from Cloud LGs VUser X Time =VUH © Copyright 2013 Hewlett-Packard Development Company, L. P. The information contained herein is subject to change without notice. New!!!

Price in two simple steps: 1 2 12 Type of VUser X Time =VUH UI Virtual Users API Hours of test © Copyright 2013 Hewlett-Packard Development Company, L. P. The information contained herein is subject to change without notice. Dev Number of test runs

Define TYPE of VUser STE P 1 13 UI Enables you to run UI level protocols, such as Tru. Client scripts. Ideal for lower volume load tests with precise UI emulation and less scripting time API Enables you to run network level protocols, such as Web(HTTP/HTML). Ideal for Large volume load tests. Dev Enables you to run third party protocols, such as JMeter © Copyright 2013 Hewlett-Packard Development Company, L. P. The information contained herein is subject to change without notice.

Price in two simple steps: 1 Type of TEST 2 VUH X Time API = 15, 000 Virtual Users 14 4 2 Hours of test Times of test execution © Copyright 2013 Hewlett-Packard Development Company, L. P. The information contained herein is subject to change without notice. 120, 000 VUH

Customer Feedback • “HPE's latest performance testing service will help IT teams to begin load testing earlier and earlier, with an on-demand model that is simple and elegant. It's an impressively comprehensive solution, nicely designed and very easy to use” (Mark T) • “Storm. Runner is very simple and easy to use. Even my manager could run a load test. ” • "Very helpful to agile teams - saves a lot of time" • “Analysis is very good, very helpful for my team” • "You're making it too easy to create and run a load test” 15 © Copyright 2016 HPE. The information contained herein is subject to change without notice.

Why Storm. Runner Load? Agile cloud performance testing for modern apps Simple Smart Scalable • Easily extends LR and PC • Really fast spin up (tests start in minutes – no waiting for and paying for LGs) • Don’t worry about infrastructure for your test • Real-time analytics and quick access to data after test complete. 16 © Copyright 2016 HPE. The information contained herein is subject to change without notice.

Why HPE performance testing K 17 © Copyright 2016 HPE. The information contained herein is subject to change without notice.

HPE performance testing solutions Performance testing solutions Storm. Runner Load. Runner Performance Center on-premise Delivered on Saa. S Monitor with Site. Scope Profiler solution to pinpoint root cause Detect network behavior Virtualize test environment 18 © Copyright 2016 HPE. The information contained herein is subject to change without notice. Diagnostics Network Virtualization Service Virtualization

Selecting the HPE performance testing solution Customer needs for performance testing What app need to be tested? Web and mobile (test in the cloud) Any application Where will the test be executed? Cloud-based, on-demand On-premise What type of performance test is required? Simple, scalable, and agile AUT in the cloud delivered by HP Easy, fast, powerful, site-specific, project-based test Global and complete end-to-end performance testing Storm. Runner Load. Runner Performance Center on-premise Delivered on Saa. S 19 © Copyright 2016 HPE. The information contained herein is subject to change without notice.

HP performance testing solutions matrix Capabilities Storm. Runner Load. Runner Performance Center Network Virtualization Yes Yes Platform/price Cloud On-Demand Premise, pay as you go and Saa. S Support multiple platforms/protocols Web and mobile 50+ Strong analysis engine Yes Yes Auto correlation Yes Yes Supports browser-based and native mobile application Yes Yes Topology Yes Asset sharing Yes Performance requirements & defects Yes Lab management Yes Production data as baseline (performance application lifecycle) Yes Central repository for scripts, results, and analysis Yes 20 © Copyright 2016 HPE. The information contained herein is subject to change without notice. Yes

HP performance testing solutions Storm. Runner Load Cloud testing for Agile Simple Load. Runner On Premise Project Based Easy Performance Center On-premise and Saa. S Shared Smart Fast Global Scalable Comprehensive Complete HP performance testing add-on products Service Virtualization Simulate a service’s behavior Network Virtualization Detect Network Behavior 21 © Copyright 2016 HPE. The information contained herein is subject to change without notice. Diagnostics Pinpoint root cause issues

HP performance testing solutions Storm. Runner Load Simple, smart and scalable cloud testing Simple Smart Scalable Easily design and create load test in under 10 minutes Understand anomalies and problems in real-time using predictive analytics Automatically scale to 1 M+ v. User load tests Provisioning Real-time and off-line analysis SRL: 5 -10 minutes SRL: immediately 22 © Copyright 2016 HPE. The information contained herein is subject to change without notice.

HP performance testing solutions Load. Runner Easy, fast, comprehensive and now free (on-premise) Easy Fast Comprehensive • Flexible delivery model: cloud or on premise • Flexible licensing: daily, term or perpetual • Test in 2 simple steps: record the user flow and run the test Simulate simple or complex transactions with the Tru. Client Technology (no scripting knowledge required) • Simple licensing: No more controller costs, pay as you go • Add Virtual User days using Paypal™ or your credit card • Run tests anywhere or everywhere, at any time • Scale in the cloud as needed from multiple places in the world • Deliver rapid feedback throughout Development. Load. Runner integrates with Dev tools for continuous test (j. Unit, n. Unit, Eclipse, MS Studio, Selenium) • Test it all: Web, mobile and hundreds other types of apps • Understand the network impact as part of your testing with the exclusive HP Network Virtualization product • Analyze results in real-time and with complete coverage • Supports the latest application technologies • Virtually unlimited scalability 23 © Copyright 2016 HPE. The information contained herein is subject to change without notice.

HP performance testing solutions Features comparison Summary Storm. Runner Load. Runner Performance Center Provides a lightweight self-service, Saa. S solution for testing Web & Mobile applications. Leverages Tru. Client technology, and the ability to run scripts created by Load. Runner, while requiring little to no additional software. Designed to support project-based application performance testing across a wide variety of application technologies ranging from Mainframe to Mobile Focus On-demand, browser-based solution for highly scalable testing of Internet-facing applications Simple desktop solution for project teams Technologies supported Software Required Web, mobile & API only Broad technology support Takes the Load. Runner tools and manages them across the enterprise, providing web access to shared scripts, scenarios, results and test planning and management including infrastructure and licensing Enterprise solution providing web-based access to test planning, execution and management Broad technology support None, software delivered as part of the service Vu. Gen, Controller, Analysis Procurement Self-service, purchased through Pronq. com Licensing Pay-as-you-go subscription – Virtual User Hours (VUH) Pure cloud-based, multitenant, on-demand Saa. S offering Cloud-based solution only; AUT needs to be in the public cloud in current version. Deployment Notes 24 © Copyright 2016 HPE. The information contained herein is subject to change without notice. Vu. Gen, Controller(s), Analysis, PC Server, ALM Server, database Sold through HP Software Sales and Partners, Sold through HP Software Sales and or through Pronq. com (VUDs only) Partners, HP Saa. S and Managed Service Providers Term/Perpetual/VUD licensing On-premise and managed by partners; allows On-premise and managed Saa. S; allows cloud bursting Allow you to run a mix of tests both on-premise and using the public Cloud. LR/PC cloud bursting allows you to provision LGs in the cloud from your on-premise installation to scale up and out as needed.

Why HP Marketplace validation Trusted by • 40% of Fortune/Global 500 customers, more than any other load testing tool/product • The most federal/defense agencies, financial institutions, and manufacturers worldwide • SAP, Cerner, Capgemini, Infosys, etc. • Millions of users worldwide Legacy of leadership • Inventor of Performance Testing • Leader in application performance since 1994 25 © Copyright 2016 HPE. The information contained herein is subject to change without notice.

Why HP HPE has you covered With solutions for your needs and budget • Market leadership and innovation • Scalable solutions to support any size organization • Integrated products for the entire application lifecycle • Expertise and best practices • Flexible licensing and deployment models • Broadest technology and platform support in the industry • Extensive ecosystems of partners and IT professionals for local support and resources 26 © Copyright 2016 HPE. The information contained herein is subject to change without notice.

Why HP Endorsed by leaders in their respective industries Lowers application defects, boosting customer satisfaction and service levels Achieved 100 per cent uptime on My. Results Financial Institution Performance testing cycles reduced by two weeks or more 27 © Copyright 2016 HPE. The information contained herein is subject to change without notice. HP INTERNAL ONLY - CONFIDENTIAL Post-production application failures reduced by 80% British Sky Broadcasting Increases Performance Testing Throughput by 150%

Questions and Answers Build the Quality Into your application 28 © Copyright 2016 HPE. The information contained herein is subject to change without notice.

Thank You For More Information Email us or call me at: Hewlett Packard Enterprise Deliver to the Cor. Techs, Inc. 13921 Park Center Road Herndon, VA 20171 (904) 347 – 3114 rlinton@cortechs. com HPE EDS Drive Herndon, VA 20171 Kathey. Sanders@hpe. com customer their Vision 29 © Copyright 2016 HPE. The information contained herein is subject to change without notice. © 2016 Cor. Techs, Inc.