Test Automation in Agile Migration 2 Selenium Agenda

Test Automation in Agile & Migration 2 Selenium

Agenda » The Evolution of Testing » Importance of Test Automation in Agile » Rise of Open-Source and Low-cost tools » Growing Popularity of Selenium » Challenges in Migration and the Options » Migrate 2 Selenium » Q&A www. gallop. net | Unsolicited distribution is restricted. Copyright © 2016, Gallop 2

The Evolution of Testing

Traditional Manual Testing with Defined Process Testing with Enhanced Maturity Multi-tier integrated Applications Stand alone Applications Simple web Applications CIT SIT UAT Matured Process 80% Test Uncover Defects Evolution of Testing Phased with SDLC Early Days In-house Testing Team It was all done by developers www. gallop. net | Unsolicited distribution is restricted. Copyright © 2016, Gallop 4 Test Automation In-house Test Centres

Next Level of Automation with Diversified Tools QE Transformation with Continuous Delivery Agile Driven Test Engineering Cross Technology integrated Complex Applications Diversified Complex Applications Mobility, Digital CI & CD $ Dev. Ops Automation Performance Testing & Tuning UI Service/ API Application Security Performance Security QE, Agile Transformation Era Specialized Centres of Excellence Testing Managed Centres www. gallop. net | Unsolicited distribution is restricted. Copyright © 2016, Gallop 5 Federated Co. Es

Hybrid Model Trend Forecast Tomorrow's World Testing Focus Technology Focus Go Digital Aggressive Functional Engineering Internet of Things Building SMART Automation Platforms Virtualization AI Enablement Enterprise Mobility & Cloud Hybrid Security Enabled Performance Engineering www. gallop. net | Unsolicited distribution is restricted. Copyright © 2016, Gallop 6 Envisioned Test Roles Digital Assurance Specialist Chief Quality Officer Creative Test Engineers Analytics Specialists Test Scientists Data Security Performance

The Importance of Test Automation in Agile

Why Agile? Early Revenue High Flexibility Speed to Market Client Involvement Better Quality Cost Control More Visibility Right Product Risk Management More Enjoyable! www. gallop. net | Unsolicited distribution is restricted. Copyright © 2016, Gallop 8

Importance of Test Automation in Agile Rapid test coverage Early Defect Detection Faster release of new features to business users Reduction in cost of Defects Continuous Integration and Continuous Deployment Reusability of Test Cases Faster Time to Market Test in pieces rather than the whole product www. gallop. net | Unsolicited distribution is restricted. Copyright © 2016, Gallop 9

Test Automation - Agile Test Quadrants Business Facing Automated & Manual Q 3 Functional Testing Story Tests Prototypes Simulations Exploratory Testing Scenario Based Testing Usability Testing User Acceptance Testing Alpha/Beta Manual Q 1 Automated Source: Lisa Crispin, Brian Marick Q 4 Unit tests API tests Web Services testing Component Tests Performance & Load Testing Security Testing ‘*ility’ testing Technology Facing www. gallop. net | Unsolicited distribution is restricted. Copyright © 2016, Gallop 10 Tools Automated Critique Product Supporting the team Q 2

Agile Automation Process Workflow Iterative design Prototype Integrate Rinse & Refine User Story Testing Application Code Development Design/Update proto types for the Business Components at UI and API level Define Acceptance Test Criteria Develop/Update the code, User Interface controls and Unit test cases Unit testing, integration testing and do bug fixes Execute API level automation scripts on continuous integration environment till Acceptance criteria is met Coordinate each other for developing Automation suite Write Acceptance Test Cases Execute end-to-end automation scripts on developed UI API Level Automation Testing Decision to Automate Test Yes Design Pseudo codes/Classes for API Level Automation Build API Level automation scripts with negative and positive scenarios Execute API level automation scripts on every component of developed code No Adopt Hybrid Risk Based Testing for Test optimization UI Level Automation Testing Perform Manual Testing Design Keywords for UI Level automation www. gallop. net | Unsolicited distribution is restricted. Copyright © 2016, Gallop Build automation scripts using Keywords for UI Level automation Capture UI Objects properties and integrate with UI automation scripts 11 Perform goal based Exploratory testing

Test Automation Trends API / Mid Tier / Non GUI Automation Agile Practices and Internet of Things are influencing the shift from GUI to API Testing Micro Services Small, extremely focused services will can be individually tested through automation and integrated to form a robust application Automation in Agile Environment Service/ Server Virtualization and automation testing will Organizations gradually embrace Agile practices with CI/ CD be managed by policies at a businessservice level, requiring all the groups in framework to reduce time to market and gain the competitive edge an organization to work in harmony Automation in BDD/ TDD Selenium + Open Source tools More and more organizations are embracing open-source test automation tools that are widely used across the globe Will lead to closer collaboration between developers & testers enabling shift left of testing www. gallop. net | Unsolicited distribution is restricted. Copyright © 2016, Gallop Automation in Cross Platform/ Technology Automation in Dev. OPS Allows developers, quality assurance and operations to meet customer needs through Automation Test Automation using Cloud Platform Automate Application across a variety of browsers/devices/OS in the cloud to reduce time-tomarket, increase release velocity without sacrificing quality 12 With the rise of Io. T, the year 2016 will have more focus to validate cross-device/platform and crosstechnology functionalities Mobile Automation Almost 35% of mobile app engagements last less than a minute, hence require more focus on Mobile test Automation for better consistency and user experience

Rise of Open-Source and Low-cost tools Journey of Test Automation Tools 1994 1997 2003 2009 2006 Mercury Win. Runner HP QTP HP Win. Runner HP QTP SQA Robot Rational Robot IBM Rational Robot Segue QAPartner 2009 - 2016 TRENDS Segue QAPartner Borland Segue QAPartner Microfocus Borland Compuware QARun Microsoft Visual Studio Compuware QARun Microsoft Visual Studio Automated Unit Testing GUI Testing Evolution of Frameworks New Age Tools Web Testing: Selenium Watir Ranorex Soap UI Sahi Continuous Testing API Testing Frameworks: Unit Testing Frameworks: Nunit XUnit Py. Unit API Driven Testing Hybrid BPT TDD Frisby Chakram Django Junit Test. NG GUI Testing: Ranorex Test Complete eggplant Test Studio www. gallop. net | Unsolicited distribution is restricted. Copyright © 2016, Gallop API Testing: HPUFT Parasoft v. Rest Postman Cloud Services Testing Gridlastic Cloud. Bees Mailosaur Sauce Labs Testing. Bot 13

Growing Popularity of Selenium

Selenium vs Top Commercial Tools – Jobs and Interest Source: Indeed Job Trends Source: Google Trends Selenium clearly has far higher adoption and interest than any other Commercial Test Tool www. gallop. net | Unsolicited distribution is restricted. Copyright © 2016, Gallop 15

Why Selenium? » Capability to operate on almost every Operating System (OS) » Supports multiple languages such as Python, Perl, Ruby, PHP, . NET, and Java… » Supports multiple browsers – Opera, Safari, Chrome, IE 6, 7, 8… and Mozilla Firefox » Cost effective, being an open source tool » Has an active developer community for support » Supports parallel test execution on various browsers across various devices » Easy to use development interface » Provides scalability and sustainability in the long term www. gallop. net | Unsolicited distribution is restricted. Copyright © 2016, Gallop 16

Challenges in Migration and the Options

Challenges in Migration What do I do with my existing test scripts, libraries & reusable functions? How do I handle the additional efforts to rewrite the scripts? How do I manage the additional cost to develop everything from the scratch? How do I make sure that all the test assets are migrated without any errors? What about my tool investment cost? Does the new automation tool integrate with the life cycle tools that I already have? www. gallop. net | Unsolicited distribution is restricted. Copyright © 2016, Gallop 18

What are my Options? Continue with the existing test automation tool and use Selenium for all the future automation activities Manually migrate all the existing test scripts, libraries and reusable functions to Selenium Use an automated tool which migrates all the test assets to Selenium with minimum manual intervention www. gallop. net | Unsolicited distribution is restricted. Copyright © 2016, Gallop 19

Migration Approach Automated Migration with Tool Manual Migration Manual migration to Selenium could be quite costly and time consuming. » The entire migration process is accelerated, creating standardized test assets » Reduced Time, Cost and Efforts » Needs minimal knowledge transition and less management oversight » Business remains as usual even while migration Some of the major challenges are: » Impact on business due to downtime issues » Lack of training and knowledge for performing the migration » Huge time involved in migration » Migration Cost Intricacies » Retaining the automation coverage www. gallop. net | Unsolicited distribution is restricted. Copyright © 2016, Gallop Supports migration from any platform to Selenium 15 times faster and 10 times cost effective compared to manual migration 20

Migrate 2 Selenium

Migrate 2 Selenium - World’s First Selenium Migration tool Language Supports multiple language translation Design Patterns Supports diverse automation frameworks Functional decomposition Keyword driven 1 Application Supports multiple Web browsers and versions Data driven World’s First Selenium Migration tool Accelerated Selenium Migration Object Repository Style Test Management Integration Migrate 2 Selenium by Gallop Solutions Migrates all types of object repository models Per Action Shared Object Data Sources Migrates entire test suites that reside in Quality Center/ALM converts scripts to Selenium (Designed Descriptive Programming Supports heterogeneous data sources (Excel & DB) www. gallop. net | Unsolicited distribution is restricted. Copyright © 2016, Gallop for Agile & Dev. Ops) 22

Script Migration Framework Source Automation Suite Rules Scripts (Actions) Source Map Files Target Map Files XML Import/Export Solution Environment Variables Scripts (Class Files) Object Repositories Assertions (Class Flies) Checkpoints Environment Variables Profiler Parser Translator Assembler Validator Logger Data Tables/Excel Object Repository Application Library Data Provider Detailed Log File Built-in Functions Utility Library (Class Files) Utility Libraries Launch Translator Application Functions (Class Files) Load OR Set Parent/Child Hierarchy www. gallop. net | Unsolicited distribution is restricted. Copyright © 2016, Gallop Load Script Files Convert Script Files Assemble Files 23 Validate Project

Sample Screenshots

Migrate 2 Selenium – Application Navigation a) Launch Screen www. gallop. net | Unsolicited distribution is restricted. Copyright © 2016, Gallop b) Home Screen 25

Migrate 2 Selenium – Application Navigation c) Select the Java Files www. gallop. net | Unsolicited distribution is restricted. Copyright © 2016, Gallop d) Select UFT Files 26

Migrate 2 Selenium – Application Navigation e) Select Target folder www. gallop. net | Unsolicited distribution is restricted. Copyright © 2016, Gallop f) Select Target Language & Framework 27

Migrate 2 Selenium – Application Navigation g) Selection Summary www. gallop. net | Unsolicited distribution is restricted. Copyright © 2016, Gallop h) Analysis Report 28

Q & A

Test Tools Mind Map TDD Cloud Solutions UI Automation Unit Testing Service Virtualization Continuous Integration Mobile Code Coverage www. gallop. net | Unsolicited distribution is restricted. Copyright © 2016, Gallop Team Management Tools 30

Thank You

Contact@gallop. net

Contact Information 39899 Balentine Drive, Suite 200 Newark, CA 94560 630 Freedom Business Center 3 rd Floor King of Prussia, PA 19406 E-Mail : contact@gallop. net Website : http: //www. gallop. net | Unsolicited distribution is restricted. Copyright © 2016, Gallop 33 "The V" Ascendas, Orion Block 1 st Floor Hyderabad- TG 500081