TDO Overview Oct 2019 2018 IBM Corporation Latest

Latest Market Trends in Test Data Management Bloor reports: • We see an increased emphasis on test data provisioning, as opposed to merely test data management • Due to continued interest in Dev. Ops practices, as well as Agile and Continuous Testing • Goal is to provide not only a way to create test data, but a method of distributing it effectively and efficiently to your testers • Advantage here is a significant improvement to the tester experience and to testing efficiency • Preventing Test Data from becoming a bottleneck to Test Automation, Continuous Testing and Dev. Ops (CI/CD) pipelines TDO was specifically designed to address these needs, aligning TDM and QA with Agile and Dev. Ops practices for rapid release cycles, getting the right data into the right tests, automatically, on demand 2 © 2018 IBM Corporation

Continuous Testing Requires Continuous Data The “Right Data” at the “Right Time” 3 ©

Continuous Testing Requires Continuous Data Right Data • Related (Employees, Customers, Orders, Products) • Meets requirements of “Test Cases” – Contains proper mix of data conditions • Executes the most test cases with the smallest amount of data possible Right Time • Quickly provisioned during agile sprint • Test data versioning (R 1, R 2, etc. ) • Easily/quickly refreshed 4 © 2018 IBM Corporation

Test Data – the longest pole in the tent Test Environment Provisioning & Test Data Provisioning (to Testers) Level of Effort 9 8 7 6 “Long Pole” in the Tent 5 4 3 50% of Overall Testing Time 2 1 0 System and applications Test data Database server Client operating system Browser Hardware and Server O/S Network Environment Provisioning = Loading Test Environments with Environment Data Test Data Provisioning for Consumers (Testers) = Finding & Matching the Right Data needed to Run Each Test Continuous Data for Continuous Testing / © 2019 IBM Corporation 5 © 2018 IBM Corporation

Test Data Providers & Test Data Consumers OPTIM - Test Data Provisioning Tools - ENVIRONMENT DATA PROVIDERS Sanitised Production Subset Environment Data Gold Copy Fabricated Test Data Virtual Clones of Source Data Test Environments “Your Data’s Ready!” Dev. Test “Great now I just need Input Data!” “What do you mean? ” “To test business processes I need to send data into the system” “Great, go ahead!” TEST DATA CONSUMERS First I have to: • Work out Test Coverage • Work out Data Requirements • Find the Exact Data for each Test • Match the Data to Tests • Feed Data to Test Tools & Testers Account Data Customer Data Currency Data © 2018 IBM Corporation

Test Data Providers & Test Data Consumers OPTIM - Test Data Provisioning Tools - ENVIRONMENT DATA PROVIDERS Test Environment Data Sanitised Production Subset Gold Copy Fabricated Test Data Virtual Clones of Source Data Test Environments Dev. Test Consumers (Dev. Test) need specific Test Input Data - e. g. accounts, customers, claims To execute tests against the Environment loaded by Providers TDO calculates what test input data you need, finds it and matches it to tests - automatically Account Data Customer Data Test Input Data TEST DATA CONSUMERS Test Execution Tools Currency Data © 2018 IBM Corporation

What’s the Problem!? What to Test!? Manual Effort Test 1: A Retail Customer with a USD Savings Account makes a payment from his/her mobile phone of less than $250 What Data I Need!? Test 2: A Retail Customer with a USD Checking Account makes a payment using his/her mobile phone of less than $250 Manual Effort Test 3: (etc. ) Data Combinations 1 by 1, for 100 s or 1, 000 s of tests Find my Data!? – Go Fish! Retail Savings $ Yes Data 2: Customer Type: Account Type: Acct Currency: Has Mobile App: Retail Checking $ Yes Data 3: (etc. ) Data Requirements 1 by 1, for 100 s or 1, 000 s of tests Match Specific Data to each Test!! 1 by 1, Test by Test 1 Data 1 Test 2 Data 2 Test 3 Data 3 Test 4 Test 5 Data 1: Customer Type: Account Type: Acct Currency: Has Mobile App: Test 6 Test 7 Test 8 1 by 1, Test by Test For 100 s or 1. 000 s of Tests Manually! © 2018 IBM Corporation

TDO Solves the problem Automates Activities ss ne si les Bu Ru What to Test What Data You Need Coverage Calculator Coverage Matrix Find Data Coverage Rules TDO Match Data to Tests Coverage Rule 1 Coverage Rule 2 Coverage Rule 3 Just a few Rules Feed Data to Tools 100 s, or 1, 000 s of Tests & Test Data Requirements Automates the Rest… Instead of doing 5 activities, 1 by 1, manually for 100 s or 1, 000 s of Tests TDO generates Coverage Matrix – & Automates these activities for 100 s or 1, 000 s of Tests = Paradigm Shift – Now Test Data can be Agile & Continuous for Dev. Ops © 2018 IBM Corporation

Tying it all Together… OPTIM - Test Data Provisioning Tools - ENVIRONMENT DATA PROVIDERS Sanitised Production Subset Gold Copy (Sanitised Data) Fabricated Test Data Environment Data Virtual Clones of Source Data Test Environments Dev. Test TDO 1. 2. 3. 4. Calculate Data Coverage Get Data Match Data to Tests Feed Data to Tools Test Input Data TEST DATA CONSUMERS Account Data Test Execution Tools Customer Data Test Input Data Currency Data © 2018 IBM Corporation

Sample Benefits These Customer-derived effort ratios compare current approach with TDO The compound efficiencies enabled through this level of automation driven by th ‘coverage as data pattern’ – are ‘game-changing’ © 2018 IBM Corporation

Measurable Savings When the value of TDO is fully leveraged, the effort savings are considerable Create Roles Manual Effort TDO Effort Tester 100% BA / SME TDM Engineer Update Savings Manual Effort TDO Effort Savings 40% 60% 100% 20% 80% 100% 50% 100% 30% 70% 100% 65% 35% 100% 40% 60% © 2018 IBM Corporation

Competitor Landscape – TDO Testing / TDM – Function (all functions AUTOMATED) TDO CA Informatica Delphix Others Calculate Test Coverage from Business Rules A - - Generate Data Requirements from Coverage Matrix A - - Auomate Data Acquisition from Coverage Matrix A - - Match Data to Tests Automatically – - for your whole Coverage Matrix at once A - - Identify Gaps in Available Data - based on Coverage A - - Generate Synthetic Data - from Coverage - to fill gaps A - - Generate Expected Results from Coverage A - - Feed Right Coverage & Data to Test Tools on Demand A - - Reuse Coverage & Data across environments & releases - i. e. change data source - go again with no down-time A - - Automate Test Prep & TDM for Agile Dev & CI/CD A - - © 2018 IBM Corporation

Who cares and why? QA – Significant Effort Reduction = more time to test more = reduced risk – Less time & effort = Agile – i. e. testing fits in sprints – More automation in QA & Test Data = Continuous Testing – FOR REAL! – More accurate coverage (based on business rules) = reduced risk TDM Team – Last minute requests eliminated – Less Iterations of Requests – as Data Requests are more accurate – More repeatable processes – jobs are set up once and reused – Smarter Gold Copies – gaps in available data can be fixed in next version Business – Direct involvement in defining Coverage – hands-on = higher confidence – More accurate coverage = less business risk – Coverage Rules 100% transparent to the business – no ‘blind risks’ – Eliminates need for risk based testing 16 Dev. Ops – Test Data built into delivery pipelines = rapid, continuous release cycles – Testing fits into rapid release cycles – Coverage, Data Assignment, Feed to Tools – all called over API © 2018 IBM Corporation

Make Time to Test What Really Matters – with TDO How do you Test What Really Matters – when your suppliers are Agile and running CI/CD – and you’re not there yet? How do you know what really matters to test? How do you test enough in the time that’s available? How do you test faster to make more time? TDO was designed to bring QA & TDM into alignment with Agile and Dev. Ops (CI/CD) practices so you can test what really matters – in time! HOW? Calculate Coverage: Know what really Matters to Test • Calculate exact coverage automatically from business rules or metadata • Generate Data Requirements automatically in the same process Automate Test Preparation Make Time to Test what really Matters • Automate the 80% of Testing that’s still manual – Test Preparation • Automate - Calculating Coverage & Data Requirements, Getting Right Data using this, Matching Data to Tests, Feeding Data to Test Tools & more… 17 © 2018 IBM Corporation