LARGESCALE ORGANIZATIONS SCALING AUTOMATION STRATEGY Presented by Berk

LARGE-SCALE ORGANIZATIONS. . . SCALING AUTOMATION STRATEGY Presented by Berk Kibarer

Today’s Focus • SCALABILITY AS A SOLUTION • CHALLENGES • CASE STUDY • GLOBAL EVOLUTION • PROSPECTIVE GOALS • FURTHER READINGS

SCALABILITY IS THE SOLUTION • Establishing Boundaries • Managing Standards • Driving organizational goals

Dergilik Automated Tests Powered By "Framework" D TV+ Turkcell Akademi D T Automated Tests Powered By "Framework" Life. Box TA Automated Tests Powered By "Framework" • Centralization • Adaptability • 01 • Data Management • 05 • 02 • FRIDAY • 03 • 04 • Reliability • Standardization D L Yaani Mail Automated Tests Powered By "Framework" Y

REDEFINING. . . "TEST" «Runnable set of sequential steps to predicate whether the expected result is met or not. » "AUTOMATED TEST" "TEST AUTOMATION"

Today’s Focus • SCALABILITY AS A SOLUTION • CHALLENGES • CASE STUDY • GLOBAL EVOLUTION • PROSPECTIVE GOALS • FURTHER READINGS

CHALLENGES Maintainability Centralization Data Management Reliability Defining metrics Adaptability Ease of use

S 1 MINIMAL IMPACT ON CHANGES S 2 EFFICIENT ASSET USE S 3 TESTABILITY AS AN INDICATOR Maintainability

Centralization S 1 COMMON INTERESTS S 2 ORGANIZATIONAL STANDARDS S 3 CENTRALIZED GOVERNANCE S 4 TEAM & HIGH LEVEL DASHBOARDS

Data Management S 1 SEPERATION OF CONCERNS S 2 CENTRALIZED DATA MANAGEMENT

S 1 IT IS ABOUT TRUSTWORTHINESS S 2 STABILITY OVER TIME S 3 ROCK SOLID BEHAVIOURS Reliability

Defining Metrics S 1 “QUANTITATIVE EVIDENCE OF QUALITATIVE CHANGE” - KENT BECK S 2 METRICS FOR THE BIG PICTURE

S 1 TECHNOLOGY IS UNPAUSABLE S 2 LAYER LEVEL ABSTRACTION IS THE KEY Adaptability

Ease of Use S 1 BE SUPPORTIVE S 2 FEEDBACKS ARE PRECIOUS S 3 BE THERE

Today’s Focus • SCALABILITY AS A SOLUTION • CHALLENGES • CASE STUDY • GLOBAL EVOLUTION • PROSPECTIVE GOALS • FURTHER READINGS

How it all began. . . BASED ON A TRUE STORY MOTIVATION BEHIND THE IDEA

Dergilik Tv+ Main Clients Turkcell Akademi Lifebox Yaani Mail

Gherkin Implementation Seperation of Data Gherkin model to turn the tester template into a keyword driven model. Test data, verification data, locator data and config data are segregated and centralized. Focus on reliability Executor Setup Stability for operations, F. I. R. S. T principle for all. . . Pipeline integrations, containerized executors and realiable device farms. . . THE FRAMEWORK

HOW COME IT WAS NOT ENOUGH ? IT WAS JUST A START, INDEED.

Friday Scaled Automation Solution It is not just about test automation anymore. . . Friday is a modern study to help us understand how to automate things.

WHAT FRIDAY AIMS TO FIX. . . MANAGEMENT REPORTS ANALYSIS CULTURE Project management Test management Transparent reports Useful Metrics M. L. supported smart analysis Evolving standards Strong cooperation

Specification By Example Model Based Testing Management Traceability Matrix Integrations Scheduled Executions

Custom Metrics Version-Based Live Reports Alerts & Notifications Reports

Future Estimations Analysis Risk Analysis Smart Locators Smart Regression Models

Collaboration • Shared vision • Same goal Coordination • Sharing information & resources • Mutual objectives Cooperation • Exchange information & resources • Supporting each other’s goals Culture

Today’s Focus • SCALABILITY AS A SOLUTION • CHALLENGES • CASE STUDY • GLOBAL EVOLUTION • PROSPECTIVE GOALS • FURTHER READINGS

History TEST AUTOMATION LATE 1980 1990 -2000 -2010 Segue Software 1988 (Acquired by Borland in 2006) Testframe Method by Buwalda 1994 (Integrated Test Design and Automation: Using the Testframe Method in 2001 written by Hans Buwalda, Dennis Jansen and Iris Pinkster, Paul A. Watters) JBehave 2003 (by Dan North) Specification By Example 2011 (Written By Gojko Adzic) Selenium 2004 (By Jason Huggins) Experiences of Test Automation 2011 (Written by Mark Fewster and Dorothy Graham) JUnit 1997 (By Kent Beck, Erich Gamma) *During Zurich-Atlanta flight. RSpec 2005 (By Steven Baker, Dave Astels, Aslak Hellesøy) Mercury Software 1989 (Acquired by HP in 2006) Experiences of Test Automation 1999 (Written by Mark Fewster and Dorothy Graham) Cucumber 2008 (By Aslak Hellesøy) World Famous Test Automation Pyramid Succeeding with Agile 2009 (Written by Mike Cohn) 2010 -. . . Many, Many More. .

Market Estimation Reference: https: //www. marketsandmarkets. com/Market-Reports/automation-testing-market-113583451. html

Today’s Focus • SCALABILITY AS A SOLUTION • CHALLENGES • CASE STUDY • GLOBAL EVOLUTION • PROSPECTIVE GOALS • FURTHER READINGS

EXPAND COOPERATION Whatever we do, we cannot do it all by ourselves. We need to be united to gain real success. RAISE AWARENESS Tons of test automation projects fail everyday. This rises a bias; test automation does not work or beneficial" Goals for 2020 PROGRESSIVE QUALITY Power up the development life cycles with appropriate metrics. You can only do better if you are able to define the problem thoroughly.

Today’s Focus • SCALABILITY AS A SOLUTION • CHALLENGES • CASE STUDY • GLOBAL EVOLUTION • PROSPECTIVE GOALS • FURTHER READINGS

Recommendations

THANK YOU BERK. KIBARER@TURKCELL. COM. TR BERKKIBARER. COM PROACTORS. TECH