LARGESCALE ORGANIZATIONS SCALING AUTOMATION STRATEGY Presented by Berk
LARGE-SCALE ORGANIZATIONS. . . SCALING AUTOMATION STRATEGY Presented by Berk Kibarer
Today’s Focus • SCALABILITY AS A SOLUTION • CHALLENGES • CASE STUDY • GLOBAL EVOLUTION • PROSPECTIVE GOALS • FURTHER READINGS
SCALABILITY IS THE SOLUTION • Establishing Boundaries • Managing Standards • Driving organizational goals
Dergilik Automated Tests Powered By "Framework" D TV+ Turkcell Akademi D T Automated Tests Powered By "Framework" Life. Box TA Automated Tests Powered By "Framework" • Centralization • Adaptability • 01 • Data Management • 05 • 02 • FRIDAY • 03 • 04 • Reliability • Standardization D L Yaani Mail Automated Tests Powered By "Framework" Y
REDEFINING. . . "TEST" «Runnable set of sequential steps to predicate whether the expected result is met or not. » "AUTOMATED TEST" "TEST AUTOMATION"
Today’s Focus • SCALABILITY AS A SOLUTION • CHALLENGES • CASE STUDY • GLOBAL EVOLUTION • PROSPECTIVE GOALS • FURTHER READINGS
CHALLENGES Maintainability Centralization Data Management Reliability Defining metrics Adaptability Ease of use
S 1 MINIMAL IMPACT ON CHANGES S 2 EFFICIENT ASSET USE S 3 TESTABILITY AS AN INDICATOR Maintainability
Centralization S 1 COMMON INTERESTS S 2 ORGANIZATIONAL STANDARDS S 3 CENTRALIZED GOVERNANCE S 4 TEAM & HIGH LEVEL DASHBOARDS
Data Management S 1 SEPERATION OF CONCERNS S 2 CENTRALIZED DATA MANAGEMENT
S 1 IT IS ABOUT TRUSTWORTHINESS S 2 STABILITY OVER TIME S 3 ROCK SOLID BEHAVIOURS Reliability
Defining Metrics S 1 “QUANTITATIVE EVIDENCE OF QUALITATIVE CHANGE” - KENT BECK S 2 METRICS FOR THE BIG PICTURE
S 1 TECHNOLOGY IS UNPAUSABLE S 2 LAYER LEVEL ABSTRACTION IS THE KEY Adaptability
Ease of Use S 1 BE SUPPORTIVE S 2 FEEDBACKS ARE PRECIOUS S 3 BE THERE
Today’s Focus • SCALABILITY AS A SOLUTION • CHALLENGES • CASE STUDY • GLOBAL EVOLUTION • PROSPECTIVE GOALS • FURTHER READINGS
How it all began. . . BASED ON A TRUE STORY MOTIVATION BEHIND THE IDEA
Dergilik Tv+ Main Clients Turkcell Akademi Lifebox Yaani Mail
Gherkin Implementation Seperation of Data Gherkin model to turn the tester template into a keyword driven model. Test data, verification data, locator data and config data are segregated and centralized. Focus on reliability Executor Setup Stability for operations, F. I. R. S. T principle for all. . . Pipeline integrations, containerized executors and realiable device farms. . . THE FRAMEWORK
HOW COME IT WAS NOT ENOUGH ? IT WAS JUST A START, INDEED.
Friday Scaled Automation Solution It is not just about test automation anymore. . . Friday is a modern study to help us understand how to automate things.
WHAT FRIDAY AIMS TO FIX. . . MANAGEMENT REPORTS ANALYSIS CULTURE Project management Test management Transparent reports Useful Metrics M. L. supported smart analysis Evolving standards Strong cooperation
Specification By Example Model Based Testing Management Traceability Matrix Integrations Scheduled Executions
Custom Metrics Version-Based Live Reports Alerts & Notifications Reports
Future Estimations Analysis Risk Analysis Smart Locators Smart Regression Models
Collaboration • Shared vision • Same goal Coordination • Sharing information & resources • Mutual objectives Cooperation • Exchange information & resources • Supporting each other’s goals Culture
Today’s Focus • SCALABILITY AS A SOLUTION • CHALLENGES • CASE STUDY • GLOBAL EVOLUTION • PROSPECTIVE GOALS • FURTHER READINGS
History TEST AUTOMATION LATE 1980 1990 -2000 -2010 Segue Software 1988 (Acquired by Borland in 2006) Testframe Method by Buwalda 1994 (Integrated Test Design and Automation: Using the Testframe Method in 2001 written by Hans Buwalda, Dennis Jansen and Iris Pinkster, Paul A. Watters) JBehave 2003 (by Dan North) Specification By Example 2011 (Written By Gojko Adzic) Selenium 2004 (By Jason Huggins) Experiences of Test Automation 2011 (Written by Mark Fewster and Dorothy Graham) JUnit 1997 (By Kent Beck, Erich Gamma) *During Zurich-Atlanta flight. RSpec 2005 (By Steven Baker, Dave Astels, Aslak Hellesøy) Mercury Software 1989 (Acquired by HP in 2006) Experiences of Test Automation 1999 (Written by Mark Fewster and Dorothy Graham) Cucumber 2008 (By Aslak Hellesøy) World Famous Test Automation Pyramid Succeeding with Agile 2009 (Written by Mike Cohn) 2010 -. . . Many, Many More. .
Market Estimation Reference: https: //www. marketsandmarkets. com/Market-Reports/automation-testing-market-113583451. html
Today’s Focus • SCALABILITY AS A SOLUTION • CHALLENGES • CASE STUDY • GLOBAL EVOLUTION • PROSPECTIVE GOALS • FURTHER READINGS
EXPAND COOPERATION Whatever we do, we cannot do it all by ourselves. We need to be united to gain real success. RAISE AWARENESS Tons of test automation projects fail everyday. This rises a bias; test automation does not work or beneficial" Goals for 2020 PROGRESSIVE QUALITY Power up the development life cycles with appropriate metrics. You can only do better if you are able to define the problem thoroughly.
Today’s Focus • SCALABILITY AS A SOLUTION • CHALLENGES • CASE STUDY • GLOBAL EVOLUTION • PROSPECTIVE GOALS • FURTHER READINGS
Recommendations
Recommendations
Recommendations
THANK YOU BERK. KIBARER@TURKCELL. COM. TR BERKKIBARER. COM PROACTORS. TECH
- Slides: 36