Factors on managing testing automation projects Robert Cui

Stakeholder Involvement Automation involves different stakeholders, designer(s) of framework, management with expectations, developer who build the code, developers who build the produce being tested, etc. . Communication and coordination of all stakeholders are important 2/13/2022 Factors on managing testing automation projects

Principles - Planning Identify what should be automated and what should not be, and design test cases based on the scope Automation and manual testing together should cover the full scope of software testing Smooth transition between existing and new automation tools - maintain and retire the existing automation tool, especially when current product being tested exists in near future and development of replacement product is under way 2/13/2022 Factors on managing testing automation projects

Principles - Structure and Design Less dependency on 3 rd party APIs, gems, etc. Simple – less or no abstract class, override, overload, delegate, interface, etc. Independent test cases – not share data or code among test cases if possible Test case grouping/management should be designed, such as using Test. NG Test case management should support different test runs (smoke, regression, full testing, etc. ) and full life cycle of a test case (in development, in use for different test runs, in modification, retired, etc. ) 2/13/2022 Factors on managing testing automation projects

Principles – Design and Structure (cont. ) Assert early to find test failures and fail the test case early Reporting is important for management – test coverage, pass/fail rate, test case status, etc. Support mechanism for running the automation tool how to run the tool, CI, manually command line, GUI from IDE, etc. 2/13/2022 Factors on managing testing automation projects

Principles - Coding guideline should be followed Code should be easy to understand without extra explanation from other people Comments in code are useful 2/13/2022 Factors on managing testing automation projects

Principles – Quality of Automation code should be reviewed before put in use Automation code should be fully tested before put in use Reliability – if test case passes, it really means that function being tested works; if it tails, it really means we have problem with product being tested, not a false alarm from automation code 2/13/2022 Factors on managing testing automation projects

End Automation is not about what fancy APIs or classes we use, it is about how effective, efficient and reliable is the tool to find bugs in product being tested and how easy to maintain the automation tool 2/13/2022 Factors on managing testing automation projects