ONAPAuto Test Framework 1 Test Overall Objectives Depends

ONAP-Auto Test Framework 1 Test Overall Objectives Depends. On 2 Test Strategy 6 Depends. On 3 Enables Test Documentation Implements Test Analysis, Conclusions 4 Test Script Implementation Script language (Python, bash, …); Comments in script capture the test documentation Test Specific Objectives Depends. On Use Case Description “section” or “chapter” of a Test; could be just 1 UC; Assertion (Pass/Fail Criteria) Feature/Capability being tested, success/fail determination (binary pass/fail condition, quantitative thresholds/ranges, …) Executes 5 Test Runner (Calling script) Environment Description Physical Resources (unless Test aa. S) Physical servers (CPU, RAM), disks (HD, SSD), OS; pod organization; Is. Variant. Of Cloud & Virtual Resources Manager: Openstack, K 8 S, AWS, … Resources: compute (OS), storage, network, …; VMs or Containers; * Environment Variant VNF Manager VNFs VNF Lifecycle Events ONAP, Cloudify, Tacker, … v. XYZ (CPE, FW, Switch, HSS, I/S/P-CSCF, …); Source (OPNFV, Clear. Water, ETSI, …); Format (JSON, TOSCA, …) Onboard, Remove, Deploy/Activate, Terminate, Scale-In/Out, Monitor, … Follows (sequence) Pre-test State Description of required configuration, environment variables, … Action (Test Step) e. g. : setup, start, use, stop, (functions in a script language); execute planned VNF LC events Assertion Step Evaluation of current state, application of assertion criteria, determination of Pass/Fail result Post-test State Capture/Log of significant state data (environment variables, …) Cleanup Step Function to return system to its Pre -test State Follows (sequence)

ONAP-Auto Test Organization Edge Cloud [ID: Auto-UC-01] Resilience Improvements Through ONAP [ID: Auto-UC-02] Enterprise v. CPE [ID: Auto-UC-03] (future Use Cases) [ID: Auto-UC-xy] 6 1 Test Overall Objectives Depends. On 5 Specialization: Design, Architecture, Specification, HLD 2 Test Strategy Depends. On Test Script Main Logic 3 Test Documentation Implements 6 Test Analysis, Conclusions Enables (pick IDE/SDK, handle cloud environment instances and managers, launch scripts, manage DBs, . . . ); use same test development environment, only SBIs are specific Test Script Execution Control Executes (environment choice, VNF choice, business logic (pseudocode), metric definition, pass/fail condition definition, data structure model, test results analysis, . . . ) Specialization: LLD, integration Test Result Analysis 4 Test Script Implementation 4 Test Script SBI for Open. Stack Test Script SBI for K 8 S Open. Stack APIs, Commands K 8 S APIs, Commands Open. Stack K 8 S ARM pod x 86 pod Executes 5 Test Runner (Calling script) Test DB