ONAP Benchmark Project Progress August 15 th 2018

ONAP Benchmark Project Progress August 15 th, 2018

Problems we came across • Resiliency test 8. 15 we create vcpe use case , run vcpe. py customer command this error occured: "status. Message": "Bpmn error encountered in Create. Generic. ALa. Carte. Service. Instance flow. Unexpected Error from method prepare. Create. Service. Instance() - Cannot serialize object in variable 'service. Input. Params': groovy. json. internal. Lazy. Map" The problem has been sent to onap discuss mail list.

Test Schedule N O COMPLETION TIME PLANNED ACTUAL COMPLETION TIME 2018/4/20 We chose S 3 P of v. CPE as test scope Closed 2018/4/25 2018/4/27 The required environment to run test cases has been set up and configured Closed 2018/5/1 2018/7/1 　 2018/5/1 2018/6/4 　 2018/4/23 　 TASK SUB TASK Test Target & 　 Test Scope a) Infrastructure & Environment 2 Environment b) v. CPE Deployment 1 v. CPE E 2 E Test Cases v. CPE Test 4 Indexes 3 5 Test Tools 6 Test Cases Running 7 Case AT Output (Test Report, Test 8 Document, etc. ) a) Southbound Simulator i. Openstack ii. Vnfm iii. Openflow Adapter v. BRG, v. BNG, v. GMUX, and Vgw (Cloud. Stress, Avalanche) b) Stress Test c) Performance Monitor PROGRESS 2018/06/14: We installed the latest R 2, and passed all the health check. Problems during installation were solved. However, we cannot run the v. FW and v. CPE test cases. 2018/6/4: 100% of the test cases have been finished till today. 2018/5/8: 30% of the test cases have been finished till today. STATUS Closed Not yet started Suspend Closed 2018/5/1 2018/6/4　 2018/6/04: Tools are ready to use. 2018/5/10: We are adjusting the topology of Metric to effectively monitor the resource consumption of core modules, and coordinating Smart. Bit. 2018/5/8: We completed the installation of Cloud. Stress and Metric and the debugging of hardware. Tomorrow we will release it to the Beijing Research Institute. 2018/5/1　 Preliminarily we determined to use opensource tools: Tsung/JMeter/Locust+Avalanche Use Linux opensource tools: Sar/htop/Dstat/Glances Closed Resiliency 2018/5/11 　 See in next slides Open Performance & Stability 2018/5/11 　 See in next slides Open Scalability 2018/5/11 　 See in next slides Open 　 2018/5/15 　 　 2018/5/18 　 Open

Test Schedule TASK FINIS PROGRESS HED Test Cases Running STATUS resiliency 80% 2018/08/15: Liu Chenglong: 1. redeploy vcpe use case vsp, svc and other 5 services, and distribute these 5 svcs. 2. solve some of the problems in the onap deployment, the main reason is that the af, sdc docker has not been deployed successfully, and try deploying again. 3. Communicate with Yang Bin to check the quota data of keypairs. The result of the query is that the demo user has consumed 100 keypairs and we delete these keypairs. 4. The vcpe infra deployment is successful. Sun Xinlong: 1. Verify the 'vcpe customer' and there are still errors. 2. Query the usage of VNF Adapter on mso, and the reason why errors may occur. Open Performanc e 20% 2018/08/15: 1. This week preliminary complete the simulation of the openstack interaction during the v. BRG creation process , simulates the services provided by the three ports of openstack: 5000, 8004, and 8774. Question: The vcpe scene has not been restored yet. The code still has some remaining problems. It is necessary to continue to combine ONAP debuggind adjust the contents of the reply packet to determine whether it is available. The next step: If this method is feasible, can interact with onap, we need to continue simularting the interaction with openstack during the creation of vgw (The premise is vgmux, vbng, etc. can be reused) Open Stability 20% 2018/08/15: vcpe script problem analysis is finished, we are learning robot framework user guide and plan to write test script. Open Scalability 20% 2018/08/15: 1. The current vfw closedloop script can not run completely the problem solution provided by the community is based on the oom method. Our environment does not Open

Thanks