FUNCTEST EUPHRATES release plan Hackfest April 2017 Orange

  • Slides: 12
Download presentation
FUNCTEST EUPHRATES release plan Hackfest April 2017 Orange labs. Paris

FUNCTEST EUPHRATES release plan Hackfest April 2017 Orange labs. Paris

Euphrates release schedule MILESTONES DUE MS 1 – Planning complete 2 May MS 2

Euphrates release schedule MILESTONES DUE MS 1 – Planning complete 2 May MS 2 – Test planning (which test cases will be part of the release) 22 May MS 3 – Installer integration with Open. Stack 30 May MS 4 – Test framework ready, infrastructure updates completed 5 June MS 5 – Scenario integration and Feature freeze 21 July MS 6 – Test cases and preliminary docs completed 11 Aug. MS 7 – Stable branch window closed 1 Sept. MS 8 – Formal test execution completed 18 Sept. MS 9 – JIRA issues assigned closed 20 Sept. MS 10 – Documentation completed 22 Sept. MS 11 – Release 25 Sept.

Where are we and where do we go? Release plan (2 May) April OPNFV

Where are we and where do we go? Release plan (2 May) April OPNFV Hackfest (24 -28 Apr) May Test framework ready Test cases completed (11 Aug. ) (5 June) June OPNFV Summit (12 -15 June) July August RELEASE (25 Sept) September

WORK AREAS q q q q 24/04/2017 Framework Tests CI Test API Documentation Collaboration

WORK AREAS q q q q 24/04/2017 Framework Tests CI Test API Documentation Collaboration General Footer Lorem Ipsum Dolor Sit 4

FRAMEWORK Story SNAPs Functest offline VNF abstract. Tasks Owner 6 June - Snap-rize the

FRAMEWORK Story SNAPs Functest offline VNF abstract. Tasks Owner 6 June - Snap-rize the current test cases (e. g. v. Ping) Get rid of openstack_utils eventually Also update feature projects using openstack_utils, like SFC, BGPVPN All Steven 6 June - Provide a way to run Functest without internet connectivity SNAPS must by default use internal images if available Skip tests that strictly require internet Pre-download standard Ubuntu image for test cases. Running unit test offline Jose Steven - vnf_base must be updated to take the new rules defined into account Morgan Cedric - Use Feature as driver for all bash third-party testcases Set cmd as run args in testcases. yaml Feature code status Cover feature by unit tests Call main() of testcases that are implemented in python Cedric 6 June Feature integration 6 June

FRAMEWORK Story Tasks Owner Unit tests - Coverage > 80% and if possible 100%

FRAMEWORK Story Tasks Owner Unit tests - Coverage > 80% and if possible 100% anyone providing new code MUST provide the associated unit test Catch false positives (e. g. Tempest, …) All Cedric Logging - Each test case should produce an individual log file Produce standard output in test case class. Keep log files for debugging. Helen Cedric - Micro service approach to allow user to call Rest API to see test tiers and trigger test Helen Serena - Helen - Slice the image into smaller ones - Architecture and design - Implementation Use the Functest API to call the different containers. - Continue improving code towards an well Object Oriented framework Pylint All Functest API (medium prio) Docker slicing (low prio) Code

TEST CASES Story Overlaps ONAP VNFs Tasks - Identify test that overlap and exclude

TEST CASES Story Overlaps ONAP VNFs Tasks - Identify test that overlap and exclude them or make then optional (e. g. tempest_smoke_serial vs tempest defcore) Tempest parallel? investigate 11 Aug - Collaboration XCI with ONAP Consider end to end test, not validate ONAP 11 Aug - Add more sample VNF deployments in Functest discussion with Sample. VNF team Morgan Valentin - Add test for Kubernetes based deployments (container based VNFs) No. Openstack scenarios? SNAPS support Add test cases (e. g. container ping) Add util functions for Kubernetes Jose Narinder Steven 11 Aug K 8 - Owner - Morgan Jose Juha

CI Story Promotions CI gating Dashboard Tasks Owner - Promote scenarios and test cases

CI Story Promotions CI gating Dashboard Tasks Owner - Promote scenarios and test cases that work more often. Morgan - More CI scripts to ensure no regression in coverage, no regression in file permission rights. . . For each patch-set, it should be a verify job that runs the code on a fresh virtual deployment Jose Minor improvements (e. g. arm results) Morgan -

TEST API Story Enhancements Login/Auth Tasks Owner - Provide website and support pagination there,

TEST API Story Enhancements Login/Auth Tasks Owner - Provide website and support pagination there, testresults. opnfv. org expose the website instead of swagger page Serena - Provide a way to authenticate to store/fetch results Serena

DOCUMENTATION Story Tasks Docs update 22 Sep Test API 22 Sep - Update config

DOCUMENTATION Story Tasks Docs update 22 Sep Test API 22 Sep - Update config guide Update user guide Update dev guide All - Update docs for Test API Serena Add proper doc-strings everywhere in the framework Jjob to create the doc API Cedric Discussion about how to handle release notes Serena Jose Morgan Automatic Framework documentation Release notes Owner

COLLABORATION Story Tasks Owner CVP - Identify and collect requirements from CVP towards Functest/Test

COLLABORATION Story Tasks Owner CVP - Identify and collect requirements from CVP towards Functest/Test API Jose ODL - Collaboration with the ODL community to add new test cases (robot) Cedric Refstack - Review and provide feedback to interop working group/refstack Jose

WE CAN DO IT!

WE CAN DO IT!