IEEE15 14 0303 01 004 q May 2014

IEEE-15 -14 -0303 -01 -004 q May 2014 Project: IEEE P 802. 15 Working Group for Wireless Personal Area Networks (WPANs) Submission Title: Validation and Verification Task Force Proposal Date Submitted: May 2014 Source: Frederik Beer, Joerg Robert, Friedrich-Alexander University (FAU) / Fraunhofer IIS, Am Wolfsmantel 33, 91058 Erlangen, Germany Abstract: Suggestion for Validation and Verification Task Force Purpose: Providing direction towards a ULP PHY standard Notice: This document has been prepared to assist the IEEE P 802. 15. It is offered as a basis for discussion and is not binding on the contributing individual(s) or organization(s). The material in this document is subject to change in form and content after further study. The contributor(s) reserve(s) the right to add, amend or withdraw material contained herein. Release: The contributor acknowledges and accepts that this contribution becomes the property of IEEE and may be made publicly available by P 802. 15. Submission Slide 1 Frederik Beer, Joerg Robert

IEEE-15 -14 -0303 -01 -004 q May 2014 Proposal for “Validation and Verification Task Force” for IEEE 802. 15. 4 q Frederik Beer, Joerg Robert May, 2014 Submission Slide 2 Frederik Beer, Joerg Robert

IEEE-15 -14 -0303 -01 -004 q May 2014 Outline: • Motivation • Proposal for Validation and Verification Task Force • Next Steps Submission Slide 3 Frederik Beer, Jörg Robert

IEEE-15 -14 -0303 -01 -004 q May 2014 Motivation: • The proposed IEEE 802. 15. 4 q amendment offers a wide range of new modulation and encoding algorithms on the transmitter side • Even careful drafting of the amendment cannot completely eliminate potential bugs or unclear wording Ø Undiscovered bugs in the specification may hinder the successful and rapid commercial adoption of the IEEE 802. 15. 4 q amendment Submission Slide 4 Frederik Beer, Jörg Robert

IEEE-15 -14 -0303 -01 -004 q May 2014 Proposal: • Implement a voluntary task force within (or outside) IEEE 802. 15. 4 q that verifies and validates the proposed amendment • Each participating company is supposed to generate its own reference streams at specific test points and compare them to the reference streams of other companies at the same reference points Ø Verification, whether different companies have the very same understanding of the amendment Ø Validation, whether the amendment has bugs Ø No disclosure of reception algorithms, as comparison takes place on the transmit signals Ø Well-proven approach, which has been already used in other standardization bodies Submission Slide 5 Frederik Beer, Jörg Robert

IEEE-15 -14 -0303 -01 -004 q May 2014 Transmitter System Block Diagram with Test Points: 2 1 a 1 3 3 a 5 4 1 Test Point Block diagram with positions of the individual test points. Accordingly test points would be defined for TOOK PHY Submission Slide 6 Frederik Beer, Jörg Robert

IEEE-15 -14 -0303 -01 -004 q May 2014 Example: Companies A, B and C have identical streams. The stream of company D shows a mismatch. • The stream at “test point 1” is pre-defined • The companies take their chains to simulate the streams at the other reference points for previously agreed parameter configurations • The participating companies upload their generated streams for the following reference points onto a server • A mismatch between the streams of different companies indicates a potentially unclear section or bug in the amendment Submission Slide 7 Frederik Beer, Jörg Robert

IEEE-15 -14 -0303 -01 -004 q May 2014 Required Next Steps: 1. General agreement on voluntary task force Ø FAU would volunteer to organize the task force 2. Identification of a list of useful parameter configurations and test points 3. Definition of the file exchange format 4. Setup of file server with automatic comparison Ø Again FAU volunteers 5. Start of comparison process Submission Slide 8 Frederik Beer, Jörg Robert

IEEE-15 -14 -0303 -01 -004 q May 2014 Conclusion: • Undiscovered bugs or unclear wording may hinder the commercially successful adoption of the new amendment • FAU proposes a voluntary task force for the validation and the verification of the IEEE 802. 15. 4 q amendment • Such validation and verification process is already wellproven in other standardization bodies • The group has to agree whether it likes to contribute to this activities Submission Slide 9 Frederik Beer, Jörg Robert