January 2001 doc IEEE 802 15 01055 r

January 2001 doc. : IEEE 802. 15 -01/055 r 0 IEEE 802. 15 Working Group for Wireless Personal Area Networks™ Balloting Tools and Comment DB Report January 2001 Monterey, CA USA Submission 2 Ian Gifford, M/A-COM, Inc.

January 2001 doc. : IEEE 802. 15 -01/055 r 0 Contents • Summary • Overview – Problem – Research – Solution • Backup • More Backup Submission 3 Ian Gifford, M/A-COM, Inc.

January 2001 doc. : IEEE 802. 15 -01/055 r 0 Summary • TG 1 reviewed the LB process and we believe the cycle time can be reduced by introducing a more efficient “post” LB phase Comment database to manage the LB votes, comments, and resolution as well as all the myriad of reports • TG 1 will continue to review the “Pre” LB and LB phases to see if additional cycle time can be reduced e. g. , new Balloting Tool, etc. Submission 4 Ian Gifford, M/A-COM, Inc.

January 2001 doc. : IEEE 802. 15 -01/055 r 0 Balloting Tools and Comment DB Overview • Problem – The 802. 15 LB Comment Resolution Phase seems to take to long and appears to be cumbersome. TG 1 wants to review the process and reduce the cycle time where possible. • Research – TG 1 reviewed various IEEE (802. 3, 802. 16, and IEEE-SA Balloting Center) and Non-IEEE Working Group and Sponsor Balloting Tools and Comment DB approaches. • Solution – TG 1 will use a new Comment DB for the next LB and we may introduce a new Balloting Tool(s) for the Voter too. Q How does 802. 3 manage their ballot to draft? One (1) DB per Ballot or something else? A One DB per ballot/draft. i. e. a database for a set of comments and their resolution against a particular draft. Submission 5 Ian Gifford, M/A-COM, Inc.

January 2001 doc. : IEEE 802. 15 -01/055 r 0 Problem: 802. 15 WG Letter Ballot Typical Distribution Package • Create LB Distribution Package IEEE 802. 11 Legacy Balloting Tools – Ballot • MS Word document or • E-Mail reply Letter Ballot – Comment Form • MS Word document or • MS Excel document – Draft • Adobe Acrobat document – Instructions • Adobe Acrobat document – etc. • • Distribute LB Package to WG Membership reviews package and returns vote and comments if any. Submission Comment Form 6 WG Member Ian Gifford, M/A-COM, Inc.

January 2001 doc. : IEEE 802. 15 -01/055 r 0 Problem: 802. 15 WG Letter Ballot Typical LB Tally & Resolution • Working Group – Prepare & announce LB tally and results Letter Ballot Tally & Analysis • Task Group – Review LB tally and prepare detailed analysis – Prepare LB Comment tally and prepare detailed analysis – Form TG Resolution Group – Resolve Comments – Prepare LB/D(x) Summary reports Submission Comment Tally & Analysis 7 TG Worker Letter Ballot/ Draft Summary Report Ian Gifford, M/A-COM, Inc.

January 2001 doc. : IEEE 802. 15 -01/055 r 0 Research: A Typical LB Gantt Chart and where to focus on reducing cycle time Fixed • • Variable Enhancing the Distribution Package with a so called “Balloting Tool” e. g. , MS Word, File. Maker runtime version, etc. could provide a better output from the LB Period or Voter response Introducing a Comment Database e. g. , MS Access, File. Maker, etc. with the Voter ballot responses could provide reduction in cycle times for: – LB Analysis & Report – RDBMS could calculate and report – LB Comment Analysis & Report – RDBMS could calculate and report – TG Comment Resolution – RDBMS could provide the Resolution Team as well as the Draft Editing Team with an integrated tool that clearly communicates the WG commentary on the draft. Submission 8 Ian Gifford, M/A-COM, Inc.

January 2001 doc. : IEEE 802. 15 -01/055 r 0 Research: Any LB Results format may be used provided the following information is included: • • A. Date of Ballot B. Member name C. Member affiliation (e. g. , company, agency, institution) or status (e. g. , consultant, retired) D. Member classification or relationship to the area addressed by the standard (user, producer, general interest, or others as appropriate, such as academia or government; this is the member's relationship to the activity, not his employer's relationship. ) The IEEE-SA Standards Board Operations Manual stipulates that "Except for the general interest category, no group (classification) may constitute 50% or more of the balloting group membership. " E. Confirmation of Standards Association Membership (IEEE or Affiliate number) F. Ballot Information The IEEE-SA Standards Board Operations Manual stipulates that 75% of the ballots mailed shall have been returned (only 50% required for withdrawal of a standard). A minimum of 75% of those voting shall approve the draft in order to submit the ballot results to the IEEE-SA Standards Board. As with the Sponsor Balloting Phase the WG can use any LB reporting format but TG 1 suggests the 802. 15 use the minimum reporting information to be better prepared for the Sponsor Balloting Phase. Submission 9 Ian Gifford, M/A-COM, Inc.

January 2001 doc. : IEEE 802. 15 -01/055 r 0 Research: Any LB Results format may be used provided the following info is included: (cont) • The following is an example of how to properly calculate returned ballots from eligible voters: – Draft: 5. 3 Date Closed: 18 June 1998 – Ballots Sent 100 – Ballots Returned: • • • Affirmatives 60 Negatives 13 Abstentions 15 Total 88 No Response 12 Total Ballots 100 – Percent Returned (60 + 13 + 15) / 100 = 88% – Percent Affirmative 60 / (60 + 13) = 82% – Percent Abstentions 15 / 88 = 17% • List of All Voters and their response The results of LB 6 were reported to the Task Group 1 based on the format above. Submission 10 Ian Gifford, M/A-COM, Inc.

January 2001 doc. : IEEE 802. 15 -01/055 r 0 Solution: TG 1 is creating a Comment DB to assist in post LB 7 processing • Goal – Have a Master DB to capture the LB 7 Votes, Comments, and possibly the actual Draft 8. 0. • Software being considered – MS Access 2000 – Michael Camp • In process will be ready in Feb 01 – File. Maker 5. 0 v 3 – Ian Gifford • In process will be ready in Feb 01; thanks to source from 802. 3 – Quick. Base – Ian Gifford • In process could be ready in Mar 01. Reviewing an online vs. off-line process. There are other DBs e. g. , 2 D Submission 11 Ian Gifford, M/A-COM, Inc.

January 2001 doc. : IEEE 802. 15 -01/055 r 0 IEEE 802. 15 Working Group for Wireless Personal Area Networks™ Backup Submission 12 Ian Gifford, M/A-COM, Inc.

January 2001 doc. : IEEE 802. 15 -01/055 r 0 All the files researched are here: http: //ieee 802. org/15/private/Ballot-Tools/Research/ • • Non-IEEE (source files archived) – 802. 3 ae (Geoff. T) – Quick. Base • 10 Gig. Ballot. ZIP [10 Gig. Ballot-a Solution. EXE, plus 20 DLLs] • 10 Gig. Ballot. txt • Free WWW based DB • https: //www. quickbase. com – Village Software – 802. 3 z (Howard. F, etc. ) • Pay for use Consultancy to create a Balloting Tool, Comment DB, etc. • http: //www. villagesoftware. c om • D 5. 0. mdb • db. txt – 802. 16 (Roger. M) • 80216 -00_22. doc • r 4 MAC_Comments. mdb • r 4 PHY_Comments. mdb • IEEE-SA (TBC) – 2 D, XML, etc. Access to the /private/ sub directory can be achieved – please contact the author or WG Chair for password access. Submission 13 Ian Gifford, M/A-COM, Inc.

January 2001 doc. : IEEE 802. 15 -01/055 r 0 Summary of findings - 802. 3 ae • 802. 3 ae provides two Balloting Tools e. g. , ASCII and DB – 10 Gig. Ballot. txt • This balloting tool is provided for those that do not want to use the runtime tool. – 10 Gig. Ballot-a Solution. EXE • This balloting tool is a DB created via File. Maker Pro and the File. Maker Developer; it is a runtime version of Geoff Thompson’s own tool. Great Balloting Tool but in addition to requiring a DB it requires 17 DLLs and when zipped it is 2. 2 MB. • In speaking with Roger Marks not all the DLLs are distributed and if the Voter does not use MSIEv 5 e. g. , NN, Opera, etc. then additional DLLs are required. Not confirmed. • 802. 3 ae uses a Comment DB based on MS Access and/or File. Maker to accept the Balloting Tool *. CSV outputs We also received a clone Attendance DB from 802. 3 [802 -3 Att. DB-Clone. fp 5] for trial; the legacy 802. 15 Member DB was written in 1997 MS Access but is not supported. Submission 14 Ian Gifford, M/A-COM, Inc.

January 2001 doc. : IEEE 802. 15 -01/055 r 0 Summary of findings - 802. 3 z • 802. 3 z provides two Balloting Tools e. g. , Online and ASCII – “It was a wonderful tool but had what I considered to be a major drawback. It accepted comments from a web page (preferred) or a file submitted as text or an e-mail body. The text mode depended on rigid adherence to an ASCII template for the comments to get vacuumed into the master database. The web page method was a pain if you had lots of comments. It only worked on-line. The ASCII method worked well off-line but was problematical in pulling things into the master database. ” Geoff. T • 802. 3 z uses a Comment DB based on MS Access [D 5. 0. mdb] to accept the Balloting Tool online outputs We submitted a request for info; we are still waiting for a response from Colin Mick. Submission 15 Ian Gifford, M/A-COM, Inc.

January 2001 doc. : IEEE 802. 15 -01/055 r 0 Summary of findings - 802. 16 • 802. 16 uses a single MS Word “form” Balloting Tool – 80216 -00_22. doc • This balloting tool works very well but has some drawbacks e. g. , if ““ or , ” are used a script has to be used to remove inline characters that confuse the *. CSV import • Occasional Voter errors are encounter when they use the tool • 802. 16 uses a Comment DB based on MS Access – r 4 PHY_Comments. mdb & r 4 MAC_Comments. mdb • This MS Access DB seemingly appears to be easily ported over to TG 1. Submission 16 Ian Gifford, M/A-COM, Inc.

January 2001 doc. : IEEE 802. 15 -01/055 r 0 Summary of findings – Sponsor Ballot/The Balloting Center • We are not fully clear on the Sponsor Balloting process – that is one of the reason we are reviewing this process too • The Balloting Center uses an online Balloting Tool • The Balloting Center uses a Comment DB based on 4 D – Using a print program from 4 D; they either fax or save to HTML and send as a email attachment. – The Balloting Center, Walter Pienciak, is very willing to work with the various WGs and if we supply ordered list of the fields we track, he can work a program up to send us a "something"-delimited file – this allows for better efficientcies on Comment DB import. Submission 17 Ian Gifford, M/A-COM, Inc.

January 2001 doc. : IEEE 802. 15 -01/055 r 0 IEEE 802. 15 Working Group for Wireless Personal Area Networks™ More Backup Submission 18 Ian Gifford, M/A-COM, Inc.

January 2001 doc. : IEEE 802. 15 -01/055 r 0 Sponsor Ballot Comments "something"delimited file or e-mail script? • Hi, Ian, • • Sorry for the delay in responding: I was out on vacation. As each ballot/comment is received by the system, the balloter/commenter and the workinggroup chair receive a copy of the ballot/comment by e-mail. There is a CC option that can be enabled, allowing copies to be sent to others (or to a list) as well. This should allow you to get a quick jump on issues. Once the ballot starts, you'll see what data is being sent. If, during the balloting period, you can send me an ordered list of the fields you track, I can work a program up to send you a "something"-delimited file at the end of the balloting period with all the comments or ballots included. Or, ideally, whoever maintains the database at your end could write the script that takes the desired info from each e-mail and imports it into the database as the ballot proceeds. Walter __ Walter Pienciak Manager of Electronic Information, IEEE Standards Association w. pienciak@ieee. org http: //standards. ieee. org/people/w. pienciak/ +1 303 527 0934 P. O. Box 3780, Boulder, CO 80307 -3780 • • Submission 19 Ian Gifford, M/A-COM, Inc.

January 2001 doc. : IEEE 802. 15 -01/055 r 0 TG 1 Summary - Baseline • • • ~Jun 97 - Idea for standard Mar 98 - Find Sponsor Feb 99 - Submit PAR Mar 99 - Approve PAR Jul 99 - Organize working group Sep 99 - Develop draft standard Nov 99 - Ballot draft standard Mar 00 - Approve draft standard Dec 00 - Publish approved standard (or sooner) Submission 20 Ian Gifford, M/A-COM, Inc.

January 2001 doc. : IEEE 802. 15 -01/055 r 0 Overview of IEEE Stds Process • Project Approval • Develop Draft Standards • Ballot Draft • IEEE-SA Standards Board Approval • Publish Standard • Related Programs • Resources Submission 21 Ian Gifford, M/A-COM, Inc.

January 2001 doc. : IEEE 802. 15 -01/055 r 0 PAR Process • • Identify a Sponsor Request Information Kit Complete PAR Submit to Nes. Com PAR Complete Reviewed by Nes. Com Approved? Draft Std Dev. Continues Submission 22 Ian Gifford, M/A-COM, Inc.

January 2001 doc. : IEEE 802. 15 -01/055 r 0 Draft Process • Chair Appointed by Sponsor • PAR Approved • Form WG • Establish Deadline & Schedule • Draft Doc Reviewed • Changes? • Ballot Submission 23 Ian Gifford, M/A-COM, Inc.

January 2001 doc. : IEEE 802. 15 -01/055 r 0 WG Balloting Process - old Submission 24 Ian Gifford, M/A-COM, Inc.

January 2001 doc. : IEEE 802. 15 -01/055 r 0 WG Balloting Process - new • Complete Draft • Circulate Draft to obtain WG LB approval • LB • TG Meets to resolve all comments & Written confirmation to change vote • New unresolved Nays – Yes, WG Confirmation LB – No, Technicals? • Proceed to Sponsor Ballot Submission 25 Ian Gifford, M/A-COM, Inc.

January 2001 doc. : IEEE 802. 15 -01/055 r 0 Sponsor Balloting Process • Complete WG Draft • Circulate Draft to obtain WG approval for Sponsor Ballot • SB • TG Meets to resolve all comments & Written confirmation to change vote • New unresolved Nays – Yes, WG Confirmation LB – No, Technicals? • Proceed to Stds Board Approval Submission 26 Ian Gifford, M/A-COM, Inc.

January 2001 doc. : IEEE 802. 15 -01/055 r 0 Sponsor Balloting Process (cont) • Form the Balloting Group • Ballot the doc • Obtain 75% • Resolve/Rebuttal Nays • Maintain Min 75%? • Draft Std Approval Process Submission 27 Ian Gifford, M/A-COM, Inc.

January 2001 doc. : IEEE 802. 15 -01/055 r 0 Sponsor Forms a Balloting Group • May issue invitation to ballot – Specifies responsibilities of balloters – Requests classifications (P, U, G) • Sponsor approves balance – Only general interest can be 50% or more – Avoid tricks (subdividing a category) • Once balloting begins, the balloting group remains static – IEEE-SA membership is required – Exception: experts and organization representatives, with the approval of Standards Board Submission 28 Ian Gifford, M/A-COM, Inc.

January 2001 doc. : IEEE 802. 15 -01/055 r 0 Response and Results of Balloting • Response – Need 75% return – Ballot fails with less than 75% return • Results – Need 75% approval – Attempt to resolve negative ballots • No mandate to resolve all ballots • After consensus (75% approval) is reached, establish 60 - or 90 -day deadline for resolution of comments – Recirculate revised draft and comments – Prepare report for Rev. Com • Show evidence of attempts to resolve each negative ballot • Show evidence and results of recirculation Submission 29 Ian Gifford, M/A-COM, Inc.

January 2001 doc. : IEEE 802. 15 -01/055 r 0 Draft Approval Process • Complete Submittal Form • Received by Rev. Com • Submittal Complete? • Approved? • Publish Std Submission 30 Ian Gifford, M/A-COM, Inc.

January 2001 doc. : IEEE 802. 15 -01/055 r 0 How to Complete a Successful Rev. Com Submission • • CONTACT: Rev. Com Secretary, +1 (732) 562 -3806 – Review Committee (Rev. Com) recommends action to the Standards Board Submittal must match information on PAR When is a revised PAR necessary? – Any substantive change, i. e. , scope, title, patented material, or change of working group chair Proof of coordination needed Explanation for – Change of name of coordinating body – Additional coordination Submission 31 Ian Gifford, M/A-COM, Inc.

January 2001 doc. : IEEE 802. 15 -01/055 r 0 Post-Approval and Publication • • • Draft Std Approved Final Edit Prepare for Printing Electronic Form? Print Distribute Submission 32 Ian Gifford, M/A-COM, Inc.

January 2001 doc. : IEEE 802. 15 -01/055 r 0 Post-Approval and Publication • IEEE Project Editor – Does final copy edit of text – Ensures that technical integrity of document is maintained • Formats electronic text into proofs – Committee review – Correction – Publication • Complimentary copies and awards • Some families of standards published as collections Submission 33 Ian Gifford, M/A-COM, Inc.