Research Committee Meeting 19 th July 2018 Committee

Research Committee Meeting 19 th July 2018

Committee Members 1. 3 D Studio Blomberg 2. AMRC 3. Appearition 16. Medtronic 4. Apprentice 17. Mira Labs 5. ARvolution 29. Three Sixty Reality 18. Mobiliya 6. Boeing 30. VA Tech University 19. Mozilla 7. Brainwaive 20. Newport News Shipbuilding 8. Contextere 21. NVIDIA 9. Cross. Com 22. PEREY Research & Consulting (chair) 10. Crunch. Fish 23. Pison Technology 11. EPRI 24. Proceedix 12. Huawei 25. The MTC 13. Kognitiv. Spark 26. Theorem Solutions 13. Lockheed Martin 14. 27. UI Labs (DMDII) Logisti. View 15. Marquette University 28. Wunschsicht

§ As participants in this meeting, we need to be mindful of the constraints of antitrust laws. Antitrust Policy § There shall be no discussions of agreements or concerted actions that may restrain competition. § This prohibition includes the exchange of information concerning pricing, rates, coverages, market practices or any other competitive aspect of an individual company’s operation. § Each participant is obligated to speak up immediately for the purpose of preventing any discussion falling outside these bounds. 3

Agenda Timing Agenda item 5 mins Call to order, agenda, previous minutes and administrivia 35 mins Updates/Status of Current Committee Initiatives • Status of 3 rd AREA-directed research project • Welcome new committee members • Research projects under way in AREA member companies • Call for Success Stories • Best AR Research Practices Task Force • October 4 member research results webinar 5 min 4 th AREA-directed Research Project Status Report 10 min New Topics: Volunteers for two new groups Priorities for 2 nd Half 2018 5 min Next meeting: September 20 @ 8 AM Pacific/11 AM Eastern/4 PM UK/ 5 PM CET/3 AM September 21 Melbourne

3 rd AREA-directed Research Project 5

AREA-directed Projects § AREA members propose research topic(s) and all members vote to choose the project topic § AREA member provides one research manager § Generates materials to be used in Call for Proposals § Coordinates and reviews Cf. P responses § Contract is between research supplier and the AREA § All results shared with all members in good standing 6

AR Safety and Human Factors Assessment § Three deliverables § Framework/Tool § Report about the research § Case Study AREA Member Exclusives § Executing by the MTC (an AREA NCA member) § Program Management (on behalf of the AREA) by PEREY Research & Consulting § Safety Committee will support Research, and vice versa § Completed by ~ early August 2018 7

Project Plan (Milestones Timeline) Deliverable Task/Status Schedule D 1 - Questionnaire/Discussion Guide Complete 29/03/18 D 2/D 3 – Framework Tool and Case Study First Draft 23/05/18 D 2/D 3 – Framework Tool and Case Study Receive feedback 30/05/18 D 3 – Written Report First Draft 30/05/18 21. 06. 18 D 3 – Written Report Receive Feedback 06/06/18 29. 06. 18 D 2/D 3 – Framework Tool and Case Study Final 11/06/18 26. 06. 18 09. 08. 18 D 4 – Written Report Final 14/06/18 06. 07. 18 20. 07. 18

Current Status § Report – Draft has been reviewed by subject matter experts § Framework tool – Final has been reviewed by subject matter experts § Case study – Under development

New Committee Members 10

Growing the Committee • Welcome new AREA members • Three Sixty Reality • VA Tech University

AREA Member Internal Research Projects 12

In-house R&D Activities • What approaches are you using to research AR? • What type of research does your company perform?

Success Stories • EPRI and AREA Research • PLEASE EMAIL LINKS ? CONTENT / VIDEOS to mark@thearea. org 14

Tell Us Your Enterprise AR Success Stories! • Any content (videos, case studies, content, graphics, photographs and any other media) about AR and wearable technology to: • enforce adherence to task procedures, particularly safety procedures (your technology in action) • understand ROI and benefits gained from delivering AR projects (e. g. examples of helping enterprises achieve higher efficiencies or reduced error rates)

Your Content will be Added • AREA • website portal, promoted to the ecosystem (via social media etc) and at conferences attended by the AREA • EPRI • included in an upcoming EPRI reports that thousands of utility decision makers will see. It will be featured in a trade publication, social media publicity campaign and will also serve as the basis for launching funded proposals to our EPRI members

Your Company Gains • You will receive attribution, links back to your company to all contributions and will be seen by thousands of decision makers

AR Research Best Practices Task Force • What to do? • What to avoid? 18

Develop Research Best Practices to be Attributable to Research Committee • Best practices in • • Research Design (Use Cases, part of Digital Readiness) Selection of research partners, vendors and tools Execution Metrics • Outreach/influence current and future research projects • Issue report quarterly or semi-annual • Promote directly to universities, government agencies • Post on AREA blog

Leadership • Peter Orban, Augmate • Sasha Lightbourne, Boeing • Farhad Patel, Huawei

Current Status • Discussion Guide Drafted • • Overview/Background Purpose of the research Questions about current practices Recommendations • Slack Channel for capturing references and sources of research

Can you Contribute? • Do you know subject matter experts (AR researchers)? • Are you a subject matter expert? • Can you compile your AR research methods (or lessons learned) in a document? • What recommendations do you offer (“do’s and “do not’s”)?

AR Research New/Future Directions • Obstacles to address • Possible productive directions 23

Develop Research Recommendations Attributable to AREA Research Committee (1 of 2) • Most urgent enterprise AR obstacles to be addressed • • Technology Business User experience Interoperability/standards • Outreach/influence current and future research projects • Issue report quarterly or semi-annual • Promote directly to universities, government agencies • Post on AREA blog

Develop Research Recommendations Attributable to AREA Research Committee (2 of 2) • Who can/would like to lead this?

AREA Research Thought Leadership Webinars 26

Webinar Series § Purpose: AREA thought leaders sharing/demonstrating best practices by describing/discussing successful projects § Target audiences: basic and applied AR research professionals § Speakers: AREA members § Logistics § Scheduling § Rehearsals 27

Fall 2018 § AREA Members’ Exclusive § Member Research projects § Safety and Human Factors Assessment Report and Framework § Best AR Research Practices Task Force Report § Any suggestions? 28

October 4 th Webinar § Featuring Research Results from § EPRI § Cross. Comm (tbc) § Another? § Members can watch recording on AREA Webinar – members only page of the. AREA. org § https: //www. youtube. com/watch? v=Bdi. EWAq 3 Tv 0&feature=yo utu. be 29

Webinar Promotion § AREA Member Exclusive Webinars § AREA Members mailing list § AREA newsletter § Calendar invitations § Not using social media or the web site 30

4 th AREA-directed Research Project 31

AREA-directed Projects § AREA members propose research topic(s) and all members vote to choose the project topic § AREA member whose topic is selected provides one research manager who must § Draft and manage call for proposals § Coordinate and review responses § Contract is between research supplier and the AREA § Member dues provide all financial support § All results shared with all members in good standing 32

Five AREA-directed Topics Topic Submitting organizations Facilitated User Interactions for Selecting and Manipulating Virtual Models in Augmented Reality Kognitiv. Spark Identification of and Strategies for Overcoming Barriers to AR Adoption in Manufacturing Environments Proceedix & PEREY Research & Consulting How and When to Purchase AR Products and Services EPRI & PEREY Research & Consulting Size and Growth of Enterprise AR Market (2018 -2021) PEREY Research & Consulting Framework for benchmarking optimization software AMRC with Boeing 33

Results of Members’ Vote § Identification of and Strategies for Overcoming Barriers to AR Adoption in Manufacturing Environments § Proceedix & PEREY Research & Consulting 34

Revised Steps and Schedule Date Milestone May 21, 2018 AREA issues call to members to submit their project ideas (via secure page on website) Close of member research topic submission period AREA opens members voting on project ideas AREA members pitching session AREA members voting on project ideas closes AREA Board review/approve Research Committee recommendation AREA publishes call for proposals from research groups (bidders) Deadline for bidders to submit their responses Project awarded to best bidder Project kickoff and start date Preliminary out-brief by project research team Project conclusion and publishing of project results to AREA members June 22, 2018 July 9, 2018 July 16, 2018 July 20, 2018 July 24, 2018 August 10, 2018 August 13, 2018 August 20, 2018 October 30, 2018 mid-Nov 2018

Research Value Task Force 36

Contributing (to) Research Committee Value § Tackle important questions § When/how should previous AREA research be released to the enterprise AR ecosystem? § Develop a new research committee web page § Promote the committee and the members of the group § Provide access for members to upload/share research they come across etc. § Study how the AREA research is being used (or not!) § Write and/or promote posts about AREA Research Value on member blogs (or the AREA blog) 37

Can you provide leadership? § Frame/guide the work (via bulletin board or e-mail) § Solicit volunteers and manage volunteer inputs § Schedule and host task force meetings § Compile and provide results to AREA ED § Report to the Research Committee (5 min monthly) 38

Human Factors Interest Group 39

What is Human Factors for Enterprise AR? ▪ [Maybe one of the first goals is to develop/agree upon a definition? ] ▪ The study (and the best techniques to accommodation) of human morphological, physiological and psychological traits and taking these traits into account when designing the best experiences for enterprise AR ▪ How is Human Factors different from UX, UI and HCI? 40

Scope of the Human Factors Interest Group (1 of 2) ▪ Frame the important questions ▪ What are the most important human factors questions (for AREA members)? ▪ Develop, evaluate and provide feedback and guidance about current principles, research protocols/methods ▪ Create a procedure for collecting, etc. ▪ Share research, anecdotal reports of success and failure in human factors 41

Scope of the Human Factors Interest Group (2 of 2) ▪ Contribute to AREA (and industry) thought leadership on human factors in an enterprise environment by informing/sharing ▪ Design/host webinars (schedule, invite experts, etc. ) ▪ Write and/or promote posts about Human Factors on member blogs (or the AREA blog) 42

Don Shin (Cross. Comm) will serve as co-leader ▪ Frame/guide the work (via bulletin board, Slack or e▪ ▪ mail) Solicit volunteers and moderate/manage participant discussion Schedule and host interest group meetings Compile and provide results to AREA ED Report to the Research Committee (5 min monthly) 43

Can you co-lead? ▪ Do you have skills/domain expertise in human factors research design, quantitative research protocols? ▪ Do you want to contribute to thought leadership in enterprise AR human factors? ▪ Support from new AREA member – Three Sixty Research 44

Want to Participate? ▪ Send message to Don. Shin@crosscomm. com ▪ What’s your area of interest/expertise? ▪ How much time available? 45

Research Committee Goals in 2 nd Half 2018 What are projects on your agenda? • Collaborative projects (Member-directed research)?

Next Meeting • Thursday September 20 2018 8 AM Pacific/11 AM Eastern/4 PM UK/5 PM CET/3 AM Sept 21 Melbourne • 4 th AREA-Directed research project status report • Continuing discussion on committee topics • Putting Fall 2018 plans into motion • Thursday Oct 18 will be during AWE Europe • Should we move to Oct 11 (during EWTS)?