HOLOLENS V KUHINJI Introduction to Hololens development Rok

HOLOLENS V KUHINJI Introduction to Hololens development Rok Bermež, Dušan Zupančič

Agenda Overview Holo. Toolkit Spatial Mapping Gestures & Voice Commands Enterprise Integration

Quick Overview Reach us with #ntk 17

Head Related Transfer Function Reach us with #ntk 17

Holo. Toolkit

Fragments Young Conker Reach us with #ntk 17

Holo. Toolkit – Making Life Easyer Reach us with #ntk 17

Holo. Toolkit Features Project Setup Spatial Sharing Scripts Reach us with #ntk 17

Rok Demo - Holo. Toolkit 1. Create a new project 2. Download and add Holo. Toolkit 3. Add 3 D model we will use for the rest of the demos

Spatial Mapping

https: //developer. microsoft. com/en-us/windows/holographic/spatial_mapping Reach us with #ntk 17

Spatial Mapping Usage Reach us with #ntk 17

Rok Demo – Placing the Hologram 1. Use Spatial Mapping to find floor 2. Place 3 D model on the floor 3. Show on Hololenc through Holographic Remoting Player 4. Build & deploy to Hololens

Gestures & Voice Commands

Reach us with #ntk 17

Speech Design • What actions can be taken through speech? • Is speech input a good option for completing a task? • How does a user know when speech input is available? • Is the app always listening? • What phrases initiate an action or behavior? • What is the interaction dialog between app and user? • Is network connectivity required?

Rok Demo – Interaction & Deployment Create door open animation Add gaze cursor Use Airtap to start animation Use „door open“ / „door close“ voice commands

Enterprise Integration

Presentation Layer Connectlife Hololens app Service Layer Business rules & wizards CHP Appliances Connectlife BOT Connectlife API Wizards API Recipe & Menu Database Service agents Connectlife Web site Food storage Hob Guide Connectlife Smart device app 3 rd party applications CHP API Refresh air Etc. Recipes, Menus, Ingredients storage info … Oven Refrigerator Hob Connected Home Platform Hood Etc.

Generalised concept of a wizard App 21 Backend (Connectlife Service)

Connectlife Service Call (in SOAPUI) • Input parameters: • Category: Beef • SAP id: 496124 • Output parameters: • Refrigerator: • • Storage zone Shelf Temperature Duration • Freezer: • • Storage zone Shelf Temperature Duration

Storage zones schema

Demo – Enterprise Integration Dušan

Where to next? Ultimate resource list: http: //chadcarter. net/ultimate-hololens-resource-list/ Holo. Toolkit packages: https: //holotoolkit. download/ Perception simulation: https: //developer. microsoft. com/en-us/windows/mixed-reality/perception_simulation Simplygon: https: //labs. simplygon. com/ Reach us with #ntk 17

Q&A

© Copyright Microsoft Corporation. All rights reserved.