Interactive Recorder for 3 D Reconstruction with the

Interactive Recorder for 3 D Reconstruction with the Holo. Lens Write an application for the Holo. Lens that provides realtime feedback to the user to enable high quality 3 D reconstruction Description: Goal: The Microsoft Holo. Lens is equipped with a broad range of sensors suitable for 3 D reconstruction purposes, including an IMU, a depth sensor, and an RGB camera and four grayscale cameras. Using these sensors, the Holo. Lens builds and maintains a coarse 3 D model of the world in real-time that can be used by applications on the device. To enable efficient recording and high quality 3 D reconstruction using offline reconstruction algorithms, users should be guided with real-time feedback in terms of coverage and accuracy of the recorded data. This project should extend the existing recorder application based on the Holo. Lens research mode API by augmenting and visualizing the coarse mesh model with uncertainty information in real-time. More specifically, the developed application should colorize the coarse mesh model with coverage and accuracy information deduced from the viewing geometry. This project will have great impact on enabling high quality 3 D reconstruction from the Holo. Lens by guiding the user during the recording process. Requirements / Tools: Preferred: C++/C#/Unity Supervisor: Johannes Schönberger (jsch@inf. ethz. ch) Sudipta Sinha (sudipta. sinha@microsoft. com) Marc Pollefeys (marc. pollefeys@inf. ethz. ch) 3 D Vision, Spring Semester 2018