ICG Appendix 2 VR Headset Ming Ouhyoung It

  • Slides: 32
Download presentation
ICG Appendix 2: VR Headset 歐陽明 教授 Ming Ouhyoung

ICG Appendix 2: VR Headset 歐陽明 教授 Ming Ouhyoung

It seems that VR/AR is just going through the Cambrian explosion! (寒武紀大爆發) ¡ Google

It seems that VR/AR is just going through the Cambrian explosion! (寒武紀大爆發) ¡ Google glass (failed product) ¡ Oculus Rift/Rift 2 (purchased by Facebook) ¡ Google Cardboard VR project ¡ Microsoft Holo. Lens project all these happened in 2014/2015!

Extremely cheap HMD: US$6 -20

Extremely cheap HMD: US$6 -20

Half a million sold in one week! (December 16, 2014 news) ¡ Less than

Half a million sold in one week! (December 16, 2014 news) ¡ Less than a week after going on sale and dropping rather quietly on an unsuspecting America, Project Cardboard has rocketed past the 500, 000 sales mark. Such is the popularity of the DIY virtual reality toy that Google has even built and launched a dedicated area of the Play Store for apps created for or ideally suited for use with the unusual piece of facewear.

Why so popular? ¡ “The growth of mobile, and the acceleration of open platforms

Why so popular? ¡ “The growth of mobile, and the acceleration of open platforms like Android make it an especially exciting time for VR, ” beamed Andrew Nartker, project manager for Google Cardboard.

30 years from UNC HMD: much cheaper! (Display, Sensors) Polhemus position/orientation sensor: US$2000, 25

30 years from UNC HMD: much cheaper! (Display, Sensors) Polhemus position/orientation sensor: US$2000, 25 years ago. Display: LCD TV screens: US$400 per set, and need 2 of them!

Exploring Virtual Worlds With Head. Mounted Displays ¡ James C Chung, Mark R Harris,

Exploring Virtual Worlds With Head. Mounted Displays ¡ James C Chung, Mark R Harris, Fredrick P Brooks, Henry Fuchs, Michael T Kelley, John Hughes, Ming Ouh-Young, Clement Cheung, Richard L Holloway, Michael Pique ¡ PP. 42 -52 ¡ OE/LASE'89, 15 -20 Jan. , Los Angeles. CA, 1989 ¡ International Society for Optics and Photonics

Polhemus trackers ¡ Polhemus pioneered the original AC electromagnetic head tracking in the late

Polhemus trackers ¡ Polhemus pioneered the original AC electromagnetic head tracking in the late 1960's and has advanced the technology in tracking excellence ever since. ¡ full six-degrees-of-freedom (6 DOF) motion tracking ¡ Our latest head/helmet tracker is SCOUT--the world's only 6 DOF self contained head tracker. We are proud to offer our customers the low risk, high minimal cockpit mounted equipment, no line-of-sight limitations and an ultra small lightweight and embeddable helmet sensor. SCOUT is currently in full rate production and is fielded and flying on A-10, F-16, C-130 aircraft. It's the trusted choice for worldclass pilots. ¡

 • [LC 5] Wen-Kae Tsao and Ming Ouhyoung, "An Alternative Approach of Rendering

• [LC 5] Wen-Kae Tsao and Ming Ouhyoung, "An Alternative Approach of Rendering High Quality Imagees for Virtual Environments Using Scanne • [LC 5] Wen-Kae Tsao and Ming Ouhyoung, "An Alternative Approach of Rendering High Quality Imagees for Virtual Environments Using Scan Android Apps For HTC, Samsung, Xiaomi Inc. etc. : best VR Apps, ¡ 1. Cardboard VR app ¡ 2. Cosmic Rollercoaster VR app ¡ 3. Jurassic Dino VR ¡ 4. VR Cinema (just choose a video, and play using this app) ¡ 5. Crazy Swing VR ¡ 6. Rollercoaster VR ¡ 7. Space Terror (need Bluetooth controller to play) ¡ 8. 街景服務 (台大正門, 南美 Machu Picchu, 澳洲昆士蘭 (水底), 印度Taj Mahal, England Westminster Abbey, London, 約旦(馬安省)(Al-Gi) 佩特拉古城, Nabatean Theater, Palace Tomb, Bynantine Church, Spain, Sevilla cathedral, USA California 優勝美地, 爬山過程, 義大 利, 米蘭大教堂)

如何產生 360度 VR 場景? 1. 多張影像拼貼, 如地球儀一樣 2. 兩個或四個魚眼鏡頭拼貼. 3. Wen-Kae Tsao and Ming

如何產生 360度 VR 場景? 1. 多張影像拼貼, 如地球儀一樣 2. 兩個或四個魚眼鏡頭拼貼. 3. Wen-Kae Tsao and Ming Ouhyoung, "An Alternative Approach of Rendering High Quality Imagees for Virtual Environments Using Scanned Images“, Proc. of RAMS'95 (Realtime and Multimedia Systems'95), pp. 71 -78, Taipei, July 1995. 4. 使用影像在虛擬環境中繪製真實場景的方法, MS Thesis, 曹文凱, 84, 國立台灣大學資訊 程系 5. Ding-Yuen Chen, Ming Ouhyoung, "Video. VR: A realtime system for automatically constructing panoramic images from video clips", pp. 140 -143, Proc. IFIP 1998 Workshop on Modelling and Motion Capture Techniques for Virtual Environments (CAPTECH 98),

i. OS Apps ¡ For i. Phone 4, i. Phone 5, i. Phone 6

i. OS Apps ¡ For i. Phone 4, i. Phone 5, i. Phone 6 s, and 6 plus, i. Pad Air, 1. Cardboard VR 2. City Rollercoaster (Best effects, ok) 3. Moorente, (not ok for small stereo) 4. Dive. Zombie 5. Appartment (need additional Bluetooth controller) 6. VR sport (need controller) 7. The Height 8. 街景服務 (台大正門, 南美 Machu Picchu, 澳洲昆士蘭 (水底), 印度 Taj Mahal, England Westminster Abbey, London, 以色列(馬安 省)(Al-Gi) Nabatean Theater, Palace Tomb, Bynantine Church )

3 D Video from Youtube Key word: 3 D trailers for 3 D glasses

3 D Video from Youtube Key word: 3 D trailers for 3 D glasses Example titles: Avatar 3 D Air Racers 3 D (Choose the Google VR logo), real airplane stunt show Samsung 3 D demo Sly cooper (Choose the Google VR logo) Wo. W, World of Warcraft Finding Nimos 3 D (Choose the Google VR logo) , is one good example,

DEMO of hw#1 in my previous course: wth APK files 1. http: //www. cmlab.

DEMO of hw#1 in my previous course: wth APK files 1. http: //www. cmlab. csie. ntu. edu. tw/~ming/images/201 5_VR_Cardboard_VR_DEMO_2/DEMO 1_Labyrinth/ 2. http: //www. cmlab. csie. ntu. edu. tw/~ming/images/201 5_VR_Cardboard_VR_DEMO_2/DEMO 2_Dancing_ Girl/ 3. http: //www. cmlab. csie. ntu. edu. tw/~ming/images/201 5_VR_Cardboard_VR_DEMO_2/DEMO 3_Nightmare /

HMD User Manual (For Android phones and i. Os i. Phone 6 s etc.

HMD User Manual (For Android phones and i. Os i. Phone 6 s etc. ) ¡ You can wear eyeglasses ¡ A movable magnet (ring) at the left side, which is a controller button (sliding down) ¡ For some smartphones, such as from Samsung, place the movable magnet (ring) at the RIGHT side. ¡ Rotate the HMD 90 degrees will sometimes reset the application, such as in “Cardboard VR app”

Influence of the future smartphones, a projection 1. In the past, GPUs in phones

Influence of the future smartphones, a projection 1. In the past, GPUs in phones are not really important, VIDEO codes are more important! (Flicker, Youtube Inc. ) 2. Now, heterogeneous systems (CPU+GPU) are increasingly important, a must! (VR, AR) 3. New sensors (position sensor, roll sensor) needed, probably as additional NFC/Bluetooth devices. 4. Higher resolution (toward 4 x by 4 k x 2)

Definition of Roll, Pitch, Raw

Definition of Roll, Pitch, Raw

More choices: Gear VR by Oculus and from HTC! (US$199. ),

More choices: Gear VR by Oculus and from HTC! (US$199. ),

Spec. 96˚ Field of View Sensor: Accelerator, Gyrometer, Geomagnetic, Proximity Motion to Photon Latency:

Spec. 96˚ Field of View Sensor: Accelerator, Gyrometer, Geomagnetic, Proximity Motion to Photon Latency: < 20 ms Focal Adjustment: Covers Nearsighted / Farsighted Eyes Interpupillary Distance Coverage 55 ~ 71 mm

Gear VR with Samsung Galaxy Note 4 Display: 5. 7 inch (143. 9 mm)

Gear VR with Samsung Galaxy Note 4 Display: 5. 7 inch (143. 9 mm) Quad HD Super AMOLED (2560× 1440) Physical User Interface Touch Pad, Back Button, Volume Key Audio: 3 D Spatial Sound on Samsung VR Player for VR Gallery contents (Earphone needed)

HTC VIVE HMD ¡ Vive has a refresh rate of 90 Hz, ¡ two

HTC VIVE HMD ¡ Vive has a refresh rate of 90 Hz, ¡ two screens, one per eye, each having a resolution of 2160 x 1200. [6] ¡ uses more than 70 sensors including a MEMS gyroscope, accelerometer and laser position sensors, and is said to operate in a 15 feet by 15 feet (4. 5 by 4. 5 meters) tracking space if used with a passive "Lighthouse" base station (x 2)

Oculus Rift 2 vs. HTC Vive Pre Oculus Rift HTC Vive Display Resolution Refresh

Oculus Rift 2 vs. HTC Vive Pre Oculus Rift HTC Vive Display Resolution Refresh Rate Platform Field of view OLED 2160 x 1200 90 Hz Oculus Home Steam. VR 110 degrees Tracking area Built-in audio TBA 15 x 15 feet Yes Promised, not yet available Built-in mic Yes TBA Controller Oculus Touch, Xbox One Steam. VR controller, controller any PC compatible gamepad Accelerometer, gyroscope, laser magnetometer, 360 position sensor, frontdegree positional tracking facing camera Sensors

Acer VR Headset: 210 -degree field of view: Swedish game developer Starbreeze AB. The

Acer VR Headset: 210 -degree field of view: Swedish game developer Starbreeze AB. The headset, called Star. VR Dual 5. 5" Quad HD Panel

5 K-resolution Star. VR headset ¡ IMAX wants moviegoers to be able to "step

5 K-resolution Star. VR headset ¡ IMAX wants moviegoers to be able to "step into the movie" using Star. VR headsets in an adjacent room after watching movies in IMAX.

What is the best resolution in display? ¡ For example, for mobile device display:

What is the best resolution in display? ¡ For example, for mobile device display: For Google Cardboard VR HMD, if the field of view (angle) is 60 degrees, the required screen resolution is around 5700 x 5700, As in Oculus Gear VR, or HTC Vive, the filed of view is 90 degrees or above, the required resolution should be 10 Kx 10 K ! (Because in visual acuity: eye’s ability to distinguish two points of light is limited to 1. 5 – 2. 0 mm at a distance of 10 meters. (or 2 microns on the retina)).

Higher display resolution and same latency: means more dizziness ¡ Found by Professor Henry

Higher display resolution and same latency: means more dizziness ¡ Found by Professor Henry Duh (University of Tasmania) (杜本麟). ¡ Observation: when our head rotates fast, the scene to hour eye gets blurred. Not the case in VR headset, thus more dizziness.

Google’s Daydream project ¡ Daydream requires these three pillars in order to be a

Google’s Daydream project ¡ Daydream requires these three pillars in order to be a viable VR option: smartphones that are optimized for VR, with a high quality system on chip (So. C) to maintain 60 framesper-second playback, low persistence displays to eliminate ghosting and lag, and finally, top-notch sensors that operate with minimal latency to boost the sense of presence.

應用與機會: new sensors, form factors for HMD ¡ 機會: App 軟體微型創業, new type game

應用與機會: new sensors, form factors for HMD ¡ 機會: App 軟體微型創業, new type game pad with joystick using USB, position sensors, camera-based tracking device (using Church’s algorithm etc. ) ¡

END

END

AR + VR ¡ Microsoft Inc. Holo. Lens Project, Windows 10, Holographics Live Demo

AR + VR ¡ Microsoft Inc. Holo. Lens Project, Windows 10, Holographics Live Demo ¡ https: //www. youtube. com/watch? v=k. CMx. Bw -ut. EY&feature=youtu. be ¡ https: //www. youtube. com/watch? v=vs. KMi 13 77 c. U

Holo. Lens Project

Holo. Lens Project

Technology reverse engineering (by Yu-shuan Huang) It is an optical seethrough AR, but not

Technology reverse engineering (by Yu-shuan Huang) It is an optical seethrough AR, but not really Holography Very similar to Google Glass and Epson Moverio