PLEASE VIEW IN SLIDE SHOW MODE TO ACTIVATE

3 D Challenges Pre-Viewer n 2 X equipment & signals + Additional personnel n

3 D Viewer Challenges n Limited 3 DTV penetration n n cost, batteries, maintenance

What Is 3 D? n Motion n n Sound n n earring or blood?

Theory of Two-Lens Stereoscopy screen 3 D = height, width, depth acquisition Mark Schubin,

Other 3 Stereo Dimensions pupillary distance screen size ~ 3 cm to 30 m

Infinite Distance* n n n Normal: parallel views Reduced: converging views Expanded: diverging views

IBC 2010 Best Paper Award “Does Size Matter? ” NDS authors http: //www. nds.

Vergence-Accommodation Conflict from Prof. Martin Banks, Visual Space Perception Lab University of California –

Countering V-A Conflict In-Three “ 3 D in the Home” http: //www. in-three. com/3

Miniaturization 2 D left-eye right-eye view Image position relatively easy to change; image content

Ghosting (Crosstalk) n n n Glasses Display Synchronization Viewing Angle Orientation Inability to fuse

Spatial Resolution Mark Schubin, 3 D Stereo MEDIA, Liege, 2010 December 9 photos by

Anaglyph Challenges n n Inexpensive glasses Any TV Any color TV distribution Full resolution

Why Not Anaglyph? even inexpensive glasses pass & reject as desired but displays don’t

Cue Significance S. Nagata, 1991 Mark Schubin, 3 D Stereo MEDIA, Liege, 2010 December

The Elusive Grail Can there be a 3 D system with n no ghosting

Alternatives to Twin-Lens 3 D n Less Than Fully Stereoscopic n n 2 D-to-3

Chromostereopsis n Eye lens focuses one color n n red seems in front of

Pulfrich Illusion n One eye darkened dark eye sees what was n clear eye

View Shifting n n n “Wiggle-Vision” 3 D for the one-eyed Constant motion if

Less Than Full Stereoscopy in Use enhanced chromostereopsis (Chroma. Depth) – VH 1 Pulfrich

Virtual-Camera S 3 D Imec above, BBC Research White Paper 180 similar Mark Schubin,

Origins of Stereoscopy n 1833 Wheatstone n n 1849 Brewster n n adjustable distance

“Binauricular Auduition” compared to stereoscope The Other Stereo A-B Stereo (Spaced Omnis) distance >>human

“Single-Source” Stereo X-Y, M-S, Dummy Head “coincident stereo” techniques Mark Schubin, 3 D Stereo

Narrow-Separation Listening Embracing. Sound speaker system Philips HTS 7140 3 D Blu-ray home theatre

Visual Stereoacuity 10 arcsecond stereoacuity ~ 1/6 of a pixel at “optimum” (6/6, 20/20)

Limited Stereopsis reference: Canon XJ 22 x 7. 3 compact studio lens 165 mm

3 ality Demo at 2010 DCS photo by Mark Forman http: //screeningroom. com/ Mark

n n Microstereopsis Term coined by Mel Siegel, Robotics Institute, Carnegie Mellon University, and

Microstereopsis 1979: D. O. T. S. NL (Beiser US; 1970: Songer) Nine TV Sydney

Microstereopsis Successfully broadcast n Patents have expired n One ordinary lens/position* n Single-camera/position* n

More at Schubin. Cafe. com Thanks to All-Mobile Video for 3 D production and

Slides: 36

Download presentation

PLEASE VIEW IN SLIDE SHOW MODE TO ACTIVATE AUDIO Some Aspects of 3 D… in Depth! Single-Source Stereo and Microstereoscopic 3 D Mark Schubin, Schubin. Cafe. com Mark Schubin, 3 D Stereo MEDIA, Liege, 2010 December 9 1

3 D Challenges Pre-Viewer n 2 X equipment & signals + Additional personnel n n n convergence per pair stereographer Additional processing n n Pace rig correct, match, format Graphics z-axis depth Distribution resolution Monitoring challenges Mark Schubin, 3 D Stereo MEDIA, Liege, 2010 December 9 Sony brochures 2 NEP SS-3 D (6 of 16 seats) n

3 D Viewer Challenges n Limited 3 DTV penetration n n cost, batteries, maintenance Compatibility w/2 D viewing n n Pace. Fujinon Shadow Glasses n n need for separate coverage? need for 2 D glasses? Sony 3 DTV at CES 2009 Perceptual conflicts n n stereovisual-vestibular distance-based Mark Schubin, 3 D Stereo MEDIA, Liege, 2010 December 9 3 “simulator sickness” 3

What Is 3 D? n Motion n n Sound n n earring or blood? 3 D n n Mark Schubin, 3 D Stereo MEDIA, Liege, 2010 December 9 red dress? army green? HD n n what’s she saying? Color n n what just happened? depth information? or just depth sensation? 4

Theory of Two-Lens Stereoscopy screen 3 D = height, width, depth acquisition Mark Schubin, 3 D Stereo MEDIA, Liege, 2010 December 9 presentation 5

Other 3 Stereo Dimensions pupillary distance screen size ~ 3 cm to 30 m viewing distance 40 -80 mm (down to 5 -year-olds) vast range of vergence-based distance for same 3 D master Mark Schubin, 3 D Stereo MEDIA, Liege, 2010 December 9 6

Infinite Distance* n n n Normal: parallel views Reduced: converging views Expanded: diverging views not normal! *in visual terms, “infinite distance” starts at as little as 6 m Mark Schubin, 3 D Stereo MEDIA, Liege, 2010 December 9 7

IBC 2010 Best Paper Award “Does Size Matter? ” NDS authors http: //www. nds. com/pdfs/3 DTV-Does. Size. Matter_IBC 2010 Award. pdf Mark Schubin, 3 D Stereo MEDIA, Liege, 2010 December 9 8

Vergence-Accommodation Conflict from Prof. Martin Banks, Visual Space Perception Lab University of California – Berkeley 3. 2 meters (10. 5 feet) ok to +∞ Mark Schubin, 3 D Stereo MEDIA, Liege, 2010 December 9 9

Countering V-A Conflict In-Three “ 3 D in the Home” http: //www. in-three. com/3 Dinthe. Homev 2. html Mark Schubin, 3 D Stereo MEDIA, Liege, 2010 December 9 10

Miniaturization 2 D left-eye right-eye view Image position relatively easy to change; image content much harder to change Elan Valley Miniature (tilt-shift technique based on blur) http: //www. flickr. com/photos/frosted_peppercorn/481102393/ Mark Schubin, 3 D Stereo MEDIA, Liege, 2010 December 9 11

Ghosting (Crosstalk) n n n Glasses Display Synchronization Viewing Angle Orientation Inability to fuse shot through active-shutter glasses for Gizmodo 3 DTV review http: //gizmodo. com/5501900/the-best-3 dtv-samsung-un 55 c 7000 -vs-panasonic-tc+p 50 vt 20 Mark Schubin, 3 D Stereo MEDIA, Liege, 2010 December 9 12

Spatial Resolution Mark Schubin, 3 D Stereo MEDIA, Liege, 2010 December 9 photos by Peter Fasciano 13

Anaglyph Challenges n n Inexpensive glasses Any TV Any color TV distribution Full resolution But n n n Strong ghosting Poor color rendition Eye rivalry Light loss Display adjustment Mark Schubin, 3 D Stereo MEDIA, Liege, 2010 December 9 Trio. Scopics Color. Code 3 -D 14

Why Not Anaglyph? even inexpensive glasses pass & reject as desired but displays don’t match Ghosting in Anaglyphic Stereoscopic Images Andrew J. Woods & Tegan Rourke Centre for Marine Science & Technology, Curtin University of Technology http: //cmst. curtin. edu. au/local/docs/pubs/2004 -08. pdf Mark Schubin, 3 D Stereo MEDIA, Liege, 2010 December 9 15

Cue Significance S. Nagata, 1991 Mark Schubin, 3 D Stereo MEDIA, Liege, 2010 December 9 J. Cutting & P. Vishton, 1995 16

The Elusive Grail Can there be a 3 D system with n no ghosting n no V-A conflict or shrinking n 2 D-viewer compatibility n no extra personnel n one lens & camera/position n one signal path/recording n full resolution n inexpensive glasses n for all TVs & distribution? Mark Schubin, 3 D Stereo MEDIA, Liege, 2010 December 9 17

Alternatives to Twin-Lens 3 D n Less Than Fully Stereoscopic n n 2 D-to-3 D Conversion n n frame-by-frame, auto+assist, live Virtual 3 D Cameras n n e. g. , choromostereoscopic, Pulfrich second VC per position Single-Lens Stereoscopic n Sony TDG, ISee 3 D, etc. Mark Schubin, 3 D Stereo MEDIA, Liege, 2010 December 9 BBC R&D White Paper 180 ISee 3 D shuttering 18

Chromostereopsis n Eye lens focuses one color n n red seems in front of blue Real-world often matches front: people, animals back: green trees, blue skies n easy animation n n Chroma. Depth glasses n prism-based color shift portion of Apparatus to Talk to Aliens, Akiyoshi Kitaoka, Ritsumeikan U. Mark Schubin, 3 D Stereo MEDIA, Liege, 2010 December 9 19

Pulfrich Illusion n One eye darkened dark eye sees what was n clear eye sees what is n n Choreography crucial n n carousel ideal Rolling Stones Steel Wheels tour – good Super Bowl half-time – bad Mark Schubin, 3 D Stereo MEDIA, Liege, 2010 December 9 20

View Shifting n n n “Wiggle-Vision” 3 D for the one-eyed Constant motion if not subtle, annoying n if subtle, near invisible n n V 3 iris-shifting lens adaptor widely used, very subtle n see for yourself: http: //www. inv 3. com/examples_section. html n Mark Schubin, 3 D Stereo MEDIA, Liege, 2010 December 9 21

Less Than Full Stereoscopy in Use enhanced chromostereopsis (Chroma. Depth) – VH 1 Pulfrich - Discovery New York Times, April 22, 1980 Mark Schubin, 3 D Stereo MEDIA, Liege, 2010 December 9 microstereopsis – Nine TV Sydney (Trio. Scopics shown) 22 viewshift – CBS

Virtual-Camera S 3 D Imec above, BBC Research White Paper 180 similar Mark Schubin, 3 D Stereo MEDIA, Liege, 2010 December 9 23

Origins of Stereoscopy n 1833 Wheatstone n n 1849 Brewster n n adjustable distance lenticular (lensed) 1851 Holmes n adjustable prismatic lenticular Mark Schubin, 3 D Stereo MEDIA, Liege, 2010 December 9 24

“Binauricular Auduition” compared to stereoscope The Other Stereo A-B Stereo (Spaced Omnis) distance >>human head width n n n Scientific American, December 31, 1881 Mark Schubin, 3 D Stereo MEDIA, Liege, 2010 December 9 BIG sensation difference Unnatural Poor mono compatibility remember “ping-pong” stereo? 25

“Single-Source” Stereo X-Y, M-S, Dummy Head “coincident stereo” techniques Mark Schubin, 3 D Stereo MEDIA, Liege, 2010 December 9 consumer, too 26

Narrow-Separation Listening Embracing. Sound speaker system Philips HTS 7140 3 D Blu-ray home theatre with surround-sound bar common professional Wohler stereo monitoring Mark Schubin, 3 D Stereo MEDIA, Liege, 2010 December 9 27

Visual Stereoacuity 10 arcsecond stereoacuity ~ 1/6 of a pixel at “optimum” (6/6, 20/20) viewing angle “Stereoacuity at Distance and Near, ” Wong, Woods, & Peli http: //www. eri. harvard. edu/faculty/peli/posters/optometry/AAO 2000_poster. pdf Binocular Vision and Stereopsis, Howard & Rogers, 1996 Mark Schubin, 3 D Stereo MEDIA, Liege, 2010 December 9 28

Limited Stereopsis reference: Canon XJ 22 x 7. 3 compact studio lens 165 mm wide box Panasonic VW-CLT 1 3 D conversion lens (outer width 58 mm) DXG-321 much narrower than pupillary distance Canon 3 D lens, shown on XL 1 Hammacher. Schlemmer Mark Schubin, 3 D Stereo MEDIA, Liege, 2010 December 9 lens adaptor Sharp 3 D module 29

3 ality Demo at 2010 DCS photo by Mark Forman http: //screeningroom. com/ Mark Schubin, 3 D Stereo MEDIA, Liege, 2010 December 9 30

n n Microstereopsis Term coined by Mel Siegel, Robotics Institute, Carnegie Mellon University, and co-authors of papers “Kinder Gentler Stereo, ” and “Just Enough Reality: Comfortable 3 D Viewing via Microstereopsis” (Proc. SPIE, 1999) Intended as a solution to “simulator sickness” Concept much older (as will be seen) Not likely to be confused with microstereoscopy, term used for 3 D microscopy Mark Schubin, 3 D Stereo MEDIA, Liege, 2010 December 9 31

Microstereopsis 1979: D. O. T. S. NL (Beiser US; 1970: Songer) Nine TV Sydney Sony Technology Development Group CES 2009 no-glasses 2 D-compatible (no double images) ISee 3 D alternate-shuttered version Mark Schubin, 3 D Stereo MEDIA, Liege, 2010 December 9 § in focus: normal § too close: LG, RM § too far: LM, RG § one camera 32

Microstereopsis Successfully broadcast n Patents have expired n One ordinary lens/position* n Single-camera/position* n 3 D display ok for 2 D viewing n Ghosting not an issue n V-A conflict not an issue * depends somewhat on system n Mark Schubin, 3 D Stereo MEDIA, Liege, 2010 December 9 33

More at Schubin. Cafe. com Thanks to All-Mobile Video for 3 D production and transmission facilities Mark Schubin, 3 D Stereo MEDIA, Liege, 2010 December 9 36