Computational Plenoptic Imaging Gordon Wetzstein 1 Ivo Ihrke

  • Slides: 8
Download presentation
Computational Plenoptic Imaging Gordon Wetzstein 1 Ivo Ihrke 2 Douglas Lanman 3 Wolfgang Heidrich

Computational Plenoptic Imaging Gordon Wetzstein 1 Ivo Ihrke 2 Douglas Lanman 3 Wolfgang Heidrich 1 1 University of British Columbia 2 Saarland University 3 MIT Media Lab I. Introduction Eurographics 2011 – State of the Art Report EG 2011 | Computational Plenoptic Imaging STAR | I. Introduction 1

The Mantis Shrimp 3 bands = trinocular vision with each eye! Up to 16

The Mantis Shrimp 3 bands = trinocular vision with each eye! Up to 16 different photoreceptors: • 12 for color (4 UV, visible, IR) • 4 for polarization (linear & circular) EG 2011 | Computational Plenoptic Imaging STAR | I. Introduction 2

Cameras are modeled as one Human Eye webvision. med. utah. edu How would a

Cameras are modeled as one Human Eye webvision. med. utah. edu How would a camera look like if it was modeled as a mantis shrimp eye? [Williams 91] http: //en. wikipedia. org/wiki/Bayer_filter EG 2011 | Computational Plenoptic Imaging STAR | I. Introduction 3

The Plenoptic Function • Ray-based model for light • Includes variations in space, time,

The Plenoptic Function • Ray-based model for light • Includes variations in space, time, wavelength, and directions • Light field is More common angular parameterization EG 2011 | Computational Plenoptic Imaging STAR | I. Introduction [Adelson & Bergen 91] 4

Plenoptic Information Sampled HVS Consumer Video Camera 4 Plenoptic Parameters Sampled (no Vx, y,

Plenoptic Information Sampled HVS Consumer Video Camera 4 Plenoptic Parameters Sampled (no Vx, y, z) 1920 x 1080 (HD) 3, Bayer color filter array continuous, ~30 fps (band-limited) 1 Allan Brooks, EE 421, 2003 EG 2011 | Computational Plenoptic Imaging STAR | I. Introduction 5

Computational Photography and Plenoptic Imaging • CP: computational optics, illumination, probes, reconstruction, image processing,

Computational Photography and Plenoptic Imaging • CP: computational optics, illumination, probes, reconstruction, image processing, sensors, etc. EG 2011 | Computational Plenoptic Imaging STAR | I. Introduction [Raskar & Tumblin] • CPI: joint optical modulation & computational processing of plenoptic dimensions 6

Taxonomy and Overview II. High Dynamic Range Imaging – 10 minutes, Wetzstein III. Spectral

Taxonomy and Overview II. High Dynamic Range Imaging – 10 minutes, Wetzstein III. Spectral Imaging – 10 minutes, Wetzstein IV. Light Field Acquisition – 25 minutes, Lanman V. – 15 minutes, Wetzstein Space & Focal Surfaces VI. Temporal Multiplexing – 10 minutes, Wetzstein VII. Further Light Properties – 10 minutes, Wetzstein VIII. Discussion – 5 minutes, Wetzstein EG 2011 | Computational Plenoptic Imaging STAR | I. Introduction 7

Next: High Dynamic Range Imaging EG 2011 | Computational Plenoptic Imaging STAR | I.

Next: High Dynamic Range Imaging EG 2011 | Computational Plenoptic Imaging STAR | I. Introduction 8