Bringing Photographs to Life With View Morphing Steve

Bringing Photographs to Life With View Morphing Steve Seitz University of Wisconsin—Madison

Images Are Static • Photographs Lack – Movement — scene is frozen in time – Depth — image is two-dimensional • Can we animate the scene via the image?

Objective: Scene Interaction Via Photos • Scene Viewing – Move virtual camera, view real scene • Scene Interaction – Move objects — cut and paste – Change objects — paint, sculpt – Animate the scene — make things walk, talk

Adding Movement • Original Image Expression Change

Adding Depth • Original Image Perspective Change

Talk Outline • Adding Motion and Depth • View Morphing • Applications • Visualization, photo correction, special effects • Interacting With the Scene • Scene editing via photographs

Photograp h

Virtual Camera Morphed View

• 1. Prewarp • align views

• 1. Prewarp • align views • 2. Morph • move camera

• 1. Prewarp • align views • 2. Morph • move camera • 3. Postwarp • point camera

Features of View Morphing • Provides – A mobile virtual camera – Better image morphs • Requires no prior knowledge – No 3 D shape information – No camera information – No training on other images

Applications: Visualization • User-controlled Virtual Camera – Telepresence — visit a remote scene – Web commerce — product viewing over Internet – Viewing historical sites – Animating paintings

Applications: Photo Correction • Image Postprocessing – Alter image perspective in the lab • Image Databases – Normalize images for better indexing – Simplify face recognition tasks

Original Photographs Corrected Photographs

Applications: Better Image Transitions – Avoid bending and shearing distortions – Shapes do not need to be aligned Image Morph View Morph

The Next Step: Interacting With the Scene • Scene Editing Via Photographs – Move objects — cut and paste – Change objects — paint, warp Scene Painted Photo Propagation Photo

Original Photo

Painted Photo Original Photo Cut Photo

Painted Photo Original Photo New Views of Modified Scene Cut Photo

Conclusions • Photographs Come Alive – Motion, depth added by View Morphing • User-Scene Interaction Via Photos – Still images interactive movies – What kinds of scene changes are possible? – Which modes of interaction are natural?