Computational Photography and Videography Christian Theobalt and Ivo

Computational Photography and Videography Christian Theobalt and Ivo Ihrke Winter term 09/10

Coordinates § MPI – room 019 § Wednesdays, 14: 00 c. t. § Christian Theobalt – MPI, room 228 – theobalt@mpii. de § Ivo Ihrke – MPI, room 225 – ihrke@mpii. de § Mailing List – seminar-cpav 09@mpi-inf. mpg. de § Web Page – http: //www. mpi-inf. mpg. de/~theobalt/courses/Seminar_WS_2009/ CPAV 09/10 – First Meeting – 2009/10/23

Formal Requirements § Presence required § Read all papers and participate in discussion § One paper is “your paper” and you have to give a 40 -45 minute presentation on it § Prepare a written report on the topic you presented § Grade: talk 50 %, report 50 % CPAV 09/10 – First Meeting – 2009/10/23

Organizational Issues § Register by sending an Email to both of us § Topic assignment – Send list of ordered preferences by Friday (23 rd of Oct. ) – We try to accommodate wishes as well as possible – We send out assignment on Monday, 26 th of Oct. § First topic presentation 2009/11/18 – (10 students) CPAV 09/10 – First Meeting – 2009/10/23

Benefits § Practice one of the most important skills in science – Read and understand papers – Present scientific results § Discussion is essential – If you don’t participate you miss a big chance – Most ideas are developed in discussions about other papers àPrepare the seminar classes ! àBenefit from the interaction in the group ! CPAV 09/10 – First Meeting – 2009/10/23

Organizational Issues § Topics will be covered in the order appearing on the seminar web page § If necessary, and mutually agreed on, dates can be exchanged § Presentations § § 45 min. presenter leads the discussion on the papers All participants are supposed to read the papers Active participation in discussion is expected CPAV 09/10 – First Meeting – 2009/10/23

Organizational Issues § Two scheduled meetings per topic – 1. 3 weeks prior to presentation § Read papers for this meeting § Ask questions if you have difficulties § Discuss plans for presentation – 2. 1 week prior to presentation § prepare a preliminary presentation § We can provide feedback CPAV 09/10 – First Meeting – 2009/10/23

Organizational Issues § one office hour per week – Announced on seminar web page § You can ask questions by e-mail any time CPAV 09/10 – First Meeting – 2009/10/23

Organizational Issues § Report – 6 – 8 pages summary of major ideas of your topic – 2 - 3 pages with your own ideas, e. g. , § Discuss limitations not mentioned in the paper and sketch a solution § Try to suggest improvements § Novel ideas based on content described in the papers § Your ideas can be the result of the discussion after your presentation ! – The idea is that you get a feeling for your specific topic surpassing the level of simply understanding a paper. CPAV 09/10 – First Meeting – 2009/10/23

Organizational Issues § Report – – Due date 2010/02/19 (2 1/2 weeks after last seminar) Pdf by e-mail We provide a La. Te. X-style on the seminar page If you use other software make it look like the La. Te. Xexample CPAV 09/10 – First Meeting – 2009/10/23

Image-Based Rendering Concepts § Adelson & Bergen: The plenoptic function and elements of early vision, Computational Models of Visual Processing 1991 § Levoy & Hanrahan: Light Field Rendering, SIGGRAPH’ 96 CPAV 09/10 – First Meeting – 2009/10/23

Camera Models and Noise § Healy & Kondepudy: Radiometric CCD Calibration and Noise Estimation, PAMI 1994 § Kolb et al. : A Realistic Camera Model for Computer Graphics, SIGGRAPH 1995 CPAV 09/10 – First Meeting – 2009/10/23

Geometric Camera Calibration § Zhang: A flexible new technique for camera calibration, PAMI 2000 § Hartley & Zisserman, Multiple View Geometry in Computer Vision, chapter 5, Cambridge University Press, 2000 CPAV 09/10 – First Meeting – 2009/10/23

Fourier Analysis of Light Fields § Isaksen et al. : Dynamically Reparameterized Light Fields, SIGGRAPH 2000 § Ng: Fourier Slice Photography, SIGGRAPH 2005 CPAV 09/10 – First Meeting – 2009/10/23

Light Field Capture with Non-Refractive Modulators § Veeraraghavan et al: Dappled Photography: Mask. Enhanced Cameras for Heterodyned Light Fields and Coded Aperture Refocusing, SIGGRAPH 2007 § Lanman et al: Shield Fields: Modeling and Capturing 3 D Occluders, SIGGRAPH Asia 2008 CPAV 09/10 – First Meeting – 2009/10/23

Multi-View Basics § Laurentini: The Visual Hull Concept for Silhouette-Based Image Understanding, PAMI 1994 § Matusik et al. : Image-Based Visual Hulls, SIGGRAPH 2000 CPAV 09/10 – First Meeting – 2009/10/23

Multi-view Stereo for Static and Dynamic Scenes § Furukawa et al. , Accurate, Dense, and Robust Multi-view Stereopsis , CVPR 2007 § Zitnick et al. , High-Quality Video View Interpolation Using a Layered Representation, SIGGRAPH 2004 CPAV 09/10 – First Meeting – 2009/10/23

Marker-less Motion Capture § Bregler et al. , tracking people with twists and exponential maps, CVPR 1998 § Balan et al. , detailed human shape and pose from images CPAV 09/10 – First Meeting – 2009/10/23

Marker-less Performance Capture § Vlasic et al. , Articulated Mesh Animation from Multi-view Silhouettes, SIGGRAPH 2008 § De Aguiar et al. , Performance Capture from Sparse Multi -view Video, SIGGRAPH 2008 CPAV 09/10 – First Meeting – 2009/10/23

Video Recinematography § Gleicher et al. , Re-Cinematography: Improving the Camerawork of Casual Video, ACM TOMCCAP § Feng Liu et al. , Content-Preserving Warps for 3 D Video Stabilization, SIGGRAPH 2009 CPAV 09/10 – First Meeting – 2009/10/23

Reconstruction from Community Photo Collections § Snavely et al. , Photo Tourism: Exploring image collections in 3 D, SIGGRAPH 2006 § Goesele et al. , Multi-View Stereo for Community Photo Collections, ICCV 2008 CPAV 09/10 – First Meeting – 2009/10/23

Reconstruction with Time-of-Flight Cameras § Fusion of Time-of-Flight Depth and Stereo for High Accuracy Depth Maps (PDF), Jiejie Zhu, Liang Wang, Ruigang Yang and James Davis, CVPR 2008 § Hebert et al. , 3 d measurements from imaging laser radars: How good are they? , IVC 1992 CPAV 09/10 – First Meeting – 2009/10/23