Geometry 4 Multiview Stereo Introduction to Computer Vision

  • Slides: 25
Download presentation
Geometry 4: Multiview Stereo Introduction to Computer Vision Ronen Basri Weizmann Institute of Science

Geometry 4: Multiview Stereo Introduction to Computer Vision Ronen Basri Weizmann Institute of Science

Material covered • Pinhole camera model, perspective projection • Two view geometry, general case:

Material covered • Pinhole camera model, perspective projection • Two view geometry, general case: • Epipolar geometry, the essential matrix • Camera calibration, the fundamental matrix • Two view geometry, degenerate cases • Homography (planes, camera rotation) • A taste of projective geometry • Stereo vision: 3 D reconstruction from two views • Multi-view geometry, reconstruction through factorization

Structure from motion • Input: • a set of point tracks • Output: •

Structure from motion • Input: • a set of point tracks • Output: • 3 D location of each point (shape) • camera parameters (motion) • Assumptions: • Rigid motion • Orthographic projection (no scale) • Method: SVD factorization (Tomasi & Kanade)

Setup •

Setup •

Objective •

Objective •

Eliminate translation •

Eliminate translation •

Objective (no translation) •

Objective (no translation) •

Measurement matrix •

Measurement matrix •

Transformation and shape matrices •

Transformation and shape matrices •

Objective: matrix notation •

Objective: matrix notation •

TK-Factorization •

TK-Factorization •

TK-Factorization •

TK-Factorization •

TK-Factorization •

TK-Factorization •

TK-Factorization •

TK-Factorization •

TK-Factorization: Summary •

TK-Factorization: Summary •

TK-Factorization: pros and cons • Advantages: • Breaks a difficult, non-linear optimization into simple

TK-Factorization: pros and cons • Advantages: • Breaks a difficult, non-linear optimization into simple optimization steps • Works well with errors • Disadvantage: • Orthographic projection • Requires complete tracks

Factorization with incomplete tracks •

Factorization with incomplete tracks •

Perspective multiview stereo •

Perspective multiview stereo •

Bundle adjustment •

Bundle adjustment •

Bundler (Photo Tourism) (Snavely et al. )

Bundler (Photo Tourism) (Snavely et al. )

Bundler (Photo Tourism) •

Bundler (Photo Tourism) •

Simultaneous solutions •

Simultaneous solutions •

Epipolar relation in global coordinates •

Epipolar relation in global coordinates •

Multiview reconsruction

Multiview reconsruction