Stereo Matching

Stereo Matching

Face modeling

Z-keying: mix live and synthetic

Virtualized RealityTM

View Interpolation

More view interpolation

Video view interpolation

Slide 9

View Morphing

Additional applications?

Stereo Matching

Stereo Matching

Outline (remainder of lecture)

Stereo: epipolar geometry

Stereo: epipolar geometry

Rectification

Rectification

Rectification

Matching criteria

Finding correspondences

Image registration (revisited)

Neighborhood size

Stereo: certainty modeling

Plane Sweep Stereo

Plane Sweep Stereo

Plane sweep stereo

Stereo matching framework

Stereo matching framework

Stereo matching framework

Traditional Stereo Matching

Feature-based stereo

Data interpolation

Energy minimization

Relaxation

Relaxation

Dynamic programming

Dynamic programming

Dynamic programming

Dynamic programming

Dynamic programming

Graph cuts

Graph cuts

Graph cuts

Bayesian inference

Markov Random Field

Measurement model

MAP estimate

Why Bayesian estimation?

Depth Map Results

Traditional stereo

Multi-View Stereo

Stereo Reconstruction

Choosing the Baseline

Effect of Baseline on  Estimation

Slide 56

Multibaseline Stereo

Epipolar-Plane Images [Bolles 87]

Volumetric Stereo

Voxel Coloring

Slide 61

Reconstruction from Silhouettes

Volume Intersection

Voxel Volume Intersection

Properties of Volume Intersection

Slide 66

Voxel Coloring Approach

Depth Ordering:  visit occluders first!

Compatible Camera Configurations

Calibrated Image Acquisition

Voxel Coloring Results (Video)

Slide 72

Space Carving Algorithm

Space Carving Algorithm

Multi-Pass Plane Sweep

Results:  African Violet

Results:  Hand

Other Approaches

Summary

Bibliography

Bibliography

Bibliography