1	Announcements Project 3 grades out today, write-ups online asap Project 4 extension: Thurs, 11:59pm
2	Multiview stereo Readings S. M. Seitz and C. R. Dyer, Photorealistic Scene Reconstruction by Voxel Coloring, International Journal of Computer Vision, 35(2), 1999, pp. 151-173. http://www.cs.washington.edu/homes/seitz/papers/ijcv99.pdf
3	Choosing the stereo baseline What’s the optimal baseline? Too small: large depth error Too large: difficult search problem
4	The Effect of Baseline on Depth Estimation
5
6
7	Multibaseline Stereo Basic Approach Choose a reference view Use your favorite stereo algorithm BUT replace two-view SSD with SSD over all baselines Limitations Must choose a reference view (bad) Visibility! CMU’s 3D Room Video
8	The visibility problem
9	Volumetric stereo
10	Discrete formulation: Voxel Coloring
11	Complexity and computability
12	Issues Theoretical Questions Identify class of all photo-consistent scenes Practical Questions How do we compute photo-consistent models?
13
14	Reconstruction from Silhouettes (C = 2)
15	Volume intersection Reconstruction Contains the True Scene But is generally not the same In the limit (all views) get visual hull Complement of all lines that don’t intersect S
16	Voxel algorithm for volume intersection Color voxel black if on silhouette in every image for M images, N³ voxels Don’t have to search 2^N³ possible scenes!
17	Properties of Volume Intersection Pros Easy to implement, fast Accelerated via octrees [Szeliski 1993] or interval techniques [Matusik 2000] Cons No concavities Reconstruction is not photo-consistent Requires identification of silhouettes
18
19	Voxel Coloring Approach
20	Depth Ordering: visit occluders first!
21	Panoramic Depth Ordering Cameras oriented in many different directions Planar depth ordering does not apply
22	Panoramic Depth Ordering
23	Panoramic Layering
24	Panoramic Layering
25	Compatible Camera Configurations
26	Calibrated Image Acquisition Calibrated Turntable 360° rotation (21 images)
27	Voxel Coloring Results (Video)
28	Limitations of Depth Ordering A view-independent depth order may not exist
29
30	Space Carving Algorithm Space Carving Algorithm
31	Which shape do you get? The Photo Hull is the UNION of all photo-consistent scenes in V It is a photo-consistent scene reconstruction Tightest possible bound on the true scene
32	Space Carving Algorithm The Basic Algorithm is Unwieldy Complex update procedure Alternative: Multi-Pass Plane Sweep Efficient, can use texture-mapping hardware Converges quickly in practice Easy to implement
33	Multi-Pass Plane Sweep Sweep plane in each of 6 principle directions Consider cameras on only one side of plane Repeat until convergence
34	Multi-Pass Plane Sweep Sweep plane in each of 6 principle directions Consider cameras on only one side of plane Repeat until convergence
35	Multi-Pass Plane Sweep Sweep plane in each of 6 principle directions Consider cameras on only one side of plane Repeat until convergence
36	Multi-Pass Plane Sweep Sweep plane in each of 6 principle directions Consider cameras on only one side of plane Repeat until convergence
37	Multi-Pass Plane Sweep Sweep plane in each of 6 principle directions Consider cameras on only one side of plane Repeat until convergence
38	Multi-Pass Plane Sweep Sweep plane in each of 6 principle directions Consider cameras on only one side of plane Repeat until convergence
39	Space Carving Results: African Violet
40	Space Carving Results: Hand
41	Other Approaches