Image-Based Rendering

Today’s lecture

Today’s lecture

Readings

Readings

Readings

Lightfields and Lumigraphs

Modeling light

Computer Graphics

Computer Vision

Combined

But, vision technology falls short

… and so does graphics.

Image Based Rendering

Ray

All Rays

Line

Ray

Image

Panoramic Mosaics

Image

Object

Object

Slide 24

Object

Lumigraph / Lightfield

Slide 27

Lumigraph

Lumigraph - Organization

Slide 30

Slide 31

Slide 32

Slide 33

Slide 34

Slide 35

Lumigraph - Rendering

Slide 37

Lumigraph - Rendering

Lumigraph - Rendering

Lumigraph - Rendering

Lumigraph - Rendering

Lumigraph - Ray Space

Lumigraph - Ray Space

Lumigraph - Demo

Complex Light Field acquisition

Unstructured Lumigraph

Surface Light Fields

Surface Light Fields

3D Representations

3D Lumigraph

3D Lumigraph

Concentric Mosaics

Concentric Mosaics

Concentric Mosaics

Slide 55

Slide 56

2.5D Representations

Layered Depth Image

Slide 59

Slide 60

Sprites with Depth

Environment matting
and compositing

Environment Matting

Environment Matting - examples

Environment Matting

Acquisition setup

Environment matting equation

Environment matting - result

Environment matting extensions

Image-Based Modeling

Image Based Models

Image-Based Modeling

Façade

View-dependent texture mapping

Model-based stereo

Image-Based Faces

Hierarchy of Light Fields [Levoy]

Graphics/Imaging Continuum

What lies beyond
Image-Based Rendering?

Video-Based Rendering

VBR Examples

Facial animation

Matting and Compositing

Slide 84

Video Matting

Video Matting

Shadow Matting

Shadow Matting

Shadow Matting

Shadow Matting

Video Textures

Video Textures

Video Textures

Region-based analysis

Crossfading and morphing

Video portrait

Dynamic scene element

Interactive fish

A complete animation

Video-Based Tours

Video-Based Walkthroughs

Surround video acquisition system

OmniCam

Acquisition platforms

Demo
A Virtual Home Tour

Open issues

Summary

Summary