SIFT

SIFT Features and
Its Applications

Autostitch Demo

Autostitch

1. Solve for homography

1. Solve for homography

1. Solve for homography

2. Find connected sets of images

2. Find connected sets of images

2. Find connected sets of images

3. Solve for camera parameters

3. Solve for camera parameters

4. Blending the panorama

2-band Blending

Linear Blending

2-band Blending

So, what is SIFT?

Example: object recognition

SIFT properties

SIFT algorithm overview

1. Feature detection

1. Feature detection

1. Feature detection

1. Feature detection

1. Feature detection

2. Feature description

2. Feature description

2. Feature description

Performance: stability to noise

Performance:
stability to affine change

Performance: distinctiveness

3. Feature matching

3. Feature matching

3. Feature matching

3. Feature matching

3. Feature matching

3. Feature matching

3. Feature matching

3. Feature matching

Planar recognition

Planar recognition

3D object recognition

3D object recognition

Recognition under occlusion

Illumination invariance

Applications of SIFT

Location recognition

Robot Localization

Map continuously built over time

Locations of map features in 3D

Slide 51

The Office of the Past

Unify physical and
electronic desktops

Unify physical and
electronic desktops

Example input video

Demo – Remote desktop

System overview

System overview

System overview

System overview

System overview

System overview

System overview

System overview

Assumptions

Assumptions

Non-assumptions

Non-assumptions

Algorithm overview

Algorithm overview

Algorithm overview

Algorithm overview

Algorithm overview

Algorithm overview

Document tracking example

Document tracking example

Document tracking example

Document tracking example

Document tracking example

Document tracking example

Document tracking example

Document tracking example

Document tracking example

Document tracking example

Document Recognition

Document Recognition

Document Recognition

Document Recognition

Results

Demo – Paper tracking

Photo sorting example

Photo sorting example

Demo – Photo sorting

Future work

Summary

References