Announcements
Final
Monday 10:30-12:20, in this room
Closed book/notes
Comprehensive (through today)
Review today
Project 3 artifacts
Evals
at end of class

Modeling Texture
What is texture?
How can we model it?

Markov Chains
Markov Chain
a sequence of random variables
      is the state of the model at time t
Markov assumption:  each state is dependent only on the previous one
dependency given by a conditional probability:
The above is actually a first-order Markov chain
An N’th-order Markov chain:

Markov Chain Example:  Text
“A dog is a man’s best friend. It’s a dog eat dog world out there.”

Text synthesis
Create plausible looking poetry, love letters, term papers, etc.
Most basic algorithm
Build probability histogram
find all blocks of N consecutive words/letters in training documents
compute probability of occurance
Given words
compute          by sampling from
Example on board...

[Scientific American, June 1989, Dewdney]
“I Spent an Interesting Evening Recently with a Grain of Salt”
                     - Mark V. Shaney
(computer-generated contributor to UseNet News group called net.singles)

Modeling Texture
What is texture?
An image obeying some statistical properties
Similar structures repeated over and over again
Often has some degree of randomness

Markov Random Field

Texture Synthesis [Efros & Leung, ICCV 99]
Can apply 2D version of text synthesis

Synthesizing One Pixel
What is                                                                           ?
Find all the windows in the image that match the neighborhood
consider only pixels in the neighborhood that are already filled in
To synthesize x
pick one matching window at random
assign x to be the center pixel of that window

Really Synthesizing One Pixel

Growing Texture

Window Size Controls Regularity

More Synthesis Results

More Results

Failure Cases

Image-Based Text Synthesis

Applications of Texture Modeling
Super-resolution
Freeman & Pasztor, 1999
Baker & Kanade, 2000
Image/video compression
Video Textures
Wei & Levoy, 2000
Schodl et al., 2000
Texture recognition, segmentation
DeBonet
Restoration
removing scratches, holes, filtering
Zhu et al.
Art/entertainment