Your basic stereo algorithm
For each epipolar line
   For each pixel in the left image
compare with every pixel on same epipolar line in right image
pick pixel with minimum match cost
Improvement:  match windows
This should look familar...