 |
    |
Shapecollage: Occlusion-Aware, Example-Based Shape Interpretation
Forrester Cole, Phillip Isola, William T. Freeman, Frédo Durand, and Edward H. Adelson
Massachusetts Institute of Technology, USAfcole@csail.mit.edu
phillipi@csail.mit.edu
billf@csail.mit.edu
fredo@csail.mit.edu
adelson@csail.mit.edu
Abstract. This paper presents an example-based method to interpret a 3D shape from a single image depicting that shape. A major difficulty in applying an example-based approach to shape interpretation is the combinatorial explosion of shape possibilities that occur at occluding contours. Our key technical contribution is a new shape patch representation and corresponding pairwise compatibility terms that allow for flexible matching of overlapping patches, avoiding the combinatorial explosion by allowing patches to explain only the parts of the image they best fit. We infer the best set of localized shape patches over a graph of keypoints at multiple scales to produce a discontinuous shape representation we term a shape collage. To reconstruct a smooth result, we fit a surface to the collage using the predicted confidence of each shape patch. We demonstrate the method on shapes depicted in line drawing, diffuse and glossy shading, and textured styles.
LNCS 7574, p. 665 ff.
lncs@springer.com
© Springer-Verlag Berlin Heidelberg 2012