Approximate Nearest Subspace Search with Applications to Pattern Recognition

Published in IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Minneapolis, 2007

Recommended citation: Ronen Basri, Tal Hassner, and Lihi Zelnik-Manor*. Approximate Nearest Subspace Search with Applications to Pattern Recognition. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Minneapolis, 2007.

Abstract

Linear and affine subspaces are commonly used to describe appearance of objects under different lighting, viewpoint, articulation, and identity. A natural problem arising from their use is - given a query image portion represented as a point in some high dimensional space - find a subspace near to the query. This paper presents an efficient solution to the approximate nearest subspace problem for both linear and affine subspaces. Our method is based on a simple reduction to the problem of nearest point search, and can thus employ tree based search or locality sensitive hashing to find a near subspace. Further speedup may be achieved by using random projections to lower the dimensionality of the problem. We provide theoretical proofs of correctness and error bounds of our construction and demonstrate its capabilities on synthetic and real data. Our experiments demonstrate that an approximate nearest subspace can be located significantly faster than the exact nearest subspace, while at the same time it can find better matches compared to a similar search on points, in the presence of variations due to viewpoint, lighting etc.

Download paper here

Download supplementary material here

BibTeX

Errata: The Yale-Face experiments were run with ANN epsilon value of 10, and not 100 as reported.

Example result - subspaces for image approximation

Approximate nearest patchNearest patchApproximate nearest subspaceNearest subspace
0.6sec27.7sec1.2sec4.2sec

Approximating the intensities of a query image by those of a separate database image (below). Results are presented for approximate nearest patch search, exact patch search, approximate nearest subspace search, and exact nearest subspace search. Please see text for more details.


The image used to produce the patch and subspace databases for the approximation