A Theory of Local Matching: SIFT and Beyond
  Why has SIFT been so successful? Why its extension, DSP-SIFT, can further
improve SIFT? Is there a theory that can explain both? How can such theory
benefit real applications? Can it suggest new algorithms with reduced
computational complexity or new descriptors with better accuracy for matching?
We construct a general theory of local descriptors for visual matching. Our
theory relies on concepts in energy minimization and heat diffusion. We show
that SIFT and DSP-SIFT approximate the solution the theory suggests. In
particular, DSP-SIFT gives a better approximation to the theoretical solution;
justifying why DSP-SIFT outperforms SIFT. Using the developed theory, we derive
new descriptors that have fewer parameters and are potentially better in
handling affine deformations.
