Deep Discriminative Representation Learning with Attention Map for Scene
  Classification
  Learning powerful discriminative features for remote sensing image scene
classification is a challenging computer vision problem. In the past, most
classification approaches were based on handcrafted features. However, most
recent approaches to remote sensing scene classification are based on
Convolutional Neural Networks (CNNs). The de facto practice when learning these
CNN models is only to use original RGB patches as input with training performed
on large amounts of labeled data (ImageNet). In this paper, we show class
activation map (CAM) encoded CNN models, codenamed DDRL-AM, trained using
original RGB patches and attention map based class information provide
complementary information to the standard RGB deep models. To the best of our
knowledge, we are the first to investigate attention information encoded CNNs.
Additionally, to enhance the discriminability, we further employ a recently
developed object function called "center loss," which has proved to be very
useful in face recognition. Finally, our framework provides attention guidance
to the model in an end-to-end fashion. Extensive experiments on two benchmark
datasets show that our approach matches or exceeds the performance of other
methods.
