Efficient Localness Transformer for Smart Sensor-Based Energy
  Disaggregation
  Modern smart sensor-based energy management systems leverage non-intrusive
load monitoring (NILM) to predict and optimize appliance load distribution in
real-time. NILM, or energy disaggregation, refers to the decomposition of
electricity usage conditioned on the aggregated power signals (i.e., smart
sensor on the main channel). Based on real-time appliance power prediction
using sensory technology, energy disaggregation has great potential to increase
electricity efficiency and reduce energy expenditure. With the introduction of
transformer models, NILM has achieved significant improvements in predicting
device power readings. Nevertheless, transformers are less efficient due to
O(l^2) complexity w.r.t. sequence length l. Moreover, transformers can fail to
capture local signal patterns in sequence-to-point settings due to the lack of
inductive bias in local context. In this work, we propose an efficient
localness transformer for non-intrusive load monitoring (ELTransformer).
Specifically, we leverage normalization functions and switch the order of
matrix multiplication to approximate self-attention and reduce computational
complexity. Additionally, we introduce localness modeling with sparse local
attention heads and relative position encodings to enhance the model capacity
in extracting short-term local patterns. To the best of our knowledge,
ELTransformer is the first NILM model that addresses computational complexity
and localness modeling in NILM. With extensive experiments and quantitative
analyses, we demonstrate the efficiency and effectiveness of the the proposed
ELTransformer with considerable improvements compared to state-of-the-art
baselines.
