Time Series is a Special Sequence: Forecasting with Sample Convolution
  and Interaction
  Time series is a special type of sequence data, a set of observations
collected at even time intervals and ordered chronologically. Existing deep
learning techniques use generic sequence models (e.g., recurrent neural
network, Transformer model, or temporal convolutional network) for time series
analysis, which ignore some of its unique properties. In particular, three
components characterize time series: trend, seasonality, and irregular
components, and the former two components enable us to perform forecasting with
reasonable accuracy. Other types of sequence data do not have such
characteristics. Motivated by the above, in this paper, we propose a novel
neural network architecture that conducts sample convolution and interaction
for temporal modeling and apply it for the time series forecasting problem,
namely \textbf{SCINet}. Compared to conventional dilated causal convolution
architectures, the proposed downsample-convolve-interact architecture enables
multi-resolution analysis besides expanding the receptive field of the
convolution operation, which facilitates extracting temporal relation features
with enhanced predictability. Experimental results show that SCINet achieves
significant prediction accuracy improvement over existing solutions across
various real-world time series forecasting datasets.
