{'fraction_non_alphanumeric': 0.018711018711018712, 'fraction_numerical': 0.0, 'mean_word_length': 5.595890410958904, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Spatial-Temporal Multi-Head Attention Networks for Traffic Flow Forecasting

Traffic flow forecasting plays an important role in the intelligent traffic system, which is the basis for traffic control and traffic management. However, due to the complex spatial-temporal dependence, traffic flow forecasting has always been a difficulty in the field of intelligent traffic. In order to select a suitable spatial-temporal forecasting method and solve the problem that recurrent neural architecture is not conducive to parallel computing, we construct a spatial-temporal forecasting model by using multi-head attention models. Use graph attention networks with multi-head attention mechanism to capture spatial features, and use the scaled dot product attention with positional encoding like Transformer to capture temporal features. Experimental results on two real-world datasets demonstrate that the forecasting error of our method is lower than baseline methods.