{'fraction_non_alphanumeric': 0.023960535588442564, 'fraction_numerical': 0.0021141649048625794, 'mean_word_length': 5.69811320754717, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Faulty data detection and classification for bridge structural health monitoring via statistical and deep‐learning approach

Over the last several decades, a lot of bridges have been equipped with the bridge structural health monitoring system, leading to an accumulation of voluminous monitoring data. Since the sensors and associated transmission hardware are subjected to harsh environments, the monitoring data frequently contains various faults, and it is laborious to cleanse the data manually. For the purpose of automatically detecting and classifying faulty monitoring data in large quantities, this paper proposes a novel method that uses the relative frequency distribution histograms (RFDH) of monitoring data as well as the one‐dimensional convolutional neural network (1‐D CNN). The overall procedure of this method can be described as follows: First, RFDHs are constructed from different classes of hour‐long data segments. Second, inverted envelopes of the RFDHs are labeled as the training data to train the 1‐D CNN. Third, a well‐trained 1‐D CNN is used to detect and classify long‐term monitoring data according to their RFDHs of hour‐long data segments. Comprehensive validation of the proposed method is conducted with selective acceleration data collected from two long‐span bridges. The validation yields satisfactory results, demonstrating the accuracy, efficiency, and generality of the method.