{'fraction_non_alphanumeric': 0.02367531003382187, 'fraction_numerical': 0.0, 'mean_word_length': 5.184668989547038, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Automated Transient Electromagnetic Data Processing for Ground-Based and Airborne Systems by a Deep Learning Expert System

Modern transient electromagnetic (TEM) surveys, either ground-based or airborne, may yield thousands of line kilometers of data. Parts of these data, especially in areas with dense infrastructure, are often disturbed by electromagnetic couplings due to infrastructure, e.g., power cables and fences. In most cases and in particular when working in a hydro-geological context, such coupled data must be culled before inversion. The process of identifying and culling coupled data is a manual task, requiring specialists to examine and process the data in detail. Manual data processing is subjective, difficult to reproduce, and time-consuming. To automate the complex data processing workflows, we propose an expert system based on a deep convolutional auto-encoder to identify couplings in the data. We configure the auto-encoder to learn an encoded representation of TEM data in a latent space. A reconstruction part that decodes the encoded representation is also trained, aiming to reconstruct input data. If the data unaffected by electromagnetic couplings are observed by the auto-encoder, the reconstructed output will have low error to the input. However, when having couplings in the data, the reconstruction error is elevated, indicating a nongeologic anomaly. The size of the anomaly is based on the relative error between the input data and the reconstructed output normalized by the data standard deviation. We show that the proposed approach displays high-quality data processing within a fraction of a second for a ground-based and an airborne system, which is either ready for inversion or requires minimal further quality inspection.