{'fraction_non_alphanumeric': 0.024390243902439025, 'fraction_numerical': 0.0, 'mean_word_length': 4.822695035460993, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
DAS: Deep Autoencoder with Scoring Neural Network for Anomaly Detection

Many anomaly detection methods are unsupervised e.g. they only utilize the non-anomalous data for model training. Data points that deviate from the majority of the pattern are deemed as anomalies. However, in many cases, anomaly labels are available which can help to guide the model learning for anomaly detection. We introduce an end-to-end anomaly score learning model composed of an autoencoder and a scoring neural network, which assigns an anomaly score to a given data point according to its level of abnormality. We jointly optimize the reconstruction loss and anomaly score function in an end-to-end manner. Experimental results on multiple datasets show that the proposed method appears to be superior over many state-of-the-art methods.