{'fraction_non_alphanumeric': 0.019789734075448363, 'fraction_numerical': 0.004947433518862091, 'mean_word_length': 5.037313432835821, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Mining Semantic Time Period Similarity in Spatio-Temporal Climate Data

Over the last decade, advances in high performance computing and remote sensing have produced a vast amount of spatio-temporal data. One area that this data explosion is most prevalent is climate science. With this in mind, there is an increasing need to characterize large spatio-temporal datasets. One such characterization is to find periods of time that exhibit the same spatio-temporal pattern. The focus of this research is to find similar spatio-temporal patterns for semantic time periods. A semantic time period could be any arbitrary division in time such as year, month, or week. The proposed approach first characterizes the data spatially by using one of three approaches including local entropy, local spatial autocorrelation, and local distance-based outliers, to identify interesting spatial features in the dataset. Then, a location/time period matrix which is analogous to a term/document matrix in natural language processing is created to capture the spatial features for a given semantic time period. This matrix contains a count of for each spatial location, the number of times that it is a feature of interest during a semantic time period. Then using latent semantic analysis, the cosine similarity for each semantic time period is calculated. The results are then clustered using affinity propagation. The results show that the similarity matrix produced by distance-based outliers creates the best clustering. The approach is demonstrated on a modeled global climate dataset where we clustered years from 1948 to 2012.