{'fraction_non_alphanumeric': 0.026515151515151516, 'fraction_numerical': 0.0, 'mean_word_length': 5.5246913580246915, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Matching Heterogeneous Textual Data Using Spatial Features

An increasing amount of textual data is made available through different medium (e.g., social networks, company, data catalog, etc.). These new resources are highly heterogeneous, thus new methods are needed to extract information. Here, we propose a text matching process based on spatial features and compatible with heterogeneous textual data. Besides being compatible with heterogeneous data, we introduce two contributions. First, to be compared, spatial information is extracted then stored in a dedicated representation: STR, or Spatial Textual Representation. Second, to improve the approximation of the spatial similarity, we propose two transformations to apply on STR. To support our contributions, we evaluate the different aspects of the process using two corpora, including one corpus that is highly heterogeneous. Results obtained on both corpora demonstrate that relevant spatial matches can be obtained between the most similar STRs with an improvement due to STR transformation.