{'fraction_non_alphanumeric': 0.021709633649932156, 'fraction_numerical': 0.0006784260515603799, 'mean_word_length': 5.357758620689655, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Context-sensitive vocabulary mapping with a spreading activation network

A spreading activation network model is applied to the problem of reconciling heterogeneous indexing (STI index terms and ApJ subject descriptors) in a database of documents in the field of astronomy. Drawing on evidence from a set of co-indexed documents, a 3-layer feed-forward network is constructed. It includes an input term layer (source vocabulary), document layer, and output term layer (target vocabulary). Results of experiments show that the network can uncover both static, term-to-term relationships, and those that depend on the context of a particular document’s indexing. From the static mapping experiment, the asymmetric nature of term mapping is revealed. A visualization tool graphically shows complex term relationships identified by this model. The contextsensitive mapping experiment tests the robustness of the network against the removal of each document node under testing. The performance of the complete network is compared to that of the reduced network. The results imply that mapping is largely dependent on regularities emerging from the entire pattern of connections in the network rather than localist representations. The mapping from specific to general shows better performance than the mapping from general to specific. Several issues related to the model including limitations, application of a learning algorithm, and the generality of the study are discussed.