{'fraction_non_alphanumeric': 0.02040816326530612, 'fraction_numerical': 0.009070294784580499, 'mean_word_length': 5.307142857142857, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 1, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Comparing Statistical Measures for Discovering Emerging Terms in Scopus Publications in the Area of Decision Support in Smart City

Discovery of emerging research topics is an important task for scientists, conference organizers, policymakers, and scientific foundations. The paper aims at comparative analysis of statistical models that can be used for discovering emerging terms in a corpus of documents. Three models are evaluated based on calculation of the $TF*IDF$ and Energy measures. As a case study, a corpus of abstracts of scientific publications related to decision support in smart city is used that was downloaded from Scopus for 2015-2020. The models are compared and directions of future research to improve the results, namely usage of combinations of models, analysis of synonyms, and usage of additional rules for filtering out non-emerging terms, are identified.