{'fraction_non_alphanumeric': 0.03335860500379075, 'fraction_numerical': 0.0, 'mean_word_length': 5.439024390243903, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
A Comparative Study Of Co-Occurrence Strategies for Building A Cross-Domain Sentiment Thesaurus

With the evolution of user-based web content, people naturally and freely share their opinion in numerous domains. However, this would result in a massive cost to label training data for many domains and prevent us from taking advantage of the shared information across-domains. As a result, cross-domain sentiment analysis is a challenging NLP task due to feature and polarity divergence. To build a sentiment sensitive thesaurus that to group different features that express the same sentiments for cross-domain sentiment classification, different co-occurrence measures are used. This paper presents a comparative study covering different co-occurrence methods for building a cross-domain sentiment thesaurus. This work also defines a Bidirectional Conditional Probability (BCP) to handle the unsymmetrical co-occurrence problem. Two machine learning classifiers (Naïve Bayes (NB) and Support Vector Machine (SVM)) and three feature selection methods (Information gain, Odd ratio, Chi-square) are used to evaluate the proposed model. Experimental results show that BCP results outperform four baseline co-occurrence calculation methods (PMI, PMI-square, EMI, and G-means) in the task of cross-domain sentiment analysis.