{'fraction_non_alphanumeric': 0.02596053997923157, 'fraction_numerical': 0.004153686396677051, 'mean_word_length': 5.300653594771242, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Text Classification Method Based On Semi-Supervised Transfer Learning

Semi-supervised transfer learning is an effective technique to improve the performance of few-shot learning. In order to solve the difficulty of obtaining a large amount of labeled data, this paper proposes a text classification method based on semi-supervised transfer learning (TC_SSTL). TC_SSTL makes full use of readily available unlabeled data to assist the model in learning text features through its underlying information. Firstly, TC_SSTL uses data augmentation on unlabeled data. Then augmented data, unlabeled data and labeled data are sent into the pre-training model together, using pseudo-label technology to conduct semi-supervised training on the unlabeled data and augmented data. At the same time, the pre-training model is fine-tuned using discriminative fine-tuning. On short text classification task, TC_SSTL can achieve the best performance using only 1000 labeled data.