{'fraction_non_alphanumeric': 0.01890359168241966, 'fraction_numerical': 0.003780718336483932, 'mean_word_length': 5.051428571428572, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
An Active Learning Approach to Task Adaptation

An active learning approach is proposed to automatically analyze speech recognition tasks and select particularly useful adaptation data. In this approach, the distribution of task data is ﬁrst estimated, which is a combination of two distributions based on N-best recognition results and low conﬁdence data. After that, a subset of adaptation data is selected in two stages using a greedy algorithm according to the estimated distribution. Low conﬁdence data are ﬁrstly selected and manually labeled. Then, the high conﬁdence data are selected based on the top-best recognition results, which are also used as labels for the adaptation. The experimental results of the subsequent task adaptation show that the proposed active learning approach can effectively select the useful data to improve the overall performance of the system. The word accuracy is close to, and even exceed, the performance of supervised adaptation using all of the data, when only 10%-20% of the total data need to be manually labeled.