{'fraction_non_alphanumeric': 0.02072192513368984, 'fraction_numerical': 0.0, 'mean_word_length': 4.91699604743083, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Semi-automatic acquisition translation knowledge from parallel corpora

Translation in most current machine translation systems is based on rules. A crucial problem in such rule-based machine translation is how to acquire the translation knowledge, or called translation rules. Many studies have been conducted for automatic acquisition in the past, but they require a great deal of annotated examples. However, it is difficult to get a large number of annotated examples. In fact, most bilingual texts are not matched in sentences, although matched as the whole text. We describe a semi-automatic process of acquisition of machine translation knowledge from Japanese-Chinese parallel corpora. The process consists of the following three parts. The first part is parallel text alignment, PTA for short. The second part is example analysis and annotation, EAA for short. The third part is construction of the translation rules, CTR for short. The process interacts with a linguist in order to solve problems that the system is unable to solve. This approach is more efficient than the completely automatic approach in the sense that fewer examples are required. We describe the basic idea and the methods of PTA, EAA, and CTR. A prototype system based on the proposed method has been built and some experiments on Japanese-Chinese have been carried out. The results show that once the acquired knowledge is integrated with an MT system, we observe a significant improvement in translation quality.