{'fraction_non_alphanumeric': 0.024200518582541054, 'fraction_numerical': 0.006050129645635264, 'mean_word_length': 5.50561797752809, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Enhancing Thai Keyphrase Extraction Using Syntactic Relations: An Adoption of Universal Dependencies Framework

Topical phrases representing the document and used in various fields are called keyphrases. Various methods are proposed to extract keyphrases automatically. However, most methods rely on candidate selection using linguistic heuristics in the English language. In this work for Thai keyphrases extraction, the candidate selection based on Universal Dependencies (UD) is proposed rather than using only POS sequence to make this step language independent. To enhance candidate selection, tree-based keyphrases extraction is also adapted to keep only logical candidates based on the cohesiveness index (CI). Besides that, the score filtering is proposed to combine linguistic heuristics, like stop words and the phrase's position. In the experiments, our method gained the double averaged F1 score of the state-of-the-art method, even though the UD was trained by only 1,781 EDUs and achieved 84% labeled attachment score. In addition, ablation studies on each factor in score filtering revealed which factor is important for keyphrase extraction.