{'fraction_non_alphanumeric': 0.05215123859191656, 'fraction_numerical': 0.003911342894393742, 'mean_word_length': 4.731343283582089, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Open-Domain Attribute-Value Acquisition from Semi-Structured Texts

This paper proposes an unsupervised method that acquires a set of attribute-value pairs (avps, e.g., ⟨director, W. Wyler⟩) for a given object (e.g., “Ben-Hur”) from semi-structured HTML documents. The objects’ avps are one of the principal components of domain ontologies. We first acquire class attributes that are used by many web authors to describe the objects’ avps. Then, we exploit the acquired class attributes to induce patterns for extracting avps from web pages. Experimental results show that, with our method, at least one set of correct avps are acquired for 67.7% of objects among open-domain class-object pairs whose source documents (web pages) include the objects’ avps in layouts.