{'fraction_non_alphanumeric': 0.02720527617477329, 'fraction_numerical': 0.0, 'mean_word_length': 5.290155440414508, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Automatic Generation of Multilingual Lexicon by Using Wordnet

A lexicon is the heart of any language processing system. Accurate words with grammatical and semantic attributes are essential or highly desirable for any application- be it machine translation, information extraction, various forms of tagging or text mining. However, good quality lexicons are difficult to construct requiring enormous amount of time and manpower. In this paper, we present a method for automatically generating multilingual Universal Word (UW) dictionaries (for English, Hindi and Marathi) from an input document- making use of English, Hindi and Marathi WordNets. The dictionary entries are in the form of Universal Words (UWs) which are language words (primarily English) concatenated with disambiguation information. The entries are associ- ated with syntactic and semantic properties- most of which too are generated automatically. In addition to the WordNet, the system uses a word sense disam- biguator, an inferencer and the knowledge base (KB) of the Universal Network- ing Language which is a recently proposed interlingua. The lexicon so con- structed is sufficiently accurate and reduces the manual labor substantially.