{'fraction_non_alphanumeric': 0.009448818897637795, 'fraction_numerical': 0.008661417322834646, 'mean_word_length': 4.857142857142857, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Natural Language Processing based Rule Based Discourse Analysis of Marathi Text

Indian languages are verb final and morphologically rich. For the present work Marathi language is explored which belongs to Indo Aryan family. The data is collected from the Marathi Balbharati book from standard 1st to 4th. This paper presents challenges of discourse analysis means two or more sentences are linked together which is required for many natural language based applications. Rule based structure is framed to find out the discourse from the dataset. These rules are framed on the basis of the Marathi grammar and world knowledge of the linguistic. With the help of POS tagger identify the tag of each word in the discourse is identified. The discourse anaphora is resolved in various foreign as well as Indian languages but Marathi is one of the languages where the discourse is not resolved uptil now. Discourse means that the some relative sentences or the sub sentences are connected with each-other. An important step in understanding the connected discourse is skill to link the meaning of the successive sentence together. Total 515 discourse sentences are considered here to resolving the anaphora from which 177 are the simple sentence and 338 are the discourse one.