{'fraction_non_alphanumeric': 0.025591810620601407, 'fraction_numerical': 0.0019193857965451055, 'mean_word_length': 5.59915611814346, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Data warehouse designing for Vietnamese textual document-based plagiarism detection system

In this paper, the significance role of data warehouse designing for textual anti-plagiarism system is investigated. The paper covers the central issues of data warehousing modeling including: (1) formulating the data representation, (2) establishing the foundations of storage structure, (3) proposing corresponding architecture allowing to store, update and manage data. Consequently, two levels are considered in this paper to address the above mentioned research axes. First, at a theoretical level, the objective is to introduce novel and practical contributions in the area of textual document-based plagiarism system. The chosen approach is proposed to collect, analysis and store textual dataset. Secondly, at an implementation level, the paper focuses on the platform for processing the data, calling to modeling exhibits promising capabilities such as support for real-time, new sources of data, and self-service capabilities. The real application is performed in Vietnamese text-based document by conducting documents containing final reports/assignments, dissertations of master/Ph.D and research scientific papers applied for the University of Danang. The contribution of the paper is not only provide values to all researchers, educators and students in the university of Danang systems but also be considered as seminal work to develop plagiarism in our further next investigation of building a big-data warehouse severing for a automatic duplicate system.