{'fraction_non_alphanumeric': 0.012454212454212455, 'fraction_numerical': 0.0, 'mean_word_length': 5.180995475113122, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
An Intelligent System for Digitization and Processing of Historical Arabic Documents

The documentary patrimony deposited in the libraries and archives represents an essential part in the collective memory; it reflects the diversity of languages, peoples and cultures. But such memory is fragile and a part of such patrimony regularly disappears by accident, war or ageing. There exist about three million manuscripts of an Arab or Islamic origin, scattered throughout the world. They are not well preserved, that is why researchers encounter difficulty in consulting them. The digitization of such documents has become an absolute necessity for saving and preserving them for future generations. This paper presents a contribution in the domain of digitization and processing of images of historical documents stored in the Arabic libraries. After being scanned, the raw images obtained undergo a primary pre-processing treatment in order to clean them and restore them; then they go through a second phase of image analysis which consists in segmenting the documents so as to separate out texts and graphics, and in compressing the images so as to reduce their stocking cost and their communication time. All such operations are necessary for the retro conversion of the images of historical documents for the purpose of indexing and hosting them on the internet.