{'fraction_non_alphanumeric': 0.020497803806734993, 'fraction_numerical': 0.0076866764275256225, 'mean_word_length': 5.225512528473804, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Information Society Technologies (ist) Programme Digital Document Workbench (ddw) V1.0 Demonstration and Test Summary Report Deliverable D9 Executive Summary

Owing to the ongoing integration efforts, successive versions of DDW have been made available for testing and evaluation in the real context of work provided by two partner archives, the Stutthof Museum in Poland and the Moreshet Holocaust Study and Research Center in Israel since September 2003. All through that time DDW has been expanded in terms of its accuracy, implying lower error rate of the OCR output, as well as efficiency, allowing to process documents faster, and to reduce the amount of work spent on correcting the final document content before accepting it to the digital archive (database). The experiments described in this document have been carefully planned, executed and their results evaluated to provide a common base for objective comparison with future versions of DDW and measuring the overall project progress. This document has been written according to the general standard IEEE guideline for test documentation, and its respective sections address all relevant issues concerning the tested product, its environment and test data used. The current status of each DDW component has been detailed in Section 1, with special emphasis on features of that had to be tested during the reported experiments. Steps of the assumed test procedure have been described in Section 2, and an argument has been provided that the procedure can measure objectively advances of DDW beyond current practices of digitizing historical documents in memorial places. In Section 3 a representative set of test cases has been described and explained from the point of view of objectives of the testing procedure. Organizational and legal aspects of test items needed for the test, i.e., executables of DDW components, other tools, and document files are described in Section 4. Incidents, failures and bugs noticed during the experiments are described in Section 5, including their impact on future versions of the DDW toolset and solutions to the problems they may have caused. Comprehensive assessment and evaluation of test results is given is Section 6. Finally, Section 7 wraps-up the last 12 months of DDW toolset development and integration activities in Workpackage 5 with general recommendations for the future, including user site training and commercialization. The Digital Document Life-Cycle (DDLC) development model, supported by DDW involves six phases, specified in detail in Deliverable D6 [5]: 1. Digitization; conversion of a paper document page into its digital (facsimile) image with a digital device like a scanner or camera; 2. Qualification; …