{'fraction_non_alphanumeric': 0.017921146953405017, 'fraction_numerical': 0.0, 'mean_word_length': 5.647619047619048, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
A distributed digital library architecture incorporating different index styles

The New Zealand Digital Library offers several collections of information over the World Wide Web. Although full-text indexing is the primary access mechanism, musical collections can also be accessed through a novel melody retrieval system. In offering this service over a three-year period, we have had to face many practical challenges in building, maintaining and administering diverse collections of different kinds of information, involving different search and retrieval systems, with different user interfaces. This paper describes the design of the software we have built to support the service. Interface server programs provide a uniform interface between the search engine and the client, irrespective of the nature of the collection. Search engines that embody completely different index styles operate under a single distributed framework-we describe as examples MG (Managing Gigabytes), a full-text retrieval system, and the MR (Melody Retrieval) system. A flexible protocol for communicating between an interface server and a search engine is defined. The resulting architecture simplifies library administration and the creation of new collections by providing a unified framework under which vastly different user interfaces and search engines can co-exist in a distributed computing environment.