{'fraction_non_alphanumeric': 0.013574660633484163, 'fraction_numerical': 0.005429864253393665, 'mean_word_length': 5.9125, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Machine-assisted indexing of scientific research summaries

The Smithsonian Science Information Exchange operates a large interdisciplinary information storage and retrieval system covering current and recently concluded research. It annually collects and indexes more than 100,000 summaries of research projects, and then retrieves selected summaries in response to specific requests for information. With the objective of improving its manual subject indexing effort, the Exchange has developed a computer system which indexes word combinations in each summary according to a Classifying Dictionary, prior to review by its professional staff. The combination creates a man‐machine team which is believed to produce more consistent indexing, quicker and at less cost, while maintaining the scientific quality of current indexing practices. The system differs from some other machine approaches by condensing the multitude of text possibilities into restricted and ordered hierarchies. This article discusses the original aims of the system, its operation and the early experience with its implementation.