{'fraction_non_alphanumeric': 0.00849514563106796, 'fraction_numerical': 0.0, 'mean_word_length': 5.6, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Distributed Linear Hashing and Parallel Projection in Main Memory Databases

This paper extends the concepts of the distributed linear hashed main memory file system with the objective of supporting higher level parallel dambase operations. The basic distributed linear hashing technique provides a high speed hash based dynamic file system on a NUMA atchitecture multi-processor system. Distributed linear hashing has been extended to include the ability to perform high speed parallel scans of the hashed file. The fast scan feature provides load balancing to compensate for uneven distributions of records and uneven processing speed among different processors. These extensions are used to implement a parallel projection capability. The performance of distributed linear hashing and parallel projection is investigated.