{'fraction_non_alphanumeric': 0.013727560718057022, 'fraction_numerical': 0.0, 'mean_word_length': 5.2368421052631575, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Storage design of Marine ship inspection data based on cloud platform

With the development of cloud platform technology, the storage mode of Marine ship inspection data is gradually shifting from offline to online. The massive files generated by ship inspection are mainly small files, and it is difficult to cope with the application of the traditional storage mode. This paper introduces the basic architecture of Marine inspection system based on cloud platform, analyzes the fault tolerance of Hadoop framework and HDFS, and analyzes the characteristics of Marine inspection data. Aiming at the two problems of Hadoop's excessive storage of NameNode memory when storing such massive data, and the low efficiency of file reading and writing, the traditional HDFS storage process was optimized, and a storage and retrieval scheme for small files in Marine ship inspection was proposed. The rationality of the scheme was verified by experiments.