{'fraction_non_alphanumeric': 0.01645021645021645, 'fraction_numerical': 0.0017316017316017316, 'mean_word_length': 5.08421052631579, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Determining the skeletons of the auroras

The auroral emissions observed in the high-latitude regions encircling the magnetic poles are a key element in studying plasma physical processes in the near-Earth space, the magnetosphere. The Finnish Meteorological Institute operates five digital all-sky cameras, which routinely monitor the auroral emissions in Northern Finland, Sweden, and Svalbard; each camera records an image of the full sky at 20 second intervals. In this paper, we develop a method that allows us to examine such a large data set by classifying the images through determining the shape skeletons of the auroral forms in each auroral image. Shape skeletons are a commonly used representation of object shapes in machine vision applications. Once determined, shape skeletons have the advantage that they can also be used to represent noisy or unevenly distributed data. Here we apply a skeletonising algorithm to determine the skeletons of auroras in a noisy environment. The algorithm is based on a batch mode self-organising map. The results can be further improved by implementing understanding of the auroral physics to the algorithm.