{'fraction_non_alphanumeric': 0.016515276630883566, 'fraction_numerical': 0.0, 'mean_word_length': 5.481283422459893, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Hyperspectral band selection with similarity assessment

Hyperspectral band selection extracts several bands of importance in some sense by taking advantage of high spectral correlation. Driven by detection or classification accuracy, one would expect that using a subset of original bands the accuracy is unchanged or tolerably degraded while computational burden is significantly relaxed. When the desired object information is known, i.e., supervised band selection, this task can be achieved by finding the bands that contain the most information about these objects. When the desired object information is unknown, i.e., unsupervised band selection, the objective is to select the most distinctive and informative bands. It is expected that these bands can provide an overall satisfactory detection and classification performance. We propose an unsupervised band selection algorithm based on band similarity measurement, which can yield a better result in terms of information conservation and class separability than other widely used techniques. We also extend this algorithm to the case when the desired object information is known. The experimental result shows the effectiveness of this new algorithm.