{'fraction_non_alphanumeric': 0.019813519813519812, 'fraction_numerical': 0.0034965034965034965, 'mean_word_length': 5.3161764705882355, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Applying differentiable mutual information to hyperspectral band selection

In this paper, we extend our earlier work by improving a mutual information (MI) based hyperspectral band selection method. Mutual information effectively measures the statistical dependence between two random variables. By modeling ground truth (e.g., a reference map) as one of the two random variables, MI can be used to find the spectral bands that contribute most to image classification. We apply a differentiable rather a histogram-based representation of mutual information to construct the estimated reference map, which results in an automatic solution by gradient searching. Experiments on the AVIRIS 92AV3C data set show that the proposed approach can find the best spectral window, and the bands in this window can be used to construct the reference map satisfactorily.