{'fraction_non_alphanumeric': 0.019241341396371632, 'fraction_numerical': 0.0005497526113249038, 'mean_word_length': 5.254295532646048, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
A New Algorithm for Robust Estimation of the Signal Subspace in Hyperspectral Images in the Presence of Rare Signal Components

This paper deals with the problem of signal subspace estimation for dimensionality reduction (DR) in hyperspectral images in the presence of rare pixels, i.e., pixels that are scarcely represented in the image and containing spectral components that are linearly independent of the background. Most of the classical methods proposed in the literature are based on the analysis of second-order statistics (SOS), which are weakly influenced by the rare signals. Therefore, such techniques estimate the signal subspace addressing mostly the background and ignoring the presence of rare pixels. This may reduce the target/background spectral contrast, thus decreasing the detection performance when DR is adopted as preprocessing task in small-target detection applications. In this paper, a new robust algorithm, namely, robust signal subspace estimation (RSSE), is developed, which preserves both abundant and rare signal components. It combines the analysis of SOS and a recent approach based on the analysis of the l 2 infin norm. The novel contribution of this paper is twofold. First, the RSSE algorithm is presented, which includes a new iterative procedure to derive the signal subspace and an original statistical method to estimate the data dimensionality. Second, an ad hoc simulation strategy is proposed to assess the performance of signal subspace estimation methods in the presence of rare signal components. The procedure is adopted to compare the RSSE algorithm with a classical technique based on the analysis of SOS. The results obtained by applying the two methods on a real Airborne Visible Infrared Imaging Spectrometer hyperspectral image are also presented and discussed.