{'fraction_non_alphanumeric': 0.02779291553133515, 'fraction_numerical': 0.016893732970027248, 'mean_word_length': 5.628158844765343, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Hyperspectral reflectance models for soil salt content by filtering methods and waveband selection

Abstract For improving the understanding of interactions between hyperspectral reflectance and soil salinity, in situ hyperspectral inversion of soil salt content at a depth of 0-10 cm was conducted in Hetao Irrigation District, Inner Mongolia, China. Six filtering methods were used to preprocess soil reflectance data, and waveband selection combined by VIP (variable importance in projection) and b-coefficients (regression coefficients of model) was also applied to simplify model. Then statistical methods of partial least square regression (PLS) and orthogonal projection to latent structures (OPLS) were processed to establish the inversion models. Our findings indicate that the selected sensitive wavebands for the 6 filtering methods are different, among which the multiplicative signal correction (MSC) and standard normal variate methods (SNV) have some similar sensitive wavebands with unfiltered data. Derivatives (DF1 and DF2) could characterize sensitive wavebands along the scale of VNIR (350-1100 nm), especially the second derivative (DF2). The sensitive wavebands for continuum-removed reflectance method (CR) have protruded many narrow absorption features. For orthogonal signal correction method (OSC), the selected wavebands are centralized in the range of 565-1013 nm. The calibration and evaluation processes have demonstrated the second order derivate filtering method (DF2) combined with waveband selection is superior to other processes, for it has high R2 (larger than 0.7) both in PLS and OPLS models for calibration and evaluation, by choosing only 156 wavebands from the whole 700 wavebands. Meanwhile, OPLS method was considered to be more suitable for the analyzing than PLS in most of our situations.