{'fraction_non_alphanumeric': 0.01020408163265306, 'fraction_numerical': 0.0014577259475218659, 'mean_word_length': 5.245454545454545, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Threshold Selection for Line Detection Algorithms

Local operators are used to detect linear features in Landsat data for an area where such features are typically less than 1 pixel in width. A modification to existing techniques is made which gives improved results. The choice of threshold for the detector algorithm is investigated by considering line and background intensity, linewidths, and line alignment with respect to the pixel boundaries and spatial autocorrelation in the data set. It is found that results will always contain a significant amount of noise. Two postprocessing techniques are described which reduce this noise by utilizing contextual information in the data.