{'fraction_non_alphanumeric': 0.02824360105913504, 'fraction_numerical': 0.00706090026478376, 'mean_word_length': 5.19672131147541, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Data Filtering Method based on LSTM for Non-Water-Stressed Baseline Estimation in Real-time Crop Water Stress Monitoring

To determine crop water status and quantify crop’s stress, an indicator called crop water stress index (CWSI) using empirical approach was used. The experiment has been conducted with the purpose of estimating CWSI of a durian tree around durian orchard which is located at Chanthaburi, Thailand. Since real-time recorded dataset was affected by ever-changing environmental conditions, data points became scattered. As a result, by using the correlation between stem water potential and CWSI of the durian tree to evaluate accuracy of calculated CWSI, the correlation coefficient was averagely equal to -0.042. Therefore, this paper proposed a data cleansing framework that included time, irradiance, wind speed, air relative humidity as parameters and implemented long short-term memory (LSTM) to filter the dataset for estimating non-water-stressed baseline. The results show that this framework is able to produce correlation coefficient between stem water potential and CWSI to be averagely equal to -0.650.