{'fraction_non_alphanumeric': 0.023172905525846704, 'fraction_numerical': 0.004753416518122401, 'mean_word_length': 5.101449275362318, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Using MODIS with AIRS to develop an operational cloud-cleared radiance product

Today, most Numerical Weather Prediction (NWP) centers are assimilating cloud-free radiances. Radiances from the Atmospheric Infrared Sounder have been directly assimilated in NWP models with modest positive impacts. However, since only 5% percentage of AIRS fields of view (fovs) are cloud-free, only very small amounts of the data in the lower troposphere are assimilated. (Note that channels in the mid-upper stratosphere are always assimilated since they are never contaminated by clouds.) The highest vertical resolving power of AIRS is in the lower troposphere. To further improve forecast skill we must increase the use of channels in the lower troposphere. This can be accomplished by assimilating cloud-cleared radiances, which has a yield of about 50%. Since cloud-cleared radiance may have residual cloud contamination and forecast accuracy is very sensitive to the accuracy of the input observations, a technique has been developed to use the 1 km infrared channels on the Moderate Resolution Imaging Spectroradiometer (MODIS) to quality control the cloud-cleared radiances derived from an array of 3 x 3 high spectral infrared sounder AIRS 14 km fovs. This is accomplished by finding MODIS clear radiances values within the AIRS field of view. The MODIS clear radiances are compared to cloud-cleared AIRS radiances that have been convolved to the MODIS spectral resolution. Our studies have found that the cloud-cleared radiances error statistics are very similar to cloud-free (clear) when MODIS data are used to remove potential outliers in the population of AIRS cloud-cleared radiances.