{'fraction_non_alphanumeric': 0.016725352112676055, 'fraction_numerical': 0.002640845070422535, 'mean_word_length': 5.572254335260116, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Noise classification and automatic restoration system using non-local regularization frameworks

ABSTRACT Medical, satellite or microscopic images differ in the imaging techniques used, hence their underlying noise distribution also are different. Most of the restoration methods including regularization models make prior assumptions about the noise to perform an efficient restoration. Here we propose a system that estimates and classifies the noise into different distributions by extracting the relevant features. The system provides information about the noise distribution and then it gets directed into the restoration module where an appropriate regularization method (based on the non-local framework) has been employed to provide an efficient restoration of the data. We have effectively addressed the distortion due to data-dependent noise distributions such as Poisson and Gamma along with data uncorrelated Gaussian noise. The studies have shown a 97.7% accuracy in classifying noise in the test data. Moreover, the system also shows the capability to cater to other popular noise distributions such as Rayleigh, Chi, etc.