{'fraction_non_alphanumeric': 0.04550499445061043, 'fraction_numerical': 0.0011098779134295228, 'mean_word_length': 5.632352941176471, 'pattern_counts': {'":': 0, '<': 8, '<?xml version=': 0, '>': 8, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Relations between conditional Shannon entropy and expectation of ℓα-norm

The paper examines relationships between the conditional Shannon entropy and the expectation of ℓ<sub>α</sub>-norm for joint probability distributions. More precisely, we investigate the sharp bounds of the expectation of ℓ<sub>α</sub>-norm with a fixed conditional Shannon entropy, and vice versa. As applications of the results, we derive the sharp bounds between the conditional Shannon entropy and several information measures which are determined by the expectation of ℓ<sub>α</sub>-norm, e.g., Arimoto's conditional Rényi entropy and the conditional R-norm information. Moreover, we apply these results to discrete memoryless channels under a uniform input distribution. Then, sharp bounds are obtained for Gallager's reliability functions E<sub>0</sub> with a fixed mutual information under a uniform input distribution.